2024-09-11T23:56:09.975 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T23:56:09.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:56:10.092 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7901828' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKejTcU641875ax++hgU9wM0bKVK0firMrAWRIFSTfFV/WR2vhBWrq6S6LeNmweBTyvvtaFYutF+y3IVHsFGUH0= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHplrWTR+zkU2iT4vUhVIM6+n3kHg/V0xjmvT2sjAP+EvuF1AD4KKllDlTDSUNKrBH/Sj1Tqu2S5W0VHkaMqUk= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T23:56:10.092 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-11T23:56:10.093 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-11T23:56:10.093 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T23:56:10.094 INFO:teuthology.task.internal:Checking packages... 2024-09-11T23:56:10.118 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-11T23:56:10.118 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T23:56:10.118 INFO:teuthology.packaging:ref: None 2024-09-11T23:56:10.118 INFO:teuthology.packaging:tag: None 2024-09-11T23:56:10.118 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-11T23:56:10.118 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-11T23:56:10.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-11T23:56:10.268 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-11T23:56:10.270 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T23:56:10.276 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T23:56:10.276 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T23:56:10.281 INFO:teuthology.task.internal:Saving configuration 2024-09-11T23:56:10.301 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T23:56:10.308 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T23:56:10.342 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:50:39.422571', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBoE1qaH4XU462t5tivg6UyNISo/2P/4ZBZYEVmByl8I'} 2024-09-11T23:56:10.372 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:50:39.420890', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEiuHFMn4QSda+ea4I5SCl5hcmxnthrLjZU4IlIrL7Eq'} 2024-09-11T23:56:10.372 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T23:56:10.379 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-11T23:56:10.379 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T23:56:10.379 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T23:56:10.458 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f56c747bbe0>, signals=[15]) 2024-09-11T23:56:10.458 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T23:56:10.464 INFO:teuthology.task.internal:Opening connections... 2024-09-11T23:56:10.464 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-11T23:56:10.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:56:10.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-09-11T23:56:10.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:56:10.652 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T23:56:10.659 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-11T23:56:10.665 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-11T23:56:10.665 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="22.04" 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=jammy 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T23:56:10.713 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=jammy 2024-09-11T23:56:10.714 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-11T23:56:10.746 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-09-11T23:56:10.753 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-09-11T23:56:10.753 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-09-11T23:56:10.801 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T23:56:10.801 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu" 2024-09-11T23:56:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04" 2024-09-11T23:56:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T23:56:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy 2024-09-11T23:56:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu 2024-09-11T23:56:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian 2024-09-11T23:56:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T23:56:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T23:56:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T23:56:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T23:56:10.802 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy 2024-09-11T23:56:10.802 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-09-11T23:56:10.837 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T23:56:10.846 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T23:56:10.894 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T23:56:10.895 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:56:10.897 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:56:10.902 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T23:56:10.908 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T23:56:10.908 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:56:10.946 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:56:10.960 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T23:56:11.035 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T23:56:11.050 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T23:56:11.050 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T23:56:11.050 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:56:11.051 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:56:11.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:56:11.056 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-11T23:56:11.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:56:11.057 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-09-11T23:56:11.101 INFO:teuthology.orchestra.run.smithi102.stdout:5.15.0-56-generic 2024-09-11T23:56:11.101 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.15.0-56-generic 2024-09-11T23:56:11.102 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2024-09-11T23:56:11.106 INFO:teuthology.orchestra.run.smithi121.stdout:5.15.0-56-generic 2024-09-11T23:56:11.107 INFO:teuthology.task.kernel:Running kernel on smithi121: 5.15.0-56-generic 2024-09-11T23:56:11.107 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get clean 2024-09-11T23:56:11.221 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2024-09-11T23:56:11.265 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-09-11T23:56:11.410 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:56:11.427 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T23:56:11.491 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:56:11.492 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T23:56:11.496 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T23:56:11.525 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T23:56:11.548 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T23:56:11.640 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T23:56:11.771 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T23:56:11.895 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T23:56:11.902 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T23:56:11.916 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T23:56:11.925 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T23:56:11.934 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T23:56:11.978 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T23:56:11.996 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T23:56:12.014 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T23:56:12.038 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T23:56:12.041 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T23:56:12.056 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T23:56:12.092 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T23:56:12.127 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T23:56:12.149 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T23:56:12.167 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T23:56:12.185 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T23:56:12.203 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T23:56:12.215 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T23:56:12.221 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T23:56:12.234 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T23:56:12.260 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T23:56:12.297 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T23:56:12.316 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T23:56:12.334 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T23:56:12.352 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T23:56:12.370 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T23:56:12.387 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T23:56:12.388 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T23:56:12.394 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T23:56:12.399 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T23:56:12.400 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T23:56:12.406 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T23:56:12.407 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T23:56:12.408 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T23:56:12.410 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T23:56:12.424 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T23:56:12.432 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T23:56:12.445 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T23:56:12.446 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T23:56:12.447 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T23:56:12.479 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T23:56:12.520 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T23:56:12.520 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T23:56:12.520 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T23:56:12.521 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T23:56:12.528 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T23:56:12.528 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T23:56:12.531 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T23:56:12.539 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T23:56:12.539 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T23:56:12.540 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T23:56:12.540 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T23:56:12.552 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T23:56:12.554 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T23:56:12.556 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T23:56:12.557 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T23:56:12.557 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T23:56:12.558 INFO:teuthology.orchestra.run.smithi121.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T23:56:12.558 INFO:teuthology.orchestra.run.smithi121.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T23:56:12.559 INFO:teuthology.orchestra.run.smithi121.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T23:56:12.559 INFO:teuthology.orchestra.run.smithi121.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T23:56:12.564 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T23:56:12.591 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T23:56:12.596 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T23:56:12.596 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T23:56:12.597 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T23:56:12.597 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T23:56:12.632 INFO:teuthology.orchestra.run.smithi121.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T23:56:12.632 INFO:teuthology.orchestra.run.smithi121.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T23:56:12.638 INFO:teuthology.orchestra.run.smithi121.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T23:56:12.639 INFO:teuthology.orchestra.run.smithi121.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T23:56:12.640 INFO:teuthology.orchestra.run.smithi121.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T23:56:12.641 INFO:teuthology.orchestra.run.smithi121.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T23:56:12.642 INFO:teuthology.orchestra.run.smithi121.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T23:56:12.642 INFO:teuthology.orchestra.run.smithi121.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T23:56:12.643 INFO:teuthology.orchestra.run.smithi121.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T23:56:12.678 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T23:56:12.721 INFO:teuthology.orchestra.run.smithi121.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T23:56:12.721 INFO:teuthology.orchestra.run.smithi121.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T23:56:18.185 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 15.8 MB in 2s (7,310 kB/s) 2024-09-11T23:56:18.732 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 15.8 MB in 3s (5,882 kB/s) 2024-09-11T23:56:19.557 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-11T23:56:19.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:56:19.635 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-11T23:56:19.844 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-11T23:56:19.845 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-11T23:56:20.018 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:56:20.018 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:56:20.018 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:56:20.019 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:56:20.019 INFO:teuthology.orchestra.run.smithi102.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T23:56:20.019 INFO:teuthology.orchestra.run.smithi102.stdout: python2.7-minimal 2024-09-11T23:56:20.019 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:56:20.020 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-11T23:56:20.020 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:56:20.020 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T23:56:20.021 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T23:56:20.022 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-11T23:56:20.022 INFO:teuthology.orchestra.run.smithi102.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T23:56:20.022 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2024-09-11T23:56:20.022 INFO:teuthology.orchestra.run.smithi102.stdout: thermald 2024-09-11T23:56:20.073 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-11T23:56:20.073 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:56:20.073 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T23:56:20.073 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T23:56:20.074 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2024-09-11T23:56:20.074 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T23:56:20.126 INFO:teuthology.orchestra.run.smithi102.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:56:20.126 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 113 MB of archives. 2024-09-11T23:56:20.126 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T23:56:20.126 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T23:56:20.191 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-11T23:56:20.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:56:20.274 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-11T23:56:20.484 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-09-11T23:56:20.484 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-09-11T23:56:20.554 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T23:56:20.652 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T23:56:20.670 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:56:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:56:20.670 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:56:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:56:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T23:56:20.671 INFO:teuthology.orchestra.run.smithi121.stdout: python2.7-minimal 2024-09-11T23:56:20.671 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:56:20.672 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2024-09-11T23:56:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:56:20.672 INFO:teuthology.orchestra.run.smithi121.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T23:56:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T23:56:20.674 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2024-09-11T23:56:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T23:56:20.674 INFO:teuthology.orchestra.run.smithi121.stdout:Recommended packages: 2024-09-11T23:56:20.674 INFO:teuthology.orchestra.run.smithi121.stdout: thermald 2024-09-11T23:56:20.723 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2024-09-11T23:56:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:56:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T23:56:20.724 INFO:teuthology.orchestra.run.smithi121.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T23:56:20.725 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages will be upgraded: 2024-09-11T23:56:20.725 INFO:teuthology.orchestra.run.smithi121.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T23:56:20.776 INFO:teuthology.orchestra.run.smithi121.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:56:20.776 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 113 MB of archives. 2024-09-11T23:56:20.776 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T23:56:20.776 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T23:56:21.217 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T23:56:21.319 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T23:56:21.480 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T23:56:21.480 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T23:56:21.480 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T23:56:21.601 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T23:56:21.623 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T23:56:22.019 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 113 MB in 2s (73.5 MB/s) 2024-09-11T23:56:22.093 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T23:56:22.094 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T23:56:22.094 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T23:56:22.190 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T23:56:22.216 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T23:56:22.322 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T23:56:22.702 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 113 MB in 2s (71.3 MB/s) 2024-09-11T23:56:22.873 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T23:56:24.299 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T23:56:24.303 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:56:24.413 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:24.853 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T23:56:24.859 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:56:24.928 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:26.739 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T23:56:26.760 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:56:26.842 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:27.037 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T23:56:27.058 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:56:27.146 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:27.375 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T23:56:27.396 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:56:27.512 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:27.574 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T23:56:27.595 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:56:27.624 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:34.233 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:56:34.351 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:56:34.511 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:56:34.613 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:56:34.685 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:56:34.813 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:56:34.905 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:56:35.058 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:56:35.132 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T23:56:35.155 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T23:56:35.199 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:56:35.361 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T23:56:35.384 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T23:56:35.453 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:56:40.996 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T23:56:41.033 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:56:41.071 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:41.244 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T23:56:41.281 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:56:41.319 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:43.668 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:56:43.765 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:56:44.081 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:56:44.203 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:44.329 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T23:56:44.444 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:44.568 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:56:44.691 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:56:45.057 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:56:45.204 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:45.338 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T23:56:45.467 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:45.724 INFO:teuthology.orchestra.run.smithi121.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:56:45.724 INFO:teuthology.orchestra.run.smithi121.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T23:56:45.724 INFO:teuthology.orchestra.run.smithi121.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:56:45.725 INFO:teuthology.orchestra.run.smithi121.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T23:56:45.887 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:46.814 INFO:teuthology.orchestra.run.smithi102.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:56:46.815 INFO:teuthology.orchestra.run.smithi102.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T23:56:46.815 INFO:teuthology.orchestra.run.smithi102.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:56:46.815 INFO:teuthology.orchestra.run.smithi102.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T23:56:47.705 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:47.944 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:49.056 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T23:56:49.191 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T23:56:49.317 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:49.389 INFO:teuthology.orchestra.run.smithi121.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T23:56:49.389 INFO:teuthology.orchestra.run.smithi121.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:56:49.404 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:50.840 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T23:56:50.965 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T23:56:51.108 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:56:51.184 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T23:56:51.184 INFO:teuthology.orchestra.run.smithi102.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:57:04.134 INFO:teuthology.orchestra.run.smithi121.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T23:57:04.135 INFO:teuthology.orchestra.run.smithi121.stdout:Sourcing file `/etc/default/grub' 2024-09-11T23:57:04.155 INFO:teuthology.orchestra.run.smithi121.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:57:04.185 INFO:teuthology.orchestra.run.smithi121.stdout:Generating grub configuration file ... 2024-09-11T23:57:04.471 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:57:04.493 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:57:04.776 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:57:04.782 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:57:04.859 INFO:teuthology.orchestra.run.smithi121.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:57:04.865 INFO:teuthology.orchestra.run.smithi121.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:57:05.014 INFO:teuthology.orchestra.run.smithi121.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:57:05.014 INFO:teuthology.orchestra.run.smithi121.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:57:05.015 INFO:teuthology.orchestra.run.smithi121.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:57:05.048 INFO:teuthology.orchestra.run.smithi121.stdout:done 2024-09-11T23:57:05.539 DEBUG:teuthology.orchestra.run.smithi121:> dpkg -s linux-image-generic 2024-09-11T23:57:05.540 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T23:57:05.540 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub' 2024-09-11T23:57:05.557 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:57:05.561 INFO:teuthology.orchestra.run.smithi121.stdout:Package: linux-image-generic 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Status: install ok installed 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Priority: optional 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Section: kernel 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Installed-Size: 21 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: amd64 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Source: linux-meta 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Version: 5.15.0.119.119 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Recommends: thermald 2024-09-11T23:57:05.562 INFO:teuthology.orchestra.run.smithi121.stdout:Description: Generic Linux kernel image 2024-09-11T23:57:05.563 INFO:teuthology.orchestra.run.smithi121.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:57:05.563 INFO:teuthology.orchestra.run.smithi121.stdout: available. 2024-09-11T23:57:05.563 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T23:57:05.563 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:57:05.563 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:57:05.563 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T23:57:05.563 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:57:05.563 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get clean 2024-09-11T23:57:05.574 INFO:teuthology.orchestra.run.smithi102.stdout:Generating grub configuration file ... 2024-09-11T23:57:05.722 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2024-09-11T23:57:05.845 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:57:05.899 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:57:05.917 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:57:05.967 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:57:06.050 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:57:06.129 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:57:06.234 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:57:06.240 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:57:06.309 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:57:06.315 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:57:06.488 INFO:teuthology.orchestra.run.smithi102.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:57:06.488 INFO:teuthology.orchestra.run.smithi102.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:57:06.488 INFO:teuthology.orchestra.run.smithi102.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:57:06.525 INFO:teuthology.orchestra.run.smithi102.stdout:done 2024-09-11T23:57:06.977 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2024-09-11T23:57:06.992 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 21 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.15.0.119.119 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2024-09-11T23:57:06.993 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:57:06.994 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2024-09-11T23:57:06.994 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T23:57:06.994 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:57:06.994 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:57:06.994 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T23:57:06.994 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:57:06.994 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2024-09-11T23:57:07.145 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-09-11T23:57:07.292 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-11T23:57:07.309 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:57:07.369 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-11T23:57:07.395 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:57:07.396 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:57:07.466 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:57:07.547 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-09-11T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-09-11T23:57:07.759 INFO:teuthology.orchestra.run.smithi121.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T23:57:07.759 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:57:07.759 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:57:07.759 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:57:07.759 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:57:07.759 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:57:07.760 INFO:teuthology.orchestra.run.smithi121.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:57:07.760 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:57:07.799 INFO:teuthology.orchestra.run.smithi121.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:57:07.801 DEBUG:teuthology.orchestra.run.smithi121:> dpkg -s linux-image-generic 2024-09-11T23:57:07.816 INFO:teuthology.orchestra.run.smithi121.stdout:Package: linux-image-generic 2024-09-11T23:57:07.816 INFO:teuthology.orchestra.run.smithi121.stdout:Status: install ok installed 2024-09-11T23:57:07.816 INFO:teuthology.orchestra.run.smithi121.stdout:Priority: optional 2024-09-11T23:57:07.816 INFO:teuthology.orchestra.run.smithi121.stdout:Section: kernel 2024-09-11T23:57:07.816 INFO:teuthology.orchestra.run.smithi121.stdout:Installed-Size: 21 2024-09-11T23:57:07.816 INFO:teuthology.orchestra.run.smithi121.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:57:07.816 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: amd64 2024-09-11T23:57:07.816 INFO:teuthology.orchestra.run.smithi121.stdout:Source: linux-meta 2024-09-11T23:57:07.816 INFO:teuthology.orchestra.run.smithi121.stdout:Version: 5.15.0.119.119 2024-09-11T23:57:07.817 INFO:teuthology.orchestra.run.smithi121.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:57:07.817 INFO:teuthology.orchestra.run.smithi121.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:57:07.817 INFO:teuthology.orchestra.run.smithi121.stdout:Recommends: thermald 2024-09-11T23:57:07.817 INFO:teuthology.orchestra.run.smithi121.stdout:Description: Generic Linux kernel image 2024-09-11T23:57:07.817 INFO:teuthology.orchestra.run.smithi121.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:57:07.817 INFO:teuthology.orchestra.run.smithi121.stdout: available. 2024-09-11T23:57:07.817 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-09-11T23:57:07.865 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.ohbkWnGsMn 2024-09-11T23:57:07.866 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ohbkWnGsMn 2024-09-11T23:57:07.933 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.ohbkWnGsMn 2024-09-11T23:57:08.055 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.ohbkWnGsMn is 10KB 2024-09-11T23:57:08.068 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.ohbkWnGsMn 2024-09-11T23:57:08.073 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T23:57:08.129 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-11T23:57:08.129 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T23:57:08.129 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T23:57:08.196 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T23:57:08.197 DEBUG:teuthology.orchestra.run.smithi121:> sudo update-grub 2024-09-11T23:57:08.818 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-11T23:57:08.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:57:08.897 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-11T23:57:09.107 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-11T23:57:09.107 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-11T23:57:09.287 INFO:teuthology.orchestra.run.smithi102.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T23:57:09.288 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:57:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:57:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:57:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:57:09.288 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:57:09.289 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:57:09.289 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:57:09.330 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:57:09.335 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2024-09-11T23:57:09.353 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 21 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.15.0.119.119 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2024-09-11T23:57:09.354 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:57:09.355 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2024-09-11T23:57:09.355 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-11T23:57:09.375 INFO:teuthology.orchestra.run.smithi121.stderr:Sourcing file `/etc/default/grub' 2024-09-11T23:57:09.375 INFO:teuthology.orchestra.run.smithi121.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:57:09.377 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2024-09-11T23:57:09.411 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.bK2reOiZHL 2024-09-11T23:57:09.412 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub/grub.cfg /tmp/tmp.bK2reOiZHL 2024-09-11T23:57:09.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.bK2reOiZHL 2024-09-11T23:57:09.571 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:57:09.577 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:57:09.647 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.bK2reOiZHL is 10KB 2024-09-11T23:57:09.662 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.bK2reOiZHL 2024-09-11T23:57:09.667 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T23:57:09.722 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T23:57:09.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T23:57:09.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T23:57:09.802 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T23:57:09.802 DEBUG:teuthology.orchestra.run.smithi102:> sudo update-grub 2024-09-11T23:57:09.817 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:57:09.824 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:57:09.865 INFO:teuthology.orchestra.run.smithi121.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:57:09.871 INFO:teuthology.orchestra.run.smithi121.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:57:10.008 INFO:teuthology.orchestra.run.smithi121.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:57:10.008 INFO:teuthology.orchestra.run.smithi121.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:57:10.008 INFO:teuthology.orchestra.run.smithi121.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:57:10.027 INFO:teuthology.orchestra.run.smithi121.stderr:done 2024-09-11T23:57:10.036 DEBUG:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2024-09-11T23:57:11.197 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2024-09-11T23:57:11.198 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:57:11.201 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-11T23:57:11.388 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:57:11.393 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:57:11.673 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:57:11.678 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:57:11.720 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:57:11.725 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:57:11.872 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:57:11.872 INFO:teuthology.orchestra.run.smithi102.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:57:11.872 INFO:teuthology.orchestra.run.smithi102.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:57:11.896 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-11T23:57:11.904 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-09-11T23:57:40.069 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T23:57:40.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-11T23:57:40.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:57:41.909 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T23:57:41.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-11T23:57:41.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:57:58.461 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-09-11T23:58:00.253 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-11T23:58:07.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-11T23:58:07.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:58:09.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-11T23:58:09.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:58:10.557 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-09-11T23:58:12.349 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-11T23:58:22.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-11T23:58:22.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:58:24.352 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-11T23:58:24.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:58:54.233 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-11T23:58:54.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-11T23:58:54.812 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-11T23:58:54.812 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-09-11T23:58:54.858 INFO:teuthology.orchestra.run.smithi121.stdout:5.15.0-119-generic 2024-09-11T23:58:54.858 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T23:58:54.859 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:58:54.859 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T23:58:55.888 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T23:58:55.888 DEBUG:teuthology.orchestra.run.smithi121:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:58:55.948 INFO:teuthology.orchestra.run.smithi121.stdout:ttyS1 2024-09-11T23:58:55.975 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:56.135 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-11T23:58:56.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-11T23:58:56.736 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-11T23:58:56.736 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-11T23:58:56.781 INFO:teuthology.orchestra.run.smithi102.stdout:5.15.0-119-generic 2024-09-11T23:58:56.782 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T23:58:56.782 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:58:56.782 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T23:58:57.783 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T23:58:57.783 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:58:58.139 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-09-11T23:58:58.164 DEBUG:teuthology.parallel:result is None 2024-09-11T23:58:58.164 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T23:58:58.181 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T23:58:58.182 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:58:58.188 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:58:58.194 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T23:58:58.203 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T23:58:58.210 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T23:58:58.211 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:58:58.234 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:58:58.256 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T23:58:58.263 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T23:58:58.263 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:58:58.290 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:58:58.310 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:58:58.318 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:58:58.321 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:58:58.329 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:58:58.331 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T23:58:58.339 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T23:58:58.339 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:58:58.375 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:58:58.390 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T23:58:58.402 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T23:58:58.402 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:58:58.434 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:58:58.441 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:58:58.485 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:58:58.533 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T23:58:58.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:58:58.604 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:58:58.609 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:58:58.658 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-11T23:58:58.658 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:58:58.724 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-11T23:58:58.727 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-09-11T23:58:58.801 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T23:58:58.811 INFO:teuthology.task.internal:Starting timer... 2024-09-11T23:58:58.811 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T23:58:58.826 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T23:58:58.834 DEBUG:teuthology.task.selinux:Excluding smithi102: OS 'ubuntu' does not support SELinux 2024-09-11T23:58:58.834 DEBUG:teuthology.task.selinux:Excluding smithi121: OS 'ubuntu' does not support SELinux 2024-09-11T23:58:58.834 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T23:58:58.834 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-11T23:58:58.834 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T23:58:58.834 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T23:58:58.845 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T23:58:58.860 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T23:58:58.862 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi102.front.sepia.ceph.com,smithi121.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:06:25.903 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com')] 2024-09-12T00:06:25.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-12T00:06:25.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:06:26.020 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-12T00:06:26.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-12T00:06:26.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-12T00:06:26.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:06:26.192 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-12T00:06:26.273 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-12T00:06:26.274 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:06:26.284 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:06:26.284 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:06:26.285 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:06:26.287 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:06:26.287 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:06:26.315 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:06:26.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: Command line: ntpd -gq 2024-09-12T00:06:26.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: ---------------------------------------------------- 2024-09-12T00:06:26.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:06:26.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:06:26.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: corporation. Support and training for ntp-4 are 2024-09-12T00:06:26.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: available at https://www.nwtime.org/support 2024-09-12T00:06:26.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: ---------------------------------------------------- 2024-09-12T00:06:26.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: proto: precision = 0.044 usec (-24) 2024-09-12T00:06:26.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: basedate set to 2022-02-04 2024-09-12T00:06:26.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:06:26.317 INFO:teuthology.orchestra.run.smithi102.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:06:26.317 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:06:26.317 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:06:26.317 INFO:teuthology.orchestra.run.smithi102.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:06:26.318 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:06:26.318 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:06:26.318 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:06:26.318 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: Listen normally on 3 enp3s0f1 172.21.15.102:123 2024-09-12T00:06:26.319 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: Listen normally on 4 lo [::1]:123 2024-09-12T00:06:26.319 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d769%5]:123 2024-09-12T00:06:26.319 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:26 ntpd[18592]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:06:26.340 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:06:26.340 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: Command line: ntpd -gq 2024-09-12T00:06:26.340 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: ---------------------------------------------------- 2024-09-12T00:06:26.340 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:06:26.340 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:06:26.340 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: corporation. Support and training for ntp-4 are 2024-09-12T00:06:26.340 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: available at https://www.nwtime.org/support 2024-09-12T00:06:26.340 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: ---------------------------------------------------- 2024-09-12T00:06:26.340 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: proto: precision = 0.045 usec (-24) 2024-09-12T00:06:26.341 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: basedate set to 2022-02-04 2024-09-12T00:06:26.341 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:06:26.341 INFO:teuthology.orchestra.run.smithi121.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:06:26.342 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:06:26.342 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:06:26.342 INFO:teuthology.orchestra.run.smithi121.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:06:26.343 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:06:26.343 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:06:26.343 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:06:26.343 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: Listen normally on 3 enp3s0f1 172.21.15.121:123 2024-09-12T00:06:26.343 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: Listen normally on 4 lo [::1]:123 2024-09-12T00:06:26.343 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cba3%5]:123 2024-09-12T00:06:26.343 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:26 ntpd[18601]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:06:27.340 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:27 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:27.340 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:27 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:27.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:27 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:27.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:27 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:27.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:27 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:27.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:27 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:27.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:27 ntpd[18601]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:27.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:27 ntpd[18601]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:28.340 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:28 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:28.340 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:28 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:28.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:28 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:28.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:28 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:28.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:28 ntpd[18601]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:28.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:28 ntpd[18601]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:29.317 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:29.317 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:29.317 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:29.317 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:29.317 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:29.318 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:29.318 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:29.318 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:29.318 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:29.318 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:29.318 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:29.318 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:29 ntpd[18592]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:29.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:29 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:29.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:29 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:29.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:29 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:29.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:29 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:29.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:29 ntpd[18601]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:29.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:29 ntpd[18601]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:30.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:30 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:30.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:30 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:30.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:30 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:30.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:30 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:30.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:30 ntpd[18592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:30.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:30 ntpd[18592]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:30.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:30.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:30.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:30.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:30.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:30.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:30.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:30.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:30.342 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:30.342 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:30.342 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:30.342 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:30 ntpd[18601]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:31.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:31.317 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:31 ntpd[18592]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:31.340 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:31 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:31.340 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:31 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:31.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:31 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:31.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:31 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:31.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:31 ntpd[18601]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:31.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:31 ntpd[18601]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:32 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:32 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:32 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:32 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:32 ntpd[18592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:32 ntpd[18592]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:32.342 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:32.342 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:32 ntpd[18601]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:33.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:33.317 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:33.317 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:33 ntpd[18592]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:33.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:33 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:33.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:33 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:33.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:33 ntpd[18601]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:33.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:33 ntpd[18601]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:33.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:33 ntpd[18601]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:33.341 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:33 ntpd[18601]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:33.342 INFO:teuthology.orchestra.run.smithi121.stdout:12 Sep 00:06:33 ntpd[18601]: ntpd: time slew +0.002225 s 2024-09-12T00:06:33.342 INFO:teuthology.orchestra.run.smithi121.stdout:ntpd: time slew +0.002225s 2024-09-12T00:06:33.342 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:33 ntpd[18601]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:06:33.342 INFO:teuthology.orchestra.run.smithi121.stderr:12 Sep 00:06:33 ntpd[18601]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:06:33.393 INFO:teuthology.orchestra.run.smithi121.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:06:33.393 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================== 2024-09-12T00:06:33.393 INFO:teuthology.orchestra.run.smithi121.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:06:33.393 INFO:teuthology.orchestra.run.smithi121.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:06:33.393 INFO:teuthology.orchestra.run.smithi121.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:06:33.393 INFO:teuthology.orchestra.run.smithi121.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:06:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:34 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:34 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:34 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:34 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:34 ntpd[18592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:34 ntpd[18592]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:35.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:35 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:35.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:35 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:35.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:35 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:35.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:35 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:35.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:35 ntpd[18592]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:06:35.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:35 ntpd[18592]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:06:35.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:35 ntpd[18592]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:06:35.315 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:35 ntpd[18592]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:06:35.316 INFO:teuthology.orchestra.run.smithi102.stdout:12 Sep 00:06:35 ntpd[18592]: ntpd: time slew +0.001514 s 2024-09-12T00:06:35.316 INFO:teuthology.orchestra.run.smithi102.stdout:ntpd: time slew +0.001514s 2024-09-12T00:06:35.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:35 ntpd[18592]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:06:35.316 INFO:teuthology.orchestra.run.smithi102.stderr:12 Sep 00:06:35 ntpd[18592]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:06:35.369 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:06:35.369 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2024-09-12T00:06:35.369 INFO:teuthology.orchestra.run.smithi102.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:06:35.369 INFO:teuthology.orchestra.run.smithi102.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:06:35.369 INFO:teuthology.orchestra.run.smithi102.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:06:35.369 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:06:35.369 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:06:35.407 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:06:35.408 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:06:35.408 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:06:35.408 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:06:35.413 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:06:35.413 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:06:35.414 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-key list | grep Ceph 2024-09-12T00:06:35.414 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-key list | grep Ceph 2024-09-12T00:06:35.474 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:06:35.479 INFO:teuthology.orchestra.run.smithi121.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:06:35.502 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:06:35.502 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:06:35.503 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:06:35.503 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:06:35.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:06:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:06:35.517 INFO:teuthology.orchestra.run.smithi121.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:06:35.517 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:06:35.517 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:06:35.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:06:35.654 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:06:35.654 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:06:35.666 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:06:35.667 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:06:35.770 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:06:35.770 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:06:35.784 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-09-12T00:06:35.789 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:06:35.789 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:06:35.803 DEBUG:teuthology.orchestra.run.smithi121:> sudo apt-get update 2024-09-12T00:06:35.951 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:06:35.951 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:06:35.961 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:06:35.970 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:06:35.980 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:06:36.004 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:06:36.024 INFO:teuthology.orchestra.run.smithi121.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:06:36.025 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:06:36.045 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:06:36.049 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:06:36.067 INFO:teuthology.orchestra.run.smithi121.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:06:36.070 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:06:36.088 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:06:36.094 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:06:36.097 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:06:36.115 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:06:36.172 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:06:36.254 INFO:teuthology.orchestra.run.smithi121.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:06:36.326 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 29.2 kB in 0s (80.4 kB/s) 2024-09-12T00:06:36.402 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 29.2 kB in 0s (70.5 kB/s) 2024-09-12T00:06:37.310 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-12T00:06:37.326 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:06:37.379 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-12T00:06:37.448 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-12T00:06:37.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:06:37.520 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-12T00:06:37.572 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-12T00:06:37.572 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-12T00:06:37.704 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-09-12T00:06:37.705 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-09-12T00:06:37.762 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:06:37.762 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:06:37.762 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:06:37.762 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:06:37.762 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:06:37.763 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:06:37.763 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:06:37.763 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-12T00:06:37.763 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:06:37.764 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:06:37.764 INFO:teuthology.orchestra.run.smithi102.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:06:37.764 INFO:teuthology.orchestra.run.smithi102.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:06:37.765 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:06:37.765 INFO:teuthology.orchestra.run.smithi102.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:06:37.765 INFO:teuthology.orchestra.run.smithi102.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:06:37.765 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:06:37.765 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:06:37.765 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:06:37.766 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet zip 2024-09-12T00:06:37.767 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-12T00:06:37.767 INFO:teuthology.orchestra.run.smithi102.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:06:37.767 INFO:teuthology.orchestra.run.smithi102.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:06:37.767 INFO:teuthology.orchestra.run.smithi102.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:06:37.767 INFO:teuthology.orchestra.run.smithi102.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:06:37.767 INFO:teuthology.orchestra.run.smithi102.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:06:37.767 INFO:teuthology.orchestra.run.smithi102.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:06:37.767 INFO:teuthology.orchestra.run.smithi102.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:06:37.767 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2024-09-12T00:06:37.767 INFO:teuthology.orchestra.run.smithi102.stdout: btrfs-tools 2024-09-12T00:06:37.871 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-12T00:06:37.871 INFO:teuthology.orchestra.run.smithi102.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:06:37.872 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:06:37.872 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:06:37.873 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:06:37.873 INFO:teuthology.orchestra.run.smithi102.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:06:37.873 INFO:teuthology.orchestra.run.smithi102.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:06:37.873 INFO:teuthology.orchestra.run.smithi102.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:06:37.873 INFO:teuthology.orchestra.run.smithi102.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:06:37.873 INFO:teuthology.orchestra.run.smithi102.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:06:37.874 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:06:37.875 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:06:37.875 INFO:teuthology.orchestra.run.smithi102.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:06:37.875 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:06:37.875 INFO:teuthology.orchestra.run.smithi102.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:06:37.887 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:06:37.887 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:06:37.887 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:06:37.887 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:06:37.887 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:06:37.888 INFO:teuthology.orchestra.run.smithi121.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:06:37.888 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:06:37.888 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2024-09-12T00:06:37.888 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:06:37.888 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:06:37.888 INFO:teuthology.orchestra.run.smithi121.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:06:37.888 INFO:teuthology.orchestra.run.smithi121.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:06:37.889 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:06:37.890 INFO:teuthology.orchestra.run.smithi121.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:06:37.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:06:37.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:06:37.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:06:37.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:06:37.891 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet zip 2024-09-12T00:06:37.891 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2024-09-12T00:06:37.891 INFO:teuthology.orchestra.run.smithi121.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:06:37.891 INFO:teuthology.orchestra.run.smithi121.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:06:37.891 INFO:teuthology.orchestra.run.smithi121.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:06:37.891 INFO:teuthology.orchestra.run.smithi121.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:06:37.892 INFO:teuthology.orchestra.run.smithi121.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:06:37.892 INFO:teuthology.orchestra.run.smithi121.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:06:37.892 INFO:teuthology.orchestra.run.smithi121.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:06:37.892 INFO:teuthology.orchestra.run.smithi121.stdout:Recommended packages: 2024-09-12T00:06:37.892 INFO:teuthology.orchestra.run.smithi121.stdout: btrfs-tools 2024-09-12T00:06:37.995 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2024-09-12T00:06:37.995 INFO:teuthology.orchestra.run.smithi121.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:06:37.995 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:06:37.995 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:06:37.995 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:06:37.995 INFO:teuthology.orchestra.run.smithi121.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:06:37.995 INFO:teuthology.orchestra.run.smithi121.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:06:37.997 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:06:37.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:06:37.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:06:37.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:06:37.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:06:37.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:06:37.998 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:06:37.998 INFO:teuthology.orchestra.run.smithi121.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:06:38.019 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:06:38.020 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 251 MB of archives. 2024-09-12T00:06:38.020 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:06:38.020 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:06:38.059 INFO:teuthology.orchestra.run.smithi121.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:06:38.059 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 251 MB of archives. 2024-09-12T00:06:38.059 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:06:38.059 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:06:38.064 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:06:38.136 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:06:38.148 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:06:38.150 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:06:38.169 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:06:38.205 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:06:38.229 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:06:38.234 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:06:38.247 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:06:38.251 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:06:38.251 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:06:38.252 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:06:38.261 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:06:38.263 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:06:38.265 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:06:38.267 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:06:38.267 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:06:38.268 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:06:38.270 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:06:38.285 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:06:38.287 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:06:38.287 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:06:38.288 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:06:38.288 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:06:38.289 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:06:38.289 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:06:38.289 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:06:38.290 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:06:38.294 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:06:38.296 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:06:38.299 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:06:38.300 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:06:38.305 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:06:38.305 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:06:38.307 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:06:38.321 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:06:38.323 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:06:38.324 INFO:teuthology.orchestra.run.smithi121.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:06:38.324 INFO:teuthology.orchestra.run.smithi121.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:06:38.325 INFO:teuthology.orchestra.run.smithi121.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:06:38.326 INFO:teuthology.orchestra.run.smithi121.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:06:38.326 INFO:teuthology.orchestra.run.smithi121.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:06:38.326 INFO:teuthology.orchestra.run.smithi121.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:06:38.338 INFO:teuthology.orchestra.run.smithi121.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:06:38.339 INFO:teuthology.orchestra.run.smithi121.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:06:38.356 INFO:teuthology.orchestra.run.smithi121.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:06:38.362 INFO:teuthology.orchestra.run.smithi121.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:06:38.362 INFO:teuthology.orchestra.run.smithi121.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:06:38.363 INFO:teuthology.orchestra.run.smithi121.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:06:38.363 INFO:teuthology.orchestra.run.smithi121.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:06:38.364 INFO:teuthology.orchestra.run.smithi121.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:06:38.366 INFO:teuthology.orchestra.run.smithi121.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:06:38.367 INFO:teuthology.orchestra.run.smithi121.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:06:38.374 INFO:teuthology.orchestra.run.smithi121.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:06:38.374 INFO:teuthology.orchestra.run.smithi121.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:06:38.389 INFO:teuthology.orchestra.run.smithi121.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:06:38.391 INFO:teuthology.orchestra.run.smithi121.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:06:38.392 INFO:teuthology.orchestra.run.smithi121.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:06:38.393 INFO:teuthology.orchestra.run.smithi121.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:06:38.395 INFO:teuthology.orchestra.run.smithi121.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:06:38.448 INFO:teuthology.orchestra.run.smithi121.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:06:38.449 INFO:teuthology.orchestra.run.smithi121.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:06:38.450 INFO:teuthology.orchestra.run.smithi121.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:06:38.451 INFO:teuthology.orchestra.run.smithi121.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:06:38.452 INFO:teuthology.orchestra.run.smithi121.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:06:38.469 INFO:teuthology.orchestra.run.smithi121.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:06:38.471 INFO:teuthology.orchestra.run.smithi121.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:06:38.471 INFO:teuthology.orchestra.run.smithi121.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:06:38.485 INFO:teuthology.orchestra.run.smithi121.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:06:38.485 INFO:teuthology.orchestra.run.smithi121.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:06:38.486 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:06:38.486 INFO:teuthology.orchestra.run.smithi121.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:06:38.486 INFO:teuthology.orchestra.run.smithi121.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:06:38.486 INFO:teuthology.orchestra.run.smithi121.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:06:38.487 INFO:teuthology.orchestra.run.smithi121.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:06:38.498 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:06:38.503 INFO:teuthology.orchestra.run.smithi121.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:06:38.504 INFO:teuthology.orchestra.run.smithi121.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:06:38.504 INFO:teuthology.orchestra.run.smithi121.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:06:38.508 INFO:teuthology.orchestra.run.smithi121.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:06:38.520 INFO:teuthology.orchestra.run.smithi121.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:06:38.522 INFO:teuthology.orchestra.run.smithi121.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:06:38.522 INFO:teuthology.orchestra.run.smithi121.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:06:38.525 INFO:teuthology.orchestra.run.smithi121.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:06:38.527 INFO:teuthology.orchestra.run.smithi121.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:06:38.528 INFO:teuthology.orchestra.run.smithi121.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:06:38.528 INFO:teuthology.orchestra.run.smithi121.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:06:38.532 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:06:38.535 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:06:38.538 INFO:teuthology.orchestra.run.smithi121.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:06:38.538 INFO:teuthology.orchestra.run.smithi121.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:06:38.541 INFO:teuthology.orchestra.run.smithi121.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:06:38.543 INFO:teuthology.orchestra.run.smithi121.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:06:38.543 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:06:38.550 INFO:teuthology.orchestra.run.smithi121.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:06:38.551 INFO:teuthology.orchestra.run.smithi121.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:06:38.555 INFO:teuthology.orchestra.run.smithi121.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:06:38.555 INFO:teuthology.orchestra.run.smithi121.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:06:38.556 INFO:teuthology.orchestra.run.smithi121.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:06:38.556 INFO:teuthology.orchestra.run.smithi121.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:06:38.558 INFO:teuthology.orchestra.run.smithi121.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:06:38.558 INFO:teuthology.orchestra.run.smithi121.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:06:38.558 INFO:teuthology.orchestra.run.smithi121.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:06:38.565 INFO:teuthology.orchestra.run.smithi121.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:06:38.565 INFO:teuthology.orchestra.run.smithi121.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:06:38.565 INFO:teuthology.orchestra.run.smithi121.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:06:38.573 INFO:teuthology.orchestra.run.smithi121.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:06:38.575 INFO:teuthology.orchestra.run.smithi121.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:06:38.575 INFO:teuthology.orchestra.run.smithi121.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:06:38.580 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:06:38.807 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:06:38.818 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:06:38.847 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:06:38.856 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:06:38.857 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:06:38.858 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:06:38.869 INFO:teuthology.orchestra.run.smithi121.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:06:38.871 INFO:teuthology.orchestra.run.smithi121.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:06:38.876 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:06:38.880 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:06:38.885 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:06:38.889 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:06:38.911 INFO:teuthology.orchestra.run.smithi121.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:06:38.969 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:06:38.973 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:06:38.977 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:06:38.980 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:06:38.981 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:06:38.982 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:06:38.984 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:06:38.984 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:06:38.985 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:06:39.052 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:06:39.067 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:06:39.068 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:06:39.069 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:06:39.074 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:06:39.075 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:06:39.133 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:06:39.134 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:06:39.136 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:06:39.136 INFO:teuthology.orchestra.run.smithi102.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:06:39.214 INFO:teuthology.orchestra.run.smithi102.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:06:39.216 INFO:teuthology.orchestra.run.smithi102.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:06:39.218 INFO:teuthology.orchestra.run.smithi102.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:06:39.219 INFO:teuthology.orchestra.run.smithi102.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:06:39.229 INFO:teuthology.orchestra.run.smithi102.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:06:39.295 INFO:teuthology.orchestra.run.smithi102.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:06:39.296 INFO:teuthology.orchestra.run.smithi102.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:06:39.297 INFO:teuthology.orchestra.run.smithi102.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:06:39.300 INFO:teuthology.orchestra.run.smithi102.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:06:39.304 INFO:teuthology.orchestra.run.smithi102.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:06:39.377 INFO:teuthology.orchestra.run.smithi102.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:06:39.379 INFO:teuthology.orchestra.run.smithi102.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:06:39.381 INFO:teuthology.orchestra.run.smithi102.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:06:39.457 INFO:teuthology.orchestra.run.smithi102.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:06:39.458 INFO:teuthology.orchestra.run.smithi102.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:06:39.517 INFO:teuthology.orchestra.run.smithi102.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:06:39.518 INFO:teuthology.orchestra.run.smithi102.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:06:39.521 INFO:teuthology.orchestra.run.smithi102.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:06:39.600 INFO:teuthology.orchestra.run.smithi102.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:06:39.602 INFO:teuthology.orchestra.run.smithi102.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:06:39.604 INFO:teuthology.orchestra.run.smithi102.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:06:39.634 INFO:teuthology.orchestra.run.smithi102.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:06:39.662 INFO:teuthology.orchestra.run.smithi102.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:06:39.664 INFO:teuthology.orchestra.run.smithi102.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:06:39.666 INFO:teuthology.orchestra.run.smithi102.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:06:39.667 INFO:teuthology.orchestra.run.smithi102.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:06:39.669 INFO:teuthology.orchestra.run.smithi102.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:06:39.716 INFO:teuthology.orchestra.run.smithi102.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:06:39.738 INFO:teuthology.orchestra.run.smithi102.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:06:39.739 INFO:teuthology.orchestra.run.smithi102.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:06:39.786 INFO:teuthology.orchestra.run.smithi102.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:06:39.787 INFO:teuthology.orchestra.run.smithi102.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:06:39.808 INFO:teuthology.orchestra.run.smithi102.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:06:39.828 INFO:teuthology.orchestra.run.smithi102.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:06:39.829 INFO:teuthology.orchestra.run.smithi102.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:06:39.830 INFO:teuthology.orchestra.run.smithi102.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:06:39.831 INFO:teuthology.orchestra.run.smithi102.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:06:39.832 INFO:teuthology.orchestra.run.smithi102.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:06:39.833 INFO:teuthology.orchestra.run.smithi102.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:06:39.841 INFO:teuthology.orchestra.run.smithi102.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:06:39.910 INFO:teuthology.orchestra.run.smithi102.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:06:39.913 INFO:teuthology.orchestra.run.smithi102.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:06:39.914 INFO:teuthology.orchestra.run.smithi102.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:06:39.991 INFO:teuthology.orchestra.run.smithi102.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:06:39.997 INFO:teuthology.orchestra.run.smithi102.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:06:39.999 INFO:teuthology.orchestra.run.smithi102.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:06:40.000 INFO:teuthology.orchestra.run.smithi102.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:06:40.009 INFO:teuthology.orchestra.run.smithi121.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:06:40.011 INFO:teuthology.orchestra.run.smithi102.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:06:40.013 INFO:teuthology.orchestra.run.smithi102.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:06:40.020 INFO:teuthology.orchestra.run.smithi102.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:06:40.072 INFO:teuthology.orchestra.run.smithi102.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:06:40.073 INFO:teuthology.orchestra.run.smithi102.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:06:40.074 INFO:teuthology.orchestra.run.smithi102.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:06:40.137 INFO:teuthology.orchestra.run.smithi121.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:06:40.144 INFO:teuthology.orchestra.run.smithi121.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:06:40.145 INFO:teuthology.orchestra.run.smithi121.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:06:40.153 INFO:teuthology.orchestra.run.smithi102.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:06:40.155 INFO:teuthology.orchestra.run.smithi102.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:06:40.172 INFO:teuthology.orchestra.run.smithi102.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:06:40.173 INFO:teuthology.orchestra.run.smithi102.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:06:40.173 INFO:teuthology.orchestra.run.smithi102.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:06:40.178 INFO:teuthology.orchestra.run.smithi102.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:06:40.180 INFO:teuthology.orchestra.run.smithi102.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:06:40.221 INFO:teuthology.orchestra.run.smithi121.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:06:40.464 INFO:teuthology.orchestra.run.smithi121.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:06:40.542 INFO:teuthology.orchestra.run.smithi102.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:06:40.543 INFO:teuthology.orchestra.run.smithi102.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:06:40.560 INFO:teuthology.orchestra.run.smithi102.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:06:40.603 INFO:teuthology.orchestra.run.smithi102.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:06:40.614 INFO:teuthology.orchestra.run.smithi102.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:06:40.616 INFO:teuthology.orchestra.run.smithi102.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:06:41.409 INFO:teuthology.orchestra.run.smithi121.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:06:41.410 INFO:teuthology.orchestra.run.smithi121.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:06:41.427 INFO:teuthology.orchestra.run.smithi121.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:06:41.468 INFO:teuthology.orchestra.run.smithi121.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:06:41.497 INFO:teuthology.orchestra.run.smithi121.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:06:41.499 INFO:teuthology.orchestra.run.smithi121.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:06:42.584 INFO:teuthology.orchestra.run.smithi102.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:06:42.762 INFO:teuthology.orchestra.run.smithi102.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:06:42.762 INFO:teuthology.orchestra.run.smithi102.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:06:43.871 INFO:teuthology.orchestra.run.smithi121.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:06:44.087 INFO:teuthology.orchestra.run.smithi121.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:06:44.087 INFO:teuthology.orchestra.run.smithi121.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:06:44.535 INFO:teuthology.orchestra.run.smithi102.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:06:44.537 INFO:teuthology.orchestra.run.smithi102.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:06:44.538 INFO:teuthology.orchestra.run.smithi102.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:06:44.988 INFO:teuthology.orchestra.run.smithi102.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:06:45.557 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 251 MB in 7s (35.3 MB/s) 2024-09-12T00:06:45.613 INFO:teuthology.orchestra.run.smithi121.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:06:45.615 INFO:teuthology.orchestra.run.smithi121.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:06:45.617 INFO:teuthology.orchestra.run.smithi121.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:06:45.685 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:06:45.783 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:06:45.788 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:06:45.858 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:06:45.922 INFO:teuthology.orchestra.run.smithi121.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:06:46.137 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:06:46.163 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:06:46.203 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:06:46.481 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 251 MB in 8s (31.7 MB/s) 2024-09-12T00:06:46.532 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:06:46.558 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:06:46.598 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:06:46.658 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:06:46.758 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:06:46.764 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:06:46.848 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:06:47.020 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:06:47.045 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:06:47.096 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:06:47.185 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:06:47.211 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:06:47.252 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:06:47.472 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:06:47.498 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:06:47.538 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:06:47.571 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:06:47.597 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:06:47.638 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:06:47.874 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:06:47.901 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:06:47.941 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:06:48.058 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:06:48.084 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:06:48.132 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:06:48.277 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:06:48.303 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:06:48.344 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:06:48.561 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:06:48.587 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:06:48.614 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librados2. 2024-09-12T00:06:48.627 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:06:48.640 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:48.672 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:48.973 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:06:48.999 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:06:49.039 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:06:49.133 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:06:49.159 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:49.199 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:49.450 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:06:49.476 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:06:49.525 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:06:49.594 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:06:49.609 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:49.644 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:49.955 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:06:49.970 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:50.013 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:50.020 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librados2. 2024-09-12T00:06:50.046 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:50.095 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:50.332 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:06:50.359 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:06:50.399 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:50.531 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:06:50.557 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:50.589 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:50.651 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:06:50.666 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:50.710 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:50.970 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:06:50.986 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:06:51.020 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:51.042 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:06:51.068 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:51.108 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:51.324 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:06:51.350 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:06:51.390 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:06:51.394 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:06:51.409 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:51.452 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:51.726 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:06:51.753 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:06:51.789 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:06:51.793 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:06:51.815 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:06:51.855 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:52.054 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:06:52.080 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:52.092 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:06:52.100 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:52.121 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:52.133 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:52.407 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:06:52.433 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:06:52.465 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:06:52.477 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:06:52.503 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:06:52.551 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:52.726 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:06:52.752 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:06:52.792 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:06:52.913 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:06:52.939 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:06:52.980 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:06:53.095 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:06:53.110 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:06:53.170 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:06:53.299 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:06:53.325 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:06:53.366 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:06:53.499 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:06:53.526 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:06:53.557 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:06:53.635 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:06:53.650 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:53.701 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:53.860 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:06:53.887 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:06:53.926 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:06:54.113 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:06:54.139 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:06:54.179 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package zip. 2024-09-12T00:06:54.196 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:06:54.206 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:06:54.254 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:06:54.482 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:06:54.497 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:06:54.515 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package unzip. 2024-09-12T00:06:54.531 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:06:54.540 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:06:54.565 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:06:54.868 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:06:54.894 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:06:54.928 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:06:54.951 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:06:54.954 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:06:54.994 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:06:55.238 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:06:55.264 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:06:55.305 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:06:55.369 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:06:55.396 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:55.435 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:55.624 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:06:55.639 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:06:55.683 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:06:55.927 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package zip. 2024-09-12T00:06:55.942 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:06:55.979 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:06:55.985 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:06:55.994 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:56.029 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:56.255 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package unzip. 2024-09-12T00:06:56.270 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:06:56.305 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:06:56.366 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:06:56.392 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:06:56.433 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:06:56.692 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:06:56.718 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:06:56.735 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:06:56.758 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:06:56.761 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:56.801 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:57.125 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:06:57.267 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:57.268 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:57.268 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:06:57.268 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:57.268 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:57.802 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:06:57.817 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:57.861 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:58.230 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:06:58.256 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:06:58.296 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:06:58.557 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:06:58.572 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:58.607 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:58.743 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:06:58.770 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:58.820 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:59.027 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:06:59.054 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:06:59.085 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:06:59.406 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:06:59.432 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:06:59.472 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:06:59.758 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:06:59.785 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:06:59.825 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:07:00.145 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:07:00.171 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:07:00.211 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:07:00.522 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:07:00.549 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:07:00.565 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:07:00.589 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:07:00.591 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:00.633 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:00.842 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:07:00.868 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:07:00.900 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:07:01.161 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:07:01.176 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:07:01.186 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:07:01.213 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:07:01.219 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:07:01.253 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:07:01.531 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:07:01.557 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:07:01.564 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:07:01.590 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:07:01.597 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:07:01.631 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:07:01.925 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:07:01.934 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:07:01.951 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:07:01.959 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:07:01.983 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:07:01.999 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:07:02.245 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:07:02.272 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:07:02.286 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:07:02.312 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:07:02.313 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:07:02.352 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:07:02.605 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:07:02.623 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:07:02.631 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:07:02.652 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:07:02.672 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:07:02.681 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:07:02.958 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:07:02.976 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:07:02.984 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:07:03.003 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:07:03.024 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:07:03.042 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:07:03.310 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:07:03.329 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:07:03.337 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:07:03.355 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:07:03.377 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:07:03.395 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:07:03.647 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:07:03.673 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:07:03.673 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:07:03.700 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:07:03.705 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:07:03.740 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:07:03.966 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:07:03.992 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:07:04.026 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:07:04.032 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:07:04.052 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:07:04.086 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:07:04.370 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:07:04.386 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:07:04.397 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:07:04.412 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:07:04.437 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:07:04.452 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:07:04.722 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:07:04.732 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:07:04.749 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:07:04.758 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:07:04.780 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:07:04.798 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:07:05.067 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:07:05.093 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:07:05.133 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:07:05.151 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:07:05.174 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:07:05.221 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:07:05.521 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:07:05.547 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:07:05.587 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:07:05.719 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:07:05.746 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:07:05.786 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:07:05.849 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:07:05.875 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:07:05.915 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:07:06.114 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:07:06.141 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:07:06.215 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:07:06.218 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:07:06.234 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:07:06.268 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:07:06.521 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:07:06.547 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:07:06.550 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:07:06.576 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:07:06.587 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:07:06.617 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:07:06.883 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:07:06.903 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:07:06.909 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:07:06.929 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:07:06.949 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:07:06.969 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:07:07.285 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:07:07.312 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:07:07.330 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:07:07.352 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:07:07.358 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:07:07.401 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:07:07.700 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:07:07.715 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:07:07.727 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:07:07.741 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:07:07.767 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:07:07.782 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:07:08.052 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:07:08.079 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:07:08.084 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:07:08.111 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:07:08.119 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:07:08.142 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:07:08.420 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:07:08.447 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:07:08.447 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:07:08.463 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:07:08.486 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:07:08.497 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:07:08.758 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:07:08.784 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:07:08.790 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:07:08.817 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:07:08.824 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:07:08.857 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:07:09.128 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:07:09.155 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:07:09.168 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:07:09.194 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:07:09.194 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:07:09.234 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:07:09.523 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:07:09.529 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:07:09.549 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:07:09.555 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:09.589 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:07:09.595 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:09.952 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:07:09.967 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:07:09.978 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:07:09.994 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:10.018 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:07:10.034 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:10.286 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:07:10.302 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:07:10.312 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:07:10.336 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:07:10.344 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:07:10.371 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:07:10.648 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:07:10.674 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:07:10.714 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:07:11.051 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:07:11.077 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:11.117 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:11.533 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:07:11.561 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:07:11.599 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:07:11.902 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:07:11.929 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:07:11.969 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:07:12.280 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:07:12.296 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:07:12.337 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:07:12.338 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:07:12.364 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:12.404 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:12.600 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:07:12.615 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:12.649 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:12.999 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:07:13.026 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:13.038 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:07:13.065 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:13.068 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:13.104 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:13.407 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:07:13.434 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:07:13.465 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:07:13.743 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:07:13.770 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:07:13.809 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:07:14.154 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:07:14.181 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:14.221 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:14.469 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph. 2024-09-12T00:07:14.496 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:14.535 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:14.591 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:07:14.618 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:14.649 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:14.863 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:07:14.890 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:14.929 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:15.252 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:07:15.279 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:15.300 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:07:15.318 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:15.326 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:15.366 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:15.702 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:07:15.729 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:15.760 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:16.088 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:07:16.115 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:07:16.154 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:07:16.414 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph. 2024-09-12T00:07:16.441 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:16.474 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:07:16.480 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:16.490 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:07:16.532 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:07:16.791 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:07:16.818 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:16.858 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:17.244 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:07:17.271 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:17.310 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:17.545 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:07:17.573 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:07:17.612 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:07:17.705 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:07:17.733 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:17.772 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:17.932 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:07:17.958 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:07:17.998 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:07:18.099 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:07:18.127 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:07:18.166 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:07:18.343 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:07:18.370 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:18.409 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:18.477 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:07:18.504 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:07:18.543 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:07:18.754 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:07:18.781 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:07:18.837 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:07:19.116 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:07:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:07:19.174 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:07:19.510 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:07:19.537 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:19.540 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:07:19.568 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:07:19.577 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:19.606 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:07:19.893 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:07:19.920 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:07:19.959 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:07:20.271 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:07:20.298 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:20.337 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:20.682 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:07:20.709 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:07:20.748 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:07:21.001 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:07:21.028 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:07:21.076 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:07:21.405 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:07:21.432 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:21.465 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:22.206 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:07:22.223 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:07:22.265 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:07:22.729 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:07:22.757 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:07:22.796 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:07:23.124 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:07:23.151 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:07:23.190 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:07:23.476 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:07:23.505 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:07:23.543 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:07:24.243 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:07:24.272 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:24.395 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:24.567 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:07:24.584 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:07:24.625 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:07:25.148 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:07:25.175 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:07:25.214 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:07:25.316 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:07:25.343 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:07:25.382 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:07:25.592 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:07:25.620 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:07:25.658 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:07:25.685 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:07:25.713 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:07:25.753 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:07:25.911 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:07:25.939 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:07:25.969 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:07:26.089 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:07:26.116 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:07:26.155 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:07:26.466 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:07:26.494 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:07:26.533 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:07:26.670 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:07:26.697 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:26.822 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:26.853 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:07:26.881 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:07:26.920 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:07:27.215 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:07:27.242 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:07:27.281 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:07:27.551 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:07:27.566 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:07:27.609 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:07:27.767 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:07:27.794 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:07:27.825 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:07:27.929 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:07:27.957 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:07:27.996 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:07:28.095 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:07:28.122 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:07:28.161 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:07:28.506 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:07:28.533 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:07:28.573 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:07:28.668 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:07:28.696 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:28.735 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:28.875 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:07:28.891 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:07:28.934 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:07:29.062 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:07:29.090 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:07:29.129 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:07:29.229 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:07:29.256 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:07:29.295 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:07:29.449 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:07:29.476 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:07:29.515 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:07:29.632 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:07:29.660 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:07:29.699 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:07:29.776 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package jq. 2024-09-12T00:07:29.792 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:07:29.826 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:07:30.018 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:07:30.046 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package socat. 2024-09-12T00:07:30.049 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:07:30.062 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:07:30.085 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:07:30.103 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:07:30.373 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:07:30.389 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:07:30.404 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:07:30.432 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:07:30.432 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:07:30.471 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:07:30.944 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:07:30.961 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:30.994 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:31.251 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:07:31.280 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:31.318 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:31.604 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:07:31.631 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:07:31.662 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:07:31.999 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:07:32.026 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:07:32.065 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:07:32.335 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package jq. 2024-09-12T00:07:32.362 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:07:32.401 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:07:32.670 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package socat. 2024-09-12T00:07:32.698 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:07:32.737 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:07:33.023 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:07:33.039 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:07:33.081 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:07:33.444 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:07:33.460 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:33.502 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:33.566 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:07:33.594 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:33.632 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:33.936 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:07:33.964 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:34.002 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:34.314 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:07:34.342 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:07:34.380 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:07:34.703 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:07:35.012 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:07:35.012 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:07:35.064 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:07:35.092 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:07:35.122 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:07:35.552 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:07:35.581 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:07:35.619 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:07:35.838 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:07:35.855 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:07:35.897 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:07:35.915 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:07:35.943 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:07:35.974 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:36.276 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:07:36.293 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:36.299 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:07:36.326 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:36.327 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:07:36.358 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:07:36.613 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:07:36.640 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:07:36.644 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:07:36.670 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:07:36.672 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:07:36.710 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:07:37.000 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:07:37.029 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:07:37.047 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:07:37.067 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:07:37.075 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:07:37.114 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:07:37.425 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:07:37.437 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:07:37.453 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:07:37.465 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:07:37.492 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:07:37.504 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:07:37.878 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:07:37.906 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:07:37.917 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:07:37.944 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:07:37.945 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:07:37.984 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:07:38.220 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:07:38.236 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:07:38.273 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:07:38.278 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:07:38.289 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:07:38.331 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:07:38.706 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:07:38.734 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:07:38.773 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:07:38.777 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:07:38.805 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:07:38.843 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:07:39.000 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:07:39.017 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:07:39.059 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:07:39.105 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:07:39.135 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:07:39.171 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:07:39.370 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:07:39.398 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:07:39.437 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:07:39.474 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:07:39.490 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:07:39.532 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:07:39.756 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:07:39.784 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:07:39.823 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:07:39.836 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:07:39.864 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:07:39.902 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:07:40.143 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:07:40.146 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:07:40.170 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:07:40.175 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:07:40.208 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:07:40.213 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:07:40.545 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:07:40.573 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:07:40.612 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:07:40.967 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:07:40.995 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:41.033 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:41.083 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:07:41.111 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:07:41.149 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:07:41.418 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:07:41.434 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:07:41.468 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:07:41.754 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:07:41.782 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:07:41.820 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:07:41.937 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:07:41.953 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:41.995 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:42.149 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:07:42.178 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:07:42.207 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:07:42.290 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:07:42.443 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:07:42.459 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:07:42.493 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:07:42.558 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:07:42.692 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:07:42.955 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:07:43.181 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:07:43.209 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:43.238 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:43.262 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:07:43.710 INFO:teuthology.orchestra.run.smithi102.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:07:43.803 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:44.175 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:07:44.203 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:07:44.241 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:44.312 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user cephadm....done 2024-09-12T00:07:44.493 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:07:44.546 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:07:44.805 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:07:44.906 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:07:45.124 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:07:45.143 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:07:45.448 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:07:45.538 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:07:45.639 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:07:45.853 INFO:teuthology.orchestra.run.smithi121.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:07:45.899 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:07:45.915 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:46.150 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:07:46.276 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:07:46.482 INFO:teuthology.orchestra.run.smithi121.stdout:Adding system user cephadm....done 2024-09-12T00:07:46.603 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:07:46.630 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:07:46.881 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:07:47.005 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:07:47.133 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:07:47.248 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:07:47.258 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:07:47.518 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:07:47.524 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:07:47.767 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:07:47.777 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:07:47.903 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:07:48.010 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:07:48.222 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:07:48.378 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:07:48.557 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:07:48.645 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:48.817 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:07:48.921 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:07:49.047 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:07:49.084 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:07:49.173 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:07:49.300 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:07:49.327 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:07:49.542 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:07:49.578 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:07:49.700 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:07:49.731 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:07:49.795 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:07:49.846 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:07:49.913 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:07:50.089 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:50.314 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:07:50.340 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:07:50.440 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:07:50.466 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:07:50.592 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:07:50.716 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:07:50.718 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:07:50.977 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:07:51.009 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:07:51.136 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:07:51.165 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:07:51.221 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:07:51.302 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:07:51.331 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:07:51.436 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:07:51.673 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:07:51.825 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:07:52.080 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:07:52.092 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:07:52.315 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:07:52.360 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:07:52.440 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:07:52.566 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:07:52.661 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:07:52.787 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:07:52.859 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:07:53.252 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:07:53.447 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:07:53.512 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:07:53.698 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:07:53.824 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:07:53.871 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:07:53.950 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:07:54.140 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:07:54.243 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:07:54.483 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:07:54.627 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:07:54.725 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:07:54.851 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:54.878 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:07:55.195 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:07:55.263 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:07:55.539 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:07:55.546 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:07:55.899 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:07:56.150 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:07:56.276 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:07:56.719 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:07:56.768 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:07:57.029 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:07:57.054 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:07:57.154 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:07:57.405 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:07:57.523 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:07:57.649 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:07:57.950 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:07:58.210 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:07:58.234 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:07:58.461 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:07:58.485 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:07:58.587 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:07:58.620 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:07:58.864 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:07:58.871 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:07:58.972 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:07:59.081 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:07:59.107 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:07:59.349 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:07:59.374 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:07:59.601 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:07:59.683 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:07:59.851 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:07:59.960 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:08:00.085 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:08:00.119 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:08:00.237 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:08:00.379 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:08:00.513 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:08:00.621 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:08:00.631 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:08:00.856 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:08:00.924 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:08:01.107 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:08:01.209 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:08:01.358 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:08:01.459 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:08:01.586 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:08:01.625 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:08:01.712 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:08:01.751 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:08:01.802 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:08:02.027 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:08:02.039 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:08:02.154 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:08:02.165 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:08:02.438 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:08:02.541 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:08:02.747 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:08:02.793 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:08:02.919 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:08:03.007 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:08:03.133 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:08:03.187 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:08:03.259 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:08:03.313 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:08:03.365 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:08:03.622 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:08:03.635 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:08:03.753 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:08:03.932 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:08:04.146 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:08:04.191 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:08:04.292 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:08:04.397 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:08:04.523 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:08:04.552 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:08:04.783 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:08:04.828 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:08:04.909 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:08:05.156 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:08:05.226 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:08:05.533 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:08:05.544 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:08:05.812 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:08:05.889 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:08:05.913 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:08:06.181 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:08:06.214 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:08:06.340 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:06.449 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:06.456 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:08:06.559 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:08:06.801 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:08:06.878 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:07.004 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:07.130 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:08:07.186 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:08:07.398 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:07.455 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:08:07.516 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:07.625 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:07.790 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:08:07.820 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:08:07.820 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:08:07.917 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:08.042 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:08.177 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:08:08.293 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:08.419 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:08.538 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:08.545 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:08.664 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:08.680 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:08:08.790 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:08:09.083 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:09.209 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:09.335 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:09.551 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:08:09.551 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:08:09.884 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:09.985 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:09.988 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:10.111 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:10.115 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:10.237 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:10.249 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:10.363 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:10.375 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:08:10.906 INFO:teuthology.orchestra.run.smithi102.stdout:Adding group ceph....done 2024-09-12T00:08:11.232 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user ceph....done 2024-09-12T00:08:11.377 INFO:teuthology.orchestra.run.smithi102.stdout:Setting system user ceph properties....done 2024-09-12T00:08:11.389 INFO:teuthology.orchestra.run.smithi102.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:08:11.527 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:08:11.620 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:11.746 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:11.872 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:11.903 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:08:12.006 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:12.158 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:12.356 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:12.482 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:12.767 INFO:teuthology.orchestra.run.smithi121.stdout:Adding group ceph....done 2024-09-12T00:08:12.969 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:08:12.969 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:08:13.152 INFO:teuthology.orchestra.run.smithi121.stdout:Adding system user ceph....done 2024-09-12T00:08:13.320 INFO:teuthology.orchestra.run.smithi121.stdout:Setting system user ceph properties....done 2024-09-12T00:08:13.340 INFO:teuthology.orchestra.run.smithi121.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:08:13.475 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:13.479 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:08:13.815 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:08:13.816 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:08:14.275 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:14.277 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:14.401 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:14.512 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:08:14.512 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:08:14.860 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:08:14.860 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:08:14.963 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:15.188 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:08:15.188 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:08:15.295 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:15.653 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:08:15.692 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:15.959 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:08:15.960 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:08:16.132 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:16.473 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:08:16.474 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:08:16.508 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:16.609 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:16.752 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:16.941 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:16.959 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:08:16.959 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:08:17.159 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:08:17.160 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:08:17.453 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:17.570 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:17.610 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:17.705 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:17.856 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:17.895 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:08:17.896 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:08:18.217 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:08:18.318 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:08:18.361 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:18.479 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:18.571 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:08:18.605 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:18.822 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:08:18.822 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:08:19.289 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:19.432 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:19.558 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:19.709 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:19.755 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:08:20.061 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:08:20.154 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:08:20.298 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:08:20.409 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:08:20.412 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:08:20.510 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-12T00:08:20.729 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-12T00:08:20.730 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-12T00:08:20.914 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:08:20.914 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:08:20.914 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:08:20.914 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:08:20.914 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:08:20.915 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:08:20.915 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:08:20.916 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-12T00:08:20.916 INFO:teuthology.orchestra.run.smithi102.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:08:20.916 INFO:teuthology.orchestra.run.smithi102.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:08:20.916 INFO:teuthology.orchestra.run.smithi102.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:08:20.916 INFO:teuthology.orchestra.run.smithi102.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:08:20.916 INFO:teuthology.orchestra.run.smithi102.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:08:20.916 INFO:teuthology.orchestra.run.smithi102.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:08:20.916 INFO:teuthology.orchestra.run.smithi102.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:08:20.917 INFO:teuthology.orchestra.run.smithi102.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:08:20.917 INFO:teuthology.orchestra.run.smithi102.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:08:20.917 INFO:teuthology.orchestra.run.smithi102.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:08:20.917 INFO:teuthology.orchestra.run.smithi102.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:08:20.918 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-12T00:08:20.918 INFO:teuthology.orchestra.run.smithi102.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:08:20.918 INFO:teuthology.orchestra.run.smithi102.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:08:20.918 INFO:teuthology.orchestra.run.smithi102.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:08:20.918 INFO:teuthology.orchestra.run.smithi102.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:08:20.918 INFO:teuthology.orchestra.run.smithi102.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:08:20.956 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-12T00:08:20.956 INFO:teuthology.orchestra.run.smithi102.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:08:20.956 INFO:teuthology.orchestra.run.smithi102.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:08:20.956 INFO:teuthology.orchestra.run.smithi102.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:08:20.957 INFO:teuthology.orchestra.run.smithi102.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:08:20.957 INFO:teuthology.orchestra.run.smithi102.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:08:20.957 INFO:teuthology.orchestra.run.smithi102.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:08:20.957 INFO:teuthology.orchestra.run.smithi102.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:08:20.957 INFO:teuthology.orchestra.run.smithi102.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:08:20.957 INFO:teuthology.orchestra.run.smithi102.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:08:20.957 INFO:teuthology.orchestra.run.smithi102.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:08:20.957 INFO:teuthology.orchestra.run.smithi102.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:08:20.958 INFO:teuthology.orchestra.run.smithi102.stdout: s3cmd 2024-09-12T00:08:21.030 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:08:21.030 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:08:21.030 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:08:21.030 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:08:21.048 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:08:21.048 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:08:21.052 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:08:21.082 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:08:21.087 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:08:21.103 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:08:21.104 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:08:21.135 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:08:21.155 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:08:21.156 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:08:21.157 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:08:21.203 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:08:21.204 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:08:21.221 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:08:21.222 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:08:21.223 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:08:21.223 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:08:21.224 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:08:21.227 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:08:21.227 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:08:21.233 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:08:21.235 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:08:21.240 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:08:21.253 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:08:21.253 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:08:21.254 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:08:21.254 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:08:21.256 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:08:21.260 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:08:21.261 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:08:21.276 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:08:21.276 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:08:21.293 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:08:21.293 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:08:21.293 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:08:21.689 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 10.4 MB in 0s (31.6 MB/s) 2024-09-12T00:08:21.748 INFO:teuthology.orchestra.run.smithi121.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:08:21.751 DEBUG:teuthology.orchestra.run.smithi121:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:08:21.776 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:08:21.831 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:08:21.835 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:08:21.852 INFO:teuthology.orchestra.run.smithi121.stdout:Reading package lists... 2024-09-12T00:08:21.884 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:08:22.061 INFO:teuthology.orchestra.run.smithi121.stdout:Building dependency tree... 2024-09-12T00:08:22.062 INFO:teuthology.orchestra.run.smithi121.stdout:Reading state information... 2024-09-12T00:08:22.112 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:08:22.127 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:08:22.162 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:08:22.263 INFO:teuthology.orchestra.run.smithi121.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:08:22.263 INFO:teuthology.orchestra.run.smithi121.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:08:22.263 INFO:teuthology.orchestra.run.smithi121.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:08:22.263 INFO:teuthology.orchestra.run.smithi121.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:08:22.263 INFO:teuthology.orchestra.run.smithi121.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:08:22.264 INFO:teuthology.orchestra.run.smithi121.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:08:22.264 INFO:teuthology.orchestra.run.smithi121.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout:The following additional packages will be installed: 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:08:22.265 INFO:teuthology.orchestra.run.smithi121.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:08:22.266 INFO:teuthology.orchestra.run.smithi121.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:08:22.266 INFO:teuthology.orchestra.run.smithi121.stdout:Suggested packages: 2024-09-12T00:08:22.266 INFO:teuthology.orchestra.run.smithi121.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:08:22.266 INFO:teuthology.orchestra.run.smithi121.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:08:22.266 INFO:teuthology.orchestra.run.smithi121.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:08:22.266 INFO:teuthology.orchestra.run.smithi121.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:08:22.267 INFO:teuthology.orchestra.run.smithi121.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:08:22.305 INFO:teuthology.orchestra.run.smithi121.stdout:The following NEW packages will be installed: 2024-09-12T00:08:22.305 INFO:teuthology.orchestra.run.smithi121.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:08:22.305 INFO:teuthology.orchestra.run.smithi121.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:08:22.306 INFO:teuthology.orchestra.run.smithi121.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:08:22.306 INFO:teuthology.orchestra.run.smithi121.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:08:22.306 INFO:teuthology.orchestra.run.smithi121.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:08:22.306 INFO:teuthology.orchestra.run.smithi121.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:08:22.306 INFO:teuthology.orchestra.run.smithi121.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:08:22.306 INFO:teuthology.orchestra.run.smithi121.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:08:22.306 INFO:teuthology.orchestra.run.smithi121.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:08:22.306 INFO:teuthology.orchestra.run.smithi121.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:08:22.307 INFO:teuthology.orchestra.run.smithi121.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:08:22.307 INFO:teuthology.orchestra.run.smithi121.stdout: s3cmd 2024-09-12T00:08:22.406 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:08:22.423 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:08:22.465 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:08:22.488 INFO:teuthology.orchestra.run.smithi121.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:08:22.488 INFO:teuthology.orchestra.run.smithi121.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:08:22.488 INFO:teuthology.orchestra.run.smithi121.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:08:22.488 INFO:teuthology.orchestra.run.smithi121.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:08:22.570 INFO:teuthology.orchestra.run.smithi121.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:08:22.570 INFO:teuthology.orchestra.run.smithi121.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:08:22.587 INFO:teuthology.orchestra.run.smithi121.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:08:22.717 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:08:22.745 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:08:22.749 INFO:teuthology.orchestra.run.smithi121.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:08:22.784 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:08:22.820 INFO:teuthology.orchestra.run.smithi121.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:08:22.829 INFO:teuthology.orchestra.run.smithi121.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:08:22.962 INFO:teuthology.orchestra.run.smithi121.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:08:23.037 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:08:23.053 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:08:23.054 INFO:teuthology.orchestra.run.smithi121.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:08:23.055 INFO:teuthology.orchestra.run.smithi121.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:08:23.061 INFO:teuthology.orchestra.run.smithi121.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:08:23.095 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:08:23.203 INFO:teuthology.orchestra.run.smithi121.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:08:23.204 INFO:teuthology.orchestra.run.smithi121.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:08:23.249 INFO:teuthology.orchestra.run.smithi121.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:08:23.250 INFO:teuthology.orchestra.run.smithi121.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:08:23.251 INFO:teuthology.orchestra.run.smithi121.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:08:23.253 INFO:teuthology.orchestra.run.smithi121.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:08:23.254 INFO:teuthology.orchestra.run.smithi121.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:08:23.263 INFO:teuthology.orchestra.run.smithi121.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:08:23.265 INFO:teuthology.orchestra.run.smithi121.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:08:23.300 INFO:teuthology.orchestra.run.smithi121.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:08:23.303 INFO:teuthology.orchestra.run.smithi121.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:08:23.322 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:08:23.339 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:08:23.367 INFO:teuthology.orchestra.run.smithi121.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:08:23.369 INFO:teuthology.orchestra.run.smithi121.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:08:23.369 INFO:teuthology.orchestra.run.smithi121.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:08:23.372 INFO:teuthology.orchestra.run.smithi121.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:08:23.373 INFO:teuthology.orchestra.run.smithi121.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:08:23.381 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:08:23.383 INFO:teuthology.orchestra.run.smithi121.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:08:23.391 INFO:teuthology.orchestra.run.smithi121.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:08:23.395 INFO:teuthology.orchestra.run.smithi121.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:08:23.462 INFO:teuthology.orchestra.run.smithi121.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:08:23.463 INFO:teuthology.orchestra.run.smithi121.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:08:23.492 INFO:teuthology.orchestra.run.smithi121.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:08:23.493 INFO:teuthology.orchestra.run.smithi121.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:08:23.493 INFO:teuthology.orchestra.run.smithi121.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:08:23.633 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:08:23.649 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:08:23.691 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi121.stdout:Fetched 10.4 MB in 1s (8,792 kB/s) 2024-09-12T00:08:23.952 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:08:23.980 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:08:24.012 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:08:24.018 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:08:24.081 INFO:teuthology.orchestra.run.smithi121.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:08:24.083 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:08:24.136 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:08:24.304 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:08:24.321 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:08:24.363 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:08:24.380 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:08:24.409 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:08:24.439 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:08:24.590 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:08:24.607 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:08:24.649 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:08:24.683 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:08:24.712 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:08:24.750 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:08:24.902 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:08:24.918 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:08:24.960 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:08:24.985 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:08:25.014 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:08:25.052 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:08:25.330 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:08:25.358 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:08:25.371 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:08:25.396 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:08:25.399 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:08:25.438 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:08:25.607 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:08:25.623 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:08:25.657 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:08:25.774 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:08:25.801 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:08:25.832 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:08:25.909 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:08:25.926 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:08:25.968 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:08:26.205 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:08:26.212 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:08:26.256 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:08:26.331 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:08:26.346 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:08:26.388 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:08:26.598 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:08:26.626 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:08:26.648 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:08:26.664 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:08:26.665 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:08:26.707 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:08:26.916 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:08:26.933 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:08:26.934 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:08:26.950 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:08:26.975 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:08:26.984 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:08:27.219 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:08:27.236 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:08:27.237 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:08:27.253 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:08:27.269 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:08:27.295 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:08:27.547 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:08:27.564 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:08:27.597 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:08:27.842 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:08:27.870 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:08:27.925 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:08:28.031 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:08:28.048 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:08:28.089 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:08:28.161 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:08:28.177 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:08:28.219 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:08:28.342 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:08:28.358 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:08:28.400 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:08:28.540 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:08:28.568 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:08:28.607 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:08:28.779 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:08:28.796 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:08:28.829 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:08:28.850 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:08:28.864 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:08:28.892 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:08:29.048 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:08:29.065 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:08:29.098 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:08:29.128 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:08:29.144 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:08:29.189 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:08:29.350 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:08:29.367 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:08:29.409 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:08:29.439 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:08:29.467 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:08:29.506 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:08:29.669 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:08:29.698 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:08:29.736 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:08:29.758 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:08:29.783 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:08:29.825 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:08:29.997 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:08:30.014 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:08:30.055 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:08:30.094 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:08:30.110 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:08:30.144 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:08:30.316 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:08:30.333 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:08:30.366 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:08:30.388 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:08:30.416 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:08:30.454 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:08:30.619 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:08:30.647 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:08:30.685 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:08:30.709 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:08:30.737 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:08:30.775 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:08:31.014 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:08:31.031 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:08:31.036 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:08:31.053 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:08:31.072 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:08:31.086 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:08:31.325 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:08:31.353 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:08:31.391 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:08:31.432 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:08:31.449 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:08:31.490 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:08:31.594 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:08:31.608 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:08:31.652 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:08:31.877 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:08:31.894 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:08:31.913 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:08:31.936 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:08:31.941 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:08:31.980 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:08:32.215 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:08:32.232 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:08:32.263 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:08:32.273 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:08:32.279 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:08:32.321 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:08:32.534 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:08:32.551 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:08:32.592 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:08:32.791 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package maven. 2024-09-12T00:08:32.820 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:08:32.858 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:08:32.880 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:08:32.896 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:08:32.930 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:08:33.153 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:08:33.175 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:08:33.181 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:08:33.203 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:08:33.219 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:08:33.241 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:08:33.464 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:08:33.480 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:08:33.502 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:08:33.519 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:08:33.522 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:08:33.552 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:08:33.830 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:08:33.846 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:08:33.860 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:08:33.888 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:08:33.969 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:08:34.089 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:08:34.212 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:08:34.276 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:08:34.305 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:08:34.343 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:08:34.363 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:08:34.490 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:08:34.605 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:08:34.616 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:08:34.620 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:08:34.662 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:08:34.742 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:08:34.868 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:08:34.977 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:08:35.086 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:08:35.098 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package maven. 2024-09-12T00:08:35.126 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:08:35.164 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:08:35.212 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:08:35.338 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:08:35.464 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:08:35.476 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:08:35.505 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:08:35.542 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:08:35.590 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:08:35.733 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:08:35.845 INFO:teuthology.orchestra.run.smithi121.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:08:35.873 INFO:teuthology.orchestra.run.smithi121.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:08:35.911 INFO:teuthology.orchestra.run.smithi121.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:08:36.001 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:08:36.111 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:08:36.228 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:08:36.273 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:08:36.400 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:08:36.526 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:08:36.618 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:08:36.644 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:08:36.770 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:08:36.896 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:08:36.974 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:08:37.022 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:08:37.100 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:08:37.148 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:08:37.226 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:08:37.274 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:08:37.399 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:08:37.509 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:08:37.510 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:08:37.610 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:08:37.628 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:08:37.711 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:08:37.754 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:08:37.880 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:08:37.907 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:08:38.006 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:08:38.031 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:08:38.132 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:08:38.157 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:08:38.258 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:08:38.384 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:08:38.425 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:08:38.502 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:08:38.551 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:08:38.603 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:08:38.677 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:08:38.754 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:08:38.786 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:08:38.880 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:08:38.887 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:08:39.004 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:08:39.131 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:08:39.138 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:08:39.209 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:08:39.432 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:08:39.558 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:08:39.667 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:08:39.768 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:08:39.869 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:08:39.986 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:08:40.088 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:08:40.189 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:08:40.314 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:08:40.457 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:08:40.564 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:08:40.570 DEBUG:teuthology.parallel:result is None 2024-09-12T00:08:40.583 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:08:40.709 INFO:teuthology.orchestra.run.smithi121.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:08:40.968 INFO:teuthology.orchestra.run.smithi121.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:08:41.030 INFO:teuthology.orchestra.run.smithi121.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:08:42.433 INFO:teuthology.orchestra.run.smithi121.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:08:42.438 DEBUG:teuthology.parallel:result is None 2024-09-12T00:08:42.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:08:42.590 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:08:42.609 INFO:teuthology.orchestra.run.smithi102.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:08:42.610 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:08:42.611 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:08:42.613 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:08:42.764 DEBUG:teuthology.orchestra.run.smithi121:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:08:42.783 INFO:teuthology.orchestra.run.smithi121.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:08:42.783 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:08:42.783 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:08:42.785 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:08:42.786 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:08:42.786 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:08:42.800 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:08:42.800 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:08:42.840 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:08:42.840 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:08:42.840 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:08:42.853 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:08:42.908 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:08:42.908 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:08:42.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:08:42.980 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:08:42.981 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:08:42.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:08:42.993 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:08:43.049 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:08:43.050 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:08:43.063 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:08:43.119 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:08:43.119 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:08:43.120 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:08:43.134 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:08:43.188 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:08:43.188 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:08:43.201 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:08:43.254 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:08:43.343 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:08:43.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-09-12T00:08:43.346 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2024-09-12T00:08:43.359 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:08:43.359 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:08:43.403 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:08:43.415 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:08:43.415 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:08:43.459 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:08:43.510 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:08:43.510 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:08:43.510 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7901828', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKejTcU641875ax++hgU9wM0bKVK0firMrAWRIFSTfFV/WR2vhBWrq6S6LeNmweBTyvvtaFYutF+y3IVHsFGUH0=', 'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCHplrWTR+zkU2iT4vUhVIM6+n3kHg/V0xjmvT2sjAP+EvuF1AD4KKllDlTDSUNKrBH/Sj1Tqu2S5W0VHkaMqUk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:08:43.511 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:08:43.515 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:08:43.520 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:08:43.563 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:08:43.576 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:08:43.576 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:08:43.622 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:08:43.622 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-12T00:08:43.669 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:08:43.670 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:08:43.670 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-12T00:08:43.670 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:08:43.670 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-12 00:02:56.453853600 +0000 2024-09-12T00:08:43.670 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-12 00:02:56.193855923 +0000 2024-09-12T00:08:43.670 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-12 00:02:56.193855923 +0000 2024-09-12T00:08:43.670 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-12T00:08:43.670 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:08:43.723 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-12T00:08:43.724 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-12T00:08:43.724 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000448313 s, 1.1 MB/s 2024-09-12T00:08:43.725 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:08:43.775 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-12T00:08:43.821 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:08:43.821 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:08:43.822 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-12T00:08:43.822 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:08:43.822 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-12 00:02:56.673851635 +0000 2024-09-12T00:08:43.822 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-12 00:02:56.669851671 +0000 2024-09-12T00:08:43.822 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-12 00:02:56.669851671 +0000 2024-09-12T00:08:43.822 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-12T00:08:43.822 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:08:43.876 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-12T00:08:43.876 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-12T00:08:43.876 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.00044348 s, 1.2 MB/s 2024-09-12T00:08:43.877 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:08:43.927 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-12T00:08:43.974 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:08:43.974 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:08:43.974 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-12T00:08:43.974 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:08:43.974 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-12 00:02:57.429844883 +0000 2024-09-12T00:08:43.974 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-12 00:02:57.157847312 +0000 2024-09-12T00:08:43.974 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-12 00:02:57.157847312 +0000 2024-09-12T00:08:43.974 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-12T00:08:43.974 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:08:44.028 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-12T00:08:44.028 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-12T00:08:44.028 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000364534 s, 1.4 MB/s 2024-09-12T00:08:44.029 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:08:44.078 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-12T00:08:44.125 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:08:44.125 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:08:44.125 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-09-12T00:08:44.126 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:08:44.126 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-12 00:02:57.929840416 +0000 2024-09-12T00:08:44.126 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-12 00:02:57.681842632 +0000 2024-09-12T00:08:44.126 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-12 00:02:57.681842632 +0000 2024-09-12T00:08:44.126 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-12T00:08:44.126 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:08:44.180 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-12T00:08:44.180 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-12T00:08:44.181 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.00037555 s, 1.4 MB/s 2024-09-12T00:08:44.182 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:08:44.231 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:08:44.231 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:08:44.231 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:08:44.237 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:08:44.238 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-09-12T00:08:44.284 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:08:44.285 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:08:44.285 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-09-12T00:08:44.285 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:08:44.285 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-12 00:02:57.114052816 +0000 2024-09-12T00:08:44.285 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-12 00:02:56.866055031 +0000 2024-09-12T00:08:44.285 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-12 00:02:56.866055031 +0000 2024-09-12T00:08:44.285 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-09-12T00:08:44.285 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:08:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-12T00:08:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-12T00:08:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000451757 s, 1.1 MB/s 2024-09-12T00:08:44.340 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:08:44.389 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-09-12T00:08:44.436 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:08:44.436 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:08:44.437 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-09-12T00:08:44.437 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:08:44.437 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-12 00:02:57.602048457 +0000 2024-09-12T00:08:44.437 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-12 00:02:57.366050565 +0000 2024-09-12T00:08:44.437 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-12 00:02:57.366050565 +0000 2024-09-12T00:08:44.437 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-09-12T00:08:44.437 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:08:44.490 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-12T00:08:44.490 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-12T00:08:44.491 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000308202 s, 1.7 MB/s 2024-09-12T00:08:44.492 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:08:44.541 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-09-12T00:08:44.588 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:08:44.589 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:08:44.589 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-09-12T00:08:44.589 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:08:44.589 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-12 00:02:58.074044241 +0000 2024-09-12T00:08:44.589 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-12 00:02:57.834046385 +0000 2024-09-12T00:08:44.589 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-12 00:02:57.834046385 +0000 2024-09-12T00:08:44.589 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-09-12T00:08:44.590 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:08:44.643 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-12T00:08:44.643 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-12T00:08:44.643 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000408677 s, 1.3 MB/s 2024-09-12T00:08:44.644 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:08:44.694 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-09-12T00:08:44.740 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:08:44.740 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:08:44.740 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-09-12T00:08:44.741 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:08:44.741 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-12 00:02:58.606039489 +0000 2024-09-12T00:08:44.741 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-12 00:02:58.318042062 +0000 2024-09-12T00:08:44.741 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-12 00:02:58.318042062 +0000 2024-09-12T00:08:44.741 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: - 2024-09-12T00:08:44.741 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:08:44.794 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-12T00:08:44.794 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-12T00:08:44.794 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000374845 s, 1.4 MB/s 2024-09-12T00:08:44.795 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:08:44.845 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:08:44.846 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:08:44.846 INFO:tasks.ceph:Generating config... 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T00:08:44.848 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:08:44.849 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:08:44.849 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:08:44.849 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:08:44.849 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:08:44.849 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:08:44.850 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:08:44.850 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:08:44.850 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:08:44.850 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T00:08:44.850 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:08:44.850 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:08:44.850 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:08:44.850 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:08:44.850 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:08:44.850 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:08:44.850 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:08:44.850 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T00:08:44.850 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:08:44.851 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:08:44.852 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T00:08:44.852 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:08:44.852 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:08:44.852 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:08:44.852 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:08:44.887 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:08:44.894 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:08:44.969 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:08:45.023 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.102'), ('mon.c', '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]'), ('mon.b', '172.21.15.121')] 2024-09-12T00:08:45.024 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],172.21.15.121', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:08:45.024 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:08:45.025 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:08:45.070 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.102 --addv c '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]' --add b 172.21.15.121 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:08:45.155 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:08:45.155 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:08:45.156 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:08:45.156 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: generated fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:08:45.156 INFO:teuthology.orchestra.run.smithi102.stdout:setting min_mon_release = quincy 2024-09-12T00:08:45.156 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 0 2024-09-12T00:08:45.156 INFO:teuthology.orchestra.run.smithi102.stdout:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:08:45.156 INFO:teuthology.orchestra.run.smithi102.stdout:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:08:45.156 INFO:teuthology.orchestra.run.smithi102.stdout:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:08:45.156 INFO:teuthology.orchestra.run.smithi102.stdout:min_mon_release 17 (quincy) 2024-09-12T00:08:45.157 INFO:teuthology.orchestra.run.smithi102.stdout:election_strategy: 1 2024-09-12T00:08:45.157 INFO:teuthology.orchestra.run.smithi102.stdout:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:08:45.157 INFO:teuthology.orchestra.run.smithi102.stdout:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:08:45.157 INFO:teuthology.orchestra.run.smithi102.stdout:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:08:45.157 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:08:45.158 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:08:45.206 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434... 2024-09-12T00:08:45.207 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:08:45.250 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:08:45.278 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-12T00:08:45.278 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-12T00:08:45.278 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:08:45.278 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-12T00:08:45.278 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.278 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-12T00:08:45.278 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.278 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-12T00:08:45.278 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.279 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:08:45.280 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],172.21.15.121" 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: mon client directed command retry = 5 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject socket failures = 5000 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: osd heartbeat grace = 40 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:08:45.281 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-12T00:08:45.282 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:08:45.283 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: bdev async discard = True 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: bdev enable discard = True 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore allocator = bitmap 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: debug objclass = 20 2024-09-12T00:08:45.284 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: osd fast shutdown = False 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: osd shutdown pgref assert = True 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-12T00:08:45.285 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-12T00:08:45.286 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:08:45.287 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd crush smoke test = False 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = True 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:08:45.288 INFO:teuthology.orchestra.run.smithi102.stdout: debug rgw = 20 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: debug rgw notification = 20 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw bucket counters cache = True 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw crypt require ssl = False 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw s3 auth use sts = True 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw torrent flag = True 2024-09-12T00:08:45.289 INFO:teuthology.orchestra.run.smithi102.stdout: rgw user counters cache = True 2024-09-12T00:08:45.290 INFO:teuthology.orchestra.run.smithi102.stdout: setgroup = ceph 2024-09-12T00:08:45.290 INFO:teuthology.orchestra.run.smithi102.stdout: setuser = ceph 2024-09-12T00:08:45.290 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-12T00:08:45.290 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-09-12T00:08:45.290 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-09-12T00:08:45.290 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-09-12T00:08:45.290 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-09-12T00:08:45.290 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-09-12T00:08:45.291 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-09-12T00:08:45.293 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = "172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],172.21.15.121" 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: mon client directed command retry = 5 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: ms inject socket failures = 5000 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: osd heartbeat grace = 40 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:08:45.294 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.295 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: bdev async discard = True 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: bdev enable discard = True 2024-09-12T00:08:45.296 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore allocator = bitmap 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 1/20 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 1/20 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: debug objclass = 20 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 4/10 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:08:45.297 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: osd fast shutdown = False 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: osd shutdown pgref assert = True 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-09-12T00:08:45.298 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.299 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd crush smoke test = False 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-12T00:08:45.300 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = True 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: debug rgw = 20 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: debug rgw notification = 20 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: rgw bucket counters cache = True 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: rgw crypt require ssl = False 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T00:08:45.301 INFO:teuthology.orchestra.run.smithi121.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T00:08:45.302 INFO:teuthology.orchestra.run.smithi121.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:08:45.302 INFO:teuthology.orchestra.run.smithi121.stdout: rgw s3 auth use sts = True 2024-09-12T00:08:45.302 INFO:teuthology.orchestra.run.smithi121.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:08:45.302 INFO:teuthology.orchestra.run.smithi121.stdout: rgw torrent flag = True 2024-09-12T00:08:45.302 INFO:teuthology.orchestra.run.smithi121.stdout: rgw user counters cache = True 2024-09-12T00:08:45.302 INFO:teuthology.orchestra.run.smithi121.stdout: setgroup = ceph 2024-09-12T00:08:45.302 INFO:teuthology.orchestra.run.smithi121.stdout: setuser = ceph 2024-09-12T00:08:45.302 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-09-12T00:08:45.302 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.c] 2024-09-12T00:08:45.302 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.b] 2024-09-12T00:08:45.304 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:08:45.304 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:08:45.395 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:08:45.395 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:08:45.395 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:08:45.400 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:08:45.400 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:08:45.450 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T00:08:45.450 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:08:45.450 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:08:45.450 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:08:45.514 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:08:45.515 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:08:45.562 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T00:08:45.562 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:08:45.562 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:08:45.562 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:08:45.586 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:08:45.587 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:08:45.632 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:08:45.632 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:08:45.633 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:08:45.676 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:08:45.678 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:08:45.721 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:08:45.730 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:08:45.730 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:08:45.730 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:08:45.765 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:08:45.775 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:08:45.810 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:08:45.821 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:08:45.821 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:08:45.822 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:08:45.834 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:08:45.834 INFO:tasks.ceph:role: osd.0 2024-09-12T00:08:45.835 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T00:08:45.835 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:08:45.896 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:08:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:08:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:08:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:08:45.897 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:08:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:08:45.897 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:08:45.897 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:08:45.897 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:08:45.897 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:08:46.353 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-12T00:08:46.355 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-12T00:08:46.355 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:08:46.450 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:08:46.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:08:46.460 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:08:46.460 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:08:46.512 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:08:46.512 INFO:tasks.ceph:role: osd.1 2024-09-12T00:08:46.512 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T00:08:46.513 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:08:46.573 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:08:46.573 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:08:46.573 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:08:46.573 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:08:46.574 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:08:46.574 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:08:46.574 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:08:46.574 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:08:46.574 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:08:46.574 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:08:47.044 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-12T00:08:47.046 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-12T00:08:47.047 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:08:47.201 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:08:47.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:08:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:08:47.213 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:08:47.273 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:08:47.274 INFO:tasks.ceph:role: osd.2 2024-09-12T00:08:47.274 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T00:08:47.274 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:08:47.337 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:08:47.337 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:08:47.338 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:08:47.338 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:08:47.338 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:08:47.338 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:08:47.338 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:08:47.338 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:08:47.338 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:08:47.338 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:08:47.809 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-12T00:08:47.810 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-12T00:08:47.810 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:08:47.950 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:08:47.961 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:08:47.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:08:47.962 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:08:48.021 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:08:48.021 INFO:tasks.ceph:role: osd.3 2024-09-12T00:08:48.021 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T00:08:48.021 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:08:48.084 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:08:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:08:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:08:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:08:48.085 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:08:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:08:48.085 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:08:48.085 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:08:48.086 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:08:48.086 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:08:48.515 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-12T00:08:48.518 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-12T00:08:48.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:08:48.616 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:08:48.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:08:48.626 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:08:48.627 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:08:48.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:48.767+0000 7fbee2e377c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:08:48.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:48.771+0000 7fbee2e377c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:08:48.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:48.771+0000 7fbee2e377c0 -1 bdev(0x5604f688b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:08:48.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:48.771+0000 7fbee2e377c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:08:52.141 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:08:52.155 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:08:52.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:52.239+0000 7fb205ff57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:08:52.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:52.239+0000 7fb205ff57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:08:52.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:52.239+0000 7fb205ff57c0 -1 bdev(0x561d85389800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:08:52.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:52.239+0000 7fb205ff57c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:08:55.364 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:08:55.418 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:08:55.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:55.499+0000 7f20a69cc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:08:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:55.499+0000 7f20a69cc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:08:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:55.499+0000 7f20a69cc7c0 -1 bdev(0x561c845a7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:08:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:55.499+0000 7f20a69cc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:08:58.617 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:08:58.674 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:08:58.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:58.755+0000 7f5c4bd097c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:08:58.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:58.755+0000 7f5c4bd097c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:08:58.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:58.755+0000 7f5c4bd097c0 -1 bdev(0x563d197d1800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:08:58.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:08:58.755+0000 7f5c4bd097c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:09:01.890 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:09:01.947 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:09:01.961 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:09:01.961 INFO:tasks.ceph:role: osd.4 2024-09-12T00:09:01.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T00:09:01.962 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:09:02.025 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:09:02.026 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:09:02.026 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:09:02.026 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:09:02.026 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:09:02.026 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:09:02.026 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:09:02.026 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:09:02.026 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:09:02.026 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:09:02.519 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-12T00:09:02.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-12T00:09:02.522 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:09:02.640 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:09:02.651 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:09:02.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:09:02.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:09:02.709 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:09:02.710 INFO:tasks.ceph:role: osd.5 2024-09-12T00:09:02.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T00:09:02.710 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:09:02.772 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:09:02.772 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:09:02.772 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:09:02.772 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:09:02.772 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:09:02.772 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:09:02.772 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:09:02.772 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:09:02.772 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:09:02.772 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:09:03.211 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-12T00:09:03.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-12T00:09:03.213 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:09:03.278 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:09:03.331 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:09:03.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:09:03.333 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:09:03.388 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:09:03.388 INFO:tasks.ceph:role: osd.6 2024-09-12T00:09:03.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T00:09:03.389 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:09:03.452 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:09:03.452 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:09:03.452 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:09:03.452 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:09:03.452 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:09:03.452 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:09:03.452 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:09:03.453 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:09:03.453 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:09:03.453 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:09:03.916 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-12T00:09:03.918 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-12T00:09:03.918 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:09:03.998 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:09:04.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:09:04.048 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:09:04.049 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:09:04.101 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:09:04.101 INFO:tasks.ceph:role: osd.7 2024-09-12T00:09:04.102 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T00:09:04.102 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:09:04.164 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:09:04.164 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:09:04.164 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:09:04.164 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:09:04.165 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:09:04.165 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:09:04.165 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:09:04.165 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:09:04.165 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:09:04.165 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:09:04.659 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-12T00:09:04.661 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-12T00:09:04.661 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:09:04.802 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:09:04.812 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:09:04.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:09:04.813 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:09:04.920 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:04.921+0000 7ff94622e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:09:04.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:04.925+0000 7ff94622e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:09:04.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:04.925+0000 7ff94622e7c0 -1 bdev(0x555a971e1800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:09:04.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:04.925+0000 7ff94622e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:09:08.050 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:09:08.063 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:09:08.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:08.145+0000 7fccaa40a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:09:08.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:08.145+0000 7fccaa40a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:09:08.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:08.145+0000 7fccaa40a7c0 -1 bdev(0x562ef17d3800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:09:08.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:08.145+0000 7fccaa40a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:09:11.284 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:09:11.344 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:09:11.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:11.425+0000 7f70052f87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:09:11.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:11.425+0000 7f70052f87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:09:11.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:11.425+0000 7f70052f87c0 -1 bdev(0x55c85b5bb800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:09:11.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:11.425+0000 7f70052f87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:09:14.575 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:09:14.628 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:09:14.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:14.709+0000 7fc80238a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:14.713+0000 7fc80238a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:14.713+0000 7fc80238a7c0 -1 bdev(0x55e07c2a1800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-12T00:09:14.713+0000 7fc80238a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:09:17.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:09:17.916 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:09:17.917 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:17.917 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:09:17.931 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:17.931 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:09:17.985 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:17.986 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:09:18.043 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:18.044 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:09:18.100 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:18.101 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:09:18.152 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:09:18.152 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:09:18.165 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:09:18.166 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:09:18.219 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:09:18.219 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:09:18.270 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:09:18.270 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:09:18.322 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:09:18.323 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:09:18.378 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:18.379 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:09:18.384 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:09:18.384 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:09:18.424 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:09:18.424 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:09:18.433 DEBUG:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:09:18.469 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQANMeJmwDGWKBAAMwMyAKYg5f8VA7xi8lop7g== 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAQMeJm2Vz3LRAAF8YNmLJZQ5j6h5MONAQlVA== 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAUMeJmtTtwDhAA5WcrP+IxJTrPl7TZoPWSAw== 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAXMeJmlVcYHhAATqTBhNhzNeHTHt/tQ0kzdw== 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAaMeJmX/5SLRAAAI1rJz4T3wSY0ekqzKCluA== 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2024-09-12T00:09:18.470 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQANMeJm1302KxAAr6Q5QCZdNnAxuZ8mPAr4jw== 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAgMeJmhIQcNxAA0Jg7cRrfRCAnw6dhuHPe4w== 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAkMeJmp0rsCBAAK0Xl/knaJyyyh5QcGo3xqw== 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAnMeJmUCagGRAAJh5yJK/1GYV2crFFhqmaOw== 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQAqMeJmzZKnKhAAmzhfxKesLzrQ6mRbk6WioQ== 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQANMeJm1B/pLRAA9T8KEpZc7pxnKGyiTAtMIw== 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2024-09-12T00:09:18.471 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQANMeJmH8eQMBAAS9ydhrtGY8AsB0KHAfwfwQ== 2024-09-12T00:09:18.477 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.y] 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANMeJmwDGWKBAAMwMyAKYg5f8VA7xi8lop7g== 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAQMeJm2Vz3LRAAF8YNmLJZQ5j6h5MONAQlVA== 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAUMeJmtTtwDhAA5WcrP+IxJTrPl7TZoPWSAw== 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAXMeJmlVcYHhAATqTBhNhzNeHTHt/tQ0kzdw== 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.3] 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAaMeJmX/5SLRAAAI1rJz4T3wSY0ekqzKCluA== 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANMeJm1302KxAAr6Q5QCZdNnAxuZ8mPAr4jw== 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.4] 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAgMeJmhIQcNxAA0Jg7cRrfRCAnw6dhuHPe4w== 2024-09-12T00:09:18.478 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.5] 2024-09-12T00:09:18.479 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAkMeJmp0rsCBAAK0Xl/knaJyyyh5QcGo3xqw== 2024-09-12T00:09:18.479 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.6] 2024-09-12T00:09:18.479 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAnMeJmUCagGRAAJh5yJK/1GYV2crFFhqmaOw== 2024-09-12T00:09:18.479 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.7] 2024-09-12T00:09:18.479 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQAqMeJmzZKnKhAAmzhfxKesLzrQ6mRbk6WioQ== 2024-09-12T00:09:18.479 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-12T00:09:18.479 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANMeJm1B/pLRAA9T8KEpZc7pxnKGyiTAtMIw== 2024-09-12T00:09:18.479 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2024-09-12T00:09:18.479 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQANMeJmH8eQMBAAS9ydhrtGY8AsB0KHAfwfwQ== 2024-09-12T00:09:18.480 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:09:18.522 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:09:18.568 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:18.570 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:18.611 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:18.654 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:18.698 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:18.700 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:18.778 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:18.786 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:18.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:09:18.866 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:09:18.948 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:18.950 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:18.991 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:19.034 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:19.078 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:19.119 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:19.159 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:19.202 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:09:19.245 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:09:19.286 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:09:19.334 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:09:19.375 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:09:19.423 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:09:19.424 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:09:19.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:09:19.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:09:19.547 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:09:19.597 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:09:19.685 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:09:19.695 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:09:19.709 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:09:19.804 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:09:19.814 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:09:19.817 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:09:19.861 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:09:19.862 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:09:19.862 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:09:19.866 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:09:19.866 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:09:19.866 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:09:19.869 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:09:19.869 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:09:19.869 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:09:19.909 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:09:19.909 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:09:19.910 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:09:19.910 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:09:19.912 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:09:19.912 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:09:19.912 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:09:19.915 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:09:19.915 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:09:19.915 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:09:19.915 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:09:26.125 INFO:teuthology.orchestra.run.smithi102.stderr:adjusted tunables profile to default 2024-09-12T00:09:26.144 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:09:26.145 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:09:26.145 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:26.145 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:09:26.156 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:26.156 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:09:26.210 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:26.210 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:09:26.264 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:26.264 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:09:26.317 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:09:26.317 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:09:26.330 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:09:26.330 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:09:26.383 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:09:26.383 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:09:26.439 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-12T00:09:26.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:09:26.495 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 0b227208-8b0b-40b7-86af-a3fceb4c1dd5 0 2024-09-12T00:09:26.763 INFO:teuthology.orchestra.run.smithi121.stdout:0 2024-09-12T00:09:26.779 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 616a3dee-4034-4eaa-843f-b03ee416c716 1 2024-09-12T00:09:26.993 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-12T00:09:27.010 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 7278941b-405f-4f57-b2ca-568eb73d137b 2 2024-09-12T00:09:27.217 INFO:teuthology.orchestra.run.smithi121.stdout:2 2024-09-12T00:09:27.229 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 6ee9c72e-0150-4c2e-bcce-c57a772fc13f 3 2024-09-12T00:09:27.450 INFO:teuthology.orchestra.run.smithi121.stdout:3 2024-09-12T00:09:27.467 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new f364f405-9739-4160-95d2-73606bcfb3e9 4 2024-09-12T00:09:27.670 INFO:teuthology.orchestra.run.smithi121.stdout:4 2024-09-12T00:09:27.685 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 883c0010-02d5-487e-b74c-8f6558b41b8c 5 2024-09-12T00:09:27.932 INFO:teuthology.orchestra.run.smithi121.stdout:5 2024-09-12T00:09:27.948 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 6014bfe5-bacf-49a8-a138-48472a94792f 6 2024-09-12T00:09:28.139 INFO:teuthology.orchestra.run.smithi121.stdout:6 2024-09-12T00:09:28.155 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 91c1b7d3-f3ab-41fe-98cc-c76ce4826a86 7 2024-09-12T00:09:28.171 INFO:tasks.ceph.mgr.x.smithi121.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:09:28.171 INFO:tasks.ceph.mgr.x.smithi121.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:09:28.171 INFO:tasks.ceph.mgr.x.smithi121.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:09:28.353 INFO:teuthology.orchestra.run.smithi121.stdout:7 2024-09-12T00:09:28.369 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:09:28.369 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:09:28.372 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:09:28.372 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:09:28.372 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:09:28.374 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:09:28.374 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:09:28.374 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:09:28.376 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:09:28.377 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:09:28.377 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:09:28.379 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:09:28.379 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:09:28.379 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:09:28.413 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:09:28.413 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:09:28.414 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:09:28.416 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:09:28.416 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:09:28.416 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:09:28.419 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:09:28.419 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:09:28.419 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:09:28.422 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:09:28.422 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:09:28.637 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:09:28.637 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":10,"fsid":"92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434","created":"2024-09-12T00:09:25.299238+0000","modified":"2024-09-12T00:09:28.354915+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:09:28.354915+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0b227208-8b0b-40b7-86af-a3fceb4c1dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"616a3dee-4034-4eaa-843f-b03ee416c716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7278941b-405f-4f57-b2ca-568eb73d137b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6ee9c72e-0150-4c2e-bcce-c57a772fc13f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f364f405-9739-4160-95d2-73606bcfb3e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"883c0010-02d5-487e-b74c-8f6558b41b8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6014bfe5-bacf-49a8-a138-48472a94792f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"91c1b7d3-f3ab-41fe-98cc-c76ce4826a86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:09:28.654 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:09:28.654 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:09:28.812 INFO:tasks.ceph.mgr.y.smithi102.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:09:28.812 INFO:tasks.ceph.mgr.y.smithi102.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:09:28.812 INFO:tasks.ceph.mgr.y.smithi102.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:09:29.461 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:09:29.605 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-12T00:09:29.607+0000 7f5ee63047c0 -1 Falling back to public interface 2024-09-12T00:09:29.629 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-12T00:09:29.631+0000 7f4c732997c0 -1 Falling back to public interface 2024-09-12T00:09:29.646 INFO:teuthology.misc.health.smithi102.stdout: 2024-09-12T00:09:29.646 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":10,"fsid":"92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434","created":"2024-09-12T00:09:25.299238+0000","modified":"2024-09-12T00:09:28.354915+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:09:28.354915+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0b227208-8b0b-40b7-86af-a3fceb4c1dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"616a3dee-4034-4eaa-843f-b03ee416c716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7278941b-405f-4f57-b2ca-568eb73d137b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6ee9c72e-0150-4c2e-bcce-c57a772fc13f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f364f405-9739-4160-95d2-73606bcfb3e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"883c0010-02d5-487e-b74c-8f6558b41b8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6014bfe5-bacf-49a8-a138-48472a94792f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"91c1b7d3-f3ab-41fe-98cc-c76ce4826a86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:09:29.661 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:09:29.793 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-12T00:09:29.795+0000 7fb4943097c0 -1 Falling back to public interface 2024-09-12T00:09:30.029 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-12T00:09:30.031+0000 7ff79a96b7c0 -1 Falling back to public interface 2024-09-12T00:09:30.060 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-09-12T00:09:30.061+0000 7fa6c8f567c0 -1 Falling back to public interface 2024-09-12T00:09:30.108 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-09-12T00:09:30.109+0000 7f89ffb0b7c0 -1 Falling back to public interface 2024-09-12T00:09:30.128 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-09-12T00:09:30.129+0000 7f6e486c37c0 -1 Falling back to public interface 2024-09-12T00:09:30.337 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-09-12T00:09:30.337+0000 7f7bb3e4b7c0 -1 Falling back to public interface 2024-09-12T00:09:31.057 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-12T00:09:31.057+0000 7f5cd5880640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:09:31.063 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-12T00:09:31.061+0000 7f5cd5880640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:09:33.911 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-12T00:09:33.911+0000 7f4c732997c0 -1 osd.0 0 log_to_monitors true 2024-09-12T00:09:34.008 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-12T00:09:34.011+0000 7f5ee63047c0 -1 osd.3 0 log_to_monitors true 2024-09-12T00:09:34.139 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-12T00:09:34.139+0000 7fb4943097c0 -1 osd.2 0 log_to_monitors true 2024-09-12T00:09:34.162 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-09-12T00:09:34.161+0000 7f6e486c37c0 -1 osd.7 0 log_to_monitors true 2024-09-12T00:09:34.244 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-12T00:09:34.243+0000 7ff79a96b7c0 -1 osd.1 0 log_to_monitors true 2024-09-12T00:09:34.283 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-09-12T00:09:34.281+0000 7f7bb3e4b7c0 -1 osd.4 0 log_to_monitors true 2024-09-12T00:09:34.309 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-09-12T00:09:34.309+0000 7fa6c8f567c0 -1 osd.6 0 log_to_monitors true 2024-09-12T00:09:34.592 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-09-12T00:09:34.593+0000 7f89ffb0b7c0 -1 osd.5 0 log_to_monitors true 2024-09-12T00:09:36.469 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:09:36.862 INFO:teuthology.misc.health.smithi102.stdout: 2024-09-12T00:09:36.862 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":13,"fsid":"92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434","created":"2024-09-12T00:09:25.299238+0000","modified":"2024-09-12T00:09:36.408651+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:09:28.354915+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0b227208-8b0b-40b7-86af-a3fceb4c1dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"616a3dee-4034-4eaa-843f-b03ee416c716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7278941b-405f-4f57-b2ca-568eb73d137b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6ee9c72e-0150-4c2e-bcce-c57a772fc13f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f364f405-9739-4160-95d2-73606bcfb3e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"883c0010-02d5-487e-b74c-8f6558b41b8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6014bfe5-bacf-49a8-a138-48472a94792f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"91c1b7d3-f3ab-41fe-98cc-c76ce4826a86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:09:36.889 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:09:37.052 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-09-12T00:09:37.053+0000 7f7bafdf4640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:09:37.090 INFO:tasks.ceph.osd.4.smithi121.stderr:2024-09-12T00:09:37.089+0000 7f7ba7c26640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:09:37.133 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-09-12T00:09:37.133+0000 7fa6c4eff640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:09:37.156 INFO:tasks.ceph.osd.6.smithi121.stderr:2024-09-12T00:09:37.157+0000 7fa6bcd31640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:09:37.178 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-09-12T00:09:37.177+0000 7f6e4466c640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:09:37.212 INFO:tasks.ceph.osd.7.smithi121.stderr:2024-09-12T00:09:37.213+0000 7f6e3c49e640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:09:37.454 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-12T00:09:37.455+0000 7f5ee2abf640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:09:37.454 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-12T00:09:37.455+0000 7f4c6f242640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:09:37.472 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-12T00:09:37.471+0000 7ff797126640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:09:37.481 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-12T00:09:37.483+0000 7f4c67074640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:09:37.487 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-12T00:09:37.487+0000 7fb4902b2640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:09:37.501 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-12T00:09:37.503+0000 7f5eda0df640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:09:37.509 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-12T00:09:37.511+0000 7ff78e746640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:09:37.521 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-12T00:09:37.523+0000 7fb4880e4640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:09:37.617 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-09-12T00:09:37.617+0000 7f89fbab4640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:09:37.644 INFO:tasks.ceph.osd.5.smithi121.stderr:2024-09-12T00:09:37.645+0000 7f89f38e6640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:09:43.696 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:09:44.005 INFO:teuthology.misc.health.smithi102.stdout: 2024-09-12T00:09:44.005 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":17,"fsid":"92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434","created":"2024-09-12T00:09:25.299238+0000","modified":"2024-09-12T00:09:41.089068+0000","last_up_change":"2024-09-12T00:09:38.063826+0000","last_in_change":"2024-09-12T00:09:28.354915+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:09:38.091156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b227208-8b0b-40b7-86af-a3fceb4c1dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6809","nonce":1237794167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6811","nonce":1237794167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6815","nonce":1237794167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6813","nonce":1237794167}]},"public_addr":"172.21.15.102:6809/1237794167","cluster_addr":"172.21.15.102:6811/1237794167","heartbeat_back_addr":"172.21.15.102:6815/1237794167","heartbeat_front_addr":"172.21.15.102:6813/1237794167","state":["exists","up"]},{"osd":1,"uuid":"616a3dee-4034-4eaa-843f-b03ee416c716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6825","nonce":1865676346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6827","nonce":1865676346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6831","nonce":1865676346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6829","nonce":1865676346}]},"public_addr":"172.21.15.102:6825/1865676346","cluster_addr":"172.21.15.102:6827/1865676346","heartbeat_back_addr":"172.21.15.102:6831/1865676346","heartbeat_front_addr":"172.21.15.102:6829/1865676346","state":["exists","up"]},{"osd":2,"uuid":"7278941b-405f-4f57-b2ca-568eb73d137b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6817","nonce":1118146796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6819","nonce":1118146796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6823","nonce":1118146796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6821","nonce":1118146796}]},"public_addr":"172.21.15.102:6817/1118146796","cluster_addr":"172.21.15.102:6819/1118146796","heartbeat_back_addr":"172.21.15.102:6823/1118146796","heartbeat_front_addr":"172.21.15.102:6821/1118146796","state":["exists","up"]},{"osd":3,"uuid":"6ee9c72e-0150-4c2e-bcce-c57a772fc13f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6801","nonce":1464080842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6803","nonce":1464080842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6807","nonce":1464080842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6805","nonce":1464080842}]},"public_addr":"172.21.15.102:6801/1464080842","cluster_addr":"172.21.15.102:6803/1464080842","heartbeat_back_addr":"172.21.15.102:6807/1464080842","heartbeat_front_addr":"172.21.15.102:6805/1464080842","state":["exists","up"]},{"osd":4,"uuid":"f364f405-9739-4160-95d2-73606bcfb3e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6827","nonce":1318321638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6829","nonce":1318321638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6833","nonce":1318321638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6831","nonce":1318321638}]},"public_addr":"172.21.15.121:6827/1318321638","cluster_addr":"172.21.15.121:6829/1318321638","heartbeat_back_addr":"172.21.15.121:6833/1318321638","heartbeat_front_addr":"172.21.15.121:6831/1318321638","state":["exists","up"]},{"osd":5,"uuid":"883c0010-02d5-487e-b74c-8f6558b41b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6811","nonce":1906913778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6813","nonce":1906913778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6817","nonce":1906913778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6815","nonce":1906913778}]},"public_addr":"172.21.15.121:6811/1906913778","cluster_addr":"172.21.15.121:6813/1906913778","heartbeat_back_addr":"172.21.15.121:6817/1906913778","heartbeat_front_addr":"172.21.15.121:6815/1906913778","state":["exists","up"]},{"osd":6,"uuid":"6014bfe5-bacf-49a8-a138-48472a94792f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6803","nonce":901978356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6805","nonce":901978356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6809","nonce":901978356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6807","nonce":901978356}]},"public_addr":"172.21.15.121:6803/901978356","cluster_addr":"172.21.15.121:6805/901978356","heartbeat_back_addr":"172.21.15.121:6809/901978356","heartbeat_front_addr":"172.21.15.121:6807/901978356","state":["exists","up"]},{"osd":7,"uuid":"91c1b7d3-f3ab-41fe-98cc-c76ce4826a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6819","nonce":3404057850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6821","nonce":3404057850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6825","nonce":3404057850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6823","nonce":3404057850}]},"public_addr":"172.21.15.121:6819/3404057850","cluster_addr":"172.21.15.121:6821/3404057850","heartbeat_back_addr":"172.21.15.121:6825/3404057850","heartbeat_front_addr":"172.21.15.121:6823/3404057850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:34.951640+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.295761+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.128138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.031338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.295702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.628290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.279886+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.148247+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:09:44.023 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:09:44.023 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:09:44.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:09:45.140 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'rbd' created 2024-09-12T00:09:45.167 DEBUG:teuthology.orchestra.run.smithi102:> rbd --cluster ceph pool init rbd 2024-09-12T00:09:45.215 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:09:45.215 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:09:48.206 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:09:48.207 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:09:48.207 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:09:48.565 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:09:48.584 INFO:teuthology.orchestra.run.smithi102.stdout:[{"version":9,"timestamp":"2024-09-12T00:09:37.623983+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"6843.160286"}]}] 2024-09-12T00:09:48.584 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:09:48.585 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:09:48.585 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:09:48.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:09:48.936 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:09:48.954 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":3541484140},{"type":"v1","addr":"172.21.15.121:6801","nonce":3541484140}]},"active_addr":"172.21.15.121:6801/3541484140","active_change":"2024-09-12T00:09:30.040962+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":2077101679}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":4205090566}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":33533861}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":3980512713}]}]} 2024-09-12T00:09:48.958 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:09:48.958 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:09:48.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:09:49.254 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:09:49.254 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434","created":"2024-09-12T00:09:25.299238+0000","modified":"2024-09-12T00:09:48.166325+0000","last_up_change":"2024-09-12T00:09:38.063826+0000","last_in_change":"2024-09-12T00:09:28.354915+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:09:38.091156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:09:44.342579+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b227208-8b0b-40b7-86af-a3fceb4c1dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6809","nonce":1237794167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6811","nonce":1237794167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6815","nonce":1237794167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6813","nonce":1237794167}]},"public_addr":"172.21.15.102:6809/1237794167","cluster_addr":"172.21.15.102:6811/1237794167","heartbeat_back_addr":"172.21.15.102:6815/1237794167","heartbeat_front_addr":"172.21.15.102:6813/1237794167","state":["exists","up"]},{"osd":1,"uuid":"616a3dee-4034-4eaa-843f-b03ee416c716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6825","nonce":1865676346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6827","nonce":1865676346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6831","nonce":1865676346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6829","nonce":1865676346}]},"public_addr":"172.21.15.102:6825/1865676346","cluster_addr":"172.21.15.102:6827/1865676346","heartbeat_back_addr":"172.21.15.102:6831/1865676346","heartbeat_front_addr":"172.21.15.102:6829/1865676346","state":["exists","up"]},{"osd":2,"uuid":"7278941b-405f-4f57-b2ca-568eb73d137b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6817","nonce":1118146796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6819","nonce":1118146796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6823","nonce":1118146796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6821","nonce":1118146796}]},"public_addr":"172.21.15.102:6817/1118146796","cluster_addr":"172.21.15.102:6819/1118146796","heartbeat_back_addr":"172.21.15.102:6823/1118146796","heartbeat_front_addr":"172.21.15.102:6821/1118146796","state":["exists","up"]},{"osd":3,"uuid":"6ee9c72e-0150-4c2e-bcce-c57a772fc13f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6801","nonce":1464080842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6803","nonce":1464080842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6807","nonce":1464080842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6805","nonce":1464080842}]},"public_addr":"172.21.15.102:6801/1464080842","cluster_addr":"172.21.15.102:6803/1464080842","heartbeat_back_addr":"172.21.15.102:6807/1464080842","heartbeat_front_addr":"172.21.15.102:6805/1464080842","state":["exists","up"]},{"osd":4,"uuid":"f364f405-9739-4160-95d2-73606bcfb3e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6827","nonce":1318321638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6829","nonce":1318321638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6833","nonce":1318321638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6831","nonce":1318321638}]},"public_addr":"172.21.15.121:6827/1318321638","cluster_addr":"172.21.15.121:6829/1318321638","heartbeat_back_addr":"172.21.15.121:6833/1318321638","heartbeat_front_addr":"172.21.15.121:6831/1318321638","state":["exists","up"]},{"osd":5,"uuid":"883c0010-02d5-487e-b74c-8f6558b41b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6811","nonce":1906913778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6813","nonce":1906913778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6817","nonce":1906913778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6815","nonce":1906913778}]},"public_addr":"172.21.15.121:6811/1906913778","cluster_addr":"172.21.15.121:6813/1906913778","heartbeat_back_addr":"172.21.15.121:6817/1906913778","heartbeat_front_addr":"172.21.15.121:6815/1906913778","state":["exists","up"]},{"osd":6,"uuid":"6014bfe5-bacf-49a8-a138-48472a94792f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6803","nonce":901978356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6805","nonce":901978356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6809","nonce":901978356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6807","nonce":901978356}]},"public_addr":"172.21.15.121:6803/901978356","cluster_addr":"172.21.15.121:6805/901978356","heartbeat_back_addr":"172.21.15.121:6809/901978356","heartbeat_front_addr":"172.21.15.121:6807/901978356","state":["exists","up"]},{"osd":7,"uuid":"91c1b7d3-f3ab-41fe-98cc-c76ce4826a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6819","nonce":3404057850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6821","nonce":3404057850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6825","nonce":3404057850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6823","nonce":3404057850}]},"public_addr":"172.21.15.121:6819/3404057850","cluster_addr":"172.21.15.121:6821/3404057850","heartbeat_back_addr":"172.21.15.121:6825/3404057850","heartbeat_front_addr":"172.21.15.121:6823/3404057850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:34.951640+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.295761+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.128138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.031338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.295702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.628290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.279886+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.148247+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:09:49.271 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:09:49.271 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:09:49.555 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:09:49.555 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"fsid":"92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434","created":"2024-09-12T00:09:25.299238+0000","modified":"2024-09-12T00:09:48.166325+0000","last_up_change":"2024-09-12T00:09:38.063826+0000","last_in_change":"2024-09-12T00:09:28.354915+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:09:38.091156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:09:44.342579+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b227208-8b0b-40b7-86af-a3fceb4c1dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6809","nonce":1237794167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6811","nonce":1237794167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6815","nonce":1237794167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6813","nonce":1237794167}]},"public_addr":"172.21.15.102:6809/1237794167","cluster_addr":"172.21.15.102:6811/1237794167","heartbeat_back_addr":"172.21.15.102:6815/1237794167","heartbeat_front_addr":"172.21.15.102:6813/1237794167","state":["exists","up"]},{"osd":1,"uuid":"616a3dee-4034-4eaa-843f-b03ee416c716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6825","nonce":1865676346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6827","nonce":1865676346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6831","nonce":1865676346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6829","nonce":1865676346}]},"public_addr":"172.21.15.102:6825/1865676346","cluster_addr":"172.21.15.102:6827/1865676346","heartbeat_back_addr":"172.21.15.102:6831/1865676346","heartbeat_front_addr":"172.21.15.102:6829/1865676346","state":["exists","up"]},{"osd":2,"uuid":"7278941b-405f-4f57-b2ca-568eb73d137b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6817","nonce":1118146796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6819","nonce":1118146796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6823","nonce":1118146796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6821","nonce":1118146796}]},"public_addr":"172.21.15.102:6817/1118146796","cluster_addr":"172.21.15.102:6819/1118146796","heartbeat_back_addr":"172.21.15.102:6823/1118146796","heartbeat_front_addr":"172.21.15.102:6821/1118146796","state":["exists","up"]},{"osd":3,"uuid":"6ee9c72e-0150-4c2e-bcce-c57a772fc13f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6801","nonce":1464080842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6803","nonce":1464080842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6807","nonce":1464080842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6805","nonce":1464080842}]},"public_addr":"172.21.15.102:6801/1464080842","cluster_addr":"172.21.15.102:6803/1464080842","heartbeat_back_addr":"172.21.15.102:6807/1464080842","heartbeat_front_addr":"172.21.15.102:6805/1464080842","state":["exists","up"]},{"osd":4,"uuid":"f364f405-9739-4160-95d2-73606bcfb3e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6827","nonce":1318321638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6829","nonce":1318321638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6833","nonce":1318321638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6831","nonce":1318321638}]},"public_addr":"172.21.15.121:6827/1318321638","cluster_addr":"172.21.15.121:6829/1318321638","heartbeat_back_addr":"172.21.15.121:6833/1318321638","heartbeat_front_addr":"172.21.15.121:6831/1318321638","state":["exists","up"]},{"osd":5,"uuid":"883c0010-02d5-487e-b74c-8f6558b41b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6811","nonce":1906913778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6813","nonce":1906913778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6817","nonce":1906913778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6815","nonce":1906913778}]},"public_addr":"172.21.15.121:6811/1906913778","cluster_addr":"172.21.15.121:6813/1906913778","heartbeat_back_addr":"172.21.15.121:6817/1906913778","heartbeat_front_addr":"172.21.15.121:6815/1906913778","state":["exists","up"]},{"osd":6,"uuid":"6014bfe5-bacf-49a8-a138-48472a94792f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6803","nonce":901978356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6805","nonce":901978356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6809","nonce":901978356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6807","nonce":901978356}]},"public_addr":"172.21.15.121:6803/901978356","cluster_addr":"172.21.15.121:6805/901978356","heartbeat_back_addr":"172.21.15.121:6809/901978356","heartbeat_front_addr":"172.21.15.121:6807/901978356","state":["exists","up"]},{"osd":7,"uuid":"91c1b7d3-f3ab-41fe-98cc-c76ce4826a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6819","nonce":3404057850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6821","nonce":3404057850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6825","nonce":3404057850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6823","nonce":3404057850}]},"public_addr":"172.21.15.121:6819/3404057850","cluster_addr":"172.21.15.121:6821/3404057850","heartbeat_back_addr":"172.21.15.121:6825/3404057850","heartbeat_front_addr":"172.21.15.121:6823/3404057850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:34.951640+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.295761+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.128138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.031338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.295702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.628290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.279886+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.148247+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:09:49.573 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:09:49.573 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:09:49.573 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:09:49.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:09:49.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:09:49.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:09:49.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:09:49.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:09:49.822 INFO:teuthology.orchestra.run.smithi102.stdout:60129542148 2024-09-12T00:09:49.823 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:09:49.833 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-12T00:09:49.833 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:09:49.839 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-12T00:09:49.839 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:09:49.840 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-12T00:09:49.840 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:09:49.841 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-12T00:09:49.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:09:49.842 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-12T00:09:49.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:09:49.846 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-12T00:09:49.847 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:09:49.861 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-12T00:09:49.861 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:09:50.345 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-12T00:09:50.364 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-12T00:09:50.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-12T00:09:50.372 DEBUG:teuthology.parallel:result is None 2024-09-12T00:09:50.373 INFO:teuthology.orchestra.run.smithi102.stdout:60129542148 2024-09-12T00:09:50.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-12T00:09:50.390 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-12T00:09:50.390 DEBUG:teuthology.parallel:result is None 2024-09-12T00:09:50.397 INFO:teuthology.orchestra.run.smithi102.stdout:60129542150 2024-09-12T00:09:50.398 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-12T00:09:50.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2024-09-12T00:09:50.402 DEBUG:teuthology.parallel:result is None 2024-09-12T00:09:50.418 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-12T00:09:50.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-12T00:09:50.419 DEBUG:teuthology.parallel:result is None 2024-09-12T00:09:50.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-12T00:09:50.421 DEBUG:teuthology.parallel:result is None 2024-09-12T00:09:50.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-09-12T00:09:50.422 DEBUG:teuthology.parallel:result is None 2024-09-12T00:09:50.425 INFO:teuthology.orchestra.run.smithi102.stdout:60129542149 2024-09-12T00:09:50.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-12T00:09:50.437 DEBUG:teuthology.parallel:result is None 2024-09-12T00:09:50.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-12T00:09:50.444 DEBUG:teuthology.parallel:result is None 2024-09-12T00:09:50.444 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:09:50.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:09:50.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:09:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-12T00:09:50.776 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T00:09:50.051030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223232,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751488,"statfs":{"total":773094113280,"available":772865523712,"internally_reserved":0,"allocated":2899968,"data_stored":1758366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905751"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.181937+0000","last_change":"2024-09-12T00:09:48.181937+0000","last_active":"2024-09-12T00:09:48.181937+0000","last_peered":"2024-09-12T00:09:48.181937+0000","last_clean":"2024-09-12T00:09:48.181937+0000","last_became_active":"2024-09-12T00:09:46.163643+0000","last_became_peered":"2024-09-12T00:09:46.163643+0000","last_unstale":"2024-09-12T00:09:48.181937+0000","last_undegraded":"2024-09-12T00:09:48.181937+0000","last_fullsized":"2024-09-12T00:09:48.181937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:23.976934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095304600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.193796+0000","last_change":"2024-09-12T00:09:48.193796+0000","last_active":"2024-09-12T00:09:48.193796+0000","last_peered":"2024-09-12T00:09:48.193796+0000","last_clean":"2024-09-12T00:09:48.193796+0000","last_became_active":"2024-09-12T00:09:46.162309+0000","last_became_peered":"2024-09-12T00:09:46.162309+0000","last_unstale":"2024-09-12T00:09:48.193796+0000","last_undegraded":"2024-09-12T00:09:48.193796+0000","last_fullsized":"2024-09-12T00:09:48.193796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:57.198136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010860449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.283460+0000","last_change":"2024-09-12T00:09:48.283460+0000","last_active":"2024-09-12T00:09:48.283460+0000","last_peered":"2024-09-12T00:09:48.283460+0000","last_clean":"2024-09-12T00:09:48.283460+0000","last_became_active":"2024-09-12T00:09:46.177603+0000","last_became_peered":"2024-09-12T00:09:46.177603+0000","last_unstale":"2024-09-12T00:09:48.283460+0000","last_undegraded":"2024-09-12T00:09:48.283460+0000","last_fullsized":"2024-09-12T00:09:48.283460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:26.898658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.193791+0000","last_change":"2024-09-12T00:09:48.193791+0000","last_active":"2024-09-12T00:09:48.193791+0000","last_peered":"2024-09-12T00:09:48.193791+0000","last_clean":"2024-09-12T00:09:48.193791+0000","last_became_active":"2024-09-12T00:09:46.178541+0000","last_became_peered":"2024-09-12T00:09:46.178541+0000","last_unstale":"2024-09-12T00:09:48.193791+0000","last_undegraded":"2024-09-12T00:09:48.193791+0000","last_fullsized":"2024-09-12T00:09:48.193791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:55.733179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00107328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.189916+0000","last_change":"2024-09-12T00:09:48.188360+0000","last_active":"2024-09-12T00:09:48.189916+0000","last_peered":"2024-09-12T00:09:48.189916+0000","last_clean":"2024-09-12T00:09:48.189916+0000","last_became_active":"2024-09-12T00:09:46.161046+0000","last_became_peered":"2024-09-12T00:09:46.161046+0000","last_unstale":"2024-09-12T00:09:48.189916+0000","last_undegraded":"2024-09-12T00:09:48.189916+0000","last_fullsized":"2024-09-12T00:09:48.189916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:21.375528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022130560000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.355061+0000","last_change":"2024-09-12T00:09:48.355061+0000","last_active":"2024-09-12T00:09:48.355061+0000","last_peered":"2024-09-12T00:09:48.355061+0000","last_clean":"2024-09-12T00:09:48.355061+0000","last_became_active":"2024-09-12T00:09:46.179853+0000","last_became_peered":"2024-09-12T00:09:46.179853+0000","last_unstale":"2024-09-12T00:09:48.355061+0000","last_undegraded":"2024-09-12T00:09:48.355061+0000","last_fullsized":"2024-09-12T00:09:48.355061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:34.347111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056473999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.283186+0000","last_change":"2024-09-12T00:09:48.283186+0000","last_active":"2024-09-12T00:09:48.283186+0000","last_peered":"2024-09-12T00:09:48.283186+0000","last_clean":"2024-09-12T00:09:48.283186+0000","last_became_active":"2024-09-12T00:09:46.164248+0000","last_became_peered":"2024-09-12T00:09:46.164248+0000","last_unstale":"2024-09-12T00:09:48.283186+0000","last_undegraded":"2024-09-12T00:09:48.283186+0000","last_fullsized":"2024-09-12T00:09:48.283186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:55.257275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099742600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.187085+0000","last_change":"2024-09-12T00:09:48.187085+0000","last_active":"2024-09-12T00:09:48.187085+0000","last_peered":"2024-09-12T00:09:48.187085+0000","last_clean":"2024-09-12T00:09:48.187085+0000","last_became_active":"2024-09-12T00:09:46.162330+0000","last_became_peered":"2024-09-12T00:09:46.162330+0000","last_unstale":"2024-09-12T00:09:48.187085+0000","last_undegraded":"2024-09-12T00:09:48.187085+0000","last_fullsized":"2024-09-12T00:09:48.187085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:31.598024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090615300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.281986+0000","last_change":"2024-09-12T00:09:40.226824+0000","last_active":"2024-09-12T00:09:48.281986+0000","last_peered":"2024-09-12T00:09:48.281986+0000","last_clean":"2024-09-12T00:09:48.281986+0000","last_became_active":"2024-09-12T00:09:40.224430+0000","last_became_peered":"2024-09-12T00:09:40.224430+0000","last_unstale":"2024-09-12T00:09:48.281986+0000","last_undegraded":"2024-09-12T00:09:48.281986+0000","last_fullsized":"2024-09-12T00:09:48.281986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_clean_scrub_stamp":"2024-09-12T00:09:39.068560+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.078225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":72218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:09:50.777 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:09:51.059 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:09:51.060 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-12T00:09:51.076 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T00:09:50.051030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223232,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751488,"statfs":{"total":773094113280,"available":772865523712,"internally_reserved":0,"allocated":2899968,"data_stored":1758366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905751"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.181937+0000","last_change":"2024-09-12T00:09:48.181937+0000","last_active":"2024-09-12T00:09:48.181937+0000","last_peered":"2024-09-12T00:09:48.181937+0000","last_clean":"2024-09-12T00:09:48.181937+0000","last_became_active":"2024-09-12T00:09:46.163643+0000","last_became_peered":"2024-09-12T00:09:46.163643+0000","last_unstale":"2024-09-12T00:09:48.181937+0000","last_undegraded":"2024-09-12T00:09:48.181937+0000","last_fullsized":"2024-09-12T00:09:48.181937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:23.976934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095304600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.193796+0000","last_change":"2024-09-12T00:09:48.193796+0000","last_active":"2024-09-12T00:09:48.193796+0000","last_peered":"2024-09-12T00:09:48.193796+0000","last_clean":"2024-09-12T00:09:48.193796+0000","last_became_active":"2024-09-12T00:09:46.162309+0000","last_became_peered":"2024-09-12T00:09:46.162309+0000","last_unstale":"2024-09-12T00:09:48.193796+0000","last_undegraded":"2024-09-12T00:09:48.193796+0000","last_fullsized":"2024-09-12T00:09:48.193796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:57.198136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010860449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.283460+0000","last_change":"2024-09-12T00:09:48.283460+0000","last_active":"2024-09-12T00:09:48.283460+0000","last_peered":"2024-09-12T00:09:48.283460+0000","last_clean":"2024-09-12T00:09:48.283460+0000","last_became_active":"2024-09-12T00:09:46.177603+0000","last_became_peered":"2024-09-12T00:09:46.177603+0000","last_unstale":"2024-09-12T00:09:48.283460+0000","last_undegraded":"2024-09-12T00:09:48.283460+0000","last_fullsized":"2024-09-12T00:09:48.283460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:26.898658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.193791+0000","last_change":"2024-09-12T00:09:48.193791+0000","last_active":"2024-09-12T00:09:48.193791+0000","last_peered":"2024-09-12T00:09:48.193791+0000","last_clean":"2024-09-12T00:09:48.193791+0000","last_became_active":"2024-09-12T00:09:46.178541+0000","last_became_peered":"2024-09-12T00:09:46.178541+0000","last_unstale":"2024-09-12T00:09:48.193791+0000","last_undegraded":"2024-09-12T00:09:48.193791+0000","last_fullsized":"2024-09-12T00:09:48.193791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:55.733179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00107328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.189916+0000","last_change":"2024-09-12T00:09:48.188360+0000","last_active":"2024-09-12T00:09:48.189916+0000","last_peered":"2024-09-12T00:09:48.189916+0000","last_clean":"2024-09-12T00:09:48.189916+0000","last_became_active":"2024-09-12T00:09:46.161046+0000","last_became_peered":"2024-09-12T00:09:46.161046+0000","last_unstale":"2024-09-12T00:09:48.189916+0000","last_undegraded":"2024-09-12T00:09:48.189916+0000","last_fullsized":"2024-09-12T00:09:48.189916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:21.375528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022130560000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.355061+0000","last_change":"2024-09-12T00:09:48.355061+0000","last_active":"2024-09-12T00:09:48.355061+0000","last_peered":"2024-09-12T00:09:48.355061+0000","last_clean":"2024-09-12T00:09:48.355061+0000","last_became_active":"2024-09-12T00:09:46.179853+0000","last_became_peered":"2024-09-12T00:09:46.179853+0000","last_unstale":"2024-09-12T00:09:48.355061+0000","last_undegraded":"2024-09-12T00:09:48.355061+0000","last_fullsized":"2024-09-12T00:09:48.355061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:34.347111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056473999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.283186+0000","last_change":"2024-09-12T00:09:48.283186+0000","last_active":"2024-09-12T00:09:48.283186+0000","last_peered":"2024-09-12T00:09:48.283186+0000","last_clean":"2024-09-12T00:09:48.283186+0000","last_became_active":"2024-09-12T00:09:46.164248+0000","last_became_peered":"2024-09-12T00:09:46.164248+0000","last_unstale":"2024-09-12T00:09:48.283186+0000","last_undegraded":"2024-09-12T00:09:48.283186+0000","last_fullsized":"2024-09-12T00:09:48.283186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:55.257275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099742600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.187085+0000","last_change":"2024-09-12T00:09:48.187085+0000","last_active":"2024-09-12T00:09:48.187085+0000","last_peered":"2024-09-12T00:09:48.187085+0000","last_clean":"2024-09-12T00:09:48.187085+0000","last_became_active":"2024-09-12T00:09:46.162330+0000","last_became_peered":"2024-09-12T00:09:46.162330+0000","last_unstale":"2024-09-12T00:09:48.187085+0000","last_undegraded":"2024-09-12T00:09:48.187085+0000","last_fullsized":"2024-09-12T00:09:48.187085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:31.598024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090615300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:09:48.281986+0000","last_change":"2024-09-12T00:09:40.226824+0000","last_active":"2024-09-12T00:09:48.281986+0000","last_peered":"2024-09-12T00:09:48.281986+0000","last_clean":"2024-09-12T00:09:48.281986+0000","last_became_active":"2024-09-12T00:09:40.224430+0000","last_became_peered":"2024-09-12T00:09:40.224430+0000","last_unstale":"2024-09-12T00:09:48.281986+0000","last_undegraded":"2024-09-12T00:09:48.281986+0000","last_fullsized":"2024-09-12T00:09:48.281986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_clean_scrub_stamp":"2024-09-12T00:09:39.068560+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.078225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":217088,"data_stored":72218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:09:51.077 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:09:51.077 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:09:51.077 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:09:51.077 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:09:51.389 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:09:51.389 INFO:teuthology.orchestra.run.smithi102.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:09:51.406 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:09:51.406 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:09:51.419 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T00:09:51.421 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:09:51.427 DEBUG:teuthology.orchestra.run.smithi102:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T00:09:51.789 INFO:teuthology.orchestra.run.smithi102.stderr:........+................+.....+....+........................+...........+......+...+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+......+.+.....+...+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+........+......+.....................+.........+......+....+..............+.......+...+............+...+.....+.+......+......+.........+......+..............................+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:09:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:...............+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..............+...........+..........+........+...+...+...............+.......+...+..............+.+.........+........+............+.............+..+.+......+...+..+......+....+...........+...............+....+...+.....+.+..+.......+...+..+......+.....................................+............+......+.....+......+...+..........+......+....................+......+.+...+............+.....+.........+..........+..................+...+..+..........+......+.........+...+..+.+.....+....+..+............................+...........+..........+...........+......+....+.....+....+..+....+...+.....+...+...+.......+.......................+.......+.....+.........+.+...+............+.................+......+....+...........+.+.....+...+.+.....+.+........+...............+......+............+.......+.....+..........+..+......+....+.........+..+....+...+..+..........+......+...+.........+...+........+...................+...+..+.......+.....+...+.............+..+...........................+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:09:52.673 INFO:teuthology.orchestra.run.smithi102.stderr:----- 2024-09-12T00:09:52.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-12T00:09:52.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo update-ca-certificates 2024-09-12T00:09:52.827 INFO:teuthology.orchestra.run.smithi102.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T00:09:53.441 INFO:teuthology.orchestra.run.smithi102.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-12T00:09:53.460 INFO:teuthology.orchestra.run.smithi102.stdout:1 added, 0 removed; done. 2024-09-12T00:09:53.466 INFO:teuthology.orchestra.run.smithi102.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T00:09:53.470 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:09:55.079 INFO:teuthology.orchestra.run.smithi102.stdout:Adding debian:root.pem 2024-09-12T00:09:55.096 INFO:teuthology.orchestra.run.smithi102.stdout:done. 2024-09-12T00:09:55.097 INFO:teuthology.orchestra.run.smithi102.stdout:done. 2024-09-12T00:09:55.101 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:09:55.149 DEBUG:teuthology.orchestra.run.smithi102:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi102.front.sepia.ceph.com 2024-09-12T00:09:55.342 INFO:teuthology.orchestra.run.smithi102.stderr:...+...........+....+......+..+...+...+.+...+..+...............................+..+............+.........+.........+..........+......+............+..+.......+...............+.....+.+.....+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.......+...+.....+.......+..+...............+.+...+..+.........+....+.....+..........+.........+..+.+..+.............+..+...+...................+...+.................+...+.+..+....+...........+....+...+...+..+......+.........+.......+......+........+....+..+.........+......+.+............+.....+......................+...+...+...+...........+...+............+...+......+............+..........+...+.....+.........+.+......+...+..+....+..............+.+..+.......+...+..................+.....+.+........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:09:55.421 INFO:teuthology.orchestra.run.smithi102.stderr:........+....+.....+.......+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+...+.+...........+...+.............+..+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.......+..............+.+...+...+........+....+.....+......+.........+.+.....+.......+..+..........+.................+...+.+......+...+..+....+..+...+....+...........+.+...+.....+.+.....+.......+...+..+...+....+..................+.................+.+......+.....+...+...............+...+..........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:09:55.425 INFO:teuthology.orchestra.run.smithi102.stderr:----- 2024-09-12T00:09:55.428 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:09:55.428 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:09:55.478 DEBUG:teuthology.orchestra.run.smithi102:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:09:55.528 INFO:teuthology.orchestra.run.smithi102.stderr:Certificate request self-signature ok 2024-09-12T00:09:55.528 INFO:teuthology.orchestra.run.smithi102.stderr:subject=CN = smithi102.front.sepia.ceph.com 2024-09-12T00:09:55.541 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:09:55.588 DEBUG:teuthology.orchestra.run.smithi102:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:09:55.642 INFO:teuthology.orchestra.run.smithi102.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T00:09:55.642 DEBUG:teuthology.orchestra.run.smithi102:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:09:55.689 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:09:55.706 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T00:09:55.706 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:09:55.706 INFO:tasks.rgw:Creating data pools 2024-09-12T00:09:55.706 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:09:55.707 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-12T00:09:56.232 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:09:58.208 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:09:58.246 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:09:59.211 INFO:teuthology.orchestra.run.smithi102.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:09:59.258 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:10:00.215 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:10:00.251 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:10:01.218 INFO:teuthology.orchestra.run.smithi102.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:10:01.256 DEBUG:tasks.rgw:Pools created 2024-09-12T00:10:01.256 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:10:01.256 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:10:01.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:10:01.257 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:10:01.460 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:01.460 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:03.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.326+0000 7f9212c65640 0 -- 172.21.15.102:0/2445131525 >> [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] conn(0x7f90e80709f0 msgr2=0x7f90e8072eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:10:03.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.330+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:03.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.334+0000 7f9211c63640 0 -- 172.21.15.102:0/3675489557 >> [v2:172.21.15.102:6824/1865676346,v1:172.21.15.102:6825/1865676346] conn(0x559746e6fa70 msgr2=0x559746e71f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:10:03.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.538+0000 7f921495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:03.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.538+0000 7f921495e9c0 20 realm 2024-09-12T00:10:03.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.538+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:03.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.538+0000 7f921495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:03.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.538+0000 7f921495e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:10:03.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.538+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:03.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.538+0000 7f921495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:03.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.538+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:03.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.542+0000 7f921495e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:10:03.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.542+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:03.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.546+0000 7f921495e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:10:03.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.546+0000 7f921495e9c0 20 searching for the correct realm 2024-09-12T00:10:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:10:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:10:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:10:03.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:10:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:10:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:10:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:03.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:10:03.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.574+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.578+0000 7f921495e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:10:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.578+0000 7f921495e9c0 20 zone default found 2024-09-12T00:10:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.578+0000 7f921495e9c0 4 Realm: () 2024-09-12T00:10:03.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.578+0000 7f921495e9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:10:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.578+0000 7f921495e9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:10:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.578+0000 7f921495e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:10:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.578+0000 7f921495e9c0 20 zonegroup default 2024-09-12T00:10:03.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.578+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:03.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.578+0000 7f921495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:03.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:03.578+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:05.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:05.301+0000 7f921495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:05.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:05.301+0000 7f921495e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:05.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:05.301+0000 7f921495e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:05.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:05.301+0000 7f921495e9c0 20 started sync module instance, tier type = 2024-09-12T00:10:05.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:05.301+0000 7f921495e9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:10:07.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.361+0000 7f921495e9c0 20 add_watcher() i=0 2024-09-12T00:10:07.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.361+0000 7f921495e9c0 20 add_watcher() i=1 2024-09-12T00:10:07.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.361+0000 7f921495e9c0 20 add_watcher() i=2 2024-09-12T00:10:07.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.361+0000 7f921495e9c0 20 add_watcher() i=3 2024-09-12T00:10:07.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.361+0000 7f921495e9c0 20 add_watcher() i=4 2024-09-12T00:10:07.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.361+0000 7f921495e9c0 20 add_watcher() i=5 2024-09-12T00:10:07.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.361+0000 7f921495e9c0 20 add_watcher() i=6 2024-09-12T00:10:07.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 add_watcher() i=7 2024-09-12T00:10:07.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:10:07.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:10:07.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:10:07.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:10:07.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:10:07.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:10:07.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:10:07.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:10:07.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:10:07.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:10:07.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:10:07.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:10:07.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:10:07.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.365+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:10:07.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:10:07.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:10:07.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:10:07.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:10:07.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:10:07.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:10:07.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:10:07.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:10:07.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:10:07.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:10:07.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:10:07.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:10:07.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:10:07.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.369+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:10:07.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:10:07.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:10:07.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:10:07.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:10:07.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:10:07.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:10:07.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:10:07.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:10:07.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:10:07.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:10:07.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:10:07.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.373+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:10:07.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:10:07.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:10:07.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:10:07.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:10:07.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:10:07.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:10:07.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:10:07.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:10:07.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:10:07.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:10:07.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:10:07.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:10:07.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:10:07.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.377+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:10:07.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:10:07.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:10:07.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:10:07.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:10:07.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:10:07.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:10:07.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:10:07.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:10:07.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:10:07.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:10:07.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:10:07.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.381+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:10:07.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:10:07.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:10:07.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:10:07.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:10:07.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:10:07.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:10:07.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:10:07.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:10:07.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:10:07.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:10:07.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:10:07.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.385+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:10:07.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:10:07.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:10:07.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:10:07.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:10:07.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:10:07.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:10:07.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:10:07.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:10:07.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:10:07.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:10:07.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:10:07.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.389+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:10:07.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:10:07.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:10:07.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:10:07.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:10:07.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:10:07.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:10:07.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:10:07.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:10:07.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:10:07.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:10:07.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:10:07.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:10:07.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:10:07.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.393+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:10:07.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:10:07.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:10:07.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:10:07.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:10:07.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:10:07.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:10:07.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:10:07.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:10:07.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:10:07.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:10:07.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:10:07.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:10:07.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:10:07.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.397+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:10:07.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:10:07.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:10:07.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:10:07.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:10:07.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:10:07.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:10:07.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:10:07.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:10:07.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:10:07.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:10:07.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:10:07.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.401+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:10:07.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:10:07.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:10:07.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:10:07.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:10:07.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:10:07.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:10:07.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:10:07.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:10:07.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:10:07.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:10:07.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:10:07.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:10:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:10:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.405+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:10:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:10:07.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:10:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:10:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:10:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:10:07.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:10:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:10:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:10:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:10:07.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:10:07.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:10:07.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:10:07.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:10:07.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.409+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:10:07.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:10:07.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:10:07.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:10:07.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:10:07.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:10:07.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:10:07.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:10:07.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:10:07.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:10:07.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:10:07.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:10:07.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:10:07.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:10:07.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.413+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:10:07.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:10:07.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:10:07.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:10:07.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:10:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:10:07.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:10:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:10:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:10:07.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:10:07.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:10:07.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:10:07.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.417+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:10:07.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:10:07.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:10:07.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:10:07.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:10:07.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:10:07.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:10:07.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:10:07.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:10:07.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:10:07.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.421+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:10:07.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:10:07.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:10:07.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:10:07.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:10:07.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:10:07.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:10:07.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:10:07.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:10:07.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:10:07.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:10:07.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:10:07.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.425+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:10:07.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:10:07.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:10:07.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:10:07.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:10:07.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:10:07.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:10:07.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:10:07.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:10:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:10:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:10:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:10:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:10:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:10:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.429+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:10:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:10:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:10:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:10:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:10:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:10:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:10:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:10:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:10:07.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:10:07.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:10:07.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:10:07.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.433+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:10:07.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:10:07.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:10:07.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:10:07.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:10:07.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:10:07.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:10:07.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:10:07.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:10:07.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:10:07.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:10:07.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:10:07.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:10:07.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:10:07.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:10:07.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:10:07.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.437+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:10:07.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:10:07.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:10:07.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:10:07.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:10:07.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:10:07.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:10:07.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:10:07.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:10:07.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:10:07.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.441+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.445+0000 7f921495e9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:10:07.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.445+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:10:07.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.449+0000 7f921495e9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:10:07.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.457+0000 7f90c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:10:07.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.457+0000 7f921495e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:10:07.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:07.457+0000 7f921495e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:10:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.353+0000 7f921495e9c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:10:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.353+0000 7f921495e9c0 5 note: GC not initialized 2024-09-12T00:10:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.365+0000 7f902f7fe640 20 reqs_thread_entry: start 2024-09-12T00:10:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.365+0000 7f921495e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:10:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.365+0000 7f921495e9c0 20 Filter name: none 2024-09-12T00:10:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.365+0000 7f902d7fa640 20 reqs_thread_entry: start 2024-09-12T00:10:10.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.417+0000 7f90c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:10:10.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.425+0000 7f921495e9c0 20 remove_watcher() i=0 2024-09-12T00:10:10.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.425+0000 7f921495e9c0 2 removed watcher, disabling cache 2024-09-12T00:10:10.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.425+0000 7f921495e9c0 20 remove_watcher() i=1 2024-09-12T00:10:10.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.429+0000 7f921495e9c0 20 remove_watcher() i=2 2024-09-12T00:10:10.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.437+0000 7f921495e9c0 20 remove_watcher() i=3 2024-09-12T00:10:10.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.437+0000 7f921495e9c0 20 remove_watcher() i=4 2024-09-12T00:10:10.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.441+0000 7f921495e9c0 20 remove_watcher() i=5 2024-09-12T00:10:10.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.441+0000 7f921495e9c0 20 remove_watcher() i=6 2024-09-12T00:10:10.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.445+0000 7f921495e9c0 20 remove_watcher() i=7 2024-09-12T00:10:10.463 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-12T00:10:10.463 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:10:10.463 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:10:10.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:10:10.463 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:10:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.537+0000 7faf7929b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:10:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.537+0000 7faf7929b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:10:10.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.541+0000 7fae34ff9640 20 reqs_thread_entry: start 2024-09-12T00:10:10.562 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"19f4f3c1-461e-436c-9c0f-f6c5a929bad9","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:10:10.563 DEBUG:tasks.util.rgw: json result: {'id': '19f4f3c1-461e-436c-9c0f-f6c5a929bad9', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:10:10.563 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:10:10.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:10:10.563 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:10:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:10.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.677+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.681+0000 7fae629b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.681+0000 7fae629b89c0 20 realm 2024-09-12T00:10:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.681+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.681+0000 7fae629b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.681+0000 7fae629b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:10:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.681+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.681+0000 7fae629b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:10.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.681+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.681+0000 7fae629b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:10:10.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.681+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:10.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.685+0000 7fae629b89c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:10:10.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.685+0000 7fae629b89c0 20 searching for the correct realm 2024-09-12T00:10:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.689+0000 7fae60cbf640 0 -- 172.21.15.102:0/4062405492 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fae5400e070 msgr2=0x7fae5407b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:10:10.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:10.905+0000 7fae5fcbd640 0 -- 172.21.15.102:0/4062405492 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fae5007f040 msgr2=0x7fae50070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:10:11.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.121+0000 7fae629b89c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:10:11.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.121+0000 7fae629b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:10:11.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.121+0000 7fae629b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:10:11.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.121+0000 7fae629b89c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:10:11.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.121+0000 7fae629b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:10:11.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.121+0000 7fae629b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:10:11.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.121+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:10:11.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:10:11.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 20 zone default found 2024-09-12T00:10:11.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 4 Realm: () 2024-09-12T00:10:11.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:10:11.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:10:11.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:10:11.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 20 zonegroup default 2024-09-12T00:10:11.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.125+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.129+0000 7fae629b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.129+0000 7fae629b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.129+0000 7fae629b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.129+0000 7fae629b89c0 20 started sync module instance, tier type = 2024-09-12T00:10:11.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.129+0000 7fae629b89c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:10:11.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.153+0000 7fae629b89c0 20 add_watcher() i=0 2024-09-12T00:10:11.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.153+0000 7fae629b89c0 20 add_watcher() i=1 2024-09-12T00:10:11.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.153+0000 7fae629b89c0 20 add_watcher() i=2 2024-09-12T00:10:11.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.153+0000 7fae629b89c0 20 add_watcher() i=3 2024-09-12T00:10:11.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.153+0000 7fae629b89c0 20 add_watcher() i=4 2024-09-12T00:10:11.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.153+0000 7fae629b89c0 20 add_watcher() i=5 2024-09-12T00:10:11.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.153+0000 7fae629b89c0 20 add_watcher() i=6 2024-09-12T00:10:11.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.153+0000 7fae629b89c0 20 add_watcher() i=7 2024-09-12T00:10:11.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.153+0000 7fae629b89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:10:11.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.157+0000 7fad16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:10:11.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.157+0000 7fae629b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:10:11.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.157+0000 7fae629b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:10:11.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.161+0000 7fae629b89c0 5 note: GC not initialized 2024-09-12T00:10:11.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.161+0000 7fad15fdb640 20 reqs_thread_entry: start 2024-09-12T00:10:11.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.161+0000 7fae629b89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:10:11.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.161+0000 7fae629b89c0 20 Filter name: none 2024-09-12T00:10:11.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.161+0000 7fac877fe640 20 reqs_thread_entry: start 2024-09-12T00:10:11.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.181+0000 7fad16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:10:11.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.185+0000 7fae629b89c0 20 remove_watcher() i=0 2024-09-12T00:10:11.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.185+0000 7fae629b89c0 2 removed watcher, disabling cache 2024-09-12T00:10:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.189+0000 7fae629b89c0 20 remove_watcher() i=1 2024-09-12T00:10:11.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.189+0000 7fae629b89c0 20 remove_watcher() i=2 2024-09-12T00:10:11.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.193+0000 7fae629b89c0 20 remove_watcher() i=3 2024-09-12T00:10:11.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.197+0000 7fae629b89c0 20 remove_watcher() i=4 2024-09-12T00:10:11.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.197+0000 7fae629b89c0 20 remove_watcher() i=5 2024-09-12T00:10:11.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.197+0000 7fae629b89c0 20 remove_watcher() i=6 2024-09-12T00:10:11.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.201+0000 7fae629b89c0 20 remove_watcher() i=7 2024-09-12T00:10:11.212 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-12T00:10:11.213 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:10:11.213 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:10:11.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:10:11.213 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T00:10:11.296 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:11.297 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:11.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.329+0000 7fccfbeb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:10:11.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.329+0000 7fccfbeb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:10:11.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.333+0000 7fcb2ffff640 20 reqs_thread_entry: start 2024-09-12T00:10:11.352 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"19f4f3c1-461e-436c-9c0f-f6c5a929bad9","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:10:11.352 DEBUG:tasks.util.rgw: json result: {'id': '19f4f3c1-461e-436c-9c0f-f6c5a929bad9', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:10:11.353 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T00:10:11.353 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p /tmp/rgw_datacache 2024-09-12T00:10:11.398 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T00:10:11.453 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:10:11.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:10:11.454 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:10:11.533 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:11.533 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.577+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.577+0000 7f89d6c219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.577+0000 7f89d6c219c0 20 realm 2024-09-12T00:10:11.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.577+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.577+0000 7f89d6c219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.577+0000 7f89d6c219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:10:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.577+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.577+0000 7f89d6c219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.577+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.581+0000 7f89d6c219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:10:11.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.581+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.581+0000 7f89d6c219c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:10:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.581+0000 7f89d6c219c0 20 searching for the correct realm 2024-09-12T00:10:11.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.585+0000 7f89d4f28640 0 -- 172.21.15.102:0/619503229 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f89c8040060 msgr2=0x7f89c80675b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:10:11.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.593+0000 7f89d3f26640 0 -- 172.21.15.102:0/619503229 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f89cc130270 msgr2=0x7f89cc11e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:10:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.809+0000 7f89d6c219c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:10:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.809+0000 7f89d6c219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:10:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.809+0000 7f89d6c219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:10:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.809+0000 7f89d6c219c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:10:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.809+0000 7f89d6c219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:10:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.809+0000 7f89d6c219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:10:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.809+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.809+0000 7f89d6c219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.809+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:10:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:10:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 zone default found 2024-09-12T00:10:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 4 Realm: () 2024-09-12T00:10:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:10:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:10:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:10:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 zonegroup default 2024-09-12T00:10:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 rados->read ofs=0 len=0 2024-09-12T00:10:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:10:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 started sync module instance, tier type = 2024-09-12T00:10:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.813+0000 7f89d6c219c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:10:11.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.841+0000 7f89d6c219c0 20 add_watcher() i=0 2024-09-12T00:10:11.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.841+0000 7f89d6c219c0 20 add_watcher() i=1 2024-09-12T00:10:11.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.841+0000 7f89d6c219c0 20 add_watcher() i=2 2024-09-12T00:10:11.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.841+0000 7f89d6c219c0 20 add_watcher() i=3 2024-09-12T00:10:11.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.841+0000 7f89d6c219c0 20 add_watcher() i=4 2024-09-12T00:10:11.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.841+0000 7f89d6c219c0 20 add_watcher() i=5 2024-09-12T00:10:11.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.841+0000 7f89d6c219c0 20 add_watcher() i=6 2024-09-12T00:10:11.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.845+0000 7f89d6c219c0 20 add_watcher() i=7 2024-09-12T00:10:11.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.845+0000 7f89d6c219c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:10:11.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.849+0000 7f888afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:10:11.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.849+0000 7f89d6c219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:10:11.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.849+0000 7f89d6c219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:10:11.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.849+0000 7f89d6c219c0 5 note: GC not initialized 2024-09-12T00:10:11.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.849+0000 7f8889fdb640 20 reqs_thread_entry: start 2024-09-12T00:10:11.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.849+0000 7f89d6c219c0 20 init_complete bucket index max shards: 11 2024-09-12T00:10:11.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.849+0000 7f89d6c219c0 20 Filter name: none 2024-09-12T00:10:11.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.849+0000 7f87fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:10:11.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.869+0000 7f888afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:10:11.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.877+0000 7f89d6c219c0 20 remove_watcher() i=0 2024-09-12T00:10:11.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.877+0000 7f89d6c219c0 2 removed watcher, disabling cache 2024-09-12T00:10:11.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.877+0000 7f89d6c219c0 20 remove_watcher() i=1 2024-09-12T00:10:11.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.881+0000 7f89d6c219c0 20 remove_watcher() i=2 2024-09-12T00:10:11.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.885+0000 7f89d6c219c0 20 remove_watcher() i=3 2024-09-12T00:10:11.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.885+0000 7f89d6c219c0 20 remove_watcher() i=4 2024-09-12T00:10:11.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.885+0000 7f89d6c219c0 20 remove_watcher() i=5 2024-09-12T00:10:11.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.889+0000 7f89d6c219c0 20 remove_watcher() i=6 2024-09-12T00:10:11.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:11.889+0000 7f89d6c219c0 20 remove_watcher() i=7 2024-09-12T00:10:11.905 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-12T00:10:11.905 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:10:11.906 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:10:11.906 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:10:11.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:10:11.906 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:10:11.992 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:11.992 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.025+0000 7f88d39799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:10:12.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.025+0000 7f88d39799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:10:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.029+0000 7f870f7fe640 20 reqs_thread_entry: start 2024-09-12T00:10:12.044 INFO:teuthology.orchestra.run.smithi102.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:10:12.044 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:10:12.044 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:10:12.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:10:12.044 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:10:12.128 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.128 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.157+0000 7f33454e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:10:12.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.157+0000 7f33454e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:10:12.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.161+0000 7f3200ff9640 20 reqs_thread_entry: start 2024-09-12T00:10:12.181 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"19f4f3c1-461e-436c-9c0f-f6c5a929bad9","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:10:12.181 DEBUG:tasks.util.rgw: json result: {'id': '19f4f3c1-461e-436c-9c0f-f6c5a929bad9', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:10:12.181 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:10:12.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:10:12.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:10:12.182 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:10:12.256 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.256 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.285+0000 7f4ac7e869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:10:12.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.285+0000 7f4ac7e869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:10:12.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.289+0000 7f4988fe1640 20 reqs_thread_entry: start 2024-09-12T00:10:12.305 INFO:teuthology.orchestra.run.smithi102.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:10:12.305 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:10:12.305 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:10:12.305 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:10:12.306 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:10:12.385 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:12.386 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:12.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.413+0000 7faa036d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:10:12.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.413+0000 7faa036d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:10:12.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:10:12.417+0000 7fa83f7fe640 20 reqs_thread_entry: start 2024-09-12T00:10:12.436 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"19f4f3c1-461e-436c-9c0f-f6c5a929bad9","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:10:12.437 DEBUG:tasks.util.rgw: json result: {'id': '19f4f3c1-461e-436c-9c0f-f6c5a929bad9', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:10:12.437 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:10:12.437 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T00:10:12.437 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:10:12.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo echo -n https://smithi102.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:10:12.490 INFO:teuthology.orchestra.run.smithi102.stdout:https://smithi102.front.sepia.ceph.com:443 2024-09-12T00:10:12.491 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:10:12.546 DEBUG:teuthology.orchestra.run.smithi102:> sudo keytool -import -alias smithi102.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T00:10:12.869 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T00:10:13.173 INFO:teuthology.orchestra.run.smithi102.stderr:Certificate was added to keystore 2024-09-12T00:10:13.204 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T00:10:13.204 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:10:13.204 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:10:13.207 INFO:tasks.rgw.client.0:Started 2024-09-12T00:10:13.207 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi102.front.sepia.ceph.com:443/ 2024-09-12T00:10:13.208 DEBUG:teuthology.orchestra.run.smithi102:> curl https://smithi102.front.sepia.ceph.com:443/ 2024-09-12T00:10:13.227 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:10:13.227 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:10:13.228 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:10:13.228 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:10:13.228 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T00:10:14.229 DEBUG:teuthology.orchestra.run.smithi102:> curl https://smithi102.front.sepia.ceph.com:443/ 2024-09-12T00:10:14.240 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:10:14.240 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:10:14.240 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:10:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T00:10:14.241 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:10:16.242 DEBUG:teuthology.orchestra.run.smithi102:> curl https://smithi102.front.sepia.ceph.com:443/ 2024-09-12T00:10:16.253 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:10:16.253 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:10:16.253 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:10:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T00:10:16.253 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:10:20.254 DEBUG:teuthology.orchestra.run.smithi102:> curl https://smithi102.front.sepia.ceph.com:443/ 2024-09-12T00:10:20.267 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:10:20.267 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:10:20.267 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:10:20.267 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T00:10:20.268 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:10:28.269 DEBUG:teuthology.orchestra.run.smithi102:> curl https://smithi102.front.sepia.ceph.com:443/ 2024-09-12T00:10:28.279 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:10:28.279 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:10:28.279 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:10:28.280 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:10:28.280 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T00:10:38.491 INFO:tasks.rgw.client.0.smithi102.stdout:2024-09-12T00:10:38.119+0000 8ed9f80 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T00:10:44.282 DEBUG:teuthology.orchestra.run.smithi102:> curl https://smithi102.front.sepia.ceph.com:443/ 2024-09-12T00:10:44.297 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:10:44.297 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:10:45.419 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 166 0 --:--:-- 0:00:01 --:--:-- 166 2024-09-12T00:10:45.423 INFO:teuthology.orchestra.run.smithi102.stdout:anonymous 2024-09-12T00:10:45.423 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:10:45.435 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:10:45.435 DEBUG:teuthology.orchestra.run.smithi102:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:10:48.343 DEBUG:teuthology.orchestra.run.smithi102:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:10:49.146 INFO:teuthology.orchestra.run.smithi102.stdout:Collecting tox==3.15.0 2024-09-12T00:10:49.245 INFO:teuthology.orchestra.run.smithi102.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:10:49.302 INFO:teuthology.orchestra.run.smithi102.stdout: ---------------------------------------- 82.1/82.1 KB 1.3 MB/s eta 0:00:00 2024-09-12T00:10:49.405 INFO:teuthology.orchestra.run.smithi102.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:10:49.419 INFO:teuthology.orchestra.run.smithi102.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:10:49.454 INFO:teuthology.orchestra.run.smithi102.stdout: ---------------------------------------- 98.7/98.7 KB 2.9 MB/s eta 0:00:00 2024-09-12T00:10:49.525 INFO:teuthology.orchestra.run.smithi102.stdout:Collecting toml>=0.9.4 2024-09-12T00:10:49.543 INFO:teuthology.orchestra.run.smithi102.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:10:49.647 INFO:teuthology.orchestra.run.smithi102.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:10:49.664 INFO:teuthology.orchestra.run.smithi102.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:10:49.812 INFO:teuthology.orchestra.run.smithi102.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:10:49.827 INFO:teuthology.orchestra.run.smithi102.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:10:49.950 INFO:teuthology.orchestra.run.smithi102.stdout:Collecting packaging>=14 2024-09-12T00:10:49.964 INFO:teuthology.orchestra.run.smithi102.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:10:49.999 INFO:teuthology.orchestra.run.smithi102.stdout: ---------------------------------------- 54.0/54.0 KB 1.4 MB/s eta 0:00:00 2024-09-12T00:10:50.269 INFO:teuthology.orchestra.run.smithi102.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:10:50.289 INFO:teuthology.orchestra.run.smithi102.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:10:50.453 INFO:teuthology.orchestra.run.smithi102.stdout: ---------------------------------------- 6.0/6.0 MB 37.5 MB/s eta 0:00:00 2024-09-12T00:10:50.578 INFO:teuthology.orchestra.run.smithi102.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:10:50.593 INFO:teuthology.orchestra.run.smithi102.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:10:50.784 INFO:teuthology.orchestra.run.smithi102.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:10:50.800 INFO:teuthology.orchestra.run.smithi102.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:10:50.886 INFO:teuthology.orchestra.run.smithi102.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:10:50.916 INFO:teuthology.orchestra.run.smithi102.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:10:50.963 INFO:teuthology.orchestra.run.smithi102.stdout: -------------------------------------- 468.9/468.9 KB 11.1 MB/s eta 0:00:00 2024-09-12T00:10:51.134 INFO:teuthology.orchestra.run.smithi102.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T00:10:52.200 INFO:teuthology.orchestra.run.smithi102.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:10:52.300 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:10:53.403 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:10:53.404 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:10:53.404 DEBUG:teuthology.orchestra.run.smithi102:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:10:53.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:10:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:10:53.412 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:10:53.461 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:10:53.461 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:10:53.508 INFO:tasks.workunit:timeout=3h 2024-09-12T00:10:53.508 INFO:tasks.workunit:cleanup=True 2024-09-12T00:10:53.509 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:10:53.559 INFO:tasks.workunit.client.0.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:11:36.457 INFO:tasks.workunit.client.0.smithi102.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:11:36.458 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:11:36.458 INFO:tasks.workunit.client.0.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:11:36.458 INFO:tasks.workunit.client.0.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:11:36.458 INFO:tasks.workunit.client.0.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:11:36.458 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:11:36.458 INFO:tasks.workunit.client.0.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:11:36.458 INFO:tasks.workunit.client.0.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:11:36.458 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:11:36.459 INFO:tasks.workunit.client.0.smithi102.stderr: git switch -c 2024-09-12T00:11:36.459 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:11:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:Or undo this operation with: 2024-09-12T00:11:36.459 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:11:36.459 INFO:tasks.workunit.client.0.smithi102.stderr: git switch - 2024-09-12T00:11:36.459 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:11:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:11:36.459 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:11:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:11:36.464 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:11:36.512 INFO:tasks.workunit.client.0.smithi102.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:11:36.516 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:11:36.516 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:11:37.255 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:11:37.342 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:11:37.390 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:11:37.392 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:11:37.392 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:11:37.442 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:11:37.446 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:11:37.446 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:11:37.493 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T00:11:37.494 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T00:11:37.494 DEBUG:teuthology.orchestra.run.smithi102:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T00:11:37.546 INFO:tasks.workunit.client.0.smithi102.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T00:11:37.547 INFO:tasks.workunit.client.0.smithi102.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:11:37.547 INFO:tasks.workunit.client.0.smithi102.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:11:40.453 INFO:tasks.workunit.client.0.smithi102.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:11:40.453 INFO:tasks.workunit.client.0.smithi102.stderr:++ deactivate nondestructive 2024-09-12T00:11:40.453 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ hash -r 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ export VIRTUAL_ENV 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:11:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:++ export PATH 2024-09-12T00:11:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:11:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -z '' ']' 2024-09-12T00:11:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:11:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:++ PS1='(rgw) ' 2024-09-12T00:11:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:++ export PS1 2024-09-12T00:11:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:11:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:11:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:11:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:++ hash -r 2024-09-12T00:11:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:+ pip install pip --upgrade 2024-09-12T00:11:40.846 INFO:tasks.workunit.client.0.smithi102.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:11:41.115 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting pip 2024-09-12T00:11:41.217 INFO:tasks.workunit.client.0.smithi102.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:11:41.456 INFO:tasks.workunit.client.0.smithi102.stdout: ---------------------------------------- 1.8/1.8 MB 7.8 MB/s eta 0:00:00 2024-09-12T00:11:41.531 INFO:tasks.workunit.client.0.smithi102.stdout:Installing collected packages: pip 2024-09-12T00:11:41.531 INFO:tasks.workunit.client.0.smithi102.stdout: Attempting uninstall: pip 2024-09-12T00:11:41.531 INFO:tasks.workunit.client.0.smithi102.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:11:41.826 INFO:tasks.workunit.client.0.smithi102.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:11:41.832 INFO:tasks.workunit.client.0.smithi102.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:11:42.857 INFO:tasks.workunit.client.0.smithi102.stdout:Successfully installed pip-24.2 2024-09-12T00:11:42.921 INFO:tasks.workunit.client.0.smithi102.stderr:+ pip install configobj 2024-09-12T00:11:43.505 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting configobj 2024-09-12T00:11:43.555 INFO:tasks.workunit.client.0.smithi102.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T00:11:43.696 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting six (from configobj) 2024-09-12T00:11:43.712 INFO:tasks.workunit.client.0.smithi102.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:11:43.783 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T00:11:43.853 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:11:43.934 INFO:tasks.workunit.client.0.smithi102.stdout:Installing collected packages: six, configobj 2024-09-12T00:11:44.125 INFO:tasks.workunit.client.0.smithi102.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T00:11:44.534 INFO:tasks.workunit.client.0.smithi102.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T00:11:44.571 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T00:11:44.571 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T00:11:44.572 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:command succeeded 2024-09-12T00:11:44.572 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T00:11:44.573 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:11:44.573 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T00:11:44.630 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:command succeeded 2024-09-12T00:11:44.631 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 39829/valgrind.bin \ntcp6 0 0 :::443 :::* LISTEN 39829/valgrind.bin \n' 2024-09-12T00:11:44.631 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:radosgw port: 443 2024-09-12T00:11:44.631 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T00:11:44.631 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T00:11:44.666 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:command succeeded 2024-09-12T00:11:44.666 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:b'' 2024-09-12T00:11:44.666 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T00:11:45.118 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:command succeeded 2024-09-12T00:11:45.118 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T00:11:45.024123Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T00:11:45.024093Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T00:11:45.118 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:Creating s3cmd config... 2024-09-12T00:11:45.119 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:proto for s3cmd config is https 2024-09-12T00:11:45.119 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:s3cmd config written 2024-09-12T00:11:45.119 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T00:11:46.279 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:command succeeded 2024-09-12T00:11:46.280 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T00:11:46.280 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T00:11:50.930 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:command succeeded 2024-09-12T00:11:50.930 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 4.2 seconds, 1692.78 KB/s) [1 of 1]\n" 2024-09-12T00:11:50.931 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T00:11:52.661 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:command succeeded 2024-09-12T00:11:52.661 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 1.4 seconds, 4.87 MB/s)\n" 2024-09-12T00:11:52.661 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T00:11:53.038 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:command succeeded 2024-09-12T00:11:53.038 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7368844,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "lz4",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4210766\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4210766,\n "len": 3158078\n }\n ]\n },\n "etag": "9ee81c78995b11fd73a71a565c6268f1",\n "tag": "19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4764642562841931828",\n "manifest": {\n "objs": [],\n "obj_size": 7368844,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".SmU5yNyxG53joLfl8vFM00VGX_Bxl52_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 4190208,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1",\n "bucket_id": "19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4190208,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1",\n "bucket_id": "19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".SmU5yNyxG53joLfl8vFM00VGX_Bxl52_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 4190208,\n "ofs": 7368844,\n "stripe_size": 3178636,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1",\n "bucket_id": "19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".SmU5yNyxG53joLfl8vFM00VGX_Bxl52_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T00:11:50.733258Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4764642562841931828",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726099904/ctime:1726099904/gid:1271/gname:ubuntu/md5:9ee81c78995b11fd73a71a565c6268f1/mode:33204/mtime:1726099904/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T00:11:53.038 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:Cached object name is: .SmU5yNyxG53joLfl8vFM00VGX_Bxl52_ 2024-09-12T00:11:53.038 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T00:11:53.039 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:command succeeded 2024-09-12T00:11:53.040 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:b'0\n' 2024-09-12T00:11:53.040 INFO:tasks.workunit.client.0.smithi102.stderr:DEBUG:root:Check cache dir content: 0 2024-09-12T00:11:53.040 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-12T00:11:53.040 INFO:tasks.workunit.client.0.smithi102.stderr:INFO:root:Completed Datacache tests 2024-09-12T00:11:53.046 INFO:tasks.workunit.client.0.smithi102.stderr:+ deactivate 2024-09-12T00:11:53.046 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:11:53.046 INFO:tasks.workunit.client.0.smithi102.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:11:53.046 INFO:tasks.workunit.client.0.smithi102.stderr:+ export PATH 2024-09-12T00:11:53.046 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:11:53.047 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n '' ']' 2024-09-12T00:11:53.047 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:11:53.047 INFO:tasks.workunit.client.0.smithi102.stderr:+ hash -r 2024-09-12T00:11:53.047 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n '' ']' 2024-09-12T00:11:53.047 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:11:53.047 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:11:53.047 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:11:53.047 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset -f deactivate 2024-09-12T00:11:53.047 INFO:tasks.workunit.client.0.smithi102.stderr:+ echo OK. 2024-09-12T00:11:53.048 INFO:tasks.workunit.client.0.smithi102.stdout:OK. 2024-09-12T00:11:53.048 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:11:53.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:11:53.110 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T00:11:53.110 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:11:53.455 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:53.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:11:53.467 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:11:53.468 DEBUG:teuthology.orchestra.run.smithi102:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:11:53.592 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:11:53.592 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:11:53.602 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:11:53.602 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:11:53.602 DEBUG:teuthology.orchestra.run.smithi102:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:11:53.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:11:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:11:53.610 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:11:53.655 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:11:53.656 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:11:53.704 INFO:tasks.workunit:timeout=3h 2024-09-12T00:11:53.704 INFO:tasks.workunit:cleanup=True 2024-09-12T00:11:53.705 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:11:53.754 INFO:tasks.workunit.client.0.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:12:35.894 INFO:tasks.workunit.client.0.smithi102.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:12:35.894 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:35.894 INFO:tasks.workunit.client.0.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr: git switch -c 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr:Or undo this operation with: 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr: git switch - 2024-09-12T00:12:35.895 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:35.896 INFO:tasks.workunit.client.0.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:12:35.896 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:35.896 INFO:tasks.workunit.client.0.smithi102.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:12:35.901 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:12:35.948 INFO:tasks.workunit.client.0.smithi102.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:12:35.951 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:12:35.951 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:12:36.000 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:12:36.053 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:12:36.094 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:12:36.095 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:12:36.095 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:12:36.140 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:12:36.144 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:12:36.144 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:12:36.191 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:12:36.193 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:12:36.193 DEBUG:teuthology.orchestra.run.smithi102:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:12:36.244 INFO:tasks.workunit.client.0.smithi102.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:12:36.245 INFO:tasks.workunit.client.0.smithi102.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:12:36.245 INFO:tasks.workunit.client.0.smithi102.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:12:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:12:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:++ deactivate nondestructive 2024-09-12T00:12:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:12:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:12:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:12:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:++ hash -r 2024-09-12T00:12:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:12:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:12:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:12:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ export VIRTUAL_ENV 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ export PATH 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -z '' ']' 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ PS1='(rgw) ' 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ export PS1 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:++ hash -r 2024-09-12T00:12:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:+ pip install pip --upgrade 2024-09-12T00:12:39.556 INFO:tasks.workunit.client.0.smithi102.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:12:39.762 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting pip 2024-09-12T00:12:39.768 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:12:39.803 INFO:tasks.workunit.client.0.smithi102.stdout:Installing collected packages: pip 2024-09-12T00:12:39.803 INFO:tasks.workunit.client.0.smithi102.stdout: Attempting uninstall: pip 2024-09-12T00:12:39.803 INFO:tasks.workunit.client.0.smithi102.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:12:40.066 INFO:tasks.workunit.client.0.smithi102.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:12:40.072 INFO:tasks.workunit.client.0.smithi102.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:12:40.811 INFO:tasks.workunit.client.0.smithi102.stdout:Successfully installed pip-24.2 2024-09-12T00:12:40.870 INFO:tasks.workunit.client.0.smithi102.stderr:+ pip install boto3 2024-09-12T00:12:42.122 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting boto3 2024-09-12T00:12:42.181 INFO:tasks.workunit.client.0.smithi102.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:12:42.827 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:12:42.842 INFO:tasks.workunit.client.0.smithi102.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:12:42.974 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:12:42.991 INFO:tasks.workunit.client.0.smithi102.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:12:43.146 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:12:43.163 INFO:tasks.workunit.client.0.smithi102.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:12:43.332 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:12:43.349 INFO:tasks.workunit.client.0.smithi102.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:12:43.558 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:12:43.574 INFO:tasks.workunit.client.0.smithi102.stdout: Downloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:12:43.803 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:12:43.805 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:12:43.824 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:12:43.920 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:12:44.181 INFO:tasks.workunit.client.0.smithi102.stdout: ---------------------------------------- 12.5/12.5 MB 50.2 MB/s eta 0:00:00 2024-09-12T00:12:44.199 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:12:44.264 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:12:44.334 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:12:44.417 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:12:44.477 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:12:44.602 INFO:tasks.workunit.client.0.smithi102.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:12:45.795 INFO:tasks.workunit.client.0.smithi102.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:12:46.010 INFO:tasks.workunit.client.0.smithi102.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:12:46.152 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:12:46.190 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:46.190 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:46.234 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.232+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.236+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:46.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.236+0000 7fdd5f6ae9c0 20 realm 2024-09-12T00:12:46.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.236+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.236+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:46.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.236+0000 7fdd5f6ae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:46.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.236+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.236+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:46.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.236+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.236+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:46.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.236+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.240+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:46.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.240+0000 7fdd5f6ae9c0 20 searching for the correct realm 2024-09-12T00:12:46.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.244+0000 7fdd5d9b5640 0 -- 172.21.15.102:0/4006005480 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fdd50037070 msgr2=0x7fdd50047430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:12:46.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.460+0000 7fdd57fff640 0 -- 172.21.15.102:0/4006005480 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fdd58017810 msgr2=0x7fdd58076a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:12:46.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.676+0000 7fdd5f6ae9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:46.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.676+0000 7fdd5f6ae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:46.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.676+0000 7fdd5f6ae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:46.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.676+0000 7fdd5f6ae9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:46.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.676+0000 7fdd5f6ae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:46.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.676+0000 7fdd5f6ae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:46.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.676+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:46.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:46.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:46.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 zone default found 2024-09-12T00:12:46.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 4 Realm: () 2024-09-12T00:12:46.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:46.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:46.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:46.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 zonegroup default 2024-09-12T00:12:46.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:46.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:46.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.680+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.684+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:46.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.684+0000 7fdd5f6ae9c0 20 started sync module instance, tier type = 2024-09-12T00:12:46.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.684+0000 7fdd5f6ae9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:46.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.708+0000 7fdd5f6ae9c0 20 add_watcher() i=0 2024-09-12T00:12:46.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.708+0000 7fdd5f6ae9c0 20 add_watcher() i=1 2024-09-12T00:12:46.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.708+0000 7fdd5f6ae9c0 20 add_watcher() i=2 2024-09-12T00:12:46.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.708+0000 7fdd5f6ae9c0 20 add_watcher() i=3 2024-09-12T00:12:46.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.708+0000 7fdd5f6ae9c0 20 add_watcher() i=4 2024-09-12T00:12:46.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.708+0000 7fdd5f6ae9c0 20 add_watcher() i=5 2024-09-12T00:12:46.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.708+0000 7fdd5f6ae9c0 20 add_watcher() i=6 2024-09-12T00:12:46.712 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.712+0000 7fdd5f6ae9c0 20 add_watcher() i=7 2024-09-12T00:12:46.712 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.712+0000 7fdd5f6ae9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:46.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.716+0000 7fdc13fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:46.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.716+0000 7fdd5f6ae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:46.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.716+0000 7fdd5f6ae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:46.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.716+0000 7fdd5f6ae9c0 5 note: GC not initialized 2024-09-12T00:12:46.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.716+0000 7fdc12fe5640 20 reqs_thread_entry: start 2024-09-12T00:12:46.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.716+0000 7fdd5f6ae9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:46.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.716+0000 7fdd5f6ae9c0 20 Filter name: none 2024-09-12T00:12:46.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.716+0000 7fdc10fe1640 20 reqs_thread_entry: start 2024-09-12T00:12:46.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.716+0000 7fdd5f6ae9c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:12:46.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.716+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.720+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:46.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.720+0000 7fdd5f6ae9c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:12:46.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.720+0000 7fdd5f6ae9c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:12:46.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.720+0000 7fdd5f6ae9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:12:46.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.720+0000 7fdd5f6ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:46.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.720+0000 7fdd5f6ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:46.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.720+0000 7fdd5f6ae9c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:12:46.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.720+0000 7fdd5f6ae9c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:12:46.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.720+0000 7fdd5f6ae9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:12:46.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.720+0000 7fdd5f6ae9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:12:46.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.724+0000 7fdd5f6ae9c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:12:46.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.724+0000 7fdd5f6ae9c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:12:46.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.724+0000 7fdd5f6ae9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:12:46.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.724+0000 7fdc40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724546 cookie 94484265236144 notifier 4532 bl.length()=593 2024-09-12T00:12:46.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.724+0000 7fdc40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:12:46.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.724+0000 7fdc40ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:12:46.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.728+0000 7fdd5f6ae9c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:12:46.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.728+0000 7fdd5f6ae9c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:12:46.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.728+0000 7fdd5f6ae9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:12:46.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.732+0000 7fdc40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94484265238352 notifier 4532 bl.length()=186 2024-09-12T00:12:46.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.732+0000 7fdc40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:12:46.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.732+0000 7fdc40ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:12:46.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.736+0000 7fdc13fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:46.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.740+0000 7fdd5f6ae9c0 20 remove_watcher() i=0 2024-09-12T00:12:46.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.740+0000 7fdd5f6ae9c0 2 removed watcher, disabling cache 2024-09-12T00:12:46.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.740+0000 7fdd5f6ae9c0 20 remove_watcher() i=1 2024-09-12T00:12:46.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.744+0000 7fdd5f6ae9c0 20 remove_watcher() i=2 2024-09-12T00:12:46.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.748+0000 7fdd5f6ae9c0 20 remove_watcher() i=3 2024-09-12T00:12:46.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.748+0000 7fdd5f6ae9c0 20 remove_watcher() i=4 2024-09-12T00:12:46.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.752+0000 7fdd5f6ae9c0 20 remove_watcher() i=5 2024-09-12T00:12:46.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.752+0000 7fdd5f6ae9c0 20 remove_watcher() i=6 2024-09-12T00:12:46.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:46.752+0000 7fdd5f6ae9c0 20 remove_watcher() i=7 2024-09-12T00:12:47.020 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:47.020 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:47.122 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:47.122 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:47.249 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:47.249 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:47.381 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:47.381 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:47.587 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:47.587 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:47.668 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:47.668 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:47.768 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:47.768 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:47.829 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:47.829 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:47.956 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:47.956 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:48.270 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:48.270 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:48.369 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:48.369 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:48.527 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:48.527 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:48.596 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:48.597 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:48.752 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:48.752 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:48.822 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:48.823 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:48.960 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:48.961 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:49.026 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:12:49.026 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:49.026 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:12:49.062 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:49.062 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:49.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.108+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.108+0000 7f0c45ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.108+0000 7f0c45ca29c0 20 realm 2024-09-12T00:12:49.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.108+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.108+0000 7f0c45ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.108+0000 7f0c45ca29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:49.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.108+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.108+0000 7f0c45ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.108+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.112+0000 7f0c45ca29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:49.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.112+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.112+0000 7f0c45ca29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:49.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.112+0000 7f0c45ca29c0 20 searching for the correct realm 2024-09-12T00:12:49.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.116+0000 7f0c43fa9640 0 -- 172.21.15.102:0/3347893050 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55d5aab8e990 msgr2=0x55d5aab90d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:49.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.124+0000 7f0c42fa7640 0 -- 172.21.15.102:0/3347893050 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f0c3c04d910 msgr2=0x7f0c3c02b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:49.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.340+0000 7f0c45ca29c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:49.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.340+0000 7f0c45ca29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:49.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.340+0000 7f0c45ca29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:49.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.340+0000 7f0c45ca29c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:49.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.340+0000 7f0c45ca29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:49.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.340+0000 7f0c45ca29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:49.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.340+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.340+0000 7f0c45ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.340+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:49.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:49.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 20 zone default found 2024-09-12T00:12:49.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 4 Realm: () 2024-09-12T00:12:49.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:49.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:49.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:49.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 20 zonegroup default 2024-09-12T00:12:49.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.344+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.348+0000 7f0c45ca29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.348+0000 7f0c45ca29c0 20 started sync module instance, tier type = 2024-09-12T00:12:49.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.348+0000 7f0c45ca29c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:49.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.372+0000 7f0c45ca29c0 20 add_watcher() i=0 2024-09-12T00:12:49.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.372+0000 7f0c45ca29c0 20 add_watcher() i=1 2024-09-12T00:12:49.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.372+0000 7f0c45ca29c0 20 add_watcher() i=2 2024-09-12T00:12:49.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.372+0000 7f0c45ca29c0 20 add_watcher() i=3 2024-09-12T00:12:49.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.372+0000 7f0c45ca29c0 20 add_watcher() i=4 2024-09-12T00:12:49.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.372+0000 7f0c45ca29c0 20 add_watcher() i=5 2024-09-12T00:12:49.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.372+0000 7f0c45ca29c0 20 add_watcher() i=6 2024-09-12T00:12:49.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.372+0000 7f0c45ca29c0 20 add_watcher() i=7 2024-09-12T00:12:49.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.372+0000 7f0c45ca29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:49.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.376+0000 7f0af9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:49.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.376+0000 7f0c45ca29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:49.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.376+0000 7f0c45ca29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:49.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.376+0000 7f0c45ca29c0 5 note: GC not initialized 2024-09-12T00:12:49.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0af8fe1640 20 reqs_thread_entry: start 2024-09-12T00:12:49.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:49.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 20 Filter name: none 2024-09-12T00:12:49.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0a727fc640 20 reqs_thread_entry: start 2024-09-12T00:12:49.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:12:49.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:49.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:12:49.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:12:49.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 : miss 2024-09-12T00:12:49.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:49.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 info.flags=0x17 2024-09-12T00:12:49.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 to cache LRU end 2024-09-12T00:12:49.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:12:49.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:12:49.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.380+0000 7f0c45ca29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 2024-09-12T00:12:49.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.384+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:12:49.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.384+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:49.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.384+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:12:49.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.384+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:12:49.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.388+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:12:49.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.388+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:49.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.388+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:12:49.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.388+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:12:49.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.388+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:49.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.388+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:12:49.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.388+0000 7f0c45ca29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:49.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.400+0000 7f0af9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:49.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.408+0000 7f0c45ca29c0 20 remove_watcher() i=0 2024-09-12T00:12:49.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.408+0000 7f0c45ca29c0 2 removed watcher, disabling cache 2024-09-12T00:12:49.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.408+0000 7f0c45ca29c0 20 remove_watcher() i=1 2024-09-12T00:12:49.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.412+0000 7f0c45ca29c0 20 remove_watcher() i=2 2024-09-12T00:12:49.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.416+0000 7f0c45ca29c0 20 remove_watcher() i=3 2024-09-12T00:12:49.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.416+0000 7f0c45ca29c0 20 remove_watcher() i=4 2024-09-12T00:12:49.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.420+0000 7f0c45ca29c0 20 remove_watcher() i=5 2024-09-12T00:12:49.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.420+0000 7f0c45ca29c0 20 remove_watcher() i=6 2024-09-12T00:12:49.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.424+0000 7f0c45ca29c0 20 remove_watcher() i=7 2024-09-12T00:12:49.439 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:12:49.469 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:49.469 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:49.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.508+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.512+0000 7f63663b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.512+0000 7f63663b79c0 20 realm 2024-09-12T00:12:49.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.512+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.512+0000 7f63663b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.512+0000 7f63663b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:49.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.512+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.512+0000 7f63663b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.512+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.512+0000 7f63663b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:49.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.512+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.516+0000 7f63663b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:49.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.516+0000 7f63663b79c0 20 searching for the correct realm 2024-09-12T00:12:49.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.520+0000 7f63646be640 0 -- 172.21.15.102:0/4046843852 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f6358008050 msgr2=0x7f6358058910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:49.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.528+0000 7f63636bc640 0 -- 172.21.15.102:0/4046843852 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f635c0ef410 msgr2=0x7f635c0ef890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:49.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.744+0000 7f63663b79c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:49.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.744+0000 7f63663b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:49.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.744+0000 7f63663b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:49.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.744+0000 7f63663b79c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:49.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.744+0000 7f63663b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:49.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.744+0000 7f63663b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:49.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.744+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:49.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:49.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 zone default found 2024-09-12T00:12:49.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 4 Realm: () 2024-09-12T00:12:49.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:49.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:49.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:49.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 zonegroup default 2024-09-12T00:12:49.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.748+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.752+0000 7f63663b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.752+0000 7f63663b79c0 20 started sync module instance, tier type = 2024-09-12T00:12:49.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.752+0000 7f63663b79c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:49.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.776+0000 7f63663b79c0 20 add_watcher() i=0 2024-09-12T00:12:49.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.776+0000 7f63663b79c0 20 add_watcher() i=1 2024-09-12T00:12:49.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.776+0000 7f63663b79c0 20 add_watcher() i=2 2024-09-12T00:12:49.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.776+0000 7f63663b79c0 20 add_watcher() i=3 2024-09-12T00:12:49.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.776+0000 7f63663b79c0 20 add_watcher() i=4 2024-09-12T00:12:49.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.776+0000 7f63663b79c0 20 add_watcher() i=5 2024-09-12T00:12:49.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.776+0000 7f63663b79c0 20 add_watcher() i=6 2024-09-12T00:12:49.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.780+0000 7f63663b79c0 20 add_watcher() i=7 2024-09-12T00:12:49.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.780+0000 7f63663b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:49.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f6219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:49.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f63663b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:49.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f63663b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:49.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f63663b79c0 5 note: GC not initialized 2024-09-12T00:12:49.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f6218fe1640 20 reqs_thread_entry: start 2024-09-12T00:12:49.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f63663b79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:49.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f63663b79c0 20 Filter name: none 2024-09-12T00:12:49.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f61927fc640 20 reqs_thread_entry: start 2024-09-12T00:12:49.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f63663b79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:49.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.784+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.788+0000 7f63663b79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:49.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.788+0000 7f63663b79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:12:49.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.788+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.788+0000 7f63663b79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:49.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.788+0000 7f63663b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.788+0000 7f63663b79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:49.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.788+0000 7f63663b79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:12:49.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.788+0000 7f6219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:49.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.796+0000 7f63663b79c0 20 remove_watcher() i=0 2024-09-12T00:12:49.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.796+0000 7f63663b79c0 2 removed watcher, disabling cache 2024-09-12T00:12:49.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.796+0000 7f63663b79c0 20 remove_watcher() i=1 2024-09-12T00:12:49.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.800+0000 7f63663b79c0 20 remove_watcher() i=2 2024-09-12T00:12:49.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.804+0000 7f63663b79c0 20 remove_watcher() i=3 2024-09-12T00:12:49.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.804+0000 7f63663b79c0 20 remove_watcher() i=4 2024-09-12T00:12:49.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.808+0000 7f63663b79c0 20 remove_watcher() i=5 2024-09-12T00:12:49.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.808+0000 7f63663b79c0 20 remove_watcher() i=6 2024-09-12T00:12:49.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.808+0000 7f63663b79c0 20 remove_watcher() i=7 2024-09-12T00:12:49.825 INFO:tasks.workunit.client.0.smithi102.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 79, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:12:49.825 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:12:49.825 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:49.825 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:12:49.861 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:49.861 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:49.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.904+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.904+0000 7f40d33d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.904+0000 7f40d33d99c0 20 realm 2024-09-12T00:12:49.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.904+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.904+0000 7f40d33d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.904+0000 7f40d33d99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:49.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.904+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.904+0000 7f40d33d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:49.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.904+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.908+0000 7f40d33d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:49.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.908+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:49.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.908+0000 7f40d33d99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:49.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.908+0000 7f40d33d99c0 20 searching for the correct realm 2024-09-12T00:12:49.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.912+0000 7f40d16e0640 0 -- 172.21.15.102:0/2349562044 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f40c40d8060 msgr2=0x7f40c40fc2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:49.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:49.920+0000 7f40d06de640 0 -- 172.21.15.102:0/2349562044 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f40c805b750 msgr2=0x7f40c800f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:50.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:50.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:50.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:50.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:50.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:50.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:50.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:50.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:50.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:50.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:50.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.136+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:50.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:50.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 zone default found 2024-09-12T00:12:50.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 4 Realm: () 2024-09-12T00:12:50.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:50.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:50.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:50.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 zonegroup default 2024-09-12T00:12:50.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:50.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:50.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:50.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:50.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:50.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:50.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 started sync module instance, tier type = 2024-09-12T00:12:50.142 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.140+0000 7f40d33d99c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:50.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.164+0000 7f40d33d99c0 20 add_watcher() i=0 2024-09-12T00:12:50.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.164+0000 7f40d33d99c0 20 add_watcher() i=1 2024-09-12T00:12:50.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.164+0000 7f40d33d99c0 20 add_watcher() i=2 2024-09-12T00:12:50.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.164+0000 7f40d33d99c0 20 add_watcher() i=3 2024-09-12T00:12:50.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.164+0000 7f40d33d99c0 20 add_watcher() i=4 2024-09-12T00:12:50.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.164+0000 7f40d33d99c0 20 add_watcher() i=5 2024-09-12T00:12:50.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.164+0000 7f40d33d99c0 20 add_watcher() i=6 2024-09-12T00:12:50.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.168+0000 7f40d33d99c0 20 add_watcher() i=7 2024-09-12T00:12:50.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.168+0000 7f40d33d99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:50.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.172+0000 7f3f86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:50.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.172+0000 7f40d33d99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:50.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.172+0000 7f40d33d99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:50.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.172+0000 7f40d33d99c0 5 note: GC not initialized 2024-09-12T00:12:50.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.172+0000 7f3f85fe3640 20 reqs_thread_entry: start 2024-09-12T00:12:50.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.172+0000 7f40d33d99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:50.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.172+0000 7f40d33d99c0 20 Filter name: none 2024-09-12T00:12:50.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f3ef77fe640 20 reqs_thread_entry: start 2024-09-12T00:12:50.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:12:50.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:50.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:50.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:12:50.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:12:50.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 : miss 2024-09-12T00:12:50.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:50.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:50.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 info.flags=0x17 2024-09-12T00:12:50.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 to cache LRU end 2024-09-12T00:12:50.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:12:50.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:12:50.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 2024-09-12T00:12:50.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:12:50.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:12:50.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:50.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:12:50.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.176+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:12:50.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:12:50.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:12:50.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:12:50.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:12:50.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:12:50.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:50.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:12:50.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:12:50.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:12:50.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:12:50.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:12:50.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.180+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:50.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.184+0000 7f40d33d99c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:12:50.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.184+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:12:50.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.184+0000 7f40d33d99c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:12:50.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.184+0000 7f40d33d99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:50.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.184+0000 7f40d33d99c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:12:50.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.184+0000 7f40d33d99c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:12:50.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.184+0000 7f3f86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:50.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.188+0000 7f40d33d99c0 20 remove_watcher() i=0 2024-09-12T00:12:50.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.188+0000 7f40d33d99c0 2 removed watcher, disabling cache 2024-09-12T00:12:50.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.192+0000 7f40d33d99c0 20 remove_watcher() i=1 2024-09-12T00:12:50.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.192+0000 7f40d33d99c0 20 remove_watcher() i=2 2024-09-12T00:12:50.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.196+0000 7f40d33d99c0 20 remove_watcher() i=3 2024-09-12T00:12:50.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.196+0000 7f40d33d99c0 20 remove_watcher() i=4 2024-09-12T00:12:50.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.200+0000 7f40d33d99c0 20 remove_watcher() i=5 2024-09-12T00:12:50.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.200+0000 7f40d33d99c0 20 remove_watcher() i=6 2024-09-12T00:12:50.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:50.204+0000 7f40d33d99c0 20 remove_watcher() i=7 2024-09-12T00:12:50.227 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:12:50.664 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:12:52.102 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:52.102 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:52.292 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:12:52.292 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:12:52.330 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:52.330 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:52.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.584+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:52.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.584+0000 7f5f944559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:52.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.584+0000 7f5f944559c0 20 realm 2024-09-12T00:12:52.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.584+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:52.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.588+0000 7f5f944559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:52.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.588+0000 7f5f944559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:52.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.588+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:52.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.588+0000 7f5f944559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:52.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.588+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:52.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.588+0000 7f5f944559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:52.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.588+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:52.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.588+0000 7f5f944559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:52.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.588+0000 7f5f944559c0 20 searching for the correct realm 2024-09-12T00:12:52.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.592+0000 7f5f9275c640 0 -- 172.21.15.102:0/2877354384 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f5f88018070 msgr2=0x7f5f88002a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:52.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:52.808+0000 7f5f9175a640 0 -- 172.21.15.102:0/2877354384 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f5f8c0f5410 msgr2=0x7f5f8c0f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:53.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.024+0000 7f5f944559c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:53.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.024+0000 7f5f944559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:53.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.024+0000 7f5f944559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:53.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.024+0000 7f5f944559c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:53.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.024+0000 7f5f944559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:53.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.024+0000 7f5f944559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:53.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.024+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.024+0000 7f5f944559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.024+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:53.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:53.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 zone default found 2024-09-12T00:12:53.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 4 Realm: () 2024-09-12T00:12:53.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:53.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:53.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:53.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 zonegroup default 2024-09-12T00:12:53.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 started sync module instance, tier type = 2024-09-12T00:12:53.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.028+0000 7f5f944559c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:53.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.056+0000 7f5f944559c0 20 add_watcher() i=0 2024-09-12T00:12:53.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.056+0000 7f5f944559c0 20 add_watcher() i=1 2024-09-12T00:12:53.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.056+0000 7f5f944559c0 20 add_watcher() i=2 2024-09-12T00:12:53.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.056+0000 7f5f944559c0 20 add_watcher() i=3 2024-09-12T00:12:53.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.056+0000 7f5f944559c0 20 add_watcher() i=4 2024-09-12T00:12:53.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.056+0000 7f5f944559c0 20 add_watcher() i=5 2024-09-12T00:12:53.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.056+0000 7f5f944559c0 20 add_watcher() i=6 2024-09-12T00:12:53.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.060+0000 7f5f944559c0 20 add_watcher() i=7 2024-09-12T00:12:53.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.060+0000 7f5f944559c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:53.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.064+0000 7f5e437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:53.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.064+0000 7f5f944559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:53.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.064+0000 7f5f944559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:53.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.064+0000 7f5f944559c0 5 note: GC not initialized 2024-09-12T00:12:53.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5e427fc640 20 reqs_thread_entry: start 2024-09-12T00:12:53.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:53.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 Filter name: none 2024-09-12T00:12:53.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5db3fff640 20 reqs_thread_entry: start 2024-09-12T00:12:53.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:53.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:53.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:12:53.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:12:53.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 INFO: main: starting shard=0 2024-09-12T00:12:53.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:12:53.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 INFO: main: starting shard=1 2024-09-12T00:12:53.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.068+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:53.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 INFO: main: starting shard=2 2024-09-12T00:12:53.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:12:53.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 INFO: main: starting shard=3 2024-09-12T00:12:53.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:12:53.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 INFO: main: starting shard=4 2024-09-12T00:12:53.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:12:53.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 INFO: main: starting shard=5 2024-09-12T00:12:53.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:53.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 INFO: main: starting shard=6 2024-09-12T00:12:53.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.072+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:12:53.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 INFO: main: starting shard=7 2024-09-12T00:12:53.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:12:53.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 INFO: main: starting shard=8 2024-09-12T00:12:53.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:53.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:12:53.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 INFO: main: starting shard=9 2024-09-12T00:12:53.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:12:53.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 INFO: main: starting shard=10 2024-09-12T00:12:53.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:53.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.076+0000 7f5f944559c0 20 INFO: main: done 2024-09-12T00:12:53.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.080+0000 7f5e437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:53.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.084+0000 7f5f944559c0 20 remove_watcher() i=0 2024-09-12T00:12:53.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.084+0000 7f5f944559c0 2 removed watcher, disabling cache 2024-09-12T00:12:53.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.088+0000 7f5f944559c0 20 remove_watcher() i=1 2024-09-12T00:12:53.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.088+0000 7f5f944559c0 20 remove_watcher() i=2 2024-09-12T00:12:53.091 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.092+0000 7f5f944559c0 20 remove_watcher() i=3 2024-09-12T00:12:53.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.092+0000 7f5f944559c0 20 remove_watcher() i=4 2024-09-12T00:12:53.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.096+0000 7f5f944559c0 20 remove_watcher() i=5 2024-09-12T00:12:53.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.096+0000 7f5f944559c0 20 remove_watcher() i=6 2024-09-12T00:12:53.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.096+0000 7f5f944559c0 20 remove_watcher() i=7 2024-09-12T00:12:53.122 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:53.122 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:53.153 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:53.153 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:53.220 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:53.220 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:53.392 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:12:53.392 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:12:53.427 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:53.427 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:53.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.472+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.472+0000 7f102768a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.472+0000 7f102768a9c0 20 realm 2024-09-12T00:12:53.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.472+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.472+0000 7f102768a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.472+0000 7f102768a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:53.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.472+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.476+0000 7f102768a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.476+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.476+0000 7f102768a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:53.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.476+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.476+0000 7f102768a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:53.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.476+0000 7f102768a9c0 20 searching for the correct realm 2024-09-12T00:12:53.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.480+0000 7f1025991640 0 -- 172.21.15.102:0/1699325054 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f101c0de070 msgr2=0x7f101c0de960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:53.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.488+0000 7f102498f640 0 -- 172.21.15.102:0/1699325054 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f1020086600 msgr2=0x7f1020009c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:53.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.704+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:53.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 zone default found 2024-09-12T00:12:53.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 4 Realm: () 2024-09-12T00:12:53.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:53.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:53.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:53.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 zonegroup default 2024-09-12T00:12:53.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:53.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 started sync module instance, tier type = 2024-09-12T00:12:53.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.708+0000 7f102768a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:53.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.736+0000 7f102768a9c0 20 add_watcher() i=0 2024-09-12T00:12:53.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.736+0000 7f102768a9c0 20 add_watcher() i=1 2024-09-12T00:12:53.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.736+0000 7f102768a9c0 20 add_watcher() i=2 2024-09-12T00:12:53.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.736+0000 7f102768a9c0 20 add_watcher() i=3 2024-09-12T00:12:53.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.736+0000 7f102768a9c0 20 add_watcher() i=4 2024-09-12T00:12:53.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.736+0000 7f102768a9c0 20 add_watcher() i=5 2024-09-12T00:12:53.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.736+0000 7f102768a9c0 20 add_watcher() i=6 2024-09-12T00:12:53.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.736+0000 7f102768a9c0 20 add_watcher() i=7 2024-09-12T00:12:53.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.736+0000 7f102768a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:53.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.740+0000 7f0edb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:53.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:53.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:53.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 5 note: GC not initialized 2024-09-12T00:12:53.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f0eda7e4640 20 reqs_thread_entry: start 2024-09-12T00:12:53.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:53.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 Filter name: none 2024-09-12T00:12:53.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f0e4bfff640 20 reqs_thread_entry: start 2024-09-12T00:12:53.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:53.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:53.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:53.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:12:53.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:12:53.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 INFO: main: starting shard=0 2024-09-12T00:12:53.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.744+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:12:53.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 INFO: main: starting shard=1 2024-09-12T00:12:53.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:53.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 INFO: main: starting shard=2 2024-09-12T00:12:53.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:12:53.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 INFO: main: starting shard=3 2024-09-12T00:12:53.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:12:53.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 INFO: main: starting shard=4 2024-09-12T00:12:53.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.748+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:12:53.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: starting shard=5 2024-09-12T00:12:53.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:53.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:12:53.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: starting shard=6 2024-09-12T00:12:53.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:12:53.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: starting shard=7 2024-09-12T00:12:53.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:12:53.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: starting shard=8 2024-09-12T00:12:53.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:53.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: starting shard=9 2024-09-12T00:12:53.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:12:53.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 INFO: main: starting shard=10 2024-09-12T00:12:53.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.752+0000 7f102768a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:53.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.756+0000 7f102768a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:53.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.756+0000 7f102768a9c0 20 INFO: main: done 2024-09-12T00:12:53.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.756+0000 7f0edb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:53.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.760+0000 7f102768a9c0 20 remove_watcher() i=0 2024-09-12T00:12:53.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.760+0000 7f102768a9c0 2 removed watcher, disabling cache 2024-09-12T00:12:53.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.764+0000 7f102768a9c0 20 remove_watcher() i=1 2024-09-12T00:12:53.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.764+0000 7f102768a9c0 20 remove_watcher() i=2 2024-09-12T00:12:53.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.768+0000 7f102768a9c0 20 remove_watcher() i=3 2024-09-12T00:12:53.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.768+0000 7f102768a9c0 20 remove_watcher() i=4 2024-09-12T00:12:53.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.772+0000 7f102768a9c0 20 remove_watcher() i=5 2024-09-12T00:12:53.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.772+0000 7f102768a9c0 20 remove_watcher() i=6 2024-09-12T00:12:53.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:53.772+0000 7f102768a9c0 20 remove_watcher() i=7 2024-09-12T00:12:53.793 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:53.793 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:53.823 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:53.824 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:54.041 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:12:54.041 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:12:54.075 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:54.075 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:54.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.120+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.120+0000 7f23b25569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:54.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.120+0000 7f23b25569c0 20 realm 2024-09-12T00:12:54.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.120+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.124+0000 7f23b25569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:54.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.124+0000 7f23b25569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:54.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.124+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.124+0000 7f23b25569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:54.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.124+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.124+0000 7f23b25569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:54.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.124+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.124+0000 7f23b25569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:54.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.124+0000 7f23b25569c0 20 searching for the correct realm 2024-09-12T00:12:54.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.128+0000 7f23b085d640 0 -- 172.21.15.102:0/2774018264 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f2398037070 msgr2=0x7f2398069980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:54.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.344+0000 7f23af85b640 0 -- 172.21.15.102:0/2774018264 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f23a00b83f0 msgr2=0x7f23a00b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:54.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.560+0000 7f23b25569c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:54.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.560+0000 7f23b25569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:54.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.560+0000 7f23b25569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:54.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.560+0000 7f23b25569c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:54.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.560+0000 7f23b25569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:54.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.560+0000 7f23b25569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:54.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.560+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.560+0000 7f23b25569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:54.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.560+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:54.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:54.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 zone default found 2024-09-12T00:12:54.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 4 Realm: () 2024-09-12T00:12:54.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:54.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:54.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:54.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 zonegroup default 2024-09-12T00:12:54.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:54.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:54.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:54.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 started sync module instance, tier type = 2024-09-12T00:12:54.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.564+0000 7f23b25569c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:54.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.592+0000 7f23b25569c0 20 add_watcher() i=0 2024-09-12T00:12:54.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.592+0000 7f23b25569c0 20 add_watcher() i=1 2024-09-12T00:12:54.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.592+0000 7f23b25569c0 20 add_watcher() i=2 2024-09-12T00:12:54.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.592+0000 7f23b25569c0 20 add_watcher() i=3 2024-09-12T00:12:54.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.592+0000 7f23b25569c0 20 add_watcher() i=4 2024-09-12T00:12:54.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.592+0000 7f23b25569c0 20 add_watcher() i=5 2024-09-12T00:12:54.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.592+0000 7f23b25569c0 20 add_watcher() i=6 2024-09-12T00:12:54.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.592+0000 7f23b25569c0 20 add_watcher() i=7 2024-09-12T00:12:54.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.592+0000 7f23b25569c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:54.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.596+0000 7f2266fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:54.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:54.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:54.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 5 note: GC not initialized 2024-09-12T00:12:54.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f2265fdb640 20 reqs_thread_entry: start 2024-09-12T00:12:54.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:54.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 Filter name: none 2024-09-12T00:12:54.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f21d77fe640 20 reqs_thread_entry: start 2024-09-12T00:12:54.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:54.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:54.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:12:54.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:12:54.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 INFO: main: starting shard=0 2024-09-12T00:12:54.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.600+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:12:54.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:54.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 INFO: main: starting shard=1 2024-09-12T00:12:54.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:54.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:12:54.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 INFO: main: starting shard=2 2024-09-12T00:12:54.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:12:54.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:54.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 INFO: main: starting shard=3 2024-09-12T00:12:54.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:12:54.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:54.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 INFO: main: starting shard=4 2024-09-12T00:12:54.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:12:54.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:54.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 INFO: main: starting shard=5 2024-09-12T00:12:54.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.604+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:54.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:54.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: starting shard=6 2024-09-12T00:12:54.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:12:54.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:54.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: starting shard=7 2024-09-12T00:12:54.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:12:54.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:54.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: starting shard=8 2024-09-12T00:12:54.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:54.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:54.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: starting shard=9 2024-09-12T00:12:54.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:12:54.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:54.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: starting shard=10 2024-09-12T00:12:54.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:54.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:54.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.608+0000 7f23b25569c0 20 INFO: main: done 2024-09-12T00:12:54.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.612+0000 7f2266fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:54.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.616+0000 7f23b25569c0 20 remove_watcher() i=0 2024-09-12T00:12:54.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.616+0000 7f23b25569c0 2 removed watcher, disabling cache 2024-09-12T00:12:54.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.620+0000 7f23b25569c0 20 remove_watcher() i=1 2024-09-12T00:12:54.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.620+0000 7f23b25569c0 20 remove_watcher() i=2 2024-09-12T00:12:54.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.624+0000 7f23b25569c0 20 remove_watcher() i=3 2024-09-12T00:12:54.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.624+0000 7f23b25569c0 20 remove_watcher() i=4 2024-09-12T00:12:54.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.628+0000 7f23b25569c0 20 remove_watcher() i=5 2024-09-12T00:12:54.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.628+0000 7f23b25569c0 20 remove_watcher() i=6 2024-09-12T00:12:54.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.632+0000 7f23b25569c0 20 remove_watcher() i=7 2024-09-12T00:12:54.649 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:54.649 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:54.693 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:54.693 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:54.844 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:12:54.844 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:12:54.880 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:54.880 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:54.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.924+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.928+0000 7fe55d6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.928+0000 7fe55d6f69c0 20 realm 2024-09-12T00:12:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.928+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.928+0000 7fe55d6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.928+0000 7fe55d6f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.928+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.928+0000 7fe55d6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.928+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.928+0000 7fe55d6f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:54.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.928+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:54.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.932+0000 7fe55d6f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:54.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.932+0000 7fe55d6f69c0 20 searching for the correct realm 2024-09-12T00:12:54.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:54.932+0000 7fe55a9fb640 0 -- 172.21.15.102:0/3655262868 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x555985b2fe00 msgr2=0x7fe554061320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:55.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.144+0000 7fe55b9fd640 0 -- 172.21.15.102:0/3655262868 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x555985d73b50 msgr2=0x555985d75f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:55.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:55.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:55.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:55.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:55.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:55.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:55.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:55.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:55.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:55.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:55.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:55.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:55.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 zone default found 2024-09-12T00:12:55.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 4 Realm: () 2024-09-12T00:12:55.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:55.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:55.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:55.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 zonegroup default 2024-09-12T00:12:55.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:55.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:55.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.164+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:55.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.168+0000 7fe55d6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:55.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.168+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:55.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.168+0000 7fe55d6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:55.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.168+0000 7fe55d6f69c0 20 started sync module instance, tier type = 2024-09-12T00:12:55.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.168+0000 7fe55d6f69c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:55.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.192+0000 7fe55d6f69c0 20 add_watcher() i=0 2024-09-12T00:12:55.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.192+0000 7fe55d6f69c0 20 add_watcher() i=1 2024-09-12T00:12:55.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.192+0000 7fe55d6f69c0 20 add_watcher() i=2 2024-09-12T00:12:55.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.192+0000 7fe55d6f69c0 20 add_watcher() i=3 2024-09-12T00:12:55.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.192+0000 7fe55d6f69c0 20 add_watcher() i=4 2024-09-12T00:12:55.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.192+0000 7fe55d6f69c0 20 add_watcher() i=5 2024-09-12T00:12:55.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.192+0000 7fe55d6f69c0 20 add_watcher() i=6 2024-09-12T00:12:55.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.196+0000 7fe55d6f69c0 20 add_watcher() i=7 2024-09-12T00:12:55.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.196+0000 7fe55d6f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:55.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe411fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:55.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe55d6f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:55.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe55d6f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:55.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe55d6f69c0 5 note: GC not initialized 2024-09-12T00:12:55.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe410fe1640 20 reqs_thread_entry: start 2024-09-12T00:12:55.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe55d6f69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:55.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe55d6f69c0 20 Filter name: none 2024-09-12T00:12:55.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe38a7fc640 20 reqs_thread_entry: start 2024-09-12T00:12:55.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:55.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe55d6f69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:55.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.200+0000 7fe55d6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:55.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:55.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:12:55.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:12:55.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 INFO: main: starting shard=0 2024-09-12T00:12:55.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:12:55.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:55.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 INFO: main: starting shard=1 2024-09-12T00:12:55.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:55.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:55.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 INFO: main: starting shard=2 2024-09-12T00:12:55.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:12:55.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:55.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 INFO: main: starting shard=3 2024-09-12T00:12:55.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.204+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:12:55.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:55.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: starting shard=4 2024-09-12T00:12:55.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:12:55.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:55.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: starting shard=5 2024-09-12T00:12:55.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:55.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:55.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: starting shard=6 2024-09-12T00:12:55.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:12:55.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:55.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: starting shard=7 2024-09-12T00:12:55.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:12:55.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:55.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: starting shard=8 2024-09-12T00:12:55.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:55.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:55.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: starting shard=9 2024-09-12T00:12:55.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:12:55.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:55.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 INFO: main: starting shard=10 2024-09-12T00:12:55.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.208+0000 7fe55d6f69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:55.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.212+0000 7fe55d6f69c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:12:55.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.212+0000 7fe55d6f69c0 20 INFO: main: done 2024-09-12T00:12:55.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.212+0000 7fe411fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:55.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.216+0000 7fe55d6f69c0 20 remove_watcher() i=0 2024-09-12T00:12:55.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.216+0000 7fe55d6f69c0 2 removed watcher, disabling cache 2024-09-12T00:12:55.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.220+0000 7fe55d6f69c0 20 remove_watcher() i=1 2024-09-12T00:12:55.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.224+0000 7fe55d6f69c0 20 remove_watcher() i=2 2024-09-12T00:12:55.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.224+0000 7fe55d6f69c0 20 remove_watcher() i=3 2024-09-12T00:12:55.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.228+0000 7fe55d6f69c0 20 remove_watcher() i=4 2024-09-12T00:12:55.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.228+0000 7fe55d6f69c0 20 remove_watcher() i=5 2024-09-12T00:12:55.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.232+0000 7fe55d6f69c0 20 remove_watcher() i=6 2024-09-12T00:12:55.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:55.232+0000 7fe55d6f69c0 20 remove_watcher() i=7 2024-09-12T00:12:55.257 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:55.258 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:55.292 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:12:55.734 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:12:56.146 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:12:56.147 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:56.147 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:12:56.178 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:56.178 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:56.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.220+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.220+0000 7f3422f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:56.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.220+0000 7f3422f729c0 20 realm 2024-09-12T00:12:56.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.220+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.220+0000 7f3422f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:56.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.220+0000 7f3422f729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:56.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.220+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.220+0000 7f3422f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:56.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.220+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.224+0000 7f3422f729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:56.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.224+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.224+0000 7f3422f729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:56.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.224+0000 7f3422f729c0 20 searching for the correct realm 2024-09-12T00:12:56.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.224+0000 7f3420a78640 0 -- 172.21.15.102:0/2863707042 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x5604a3ca4dc0 msgr2=0x5604a3ca7280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:12:56.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.436+0000 7f3420a78640 0 -- 172.21.15.102:0/2863707042 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x5604a3a5d9f0 msgr2=0x7f3418099000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:12:56.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.660+0000 7f3422f729c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:56.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.660+0000 7f3422f729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:56.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.660+0000 7f3422f729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:56.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.660+0000 7f3422f729c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:56.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.660+0000 7f3422f729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:56.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.660+0000 7f3422f729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:56.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.660+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.660+0000 7f3422f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:56.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.660+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:56.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:56.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 20 zone default found 2024-09-12T00:12:56.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 4 Realm: () 2024-09-12T00:12:56.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:56.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:56.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:56.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 20 zonegroup default 2024-09-12T00:12:56.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:56.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:56.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.664+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.668+0000 7f3422f729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:56.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.668+0000 7f3422f729c0 20 started sync module instance, tier type = 2024-09-12T00:12:56.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.668+0000 7f3422f729c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:56.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.696+0000 7f3422f729c0 20 add_watcher() i=0 2024-09-12T00:12:56.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.696+0000 7f3422f729c0 20 add_watcher() i=1 2024-09-12T00:12:56.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.696+0000 7f3422f729c0 20 add_watcher() i=2 2024-09-12T00:12:56.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.696+0000 7f3422f729c0 20 add_watcher() i=3 2024-09-12T00:12:56.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.696+0000 7f3422f729c0 20 add_watcher() i=4 2024-09-12T00:12:56.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.696+0000 7f3422f729c0 20 add_watcher() i=5 2024-09-12T00:12:56.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.696+0000 7f3422f729c0 20 add_watcher() i=6 2024-09-12T00:12:56.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.696+0000 7f3422f729c0 20 add_watcher() i=7 2024-09-12T00:12:56.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.696+0000 7f3422f729c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:56.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f32d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:56.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:56.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:56.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 5 note: GC not initialized 2024-09-12T00:12:56.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f32d5fe3640 20 reqs_thread_entry: start 2024-09-12T00:12:56.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:56.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 20 Filter name: none 2024-09-12T00:12:56.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f32477fe640 20 reqs_thread_entry: start 2024-09-12T00:12:56.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:12:56.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 : miss 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 info.flags=0x17 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 to cache LRU end 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.704+0000 7f3422f729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 2024-09-12T00:12:56.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.708+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:12:56.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.708+0000 7f3422f729c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:12:56.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.708+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:56.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.708+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:12:56.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.708+0000 7f3422f729c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:12:56.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.708+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:12:56.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.712+0000 7f3422f729c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:12:56.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.712+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:12:56.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.712+0000 7f3422f729c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:12:56.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.712+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:56.712 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.712+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:12:56.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.712+0000 7f3422f729c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:12:56.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.712+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:12:56.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.712+0000 7f3422f729c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:12:56.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.712+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:56.715 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.716+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:12:56.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.716+0000 7f3422f729c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:12:56.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.716+0000 7f3422f729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:56.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.716+0000 7f3422f729c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T00:12:56.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.716+0000 7f3422f729c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:12:56.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.716+0000 7f3422f729c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:12:56.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.716+0000 7f3422f729c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T00:12:56.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.716+0000 7f3422f729c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:12:56.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.720+0000 7f32d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:56.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.724+0000 7f3422f729c0 20 remove_watcher() i=0 2024-09-12T00:12:56.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.724+0000 7f3422f729c0 2 removed watcher, disabling cache 2024-09-12T00:12:56.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.724+0000 7f3422f729c0 20 remove_watcher() i=1 2024-09-12T00:12:56.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.728+0000 7f3422f729c0 20 remove_watcher() i=2 2024-09-12T00:12:56.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.732+0000 7f3422f729c0 20 remove_watcher() i=3 2024-09-12T00:12:56.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.732+0000 7f3422f729c0 20 remove_watcher() i=4 2024-09-12T00:12:56.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.736+0000 7f3422f729c0 20 remove_watcher() i=5 2024-09-12T00:12:56.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.736+0000 7f3422f729c0 20 remove_watcher() i=6 2024-09-12T00:12:56.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:56.736+0000 7f3422f729c0 20 remove_watcher() i=7 2024-09-12T00:12:56.753 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: unlinked entries are not listable 2024-09-12T00:12:56.754 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:56.756 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:56.756 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:56.939 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:12:56.939 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:56.946 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:56.947 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:57.048 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:57.049 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:57.148 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:12:57.148 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:57.148 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:12:57.188 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:57.188 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:57.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.436+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.440+0000 7fec33b149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:57.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.440+0000 7fec33b149c0 20 realm 2024-09-12T00:12:57.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.440+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.440+0000 7fec33b149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:57.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.440+0000 7fec33b149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:57.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.440+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.440+0000 7fec33b149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:57.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.440+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.440+0000 7fec33b149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:57.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.440+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.444+0000 7fec33b149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:57.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.444+0000 7fec33b149c0 20 searching for the correct realm 2024-09-12T00:12:57.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.444+0000 7fec2bfff640 0 -- 172.21.15.102:0/3019817384 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7fec2c065770 msgr2=0x7fec2c05b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:57.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.656+0000 7fec31e1b640 0 -- 172.21.15.102:0/3019817384 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55b2e5a68790 msgr2=0x55b2e5a6aba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:57.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:57.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:57.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:57.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:57.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:57.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:57.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:57.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:57.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:57.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 zone default found 2024-09-12T00:12:57.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 4 Realm: () 2024-09-12T00:12:57.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:57.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:57.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:57.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 zonegroup default 2024-09-12T00:12:57.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.676+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.680+0000 7fec33b149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:57.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.680+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.680+0000 7fec33b149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:57.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.680+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.680+0000 7fec33b149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:57.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.680+0000 7fec33b149c0 20 started sync module instance, tier type = 2024-09-12T00:12:57.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.680+0000 7fec33b149c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:57.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.712+0000 7fec33b149c0 20 add_watcher() i=0 2024-09-12T00:12:57.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.712+0000 7fec33b149c0 20 add_watcher() i=1 2024-09-12T00:12:57.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.712+0000 7fec33b149c0 20 add_watcher() i=2 2024-09-12T00:12:57.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.712+0000 7fec33b149c0 20 add_watcher() i=3 2024-09-12T00:12:57.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.712+0000 7fec33b149c0 20 add_watcher() i=4 2024-09-12T00:12:57.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.712+0000 7fec33b149c0 20 add_watcher() i=5 2024-09-12T00:12:57.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.712+0000 7fec33b149c0 20 add_watcher() i=6 2024-09-12T00:12:57.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.716+0000 7fec33b149c0 20 add_watcher() i=7 2024-09-12T00:12:57.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.716+0000 7fec33b149c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:57.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.720+0000 7feae7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:57.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.720+0000 7fec33b149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:57.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.720+0000 7fec33b149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:57.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.720+0000 7fec33b149c0 5 note: GC not initialized 2024-09-12T00:12:57.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.720+0000 7feae6fe5640 20 reqs_thread_entry: start 2024-09-12T00:12:57.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.720+0000 7fec33b149c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:57.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.720+0000 7fec33b149c0 20 Filter name: none 2024-09-12T00:12:57.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.720+0000 7feae4fe1640 20 reqs_thread_entry: start 2024-09-12T00:12:57.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.720+0000 7fec33b149c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:12:57.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.720+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:57.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:12:57.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:12:57.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 : miss 2024-09-12T00:12:57.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:57.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:57.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 info.flags=0x17 2024-09-12T00:12:57.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 to cache LRU end 2024-09-12T00:12:57.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:12:57.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:12:57.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 2024-09-12T00:12:57.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:12:57.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:12:57.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:57.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.724+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:12:57.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.728+0000 7fec33b149c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:12:57.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.728+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:12:57.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.728+0000 7fec33b149c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:12:57.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.728+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:12:57.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.728+0000 7fec33b149c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:12:57.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.728+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:57.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.728+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:12:57.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.728+0000 7fec33b149c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:12:57.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.728+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:12:57.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.732+0000 7fec33b149c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:12:57.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.732+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:57.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.732+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:12:57.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.732+0000 7fec33b149c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:12:57.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.732+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:57.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.732+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:57.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.732+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e57ebee0 obj=check-bucket:e state=0x55b2e5a9e9f8 s->prefetch_data=0 2024-09-12T00:12:57.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:57.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e57fdb50 obj=check-bucket:d state=0x55b2e5a98b08 s->prefetch_data=0 2024-09-12T00:12:57.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:57.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e5aa1920 obj=check-bucket:c state=0x55b2e5a9c1d8 s->prefetch_data=0 2024-09-12T00:12:57.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:57.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e5a9da40 obj=check-bucket:f state=0x55b2e5a998b8 s->prefetch_data=0 2024-09-12T00:12:57.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state: setting s->obj_tag to ei9fr5qltpi9qxvj0ue3gjtaxm6ddsv3 2024-09-12T00:12:57.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state_impl: setting s->olh_tag to 0zbchtuh2vna4p52bb4t4ra0sx9n8wbr 2024-09-12T00:12:57.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0zbchtuh2vna4p52bb4t4ra0sx9n8wbr 2024-09-12T00:12:57.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state: setting s->obj_tag to lkib0rzz91g3iu1k9fm65nm3px5cnvjh 2024-09-12T00:12:57.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state_impl: setting s->olh_tag to ucq1lv0edgvd3vxzvuh14s7308g1tui3 2024-09-12T00:12:57.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ucq1lv0edgvd3vxzvuh14s7308g1tui3 2024-09-12T00:12:57.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state: setting s->obj_tag to o30ydmz2lue4dp90l7aqmxc4ygn1fhnh 2024-09-12T00:12:57.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state_impl: setting s->olh_tag to 9vkhfrudfvgtfuifj9kz4w5sylg2ucvd 2024-09-12T00:12:57.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9vkhfrudfvgtfuifj9kz4w5sylg2ucvd 2024-09-12T00:12:57.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state: setting s->obj_tag to 0a4o9n7ylaaunjysipzbb2oiur4sykk9 2024-09-12T00:12:57.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 get_obj_state_impl: setting s->olh_tag to pumr3g2wjh1p7wcw3c2htjry6cbhvifk 2024-09-12T00:12:57.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.736+0000 7fec33b149c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pumr3g2wjh1p7wcw3c2htjry6cbhvifk 2024-09-12T00:12:57.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.740+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:57.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.740+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:57.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.740+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:57.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:57.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:57.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:12:57.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 olh_log_entry: epoch=2 op=3 key=e[nJN1h7dpn9kGHyTM8R8K3-h1nkqsfC7] 2024-09-12T00:12:57.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e57ebee0 obj=check-bucket:_:nJN1h7dpn9kGHyTM8R8K3-h1nkqsfC7_e state=0x55b2e5b39e58 s->prefetch_data=0 2024-09-12T00:12:57.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:57.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 olh_log_entry: epoch=3 op=3 key=c[GFVVjsIBFAgUfzWcaz-FdIMVBIWRf41] 2024-09-12T00:12:57.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e5aa1920 obj=check-bucket:_:GFVVjsIBFAgUfzWcaz-FdIMVBIWRf41_c state=0x55b2e5b49bc8 s->prefetch_data=0 2024-09-12T00:12:57.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 10 manifest: total_size = 11 2024-09-12T00:12:57.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5415222162159434293 2024-09-12T00:12:57.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e5aa1920 obj=check-bucket:_:GFVVjsIBFAgUfzWcaz-FdIMVBIWRf41_c state=0x55b2e5b49bc8 s->prefetch_data=0 2024-09-12T00:12:57.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 prepare_atomic_modification: state is not atomic. state=0x55b2e5b49bc8 2024-09-12T00:12:57.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.744+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:57.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 10 manifest: total_size = 22 2024-09-12T00:12:57.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6904297460225520637 2024-09-12T00:12:57.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e57ebee0 obj=check-bucket:_:nJN1h7dpn9kGHyTM8R8K3-h1nkqsfC7_e state=0x55b2e5b39e58 s->prefetch_data=0 2024-09-12T00:12:57.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 prepare_atomic_modification: state is not atomic. state=0x55b2e5b39e58 2024-09-12T00:12:57.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:57.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:57.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:57.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 olh_log_entry: epoch=3 op=3 key=d[WXlrToOGzPol71OU4SZ4u0.dailiURx] 2024-09-12T00:12:57.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e57fdb50 obj=check-bucket:_:WXlrToOGzPol71OU4SZ4u0.dailiURx_d state=0x55b2e5b426e8 s->prefetch_data=0 2024-09-12T00:12:57.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:12:57.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 olh_log_entry: epoch=2 op=3 key=f[xXFL6Q9F0pWskil1mSdltRsJ4xHlG8D] 2024-09-12T00:12:57.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e5a9da40 obj=check-bucket:_:xXFL6Q9F0pWskil1mSdltRsJ4xHlG8D_f state=0x55b2e5b5bca8 s->prefetch_data=0 2024-09-12T00:12:57.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 10 manifest: total_size = 12 2024-09-12T00:12:57.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17432849192376266382 2024-09-12T00:12:57.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e57fdb50 obj=check-bucket:_:WXlrToOGzPol71OU4SZ4u0.dailiURx_d state=0x55b2e5b426e8 s->prefetch_data=0 2024-09-12T00:12:57.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 prepare_atomic_modification: state is not atomic. state=0x55b2e5b426e8 2024-09-12T00:12:57.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:57.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 10 manifest: total_size = 11 2024-09-12T00:12:57.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7123496986890035186 2024-09-12T00:12:57.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e5a9da40 obj=check-bucket:_:xXFL6Q9F0pWskil1mSdltRsJ4xHlG8D_f state=0x55b2e5b5bca8 s->prefetch_data=0 2024-09-12T00:12:57.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 prepare_atomic_modification: state is not atomic. state=0x55b2e5b5bca8 2024-09-12T00:12:57.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.748+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:57.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.752+0000 7fec33b149c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:12:57.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.752+0000 7fec33b149c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:12:57.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.752+0000 7fec33b149c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:12:57.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.752+0000 7fec33b149c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2__shadow:GFVVjsIBFAgUfzWcaz-FdIMVBIWRf41_.NOQiT-hxqAkGzAWRmiPW8TPJ7igwbff_0 2024-09-12T00:12:57.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.756+0000 7fec33b149c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:12:57.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.756+0000 7fec33b149c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:12:57.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.756+0000 7fec33b149c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:12:57.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.756+0000 7fec33b149c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2__shadow:nJN1h7dpn9kGHyTM8R8K3-h1nkqsfC7_.aUDHCE1psRh4lJBT7kBApy-7tA5fTvi_0 2024-09-12T00:12:57.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7feb14ff9640 20 handle_completion(): completion ok for obj=c[GFVVjsIBFAgUfzWcaz-FdIMVBIWRf41] 2024-09-12T00:12:57.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7fec33b149c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:12:57.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7fec33b149c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:12:57.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7fec33b149c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:12:57.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7fec33b149c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2__shadow:WXlrToOGzPol71OU4SZ4u0.dailiURx_.-hwvorBHSRli-WfvZxw1N_F6awdKEM5_0 2024-09-12T00:12:57.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7fec33b149c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:12:57.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7fec33b149c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:12:57.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7fec33b149c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:12:57.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7fec33b149c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:12:57.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7fec33b149c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2__shadow:xXFL6Q9F0pWskil1mSdltRsJ4xHlG8D_.XZVYLLGPGpJBFuGuTPS0XJ4c2q8nHpv_0 2024-09-12T00:12:57.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.760+0000 7feb03fff640 20 handle_completion(): completion ok for obj=e[nJN1h7dpn9kGHyTM8R8K3-h1nkqsfC7] 2024-09-12T00:12:57.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.764+0000 7feb14ff9640 20 handle_completion(): completion ok for obj=f[xXFL6Q9F0pWskil1mSdltRsJ4xHlG8D] 2024-09-12T00:12:57.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.764+0000 7fec33b149c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:12:57.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.764+0000 7fec33b149c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:12:57.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.764+0000 7fec33b149c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:12:57.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.764+0000 7feb14ff9640 20 handle_completion(): completion ok for obj=d[WXlrToOGzPol71OU4SZ4u0.dailiURx] 2024-09-12T00:12:57.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.768+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:57.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.768+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:57.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.768+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e57ebee0 obj=check-bucket:e state=0x55b2e5a9e9f8 s->prefetch_data=0 2024-09-12T00:12:57.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.768+0000 7fec33b149c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0zbchtuh2vna4p52bb4t4ra0sx9n8wbr 2024-09-12T00:12:57.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.768+0000 7fec33b149c0 20 get_obj_state: octx=0x55b2e5a9da40 obj=check-bucket:f state=0x55b2e5a998b8 s->prefetch_data=0 2024-09-12T00:12:57.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.768+0000 7fec33b149c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pumr3g2wjh1p7wcw3c2htjry6cbhvifk 2024-09-12T00:12:57.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.772+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:57.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.772+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:57.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.772+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:57.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.772+0000 7fec33b149c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:12:57.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.776+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:57.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.776+0000 7fec33b149c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:12:57.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.780+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:57.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.784+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:57.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.784+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:57.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.784+0000 7fec33b149c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:12:57.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.784+0000 7fec33b149c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:57.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.784+0000 7fec33b149c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:12:57.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.784+0000 7fec33b149c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:12:57.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.788+0000 7feae7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:57.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.792+0000 7fec33b149c0 20 remove_watcher() i=0 2024-09-12T00:12:57.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.792+0000 7fec33b149c0 2 removed watcher, disabling cache 2024-09-12T00:12:57.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.796+0000 7fec33b149c0 20 remove_watcher() i=1 2024-09-12T00:12:57.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.796+0000 7fec33b149c0 20 remove_watcher() i=2 2024-09-12T00:12:57.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.800+0000 7fec33b149c0 20 remove_watcher() i=3 2024-09-12T00:12:57.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.800+0000 7fec33b149c0 20 remove_watcher() i=4 2024-09-12T00:12:57.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.804+0000 7fec33b149c0 20 remove_watcher() i=5 2024-09-12T00:12:57.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.804+0000 7fec33b149c0 20 remove_watcher() i=6 2024-09-12T00:12:57.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:57.808+0000 7fec33b149c0 20 remove_watcher() i=7 2024-09-12T00:12:57.827 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:57.827 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:57.852 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:57.852 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:57.881 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:57.881 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:57.938 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:57.939 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:57.994 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:12:57.995 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:57.997 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:57.997 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:58.130 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:58.131 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:58.196 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:58.264 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:58.264 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:58.337 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:58.337 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:58.401 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:12:58.401 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:12:58.401 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:12:58.438 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:58.439 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:58.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.484+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.484+0000 7fc4652489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:58.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.484+0000 7fc4652489c0 20 realm 2024-09-12T00:12:58.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.484+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.484+0000 7fc4652489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:58.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.484+0000 7fc4652489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:58.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.484+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.484+0000 7fc4652489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:58.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.484+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.488+0000 7fc4652489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:58.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.488+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.488+0000 7fc4652489c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:58.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.488+0000 7fc4652489c0 20 searching for the correct realm 2024-09-12T00:12:58.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.492+0000 7fc46354f640 0 -- 172.21.15.102:0/777880179 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fc458008050 msgr2=0x7fc45807f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:58.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.500+0000 7fc46254d640 0 -- 172.21.15.102:0/777880179 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fc45c0d5070 msgr2=0x7fc45c0ea420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:58.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:58.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:58.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:58.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:58.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:58.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:58.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:58.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:58.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.716+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:58.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 zone default found 2024-09-12T00:12:58.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 4 Realm: () 2024-09-12T00:12:58.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:58.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:58.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:58.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 zonegroup default 2024-09-12T00:12:58.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:58.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:58.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:58.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 started sync module instance, tier type = 2024-09-12T00:12:58.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.720+0000 7fc4652489c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:58.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.744+0000 7fc4652489c0 20 add_watcher() i=0 2024-09-12T00:12:58.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.744+0000 7fc4652489c0 20 add_watcher() i=1 2024-09-12T00:12:58.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.744+0000 7fc4652489c0 20 add_watcher() i=2 2024-09-12T00:12:58.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.744+0000 7fc4652489c0 20 add_watcher() i=3 2024-09-12T00:12:58.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.744+0000 7fc4652489c0 20 add_watcher() i=4 2024-09-12T00:12:58.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.744+0000 7fc4652489c0 20 add_watcher() i=5 2024-09-12T00:12:58.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.744+0000 7fc4652489c0 20 add_watcher() i=6 2024-09-12T00:12:58.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.748+0000 7fc4652489c0 20 add_watcher() i=7 2024-09-12T00:12:58.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.748+0000 7fc4652489c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:58.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.748+0000 7fc3197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:58.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:58.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:58.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 5 note: GC not initialized 2024-09-12T00:12:58.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc293fff640 20 reqs_thread_entry: start 2024-09-12T00:12:58.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:58.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 20 Filter name: none 2024-09-12T00:12:58.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc291ffb640 20 reqs_thread_entry: start 2024-09-12T00:12:58.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:12:58.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:58.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:12:58.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:12:58.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 : miss 2024-09-12T00:12:58.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:58.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:58.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 info.flags=0x17 2024-09-12T00:12:58.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 to cache LRU end 2024-09-12T00:12:58.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:12:58.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:12:58.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.752+0000 7fc4652489c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 2024-09-12T00:12:58.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.756+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:12:58.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.756+0000 7fc4652489c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:12:58.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.756+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:58.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.756+0000 7fc4652489c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:12:58.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.756+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:12:58.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:12:58.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:12:58.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:12:58.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:12:58.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:12:58.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:58.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:12:58.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:12:58.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:12:58.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:12:58.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:12:58.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.760+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:58.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.764+0000 7fc4652489c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:12:58.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.764+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:12:58.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.764+0000 7fc4652489c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:12:58.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.764+0000 7fc4652489c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:58.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.764+0000 7fc4652489c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:12:58.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.764+0000 7fc4652489c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:12:58.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.764+0000 7fc3197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:58.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.772+0000 7fc4652489c0 20 remove_watcher() i=0 2024-09-12T00:12:58.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.772+0000 7fc4652489c0 2 removed watcher, disabling cache 2024-09-12T00:12:58.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.772+0000 7fc4652489c0 20 remove_watcher() i=1 2024-09-12T00:12:58.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.776+0000 7fc4652489c0 20 remove_watcher() i=2 2024-09-12T00:12:58.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.780+0000 7fc4652489c0 20 remove_watcher() i=3 2024-09-12T00:12:58.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.780+0000 7fc4652489c0 20 remove_watcher() i=4 2024-09-12T00:12:58.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.784+0000 7fc4652489c0 20 remove_watcher() i=5 2024-09-12T00:12:58.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.784+0000 7fc4652489c0 20 remove_watcher() i=6 2024-09-12T00:12:58.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:58.788+0000 7fc4652489c0 20 remove_watcher() i=7 2024-09-12T00:12:58.805 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:58.805 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:59.110 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:12:59.110 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:12:59.267 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:12:59.303 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:59.303 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:59.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.348+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.348+0000 7fa398da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:59.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.348+0000 7fa398da89c0 20 realm 2024-09-12T00:12:59.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.348+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.348+0000 7fa398da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:59.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.348+0000 7fa398da89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:59.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.348+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.348+0000 7fa398da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:59.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.348+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.352+0000 7fa398da89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:59.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.352+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.352+0000 7fa398da89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:59.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.352+0000 7fa398da89c0 20 searching for the correct realm 2024-09-12T00:12:59.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.356+0000 7fa3970af640 0 -- 172.21.15.102:0/972475308 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fa38c011c50 msgr2=0x7fa38c07c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:59.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.364+0000 7fa3960ad640 0 -- 172.21.15.102:0/972475308 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fa390068040 msgr2=0x7fa39005b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:12:59.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.580+0000 7fa398da89c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:12:59.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.580+0000 7fa398da89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:59.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.580+0000 7fa398da89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:59.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.580+0000 7fa398da89c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:12:59.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.580+0000 7fa398da89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:59.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.580+0000 7fa398da89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:59.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.580+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.580+0000 7fa398da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:59.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.580+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:59.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:12:59.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 zone default found 2024-09-12T00:12:59.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 4 Realm: () 2024-09-12T00:12:59.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:12:59.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:12:59.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:59.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 zonegroup default 2024-09-12T00:12:59.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:59.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:59.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:59.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 started sync module instance, tier type = 2024-09-12T00:12:59.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.584+0000 7fa398da89c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:12:59.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.608+0000 7fa398da89c0 20 add_watcher() i=0 2024-09-12T00:12:59.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.608+0000 7fa398da89c0 20 add_watcher() i=1 2024-09-12T00:12:59.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.608+0000 7fa398da89c0 20 add_watcher() i=2 2024-09-12T00:12:59.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.608+0000 7fa398da89c0 20 add_watcher() i=3 2024-09-12T00:12:59.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.608+0000 7fa398da89c0 20 add_watcher() i=4 2024-09-12T00:12:59.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.608+0000 7fa398da89c0 20 add_watcher() i=5 2024-09-12T00:12:59.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.608+0000 7fa398da89c0 20 add_watcher() i=6 2024-09-12T00:12:59.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.612+0000 7fa398da89c0 20 add_watcher() i=7 2024-09-12T00:12:59.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.612+0000 7fa398da89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:59.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.616+0000 7fa24d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:59.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.616+0000 7fa398da89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:59.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.616+0000 7fa398da89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:59.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.616+0000 7fa398da89c0 5 note: GC not initialized 2024-09-12T00:12:59.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.616+0000 7fa1c7fff640 20 reqs_thread_entry: start 2024-09-12T00:12:59.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.616+0000 7fa398da89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:12:59.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.616+0000 7fa398da89c0 20 Filter name: none 2024-09-12T00:12:59.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.616+0000 7fa1c5ffb640 20 reqs_thread_entry: start 2024-09-12T00:12:59.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.616+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.620+0000 7fa398da89c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:12:59.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.620+0000 7fa398da89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.620+0000 7fa398da89c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:12:59.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.620+0000 7fa398da89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:12:59.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.620+0000 7fa398da89c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:12:59.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.620+0000 7fa398da89c0 20 INFO: main: starting shard=0 2024-09-12T00:12:59.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.620+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:12:59.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.620+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:59.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.620+0000 7fa398da89c0 20 INFO: main: starting shard=1 2024-09-12T00:12:59.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.620+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:12:59.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:59.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 INFO: main: starting shard=2 2024-09-12T00:12:59.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:12:59.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:59.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 INFO: main: starting shard=3 2024-09-12T00:12:59.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:12:59.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:59.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 INFO: main: starting shard=4 2024-09-12T00:12:59.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:12:59.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:59.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 INFO: main: starting shard=5 2024-09-12T00:12:59.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:12:59.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.624+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:12:59.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 INFO: main: starting shard=6 2024-09-12T00:12:59.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:12:59.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:59.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 INFO: main: starting shard=7 2024-09-12T00:12:59.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:12:59.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:59.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 INFO: main: starting shard=8 2024-09-12T00:12:59.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:12:59.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:59.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 INFO: main: starting shard=9 2024-09-12T00:12:59.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:12:59.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:59.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 INFO: main: starting shard=10 2024-09-12T00:12:59.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.628+0000 7fa398da89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:12:59.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.632+0000 7fa398da89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:12:59.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.632+0000 7fa398da89c0 20 INFO: main: done 2024-09-12T00:12:59.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.632+0000 7fa24d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:59.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.636+0000 7fa398da89c0 20 remove_watcher() i=0 2024-09-12T00:12:59.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.636+0000 7fa398da89c0 2 removed watcher, disabling cache 2024-09-12T00:12:59.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.640+0000 7fa398da89c0 20 remove_watcher() i=1 2024-09-12T00:12:59.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.640+0000 7fa398da89c0 20 remove_watcher() i=2 2024-09-12T00:12:59.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.644+0000 7fa398da89c0 20 remove_watcher() i=3 2024-09-12T00:12:59.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.648+0000 7fa398da89c0 20 remove_watcher() i=4 2024-09-12T00:12:59.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.648+0000 7fa398da89c0 20 remove_watcher() i=5 2024-09-12T00:12:59.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.652+0000 7fa398da89c0 20 remove_watcher() i=6 2024-09-12T00:12:59.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.652+0000 7fa398da89c0 20 remove_watcher() i=7 2024-09-12T00:12:59.671 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:12:59.700 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:59.700 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:59.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.744+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.744+0000 7f81a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:59.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.744+0000 7f81a13f89c0 20 realm 2024-09-12T00:12:59.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.744+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.744+0000 7f81a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:59.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.744+0000 7f81a13f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:59.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.744+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.744+0000 7f81a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:59.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.744+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.748+0000 7f81a13f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:59.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.748+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:12:59.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.748+0000 7f81a13f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:12:59.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.748+0000 7f81a13f89c0 20 searching for the correct realm 2024-09-12T00:12:59.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.752+0000 7f819f6ff640 0 -- 172.21.15.102:0/413591419 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f8194008030 msgr2=0x7f8194064b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:59.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:12:59.968+0000 7f819e6fd640 0 -- 172.21.15.102:0/413591419 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f81980f2a90 msgr2=0x7f81980d8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:00.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:00.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:00.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:00.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:00.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:00.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:00.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:00.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 zone default found 2024-09-12T00:13:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 4 Realm: () 2024-09-12T00:13:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 zonegroup default 2024-09-12T00:13:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.184+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.188+0000 7f81a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.188+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.188+0000 7f81a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.188+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.188+0000 7f81a13f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.188+0000 7f81a13f89c0 20 started sync module instance, tier type = 2024-09-12T00:13:00.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.188+0000 7f81a13f89c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:00.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.212+0000 7f81a13f89c0 20 add_watcher() i=0 2024-09-12T00:13:00.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.212+0000 7f81a13f89c0 20 add_watcher() i=1 2024-09-12T00:13:00.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.212+0000 7f81a13f89c0 20 add_watcher() i=2 2024-09-12T00:13:00.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.212+0000 7f81a13f89c0 20 add_watcher() i=3 2024-09-12T00:13:00.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.212+0000 7f81a13f89c0 20 add_watcher() i=4 2024-09-12T00:13:00.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.212+0000 7f81a13f89c0 20 add_watcher() i=5 2024-09-12T00:13:00.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.212+0000 7f81a13f89c0 20 add_watcher() i=6 2024-09-12T00:13:00.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.216+0000 7f81a13f89c0 20 add_watcher() i=7 2024-09-12T00:13:00.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.216+0000 7f81a13f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:00.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f80557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:00.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f81a13f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:00.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f81a13f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:00.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f81a13f89c0 5 note: GC not initialized 2024-09-12T00:13:00.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f7fcffff640 20 reqs_thread_entry: start 2024-09-12T00:13:00.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f81a13f89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:00.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f81a13f89c0 20 Filter name: none 2024-09-12T00:13:00.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f7fcdffb640 20 reqs_thread_entry: start 2024-09-12T00:13:00.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f81a13f89c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:00.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.220+0000 7f81a13f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:00.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:00.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:00.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 INFO: main: starting shard=0 2024-09-12T00:13:00.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:00.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:00.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 INFO: main: starting shard=1 2024-09-12T00:13:00.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:00.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:00.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 INFO: main: starting shard=2 2024-09-12T00:13:00.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:00.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:00.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 INFO: main: starting shard=3 2024-09-12T00:13:00.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:00.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:00.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 INFO: main: starting shard=4 2024-09-12T00:13:00.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.224+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:00.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:00.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: starting shard=5 2024-09-12T00:13:00.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:00.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:00.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: starting shard=6 2024-09-12T00:13:00.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:00.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:00.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: starting shard=7 2024-09-12T00:13:00.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:00.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:00.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: starting shard=8 2024-09-12T00:13:00.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:00.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:13:00.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: starting shard=9 2024-09-12T00:13:00.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:00.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:00.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: starting shard=10 2024-09-12T00:13:00.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:00.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:00.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f81a13f89c0 20 INFO: main: done 2024-09-12T00:13:00.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.228+0000 7f80557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:00.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.236+0000 7f81a13f89c0 20 remove_watcher() i=0 2024-09-12T00:13:00.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.236+0000 7f81a13f89c0 2 removed watcher, disabling cache 2024-09-12T00:13:00.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.236+0000 7f81a13f89c0 20 remove_watcher() i=1 2024-09-12T00:13:00.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.240+0000 7f81a13f89c0 20 remove_watcher() i=2 2024-09-12T00:13:00.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.240+0000 7f81a13f89c0 20 remove_watcher() i=3 2024-09-12T00:13:00.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.244+0000 7f81a13f89c0 20 remove_watcher() i=4 2024-09-12T00:13:00.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.244+0000 7f81a13f89c0 20 remove_watcher() i=5 2024-09-12T00:13:00.246 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.244+0000 7f81a13f89c0 20 remove_watcher() i=6 2024-09-12T00:13:00.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.248+0000 7f81a13f89c0 20 remove_watcher() i=7 2024-09-12T00:13:00.261 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:13:00.261 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:00.261 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:13:00.288 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:00.288 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:00.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.328+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.332+0000 7f7ca13839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.332+0000 7f7ca13839c0 20 realm 2024-09-12T00:13:00.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.332+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.332+0000 7f7ca13839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.332+0000 7f7ca13839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:00.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.332+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.332+0000 7f7ca13839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.332+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.332+0000 7f7ca13839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:00.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.332+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.336+0000 7f7ca13839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:00.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.336+0000 7f7ca13839c0 20 searching for the correct realm 2024-09-12T00:13:00.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.340+0000 7f7c9ee89640 0 -- 172.21.15.102:0/2353716622 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x55dbd1a22a00 msgr2=0x55dbd1a24ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:00.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.344+0000 7f7c9e688640 0 -- 172.21.15.102:0/2353716622 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f7c980b63d0 msgr2=0x7f7c980b6830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:00.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:00.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:00.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:00.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:00.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:00.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:00.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:00.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.352+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:00.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 zone default found 2024-09-12T00:13:00.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 4 Realm: () 2024-09-12T00:13:00.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:00.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:00.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:00.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 zonegroup default 2024-09-12T00:13:00.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 started sync module instance, tier type = 2024-09-12T00:13:00.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.356+0000 7f7ca13839c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:00.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.372+0000 7f7ca13839c0 20 add_watcher() i=0 2024-09-12T00:13:00.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.372+0000 7f7ca13839c0 20 add_watcher() i=1 2024-09-12T00:13:00.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.372+0000 7f7ca13839c0 20 add_watcher() i=2 2024-09-12T00:13:00.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.372+0000 7f7ca13839c0 20 add_watcher() i=3 2024-09-12T00:13:00.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.372+0000 7f7ca13839c0 20 add_watcher() i=4 2024-09-12T00:13:00.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.372+0000 7f7ca13839c0 20 add_watcher() i=5 2024-09-12T00:13:00.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.372+0000 7f7ca13839c0 20 add_watcher() i=6 2024-09-12T00:13:00.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.372+0000 7f7ca13839c0 20 add_watcher() i=7 2024-09-12T00:13:00.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.372+0000 7f7ca13839c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:00.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7b557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:00.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:00.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:00.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 5 note: GC not initialized 2024-09-12T00:13:00.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7acffff640 20 reqs_thread_entry: start 2024-09-12T00:13:00.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:00.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 20 Filter name: none 2024-09-12T00:13:00.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7acdffb640 20 reqs_thread_entry: start 2024-09-12T00:13:00.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:00.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:00.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:00.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:00.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 : miss 2024-09-12T00:13:00.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:00.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 info.flags=0x17 2024-09-12T00:13:00.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 to cache LRU end 2024-09-12T00:13:00.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:00.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:00.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 2024-09-12T00:13:00.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.376+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:00.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:13:00.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:00.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:13:00.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:00.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:13:00.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:00.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:13:00.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:00.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:13:00.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:00.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:13:00.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:00.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:13:00.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:00.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:13:00.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.380+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:00.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.384+0000 7f7ca13839c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:13:00.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.384+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:00.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.384+0000 7f7ca13839c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:13:00.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.384+0000 7f7ca13839c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:00.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.384+0000 7f7ca13839c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:13:00.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.384+0000 7f7ca13839c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:13:00.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.384+0000 7f7b557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:00.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.388+0000 7f7ca13839c0 20 remove_watcher() i=0 2024-09-12T00:13:00.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.388+0000 7f7ca13839c0 2 removed watcher, disabling cache 2024-09-12T00:13:00.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.392+0000 7f7ca13839c0 20 remove_watcher() i=1 2024-09-12T00:13:00.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.392+0000 7f7ca13839c0 20 remove_watcher() i=2 2024-09-12T00:13:00.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.396+0000 7f7ca13839c0 20 remove_watcher() i=3 2024-09-12T00:13:00.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.396+0000 7f7ca13839c0 20 remove_watcher() i=4 2024-09-12T00:13:00.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.396+0000 7f7ca13839c0 20 remove_watcher() i=5 2024-09-12T00:13:00.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.400+0000 7f7ca13839c0 20 remove_watcher() i=6 2024-09-12T00:13:00.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.400+0000 7f7ca13839c0 20 remove_watcher() i=7 2024-09-12T00:13:00.413 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:13:00.413 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:00.413 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:13:00.442 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:00.443 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:00.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.484+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.488+0000 7f123c5ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.488+0000 7f123c5ed9c0 20 realm 2024-09-12T00:13:00.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.488+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.488+0000 7f123c5ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.488+0000 7f123c5ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:00.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.488+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.488+0000 7f123c5ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.488+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.488+0000 7f123c5ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:00.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.488+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.492+0000 7f123c5ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:00.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.492+0000 7f123c5ed9c0 20 searching for the correct realm 2024-09-12T00:13:00.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.492+0000 7f123a8f4640 0 -- 172.21.15.102:0/1395497011 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f1224026020 msgr2=0x7f12240733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:00.712 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.712+0000 7f12398f2640 0 -- 172.21.15.102:0/1395497011 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f12340048e0 msgr2=0x7f12340193b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:00.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.928+0000 7f123c5ed9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:00.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.928+0000 7f123c5ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.928+0000 7f123c5ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.928+0000 7f123c5ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.928+0000 7f123c5ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.928+0000 7f123c5ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.928+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.928+0000 7f123c5ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.928+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:00.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:00.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 zone default found 2024-09-12T00:13:00.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 4 Realm: () 2024-09-12T00:13:00.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:00.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:00.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:00.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 zonegroup default 2024-09-12T00:13:00.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 started sync module instance, tier type = 2024-09-12T00:13:00.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.932+0000 7f123c5ed9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:00.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.956+0000 7f123c5ed9c0 20 add_watcher() i=0 2024-09-12T00:13:00.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.956+0000 7f123c5ed9c0 20 add_watcher() i=1 2024-09-12T00:13:00.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.956+0000 7f123c5ed9c0 20 add_watcher() i=2 2024-09-12T00:13:00.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.956+0000 7f123c5ed9c0 20 add_watcher() i=3 2024-09-12T00:13:00.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.956+0000 7f123c5ed9c0 20 add_watcher() i=4 2024-09-12T00:13:00.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.956+0000 7f123c5ed9c0 20 add_watcher() i=5 2024-09-12T00:13:00.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.960+0000 7f123c5ed9c0 20 add_watcher() i=6 2024-09-12T00:13:00.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.960+0000 7f123c5ed9c0 20 add_watcher() i=7 2024-09-12T00:13:00.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.960+0000 7f123c5ed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:00.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.964+0000 7f10f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:00.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.964+0000 7f123c5ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:00.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.964+0000 7f123c5ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:00.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.964+0000 7f123c5ed9c0 5 note: GC not initialized 2024-09-12T00:13:00.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.964+0000 7f106b7fe640 20 reqs_thread_entry: start 2024-09-12T00:13:00.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.964+0000 7f123c5ed9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:00.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 20 Filter name: none 2024-09-12T00:13:00.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f10697fa640 20 reqs_thread_entry: start 2024-09-12T00:13:00.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:00.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:00.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:00.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:00.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 : miss 2024-09-12T00:13:00.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:00.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 info.flags=0x17 2024-09-12T00:13:00.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 to cache LRU end 2024-09-12T00:13:00.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:00.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:00.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 2024-09-12T00:13:00.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:00.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:13:00.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:00.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:13:00.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.968+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:00.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.972+0000 7f123c5ed9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:13:00.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.972+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:00.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.972+0000 7f123c5ed9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:13:00.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.972+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:00.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.972+0000 7f123c5ed9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:13:00.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.972+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:00.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.972+0000 7f123c5ed9c0 20 get_obj_state: octx=0x5560b24ceed0 obj=check-bucket:d state=0x5560b2784098 s->prefetch_data=0 2024-09-12T00:13:00.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.972+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:00.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.972+0000 7f123c5ed9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:13:00.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.972+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:00.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:13:00.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:00.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 get_obj_state: octx=0x5560b24e0b40 obj=check-bucket:c state=0x5560b277fe08 s->prefetch_data=0 2024-09-12T00:13:00.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:00.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:13:00.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:00.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:13:00.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 get_obj_state: setting s->obj_tag to lkib0rzz91g3iu1k9fm65nm3px5cnvjh 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 get_obj_state_impl: setting s->olh_tag to ucq1lv0edgvd3vxzvuh14s7308g1tui3 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 get_obj_state: setting s->obj_tag to o30ydmz2lue4dp90l7aqmxc4ygn1fhnh 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 get_obj_state_impl: setting s->olh_tag to 9vkhfrudfvgtfuifj9kz4w5sylg2ucvd 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 olh_log_entry: epoch=4 op=3 key=d[ivUaFoyEi1WgxO02f8xJC3X7-gCuXRV] 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 get_obj_state: octx=0x5560b27abca0 obj=check-bucket:_:ivUaFoyEi1WgxO02f8xJC3X7-gCuXRV_d state=0x5560b277dfe8 s->prefetch_data=0 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 olh_log_entry: epoch=4 op=3 key=c[8tCzk85bByXAlP2yLD5xklHBiwFbiKn] 2024-09-12T00:13:00.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.976+0000 7f123c5ed9c0 20 get_obj_state: octx=0x5560b27cbca0 obj=check-bucket:_:8tCzk85bByXAlP2yLD5xklHBiwFbiKn_c state=0x5560b27d5ed8 s->prefetch_data=0 2024-09-12T00:13:00.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.980+0000 7f123c5ed9c0 20 get_obj_state: octx=0x5560b27abca0 obj=check-bucket:d state=0x5560b27cd708 s->prefetch_data=0 2024-09-12T00:13:00.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.984+0000 7f123c5ed9c0 20 get_obj_state: setting s->obj_tag to lkib0rzz91g3iu1k9fm65nm3px5cnvjh 2024-09-12T00:13:00.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.984+0000 7f123c5ed9c0 20 get_obj_state_impl: setting s->olh_tag to ucq1lv0edgvd3vxzvuh14s7308g1tui3 2024-09-12T00:13:00.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.984+0000 7f123c5ed9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ucq1lv0edgvd3vxzvuh14s7308g1tui3 2024-09-12T00:13:00.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.984+0000 7f123c5ed9c0 20 get_obj_state: octx=0x5560b27cbca0 obj=check-bucket:c state=0x5560b27d4dc8 s->prefetch_data=0 2024-09-12T00:13:00.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.984+0000 7f123c5ed9c0 20 get_obj_state: setting s->obj_tag to o30ydmz2lue4dp90l7aqmxc4ygn1fhnh 2024-09-12T00:13:00.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.984+0000 7f123c5ed9c0 20 get_obj_state_impl: setting s->olh_tag to 9vkhfrudfvgtfuifj9kz4w5sylg2ucvd 2024-09-12T00:13:00.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.984+0000 7f123c5ed9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9vkhfrudfvgtfuifj9kz4w5sylg2ucvd 2024-09-12T00:13:00.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.996+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:00.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.996+0000 7f123c5ed9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:13:00.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:00.996+0000 7f123c5ed9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:01.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.000+0000 7f123c5ed9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:13:01.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.000+0000 7f123c5ed9c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:13:01.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.000+0000 7f10f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:01.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.004+0000 7f123c5ed9c0 20 remove_watcher() i=0 2024-09-12T00:13:01.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.004+0000 7f123c5ed9c0 2 removed watcher, disabling cache 2024-09-12T00:13:01.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.008+0000 7f123c5ed9c0 20 remove_watcher() i=1 2024-09-12T00:13:01.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.012+0000 7f123c5ed9c0 20 remove_watcher() i=2 2024-09-12T00:13:01.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.012+0000 7f123c5ed9c0 20 remove_watcher() i=3 2024-09-12T00:13:01.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.016+0000 7f123c5ed9c0 20 remove_watcher() i=4 2024-09-12T00:13:01.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.016+0000 7f123c5ed9c0 20 remove_watcher() i=5 2024-09-12T00:13:01.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.020+0000 7f123c5ed9c0 20 remove_watcher() i=6 2024-09-12T00:13:01.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.020+0000 7f123c5ed9c0 20 remove_watcher() i=7 2024-09-12T00:13:01.036 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:13:01.069 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:01.069 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:01.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.112+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 realm 2024-09-12T00:13:01.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:01.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:01.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:01.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.116+0000 7f7ec5bb39c0 20 searching for the correct realm 2024-09-12T00:13:01.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.120+0000 7f7ec3eba640 0 -- 172.21.15.102:0/2847492810 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x5595ad3bea60 msgr2=0x5595ad3c0e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:01.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.128+0000 7f7ec2eb8640 0 -- 172.21.15.102:0/2847492810 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f7ebc06d490 msgr2=0x7f7ebc04aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:01.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:01.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 zone default found 2024-09-12T00:13:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 4 Realm: () 2024-09-12T00:13:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.348+0000 7f7ec5bb39c0 20 zonegroup default 2024-09-12T00:13:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.352+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.352+0000 7f7ec5bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.352+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.352+0000 7f7ec5bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.352+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.352+0000 7f7ec5bb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.352+0000 7f7ec5bb39c0 20 started sync module instance, tier type = 2024-09-12T00:13:01.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.352+0000 7f7ec5bb39c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:01.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.376+0000 7f7ec5bb39c0 20 add_watcher() i=0 2024-09-12T00:13:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.376+0000 7f7ec5bb39c0 20 add_watcher() i=1 2024-09-12T00:13:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.376+0000 7f7ec5bb39c0 20 add_watcher() i=2 2024-09-12T00:13:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.376+0000 7f7ec5bb39c0 20 add_watcher() i=3 2024-09-12T00:13:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.376+0000 7f7ec5bb39c0 20 add_watcher() i=4 2024-09-12T00:13:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.376+0000 7f7ec5bb39c0 20 add_watcher() i=5 2024-09-12T00:13:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.376+0000 7f7ec5bb39c0 20 add_watcher() i=6 2024-09-12T00:13:01.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.376+0000 7f7ec5bb39c0 20 add_watcher() i=7 2024-09-12T00:13:01.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.376+0000 7f7ec5bb39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:01.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.380+0000 7f7d79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 5 note: GC not initialized 2024-09-12T00:13:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7d78fe1640 20 reqs_thread_entry: start 2024-09-12T00:13:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:01.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 Filter name: none 2024-09-12T00:13:01.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7cf27fc640 20 reqs_thread_entry: start 2024-09-12T00:13:01.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:01.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:01.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:01.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:01.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 INFO: main: starting shard=0 2024-09-12T00:13:01.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.384+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:01.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 INFO: main: starting shard=1 2024-09-12T00:13:01.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:01.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 INFO: main: starting shard=2 2024-09-12T00:13:01.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:01.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 INFO: main: starting shard=3 2024-09-12T00:13:01.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:01.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 INFO: main: starting shard=4 2024-09-12T00:13:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 INFO: main: starting shard=5 2024-09-12T00:13:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.388+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:01.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: starting shard=6 2024-09-12T00:13:01.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:01.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: starting shard=7 2024-09-12T00:13:01.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: starting shard=8 2024-09-12T00:13:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: starting shard=9 2024-09-12T00:13:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: starting shard=10 2024-09-12T00:13:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:01.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.392+0000 7f7ec5bb39c0 20 INFO: main: done 2024-09-12T00:13:01.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.396+0000 7f7d79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:01.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.400+0000 7f7ec5bb39c0 20 remove_watcher() i=0 2024-09-12T00:13:01.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.400+0000 7f7ec5bb39c0 2 removed watcher, disabling cache 2024-09-12T00:13:01.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.404+0000 7f7ec5bb39c0 20 remove_watcher() i=1 2024-09-12T00:13:01.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.404+0000 7f7ec5bb39c0 20 remove_watcher() i=2 2024-09-12T00:13:01.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.408+0000 7f7ec5bb39c0 20 remove_watcher() i=3 2024-09-12T00:13:01.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.408+0000 7f7ec5bb39c0 20 remove_watcher() i=4 2024-09-12T00:13:01.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.412+0000 7f7ec5bb39c0 20 remove_watcher() i=5 2024-09-12T00:13:01.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.412+0000 7f7ec5bb39c0 20 remove_watcher() i=6 2024-09-12T00:13:01.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.412+0000 7f7ec5bb39c0 20 remove_watcher() i=7 2024-09-12T00:13:01.429 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:13:01.457 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:01.457 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:01.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.500+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.500+0000 7f181331f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.500+0000 7f181331f9c0 20 realm 2024-09-12T00:13:01.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.500+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.500+0000 7f181331f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.500+0000 7f181331f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:01.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.500+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.500+0000 7f181331f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.500+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.504+0000 7f181331f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:01.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.504+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.504+0000 7f181331f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:01.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.504+0000 7f181331f9c0 20 searching for the correct realm 2024-09-12T00:13:01.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.512+0000 7f1810e25640 0 -- 172.21.15.102:0/1559875358 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x7f1800033040 msgr2=0x7f1800033930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:01.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.728+0000 7f1810624640 0 -- 172.21.15.102:0/1559875358 >> [v2:172.21.15.121:6810/1906913778,v1:172.21.15.121:6811/1906913778] conn(0x563415558fa0 msgr2=0x56341555b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:01.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:01.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:01.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:01.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:01.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:01.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:01.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:01.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:01.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 zone default found 2024-09-12T00:13:01.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 4 Realm: () 2024-09-12T00:13:01.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:01.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:01.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:01.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 zonegroup default 2024-09-12T00:13:01.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.736+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.740+0000 7f181331f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.740+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.740+0000 7f181331f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.740+0000 7f181331f9c0 20 started sync module instance, tier type = 2024-09-12T00:13:01.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.740+0000 7f181331f9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:01.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.760+0000 7f181331f9c0 20 add_watcher() i=0 2024-09-12T00:13:01.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.760+0000 7f181331f9c0 20 add_watcher() i=1 2024-09-12T00:13:01.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.760+0000 7f181331f9c0 20 add_watcher() i=2 2024-09-12T00:13:01.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.760+0000 7f181331f9c0 20 add_watcher() i=3 2024-09-12T00:13:01.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.760+0000 7f181331f9c0 20 add_watcher() i=4 2024-09-12T00:13:01.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.760+0000 7f181331f9c0 20 add_watcher() i=5 2024-09-12T00:13:01.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.760+0000 7f181331f9c0 20 add_watcher() i=6 2024-09-12T00:13:01.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.764+0000 7f181331f9c0 20 add_watcher() i=7 2024-09-12T00:13:01.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.764+0000 7f181331f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:01.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f16c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:01.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f181331f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:01.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f181331f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:01.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f181331f9c0 5 note: GC not initialized 2024-09-12T00:13:01.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f16c5fe3640 20 reqs_thread_entry: start 2024-09-12T00:13:01.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f181331f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:01.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f181331f9c0 20 Filter name: none 2024-09-12T00:13:01.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f16377fe640 20 reqs_thread_entry: start 2024-09-12T00:13:01.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f181331f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:01.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.768+0000 7f181331f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:01.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:01.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:01.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 INFO: main: starting shard=0 2024-09-12T00:13:01.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:01.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 INFO: main: starting shard=1 2024-09-12T00:13:01.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:01.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 INFO: main: starting shard=2 2024-09-12T00:13:01.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:01.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 INFO: main: starting shard=3 2024-09-12T00:13:01.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.772+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:01.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: starting shard=4 2024-09-12T00:13:01.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:01.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: starting shard=5 2024-09-12T00:13:01.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:01.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: starting shard=6 2024-09-12T00:13:01.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:01.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: starting shard=7 2024-09-12T00:13:01.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:01.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: starting shard=8 2024-09-12T00:13:01.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:01.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 INFO: main: starting shard=9 2024-09-12T00:13:01.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.776+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:01.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.780+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.780+0000 7f181331f9c0 20 INFO: main: starting shard=10 2024-09-12T00:13:01.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.780+0000 7f181331f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:01.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.780+0000 7f181331f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:01.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.780+0000 7f181331f9c0 20 INFO: main: done 2024-09-12T00:13:01.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.780+0000 7f16c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:01.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.784+0000 7f181331f9c0 20 remove_watcher() i=0 2024-09-12T00:13:01.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.784+0000 7f181331f9c0 2 removed watcher, disabling cache 2024-09-12T00:13:01.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.788+0000 7f181331f9c0 20 remove_watcher() i=1 2024-09-12T00:13:01.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.792+0000 7f181331f9c0 20 remove_watcher() i=2 2024-09-12T00:13:01.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.792+0000 7f181331f9c0 20 remove_watcher() i=3 2024-09-12T00:13:01.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.796+0000 7f181331f9c0 20 remove_watcher() i=4 2024-09-12T00:13:01.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.796+0000 7f181331f9c0 20 remove_watcher() i=5 2024-09-12T00:13:01.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.800+0000 7f181331f9c0 20 remove_watcher() i=6 2024-09-12T00:13:01.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.800+0000 7f181331f9c0 20 remove_watcher() i=7 2024-09-12T00:13:01.818 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:13:01.819 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:01.819 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:13:01.853 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:01.853 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:01.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.896+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.900+0000 7f506511f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.900+0000 7f506511f9c0 20 realm 2024-09-12T00:13:01.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.900+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.900+0000 7f506511f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.900+0000 7f506511f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:01.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.900+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.900+0000 7f506511f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.900+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.900+0000 7f506511f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:01.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.900+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.904+0000 7f506511f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:01.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.904+0000 7f506511f9c0 20 searching for the correct realm 2024-09-12T00:13:01.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.908+0000 7f5063426640 0 -- 172.21.15.102:0/51628170 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f50580ca070 msgr2=0x7f50580f7e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:01.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:01.912+0000 7f5062424640 0 -- 172.21.15.102:0/51628170 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f505c095b30 msgr2=0x7f505c085830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:02.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.128+0000 7f506511f9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:02.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.128+0000 7f506511f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:02.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.128+0000 7f506511f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:02.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.128+0000 7f506511f9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:02.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.128+0000 7f506511f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:02.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.128+0000 7f506511f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:02.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.128+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.128+0000 7f506511f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.128+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:02.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:02.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 20 zone default found 2024-09-12T00:13:02.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 4 Realm: () 2024-09-12T00:13:02.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:02.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:02.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:02.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 20 zonegroup default 2024-09-12T00:13:02.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.132+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.136+0000 7f506511f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.136+0000 7f506511f9c0 20 started sync module instance, tier type = 2024-09-12T00:13:02.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.136+0000 7f506511f9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:02.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.160+0000 7f506511f9c0 20 add_watcher() i=0 2024-09-12T00:13:02.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.160+0000 7f506511f9c0 20 add_watcher() i=1 2024-09-12T00:13:02.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.160+0000 7f506511f9c0 20 add_watcher() i=2 2024-09-12T00:13:02.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.160+0000 7f506511f9c0 20 add_watcher() i=3 2024-09-12T00:13:02.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.160+0000 7f506511f9c0 20 add_watcher() i=4 2024-09-12T00:13:02.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.160+0000 7f506511f9c0 20 add_watcher() i=5 2024-09-12T00:13:02.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.160+0000 7f506511f9c0 20 add_watcher() i=6 2024-09-12T00:13:02.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.164+0000 7f506511f9c0 20 add_watcher() i=7 2024-09-12T00:13:02.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.164+0000 7f506511f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:02.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.168+0000 7f4f197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.168+0000 7f506511f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.168+0000 7f506511f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.168+0000 7f506511f9c0 5 note: GC not initialized 2024-09-12T00:13:02.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.168+0000 7f4e93fff640 20 reqs_thread_entry: start 2024-09-12T00:13:02.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:02.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 20 Filter name: none 2024-09-12T00:13:02.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f4e91ffb640 20 reqs_thread_entry: start 2024-09-12T00:13:02.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:02.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:02.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:02.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:02.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 : miss 2024-09-12T00:13:02.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:02.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 info.flags=0x17 2024-09-12T00:13:02.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 to cache LRU end 2024-09-12T00:13:02.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:02.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:02.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 2024-09-12T00:13:02.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:02.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:13:02.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.172+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:02.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:13:02.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:02.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:13:02.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:02.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:13:02.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:02.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:13:02.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:02.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:13:02.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:02.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:13:02.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.176+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:02.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.180+0000 7f506511f9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:13:02.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.180+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:02.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.180+0000 7f506511f9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:13:02.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.180+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:02.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.180+0000 7f506511f9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:13:02.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.180+0000 7f506511f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:02.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.180+0000 7f506511f9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:13:02.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.180+0000 7f506511f9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:13:02.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.180+0000 7f4f197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:02.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.188+0000 7f506511f9c0 20 remove_watcher() i=0 2024-09-12T00:13:02.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.188+0000 7f506511f9c0 2 removed watcher, disabling cache 2024-09-12T00:13:02.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.188+0000 7f506511f9c0 20 remove_watcher() i=1 2024-09-12T00:13:02.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.192+0000 7f506511f9c0 20 remove_watcher() i=2 2024-09-12T00:13:02.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.196+0000 7f506511f9c0 20 remove_watcher() i=3 2024-09-12T00:13:02.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.196+0000 7f506511f9c0 20 remove_watcher() i=4 2024-09-12T00:13:02.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.200+0000 7f506511f9c0 20 remove_watcher() i=5 2024-09-12T00:13:02.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.200+0000 7f506511f9c0 20 remove_watcher() i=6 2024-09-12T00:13:02.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:02.200+0000 7f506511f9c0 20 remove_watcher() i=7 2024-09-12T00:13:02.216 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:13:02.216 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:02.218 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:02.218 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:02.245 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:02.246 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:02.277 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:02.277 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:02.402 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:13:02.403 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:02.405 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:02.405 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:02.511 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:02.511 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:02.991 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:02.992 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:03.132 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:03.132 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:03.200 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:03.201 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:03.359 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:03.359 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:03.428 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:03.428 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:03.577 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:03.577 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:03.645 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:03.645 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:03.797 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:03.797 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:03.866 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:03.866 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:04.014 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:04.014 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:04.089 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:04.089 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:04.240 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:04.241 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:04.309 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:13:04.744 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:13:06.170 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:06.171 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:06.332 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:06.332 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:13:06.368 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:06.368 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:06.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.412+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.416+0000 7fbade1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.416+0000 7fbade1779c0 20 realm 2024-09-12T00:13:06.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.416+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.416+0000 7fbade1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.416+0000 7fbade1779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:06.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.416+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.416+0000 7fbade1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.416+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.420+0000 7fbade1779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:06.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.420+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.420+0000 7fbade1779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:06.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.420+0000 7fbade1779c0 20 searching for the correct realm 2024-09-12T00:13:06.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.424+0000 7fbadc47e640 0 -- 172.21.15.102:0/3198243313 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fbad0046bc0 msgr2=0x7fbad0062a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:06.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.640+0000 7fbadb47c640 0 -- 172.21.15.102:0/3198243313 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fbad4102590 msgr2=0x7fbad410a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:06.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.856+0000 7fbade1779c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:06.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.856+0000 7fbade1779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:06.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.856+0000 7fbade1779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:06.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.856+0000 7fbade1779c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:06.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.856+0000 7fbade1779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:06.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.856+0000 7fbade1779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:06.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.856+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.856+0000 7fbade1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.856+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:06.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:06.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 zone default found 2024-09-12T00:13:06.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 4 Realm: () 2024-09-12T00:13:06.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:06.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:06.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:06.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 zonegroup default 2024-09-12T00:13:06.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 started sync module instance, tier type = 2024-09-12T00:13:06.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.860+0000 7fbade1779c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:06.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.888+0000 7fbade1779c0 20 add_watcher() i=0 2024-09-12T00:13:06.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.888+0000 7fbade1779c0 20 add_watcher() i=1 2024-09-12T00:13:06.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.888+0000 7fbade1779c0 20 add_watcher() i=2 2024-09-12T00:13:06.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.888+0000 7fbade1779c0 20 add_watcher() i=3 2024-09-12T00:13:06.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.888+0000 7fbade1779c0 20 add_watcher() i=4 2024-09-12T00:13:06.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.888+0000 7fbade1779c0 20 add_watcher() i=5 2024-09-12T00:13:06.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.888+0000 7fbade1779c0 20 add_watcher() i=6 2024-09-12T00:13:06.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.892+0000 7fbade1779c0 20 add_watcher() i=7 2024-09-12T00:13:06.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.892+0000 7fbade1779c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:06.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fb991fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:06.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fbade1779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:06.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fbade1779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:06.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fbade1779c0 5 note: GC not initialized 2024-09-12T00:13:06.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fb990fe1640 20 reqs_thread_entry: start 2024-09-12T00:13:06.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fbade1779c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:06.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fbade1779c0 20 Filter name: none 2024-09-12T00:13:06.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fb90a7fc640 20 reqs_thread_entry: start 2024-09-12T00:13:06.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fbade1779c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:06.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.896+0000 7fbade1779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:06.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:06.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:06.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 INFO: main: starting shard=0 2024-09-12T00:13:06.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:06.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 INFO: main: starting shard=1 2024-09-12T00:13:06.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:06.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 INFO: main: starting shard=2 2024-09-12T00:13:06.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.900+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:06.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: starting shard=3 2024-09-12T00:13:06.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:06.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: starting shard=4 2024-09-12T00:13:06.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:06.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: starting shard=5 2024-09-12T00:13:06.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:06.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: starting shard=6 2024-09-12T00:13:06.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:06.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: starting shard=7 2024-09-12T00:13:06.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:06.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 INFO: main: starting shard=8 2024-09-12T00:13:06.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.904+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:06.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.908+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:13:06.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.908+0000 7fbade1779c0 20 INFO: main: starting shard=9 2024-09-12T00:13:06.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.908+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:06.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.908+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.908+0000 7fbade1779c0 20 INFO: main: starting shard=10 2024-09-12T00:13:06.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.908+0000 7fbade1779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:06.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.908+0000 7fbade1779c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.908+0000 7fbade1779c0 20 INFO: main: done 2024-09-12T00:13:06.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.912+0000 7fb991fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:06.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.916+0000 7fbade1779c0 20 remove_watcher() i=0 2024-09-12T00:13:06.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.916+0000 7fbade1779c0 2 removed watcher, disabling cache 2024-09-12T00:13:06.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.916+0000 7fbade1779c0 20 remove_watcher() i=1 2024-09-12T00:13:06.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.920+0000 7fbade1779c0 20 remove_watcher() i=2 2024-09-12T00:13:06.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.920+0000 7fbade1779c0 20 remove_watcher() i=3 2024-09-12T00:13:06.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.924+0000 7fbade1779c0 20 remove_watcher() i=4 2024-09-12T00:13:06.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.928+0000 7fbade1779c0 20 remove_watcher() i=5 2024-09-12T00:13:06.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.928+0000 7fbade1779c0 20 remove_watcher() i=6 2024-09-12T00:13:06.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:06.932+0000 7fbade1779c0 20 remove_watcher() i=7 2024-09-12T00:13:06.953 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:06.953 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:07.003 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:07.003 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:07.168 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:07.168 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:13:07.206 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:07.206 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:07.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.252+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.252+0000 7f45a201a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.252+0000 7f45a201a9c0 20 realm 2024-09-12T00:13:07.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.252+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.252+0000 7f45a201a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.252+0000 7f45a201a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:07.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.252+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.252+0000 7f45a201a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.252+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.256+0000 7f45a201a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:07.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.256+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.256+0000 7f45a201a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:07.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.256+0000 7f45a201a9c0 20 searching for the correct realm 2024-09-12T00:13:07.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.260+0000 7f45a0321640 0 -- 172.21.15.102:0/2128533543 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f4594024040 msgr2=0x7f4594042430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:07.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.476+0000 7f459f31f640 0 -- 172.21.15.102:0/2128533543 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f45980ff040 msgr2=0x7f45980fb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:07.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.692+0000 7f45a201a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:07.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.692+0000 7f45a201a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:07.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.692+0000 7f45a201a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:07.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.692+0000 7f45a201a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:07.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.692+0000 7f45a201a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:07.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.692+0000 7f45a201a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:07.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.692+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.692+0000 7f45a201a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.692+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:07.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:07.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 zone default found 2024-09-12T00:13:07.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 4 Realm: () 2024-09-12T00:13:07.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:07.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:07.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:07.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 zonegroup default 2024-09-12T00:13:07.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 started sync module instance, tier type = 2024-09-12T00:13:07.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.696+0000 7f45a201a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:07.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.720+0000 7f45a201a9c0 20 add_watcher() i=0 2024-09-12T00:13:07.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.720+0000 7f45a201a9c0 20 add_watcher() i=1 2024-09-12T00:13:07.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.720+0000 7f45a201a9c0 20 add_watcher() i=2 2024-09-12T00:13:07.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.720+0000 7f45a201a9c0 20 add_watcher() i=3 2024-09-12T00:13:07.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.720+0000 7f45a201a9c0 20 add_watcher() i=4 2024-09-12T00:13:07.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.720+0000 7f45a201a9c0 20 add_watcher() i=5 2024-09-12T00:13:07.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.720+0000 7f45a201a9c0 20 add_watcher() i=6 2024-09-12T00:13:07.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.720+0000 7f45a201a9c0 20 add_watcher() i=7 2024-09-12T00:13:07.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.720+0000 7f45a201a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:07.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.724+0000 7f4455fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:07.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.724+0000 7f45a201a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:07.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.724+0000 7f45a201a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:07.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.724+0000 7f45a201a9c0 5 note: GC not initialized 2024-09-12T00:13:07.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f4454fe1640 20 reqs_thread_entry: start 2024-09-12T00:13:07.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:07.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 Filter name: none 2024-09-12T00:13:07.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f43ce7fc640 20 reqs_thread_entry: start 2024-09-12T00:13:07.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:07.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:07.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:07.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:07.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 INFO: main: starting shard=0 2024-09-12T00:13:07.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:07.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:07.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 INFO: main: starting shard=1 2024-09-12T00:13:07.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.728+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:07.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:07.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 INFO: main: starting shard=2 2024-09-12T00:13:07.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:07.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:07.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 INFO: main: starting shard=3 2024-09-12T00:13:07.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:07.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:07.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 INFO: main: starting shard=4 2024-09-12T00:13:07.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:07.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:07.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 INFO: main: starting shard=5 2024-09-12T00:13:07.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:07.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:13:07.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 INFO: main: starting shard=6 2024-09-12T00:13:07.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.732+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:07.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:07.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 INFO: main: starting shard=7 2024-09-12T00:13:07.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:07.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:07.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 INFO: main: starting shard=8 2024-09-12T00:13:07.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:07.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:07.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 INFO: main: starting shard=9 2024-09-12T00:13:07.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:07.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:07.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 INFO: main: starting shard=10 2024-09-12T00:13:07.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:07.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:07.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f45a201a9c0 20 INFO: main: done 2024-09-12T00:13:07.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.736+0000 7f4455fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:07.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.744+0000 7f45a201a9c0 20 remove_watcher() i=0 2024-09-12T00:13:07.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.744+0000 7f45a201a9c0 2 removed watcher, disabling cache 2024-09-12T00:13:07.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.744+0000 7f45a201a9c0 20 remove_watcher() i=1 2024-09-12T00:13:07.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.748+0000 7f45a201a9c0 20 remove_watcher() i=2 2024-09-12T00:13:07.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.748+0000 7f45a201a9c0 20 remove_watcher() i=3 2024-09-12T00:13:07.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.752+0000 7f45a201a9c0 20 remove_watcher() i=4 2024-09-12T00:13:07.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.752+0000 7f45a201a9c0 20 remove_watcher() i=5 2024-09-12T00:13:07.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.756+0000 7f45a201a9c0 20 remove_watcher() i=6 2024-09-12T00:13:07.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:07.756+0000 7f45a201a9c0 20 remove_watcher() i=7 2024-09-12T00:13:07.775 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:07.776 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:07.803 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:07.804 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:07.928 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:07.928 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:13:07.962 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:07.963 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:08.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.008+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.008+0000 7f3dc77709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.008+0000 7f3dc77709c0 20 realm 2024-09-12T00:13:08.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.008+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.008+0000 7f3dc77709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.008+0000 7f3dc77709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:08.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.012+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.012+0000 7f3dc77709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.012+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.012+0000 7f3dc77709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:08.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.012+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.012+0000 7f3dc77709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:08.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.012+0000 7f3dc77709c0 20 searching for the correct realm 2024-09-12T00:13:08.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.016+0000 7f3dc4a75640 0 -- 172.21.15.102:0/1385337611 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f3db0003be0 msgr2=0x7f3dc0036920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:08.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.232+0000 7f3dc5a77640 0 -- 172.21.15.102:0/1385337611 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55ec12d50ea0 msgr2=0x55ec12d53290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:08.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:08.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:08.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:08.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:08.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:08.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:08.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:08.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:08.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 zone default found 2024-09-12T00:13:08.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 4 Realm: () 2024-09-12T00:13:08.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:08.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:08.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:08.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 zonegroup default 2024-09-12T00:13:08.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.248+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.252+0000 7f3dc77709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.252+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.252+0000 7f3dc77709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.252+0000 7f3dc77709c0 20 started sync module instance, tier type = 2024-09-12T00:13:08.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.252+0000 7f3dc77709c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:08.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.276+0000 7f3dc77709c0 20 add_watcher() i=0 2024-09-12T00:13:08.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.276+0000 7f3dc77709c0 20 add_watcher() i=1 2024-09-12T00:13:08.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.276+0000 7f3dc77709c0 20 add_watcher() i=2 2024-09-12T00:13:08.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.276+0000 7f3dc77709c0 20 add_watcher() i=3 2024-09-12T00:13:08.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.276+0000 7f3dc77709c0 20 add_watcher() i=4 2024-09-12T00:13:08.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.276+0000 7f3dc77709c0 20 add_watcher() i=5 2024-09-12T00:13:08.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.276+0000 7f3dc77709c0 20 add_watcher() i=6 2024-09-12T00:13:08.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.280+0000 7f3dc77709c0 20 add_watcher() i=7 2024-09-12T00:13:08.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.280+0000 7f3dc77709c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:08.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3c7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:08.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:08.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:08.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 5 note: GC not initialized 2024-09-12T00:13:08.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3c7a7e4640 20 reqs_thread_entry: start 2024-09-12T00:13:08.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:08.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 Filter name: none 2024-09-12T00:13:08.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3bebfff640 20 reqs_thread_entry: start 2024-09-12T00:13:08.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:08.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:08.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:08.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:08.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 INFO: main: starting shard=0 2024-09-12T00:13:08.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.288+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:08.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.292+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:08.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.292+0000 7f3dc77709c0 20 INFO: main: starting shard=1 2024-09-12T00:13:08.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.292+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:08.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.292+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:13:08.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.292+0000 7f3dc77709c0 20 INFO: main: starting shard=2 2024-09-12T00:13:08.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.292+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:08.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:08.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: starting shard=3 2024-09-12T00:13:08.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:08.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:08.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: starting shard=4 2024-09-12T00:13:08.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:08.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:08.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: starting shard=5 2024-09-12T00:13:08.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:08.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:08.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: starting shard=6 2024-09-12T00:13:08.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:08.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:08.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: starting shard=7 2024-09-12T00:13:08.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:08.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:08.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 INFO: main: starting shard=8 2024-09-12T00:13:08.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.296+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:08.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.300+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:08.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.300+0000 7f3dc77709c0 20 INFO: main: starting shard=9 2024-09-12T00:13:08.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.300+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:08.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.300+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:08.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.300+0000 7f3dc77709c0 20 INFO: main: starting shard=10 2024-09-12T00:13:08.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.300+0000 7f3dc77709c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:08.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.300+0000 7f3dc77709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:08.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.300+0000 7f3dc77709c0 20 INFO: main: done 2024-09-12T00:13:08.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.300+0000 7f3c7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:08.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.304+0000 7f3dc77709c0 20 remove_watcher() i=0 2024-09-12T00:13:08.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.304+0000 7f3dc77709c0 2 removed watcher, disabling cache 2024-09-12T00:13:08.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.308+0000 7f3dc77709c0 20 remove_watcher() i=1 2024-09-12T00:13:08.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.312+0000 7f3dc77709c0 20 remove_watcher() i=2 2024-09-12T00:13:08.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.316+0000 7f3dc77709c0 20 remove_watcher() i=3 2024-09-12T00:13:08.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.316+0000 7f3dc77709c0 20 remove_watcher() i=4 2024-09-12T00:13:08.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.320+0000 7f3dc77709c0 20 remove_watcher() i=5 2024-09-12T00:13:08.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.320+0000 7f3dc77709c0 20 remove_watcher() i=6 2024-09-12T00:13:08.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.320+0000 7f3dc77709c0 20 remove_watcher() i=7 2024-09-12T00:13:08.339 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:08.339 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:08.368 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:08.368 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:08.487 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:08.489 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:13:08.523 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:08.523 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:08.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.568+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.568+0000 7fa3b6f649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.568+0000 7fa3b6f649c0 20 realm 2024-09-12T00:13:08.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.568+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.568+0000 7fa3b6f649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.568+0000 7fa3b6f649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:08.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.568+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.568+0000 7fa3b6f649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.568+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.572+0000 7fa3b6f649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:08.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.572+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.572+0000 7fa3b6f649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:08.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.572+0000 7fa3b6f649c0 20 searching for the correct realm 2024-09-12T00:13:08.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.576+0000 7fa3b526b640 0 -- 172.21.15.102:0/1880947986 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fa3a8003870 msgr2=0x7fa3a80ad9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:08.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:08.792+0000 7fa3b4269640 0 -- 172.21.15.102:0/1880947986 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fa3ac059410 msgr2=0x7fa3ac059890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:09.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.008+0000 7fa3b6f649c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:09.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.008+0000 7fa3b6f649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:09.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.008+0000 7fa3b6f649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:09.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.008+0000 7fa3b6f649c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:09.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.008+0000 7fa3b6f649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:09.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.008+0000 7fa3b6f649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:09.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.008+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.008+0000 7fa3b6f649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.008+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:09.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:09.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 zone default found 2024-09-12T00:13:09.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 4 Realm: () 2024-09-12T00:13:09.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:09.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:09.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:09.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 zonegroup default 2024-09-12T00:13:09.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 started sync module instance, tier type = 2024-09-12T00:13:09.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.012+0000 7fa3b6f649c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:09.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.040+0000 7fa3b6f649c0 20 add_watcher() i=0 2024-09-12T00:13:09.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.040+0000 7fa3b6f649c0 20 add_watcher() i=1 2024-09-12T00:13:09.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.040+0000 7fa3b6f649c0 20 add_watcher() i=2 2024-09-12T00:13:09.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.040+0000 7fa3b6f649c0 20 add_watcher() i=3 2024-09-12T00:13:09.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.040+0000 7fa3b6f649c0 20 add_watcher() i=4 2024-09-12T00:13:09.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.040+0000 7fa3b6f649c0 20 add_watcher() i=5 2024-09-12T00:13:09.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.040+0000 7fa3b6f649c0 20 add_watcher() i=6 2024-09-12T00:13:09.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.040+0000 7fa3b6f649c0 20 add_watcher() i=7 2024-09-12T00:13:09.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.040+0000 7fa3b6f649c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:09.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.044+0000 7fa26afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:09.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:09.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:09.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 5 note: GC not initialized 2024-09-12T00:13:09.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa269fe3640 20 reqs_thread_entry: start 2024-09-12T00:13:09.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:09.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 Filter name: none 2024-09-12T00:13:09.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa1db7fe640 20 reqs_thread_entry: start 2024-09-12T00:13:09.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:09.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:09.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:09.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:09.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 INFO: main: starting shard=0 2024-09-12T00:13:09.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.048+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:09.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 INFO: main: starting shard=1 2024-09-12T00:13:09.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:09.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 INFO: main: starting shard=2 2024-09-12T00:13:09.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:09.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 INFO: main: starting shard=3 2024-09-12T00:13:09.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:09.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 INFO: main: starting shard=4 2024-09-12T00:13:09.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.052+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:09.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 INFO: main: starting shard=5 2024-09-12T00:13:09.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:09.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 INFO: main: starting shard=6 2024-09-12T00:13:09.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:09.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 INFO: main: starting shard=7 2024-09-12T00:13:09.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:09.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 INFO: main: starting shard=8 2024-09-12T00:13:09.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.056+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:09.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.060+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.060+0000 7fa3b6f649c0 20 INFO: main: starting shard=9 2024-09-12T00:13:09.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.060+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:09.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.060+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.060+0000 7fa3b6f649c0 20 INFO: main: starting shard=10 2024-09-12T00:13:09.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.060+0000 7fa3b6f649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:09.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.060+0000 7fa3b6f649c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:13:09.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.060+0000 7fa3b6f649c0 20 INFO: main: done 2024-09-12T00:13:09.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.060+0000 7fa26afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:09.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.068+0000 7fa3b6f649c0 20 remove_watcher() i=0 2024-09-12T00:13:09.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.068+0000 7fa3b6f649c0 2 removed watcher, disabling cache 2024-09-12T00:13:09.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.068+0000 7fa3b6f649c0 20 remove_watcher() i=1 2024-09-12T00:13:09.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.072+0000 7fa3b6f649c0 20 remove_watcher() i=2 2024-09-12T00:13:09.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.076+0000 7fa3b6f649c0 20 remove_watcher() i=3 2024-09-12T00:13:09.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.076+0000 7fa3b6f649c0 20 remove_watcher() i=4 2024-09-12T00:13:09.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.080+0000 7fa3b6f649c0 20 remove_watcher() i=5 2024-09-12T00:13:09.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.080+0000 7fa3b6f649c0 20 remove_watcher() i=6 2024-09-12T00:13:09.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:09.080+0000 7fa3b6f649c0 20 remove_watcher() i=7 2024-09-12T00:13:09.100 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:09.100 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:09.132 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:13:09.580 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:13:10.010 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:13:10.036 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:10.036 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:10.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.076+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.080+0000 7f571bcf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.080+0000 7f571bcf29c0 20 realm 2024-09-12T00:13:10.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.080+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.080+0000 7f571bcf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.080+0000 7f571bcf29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:10.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.080+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.080+0000 7f571bcf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.080+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.080+0000 7f571bcf29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:10.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.080+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.084+0000 7f571bcf29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:10.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.084+0000 7f571bcf29c0 20 searching for the correct realm 2024-09-12T00:13:10.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.088+0000 7f5719ff9640 0 -- 172.21.15.102:0/2893661239 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f571000b940 msgr2=0x7f5710018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:10.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.092+0000 7f5718ff7640 0 -- 172.21.15.102:0/2893661239 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f571406fc50 msgr2=0x7f571404b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:10.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.308+0000 7f571bcf29c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:10.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.308+0000 7f571bcf29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:10.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.308+0000 7f571bcf29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:10.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.308+0000 7f571bcf29c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:10.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.308+0000 7f571bcf29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:10.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.308+0000 7f571bcf29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:10.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.308+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.308+0000 7f571bcf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.308+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:10.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:10.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 zone default found 2024-09-12T00:13:10.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 4 Realm: () 2024-09-12T00:13:10.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:10.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:10.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:10.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 zonegroup default 2024-09-12T00:13:10.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 started sync module instance, tier type = 2024-09-12T00:13:10.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.312+0000 7f571bcf29c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:10.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.340+0000 7f571bcf29c0 20 add_watcher() i=0 2024-09-12T00:13:10.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.340+0000 7f571bcf29c0 20 add_watcher() i=1 2024-09-12T00:13:10.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.340+0000 7f571bcf29c0 20 add_watcher() i=2 2024-09-12T00:13:10.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.340+0000 7f571bcf29c0 20 add_watcher() i=3 2024-09-12T00:13:10.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.340+0000 7f571bcf29c0 20 add_watcher() i=4 2024-09-12T00:13:10.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.340+0000 7f571bcf29c0 20 add_watcher() i=5 2024-09-12T00:13:10.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.340+0000 7f571bcf29c0 20 add_watcher() i=6 2024-09-12T00:13:10.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.340+0000 7f571bcf29c0 20 add_watcher() i=7 2024-09-12T00:13:10.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.340+0000 7f571bcf29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:10.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.344+0000 7f55cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:10.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:10.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:10.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 5 note: GC not initialized 2024-09-12T00:13:10.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f55ce7e4640 20 reqs_thread_entry: start 2024-09-12T00:13:10.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:10.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 20 Filter name: none 2024-09-12T00:13:10.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f553ffff640 20 reqs_thread_entry: start 2024-09-12T00:13:10.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:10.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:10.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:10.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:10.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 : miss 2024-09-12T00:13:10.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:10.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 info.flags=0x17 2024-09-12T00:13:10.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 to cache LRU end 2024-09-12T00:13:10.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:10.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:10.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 2024-09-12T00:13:10.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.348+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:10.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.352+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:10.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.352+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:10.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.352+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:10.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.352+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:10.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.356+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:10.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.356+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:10.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.356+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:10.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.356+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:10.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.356+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:10.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.356+0000 7f571bcf29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:10.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.368+0000 7f55cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:10.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.372+0000 7f571bcf29c0 20 remove_watcher() i=0 2024-09-12T00:13:10.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.372+0000 7f571bcf29c0 2 removed watcher, disabling cache 2024-09-12T00:13:10.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.372+0000 7f571bcf29c0 20 remove_watcher() i=1 2024-09-12T00:13:10.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.376+0000 7f571bcf29c0 20 remove_watcher() i=2 2024-09-12T00:13:10.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.376+0000 7f571bcf29c0 20 remove_watcher() i=3 2024-09-12T00:13:10.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.380+0000 7f571bcf29c0 20 remove_watcher() i=4 2024-09-12T00:13:10.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.380+0000 7f571bcf29c0 20 remove_watcher() i=5 2024-09-12T00:13:10.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.384+0000 7f571bcf29c0 20 remove_watcher() i=6 2024-09-12T00:13:10.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.384+0000 7f571bcf29c0 20 remove_watcher() i=7 2024-09-12T00:13:10.409 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:13:10.442 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:10.442 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:10.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.484+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.484+0000 7f99bbe779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.484+0000 7f99bbe779c0 20 realm 2024-09-12T00:13:10.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.484+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.488+0000 7f99bbe779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.488+0000 7f99bbe779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:10.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.488+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.488+0000 7f99bbe779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.488+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.488+0000 7f99bbe779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:10.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.488+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.488+0000 7f99bbe779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:10.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.488+0000 7f99bbe779c0 20 searching for the correct realm 2024-09-12T00:13:10.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.492+0000 7f99ba17e640 0 -- 172.21.15.102:0/1144945750 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f99b0008050 msgr2=0x7f99b006a540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:10.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.500+0000 7f99b917c640 0 -- 172.21.15.102:0/1144945750 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f99b411cb00 msgr2=0x7f99b4106740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:10.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.716+0000 7f99bbe779c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:10.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.716+0000 7f99bbe779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:10.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.716+0000 7f99bbe779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:10.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.716+0000 7f99bbe779c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:10.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.716+0000 7f99bbe779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:10.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.716+0000 7f99bbe779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:10.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.716+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.716+0000 7f99bbe779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.716+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:10.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:10.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 zone default found 2024-09-12T00:13:10.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 4 Realm: () 2024-09-12T00:13:10.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:10.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:10.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:10.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 zonegroup default 2024-09-12T00:13:10.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 started sync module instance, tier type = 2024-09-12T00:13:10.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.720+0000 7f99bbe779c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:10.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.744+0000 7f99bbe779c0 20 add_watcher() i=0 2024-09-12T00:13:10.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.744+0000 7f99bbe779c0 20 add_watcher() i=1 2024-09-12T00:13:10.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.744+0000 7f99bbe779c0 20 add_watcher() i=2 2024-09-12T00:13:10.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.744+0000 7f99bbe779c0 20 add_watcher() i=3 2024-09-12T00:13:10.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.744+0000 7f99bbe779c0 20 add_watcher() i=4 2024-09-12T00:13:10.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.744+0000 7f99bbe779c0 20 add_watcher() i=5 2024-09-12T00:13:10.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.744+0000 7f99bbe779c0 20 add_watcher() i=6 2024-09-12T00:13:10.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.748+0000 7f99bbe779c0 20 add_watcher() i=7 2024-09-12T00:13:10.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.748+0000 7f99bbe779c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:10.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f986b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:10.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:10.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:10.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 5 note: GC not initialized 2024-09-12T00:13:10.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f986a7fc640 20 reqs_thread_entry: start 2024-09-12T00:13:10.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:10.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 20 Filter name: none 2024-09-12T00:13:10.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f97dbfff640 20 reqs_thread_entry: start 2024-09-12T00:13:10.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:10.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:10.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:10.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:10.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 : miss 2024-09-12T00:13:10.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:10.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.752+0000 7f99bbe779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 info.flags=0x17 2024-09-12T00:13:10.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.756+0000 7f99bbe779c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 to cache LRU end 2024-09-12T00:13:10.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.756+0000 7f99bbe779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:10.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.756+0000 7f99bbe779c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:10.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.756+0000 7f99bbe779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2 2024-09-12T00:13:10.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.756+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.0 2024-09-12T00:13:10.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.756+0000 7f99bbe779c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:13:10.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.756+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:10.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.756+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.2 2024-09-12T00:13:10.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.756+0000 7f99bbe779c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:13:10.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.756+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.3 2024-09-12T00:13:10.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:13:10.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.4 2024-09-12T00:13:10.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:13:10.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:10.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.6 2024-09-12T00:13:10.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:13:10.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.7 2024-09-12T00:13:10.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:13:10.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:10.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.9 2024-09-12T00:13:10.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:13:10.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.760+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:10.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:10.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d34399cee0 obj=check-bucket:e state=0x55d343c4e678 s->prefetch_data=0 2024-09-12T00:13:10.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:10.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d3439aeb50 obj=check-bucket:d state=0x55d343c48788 s->prefetch_data=0 2024-09-12T00:13:10.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:10.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d343c50770 obj=check-bucket:c state=0x55d343c49508 s->prefetch_data=0 2024-09-12T00:13:10.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d343c4b7f0 obj=check-bucket:f state=0x55d343c4bfb8 s->prefetch_data=0 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state: setting s->obj_tag to 9mtff2b24v063fr5sq1d8rwjk449cg9h 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state_impl: setting s->olh_tag to weleqrymzu42zc1d7txc7aiyrn0xre1v 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=weleqrymzu42zc1d7txc7aiyrn0xre1v 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state: setting s->obj_tag to 8we8nuwbrtskm33q3hrjdtujlyha5fxu 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state_impl: setting s->olh_tag to nq8839ow9nomucieawkvahx8mm3388oi 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nq8839ow9nomucieawkvahx8mm3388oi 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state: setting s->obj_tag to jc5p8gt8qosxtirlq3crpdzm27d5cxv9 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state_impl: setting s->olh_tag to 2sft5g04vapk50a7n8ftndk9lzvrortb 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2sft5g04vapk50a7n8ftndk9lzvrortb 2024-09-12T00:13:10.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state: setting s->obj_tag to vcvnc8x2i1v06x100bk0ie15t49wolkp 2024-09-12T00:13:10.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 get_obj_state_impl: setting s->olh_tag to mi6czl9gfyngokcwsmz9140ee4lsqe0k 2024-09-12T00:13:10.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.764+0000 7f99bbe779c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mi6czl9gfyngokcwsmz9140ee4lsqe0k 2024-09-12T00:13:10.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.768+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:10.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.772+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:10.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.772+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:10.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.772+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:10.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.772+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:10.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.772+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:10.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.772+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:10.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.772+0000 7f99bbe779c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:13:10.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.772+0000 7f99bbe779c0 20 olh_log_entry: epoch=2 op=3 key=f[Zgfko0X.tBtJErwXJik5Cw0y6AFG2Cu] 2024-09-12T00:13:10.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.772+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d343c4b7f0 obj=check-bucket:_:Zgfko0X.tBtJErwXJik5Cw0y6AFG2Cu_f state=0x55d343cde318 s->prefetch_data=0 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 olh_log_entry: epoch=2 op=3 key=e[7pDNS8.uGw3ffFJw0LCJWGZMOO9SntG] 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d34399cee0 obj=check-bucket:_:7pDNS8.uGw3ffFJw0LCJWGZMOO9SntG_e state=0x55d343cf92b8 s->prefetch_data=0 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 10 manifest: total_size = 22 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2281396273154116126 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d343c4b7f0 obj=check-bucket:_:Zgfko0X.tBtJErwXJik5Cw0y6AFG2Cu_f state=0x55d343cde318 s->prefetch_data=0 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 prepare_atomic_modification: state is not atomic. state=0x55d343cde318 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 olh_log_entry: epoch=3 op=3 key=d[6vGf1NLVxaGjYt9UzlWh7PuPso6ljg.] 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d3439aeb50 obj=check-bucket:_:6vGf1NLVxaGjYt9UzlWh7PuPso6ljg._d state=0x55d343ce2118 s->prefetch_data=0 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:10.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 10 manifest: total_size = 22 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10849923905789124654 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d34399cee0 obj=check-bucket:_:7pDNS8.uGw3ffFJw0LCJWGZMOO9SntG_e state=0x55d343cf92b8 s->prefetch_data=0 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 prepare_atomic_modification: state is not atomic. state=0x55d343cf92b8 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 10 manifest: total_size = 11 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13639796114868777116 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d3439aeb50 obj=check-bucket:_:6vGf1NLVxaGjYt9UzlWh7PuPso6ljg._d state=0x55d343ce2118 s->prefetch_data=0 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 prepare_atomic_modification: state is not atomic. state=0x55d343ce2118 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 olh_log_entry: epoch=3 op=3 key=c[NGKI3G9.qx3RXqRynX8tG5HbKvtcE-h] 2024-09-12T00:13:10.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d343c50770 obj=check-bucket:_:NGKI3G9.qx3RXqRynX8tG5HbKvtcE-h_c state=0x55d343d107b8 s->prefetch_data=0 2024-09-12T00:13:10.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 10 manifest: total_size = 22 2024-09-12T00:13:10.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11683174779213530490 2024-09-12T00:13:10.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d343c50770 obj=check-bucket:_:NGKI3G9.qx3RXqRynX8tG5HbKvtcE-h_c state=0x55d343d107b8 s->prefetch_data=0 2024-09-12T00:13:10.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 prepare_atomic_modification: state is not atomic. state=0x55d343d107b8 2024-09-12T00:13:10.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.776+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:10.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.780+0000 7f99bbe779c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:13:10.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.780+0000 7f99bbe779c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:13:10.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.780+0000 7f99bbe779c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:13:10.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.780+0000 7f99bbe779c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2__shadow:Zgfko0X.tBtJErwXJik5Cw0y6AFG2Cu_.Odeh5phKNrv_MYlv2TlcZJBKKTp7nrO_0 2024-09-12T00:13:10.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:13:10.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:13:10.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:13:10.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2__shadow:6vGf1NLVxaGjYt9UzlWh7PuPso6ljg._.DYUtoN5_2MP_simocNrX9at-icQIgYI_0 2024-09-12T00:13:10.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:13:10.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:13:10.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:13:10.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2__shadow:7pDNS8.uGw3ffFJw0LCJWGZMOO9SntG_.vUgB6bUepR1rbTtb4EwvRBYBCn2QNDa_0 2024-09-12T00:13:10.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:13:10.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:13:10.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:13:10.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f99bbe779c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2__shadow:NGKI3G9.qx3RXqRynX8tG5HbKvtcE-h_.mn2X4BApeTN2N9p-keZaJUmH_CUXodo_0 2024-09-12T00:13:10.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.784+0000 7f989d7fa640 20 handle_completion(): completion ok for obj=f[Zgfko0X.tBtJErwXJik5Cw0y6AFG2Cu] 2024-09-12T00:13:10.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.788+0000 7f989cff9640 20 handle_completion(): completion ok for obj=e[7pDNS8.uGw3ffFJw0LCJWGZMOO9SntG] 2024-09-12T00:13:10.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.788+0000 7f99bbe779c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:13:10.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.792+0000 7f99bbe779c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:13:10.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.792+0000 7f99bbe779c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:13:10.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.792+0000 7f989cff9640 20 handle_completion(): completion ok for obj=d[6vGf1NLVxaGjYt9UzlWh7PuPso6ljg.] 2024-09-12T00:13:10.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.792+0000 7f99bbe779c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:13:10.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.792+0000 7f989cff9640 20 handle_completion(): completion ok for obj=c[NGKI3G9.qx3RXqRynX8tG5HbKvtcE-h] 2024-09-12T00:13:10.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.796+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d343c4b7f0 obj=check-bucket:f state=0x55d343c4bfb8 s->prefetch_data=0 2024-09-12T00:13:10.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.796+0000 7f99bbe779c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mi6czl9gfyngokcwsmz9140ee4lsqe0k 2024-09-12T00:13:10.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.796+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:10.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.796+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:10.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.800+0000 7f99bbe779c0 20 get_obj_state: octx=0x55d34399cee0 obj=check-bucket:e state=0x55d343c4e678 s->prefetch_data=0 2024-09-12T00:13:10.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.800+0000 7f99bbe779c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=weleqrymzu42zc1d7txc7aiyrn0xre1v 2024-09-12T00:13:10.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.800+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:10.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.800+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:10.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.804+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.5 2024-09-12T00:13:10.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.804+0000 7f99bbe779c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:13:10.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.804+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.8 2024-09-12T00:13:10.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.804+0000 7f99bbe779c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:13:10.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.812+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:10.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.812+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:10.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.812+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.10 2024-09-12T00:13:10.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.812+0000 7f99bbe779c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:13:10.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.812+0000 7f99bbe779c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2.1 2024-09-12T00:13:10.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.816+0000 7f99bbe779c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:13:10.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.816+0000 7f99bbe779c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:13:10.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.816+0000 7f986b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:10.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.820+0000 7f99bbe779c0 20 remove_watcher() i=0 2024-09-12T00:13:10.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.820+0000 7f99bbe779c0 2 removed watcher, disabling cache 2024-09-12T00:13:10.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.820+0000 7f99bbe779c0 20 remove_watcher() i=1 2024-09-12T00:13:10.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.824+0000 7f99bbe779c0 20 remove_watcher() i=2 2024-09-12T00:13:10.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.828+0000 7f99bbe779c0 20 remove_watcher() i=3 2024-09-12T00:13:10.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.828+0000 7f99bbe779c0 20 remove_watcher() i=4 2024-09-12T00:13:10.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.832+0000 7f99bbe779c0 20 remove_watcher() i=5 2024-09-12T00:13:10.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.832+0000 7f99bbe779c0 20 remove_watcher() i=6 2024-09-12T00:13:10.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:10.832+0000 7f99bbe779c0 20 remove_watcher() i=7 2024-09-12T00:13:10.851 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:10.851 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:10.912 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:10.912 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:11.422 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:13:11.455 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:11.455 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:11.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.500+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.500+0000 7f2141a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.500+0000 7f2141a6d9c0 20 realm 2024-09-12T00:13:11.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.500+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.504+0000 7f2141a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.504+0000 7f2141a6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:11.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.504+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.504+0000 7f2141a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.504+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.504+0000 7f2141a6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:11.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.504+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.504+0000 7f2141a6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:11.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.504+0000 7f2141a6d9c0 20 searching for the correct realm 2024-09-12T00:13:11.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.508+0000 7f213fd74640 0 -- 172.21.15.102:0/1480937197 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f21340ec030 msgr2=0x7f2134137220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:11.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.516+0000 7f213ed72640 0 -- 172.21.15.102:0/1480937197 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f213806bb80 msgr2=0x7f2138068780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:11.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:13:11.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:11.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:11.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:13:11.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:11.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:11.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:11.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.732+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:11.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 zone default found 2024-09-12T00:13:11.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 4 Realm: () 2024-09-12T00:13:11.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:13:11.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:13:11.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:11.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 zonegroup default 2024-09-12T00:13:11.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 started sync module instance, tier type = 2024-09-12T00:13:11.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.736+0000 7f2141a6d9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:13:11.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.760+0000 7f2141a6d9c0 20 add_watcher() i=0 2024-09-12T00:13:11.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.760+0000 7f2141a6d9c0 20 add_watcher() i=1 2024-09-12T00:13:11.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.760+0000 7f2141a6d9c0 20 add_watcher() i=2 2024-09-12T00:13:11.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.760+0000 7f2141a6d9c0 20 add_watcher() i=3 2024-09-12T00:13:11.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.760+0000 7f2141a6d9c0 20 add_watcher() i=4 2024-09-12T00:13:11.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.760+0000 7f2141a6d9c0 20 add_watcher() i=5 2024-09-12T00:13:11.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.764+0000 7f2141a6d9c0 20 add_watcher() i=6 2024-09-12T00:13:11.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.764+0000 7f2141a6d9c0 20 add_watcher() i=7 2024-09-12T00:13:11.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.764+0000 7f2141a6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:11.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.768+0000 7f1ff5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:11.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.768+0000 7f2141a6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:11.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.768+0000 7f2141a6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:11.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.768+0000 7f2141a6d9c0 5 note: GC not initialized 2024-09-12T00:13:11.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.768+0000 7f1ff4fe1640 20 reqs_thread_entry: start 2024-09-12T00:13:11.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:11.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 Filter name: none 2024-09-12T00:13:11.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f1f6e7fc640 20 reqs_thread_entry: start 2024-09-12T00:13:11.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:11.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:11.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:11.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:11.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:11.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.772+0000 7f2141a6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:11.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.776+0000 7f1ff5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:11.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.780+0000 7f2141a6d9c0 20 remove_watcher() i=0 2024-09-12T00:13:11.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.780+0000 7f2141a6d9c0 2 removed watcher, disabling cache 2024-09-12T00:13:11.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.784+0000 7f2141a6d9c0 20 remove_watcher() i=1 2024-09-12T00:13:11.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.788+0000 7f2141a6d9c0 20 remove_watcher() i=2 2024-09-12T00:13:11.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.788+0000 7f2141a6d9c0 20 remove_watcher() i=3 2024-09-12T00:13:11.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.792+0000 7f2141a6d9c0 20 remove_watcher() i=4 2024-09-12T00:13:11.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.792+0000 7f2141a6d9c0 20 remove_watcher() i=5 2024-09-12T00:13:11.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.792+0000 7f2141a6d9c0 20 remove_watcher() i=6 2024-09-12T00:13:11.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:13:11.796+0000 7f2141a6d9c0 20 remove_watcher() i=7 2024-09-12T00:13:11.811 INFO:tasks.workunit.client.0.smithi102.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:13:11.811 INFO:tasks.workunit.client.0.smithi102.stderr:Deleting bucket check-bucket 2024-09-12T00:13:11.813 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:11.813 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:11.861 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:13:11.862 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:13:12.415 INFO:tasks.workunit.client.0.smithi102.stderr:Completed bucket check tests 2024-09-12T00:13:12.415 INFO:tasks.workunit.client.0.smithi102.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:13:12.416 INFO:tasks.workunit.client.0.smithi102.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:13:12.416 INFO:tasks.workunit.client.0.smithi102.stdout:connected to https://localhost:443 2024-09-12T00:13:12.511 INFO:tasks.workunit.client.0.smithi102.stderr:+ deactivate 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ export PATH 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n '' ']' 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ hash -r 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n '' ']' 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:13:12.512 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:13:12.513 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset -f deactivate 2024-09-12T00:13:12.513 INFO:tasks.workunit.client.0.smithi102.stderr:+ echo OK. 2024-09-12T00:13:12.513 INFO:tasks.workunit.client.0.smithi102.stdout:OK. 2024-09-12T00:13:12.515 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:13:12.515 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:13:12.528 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:13:12.528 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:13:12.963 DEBUG:teuthology.parallel:result is None 2024-09-12T00:13:12.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:13:12.976 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:13:12.976 DEBUG:teuthology.orchestra.run.smithi102:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:13.023 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:13:13.023 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:13:13.038 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:13:13.038 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:13:13.039 DEBUG:teuthology.orchestra.run.smithi102:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:13.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:13.071 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:13:13.071 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:13.119 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:13.120 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:13:13.167 INFO:tasks.workunit:timeout=3h 2024-09-12T00:13:13.167 INFO:tasks.workunit:cleanup=True 2024-09-12T00:13:13.168 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:13:13.221 INFO:tasks.workunit.client.0.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:13:55.986 INFO:tasks.workunit.client.0.smithi102.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:13:55.987 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:55.987 INFO:tasks.workunit.client.0.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:13:55.987 INFO:tasks.workunit.client.0.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:13:55.987 INFO:tasks.workunit.client.0.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:13:55.987 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:55.987 INFO:tasks.workunit.client.0.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:13:55.987 INFO:tasks.workunit.client.0.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:13:55.987 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:55.988 INFO:tasks.workunit.client.0.smithi102.stderr: git switch -c 2024-09-12T00:13:55.988 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:55.988 INFO:tasks.workunit.client.0.smithi102.stderr:Or undo this operation with: 2024-09-12T00:13:55.988 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:55.988 INFO:tasks.workunit.client.0.smithi102.stderr: git switch - 2024-09-12T00:13:55.988 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:55.988 INFO:tasks.workunit.client.0.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:13:55.988 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:13:55.988 INFO:tasks.workunit.client.0.smithi102.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:13:55.994 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:13:56.048 INFO:tasks.workunit.client.0.smithi102.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:13:56.051 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:13:56.051 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:13:56.107 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:13:56.162 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:13:56.205 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:13:56.206 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:13:56.207 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:13:56.251 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:13:56.254 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:13:56.255 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:13:56.302 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:13:56.303 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:13:56.304 DEBUG:teuthology.orchestra.run.smithi102:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:13:56.364 INFO:tasks.workunit.client.0.smithi102.stdout:Running main() from gmock_main.cc 2024-09-12T00:13:56.365 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:13:56.365 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:13:56.365 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:13:56.365 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:13:58.446 INFO:tasks.workunit.client.0.smithi102.stdout:lock: mylock 2024-09-12T00:13:58.446 INFO:tasks.workunit.client.0.smithi102.stdout: lock_type: exclusive 2024-09-12T00:13:58.446 INFO:tasks.workunit.client.0.smithi102.stdout: tag: 2024-09-12T00:13:58.446 INFO:tasks.workunit.client.0.smithi102.stdout: lockers: 2024-09-12T00:13:58.446 INFO:tasks.workunit.client.0.smithi102.stdout: client.5151 expiration=2024-09-12T00:15:58.442515+0000 addr=v1:172.21.15.102:0/2453850429 cookie= 2024-09-12T00:13:58.453 INFO:tasks.workunit.client.0.smithi102.stdout:lock: mylock 2024-09-12T00:13:58.453 INFO:tasks.workunit.client.0.smithi102.stdout: lock_type: shared 2024-09-12T00:13:58.453 INFO:tasks.workunit.client.0.smithi102.stdout: tag: 2024-09-12T00:13:58.453 INFO:tasks.workunit.client.0.smithi102.stdout: lockers: 2024-09-12T00:13:58.453 INFO:tasks.workunit.client.0.smithi102.stdout: client.5151 expiration=2024-09-12T00:15:58.453928+0000 addr=v1:172.21.15.102:0/2453850429 cookie= 2024-09-12T00:13:58.453 INFO:tasks.workunit.client.0.smithi102.stdout: client.5160 expiration=0.000000 addr=v1:172.21.15.102:0/3615705000 cookie= 2024-09-12T00:13:58.455 INFO:tasks.workunit.client.0.smithi102.stdout:lock: mylock 2024-09-12T00:13:58.455 INFO:tasks.workunit.client.0.smithi102.stdout: lock_type: shared 2024-09-12T00:13:58.455 INFO:tasks.workunit.client.0.smithi102.stdout: tag: 2024-09-12T00:13:58.456 INFO:tasks.workunit.client.0.smithi102.stdout: lockers: 2024-09-12T00:13:58.456 INFO:tasks.workunit.client.0.smithi102.stdout: client.5160 expiration=0.000000 addr=v1:172.21.15.102:0/3615705000 cookie= 2024-09-12T00:13:59.397 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestMultiLocking (3033 ms) 2024-09-12T00:13:59.397 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:14:01.690 INFO:tasks.workunit.client.0.smithi102.stdout:lock: mylock 2024-09-12T00:14:01.690 INFO:tasks.workunit.client.0.smithi102.stdout: lock_type: shared 2024-09-12T00:14:01.690 INFO:tasks.workunit.client.0.smithi102.stdout: tag: 2024-09-12T00:14:01.690 INFO:tasks.workunit.client.0.smithi102.stdout: lockers: 2024-09-12T00:14:01.691 INFO:tasks.workunit.client.0.smithi102.stdout: client.4979 expiration=0.000000 addr=v1:172.21.15.102:0/4195782308 cookie= 2024-09-12T00:14:01.698 INFO:tasks.workunit.client.0.smithi102.stdout:lock: mylock 2024-09-12T00:14:01.698 INFO:tasks.workunit.client.0.smithi102.stdout: lock_type: exclusive 2024-09-12T00:14:01.698 INFO:tasks.workunit.client.0.smithi102.stdout: tag: new_tag 2024-09-12T00:14:01.698 INFO:tasks.workunit.client.0.smithi102.stdout: lockers: 2024-09-12T00:14:01.698 INFO:tasks.workunit.client.0.smithi102.stdout: client.4973 expiration=0.000000 addr=v1:172.21.15.102:0/145537173 cookie= 2024-09-12T00:14:02.416 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestMeta (3019 ms) 2024-09-12T00:14:02.417 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:14:04.496 INFO:tasks.workunit.client.0.smithi102.stdout:lock: mylock 2024-09-12T00:14:04.496 INFO:tasks.workunit.client.0.smithi102.stdout: lock_type: exclusive 2024-09-12T00:14:04.496 INFO:tasks.workunit.client.0.smithi102.stdout: tag: 2024-09-12T00:14:04.496 INFO:tasks.workunit.client.0.smithi102.stdout: lockers: 2024-09-12T00:14:04.500 INFO:tasks.workunit.client.0.smithi102.stdout:lock: mylock 2024-09-12T00:14:04.500 INFO:tasks.workunit.client.0.smithi102.stdout: lock_type: shared 2024-09-12T00:14:04.500 INFO:tasks.workunit.client.0.smithi102.stdout: tag: 2024-09-12T00:14:04.501 INFO:tasks.workunit.client.0.smithi102.stdout: lockers: 2024-09-12T00:14:04.501 INFO:tasks.workunit.client.0.smithi102.stdout: client.4985 expiration=0.000000 addr=v1:172.21.15.102:0/1900714535 cookie= 2024-09-12T00:14:04.501 INFO:tasks.workunit.client.0.smithi102.stdout: client.4985 expiration=0.000000 addr=v1:172.21.15.102:0/1900714535 cookie=new cookie 2024-09-12T00:14:05.462 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestCookie (3046 ms) 2024-09-12T00:14:05.462 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:14:08.482 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestMultipleLocks (3019 ms) 2024-09-12T00:14:08.486 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:14:15.650 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestLockDuration (7167 ms) 2024-09-12T00:14:15.650 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:14:18.657 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestAssertLocked (3007 ms) 2024-09-12T00:14:18.657 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:14:21.716 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestSetCookie (3060 ms) 2024-09-12T00:14:21.716 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:14:42.297 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestRenew (20581 ms) 2024-09-12T00:14:42.298 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:14:48.407 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6110 ms) 2024-09-12T00:14:48.407 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:14:55.480 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7073 ms) 2024-09-12T00:14:55.480 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:15:03.284 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7804 ms) 2024-09-12T00:15:03.284 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 11 tests from ClsLock (66920 ms total) 2024-09-12T00:15:03.284 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:15:03.285 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:15:03.285 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 11 tests from 1 test suite ran. (66920 ms total) 2024-09-12T00:15:03.285 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 11 tests. 2024-09-12T00:15:03.293 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:15:03.293 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:15:03.351 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:15:03.353 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:15:03.353 DEBUG:teuthology.orchestra.run.smithi102:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:15:03.419 INFO:tasks.workunit.client.0.smithi102.stdout:Running main() from gmock_main.cc 2024-09-12T00:15:03.420 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:15:03.420 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:15:03.420 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 4 tests from cls_log 2024-09-12T00:15:03.420 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:15:06.308 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_log.test_log_add_same_time (2888 ms) 2024-09-12T00:15:06.308 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:15:09.352 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_log.test_log_add_different_time (3044 ms) 2024-09-12T00:15:09.352 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:15:12.359 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_log.trim_by_time (3008 ms) 2024-09-12T00:15:12.359 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:15:15.420 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_log.trim_by_marker (3061 ms) 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 4 tests from cls_log (12001 ms total) 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 4 tests from 1 test suite ran. (12001 ms total) 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 4 tests. 2024-09-12T00:15:15.424 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:15:15.425 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:15:15.479 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:15:15.480 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:15:15.480 DEBUG:teuthology.orchestra.run.smithi102:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:15:15.549 INFO:tasks.workunit.client.0.smithi102.stdout:Running main() from gmock_main.cc 2024-09-12T00:15:15.549 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:15:15.549 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:15:15.549 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:15:15.549 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:15:18.438 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_refcount.test_implicit (2878 ms) 2024-09-12T00:15:18.438 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:15:21.463 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3036 ms) 2024-09-12T00:15:21.463 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:15:30.339 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_refcount.test_put_snap (8877 ms) 2024-09-12T00:15:30.340 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:15:33.364 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_refcount.test_explicit (3024 ms) 2024-09-12T00:15:33.364 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:15:36.394 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_refcount.set (3031 ms) 2024-09-12T00:15:36.395 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:15:43.467 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_refcount.test_implicit_ec (7073 ms) 2024-09-12T00:15:43.467 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:15:50.529 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7058 ms) 2024-09-12T00:15:50.529 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:16:02.683 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_refcount.test_put_snap_ec (12157 ms) 2024-09-12T00:16:02.683 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:16:09.771 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_refcount.test_explicit_ec (7089 ms) 2024-09-12T00:16:09.772 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:16:16.845 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_refcount.set_ec (7074 ms) 2024-09-12T00:16:16.845 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 10 tests from cls_refcount (61297 ms total) 2024-09-12T00:16:16.845 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:16:16.845 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:16:16.845 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 10 tests from 1 test suite ran. (61297 ms total) 2024-09-12T00:16:16.845 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 10 tests. 2024-09-12T00:16:16.849 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:16:16.849 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:16:16.906 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:16:16.907 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:16:16.907 DEBUG:teuthology.orchestra.run.smithi102:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:16:16.971 INFO:tasks.workunit.client.0.smithi102.stdout:Running main() from gmock_main.cc 2024-09-12T00:16:16.971 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:16:16.971 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:16:16.971 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:16:18.847 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:16:18.927 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.index_basic (80 ms) 2024-09-12T00:16:18.928 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:16:19.005 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (77 ms) 2024-09-12T00:16:19.005 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:16:19.117 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.index_remove_object (113 ms) 2024-09-12T00:16:19.118 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:16:21.528 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.index_suggest (2410 ms) 2024-09-12T00:16:21.529 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:16:21.542 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.index_suggest_complete (14 ms) 2024-09-12T00:16:21.542 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:16:21.616 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.index_list (73 ms) 2024-09-12T00:16:21.616 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:17:05.597 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.index_list_delimited (43981 ms) 2024-09-12T00:17:05.598 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:17:05.762 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.bi_list (165 ms) 2024-09-12T00:17:05.762 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:17:05.787 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.gc_set (25 ms) 2024-09-12T00:17:05.787 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:17:05.814 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.gc_list (26 ms) 2024-09-12T00:17:05.814 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:17:13.446 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.gc_defer (7633 ms) 2024-09-12T00:17:13.446 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:17:13.862 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.usage_basic (416 ms) 2024-09-12T00:17:13.862 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:17:13.864 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-09-12T00:17:13.864 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:17:14.078 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.usage_clear (213 ms) 2024-09-12T00:17:14.078 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:17:14.199 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.bi_log_trim (121 ms) 2024-09-12T00:17:14.199 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:17:14.232 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.index_racing_removes (32 ms) 2024-09-12T00:17:14.232 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:17:14.265 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.reshardlog_list (34 ms) 2024-09-12T00:17:14.265 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:17:14.289 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.reshardlog_num (24 ms) 2024-09-12T00:17:14.289 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:17:14.348 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw.bi_put_entries (59 ms) 2024-09-12T00:17:14.469 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 19 tests from cls_rgw (55501 ms total) 2024-09-12T00:17:14.469 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:17:14.470 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:17:14.470 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 19 tests from 1 test suite ran. (57499 ms total) 2024-09-12T00:17:14.470 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 19 tests. 2024-09-12T00:17:14.481 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:17:14.481 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:17:14.535 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:17:14.537 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:17:14.537 DEBUG:teuthology.orchestra.run.smithi102:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:17:14.603 INFO:tasks.workunit.client.0.smithi102.stdout:Running main() from gmock_main.cc 2024-09-12T00:17:14.603 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:17:14.603 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:17:14.603 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:17:14.604 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:17:16.470 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw_gc.init (1867 ms) 2024-09-12T00:17:16.471 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:17:16.514 INFO:tasks.workunit.client.0.smithi102.stderr:[ ] list info tag = chain-0 2024-09-12T00:17:16.514 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (44 ms) 2024-09-12T00:17:16.514 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:17:16.525 INFO:tasks.workunit.client.0.smithi102.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:17:16.525 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (11 ms) 2024-09-12T00:17:16.525 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:17:16.540 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (15 ms) 2024-09-12T00:17:16.540 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:17:16.624 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (84 ms) 2024-09-12T00:17:16.624 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:17:16.643 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (19 ms) 2024-09-12T00:17:16.643 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:17:16.661 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (18 ms) 2024-09-12T00:17:16.662 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:17:16.679 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (18 ms) 2024-09-12T00:17:16.679 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:17:17.509 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw_gc.finalize (830 ms) 2024-09-12T00:17:17.509 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 9 tests from cls_rgw_gc (2906 ms total) 2024-09-12T00:17:17.509 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:17:17.509 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:17:17.510 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 9 tests from 1 test suite ran. (2906 ms total) 2024-09-12T00:17:17.510 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 9 tests. 2024-09-12T00:17:17.514 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:17:17.514 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:17:17.569 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:17:17.570 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:17:17.571 DEBUG:teuthology.orchestra.run.smithi102:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:17:17.645 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:17.646 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:17.646 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:17:17.646 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:17:19.524 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:17:19.524 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:17:19.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.550+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=BTSO14T3YB1Y type=write size=32278 2024-09-12T00:17:19.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.554+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~N8BRDCF8KMXH.0 size=1048576 2024-09-12T00:17:19.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.554+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~N8BRDCF8KMXH.1 size=1048576 2024-09-12T00:17:19.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.558+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~N8BRDCF8KMXH.2 size=408446 2024-09-12T00:17:19.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.558+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=N8BRDCF8KMXH tag=O9J6P21LKIPU type=write size=3554174 2024-09-12T00:17:19.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.558+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=IRBN3YFEJ9IE type=del size=3482122 2024-09-12T00:17:19.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.562+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~R3MSRN1SQHQH.0 size=1048576 2024-09-12T00:17:19.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.562+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~R3MSRN1SQHQH.1 size=389670 2024-09-12T00:17:19.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.562+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=R3MSRN1SQHQH tag=OAZ1AF3CPITX type=write size=2486822 2024-09-12T00:17:19.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.566+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=IUWO0E0RS5K6 type=del size=429370 2024-09-12T00:17:19.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.566+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=UU8DH50HG31H type=del size=2500296 2024-09-12T00:17:19.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.570+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=YYRRQ34ZE02N type=write size=315429 2024-09-12T00:17:19.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.570+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=POCVPXCR25S7 type=del size=3474132 2024-09-12T00:17:19.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.574+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=2UV351AEDY4D type=del size=3564608 2024-09-12T00:17:19.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.574+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=QG7KCZQCKWCF type=del size=1058368 2024-09-12T00:17:19.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.578+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=IJ0VYVDU5P1W type=del size=167079 2024-09-12T00:17:19.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.578+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=4SBQ5C0XSFUH type=write size=504018 2024-09-12T00:17:19.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.582+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~ZH75SAPNC3NW.0 size=1048576 2024-09-12T00:17:19.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.582+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~ZH75SAPNC3NW.1 size=1048576 2024-09-12T00:17:19.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.586+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~ZH75SAPNC3NW.2 size=473457 2024-09-12T00:17:19.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.586+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=ZH75SAPNC3NW tag=LE6H2365OSED type=write size=3619185 2024-09-12T00:17:19.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.586+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~060GRNKNCG1F.0 size=1048576 2024-09-12T00:17:19.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.590+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~060GRNKNCG1F.1 size=332208 2024-09-12T00:17:19.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.590+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=060GRNKNCG1F tag=ZZFZ0MX870Y2 type=write size=2429360 2024-09-12T00:17:19.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.594+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~0U496GAFE7WI.0 size=14810 2024-09-12T00:17:19.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.594+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=0U496GAFE7WI tag=TGE6D01MNZUU type=write size=1063386 2024-09-12T00:17:19.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.598+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~2020160JFTBO.0 size=1048576 2024-09-12T00:17:19.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.602+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~2020160JFTBO.1 size=1048576 2024-09-12T00:17:19.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.602+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~2020160JFTBO.2 size=899336 2024-09-12T00:17:19.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.602+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=2020160JFTBO tag=XHDBDZQ36JH0 type=write size=4045064 2024-09-12T00:17:19.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.606+0000 7febed3678c0 1 < completed write operation key=52SSW5KTCS15 tag=BTSO14T3YB1Y type=write size=32278 2024-09-12T00:17:19.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.610+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~1TRSMLV5067T.0 size=1048576 2024-09-12T00:17:19.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.614+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~1TRSMLV5067T.1 size=244749 2024-09-12T00:17:19.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.614+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=1TRSMLV5067T tag=GYZ9FNDVURLN type=write size=2341901 2024-09-12T00:17:19.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.618+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~N8BRDCF8KMXH.0 size=1048576 2024-09-12T00:17:19.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.618+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~N8BRDCF8KMXH.1 size=1048576 2024-09-12T00:17:19.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.622+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~N8BRDCF8KMXH.2 size=408446 2024-09-12T00:17:19.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.626+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=N8BRDCF8KMXH tag=O9J6P21LKIPU type=write size=3554174 2024-09-12T00:17:19.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.630+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=N191462JQK3J type=del size=3554715 2024-09-12T00:17:19.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.634+0000 7febed3678c0 1 < suggested remove operation key=AHTIFXX3SGK7 tag=IRBN3YFEJ9IE type=del 2024-09-12T00:17:19.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.638+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=HT480Q6KJU4L type=del size=4041398 2024-09-12T00:17:19.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.638+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~R3MSRN1SQHQH.0 size=1048576 2024-09-12T00:17:19.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.642+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~R3MSRN1SQHQH.1 size=389670 2024-09-12T00:17:19.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.646+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=R3MSRN1SQHQH tag=OAZ1AF3CPITX type=write size=2486822 2024-09-12T00:17:19.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.650+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~ZFPG2ACZIXFN.0 size=1048576 2024-09-12T00:17:19.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.654+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~ZFPG2ACZIXFN.1 size=1048576 2024-09-12T00:17:19.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.654+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~ZFPG2ACZIXFN.2 size=355257 2024-09-12T00:17:19.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.654+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=ZFPG2ACZIXFN tag=FT7QJ7DWVK42 type=write size=3500985 2024-09-12T00:17:19.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.658+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=IUWO0E0RS5K6 type=del 2024-09-12T00:17:19.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.662+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=DXBCADULZI1N type=del size=3535147 2024-09-12T00:17:19.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.662+0000 7febed3678c0 1 < canceled operation key=25THATWGX4WS tag=UU8DH50HG31H type=del size=2500296 2024-09-12T00:17:19.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.670+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~1MEI131UV925.0 size=21149 2024-09-12T00:17:19.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.670+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=1MEI131UV925 tag=JJLRS4TDF84Q type=write size=1069725 2024-09-12T00:17:19.674 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.674+0000 7febed3678c0 1 < suggested update operation key=LWAMFA0RSW6S tag=YYRRQ34ZE02N type=write size=315429 2024-09-12T00:17:19.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.678+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=MZRHPP7JG5O3 type=del size=2815400 2024-09-12T00:17:19.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.682+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=POCVPXCR25S7 type=del 2024-09-12T00:17:19.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.686+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~N3W85F6OYQP3.0 size=1048576 2024-09-12T00:17:19.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.690+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~N3W85F6OYQP3.1 size=1048576 2024-09-12T00:17:19.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.690+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~N3W85F6OYQP3.2 size=731883 2024-09-12T00:17:19.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.690+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=N3W85F6OYQP3 tag=S1XKIBZ5LV93 type=write size=3877611 2024-09-12T00:17:19.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.694+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=2UV351AEDY4D type=del 2024-09-12T00:17:19.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.702+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~N37QM213E23H.0 size=842774 2024-09-12T00:17:19.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.702+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=N37QM213E23H tag=T6JEB9LFF2XL type=write size=1891350 2024-09-12T00:17:19.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.702+0000 7febed3678c0 1 < canceled operation key=4K65QIB9F00S tag=QG7KCZQCKWCF type=del size=1058368 2024-09-12T00:17:19.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.706+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=8ADWLU3ZIBJ9 type=del size=1404083 2024-09-12T00:17:19.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.710+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=IJ0VYVDU5P1W type=del 2024-09-12T00:17:19.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.710+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=QDW43HSPI1KL type=del size=497252 2024-09-12T00:17:19.714 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.714+0000 7febed3678c0 1 < completed write operation key=88BY5RHXSHD4 tag=4SBQ5C0XSFUH type=write size=504018 2024-09-12T00:17:19.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.718+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=UELURWDSFOV1 type=write size=102509 2024-09-12T00:17:19.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.722+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~ZH75SAPNC3NW.0 size=1048576 2024-09-12T00:17:19.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.722+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~ZH75SAPNC3NW.1 size=1048576 2024-09-12T00:17:19.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.726+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~ZH75SAPNC3NW.2 size=473457 2024-09-12T00:17:19.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.730+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=ZH75SAPNC3NW tag=LE6H2365OSED type=write size=3619185 2024-09-12T00:17:19.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.734+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~JPURZ8AG5S5X.0 size=1048576 2024-09-12T00:17:19.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.738+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~JPURZ8AG5S5X.1 size=1048576 2024-09-12T00:17:19.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.742+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~JPURZ8AG5S5X.2 size=824417 2024-09-12T00:17:19.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.742+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=JPURZ8AG5S5X tag=LUK924ZHXTCO type=write size=3970145 2024-09-12T00:17:19.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.746+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~060GRNKNCG1F.0 size=1048576 2024-09-12T00:17:19.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.750+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~060GRNKNCG1F.1 size=332208 2024-09-12T00:17:19.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.754+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=060GRNKNCG1F tag=ZZFZ0MX870Y2 type=write size=2429360 2024-09-12T00:17:19.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.758+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~TDGEN06IM43R.0 size=1048576 2024-09-12T00:17:19.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.762+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~TDGEN06IM43R.1 size=1048576 2024-09-12T00:17:19.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.762+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~TDGEN06IM43R.2 size=252427 2024-09-12T00:17:19.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.762+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=TDGEN06IM43R tag=HZMHMXH236YN type=write size=3398155 2024-09-12T00:17:19.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.766+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~0U496GAFE7WI.0 size=14810 2024-09-12T00:17:19.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.770+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=0U496GAFE7WI tag=TGE6D01MNZUU type=write size=1063386 2024-09-12T00:17:19.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.774+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=IO1GFJZMMZ6N type=del size=260151 2024-09-12T00:17:19.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.778+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~2020160JFTBO.0 size=1048576 2024-09-12T00:17:19.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.778+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~2020160JFTBO.1 size=1048576 2024-09-12T00:17:19.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.782+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~2020160JFTBO.2 size=899336 2024-09-12T00:17:19.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.786+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=2020160JFTBO tag=XHDBDZQ36JH0 type=write size=4045064 2024-09-12T00:17:19.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.790+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=H0YC0HJXQ0UE type=del size=3115602 2024-09-12T00:17:19.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.790+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~1TRSMLV5067T.0 size=1048576 2024-09-12T00:17:19.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.794+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~1TRSMLV5067T.1 size=244749 2024-09-12T00:17:19.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.798+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=1TRSMLV5067T tag=GYZ9FNDVURLN type=write size=2341901 2024-09-12T00:17:19.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.802+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=UGUEK10MJ3Y6 type=write size=326085 2024-09-12T00:17:19.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.806+0000 7febed3678c0 1 < suggested update operation key=MHS307JKNVCK tag=N191462JQK3J type=del size=3554715 2024-09-12T00:17:19.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.810+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=9GQMY9U8PDHQ type=del size=3503530 2024-09-12T00:17:19.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.814+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=HT480Q6KJU4L type=del 2024-09-12T00:17:19.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.822+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~EDHEN5731FLY.0 size=1048576 2024-09-12T00:17:19.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.822+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~EDHEN5731FLY.1 size=1048576 2024-09-12T00:17:19.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.826+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~EDHEN5731FLY.2 size=107324 2024-09-12T00:17:19.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.826+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=EDHEN5731FLY tag=GQYMQUUL98WW type=write size=3253052 2024-09-12T00:17:19.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.826+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~ZFPG2ACZIXFN.0 size=1048576 2024-09-12T00:17:19.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.830+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~ZFPG2ACZIXFN.1 size=1048576 2024-09-12T00:17:19.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.830+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~ZFPG2ACZIXFN.2 size=355257 2024-09-12T00:17:19.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.838+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=ZFPG2ACZIXFN tag=FT7QJ7DWVK42 type=write size=3500985 2024-09-12T00:17:19.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.838+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=P86TZ15M2GMT type=write size=491806 2024-09-12T00:17:19.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.842+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=DXBCADULZI1N type=del 2024-09-12T00:17:19.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.846+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~ZAN4AAK0ZJ6Y.0 size=852986 2024-09-12T00:17:19.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.846+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=ZAN4AAK0ZJ6Y tag=H0LCMG7T23D7 type=write size=1901562 2024-09-12T00:17:19.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.850+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~1MEI131UV925.0 size=21149 2024-09-12T00:17:19.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.854+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=1MEI131UV925 tag=JJLRS4TDF84Q type=write size=1069725 2024-09-12T00:17:19.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.858+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=0E2TLULYI1CJ type=write size=102000 2024-09-12T00:17:19.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.858+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=MZRHPP7JG5O3 type=del 2024-09-12T00:17:19.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.862+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=S7YL6XLDEA49 type=del size=2000534 2024-09-12T00:17:19.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.866+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~N3W85F6OYQP3.0 size=1048576 2024-09-12T00:17:19.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.866+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~N3W85F6OYQP3.1 size=1048576 2024-09-12T00:17:19.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.870+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~N3W85F6OYQP3.2 size=731883 2024-09-12T00:17:19.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.874+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=N3W85F6OYQP3 tag=S1XKIBZ5LV93 type=write size=3877611 2024-09-12T00:17:19.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.878+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~9F31612Z9WC3.0 size=1048576 2024-09-12T00:17:19.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.882+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~9F31612Z9WC3.1 size=424404 2024-09-12T00:17:19.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.882+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=9F31612Z9WC3 tag=FL3YVL5BJW6W type=write size=2521556 2024-09-12T00:17:19.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.886+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~N37QM213E23H.0 size=842774 2024-09-12T00:17:19.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.890+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=N37QM213E23H tag=T6JEB9LFF2XL type=write size=1891350 2024-09-12T00:17:19.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.894+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=XQTHAHU7WY51 type=del size=1476436 2024-09-12T00:17:19.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.894+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=8ADWLU3ZIBJ9 type=del 2024-09-12T00:17:19.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.898+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=ISNLZQZW92DI type=write size=156449 2024-09-12T00:17:19.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.902+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=QDW43HSPI1KL type=del 2024-09-12T00:17:19.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.910+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~MVD0AR8MZFEY.0 size=1048576 2024-09-12T00:17:19.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.910+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~MVD0AR8MZFEY.1 size=208014 2024-09-12T00:17:19.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.910+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=MVD0AR8MZFEY tag=ET0LMYQIMQCX type=write size=2305166 2024-09-12T00:17:19.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.914+0000 7febed3678c0 -1 < failed to complete operation key=MHS307JKNVCK tag=UELURWDSFOV1 type=write size=102509: (22) Invalid argument 2024-09-12T00:17:19.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.922+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~5293JEFCGEE5.0 size=1048576 2024-09-12T00:17:19.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.926+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~5293JEFCGEE5.1 size=1048576 2024-09-12T00:17:19.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.926+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~5293JEFCGEE5.2 size=481990 2024-09-12T00:17:19.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.926+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=5293JEFCGEE5 tag=J79QB8PPV86M type=write size=3627718 2024-09-12T00:17:19.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.930+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~JPURZ8AG5S5X.0 size=1048576 2024-09-12T00:17:19.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.934+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~JPURZ8AG5S5X.1 size=1048576 2024-09-12T00:17:19.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.934+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~JPURZ8AG5S5X.2 size=824417 2024-09-12T00:17:19.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.942+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=JPURZ8AG5S5X tag=LUK924ZHXTCO type=write size=3970145 2024-09-12T00:17:19.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.946+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=AHOCC60AHJ43 type=del size=2452379 2024-09-12T00:17:19.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.950+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~TDGEN06IM43R.0 size=1048576 2024-09-12T00:17:19.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.950+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~TDGEN06IM43R.1 size=1048576 2024-09-12T00:17:19.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.954+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~TDGEN06IM43R.2 size=252427 2024-09-12T00:17:19.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.958+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=TDGEN06IM43R tag=HZMHMXH236YN type=write size=3398155 2024-09-12T00:17:19.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.962+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=XFF234A0G9TS type=del size=333994 2024-09-12T00:17:19.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.966+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=IO1GFJZMMZ6N type=del 2024-09-12T00:17:19.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.970+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=CLT7Z6436DI2 type=write size=645652 2024-09-12T00:17:19.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.978+0000 7febed3678c0 1 < suggested update operation key=8RVDLW1VC8LP tag=H0YC0HJXQ0UE type=del size=3115602 2024-09-12T00:17:19.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.982+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=OB8IO6CI2XAE type=del size=1531798 2024-09-12T00:17:19.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.986+0000 7febed3678c0 1 < canceled operation key=70W3V7TFBUFJ tag=UGUEK10MJ3Y6 type=write size=326085 2024-09-12T00:17:19.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.990+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~MCA19O49Q0CB.0 size=1048576 2024-09-12T00:17:19.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.994+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~MCA19O49Q0CB.1 size=1048576 2024-09-12T00:17:19.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.994+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~MCA19O49Q0CB.2 size=450963 2024-09-12T00:17:19.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:19.994+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=MCA19O49Q0CB tag=Y0C01YRXKTMF type=write size=3596691 2024-09-12T00:17:20.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.002+0000 7febed3678c0 1 < suggested update operation key=70W3V7TFBUFJ tag=9GQMY9U8PDHQ type=del size=3503530 2024-09-12T00:17:20.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.006+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=MH76GBC5BPAZ type=del size=745412 2024-09-12T00:17:20.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.006+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~EDHEN5731FLY.0 size=1048576 2024-09-12T00:17:20.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.010+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~EDHEN5731FLY.1 size=1048576 2024-09-12T00:17:20.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.010+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~EDHEN5731FLY.2 size=107324 2024-09-12T00:17:20.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.018+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=EDHEN5731FLY tag=GQYMQUUL98WW type=write size=3253052 2024-09-12T00:17:20.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.022+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~MN3CQDON7USB.0 size=1048576 2024-09-12T00:17:20.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.022+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~MN3CQDON7USB.1 size=116269 2024-09-12T00:17:20.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.022+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=MN3CQDON7USB tag=XTQ9GX5RI52N type=write size=2213421 2024-09-12T00:17:20.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.026+0000 7febed3678c0 1 < canceled operation key=W2VEW3JJEJY7 tag=P86TZ15M2GMT type=write size=491806 2024-09-12T00:17:20.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.030+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~IFSGPV15U33A.0 size=415772 2024-09-12T00:17:20.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.030+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=IFSGPV15U33A tag=GH307HJ8U1TC type=write size=1464348 2024-09-12T00:17:20.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.034+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~ZAN4AAK0ZJ6Y.0 size=852986 2024-09-12T00:17:20.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.038+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=ZAN4AAK0ZJ6Y tag=H0LCMG7T23D7 type=write size=1901562 2024-09-12T00:17:20.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.042+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=TGILTZTM4R87 type=del size=1862742 2024-09-12T00:17:20.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.046+0000 7febed3678c0 1 < completed write operation key=3G9ABEEEDRI3 tag=0E2TLULYI1CJ type=write size=102000 2024-09-12T00:17:20.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.046+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=HO2G57305YLC type=del size=4191992 2024-09-12T00:17:20.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.050+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=S7YL6XLDEA49 type=del 2024-09-12T00:17:20.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.054+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=R8M4G984N311 type=write size=901199 2024-09-12T00:17:20.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.058+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~9F31612Z9WC3.0 size=1048576 2024-09-12T00:17:20.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.058+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~9F31612Z9WC3.1 size=424404 2024-09-12T00:17:20.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.062+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=9F31612Z9WC3 tag=FL3YVL5BJW6W type=write size=2521556 2024-09-12T00:17:20.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.066+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=USP8UOIFK365 type=del size=551199 2024-09-12T00:17:20.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.070+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=XQTHAHU7WY51 type=del 2024-09-12T00:17:20.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.074+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=45SHXBUOQ7KT type=write size=953130 2024-09-12T00:17:20.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.074+0000 7febed3678c0 1 < completed write operation key=Z020UV2JRR0I tag=ISNLZQZW92DI type=write size=156449 2024-09-12T00:17:20.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.082+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~453O2DPOTXQF.0 size=1048576 2024-09-12T00:17:20.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.082+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~453O2DPOTXQF.1 size=833212 2024-09-12T00:17:20.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.082+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=453O2DPOTXQF tag=FWIR4OB1UFD5 type=write size=2930364 2024-09-12T00:17:20.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.086+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~MVD0AR8MZFEY.0 size=1048576 2024-09-12T00:17:20.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.090+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~MVD0AR8MZFEY.1 size=208014 2024-09-12T00:17:20.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.098+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=MVD0AR8MZFEY tag=ET0LMYQIMQCX type=write size=2305166 2024-09-12T00:17:20.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.102+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=PVO22TM64QRD type=del size=1102714 2024-09-12T00:17:20.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.102+0000 7febed3678c0 1 < canceled part key=_multipart_G22WTRRGIQKE.2~5293JEFCGEE5.0 size=1048576 2024-09-12T00:17:20.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.102+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~5293JEFCGEE5.1 size=1048576 2024-09-12T00:17:20.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.106+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~5293JEFCGEE5.2 size=481990 2024-09-12T00:17:20.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.110+0000 7febed3678c0 1 < canceled multipart upload key=G22WTRRGIQKE upload=5293JEFCGEE5 tag=J79QB8PPV86M type=write size=3627718 2024-09-12T00:17:20.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.118+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~3LWALLK5F47A.0 size=1048576 2024-09-12T00:17:20.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.118+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~3LWALLK5F47A.1 size=863504 2024-09-12T00:17:20.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.118+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=3LWALLK5F47A tag=N21VH65Y4C1G type=write size=2960656 2024-09-12T00:17:20.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.122+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=AHOCC60AHJ43 type=del 2024-09-12T00:17:20.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.126+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~TV54TFYH95BD.0 size=298972 2024-09-12T00:17:20.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.126+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=TV54TFYH95BD tag=CER8E7ER3L2N type=write size=1347548 2024-09-12T00:17:20.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.134+0000 7febed3678c0 1 < suggested remove operation key=MHS307JKNVCK tag=XFF234A0G9TS type=del 2024-09-12T00:17:20.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.138+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~XSC0VKY62721.0 size=1048576 2024-09-12T00:17:20.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.142+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~XSC0VKY62721.1 size=1048576 2024-09-12T00:17:20.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.142+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~XSC0VKY62721.2 size=854987 2024-09-12T00:17:20.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.142+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=XSC0VKY62721 tag=F6FLPDHLHG4M type=write size=4000715 2024-09-12T00:17:20.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.146+0000 7febed3678c0 -1 < failed to complete operation key=8RVDLW1VC8LP tag=CLT7Z6436DI2 type=write size=645652: (22) Invalid argument 2024-09-12T00:17:20.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.150+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=ABS65ZQ0CVQG type=write size=863132 2024-09-12T00:17:20.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.154+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=OB8IO6CI2XAE type=del 2024-09-12T00:17:20.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.154+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=5GEF2GZW2H6G type=del size=504578 2024-09-12T00:17:20.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.158+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~MCA19O49Q0CB.0 size=1048576 2024-09-12T00:17:20.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.158+0000 7febed3678c0 1 < canceled part key=_multipart_9CBI4FHAT3H2.2~MCA19O49Q0CB.1 size=1048576 2024-09-12T00:17:20.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.162+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~MCA19O49Q0CB.2 size=450963 2024-09-12T00:17:20.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.166+0000 7febed3678c0 1 < canceled multipart upload key=9CBI4FHAT3H2 upload=MCA19O49Q0CB tag=Y0C01YRXKTMF type=write size=3596691 2024-09-12T00:17:20.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.170+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=XUAHX99HTZOK type=del size=1516148 2024-09-12T00:17:20.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.174+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=MH76GBC5BPAZ type=del 2024-09-12T00:17:20.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.174+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=3Z0Z25AEZVB5 type=del size=2488391 2024-09-12T00:17:20.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.178+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~MN3CQDON7USB.0 size=1048576 2024-09-12T00:17:20.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.182+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~MN3CQDON7USB.1 size=116269 2024-09-12T00:17:20.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.186+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=MN3CQDON7USB tag=XTQ9GX5RI52N type=write size=2213421 2024-09-12T00:17:20.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.190+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=WTST901VB0N3 type=write size=317631 2024-09-12T00:17:20.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.194+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~IFSGPV15U33A.0 size=415772 2024-09-12T00:17:20.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.198+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=IFSGPV15U33A tag=GH307HJ8U1TC type=write size=1464348 2024-09-12T00:17:20.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.202+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=VAJ3UVGXIZIB type=del size=2306951 2024-09-12T00:17:20.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.206+0000 7febed3678c0 1 < suggested update operation key=H017KWW59B8Z tag=TGILTZTM4R87 type=del size=1862742 2024-09-12T00:17:20.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.210+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=VXLGH1FP8MJN type=write size=41038 2024-09-12T00:17:20.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.218+0000 7febed3678c0 1 < suggested update operation key=53T1415UK7GE tag=HO2G57305YLC type=del size=4191992 2024-09-12T00:17:20.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.218+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=L5IZPERNGRZ0 type=write size=965828 2024-09-12T00:17:20.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.222+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=R8M4G984N311 type=write size=901199 2024-09-12T00:17:20.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.226+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=94JISM6SWG46 type=del size=2168432 2024-09-12T00:17:20.234 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.234+0000 7febed3678c0 1 < suggested update operation key=1HABX7YZ491W tag=USP8UOIFK365 type=del size=551199 2024-09-12T00:17:20.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.238+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=LHKBRF6LC8OW type=del size=1006220 2024-09-12T00:17:20.244 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.246+0000 7febed3678c0 1 < suggested update operation key=70W3V7TFBUFJ tag=45SHXBUOQ7KT type=write size=953130 2024-09-12T00:17:20.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.250+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~BYKDS8MC7TCR.0 size=1048576 2024-09-12T00:17:20.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.254+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~BYKDS8MC7TCR.1 size=1048576 2024-09-12T00:17:20.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.254+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~BYKDS8MC7TCR.2 size=386872 2024-09-12T00:17:20.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.254+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=BYKDS8MC7TCR tag=EBP521JM0RHP type=write size=3532600 2024-09-12T00:17:20.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.258+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~453O2DPOTXQF.0 size=1048576 2024-09-12T00:17:20.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.262+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~453O2DPOTXQF.1 size=833212 2024-09-12T00:17:20.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.266+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=453O2DPOTXQF tag=FWIR4OB1UFD5 type=write size=2930364 2024-09-12T00:17:20.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.270+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~ZKSLWBZIA5P8.0 size=476798 2024-09-12T00:17:20.272 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.270+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=ZKSLWBZIA5P8 tag=NSSO37UKQTUQ type=write size=1525374 2024-09-12T00:17:20.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.274+0000 7febed3678c0 -1 < failed to complete operation key=1HABX7YZ491W tag=PVO22TM64QRD type=del size=1102714: (22) Invalid argument 2024-09-12T00:17:20.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.278+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=PWRTLF26M764 type=del size=3254960 2024-09-12T00:17:20.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.282+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~3LWALLK5F47A.0 size=1048576 2024-09-12T00:17:20.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.282+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~3LWALLK5F47A.1 size=863504 2024-09-12T00:17:20.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.286+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=3LWALLK5F47A tag=N21VH65Y4C1G type=write size=2960656 2024-09-12T00:17:20.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.290+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=7K1BOSHBL87O type=del size=1671252 2024-09-12T00:17:20.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.294+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~TV54TFYH95BD.0 size=298972 2024-09-12T00:17:20.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.298+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=TV54TFYH95BD tag=CER8E7ER3L2N type=write size=1347548 2024-09-12T00:17:20.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.298+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=RMCZ05MD13ZV type=del size=399445 2024-09-12T00:17:20.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.302+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~XSC0VKY62721.0 size=1048576 2024-09-12T00:17:20.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.306+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~XSC0VKY62721.1 size=1048576 2024-09-12T00:17:20.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.306+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~XSC0VKY62721.2 size=854987 2024-09-12T00:17:20.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.314+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=XSC0VKY62721 tag=F6FLPDHLHG4M type=write size=4000715 2024-09-12T00:17:20.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.318+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~YOQZYATX56PG.0 size=1048576 2024-09-12T00:17:20.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.322+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~YOQZYATX56PG.1 size=1048576 2024-09-12T00:17:20.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.322+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~YOQZYATX56PG.2 size=445762 2024-09-12T00:17:20.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.322+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=YOQZYATX56PG tag=3OE7XSMERZLA type=write size=3591490 2024-09-12T00:17:20.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.326+0000 7febed3678c0 1 < completed write operation key=8RVDLW1VC8LP tag=ABS65ZQ0CVQG type=write size=863132 2024-09-12T00:17:20.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.330+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=O2Q2JR2KJB2H type=write size=192857 2024-09-12T00:17:20.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.338+0000 7febed3678c0 1 < suggested remove operation key=1HABX7YZ491W tag=5GEF2GZW2H6G type=del 2024-09-12T00:17:20.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.342+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~8MG8G01C4HNQ.0 size=294190 2024-09-12T00:17:20.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.342+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=8MG8G01C4HNQ tag=SM1T8P4ASFXN type=write size=1342766 2024-09-12T00:17:20.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.346+0000 7febed3678c0 -1 < failed to complete operation key=53T1415UK7GE tag=XUAHX99HTZOK type=del size=1516148: (22) Invalid argument 2024-09-12T00:17:20.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.350+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~T273JOH1M5UC.0 size=629532 2024-09-12T00:17:20.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.350+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=T273JOH1M5UC tag=PKOSJXWKGHVN type=write size=1678108 2024-09-12T00:17:20.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.358+0000 7febed3678c0 1 < suggested remove operation key=ASFLGSKWYHG5 tag=3Z0Z25AEZVB5 type=del 2024-09-12T00:17:20.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.358+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=1GYSD8YIZAM7 type=del size=1883657 2024-09-12T00:17:20.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.366+0000 7febed3678c0 1 < suggested remove operation key=UGV3WQR0ADYH tag=WTST901VB0N3 type=write 2024-09-12T00:17:20.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.370+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=BCY5HT0EGRP7 type=del size=3555831 2024-09-12T00:17:20.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.370+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=VAJ3UVGXIZIB type=del 2024-09-12T00:17:20.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.374+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=LO7F0ZAR5LTE type=del size=3304690 2024-09-12T00:17:20.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.378+0000 7febed3678c0 -1 < failed to complete operation key=UGV3WQR0ADYH tag=VXLGH1FP8MJN type=write size=41038: (22) Invalid argument 2024-09-12T00:17:20.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.382+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=YYFCA8WZS4K3 type=del size=504779 2024-09-12T00:17:20.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.386+0000 7febed3678c0 1 < completed write operation key=AHTIFXX3SGK7 tag=L5IZPERNGRZ0 type=write size=965828 2024-09-12T00:17:20.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.390+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=HR6A9VCK4PDU type=write size=82680 2024-09-12T00:17:20.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.394+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=94JISM6SWG46 type=del 2024-09-12T00:17:20.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.398+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=EXVDE81VQRZO type=del size=2225695 2024-09-12T00:17:20.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.402+0000 7febed3678c0 1 < suggested update operation key=KABJD0GYBVF4 tag=LHKBRF6LC8OW type=del size=1006220 2024-09-12T00:17:20.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.406+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=HLLM05JXKQV9 type=del size=977115 2024-09-12T00:17:20.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.410+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~BYKDS8MC7TCR.0 size=1048576 2024-09-12T00:17:20.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.414+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~BYKDS8MC7TCR.1 size=1048576 2024-09-12T00:17:20.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.414+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~BYKDS8MC7TCR.2 size=386872 2024-09-12T00:17:20.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.422+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=BYKDS8MC7TCR tag=EBP521JM0RHP type=write size=3532600 2024-09-12T00:17:20.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.426+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=OYRM0VULSDRW type=del size=486707 2024-09-12T00:17:20.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.426+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~ZKSLWBZIA5P8.0 size=476798 2024-09-12T00:17:20.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.434+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=ZKSLWBZIA5P8 tag=NSSO37UKQTUQ type=write size=1525374 2024-09-12T00:17:20.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.434+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=YXUGTAS0P920 type=del size=974843 2024-09-12T00:17:20.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.438+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=PWRTLF26M764 type=del 2024-09-12T00:17:20.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.442+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=01IK3Y8NQG04 type=del size=3107251 2024-09-12T00:17:20.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.446+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=7K1BOSHBL87O type=del 2024-09-12T00:17:20.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.450+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=E4Q5FRE3VR84 type=del size=3743514 2024-09-12T00:17:20.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.454+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=RMCZ05MD13ZV type=del 2024-09-12T00:17:20.458 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.458+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~ILD51QLWBTOD.0 size=1048576 2024-09-12T00:17:20.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.462+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~ILD51QLWBTOD.1 size=1048576 2024-09-12T00:17:20.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.466+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~ILD51QLWBTOD.2 size=74997 2024-09-12T00:17:20.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.466+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=ILD51QLWBTOD tag=WVBV22GJ6KZW type=write size=3220725 2024-09-12T00:17:20.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.466+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~YOQZYATX56PG.0 size=1048576 2024-09-12T00:17:20.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.470+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~YOQZYATX56PG.1 size=1048576 2024-09-12T00:17:20.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.474+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~YOQZYATX56PG.2 size=445762 2024-09-12T00:17:20.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.478+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=YOQZYATX56PG tag=3OE7XSMERZLA type=write size=3591490 2024-09-12T00:17:20.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.482+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=28IFB5AB4HEV type=del size=1896664 2024-09-12T00:17:20.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.486+0000 7febed3678c0 1 < suggested remove operation key=MLPN8PH72VQ9 tag=O2Q2JR2KJB2H type=write 2024-09-12T00:17:20.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.490+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=DNNCQL9WWI0J type=del size=2787263 2024-09-12T00:17:20.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.490+0000 7febed3678c0 1 < canceled part key=_multipart_MAZHOU2CEUCU.2~8MG8G01C4HNQ.0 size=294190 2024-09-12T00:17:20.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.494+0000 7febed3678c0 1 < canceled multipart upload key=MAZHOU2CEUCU upload=8MG8G01C4HNQ tag=SM1T8P4ASFXN type=write size=1342766 2024-09-12T00:17:20.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.498+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=ESFB79YEEF5T type=del size=2536091 2024-09-12T00:17:20.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.502+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~T273JOH1M5UC.0 size=629532 2024-09-12T00:17:20.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.506+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=T273JOH1M5UC tag=PKOSJXWKGHVN type=write size=1678108 2024-09-12T00:17:20.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.506+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=BRE4ZZLASISU type=write size=297241 2024-09-12T00:17:20.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.510+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=1GYSD8YIZAM7 type=del 2024-09-12T00:17:20.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.514+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~BAVACNYLJIZ5.0 size=292997 2024-09-12T00:17:20.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.514+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=BAVACNYLJIZ5 tag=XTW59XCILX89 type=write size=1341573 2024-09-12T00:17:20.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.518+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=BCY5HT0EGRP7 type=del 2024-09-12T00:17:20.532 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.534+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~L6M3FBOZ7HDL.0 size=1048576 2024-09-12T00:17:20.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.534+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~L6M3FBOZ7HDL.1 size=51658 2024-09-12T00:17:20.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.534+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=L6M3FBOZ7HDL tag=R86T60A861NC type=write size=2148810 2024-09-12T00:17:20.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.538+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=LO7F0ZAR5LTE type=del 2024-09-12T00:17:20.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.542+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=XHAAAX4FHDJ0 type=del size=2391720 2024-09-12T00:17:20.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.546+0000 7febed3678c0 1 < suggested update operation key=1HABX7YZ491W tag=YYFCA8WZS4K3 type=del size=504779 2024-09-12T00:17:20.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.550+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=DND4CUBVFENO type=del size=2079597 2024-09-12T00:17:20.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.550+0000 7febed3678c0 1 < completed write operation key=UGV3WQR0ADYH tag=HR6A9VCK4PDU type=write size=82680 2024-09-12T00:17:20.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.558+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~66LHCEEW77B5.0 size=1029850 2024-09-12T00:17:20.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.558+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=66LHCEEW77B5 tag=KK358F758RQP type=write size=2078426 2024-09-12T00:17:20.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.562+0000 7febed3678c0 1 < suggested update operation key=H017KWW59B8Z tag=EXVDE81VQRZO type=del size=2225695 2024-09-12T00:17:20.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.566+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=VNKQWUASIUMO type=del size=2490509 2024-09-12T00:17:20.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.570+0000 7febed3678c0 1 < suggested remove operation key=AHTIFXX3SGK7 tag=HLLM05JXKQV9 type=del 2024-09-12T00:17:20.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.574+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~USQ3I947I3HZ.0 size=1048576 2024-09-12T00:17:20.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.578+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~USQ3I947I3HZ.1 size=1048576 2024-09-12T00:17:20.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.578+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~USQ3I947I3HZ.2 size=808262 2024-09-12T00:17:20.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.578+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=USQ3I947I3HZ tag=6G1BIWK33T4C type=write size=3953990 2024-09-12T00:17:20.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.582+0000 7febed3678c0 1 < canceled operation key=0KQK1CXHO096 tag=OYRM0VULSDRW type=del size=486707 2024-09-12T00:17:20.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.586+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=MJJ6R09BET37 type=del size=1039480 2024-09-12T00:17:20.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.590+0000 7febed3678c0 1 < suggested update operation key=KLO47UYYACLU tag=YXUGTAS0P920 type=del size=974843 2024-09-12T00:17:20.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.594+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=RE05GU0R3WT5 type=del size=3263173 2024-09-12T00:17:20.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.594+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=01IK3Y8NQG04 type=del 2024-09-12T00:17:20.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.598+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=E29HRBB5XZ6Y type=del size=3282050 2024-09-12T00:17:20.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.602+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=E4Q5FRE3VR84 type=del 2024-09-12T00:17:20.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.602+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=JSHCX240ADYK type=del size=947040 2024-09-12T00:17:20.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.606+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~ILD51QLWBTOD.0 size=1048576 2024-09-12T00:17:20.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.610+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~ILD51QLWBTOD.1 size=1048576 2024-09-12T00:17:20.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.610+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~ILD51QLWBTOD.2 size=74997 2024-09-12T00:17:20.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.614+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=ILD51QLWBTOD tag=WVBV22GJ6KZW type=write size=3220725 2024-09-12T00:17:20.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.622+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~A6Y8GIW4DYCC.0 size=1048576 2024-09-12T00:17:20.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.622+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~A6Y8GIW4DYCC.1 size=1048576 2024-09-12T00:17:20.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.626+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~A6Y8GIW4DYCC.2 size=354434 2024-09-12T00:17:20.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.626+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=A6Y8GIW4DYCC tag=R6XWVV3E4VKT type=write size=3500162 2024-09-12T00:17:20.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.634+0000 7febed3678c0 1 < suggested update operation key=4K65QIB9F00S tag=28IFB5AB4HEV type=del size=1896664 2024-09-12T00:17:20.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.638+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=EM9UFEPA21OT type=del size=3735875 2024-09-12T00:17:20.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.638+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=DNNCQL9WWI0J type=del 2024-09-12T00:17:20.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.642+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=FNAAOEIQKQMO type=del size=625976 2024-09-12T00:17:20.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.646+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=ESFB79YEEF5T type=del 2024-09-12T00:17:20.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.650+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=RXC16OYSXE1T type=del size=3113737 2024-09-12T00:17:20.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.654+0000 7febed3678c0 1 < completed write operation key=8RVDLW1VC8LP tag=BRE4ZZLASISU type=write size=297241 2024-09-12T00:17:20.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.658+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=QZPSZNGD8P11 type=del size=2815150 2024-09-12T00:17:20.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.662+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~BAVACNYLJIZ5.0 size=292997 2024-09-12T00:17:20.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.666+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=BAVACNYLJIZ5 tag=XTW59XCILX89 type=write size=1341573 2024-09-12T00:17:20.673 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.674+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~S2T7YRFLQMHZ.0 size=1048576 2024-09-12T00:17:20.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.674+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~S2T7YRFLQMHZ.1 size=1048576 2024-09-12T00:17:20.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.678+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~S2T7YRFLQMHZ.2 size=801116 2024-09-12T00:17:20.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.678+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=S2T7YRFLQMHZ tag=2RR933JXSXOM type=write size=3946844 2024-09-12T00:17:20.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.686+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~L6M3FBOZ7HDL.0 size=1048576 2024-09-12T00:17:20.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.686+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~L6M3FBOZ7HDL.1 size=51658 2024-09-12T00:17:20.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.694+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=L6M3FBOZ7HDL tag=R86T60A861NC type=write size=2148810 2024-09-12T00:17:20.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.702+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~O0T8DXF133A8.0 size=1048576 2024-09-12T00:17:20.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.702+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~O0T8DXF133A8.1 size=1048576 2024-09-12T00:17:20.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.706+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~O0T8DXF133A8.2 size=4889 2024-09-12T00:17:20.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.706+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=O0T8DXF133A8 tag=0ZIIJO7W96ZU type=write size=3150617 2024-09-12T00:17:20.712 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.714+0000 7febed3678c0 1 < suggested update operation key=UGV3WQR0ADYH tag=XHAAAX4FHDJ0 type=del size=2391720 2024-09-12T00:17:20.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.718+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~AI1L13Z435X6.0 size=611299 2024-09-12T00:17:20.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.718+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=AI1L13Z435X6 tag=4B9Y00OWZSMG type=write size=1659875 2024-09-12T00:17:20.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.726+0000 7febed3678c0 1 < suggested remove operation key=88BY5RHXSHD4 tag=DND4CUBVFENO type=del 2024-09-12T00:17:20.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.730+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~31PWHYQW938F.0 size=1048576 2024-09-12T00:17:20.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.734+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~31PWHYQW938F.1 size=189461 2024-09-12T00:17:20.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.734+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=31PWHYQW938F tag=SMUA4H4FQTY9 type=write size=2286613 2024-09-12T00:17:20.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.738+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~66LHCEEW77B5.0 size=1029850 2024-09-12T00:17:20.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.742+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=66LHCEEW77B5 tag=KK358F758RQP type=write size=2078426 2024-09-12T00:17:20.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.746+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~KKZCU84LTSBD.0 size=1048576 2024-09-12T00:17:20.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.750+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~KKZCU84LTSBD.1 size=1002780 2024-09-12T00:17:20.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.750+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=KKZCU84LTSBD tag=M4ZAJRHYMJTX type=write size=3099932 2024-09-12T00:17:20.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.754+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=VNKQWUASIUMO type=del 2024-09-12T00:17:20.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.754+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=UAGJYKJTG79K type=del size=3535564 2024-09-12T00:17:20.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.758+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~USQ3I947I3HZ.0 size=1048576 2024-09-12T00:17:20.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.762+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~USQ3I947I3HZ.1 size=1048576 2024-09-12T00:17:20.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.762+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~USQ3I947I3HZ.2 size=808262 2024-09-12T00:17:20.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.770+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=USQ3I947I3HZ tag=6G1BIWK33T4C type=write size=3953990 2024-09-12T00:17:20.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.774+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~V172IRTDIIUB.0 size=1048576 2024-09-12T00:17:20.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.778+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~V172IRTDIIUB.1 size=666604 2024-09-12T00:17:20.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.778+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=V172IRTDIIUB tag=GF1ZSN26MO4F type=write size=2763756 2024-09-12T00:17:20.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.778+0000 7febed3678c0 1 < canceled operation key=VW69JRC5JYX5 tag=MJJ6R09BET37 type=del size=1039480 2024-09-12T00:17:20.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.786+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~U891CTT3XGFA.0 size=1048576 2024-09-12T00:17:20.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.786+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~U891CTT3XGFA.1 size=975496 2024-09-12T00:17:20.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.786+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=U891CTT3XGFA tag=I0OLGC1W6GLW type=write size=3072648 2024-09-12T00:17:20.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.790+0000 7febed3678c0 -1 < failed to complete operation key=88BY5RHXSHD4 tag=RE05GU0R3WT5 type=del size=3263173: (22) Invalid argument 2024-09-12T00:17:20.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.794+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=1NWYGFBA7ZHB type=del size=457450 2024-09-12T00:17:20.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.794+0000 7febed3678c0 -1 < failed to complete operation key=UGV3WQR0ADYH tag=E29HRBB5XZ6Y type=del size=3282050: (22) Invalid argument 2024-09-12T00:17:20.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.798+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~KRR8TKUHEROZ.0 size=1048576 2024-09-12T00:17:20.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.802+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~KRR8TKUHEROZ.1 size=935781 2024-09-12T00:17:20.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.802+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=KRR8TKUHEROZ tag=0Z5NTS67KSJV type=write size=3032933 2024-09-12T00:17:20.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.806+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=JSHCX240ADYK type=del 2024-09-12T00:17:20.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.810+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~7SVVH0AIEAFL.0 size=1048576 2024-09-12T00:17:20.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.814+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~7SVVH0AIEAFL.1 size=1048576 2024-09-12T00:17:20.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.814+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~7SVVH0AIEAFL.2 size=41591 2024-09-12T00:17:20.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.814+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=7SVVH0AIEAFL tag=0GBNB8C50ZO1 type=write size=3187319 2024-09-12T00:17:20.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.818+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~A6Y8GIW4DYCC.0 size=1048576 2024-09-12T00:17:20.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.822+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~A6Y8GIW4DYCC.1 size=1048576 2024-09-12T00:17:20.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.822+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~A6Y8GIW4DYCC.2 size=354434 2024-09-12T00:17:20.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.830+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=A6Y8GIW4DYCC tag=R6XWVV3E4VKT type=write size=3500162 2024-09-12T00:17:20.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.834+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=1IBCRMVTFOM2 type=del size=3289201 2024-09-12T00:17:20.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.834+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=EM9UFEPA21OT type=del 2024-09-12T00:17:20.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.838+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=CZIOV02CIMPD type=del size=3770639 2024-09-12T00:17:20.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.842+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=FNAAOEIQKQMO type=del 2024-09-12T00:17:20.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.846+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=STXKORQF89RN type=del size=4155452 2024-09-12T00:17:20.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.850+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=RXC16OYSXE1T type=del 2024-09-12T00:17:20.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.850+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=J72HHNQNTSMS type=write size=869377 2024-09-12T00:17:20.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.854+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=QZPSZNGD8P11 type=del 2024-09-12T00:17:20.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.858+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=N2G6HNQVBSHO type=del size=309524 2024-09-12T00:17:20.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.862+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~S2T7YRFLQMHZ.0 size=1048576 2024-09-12T00:17:20.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.862+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~S2T7YRFLQMHZ.1 size=1048576 2024-09-12T00:17:20.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.866+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~S2T7YRFLQMHZ.2 size=801116 2024-09-12T00:17:20.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.870+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=S2T7YRFLQMHZ tag=2RR933JXSXOM type=write size=3946844 2024-09-12T00:17:20.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.874+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=783IA60EHN7T type=write size=491 2024-09-12T00:17:20.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.878+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~O0T8DXF133A8.0 size=1048576 2024-09-12T00:17:20.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.882+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~O0T8DXF133A8.1 size=1048576 2024-09-12T00:17:20.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.882+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~O0T8DXF133A8.2 size=4889 2024-09-12T00:17:20.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.890+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=O0T8DXF133A8 tag=0ZIIJO7W96ZU type=write size=3150617 2024-09-12T00:17:20.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.894+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~Q7IO45RB8SFE.0 size=1048576 2024-09-12T00:17:20.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.898+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~Q7IO45RB8SFE.1 size=1048576 2024-09-12T00:17:20.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.902+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~Q7IO45RB8SFE.2 size=327144 2024-09-12T00:17:20.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.902+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=Q7IO45RB8SFE tag=K3Q0SDUFMF70 type=write size=3472872 2024-09-12T00:17:20.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.902+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~AI1L13Z435X6.0 size=611299 2024-09-12T00:17:20.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.910+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=AI1L13Z435X6 tag=4B9Y00OWZSMG type=write size=1659875 2024-09-12T00:17:20.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.910+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=7OOO5SGUZ8NY type=del size=3768512 2024-09-12T00:17:20.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.914+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~31PWHYQW938F.0 size=1048576 2024-09-12T00:17:20.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.918+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~31PWHYQW938F.1 size=189461 2024-09-12T00:17:20.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.922+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=31PWHYQW938F tag=SMUA4H4FQTY9 type=write size=2286613 2024-09-12T00:17:20.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.926+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=50ET54AW36MX type=del size=4077997 2024-09-12T00:17:20.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.926+0000 7febed3678c0 1 < canceled part key=_multipart_G22WTRRGIQKE.2~KKZCU84LTSBD.0 size=1048576 2024-09-12T00:17:20.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.926+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~KKZCU84LTSBD.1 size=1002780 2024-09-12T00:17:20.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.934+0000 7febed3678c0 1 < canceled multipart upload key=G22WTRRGIQKE upload=KKZCU84LTSBD tag=M4ZAJRHYMJTX type=write size=3099932 2024-09-12T00:17:20.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.942+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=SMO2TUHJZTZY type=del size=95126 2024-09-12T00:17:20.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.946+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=UAGJYKJTG79K type=del 2024-09-12T00:17:20.949 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.950+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~0BIVUPHCCC5L.0 size=1048576 2024-09-12T00:17:20.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.950+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~0BIVUPHCCC5L.1 size=620563 2024-09-12T00:17:20.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.950+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=0BIVUPHCCC5L tag=V40N6B302Z5P type=write size=2717715 2024-09-12T00:17:20.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.954+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~V172IRTDIIUB.0 size=1048576 2024-09-12T00:17:20.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.958+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~V172IRTDIIUB.1 size=666604 2024-09-12T00:17:20.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.962+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=V172IRTDIIUB tag=GF1ZSN26MO4F type=write size=2763756 2024-09-12T00:17:20.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.962+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=DFL1DMR6W03N type=del size=2852400 2024-09-12T00:17:20.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.966+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~U891CTT3XGFA.0 size=1048576 2024-09-12T00:17:20.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.970+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~U891CTT3XGFA.1 size=975496 2024-09-12T00:17:20.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.974+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=U891CTT3XGFA tag=I0OLGC1W6GLW type=write size=3072648 2024-09-12T00:17:20.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.978+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~YLH4V7WS0LVR.0 size=11160 2024-09-12T00:17:20.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.978+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=YLH4V7WS0LVR tag=ZZE0PQH88PKP type=write size=1059736 2024-09-12T00:17:20.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.986+0000 7febed3678c0 1 < suggested update operation key=3G9ABEEEDRI3 tag=1NWYGFBA7ZHB type=del size=457450 2024-09-12T00:17:20.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.986+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=RZT5HN93F2A8 type=del size=1534957 2024-09-12T00:17:20.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.990+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~KRR8TKUHEROZ.0 size=1048576 2024-09-12T00:17:20.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.990+0000 7febed3678c0 1 < canceled part key=_multipart_9CBI4FHAT3H2.2~KRR8TKUHEROZ.1 size=935781 2024-09-12T00:17:20.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.994+0000 7febed3678c0 1 < canceled multipart upload key=9CBI4FHAT3H2 upload=KRR8TKUHEROZ tag=0Z5NTS67KSJV type=write size=3032933 2024-09-12T00:17:20.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.994+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=SCCZFEY21P4T type=del size=3651523 2024-09-12T00:17:20.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:20.998+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~7SVVH0AIEAFL.0 size=1048576 2024-09-12T00:17:21.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.002+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~7SVVH0AIEAFL.1 size=1048576 2024-09-12T00:17:21.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.002+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~7SVVH0AIEAFL.2 size=41591 2024-09-12T00:17:21.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.006+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=7SVVH0AIEAFL tag=0GBNB8C50ZO1 type=write size=3187319 2024-09-12T00:17:21.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.014+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~2CBU4B12JOSU.0 size=199850 2024-09-12T00:17:21.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.014+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=2CBU4B12JOSU tag=2UKU9DSFJ6I5 type=write size=1248426 2024-09-12T00:17:21.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.014+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=1IBCRMVTFOM2 type=del 2024-09-12T00:17:21.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.018+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~VB30T2KF1S22.0 size=1048576 2024-09-12T00:17:21.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.022+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~VB30T2KF1S22.1 size=262562 2024-09-12T00:17:21.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.022+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=VB30T2KF1S22 tag=EM0FBTV4ZAYJ type=write size=2359714 2024-09-12T00:17:21.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.026+0000 7febed3678c0 1 < suggested update operation key=ASFLGSKWYHG5 tag=CZIOV02CIMPD type=del size=3770639 2024-09-12T00:17:21.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.030+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~ZQ31ZTYA5V9E.0 size=500540 2024-09-12T00:17:21.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.030+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=ZQ31ZTYA5V9E tag=W4TZP4DJSF5H type=write size=1549116 2024-09-12T00:17:21.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.034+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=STXKORQF89RN type=del 2024-09-12T00:17:21.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.038+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=0EYV93MDJ3UW type=del size=3010564 2024-09-12T00:17:21.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.038+0000 7febed3678c0 1 < canceled operation key=W2VEW3JJEJY7 tag=J72HHNQNTSMS type=write size=869377 2024-09-12T00:17:21.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.042+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~CXAPXF24X987.0 size=1048576 2024-09-12T00:17:21.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.046+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~CXAPXF24X987.1 size=605767 2024-09-12T00:17:21.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.046+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=CXAPXF24X987 tag=BLSVQ3DE4CAG type=write size=2702919 2024-09-12T00:17:21.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.050+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=N2G6HNQVBSHO type=del 2024-09-12T00:17:21.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.054+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~6W1MV33GL1G7.0 size=666196 2024-09-12T00:17:21.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.054+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=6W1MV33GL1G7 tag=JLRK31L5EVE2 type=write size=1714772 2024-09-12T00:17:21.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.054+0000 7febed3678c0 1 < completed write operation key=1HABX7YZ491W tag=783IA60EHN7T type=write size=491 2024-09-12T00:17:21.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.058+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=8DL2SAFGBUNQ type=del size=2061771 2024-09-12T00:17:21.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.062+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~Q7IO45RB8SFE.0 size=1048576 2024-09-12T00:17:21.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.062+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~Q7IO45RB8SFE.1 size=1048576 2024-09-12T00:17:21.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.066+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~Q7IO45RB8SFE.2 size=327144 2024-09-12T00:17:21.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.070+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=Q7IO45RB8SFE tag=K3Q0SDUFMF70 type=write size=3472872 2024-09-12T00:17:21.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.074+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=T7AHCGI42EKE type=write size=361838 2024-09-12T00:17:21.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.074+0000 7febed3678c0 1 < canceled operation key=MHS307JKNVCK tag=7OOO5SGUZ8NY type=del size=3768512 2024-09-12T00:17:21.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.082+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~JIMNJGW6TKGT.0 size=1048576 2024-09-12T00:17:21.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.082+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~JIMNJGW6TKGT.1 size=707678 2024-09-12T00:17:21.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.082+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=JIMNJGW6TKGT tag=W51PJL75Q80J type=write size=2804830 2024-09-12T00:17:21.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.086+0000 7febed3678c0 1 < suggested remove operation key=9CBI4FHAT3H2 tag=50ET54AW36MX type=del 2024-09-12T00:17:21.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.090+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=Y2QRO0JWHW39 type=del size=3928164 2024-09-12T00:17:21.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.094+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=SMO2TUHJZTZY type=del 2024-09-12T00:17:21.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.094+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=9P80N5ZIPV3K type=del size=1192751 2024-09-12T00:17:21.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.098+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~0BIVUPHCCC5L.0 size=1048576 2024-09-12T00:17:21.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.102+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~0BIVUPHCCC5L.1 size=620563 2024-09-12T00:17:21.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.106+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=0BIVUPHCCC5L tag=V40N6B302Z5P type=write size=2717715 2024-09-12T00:17:21.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.110+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=LA8RTDPSQABX type=del size=1749851 2024-09-12T00:17:21.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.110+0000 7febed3678c0 -1 < no bi entry to suggest for operation key=9CBI4FHAT3H2 tag=DFL1DMR6W03N type=del size=2852400: (2) No such file or directory 2024-09-12T00:17:21.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.114+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=A4H92NIBUHYA type=del size=192935 2024-09-12T00:17:21.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.118+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~YLH4V7WS0LVR.0 size=11160 2024-09-12T00:17:21.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.122+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=YLH4V7WS0LVR tag=ZZE0PQH88PKP type=write size=1059736 2024-09-12T00:17:21.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.126+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=GWPGQUWCOD9D type=del size=3733864 2024-09-12T00:17:21.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.126+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=RZT5HN93F2A8 type=del 2024-09-12T00:17:21.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.134+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~05QARIM6Q76T.0 size=1048576 2024-09-12T00:17:21.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.134+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~05QARIM6Q76T.1 size=1048576 2024-09-12T00:17:21.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.138+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~05QARIM6Q76T.2 size=629695 2024-09-12T00:17:21.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.138+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=05QARIM6Q76T tag=4HZMWO5CES1W type=write size=3775423 2024-09-12T00:17:21.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.142+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=SCCZFEY21P4T type=del 2024-09-12T00:17:21.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.146+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~VO4GLSBNKFX6.0 size=1048576 2024-09-12T00:17:21.148 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.150+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~VO4GLSBNKFX6.1 size=1048576 2024-09-12T00:17:21.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.150+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~VO4GLSBNKFX6.2 size=633546 2024-09-12T00:17:21.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.150+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=VO4GLSBNKFX6 tag=I46IUAFZH35U type=write size=3779274 2024-09-12T00:17:21.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.154+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~2CBU4B12JOSU.0 size=199850 2024-09-12T00:17:21.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.158+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=2CBU4B12JOSU tag=2UKU9DSFJ6I5 type=write size=1248426 2024-09-12T00:17:21.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.162+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=QFSBIQ5FX0KR type=del size=52287 2024-09-12T00:17:21.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.166+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~VB30T2KF1S22.0 size=1048576 2024-09-12T00:17:21.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.166+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~VB30T2KF1S22.1 size=262562 2024-09-12T00:17:21.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.170+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=VB30T2KF1S22 tag=EM0FBTV4ZAYJ type=write size=2359714 2024-09-12T00:17:21.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.178+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~Y7MUXZYN64IJ.0 size=1048576 2024-09-12T00:17:21.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.178+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~Y7MUXZYN64IJ.1 size=1048576 2024-09-12T00:17:21.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.182+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~Y7MUXZYN64IJ.2 size=708029 2024-09-12T00:17:21.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.182+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=Y7MUXZYN64IJ tag=ZVTFPPPGAA9F type=write size=3853757 2024-09-12T00:17:21.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.186+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~ZQ31ZTYA5V9E.0 size=500540 2024-09-12T00:17:21.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.190+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=ZQ31ZTYA5V9E tag=W4TZP4DJSF5H type=write size=1549116 2024-09-12T00:17:21.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.194+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=OFC19N7GWE16 type=del size=4039274 2024-09-12T00:17:21.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.198+0000 7febed3678c0 1 < suggested update operation key=53T1415UK7GE tag=0EYV93MDJ3UW type=del size=3010564 2024-09-12T00:17:21.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.206+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~XJHQ7G7QOOQF.0 size=1048576 2024-09-12T00:17:21.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.206+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~XJHQ7G7QOOQF.1 size=1048576 2024-09-12T00:17:21.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.210+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~XJHQ7G7QOOQF.2 size=385129 2024-09-12T00:17:21.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.210+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=XJHQ7G7QOOQF tag=D7B624FMJJNG type=write size=3530857 2024-09-12T00:17:21.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.214+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~CXAPXF24X987.0 size=1048576 2024-09-12T00:17:21.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.214+0000 7febed3678c0 1 < canceled part key=_multipart_LGFKY0CP299H.2~CXAPXF24X987.1 size=605767 2024-09-12T00:17:21.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.218+0000 7febed3678c0 1 < canceled multipart upload key=LGFKY0CP299H upload=CXAPXF24X987 tag=BLSVQ3DE4CAG type=write size=2702919 2024-09-12T00:17:21.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.222+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~AH8X2XTRW1K7.0 size=1048576 2024-09-12T00:17:21.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.226+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~AH8X2XTRW1K7.1 size=1048576 2024-09-12T00:17:21.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.230+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~AH8X2XTRW1K7.2 size=4638 2024-09-12T00:17:21.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.230+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=AH8X2XTRW1K7 tag=SZSHAPE986MN type=write size=3150366 2024-09-12T00:17:21.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.234+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~6W1MV33GL1G7.0 size=666196 2024-09-12T00:17:21.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.238+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=6W1MV33GL1G7 tag=JLRK31L5EVE2 type=write size=1714772 2024-09-12T00:17:21.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.242+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~OMC7OZKPVT52.0 size=738542 2024-09-12T00:17:21.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.242+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=OMC7OZKPVT52 tag=VK7Q4ZTPSFOV type=write size=1787118 2024-09-12T00:17:21.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.250+0000 7febed3678c0 1 < suggested update operation key=ASFLGSKWYHG5 tag=8DL2SAFGBUNQ type=del size=2061771 2024-09-12T00:17:21.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.254+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=QZIRV4011Z9Q type=del size=878931 2024-09-12T00:17:21.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.254+0000 7febed3678c0 1 < canceled operation key=VU1AF57EUA0R tag=T7AHCGI42EKE type=write size=361838 2024-09-12T00:17:21.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.258+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=FP458F5EL4SN type=del size=675595 2024-09-12T00:17:21.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.262+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~JIMNJGW6TKGT.0 size=1048576 2024-09-12T00:17:21.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.262+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~JIMNJGW6TKGT.1 size=707678 2024-09-12T00:17:21.268 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.270+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=JIMNJGW6TKGT tag=W51PJL75Q80J type=write size=2804830 2024-09-12T00:17:21.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.270+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=615JMXN6TXMN type=write size=62011 2024-09-12T00:17:21.273 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.274+0000 7febed3678c0 -1 < failed to complete operation key=ASFLGSKWYHG5 tag=Y2QRO0JWHW39 type=del size=3928164: (22) Invalid argument 2024-09-12T00:17:21.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.278+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~FSL843J1BE1J.0 size=1048576 2024-09-12T00:17:21.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.282+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~FSL843J1BE1J.1 size=690091 2024-09-12T00:17:21.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.282+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=FSL843J1BE1J tag=DZDD3H3N3F9P type=write size=2787243 2024-09-12T00:17:21.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.282+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=9P80N5ZIPV3K type=del 2024-09-12T00:17:21.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.290+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~KE9V2PPH8HKU.0 size=1048576 2024-09-12T00:17:21.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.290+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~KE9V2PPH8HKU.1 size=69872 2024-09-12T00:17:21.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.290+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=KE9V2PPH8HKU tag=JM5WV66TE4J5 type=write size=2167024 2024-09-12T00:17:21.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.294+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=LA8RTDPSQABX type=del 2024-09-12T00:17:21.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.298+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=JHM6CN7WISDM type=del size=2668232 2024-09-12T00:17:21.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.298+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=A4H92NIBUHYA type=del 2024-09-12T00:17:21.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.302+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=TCAD5WFTQJU5 type=del size=4040071 2024-09-12T00:17:21.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.306+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=GWPGQUWCOD9D type=del 2024-09-12T00:17:21.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.306+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=QUJIGJD45G1S type=del size=892530 2024-09-12T00:17:21.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.310+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~05QARIM6Q76T.0 size=1048576 2024-09-12T00:17:21.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.310+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~05QARIM6Q76T.1 size=1048576 2024-09-12T00:17:21.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.314+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~05QARIM6Q76T.2 size=629695 2024-09-12T00:17:21.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.318+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=05QARIM6Q76T tag=4HZMWO5CES1W type=write size=3775423 2024-09-12T00:17:21.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.326+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~OZLK4TL2CCB9.0 size=1048576 2024-09-12T00:17:21.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.326+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~OZLK4TL2CCB9.1 size=438389 2024-09-12T00:17:21.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.326+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=OZLK4TL2CCB9 tag=YTRYCJFKV8SQ type=write size=2535541 2024-09-12T00:17:21.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.330+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~VO4GLSBNKFX6.0 size=1048576 2024-09-12T00:17:21.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.334+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~VO4GLSBNKFX6.1 size=1048576 2024-09-12T00:17:21.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.334+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~VO4GLSBNKFX6.2 size=633546 2024-09-12T00:17:21.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.338+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=VO4GLSBNKFX6 tag=I46IUAFZH35U type=write size=3779274 2024-09-12T00:17:21.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.342+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=G7EYQJ7PR9JO type=del size=3218094 2024-09-12T00:17:21.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.346+0000 7febed3678c0 1 < canceled operation key=52SSW5KTCS15 tag=QFSBIQ5FX0KR type=del size=52287 2024-09-12T00:17:21.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.350+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~GG4IT7DRUGG8.0 size=1048576 2024-09-12T00:17:21.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.354+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~GG4IT7DRUGG8.1 size=1048576 2024-09-12T00:17:21.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.354+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~GG4IT7DRUGG8.2 size=1015795 2024-09-12T00:17:21.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.354+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=GG4IT7DRUGG8 tag=SGEFAX3UXUZS type=write size=4161523 2024-09-12T00:17:21.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.358+0000 7febed3678c0 1 < canceled part key=_multipart_VW69JRC5JYX5.2~Y7MUXZYN64IJ.0 size=1048576 2024-09-12T00:17:21.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.358+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~Y7MUXZYN64IJ.1 size=1048576 2024-09-12T00:17:21.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.362+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~Y7MUXZYN64IJ.2 size=708029 2024-09-12T00:17:21.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.366+0000 7febed3678c0 1 < canceled multipart upload key=VW69JRC5JYX5 upload=Y7MUXZYN64IJ tag=ZVTFPPPGAA9F type=write size=3853757 2024-09-12T00:17:21.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.370+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~JL7ZW6XIWAFV.0 size=1048576 2024-09-12T00:17:21.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.374+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~JL7ZW6XIWAFV.1 size=953743 2024-09-12T00:17:21.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.374+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=JL7ZW6XIWAFV tag=BBB86PM0M8CA type=write size=3050895 2024-09-12T00:17:21.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.378+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=OFC19N7GWE16 type=del 2024-09-12T00:17:21.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.382+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~7QX79AN44F9U.0 size=1048576 2024-09-12T00:17:21.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.382+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~7QX79AN44F9U.1 size=1048576 2024-09-12T00:17:21.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.386+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~7QX79AN44F9U.2 size=529414 2024-09-12T00:17:21.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.386+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=7QX79AN44F9U tag=036X7GR3ZKCQ type=write size=3675142 2024-09-12T00:17:21.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.390+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~XJHQ7G7QOOQF.0 size=1048576 2024-09-12T00:17:21.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.390+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~XJHQ7G7QOOQF.1 size=1048576 2024-09-12T00:17:21.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.394+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~XJHQ7G7QOOQF.2 size=385129 2024-09-12T00:17:21.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.398+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=XJHQ7G7QOOQF tag=D7B624FMJJNG type=write size=3530857 2024-09-12T00:17:21.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.402+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~LJSMT2WIEKK9.0 size=1048576 2024-09-12T00:17:21.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.402+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~LJSMT2WIEKK9.1 size=1048576 2024-09-12T00:17:21.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.406+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~LJSMT2WIEKK9.2 size=479428 2024-09-12T00:17:21.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.406+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=LJSMT2WIEKK9 tag=KTCSLS647B9N type=write size=3625156 2024-09-12T00:17:21.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.406+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~AH8X2XTRW1K7.0 size=1048576 2024-09-12T00:17:21.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.410+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~AH8X2XTRW1K7.1 size=1048576 2024-09-12T00:17:21.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.410+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~AH8X2XTRW1K7.2 size=4638 2024-09-12T00:17:21.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.414+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=AH8X2XTRW1K7 tag=SZSHAPE986MN type=write size=3150366 2024-09-12T00:17:21.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.418+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=WOXW1AA7IBM0 type=write size=97144 2024-09-12T00:17:21.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.422+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~OMC7OZKPVT52.0 size=738542 2024-09-12T00:17:21.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.426+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=OMC7OZKPVT52 tag=VK7Q4ZTPSFOV type=write size=1787118 2024-09-12T00:17:21.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.430+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~02MXEV0EZMLF.0 size=184631 2024-09-12T00:17:21.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.430+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=02MXEV0EZMLF tag=52IA3XFPRNQD type=write size=1233207 2024-09-12T00:17:21.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.434+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=QZIRV4011Z9Q type=del 2024-09-12T00:17:21.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.438+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~YWDWH8J6DQM3.0 size=1048576 2024-09-12T00:17:21.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.438+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~YWDWH8J6DQM3.1 size=486493 2024-09-12T00:17:21.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.438+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=YWDWH8J6DQM3 tag=B2FR64OLUM1O type=write size=2583645 2024-09-12T00:17:21.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.442+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=FP458F5EL4SN type=del 2024-09-12T00:17:21.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.446+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~HRXL41DQCSHT.0 size=810347 2024-09-12T00:17:21.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.446+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=HRXL41DQCSHT tag=JPM4VDR6F10S type=write size=1858923 2024-09-12T00:17:21.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.446+0000 7febed3678c0 1 < completed write operation key=25THATWGX4WS tag=615JMXN6TXMN type=write size=62011 2024-09-12T00:17:21.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.450+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=L42O35C0ZLXK type=del size=2154543 2024-09-12T00:17:21.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.450+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~FSL843J1BE1J.0 size=1048576 2024-09-12T00:17:21.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.454+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~FSL843J1BE1J.1 size=690091 2024-09-12T00:17:21.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.458+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=FSL843J1BE1J tag=DZDD3H3N3F9P type=write size=2787243 2024-09-12T00:17:21.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.462+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~OXVUXRVIBD34.0 size=1048576 2024-09-12T00:17:21.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.462+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~OXVUXRVIBD34.1 size=1048576 2024-09-12T00:17:21.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.466+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~OXVUXRVIBD34.2 size=144724 2024-09-12T00:17:21.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.466+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=OXVUXRVIBD34 tag=WIT3ABGVWW3K type=write size=3290452 2024-09-12T00:17:21.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.470+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~KE9V2PPH8HKU.0 size=1048576 2024-09-12T00:17:21.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.474+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~KE9V2PPH8HKU.1 size=69872 2024-09-12T00:17:21.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.478+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=KE9V2PPH8HKU tag=JM5WV66TE4J5 type=write size=2167024 2024-09-12T00:17:21.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.478+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=AP6RAPV4BJJX type=del size=488277 2024-09-12T00:17:21.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.482+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=JHM6CN7WISDM type=del 2024-09-12T00:17:21.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.486+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=QMUQGI3K3X7P type=del size=3131496 2024-09-12T00:17:21.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.486+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=TCAD5WFTQJU5 type=del 2024-09-12T00:17:21.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.490+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=HCHYW8GEDV1M type=del size=3861551 2024-09-12T00:17:21.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.494+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=QUJIGJD45G1S type=del 2024-09-12T00:17:21.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.498+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~57A3ELXE4XVV.0 size=1048576 2024-09-12T00:17:21.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.498+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~57A3ELXE4XVV.1 size=45434 2024-09-12T00:17:21.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.498+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=57A3ELXE4XVV tag=32XN25GMLCSZ type=write size=2142586 2024-09-12T00:17:21.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.502+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~OZLK4TL2CCB9.0 size=1048576 2024-09-12T00:17:21.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.502+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~OZLK4TL2CCB9.1 size=438389 2024-09-12T00:17:21.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.506+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=OZLK4TL2CCB9 tag=YTRYCJFKV8SQ type=write size=2535541 2024-09-12T00:17:21.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.510+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~IS1Q6GH0IRYS.0 size=634301 2024-09-12T00:17:21.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.510+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=IS1Q6GH0IRYS tag=2K48676E4I1Y type=write size=1682877 2024-09-12T00:17:21.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.514+0000 7febed3678c0 1 < suggested remove operation key=UGV3WQR0ADYH tag=G7EYQJ7PR9JO type=del 2024-09-12T00:17:21.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.518+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=VOOHGDJEDDO6 type=del size=187185 2024-09-12T00:17:21.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.518+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~GG4IT7DRUGG8.0 size=1048576 2024-09-12T00:17:21.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.522+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~GG4IT7DRUGG8.1 size=1048576 2024-09-12T00:17:21.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.522+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~GG4IT7DRUGG8.2 size=1015795 2024-09-12T00:17:21.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.526+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=GG4IT7DRUGG8 tag=SGEFAX3UXUZS type=write size=4161523 2024-09-12T00:17:21.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.530+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=C1EFPO862FJB type=del size=974469 2024-09-12T00:17:21.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.530+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~JL7ZW6XIWAFV.0 size=1048576 2024-09-12T00:17:21.532 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.534+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~JL7ZW6XIWAFV.1 size=953743 2024-09-12T00:17:21.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.538+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=JL7ZW6XIWAFV tag=BBB86PM0M8CA type=write size=3050895 2024-09-12T00:17:21.539 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.538+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=L6551C1VQ00R type=del size=1239656 2024-09-12T00:17:21.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.542+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~7QX79AN44F9U.0 size=1048576 2024-09-12T00:17:21.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.542+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~7QX79AN44F9U.1 size=1048576 2024-09-12T00:17:21.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.546+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~7QX79AN44F9U.2 size=529414 2024-09-12T00:17:21.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.550+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=7QX79AN44F9U tag=036X7GR3ZKCQ type=write size=3675142 2024-09-12T00:17:21.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.554+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~LY8NR9O0UCT4.0 size=1048576 2024-09-12T00:17:21.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.558+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~LY8NR9O0UCT4.1 size=1048576 2024-09-12T00:17:21.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.558+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~LY8NR9O0UCT4.2 size=586425 2024-09-12T00:17:21.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.558+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=LY8NR9O0UCT4 tag=WLB80IUZR4Z0 type=write size=3732153 2024-09-12T00:17:21.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.562+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~LJSMT2WIEKK9.0 size=1048576 2024-09-12T00:17:21.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.562+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~LJSMT2WIEKK9.1 size=1048576 2024-09-12T00:17:21.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.566+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~LJSMT2WIEKK9.2 size=479428 2024-09-12T00:17:21.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.570+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=LJSMT2WIEKK9 tag=KTCSLS647B9N type=write size=3625156 2024-09-12T00:17:21.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.574+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~WH9CCLSLLXVW.0 size=1048576 2024-09-12T00:17:21.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.574+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~WH9CCLSLLXVW.1 size=317978 2024-09-12T00:17:21.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.574+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=WH9CCLSLLXVW tag=CR4VAOKEKEN2 type=write size=2415130 2024-09-12T00:17:21.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.578+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=WOXW1AA7IBM0 type=write size=97144 2024-09-12T00:17:21.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.582+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~P12EQ64IPLGN.0 size=1048576 2024-09-12T00:17:21.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.582+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~P12EQ64IPLGN.1 size=1048576 2024-09-12T00:17:21.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.586+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~P12EQ64IPLGN.2 size=674351 2024-09-12T00:17:21.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.586+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=P12EQ64IPLGN tag=U0EEPFA73GHK type=write size=3820079 2024-09-12T00:17:21.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.586+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~02MXEV0EZMLF.0 size=184631 2024-09-12T00:17:21.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.590+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=02MXEV0EZMLF tag=52IA3XFPRNQD type=write size=1233207 2024-09-12T00:17:21.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.594+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~Y48IJU3BN8OW.0 size=1048576 2024-09-12T00:17:21.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.598+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~Y48IJU3BN8OW.1 size=891528 2024-09-12T00:17:21.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.598+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=Y48IJU3BN8OW tag=I7NI4SBEB7CE type=write size=2988680 2024-09-12T00:17:21.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.598+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~YWDWH8J6DQM3.0 size=1048576 2024-09-12T00:17:21.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.602+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~YWDWH8J6DQM3.1 size=486493 2024-09-12T00:17:21.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.606+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=YWDWH8J6DQM3 tag=B2FR64OLUM1O type=write size=2583645 2024-09-12T00:17:21.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.610+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=1PUKL3YE2PUO type=del size=2168475 2024-09-12T00:17:21.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.610+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~HRXL41DQCSHT.0 size=810347 2024-09-12T00:17:21.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.614+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=HRXL41DQCSHT tag=JPM4VDR6F10S type=write size=1858923 2024-09-12T00:17:21.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.618+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=R45PTAROOTQB type=del size=2337181 2024-09-12T00:17:21.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.618+0000 7febed3678c0 1 < canceled operation key=MHS307JKNVCK tag=L42O35C0ZLXK type=del size=2154543 2024-09-12T00:17:21.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.622+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=B6B0BMOZHJVT type=del size=2449425 2024-09-12T00:17:21.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.626+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~OXVUXRVIBD34.0 size=1048576 2024-09-12T00:17:21.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.626+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~OXVUXRVIBD34.1 size=1048576 2024-09-12T00:17:21.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.630+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~OXVUXRVIBD34.2 size=144724 2024-09-12T00:17:21.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.634+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=OXVUXRVIBD34 tag=WIT3ABGVWW3K type=write size=3290452 2024-09-12T00:17:21.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.634+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=P3VI58766JFN type=del size=3527619 2024-09-12T00:17:21.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.638+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=AP6RAPV4BJJX type=del 2024-09-12T00:17:21.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.642+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=YS582I5TGJK1 type=write size=576351 2024-09-12T00:17:21.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.642+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=QMUQGI3K3X7P type=del 2024-09-12T00:17:21.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.646+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=82727873KUCZ type=del size=1429397 2024-09-12T00:17:21.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.650+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=HCHYW8GEDV1M type=del 2024-09-12T00:17:21.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.654+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~EZDUUTTUPVBW.0 size=1048576 2024-09-12T00:17:21.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.654+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~EZDUUTTUPVBW.1 size=324146 2024-09-12T00:17:21.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.654+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=EZDUUTTUPVBW tag=NE1497YVECCC type=write size=2421298 2024-09-12T00:17:21.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.658+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~57A3ELXE4XVV.0 size=1048576 2024-09-12T00:17:21.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.662+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~57A3ELXE4XVV.1 size=45434 2024-09-12T00:17:21.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.666+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=57A3ELXE4XVV tag=32XN25GMLCSZ type=write size=2142586 2024-09-12T00:17:21.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.670+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=6OKNVBA49N3M type=write size=40928 2024-09-12T00:17:21.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.670+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~IS1Q6GH0IRYS.0 size=634301 2024-09-12T00:17:21.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.678+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=IS1Q6GH0IRYS tag=2K48676E4I1Y type=write size=1682877 2024-09-12T00:17:21.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.682+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~JEGZSPSPQZYG.0 size=1048576 2024-09-12T00:17:21.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.682+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~JEGZSPSPQZYG.1 size=690101 2024-09-12T00:17:21.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.682+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=JEGZSPSPQZYG tag=AMKUOXEX6JWQ type=write size=2787253 2024-09-12T00:17:21.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.686+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=VOOHGDJEDDO6 type=del 2024-09-12T00:17:21.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.690+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=9ADB7SFOAU7Z type=del size=979312 2024-09-12T00:17:21.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.690+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=C1EFPO862FJB type=del 2024-09-12T00:17:21.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.694+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=1DK59B2B12Z1 type=write size=920867 2024-09-12T00:17:21.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.698+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=L6551C1VQ00R type=del 2024-09-12T00:17:21.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.702+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=48CBJO0MCFYT type=del size=466453 2024-09-12T00:17:21.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.702+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~LY8NR9O0UCT4.0 size=1048576 2024-09-12T00:17:21.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.706+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~LY8NR9O0UCT4.1 size=1048576 2024-09-12T00:17:21.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.706+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~LY8NR9O0UCT4.2 size=586425 2024-09-12T00:17:21.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.710+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=LY8NR9O0UCT4 tag=WLB80IUZR4Z0 type=write size=3732153 2024-09-12T00:17:21.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.718+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~Q2HLMM5DLVOK.0 size=309752 2024-09-12T00:17:21.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.718+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=Q2HLMM5DLVOK tag=122DK030SQSC type=write size=1358328 2024-09-12T00:17:21.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.718+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~WH9CCLSLLXVW.0 size=1048576 2024-09-12T00:17:21.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.722+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~WH9CCLSLLXVW.1 size=317978 2024-09-12T00:17:21.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.726+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=WH9CCLSLLXVW tag=CR4VAOKEKEN2 type=write size=2415130 2024-09-12T00:17:21.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.730+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=PVBOE567I0T7 type=del size=1111706 2024-09-12T00:17:21.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.730+0000 7febed3678c0 1 < canceled part key=_multipart_VW69JRC5JYX5.2~P12EQ64IPLGN.0 size=1048576 2024-09-12T00:17:21.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.730+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~P12EQ64IPLGN.1 size=1048576 2024-09-12T00:17:21.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.734+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~P12EQ64IPLGN.2 size=674351 2024-09-12T00:17:21.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.738+0000 7febed3678c0 1 < canceled multipart upload key=VW69JRC5JYX5 upload=P12EQ64IPLGN tag=U0EEPFA73GHK type=write size=3820079 2024-09-12T00:17:21.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.742+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=L6EKR73VQ51T type=del size=3209951 2024-09-12T00:17:21.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.742+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~Y48IJU3BN8OW.0 size=1048576 2024-09-12T00:17:21.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.746+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~Y48IJU3BN8OW.1 size=891528 2024-09-12T00:17:21.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.750+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=Y48IJU3BN8OW tag=I7NI4SBEB7CE type=write size=2988680 2024-09-12T00:17:21.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.754+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=BCUFV3ZRQTEG type=del size=1317166 2024-09-12T00:17:21.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.754+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=1PUKL3YE2PUO type=del 2024-09-12T00:17:21.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.758+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=74AYVI2CHXPH type=del size=1224007 2024-09-12T00:17:21.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.762+0000 7febed3678c0 1 < suggested update operation key=HR9MVC82R7GL tag=R45PTAROOTQB type=del size=2337181 2024-09-12T00:17:21.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.766+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=71AGM83664RD type=del size=3651509 2024-09-12T00:17:21.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.770+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=B6B0BMOZHJVT type=del 2024-09-12T00:17:21.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.774+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~PAUYVMZFZIV1.0 size=1048576 2024-09-12T00:17:21.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.778+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~PAUYVMZFZIV1.1 size=1048576 2024-09-12T00:17:21.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.778+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~PAUYVMZFZIV1.2 size=1006092 2024-09-12T00:17:21.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.778+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=PAUYVMZFZIV1 tag=R1RH2QKBEQPC type=write size=4151820 2024-09-12T00:17:21.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.786+0000 7febed3678c0 1 < suggested remove operation key=88BY5RHXSHD4 tag=P3VI58766JFN type=del 2024-09-12T00:17:21.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.790+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=MQXBJAPC7WEK type=del size=1540961 2024-09-12T00:17:21.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.790+0000 7febed3678c0 1 < completed write operation key=LWAMFA0RSW6S tag=YS582I5TGJK1 type=write size=576351 2024-09-12T00:17:21.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.794+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=NU5JJ3ZEJYKU type=del size=4171405 2024-09-12T00:17:21.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.798+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=82727873KUCZ type=del 2024-09-12T00:17:21.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.802+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=CGXA8OWIHU4E type=del size=1700216 2024-09-12T00:17:21.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.806+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~EZDUUTTUPVBW.0 size=1048576 2024-09-12T00:17:21.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.810+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~EZDUUTTUPVBW.1 size=324146 2024-09-12T00:17:21.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.814+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=EZDUUTTUPVBW tag=NE1497YVECCC type=write size=2421298 2024-09-12T00:17:21.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.818+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=AIZ2YE5B854Z type=del size=3104667 2024-09-12T00:17:21.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.822+0000 7febed3678c0 1 < completed write operation key=MAZHOU2CEUCU tag=6OKNVBA49N3M type=write size=40928 2024-09-12T00:17:21.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.822+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=M1GZXD3NE3MM type=write size=484974 2024-09-12T00:17:21.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.826+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~JEGZSPSPQZYG.0 size=1048576 2024-09-12T00:17:21.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.830+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~JEGZSPSPQZYG.1 size=690101 2024-09-12T00:17:21.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.834+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=JEGZSPSPQZYG tag=AMKUOXEX6JWQ type=write size=2787253 2024-09-12T00:17:21.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.842+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~L1GK20SMHA5Q.0 size=18914 2024-09-12T00:17:21.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.842+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=L1GK20SMHA5Q tag=MNOFFWP7K7T7 type=write size=1067490 2024-09-12T00:17:21.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.846+0000 7febed3678c0 1 < suggested update operation key=9CBI4FHAT3H2 tag=9ADB7SFOAU7Z type=del size=979312 2024-09-12T00:17:21.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.850+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=HN3HBPYVEGOD type=write size=134489 2024-09-12T00:17:21.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.854+0000 7febed3678c0 1 < completed write operation key=MAZHOU2CEUCU tag=1DK59B2B12Z1 type=write size=920867 2024-09-12T00:17:21.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.858+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=UKACU8SVVC7G type=del size=3493293 2024-09-12T00:17:21.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.862+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=48CBJO0MCFYT type=del 2024-09-12T00:17:21.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.866+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=C2Y0ZIRP4ZWZ type=del size=3351891 2024-09-12T00:17:21.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.866+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~Q2HLMM5DLVOK.0 size=309752 2024-09-12T00:17:21.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.874+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=Q2HLMM5DLVOK tag=122DK030SQSC type=write size=1358328 2024-09-12T00:17:21.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.882+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~GPZA25OEO35E.0 size=1048576 2024-09-12T00:17:21.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.882+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~GPZA25OEO35E.1 size=398952 2024-09-12T00:17:21.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.882+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=GPZA25OEO35E tag=4MEEDYDYK9FV type=write size=2496104 2024-09-12T00:17:21.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.886+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=PVBOE567I0T7 type=del 2024-09-12T00:17:21.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.894+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~UR9ZO2HSV761.0 size=1048576 2024-09-12T00:17:21.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.898+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~UR9ZO2HSV761.1 size=79074 2024-09-12T00:17:21.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.898+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=UR9ZO2HSV761 tag=ZL9ND5354MIX type=write size=2176226 2024-09-12T00:17:21.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.902+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=L6EKR73VQ51T type=del 2024-09-12T00:17:21.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.902+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=8IUS442I82WS type=del size=3252068 2024-09-12T00:17:21.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.906+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=BCUFV3ZRQTEG type=del 2024-09-12T00:17:21.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.910+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=U8G8PM2I10SQ type=write size=814763 2024-09-12T00:17:21.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.914+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=74AYVI2CHXPH type=del 2024-09-12T00:17:21.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.918+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=6PV47ZPO8UCN type=del size=748588 2024-09-12T00:17:21.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.922+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=71AGM83664RD type=del 2024-09-12T00:17:21.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.930+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~C0KZ6HQJ7O1H.0 size=1048576 2024-09-12T00:17:21.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.930+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~C0KZ6HQJ7O1H.1 size=668995 2024-09-12T00:17:21.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.930+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=C0KZ6HQJ7O1H tag=OYGF660ASG0A type=write size=2766147 2024-09-12T00:17:21.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.934+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~PAUYVMZFZIV1.0 size=1048576 2024-09-12T00:17:21.937 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.938+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~PAUYVMZFZIV1.1 size=1048576 2024-09-12T00:17:21.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.942+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~PAUYVMZFZIV1.2 size=1006092 2024-09-12T00:17:21.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.946+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=PAUYVMZFZIV1 tag=R1RH2QKBEQPC type=write size=4151820 2024-09-12T00:17:21.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.954+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~HMI0D55ZVFVM.0 size=1048576 2024-09-12T00:17:21.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.958+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~HMI0D55ZVFVM.1 size=459190 2024-09-12T00:17:21.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.958+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=HMI0D55ZVFVM tag=EJ3RLXCOI2LB type=write size=2556342 2024-09-12T00:17:21.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.958+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=MQXBJAPC7WEK type=del 2024-09-12T00:17:21.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.962+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=4I6U4H94STG5 type=del size=1094294 2024-09-12T00:17:21.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.966+0000 7febed3678c0 -1 < failed to complete operation key=9CBI4FHAT3H2 tag=NU5JJ3ZEJYKU type=del size=4171405: (22) Invalid argument 2024-09-12T00:17:21.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.970+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~D7V0ZWAKAP3P.0 size=1048576 2024-09-12T00:17:21.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.974+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~D7V0ZWAKAP3P.1 size=684061 2024-09-12T00:17:21.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.974+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=D7V0ZWAKAP3P tag=Q2ZTZO2OWA8K type=write size=2781213 2024-09-12T00:17:21.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.978+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=CGXA8OWIHU4E type=del 2024-09-12T00:17:21.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.982+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~6K5V9JW3WH2V.0 size=1048576 2024-09-12T00:17:21.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.986+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~6K5V9JW3WH2V.1 size=649623 2024-09-12T00:17:21.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.986+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=6K5V9JW3WH2V tag=VO2HISD9G19H type=write size=2746775 2024-09-12T00:17:21.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.994+0000 7febed3678c0 1 < suggested update operation key=LWAMFA0RSW6S tag=AIZ2YE5B854Z type=del size=3104667 2024-09-12T00:17:21.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:21.998+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=NVISSCD1UOUI type=del size=129329 2024-09-12T00:17:22.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.006+0000 7febed3678c0 1 < suggested remove operation key=VU1AF57EUA0R tag=M1GZXD3NE3MM type=write 2024-09-12T00:17:22.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.006+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=DEN3G0K5XV3Q type=del size=2766006 2024-09-12T00:17:22.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.006+0000 7febed3678c0 1 < canceled part key=_multipart_W2VEW3JJEJY7.2~L1GK20SMHA5Q.0 size=18914 2024-09-12T00:17:22.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.014+0000 7febed3678c0 1 < canceled multipart upload key=W2VEW3JJEJY7 upload=L1GK20SMHA5Q tag=MNOFFWP7K7T7 type=write size=1067490 2024-09-12T00:17:22.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.018+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~WGJ5LV85LTB6.0 size=206947 2024-09-12T00:17:22.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.018+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=WGJ5LV85LTB6 tag=6M8FOB5UCXZ5 type=write size=1255523 2024-09-12T00:17:22.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.026+0000 7febed3678c0 1 < suggested update operation key=53T1415UK7GE tag=HN3HBPYVEGOD type=write size=134489 2024-09-12T00:17:22.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.030+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=837EOC81CIUF type=write size=100682 2024-09-12T00:17:22.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.034+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=UKACU8SVVC7G type=del 2024-09-12T00:17:22.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.038+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~ZHAU9IT55R3E.0 size=385631 2024-09-12T00:17:22.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.038+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=ZHAU9IT55R3E tag=MUD16S87T5MR type=write size=1434207 2024-09-12T00:17:22.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.042+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=C2Y0ZIRP4ZWZ type=del 2024-09-12T00:17:22.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.046+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=8QOFGGYJHFGY type=del size=2898853 2024-09-12T00:17:22.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.046+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~GPZA25OEO35E.0 size=1048576 2024-09-12T00:17:22.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.050+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~GPZA25OEO35E.1 size=398952 2024-09-12T00:17:22.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.054+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=GPZA25OEO35E tag=4MEEDYDYK9FV type=write size=2496104 2024-09-12T00:17:22.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.058+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=YTUWMN2ZWGVM type=del size=3475319 2024-09-12T00:17:22.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.062+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~UR9ZO2HSV761.0 size=1048576 2024-09-12T00:17:22.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.066+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~UR9ZO2HSV761.1 size=79074 2024-09-12T00:17:22.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.070+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=UR9ZO2HSV761 tag=ZL9ND5354MIX type=write size=2176226 2024-09-12T00:17:22.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.074+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=H27NEQ6BX3IE type=del size=3365094 2024-09-12T00:17:22.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.078+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=8IUS442I82WS type=del 2024-09-12T00:17:22.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.082+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=S129PL9XNYSE type=del size=3360947 2024-09-12T00:17:22.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.086+0000 7febed3678c0 1 < completed write operation key=KABJD0GYBVF4 tag=U8G8PM2I10SQ type=write size=814763 2024-09-12T00:17:22.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.090+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=05YHYCLK10KY type=del size=2329127 2024-09-12T00:17:22.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.094+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=6PV47ZPO8UCN type=del 2024-09-12T00:17:22.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.094+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=MVRX3EMUUV3K type=del size=3519744 2024-09-12T00:17:22.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.098+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~C0KZ6HQJ7O1H.0 size=1048576 2024-09-12T00:17:22.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.102+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~C0KZ6HQJ7O1H.1 size=668995 2024-09-12T00:17:22.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.110+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=C0KZ6HQJ7O1H tag=OYGF660ASG0A type=write size=2766147 2024-09-12T00:17:22.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.110+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=G825XTT3RBK0 type=del size=3388397 2024-09-12T00:17:22.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.114+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~HMI0D55ZVFVM.0 size=1048576 2024-09-12T00:17:22.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.118+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~HMI0D55ZVFVM.1 size=459190 2024-09-12T00:17:22.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.126+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=HMI0D55ZVFVM tag=EJ3RLXCOI2LB type=write size=2556342 2024-09-12T00:17:22.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.126+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=U51FNH0HVL5U type=del size=3795752 2024-09-12T00:17:22.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.134+0000 7febed3678c0 1 < suggested remove operation key=RGQ4KY26RKYI tag=4I6U4H94STG5 type=del 2024-09-12T00:17:22.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.138+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=HS7WF3AN4HVN type=del size=1720308 2024-09-12T00:17:22.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.142+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~D7V0ZWAKAP3P.0 size=1048576 2024-09-12T00:17:22.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.146+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~D7V0ZWAKAP3P.1 size=684061 2024-09-12T00:17:22.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.154+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=D7V0ZWAKAP3P tag=Q2ZTZO2OWA8K type=write size=2781213 2024-09-12T00:17:22.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.158+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=46T75YBZVYQ8 type=del size=394815 2024-09-12T00:17:22.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.162+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~6K5V9JW3WH2V.0 size=1048576 2024-09-12T00:17:22.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.166+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~6K5V9JW3WH2V.1 size=649623 2024-09-12T00:17:22.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.170+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=6K5V9JW3WH2V tag=VO2HISD9G19H type=write size=2746775 2024-09-12T00:17:22.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.174+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=2SXMCJJQZZKV type=del size=1162319 2024-09-12T00:17:22.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.178+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=NVISSCD1UOUI type=del 2024-09-12T00:17:22.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.186+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~MPZIPFXC5C32.0 size=921914 2024-09-12T00:17:22.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.186+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=MPZIPFXC5C32 tag=1IOB10JDRM2J type=write size=1970490 2024-09-12T00:17:22.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.190+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=DEN3G0K5XV3Q type=del 2024-09-12T00:17:22.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.194+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=2O0QXXBOWEXW type=del size=1175877 2024-09-12T00:17:22.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.194+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~WGJ5LV85LTB6.0 size=206947 2024-09-12T00:17:22.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.202+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=WGJ5LV85LTB6 tag=6M8FOB5UCXZ5 type=write size=1255523 2024-09-12T00:17:22.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.206+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=B7ZBYQ4X6FUY type=del size=3372121 2024-09-12T00:17:22.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.210+0000 7febed3678c0 1 < canceled operation key=ELNXYXX5ZWOW tag=837EOC81CIUF type=write size=100682 2024-09-12T00:17:22.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.210+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=AKR4BPTGG1LB type=del size=3992788 2024-09-12T00:17:22.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.214+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~ZHAU9IT55R3E.0 size=385631 2024-09-12T00:17:22.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.222+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=ZHAU9IT55R3E tag=MUD16S87T5MR type=write size=1434207 2024-09-12T00:17:22.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.230+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~XFZJE23WUZUI.0 size=1048576 2024-09-12T00:17:22.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.230+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~XFZJE23WUZUI.1 size=1048576 2024-09-12T00:17:22.234 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.234+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~XFZJE23WUZUI.2 size=120182 2024-09-12T00:17:22.234 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.234+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=XFZJE23WUZUI tag=57QVKVQJPF7S type=write size=3265910 2024-09-12T00:17:22.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.242+0000 7febed3678c0 1 < suggested remove operation key=LWAMFA0RSW6S tag=8QOFGGYJHFGY type=del 2024-09-12T00:17:22.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.250+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~SF4TBUW4QM7D.0 size=1048576 2024-09-12T00:17:22.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.250+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~SF4TBUW4QM7D.1 size=679047 2024-09-12T00:17:22.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.250+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=SF4TBUW4QM7D tag=4UE3BRBFCK70 type=write size=2776199 2024-09-12T00:17:22.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.254+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=YTUWMN2ZWGVM type=del 2024-09-12T00:17:22.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.258+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=BFP60UPDR6JO type=del size=2272818 2024-09-12T00:17:22.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.262+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=H27NEQ6BX3IE type=del 2024-09-12T00:17:22.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.266+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~E1PLRSYNW2OD.0 size=1048576 2024-09-12T00:17:22.268 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.270+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~E1PLRSYNW2OD.1 size=1048576 2024-09-12T00:17:22.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.270+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~E1PLRSYNW2OD.2 size=148082 2024-09-12T00:17:22.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.270+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=E1PLRSYNW2OD tag=FD7172OSFFRU type=write size=3293810 2024-09-12T00:17:22.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.274+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=S129PL9XNYSE type=del 2024-09-12T00:17:22.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.278+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=VE9WL1JU33GF type=del size=1247238 2024-09-12T00:17:22.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.282+0000 7febed3678c0 1 < canceled operation key=9HCKHF5ZRZ5N tag=05YHYCLK10KY type=del size=2329127 2024-09-12T00:17:22.284 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.286+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=8M9P5OX8KOM8 type=del size=2302429 2024-09-12T00:17:22.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.286+0000 7febed3678c0 1 < canceled operation key=8RVDLW1VC8LP tag=MVRX3EMUUV3K type=del size=3519744 2024-09-12T00:17:22.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.290+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=MT42Q51T2XNR type=del size=656139 2024-09-12T00:17:22.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.294+0000 7febed3678c0 1 < canceled operation key=VU1AF57EUA0R tag=G825XTT3RBK0 type=del size=3388397 2024-09-12T00:17:22.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.298+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=EQTJN5FZKKDU type=del size=4010395 2024-09-12T00:17:22.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.302+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=U51FNH0HVL5U type=del 2024-09-12T00:17:22.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.306+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=2QR12R2ALGSJ type=del size=1361227 2024-09-12T00:17:22.308 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.310+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=HS7WF3AN4HVN type=del 2024-09-12T00:17:22.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.314+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=LYIW08OL8ZOZ type=del size=1534425 2024-09-12T00:17:22.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.314+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=46T75YBZVYQ8 type=del 2024-09-12T00:17:22.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.326+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~9VA5K2D6RHYY.0 size=701851 2024-09-12T00:17:22.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.326+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=9VA5K2D6RHYY tag=L4OKIZ93WTP7 type=write size=1750427 2024-09-12T00:17:22.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.330+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=2SXMCJJQZZKV type=del 2024-09-12T00:17:22.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.334+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=Q5OM29IJVHTS type=del size=3562451 2024-09-12T00:17:22.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.338+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~MPZIPFXC5C32.0 size=921914 2024-09-12T00:17:22.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.342+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=MPZIPFXC5C32 tag=1IOB10JDRM2J type=write size=1970490 2024-09-12T00:17:22.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.346+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=HL3ZAO4244AN type=del size=506107 2024-09-12T00:17:22.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.350+0000 7febed3678c0 1 < canceled operation key=G22WTRRGIQKE tag=2O0QXXBOWEXW type=del size=1175877 2024-09-12T00:17:22.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.350+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=FAKX4BHCCKHL type=del size=1043196 2024-09-12T00:17:22.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.354+0000 7febed3678c0 1 < canceled operation key=8RVDLW1VC8LP tag=B7ZBYQ4X6FUY type=del size=3372121 2024-09-12T00:17:22.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.362+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~G2YOFVEPDO8D.0 size=1048576 2024-09-12T00:17:22.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.362+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~G2YOFVEPDO8D.1 size=555910 2024-09-12T00:17:22.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.362+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=G2YOFVEPDO8D tag=FVRDT8XRCNDI type=write size=2653062 2024-09-12T00:17:22.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.366+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=AKR4BPTGG1LB type=del 2024-09-12T00:17:22.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.370+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=VND0X3OLLJNX type=del size=970147 2024-09-12T00:17:22.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.374+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~XFZJE23WUZUI.0 size=1048576 2024-09-12T00:17:22.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.374+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~XFZJE23WUZUI.1 size=1048576 2024-09-12T00:17:22.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.374+0000 7febed3678c0 1 < canceled part key=_multipart_W2VEW3JJEJY7.2~XFZJE23WUZUI.2 size=120182 2024-09-12T00:17:22.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.382+0000 7febed3678c0 1 < canceled multipart upload key=W2VEW3JJEJY7 upload=XFZJE23WUZUI tag=57QVKVQJPF7S type=write size=3265910 2024-09-12T00:17:22.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.386+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=ITSBB8CZ3H1H type=write size=447587 2024-09-12T00:17:22.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.386+0000 7febed3678c0 1 < canceled part key=_multipart_ASFLGSKWYHG5.2~SF4TBUW4QM7D.0 size=1048576 2024-09-12T00:17:22.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.386+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~SF4TBUW4QM7D.1 size=679047 2024-09-12T00:17:22.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.394+0000 7febed3678c0 1 < canceled multipart upload key=ASFLGSKWYHG5 upload=SF4TBUW4QM7D tag=4UE3BRBFCK70 type=write size=2776199 2024-09-12T00:17:22.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.398+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=TK9IAP5MF0I9 type=del size=1453609 2024-09-12T00:17:22.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.402+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=BFP60UPDR6JO type=del 2024-09-12T00:17:22.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.402+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=Z8C9ZGCRS4XO type=del size=134718 2024-09-12T00:17:22.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.406+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~E1PLRSYNW2OD.0 size=1048576 2024-09-12T00:17:22.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.406+0000 7febed3678c0 1 < canceled part key=_multipart_Z020UV2JRR0I.2~E1PLRSYNW2OD.1 size=1048576 2024-09-12T00:17:22.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.410+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~E1PLRSYNW2OD.2 size=148082 2024-09-12T00:17:22.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.414+0000 7febed3678c0 1 < canceled multipart upload key=Z020UV2JRR0I upload=E1PLRSYNW2OD tag=FD7172OSFFRU type=write size=3293810 2024-09-12T00:17:22.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.418+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=AL2QT8D2L17U type=del size=482219 2024-09-12T00:17:22.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.422+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=VE9WL1JU33GF type=del 2024-09-12T00:17:22.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.426+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=9MBRRVWYBZI4 type=del size=3469054 2024-09-12T00:17:22.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.430+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=8M9P5OX8KOM8 type=del 2024-09-12T00:17:22.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.434+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=7BEIOEPK0L7X type=write size=412640 2024-09-12T00:17:22.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.438+0000 7febed3678c0 1 < suggested remove operation key=Z020UV2JRR0I tag=MT42Q51T2XNR type=del 2024-09-12T00:17:22.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.442+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=FW2KFY09WKUQ type=del size=3892716 2024-09-12T00:17:22.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.446+0000 7febed3678c0 1 < canceled operation key=3G9ABEEEDRI3 tag=EQTJN5FZKKDU type=del size=4010395 2024-09-12T00:17:22.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.446+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=0IKNIBR8IKWZ type=del size=1727531 2024-09-12T00:17:22.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.450+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=2QR12R2ALGSJ type=del 2024-09-12T00:17:22.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.458+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~2UB6231F1UFC.0 size=203733 2024-09-12T00:17:22.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.458+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=2UB6231F1UFC tag=MCKK00GWZ5VJ type=write size=1252309 2024-09-12T00:17:22.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.462+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=LYIW08OL8ZOZ type=del 2024-09-12T00:17:22.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.466+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~V1YOJ4BST8ZJ.0 size=1048576 2024-09-12T00:17:22.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.470+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~V1YOJ4BST8ZJ.1 size=34947 2024-09-12T00:17:22.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.470+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=V1YOJ4BST8ZJ tag=B8QY0VRKY8WO type=write size=2132099 2024-09-12T00:17:22.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.470+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~9VA5K2D6RHYY.0 size=701851 2024-09-12T00:17:22.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.478+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=9VA5K2D6RHYY tag=L4OKIZ93WTP7 type=write size=1750427 2024-09-12T00:17:22.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.482+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~HQRU6YT49ZXA.0 size=952559 2024-09-12T00:17:22.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.482+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=HQRU6YT49ZXA tag=S7GXRB9VRB5V type=write size=2001135 2024-09-12T00:17:22.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.486+0000 7febed3678c0 1 < canceled operation key=4K65QIB9F00S tag=Q5OM29IJVHTS type=del size=3562451 2024-09-12T00:17:22.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.490+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=T9388VDJWN4Z type=write size=28808 2024-09-12T00:17:22.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.494+0000 7febed3678c0 1 < suggested remove operation key=G22WTRRGIQKE tag=HL3ZAO4244AN type=del 2024-09-12T00:17:22.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.498+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=V79CTAXB6VAB type=write size=494725 2024-09-12T00:17:22.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.502+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=FAKX4BHCCKHL type=del 2024-09-12T00:17:22.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.506+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~NFIHWGGEQDPK.0 size=1048576 2024-09-12T00:17:22.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.510+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~NFIHWGGEQDPK.1 size=1048576 2024-09-12T00:17:22.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.514+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~NFIHWGGEQDPK.2 size=819931 2024-09-12T00:17:22.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.514+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=NFIHWGGEQDPK tag=U6G6HFMBZCX0 type=write size=3965659 2024-09-12T00:17:22.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.514+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~G2YOFVEPDO8D.0 size=1048576 2024-09-12T00:17:22.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.514+0000 7febed3678c0 1 < canceled part key=_multipart_LWAMFA0RSW6S.2~G2YOFVEPDO8D.1 size=555910 2024-09-12T00:17:22.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.522+0000 7febed3678c0 1 < canceled multipart upload key=LWAMFA0RSW6S upload=G2YOFVEPDO8D tag=FVRDT8XRCNDI type=write size=2653062 2024-09-12T00:17:22.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.522+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=ZLAYZHCYB6RV type=del size=2624163 2024-09-12T00:17:22.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.526+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=VND0X3OLLJNX type=del 2024-09-12T00:17:22.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.530+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~B4I7IHIZGGUP.0 size=1048576 2024-09-12T00:17:22.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.534+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~B4I7IHIZGGUP.1 size=1048576 2024-09-12T00:17:22.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.534+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~B4I7IHIZGGUP.2 size=778634 2024-09-12T00:17:22.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.534+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=B4I7IHIZGGUP tag=58ZHJUV536ZN type=write size=3924362 2024-09-12T00:17:22.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.538+0000 7febed3678c0 1 < completed write operation key=3G9ABEEEDRI3 tag=ITSBB8CZ3H1H type=write size=447587 2024-09-12T00:17:22.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.542+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=OAR7H49203KR type=write size=199813 2024-09-12T00:17:22.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.546+0000 7febed3678c0 1 < suggested update operation key=AHTIFXX3SGK7 tag=TK9IAP5MF0I9 type=del size=1453609 2024-09-12T00:17:22.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.554+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~2NZKOGSC4LH5.0 size=1048576 2024-09-12T00:17:22.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.554+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~2NZKOGSC4LH5.1 size=1048576 2024-09-12T00:17:22.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.558+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~2NZKOGSC4LH5.2 size=186035 2024-09-12T00:17:22.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.558+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=2NZKOGSC4LH5 tag=RJ0PZL4WCONQ type=write size=3331763 2024-09-12T00:17:22.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.558+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=Z8C9ZGCRS4XO type=del 2024-09-12T00:17:22.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.566+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~ELYUSU8T82Z9.0 size=1048576 2024-09-12T00:17:22.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.566+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~ELYUSU8T82Z9.1 size=1048576 2024-09-12T00:17:22.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.570+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~ELYUSU8T82Z9.2 size=301679 2024-09-12T00:17:22.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.570+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=ELYUSU8T82Z9 tag=O5J4C7J3IK7I type=write size=3447407 2024-09-12T00:17:22.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.574+0000 7febed3678c0 1 < suggested update operation key=0KQK1CXHO096 tag=AL2QT8D2L17U type=del size=482219 2024-09-12T00:17:22.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.578+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=PNWHEAOQY71E type=del size=3165691 2024-09-12T00:17:22.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.582+0000 7febed3678c0 -1 < failed to complete operation key=AHTIFXX3SGK7 tag=9MBRRVWYBZI4 type=del size=3469054: (22) Invalid argument 2024-09-12T00:17:22.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.582+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=9JSQ202P03I4 type=write size=914691 2024-09-12T00:17:22.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.586+0000 7febed3678c0 1 < canceled operation key=8RVDLW1VC8LP tag=7BEIOEPK0L7X type=write size=412640 2024-09-12T00:17:22.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.590+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~BFP6NGPTHHBS.0 size=942770 2024-09-12T00:17:22.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.590+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=BFP6NGPTHHBS tag=J8TNA380LED6 type=write size=1991346 2024-09-12T00:17:22.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.594+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=FW2KFY09WKUQ type=del 2024-09-12T00:17:22.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.598+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~WNF41EDZE1TG.0 size=475114 2024-09-12T00:17:22.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.598+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=WNF41EDZE1TG tag=0C9NDISNX1SC type=write size=1523690 2024-09-12T00:17:22.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.602+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=0IKNIBR8IKWZ type=del 2024-09-12T00:17:22.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.606+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=WYTANDP0OUBJ type=del size=3309570 2024-09-12T00:17:22.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.610+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~2UB6231F1UFC.0 size=203733 2024-09-12T00:17:22.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.614+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=2UB6231F1UFC tag=MCKK00GWZ5VJ type=write size=1252309 2024-09-12T00:17:22.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.622+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=ZH774QU50UKU type=write size=686016 2024-09-12T00:17:22.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.626+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~V1YOJ4BST8ZJ.0 size=1048576 2024-09-12T00:17:22.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.630+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~V1YOJ4BST8ZJ.1 size=34947 2024-09-12T00:17:22.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.634+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=V1YOJ4BST8ZJ tag=B8QY0VRKY8WO type=write size=2132099 2024-09-12T00:17:22.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.638+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=3UBEZBX5C8NZ type=del size=3449873 2024-09-12T00:17:22.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.642+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~HQRU6YT49ZXA.0 size=952559 2024-09-12T00:17:22.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.646+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=HQRU6YT49ZXA tag=S7GXRB9VRB5V type=write size=2001135 2024-09-12T00:17:22.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.650+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=W5BHF8EEW51W type=del size=2985300 2024-09-12T00:17:22.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.650+0000 7febed3678c0 1 < canceled operation key=8RVDLW1VC8LP tag=T9388VDJWN4Z type=write size=28808 2024-09-12T00:17:22.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.654+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=WNVSV0DDCY52 type=del size=3680881 2024-09-12T00:17:22.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.658+0000 7febed3678c0 1 < completed write operation key=53T1415UK7GE tag=V79CTAXB6VAB type=write size=494725 2024-09-12T00:17:22.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.662+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~L4NNSAJ1U9EW.0 size=1048576 2024-09-12T00:17:22.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.662+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~L4NNSAJ1U9EW.1 size=902896 2024-09-12T00:17:22.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.662+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=L4NNSAJ1U9EW tag=4PTV6LHE9VTD type=write size=3000048 2024-09-12T00:17:22.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.666+0000 7febed3678c0 1 < canceled part key=_multipart_VU1AF57EUA0R.2~NFIHWGGEQDPK.0 size=1048576 2024-09-12T00:17:22.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.666+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~NFIHWGGEQDPK.1 size=1048576 2024-09-12T00:17:22.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.670+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~NFIHWGGEQDPK.2 size=819931 2024-09-12T00:17:22.672 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.674+0000 7febed3678c0 1 < canceled multipart upload key=VU1AF57EUA0R upload=NFIHWGGEQDPK tag=U6G6HFMBZCX0 type=write size=3965659 2024-09-12T00:17:22.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.674+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=1E79U811TLMD type=del size=1933011 2024-09-12T00:17:22.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.678+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=ZLAYZHCYB6RV type=del 2024-09-12T00:17:22.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.682+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=4Y9LXN9CJUPI type=del size=4015682 2024-09-12T00:17:22.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.682+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~B4I7IHIZGGUP.0 size=1048576 2024-09-12T00:17:22.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.686+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~B4I7IHIZGGUP.1 size=1048576 2024-09-12T00:17:22.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.686+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~B4I7IHIZGGUP.2 size=778634 2024-09-12T00:17:22.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.690+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=B4I7IHIZGGUP tag=58ZHJUV536ZN type=write size=3924362 2024-09-12T00:17:22.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.694+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=1TY71WNIL8SR type=write size=327330 2024-09-12T00:17:22.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.698+0000 7febed3678c0 1 < canceled operation key=3G9ABEEEDRI3 tag=OAR7H49203KR type=write size=199813 2024-09-12T00:17:22.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.698+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=DYMN2470GPMK type=del size=3517729 2024-09-12T00:17:22.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.702+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~2NZKOGSC4LH5.0 size=1048576 2024-09-12T00:17:22.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.706+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~2NZKOGSC4LH5.1 size=1048576 2024-09-12T00:17:22.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.706+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~2NZKOGSC4LH5.2 size=186035 2024-09-12T00:17:22.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.710+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=2NZKOGSC4LH5 tag=RJ0PZL4WCONQ type=write size=3331763 2024-09-12T00:17:22.715 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.714+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~UF2K22PWA9DS.0 size=1048576 2024-09-12T00:17:22.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.718+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~UF2K22PWA9DS.1 size=330795 2024-09-12T00:17:22.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.718+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=UF2K22PWA9DS tag=LP03UQGXQ2XZ type=write size=2427947 2024-09-12T00:17:22.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.718+0000 7febed3678c0 1 < canceled part key=_multipart_CIOINUP503WY.2~ELYUSU8T82Z9.0 size=1048576 2024-09-12T00:17:22.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.722+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~ELYUSU8T82Z9.1 size=1048576 2024-09-12T00:17:22.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.722+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~ELYUSU8T82Z9.2 size=301679 2024-09-12T00:17:22.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.726+0000 7febed3678c0 1 < canceled multipart upload key=CIOINUP503WY upload=ELYUSU8T82Z9 tag=O5J4C7J3IK7I type=write size=3447407 2024-09-12T00:17:22.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.730+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~12XXHEQGRWEY.0 size=719507 2024-09-12T00:17:22.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.730+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=12XXHEQGRWEY tag=QM8CLTC7UQR9 type=write size=1768083 2024-09-12T00:17:22.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.734+0000 7febed3678c0 1 < canceled operation key=9CBI4FHAT3H2 tag=PNWHEAOQY71E type=del size=3165691 2024-09-12T00:17:22.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.738+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=W3I2SHCVM2KU type=del size=1803495 2024-09-12T00:17:22.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.742+0000 7febed3678c0 1 < completed write operation key=G22WTRRGIQKE tag=9JSQ202P03I4 type=write size=914691 2024-09-12T00:17:22.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.742+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=UHGR0QLEFPP7 type=del size=458302 2024-09-12T00:17:22.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.746+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~BFP6NGPTHHBS.0 size=942770 2024-09-12T00:17:22.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.750+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=BFP6NGPTHHBS tag=J8TNA380LED6 type=write size=1991346 2024-09-12T00:17:22.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.754+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=B8J77XK3LTP7 type=del size=1466440 2024-09-12T00:17:22.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.758+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~WNF41EDZE1TG.0 size=475114 2024-09-12T00:17:22.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.762+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=WNF41EDZE1TG tag=0C9NDISNX1SC type=write size=1523690 2024-09-12T00:17:22.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.766+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=3J16D7GKALV5 type=del size=1383591 2024-09-12T00:17:22.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.770+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=WYTANDP0OUBJ type=del 2024-09-12T00:17:22.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.770+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=MAIFRDFUL0HS type=write size=623258 2024-09-12T00:17:22.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.774+0000 7febed3678c0 1 < completed write operation key=AHTIFXX3SGK7 tag=ZH774QU50UKU type=write size=686016 2024-09-12T00:17:22.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.778+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=LTYUT0X0ABG6 type=del size=165642 2024-09-12T00:17:22.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.782+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=3UBEZBX5C8NZ type=del 2024-09-12T00:17:22.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.786+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=9JUDKIAKXY1W type=del size=3047829 2024-09-12T00:17:22.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.790+0000 7febed3678c0 1 < suggested update operation key=G22WTRRGIQKE tag=W5BHF8EEW51W type=del size=2985300 2024-09-12T00:17:22.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.794+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~0G1LUNBMZYKV.0 size=1048576 2024-09-12T00:17:22.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.798+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~0G1LUNBMZYKV.1 size=457070 2024-09-12T00:17:22.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.798+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=0G1LUNBMZYKV tag=SFJSUEAK6VYH type=write size=2554222 2024-09-12T00:17:22.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.802+0000 7febed3678c0 1 < canceled operation key=4K65QIB9F00S tag=WNVSV0DDCY52 type=del size=3680881 2024-09-12T00:17:22.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.806+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=RHACP9W9707T type=del size=2062227 2024-09-12T00:17:22.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.810+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~L4NNSAJ1U9EW.0 size=1048576 2024-09-12T00:17:22.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.814+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~L4NNSAJ1U9EW.1 size=902896 2024-09-12T00:17:22.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.818+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=L4NNSAJ1U9EW tag=4PTV6LHE9VTD type=write size=3000048 2024-09-12T00:17:22.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.822+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=CZ42SKUDS8S5 type=write size=369113 2024-09-12T00:17:22.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.830+0000 7febed3678c0 1 < suggested update operation key=MAZHOU2CEUCU tag=1E79U811TLMD type=del size=1933011 2024-09-12T00:17:22.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.834+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=0DT5NOUD1NEI type=write size=185951 2024-09-12T00:17:22.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.838+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=4Y9LXN9CJUPI type=del 2024-09-12T00:17:22.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.842+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=D7WH6MPECFTP type=del size=4029393 2024-09-12T00:17:22.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.846+0000 7febed3678c0 1 < completed write operation key=88BY5RHXSHD4 tag=1TY71WNIL8SR type=write size=327330 2024-09-12T00:17:22.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.850+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~748EPPT41ORP.0 size=405369 2024-09-12T00:17:22.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.850+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=748EPPT41ORP tag=QO4T4W52CWO1 type=write size=1453945 2024-09-12T00:17:22.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.854+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=DYMN2470GPMK type=del 2024-09-12T00:17:22.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.858+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=TN533N9NFETJ type=del size=1502876 2024-09-12T00:17:22.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.862+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~UF2K22PWA9DS.0 size=1048576 2024-09-12T00:17:22.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.862+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~UF2K22PWA9DS.1 size=330795 2024-09-12T00:17:22.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.870+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=UF2K22PWA9DS tag=LP03UQGXQ2XZ type=write size=2427947 2024-09-12T00:17:22.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.870+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=BQOPAAVQ1EZ0 type=write size=779362 2024-09-12T00:17:22.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.874+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~12XXHEQGRWEY.0 size=719507 2024-09-12T00:17:22.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.878+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=12XXHEQGRWEY tag=QM8CLTC7UQR9 type=write size=1768083 2024-09-12T00:17:22.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.882+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=ENUI7C8FGR44 type=del size=3218946 2024-09-12T00:17:22.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.886+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=W3I2SHCVM2KU type=del 2024-09-12T00:17:22.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.894+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~509002TPSSMU.0 size=983101 2024-09-12T00:17:22.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.894+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=509002TPSSMU tag=RHOR023BPY66 type=write size=2031677 2024-09-12T00:17:22.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.902+0000 7febed3678c0 1 < suggested remove operation key=ASFLGSKWYHG5 tag=UHGR0QLEFPP7 type=del 2024-09-12T00:17:22.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.906+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=AWWPCE8IKXGQ type=del size=1477367 2024-09-12T00:17:22.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.910+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=B8J77XK3LTP7 type=del 2024-09-12T00:17:22.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.918+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~03HS3QUJTJYS.0 size=1048576 2024-09-12T00:17:22.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.922+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~03HS3QUJTJYS.1 size=691434 2024-09-12T00:17:22.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.922+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=03HS3QUJTJYS tag=OJBXY7L4ZJEM type=write size=2788586 2024-09-12T00:17:22.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.922+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=3J16D7GKALV5 type=del 2024-09-12T00:17:22.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.930+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~FQMNTQJV9QDN.0 size=137634 2024-09-12T00:17:22.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.930+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=FQMNTQJV9QDN tag=K6BZD38BW0QP type=write size=1186210 2024-09-12T00:17:22.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.934+0000 7febed3678c0 1 < completed write operation key=KLO47UYYACLU tag=MAIFRDFUL0HS type=write size=623258 2024-09-12T00:17:22.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.934+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=QIUN2XR73YSR type=del size=2728082 2024-09-12T00:17:22.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.938+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=LTYUT0X0ABG6 type=del 2024-09-12T00:17:22.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.942+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=IE12B58T1SZJ type=del size=1488508 2024-09-12T00:17:22.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.946+0000 7febed3678c0 -1 < failed to complete operation key=ASFLGSKWYHG5 tag=9JUDKIAKXY1W type=del size=3047829: (22) Invalid argument 2024-09-12T00:17:22.947 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.946+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=8W9ILWF88Z7S type=write size=890934 2024-09-12T00:17:22.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.950+0000 7febed3678c0 1 < canceled part key=_multipart_MAZHOU2CEUCU.2~0G1LUNBMZYKV.0 size=1048576 2024-09-12T00:17:22.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.950+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~0G1LUNBMZYKV.1 size=457070 2024-09-12T00:17:22.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.954+0000 7febed3678c0 1 < canceled multipart upload key=MAZHOU2CEUCU upload=0G1LUNBMZYKV tag=SFJSUEAK6VYH type=write size=2554222 2024-09-12T00:17:22.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.962+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~5CII6PB0VCNY.0 size=1048576 2024-09-12T00:17:22.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.962+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~5CII6PB0VCNY.1 size=539395 2024-09-12T00:17:22.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.962+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=5CII6PB0VCNY tag=SA484B5S3N18 type=write size=2636547 2024-09-12T00:17:22.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.970+0000 7febed3678c0 1 < suggested remove operation key=AHTIFXX3SGK7 tag=RHACP9W9707T type=del 2024-09-12T00:17:22.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.974+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~2UX4I3281SV9.0 size=1048576 2024-09-12T00:17:22.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.978+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~2UX4I3281SV9.1 size=1048576 2024-09-12T00:17:22.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.982+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~2UX4I3281SV9.2 size=455468 2024-09-12T00:17:22.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.982+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=2UX4I3281SV9 tag=AN824IR5X3KL type=write size=3601196 2024-09-12T00:17:22.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.986+0000 7febed3678c0 1 < suggested update operation key=G22WTRRGIQKE tag=CZ42SKUDS8S5 type=write size=369113 2024-09-12T00:17:22.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.990+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=XBP1W4JGJIUP type=write size=124510 2024-09-12T00:17:22.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.994+0000 7febed3678c0 1 < completed write operation key=LWAMFA0RSW6S tag=0DT5NOUD1NEI type=write size=185951 2024-09-12T00:17:22.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.994+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=SWLV1W3ER4SF type=write size=72461 2024-09-12T00:17:22.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:22.998+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=D7WH6MPECFTP type=del 2024-09-12T00:17:23.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.002+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=NH72SFEL1GM6 type=del size=850186 2024-09-12T00:17:23.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.006+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~748EPPT41ORP.0 size=405369 2024-09-12T00:17:23.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.010+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=748EPPT41ORP tag=QO4T4W52CWO1 type=write size=1453945 2024-09-12T00:17:23.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.014+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=1FU93LMPELWE type=del size=3442637 2024-09-12T00:17:23.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.018+0000 7febed3678c0 1 < canceled operation key=MLPN8PH72VQ9 tag=TN533N9NFETJ type=del size=1502876 2024-09-12T00:17:23.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.022+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=OHEDL7PEK11T type=write size=585922 2024-09-12T00:17:23.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.026+0000 7febed3678c0 1 < suggested remove operation key=4K65QIB9F00S tag=BQOPAAVQ1EZ0 type=write 2024-09-12T00:17:23.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.030+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=UJ9Q61NJG0OT type=del size=473024 2024-09-12T00:17:23.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.034+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=ENUI7C8FGR44 type=del 2024-09-12T00:17:23.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.038+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=QRLLCJSM1WT2 type=del size=118083 2024-09-12T00:17:23.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.042+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~509002TPSSMU.0 size=983101 2024-09-12T00:17:23.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.046+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=509002TPSSMU tag=RHOR023BPY66 type=write size=2031677 2024-09-12T00:17:23.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.050+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=43DFWN3082IM type=write size=344235 2024-09-12T00:17:23.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.054+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=AWWPCE8IKXGQ type=del 2024-09-12T00:17:23.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.058+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~R4P00DDDE3KM.0 size=1048576 2024-09-12T00:17:23.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.062+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~R4P00DDDE3KM.1 size=844126 2024-09-12T00:17:23.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.062+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=R4P00DDDE3KM tag=2CKU39GAA357 type=write size=2941278 2024-09-12T00:17:23.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.062+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~03HS3QUJTJYS.0 size=1048576 2024-09-12T00:17:23.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.066+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~03HS3QUJTJYS.1 size=691434 2024-09-12T00:17:23.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.070+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=03HS3QUJTJYS tag=OJBXY7L4ZJEM type=write size=2788586 2024-09-12T00:17:23.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.074+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=MHF7NUPAE41P type=write size=315664 2024-09-12T00:17:23.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.078+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~FQMNTQJV9QDN.0 size=137634 2024-09-12T00:17:23.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.082+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=FQMNTQJV9QDN tag=K6BZD38BW0QP type=write size=1186210 2024-09-12T00:17:23.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.090+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~QECOKDO1ESAF.0 size=1048576 2024-09-12T00:17:23.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.094+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~QECOKDO1ESAF.1 size=241901 2024-09-12T00:17:23.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.094+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=QECOKDO1ESAF tag=HW2NY4TCXB14 type=write size=2339053 2024-09-12T00:17:23.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.098+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=QIUN2XR73YSR type=del 2024-09-12T00:17:23.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.098+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=6SA7HNIPPS7A type=write size=56307 2024-09-12T00:17:23.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.106+0000 7febed3678c0 1 < suggested update operation key=Z020UV2JRR0I tag=IE12B58T1SZJ type=del size=1488508 2024-09-12T00:17:23.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.110+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=5Y9QQC0Z6P5K type=write size=426023 2024-09-12T00:17:23.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.114+0000 7febed3678c0 1 < completed write operation key=KABJD0GYBVF4 tag=8W9ILWF88Z7S type=write size=890934 2024-09-12T00:17:23.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.118+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~LRCOGLKR16FB.0 size=1048576 2024-09-12T00:17:23.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.122+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~LRCOGLKR16FB.1 size=1048576 2024-09-12T00:17:23.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.126+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~LRCOGLKR16FB.2 size=788417 2024-09-12T00:17:23.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.126+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=LRCOGLKR16FB tag=LL6G7D1VH5ND type=write size=3934145 2024-09-12T00:17:23.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.130+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~5CII6PB0VCNY.0 size=1048576 2024-09-12T00:17:23.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.130+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~5CII6PB0VCNY.1 size=539395 2024-09-12T00:17:23.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.138+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=5CII6PB0VCNY tag=SA484B5S3N18 type=write size=2636547 2024-09-12T00:17:23.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.142+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~UYQR2SYSTWKH.0 size=1048576 2024-09-12T00:17:23.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.146+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~UYQR2SYSTWKH.1 size=1048576 2024-09-12T00:17:23.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.150+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~UYQR2SYSTWKH.2 size=987415 2024-09-12T00:17:23.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.150+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=UYQR2SYSTWKH tag=0I1HR7P2L70W type=write size=4133143 2024-09-12T00:17:23.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.154+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~2UX4I3281SV9.0 size=1048576 2024-09-12T00:17:23.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.154+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~2UX4I3281SV9.1 size=1048576 2024-09-12T00:17:23.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.158+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~2UX4I3281SV9.2 size=455468 2024-09-12T00:17:23.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.166+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=2UX4I3281SV9 tag=AN824IR5X3KL type=write size=3601196 2024-09-12T00:17:23.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.170+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~DT5DTIXVUN2K.0 size=1048576 2024-09-12T00:17:23.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.174+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~DT5DTIXVUN2K.1 size=767423 2024-09-12T00:17:23.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.174+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=DT5DTIXVUN2K tag=RAHXK7MMX5IN type=write size=2864575 2024-09-12T00:17:23.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.182+0000 7febed3678c0 1 < suggested remove operation key=52SSW5KTCS15 tag=XBP1W4JGJIUP type=write 2024-09-12T00:17:23.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.186+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~761HRU9Y1JO0.0 size=512954 2024-09-12T00:17:23.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.186+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=761HRU9Y1JO0 tag=IGLOYHVQ56OJ type=write size=1561530 2024-09-12T00:17:23.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.190+0000 7febed3678c0 1 < completed write operation key=H017KWW59B8Z tag=SWLV1W3ER4SF type=write size=72461 2024-09-12T00:17:23.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.194+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~G0IBAIHANRG1.0 size=1048576 2024-09-12T00:17:23.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.198+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~G0IBAIHANRG1.1 size=1048576 2024-09-12T00:17:23.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.202+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~G0IBAIHANRG1.2 size=492711 2024-09-12T00:17:23.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.202+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=G0IBAIHANRG1 tag=9HVZBUPIGA3Z type=write size=3638439 2024-09-12T00:17:23.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.206+0000 7febed3678c0 1 < suggested update operation key=9CBI4FHAT3H2 tag=NH72SFEL1GM6 type=del size=850186 2024-09-12T00:17:23.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.210+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=391FN49YORLA type=write size=627773 2024-09-12T00:17:23.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.218+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=1FU93LMPELWE type=del 2024-09-12T00:17:23.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.222+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=N8DWKYZCJAS4 type=del size=1730743 2024-09-12T00:17:23.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.226+0000 7febed3678c0 1 < completed write operation key=MLPN8PH72VQ9 tag=OHEDL7PEK11T type=write size=585922 2024-09-12T00:17:23.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.226+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=KF7MAXM8KRA2 type=del size=3281840 2024-09-12T00:17:23.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.230+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=UJ9Q61NJG0OT type=del 2024-09-12T00:17:23.234 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.234+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=BLHSM40OEQ05 type=write size=749614 2024-09-12T00:17:23.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.238+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=QRLLCJSM1WT2 type=del 2024-09-12T00:17:23.242 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.242+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=PABD2FTWMB5L type=del size=3019494 2024-09-12T00:17:23.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.246+0000 7febed3678c0 1 < completed write operation key=MLPN8PH72VQ9 tag=43DFWN3082IM type=write size=344235 2024-09-12T00:17:23.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.250+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~UX141ICJS2G6.0 size=1048576 2024-09-12T00:17:23.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.254+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~UX141ICJS2G6.1 size=937956 2024-09-12T00:17:23.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.254+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=UX141ICJS2G6 tag=96FWD92T2YKX type=write size=3035108 2024-09-12T00:17:23.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.254+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~R4P00DDDE3KM.0 size=1048576 2024-09-12T00:17:23.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.258+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~R4P00DDDE3KM.1 size=844126 2024-09-12T00:17:23.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.262+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=R4P00DDDE3KM tag=2CKU39GAA357 type=write size=2941278 2024-09-12T00:17:23.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.270+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~AZYYJL3F5RB5.0 size=1048576 2024-09-12T00:17:23.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.270+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~AZYYJL3F5RB5.1 size=1048576 2024-09-12T00:17:23.273 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.274+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~AZYYJL3F5RB5.2 size=7297 2024-09-12T00:17:23.273 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.274+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=AZYYJL3F5RB5 tag=UWRB0WES1MWB type=write size=3153025 2024-09-12T00:17:23.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.278+0000 7febed3678c0 1 < completed write operation key=8RVDLW1VC8LP tag=MHF7NUPAE41P type=write size=315664 2024-09-12T00:17:23.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.282+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~O3KII2NX3ZET.0 size=1048576 2024-09-12T00:17:23.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.286+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~O3KII2NX3ZET.1 size=1048576 2024-09-12T00:17:23.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.290+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~O3KII2NX3ZET.2 size=128842 2024-09-12T00:17:23.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.290+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=O3KII2NX3ZET tag=XFYIVZBY124P type=write size=3274570 2024-09-12T00:17:23.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.294+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~QECOKDO1ESAF.0 size=1048576 2024-09-12T00:17:23.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.294+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~QECOKDO1ESAF.1 size=241901 2024-09-12T00:17:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.302+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=QECOKDO1ESAF tag=HW2NY4TCXB14 type=write size=2339053 2024-09-12T00:17:23.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.306+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~L7W0607DICU7.0 size=1048576 2024-09-12T00:17:23.308 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.310+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~L7W0607DICU7.1 size=341517 2024-09-12T00:17:23.308 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.310+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=L7W0607DICU7 tag=8D32P20YF4UK type=write size=2438669 2024-09-12T00:17:23.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.310+0000 7febed3678c0 1 < completed write operation key=8RVDLW1VC8LP tag=6SA7HNIPPS7A type=write size=56307 2024-09-12T00:17:23.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.318+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~DPPJWQ3TGX2U.0 size=1048576 2024-09-12T00:17:23.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.318+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~DPPJWQ3TGX2U.1 size=355421 2024-09-12T00:17:23.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.318+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=DPPJWQ3TGX2U tag=RDLI4KGLJP4S type=write size=2452573 2024-09-12T00:17:23.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.322+0000 7febed3678c0 1 < completed write operation key=KABJD0GYBVF4 tag=5Y9QQC0Z6P5K type=write size=426023 2024-09-12T00:17:23.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.326+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=NDBN4UZFBFR3 type=del size=1220361 2024-09-12T00:17:23.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.326+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~LRCOGLKR16FB.0 size=1048576 2024-09-12T00:17:23.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.330+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~LRCOGLKR16FB.1 size=1048576 2024-09-12T00:17:23.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.334+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~LRCOGLKR16FB.2 size=788417 2024-09-12T00:17:23.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.338+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=LRCOGLKR16FB tag=LL6G7D1VH5ND type=write size=3934145 2024-09-12T00:17:23.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.342+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=A71M1SAIZT6F type=del size=2586022 2024-09-12T00:17:23.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.346+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~UYQR2SYSTWKH.0 size=1048576 2024-09-12T00:17:23.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.346+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~UYQR2SYSTWKH.1 size=1048576 2024-09-12T00:17:23.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.350+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~UYQR2SYSTWKH.2 size=987415 2024-09-12T00:17:23.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.354+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=UYQR2SYSTWKH tag=0I1HR7P2L70W type=write size=4133143 2024-09-12T00:17:23.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.358+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~8SDNUXP8DXF1.0 size=1048576 2024-09-12T00:17:23.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.362+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~8SDNUXP8DXF1.1 size=1048576 2024-09-12T00:17:23.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.366+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~8SDNUXP8DXF1.2 size=221806 2024-09-12T00:17:23.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.366+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=8SDNUXP8DXF1 tag=B2C5AC0UY72Y type=write size=3367534 2024-09-12T00:17:23.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.370+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~DT5DTIXVUN2K.0 size=1048576 2024-09-12T00:17:23.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.370+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~DT5DTIXVUN2K.1 size=767423 2024-09-12T00:17:23.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.378+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=DT5DTIXVUN2K tag=RAHXK7MMX5IN type=write size=2864575 2024-09-12T00:17:23.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.382+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=KOFZI2MCBW9K type=del size=481313 2024-09-12T00:17:23.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.386+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~761HRU9Y1JO0.0 size=512954 2024-09-12T00:17:23.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.390+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=761HRU9Y1JO0 tag=IGLOYHVQ56OJ type=write size=1561530 2024-09-12T00:17:23.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.394+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=4NDL47JGPZSI type=del size=764030 2024-09-12T00:17:23.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.398+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~G0IBAIHANRG1.0 size=1048576 2024-09-12T00:17:23.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.398+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~G0IBAIHANRG1.1 size=1048576 2024-09-12T00:17:23.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.402+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~G0IBAIHANRG1.2 size=492711 2024-09-12T00:17:23.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.406+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=G0IBAIHANRG1 tag=9HVZBUPIGA3Z type=write size=3638439 2024-09-12T00:17:23.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.414+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~S2TN9J08LTWM.0 size=1048576 2024-09-12T00:17:23.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.414+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~S2TN9J08LTWM.1 size=1048576 2024-09-12T00:17:23.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.418+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~S2TN9J08LTWM.2 size=443243 2024-09-12T00:17:23.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.418+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=S2TN9J08LTWM tag=423F8MLCLL0R type=write size=3588971 2024-09-12T00:17:23.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.422+0000 7febed3678c0 1 < suggested remove operation key=KABJD0GYBVF4 tag=391FN49YORLA type=write 2024-09-12T00:17:23.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.426+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=I0FL72Z76UMJ type=del size=2974491 2024-09-12T00:17:23.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.430+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=N8DWKYZCJAS4 type=del 2024-09-12T00:17:23.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.434+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~7W0O16IY6311.0 size=1048576 2024-09-12T00:17:23.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.434+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~7W0O16IY6311.1 size=433700 2024-09-12T00:17:23.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.434+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=7W0O16IY6311 tag=EJC2UNBG97VD type=write size=2530852 2024-09-12T00:17:23.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.438+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=KF7MAXM8KRA2 type=del 2024-09-12T00:17:23.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.438+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=YZ4KJBK6Z5OG type=del size=937964 2024-09-12T00:17:23.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.446+0000 7febed3678c0 1 < suggested update operation key=88BY5RHXSHD4 tag=BLHSM40OEQ05 type=write size=749614 2024-09-12T00:17:23.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.450+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=B6YEL69DTHMC type=del size=3365379 2024-09-12T00:17:23.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.450+0000 7febed3678c0 1 < canceled operation key=4K65QIB9F00S tag=PABD2FTWMB5L type=del size=3019494 2024-09-12T00:17:23.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.454+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=8FUO8I5Z4NL0 type=del size=550967 2024-09-12T00:17:23.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.458+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~UX141ICJS2G6.0 size=1048576 2024-09-12T00:17:23.458 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.458+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~UX141ICJS2G6.1 size=937956 2024-09-12T00:17:23.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.462+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=UX141ICJS2G6 tag=96FWD92T2YKX type=write size=3035108 2024-09-12T00:17:23.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.470+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~N9BE9ZXR2OM8.0 size=43239 2024-09-12T00:17:23.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.470+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=N9BE9ZXR2OM8 tag=AEB3YLZCHE87 type=write size=1091815 2024-09-12T00:17:23.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.470+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~AZYYJL3F5RB5.0 size=1048576 2024-09-12T00:17:23.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.474+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~AZYYJL3F5RB5.1 size=1048576 2024-09-12T00:17:23.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.474+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~AZYYJL3F5RB5.2 size=7297 2024-09-12T00:17:23.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.478+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=AZYYJL3F5RB5 tag=UWRB0WES1MWB type=write size=3153025 2024-09-12T00:17:23.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.486+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~M85Q3AHX0CQZ.0 size=1048576 2024-09-12T00:17:23.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.486+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~M85Q3AHX0CQZ.1 size=1048576 2024-09-12T00:17:23.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.490+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~M85Q3AHX0CQZ.2 size=443982 2024-09-12T00:17:23.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.490+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=M85Q3AHX0CQZ tag=EVIOOKCFQ8TI type=write size=3589710 2024-09-12T00:17:23.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.494+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~O3KII2NX3ZET.0 size=1048576 2024-09-12T00:17:23.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.494+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~O3KII2NX3ZET.1 size=1048576 2024-09-12T00:17:23.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.498+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~O3KII2NX3ZET.2 size=128842 2024-09-12T00:17:23.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.502+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=O3KII2NX3ZET tag=XFYIVZBY124P type=write size=3274570 2024-09-12T00:17:23.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.506+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~VAFLLH4RH7YK.0 size=1048576 2024-09-12T00:17:23.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.510+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~VAFLLH4RH7YK.1 size=1048576 2024-09-12T00:17:23.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.510+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~VAFLLH4RH7YK.2 size=408874 2024-09-12T00:17:23.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.510+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=VAFLLH4RH7YK tag=97HD00J5ADZT type=write size=3554602 2024-09-12T00:17:23.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.514+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~L7W0607DICU7.0 size=1048576 2024-09-12T00:17:23.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.514+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~L7W0607DICU7.1 size=341517 2024-09-12T00:17:23.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.522+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=L7W0607DICU7 tag=8D32P20YF4UK type=write size=2438669 2024-09-12T00:17:23.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.522+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=EU6ZPKQPMDUR type=del size=2088690 2024-09-12T00:17:23.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.526+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~DPPJWQ3TGX2U.0 size=1048576 2024-09-12T00:17:23.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.530+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~DPPJWQ3TGX2U.1 size=355421 2024-09-12T00:17:23.532 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.534+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=DPPJWQ3TGX2U tag=RDLI4KGLJP4S type=write size=2452573 2024-09-12T00:17:23.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.538+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=QG8569JIE0V2 type=del size=2580255 2024-09-12T00:17:23.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.542+0000 7febed3678c0 1 < suggested update operation key=W2VEW3JJEJY7 tag=NDBN4UZFBFR3 type=del size=1220361 2024-09-12T00:17:23.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.550+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~3VS5OLYKH7PU.0 size=1048576 2024-09-12T00:17:23.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.550+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~3VS5OLYKH7PU.1 size=1048576 2024-09-12T00:17:23.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.554+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~3VS5OLYKH7PU.2 size=229441 2024-09-12T00:17:23.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.554+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=3VS5OLYKH7PU tag=6ZKJFK9JMCAL type=write size=3375169 2024-09-12T00:17:23.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.558+0000 7febed3678c0 1 < suggested remove operation key=AHTIFXX3SGK7 tag=A71M1SAIZT6F type=del 2024-09-12T00:17:23.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.562+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=3XOHARIEHUEC type=del size=1215094 2024-09-12T00:17:23.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.566+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~8SDNUXP8DXF1.0 size=1048576 2024-09-12T00:17:23.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.566+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~8SDNUXP8DXF1.1 size=1048576 2024-09-12T00:17:23.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.570+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~8SDNUXP8DXF1.2 size=221806 2024-09-12T00:17:23.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.574+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=8SDNUXP8DXF1 tag=B2C5AC0UY72Y type=write size=3367534 2024-09-12T00:17:23.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.578+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~SSRHWHHX8WUH.0 size=1048576 2024-09-12T00:17:23.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.582+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~SSRHWHHX8WUH.1 size=1048576 2024-09-12T00:17:23.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.586+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~SSRHWHHX8WUH.2 size=618959 2024-09-12T00:17:23.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.586+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=SSRHWHHX8WUH tag=YNL42C0X3CX6 type=write size=3764687 2024-09-12T00:17:23.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.586+0000 7febed3678c0 1 < canceled operation key=MLPN8PH72VQ9 tag=KOFZI2MCBW9K type=del size=481313 2024-09-12T00:17:23.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.590+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=MUGEHXSGFDBW type=write size=650724 2024-09-12T00:17:23.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.594+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=4NDL47JGPZSI type=del 2024-09-12T00:17:23.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.598+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=51EYVI8JYCP5 type=write size=292771 2024-09-12T00:17:23.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.598+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~S2TN9J08LTWM.0 size=1048576 2024-09-12T00:17:23.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.602+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~S2TN9J08LTWM.1 size=1048576 2024-09-12T00:17:23.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.606+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~S2TN9J08LTWM.2 size=443243 2024-09-12T00:17:23.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.610+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=S2TN9J08LTWM tag=423F8MLCLL0R type=write size=3588971 2024-09-12T00:17:23.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.614+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=J5ADXDX2QWEC type=del size=2329493 2024-09-12T00:17:23.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.622+0000 7febed3678c0 1 < suggested remove operation key=9HCKHF5ZRZ5N tag=I0FL72Z76UMJ type=del 2024-09-12T00:17:23.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.626+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=22RLA23ECQJC type=write size=28472 2024-09-12T00:17:23.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.630+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~7W0O16IY6311.0 size=1048576 2024-09-12T00:17:23.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.630+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~7W0O16IY6311.1 size=433700 2024-09-12T00:17:23.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.638+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=7W0O16IY6311 tag=EJC2UNBG97VD type=write size=2530852 2024-09-12T00:17:23.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.642+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=63QGFZ08CUQT type=del size=2843714 2024-09-12T00:17:23.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.642+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=YZ4KJBK6Z5OG type=del 2024-09-12T00:17:23.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.650+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~02Z2QQ15E9MB.0 size=1048576 2024-09-12T00:17:23.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.654+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~02Z2QQ15E9MB.1 size=1048576 2024-09-12T00:17:23.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.654+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~02Z2QQ15E9MB.2 size=788901 2024-09-12T00:17:23.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.654+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=02Z2QQ15E9MB tag=N4QLXO00LZ8H type=write size=3934629 2024-09-12T00:17:23.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.658+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=B6YEL69DTHMC type=del 2024-09-12T00:17:23.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.666+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~V9T6RWWFG2U0.0 size=1048576 2024-09-12T00:17:23.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.666+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~V9T6RWWFG2U0.1 size=760431 2024-09-12T00:17:23.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.666+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=V9T6RWWFG2U0 tag=BDM1K7NL6UVO type=write size=2857583 2024-09-12T00:17:23.674 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.674+0000 7febed3678c0 1 < suggested remove operation key=VU1AF57EUA0R tag=8FUO8I5Z4NL0 type=del 2024-09-12T00:17:23.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.678+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=XH7LR9SHE8Y9 type=write size=26462 2024-09-12T00:17:23.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.682+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~N9BE9ZXR2OM8.0 size=43239 2024-09-12T00:17:23.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.686+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=N9BE9ZXR2OM8 tag=AEB3YLZCHE87 type=write size=1091815 2024-09-12T00:17:23.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.690+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=J20F7GYAOKOO type=del size=3572308 2024-09-12T00:17:23.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.694+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~M85Q3AHX0CQZ.0 size=1048576 2024-09-12T00:17:23.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.698+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~M85Q3AHX0CQZ.1 size=1048576 2024-09-12T00:17:23.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.698+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~M85Q3AHX0CQZ.2 size=443982 2024-09-12T00:17:23.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.706+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=M85Q3AHX0CQZ tag=EVIOOKCFQ8TI type=write size=3589710 2024-09-12T00:17:23.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.706+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=ZWJRGNVK9TTS type=del size=773338 2024-09-12T00:17:23.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.710+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~VAFLLH4RH7YK.0 size=1048576 2024-09-12T00:17:23.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.710+0000 7febed3678c0 1 < canceled part key=_multipart_MHS307JKNVCK.2~VAFLLH4RH7YK.1 size=1048576 2024-09-12T00:17:23.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.714+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~VAFLLH4RH7YK.2 size=408874 2024-09-12T00:17:23.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.718+0000 7febed3678c0 1 < canceled multipart upload key=MHS307JKNVCK upload=VAFLLH4RH7YK tag=97HD00J5ADZT type=write size=3554602 2024-09-12T00:17:23.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.722+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=5CPPO0Q0THT2 type=del size=3016719 2024-09-12T00:17:23.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.726+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=EU6ZPKQPMDUR type=del 2024-09-12T00:17:23.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.734+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~VKM7HYU1X0JB.0 size=1048576 2024-09-12T00:17:23.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.734+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~VKM7HYU1X0JB.1 size=277989 2024-09-12T00:17:23.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.734+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=VKM7HYU1X0JB tag=ADXN9BLW6DP9 type=write size=2375141 2024-09-12T00:17:23.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.738+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=QG8569JIE0V2 type=del 2024-09-12T00:17:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.742+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=MH922GPIJ0FR type=write size=122599 2024-09-12T00:17:23.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.746+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~3VS5OLYKH7PU.0 size=1048576 2024-09-12T00:17:23.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.750+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~3VS5OLYKH7PU.1 size=1048576 2024-09-12T00:17:23.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.754+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~3VS5OLYKH7PU.2 size=229441 2024-09-12T00:17:23.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.758+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=3VS5OLYKH7PU tag=6ZKJFK9JMCAL type=write size=3375169 2024-09-12T00:17:23.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.766+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~WZ49PVXUNAI5.0 size=1048576 2024-09-12T00:17:23.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.770+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~WZ49PVXUNAI5.1 size=280100 2024-09-12T00:17:23.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.770+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=WZ49PVXUNAI5 tag=03UGV1XW1RZA type=write size=2377252 2024-09-12T00:17:23.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.778+0000 7febed3678c0 1 < suggested remove operation key=W2VEW3JJEJY7 tag=3XOHARIEHUEC type=del 2024-09-12T00:17:23.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.782+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=6T5HK6I0UZ69 type=del size=386119 2024-09-12T00:17:23.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.786+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~SSRHWHHX8WUH.0 size=1048576 2024-09-12T00:17:23.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.790+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~SSRHWHHX8WUH.1 size=1048576 2024-09-12T00:17:23.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.790+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~SSRHWHHX8WUH.2 size=618959 2024-09-12T00:17:23.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.798+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=SSRHWHHX8WUH tag=YNL42C0X3CX6 type=write size=3764687 2024-09-12T00:17:23.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.798+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=1RGAIIMMR1CP type=write size=225901 2024-09-12T00:17:23.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.802+0000 7febed3678c0 -1 < failed to complete operation key=9HCKHF5ZRZ5N tag=MUGEHXSGFDBW type=write size=650724: (22) Invalid argument 2024-09-12T00:17:23.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.806+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=FGTC8DIDQLY1 type=del size=3736940 2024-09-12T00:17:23.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.810+0000 7febed3678c0 1 < canceled operation key=70W3V7TFBUFJ tag=51EYVI8JYCP5 type=write size=292771 2024-09-12T00:17:23.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.814+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=WQYP0NVXF0V8 type=del size=986268 2024-09-12T00:17:23.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.818+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=J5ADXDX2QWEC type=del 2024-09-12T00:17:23.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.822+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=PDBPQAGENU3K type=del size=2720115 2024-09-12T00:17:23.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.822+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=22RLA23ECQJC type=write size=28472 2024-09-12T00:17:23.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.826+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=50U4QDTIZDQN type=del size=271027 2024-09-12T00:17:23.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.830+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=63QGFZ08CUQT type=del 2024-09-12T00:17:23.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.838+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~BQNVYL4RAQD4.0 size=1048576 2024-09-12T00:17:23.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.838+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~BQNVYL4RAQD4.1 size=1048576 2024-09-12T00:17:23.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.842+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~BQNVYL4RAQD4.2 size=1046115 2024-09-12T00:17:23.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.842+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=BQNVYL4RAQD4 tag=ROVVJBSH6TID type=write size=4191843 2024-09-12T00:17:23.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.846+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~02Z2QQ15E9MB.0 size=1048576 2024-09-12T00:17:23.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.846+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~02Z2QQ15E9MB.1 size=1048576 2024-09-12T00:17:23.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.850+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~02Z2QQ15E9MB.2 size=788901 2024-09-12T00:17:23.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.854+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=02Z2QQ15E9MB tag=N4QLXO00LZ8H type=write size=3934629 2024-09-12T00:17:23.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.858+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=SOES2VPBKXV2 type=write size=47410 2024-09-12T00:17:23.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.862+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~V9T6RWWFG2U0.0 size=1048576 2024-09-12T00:17:23.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.866+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~V9T6RWWFG2U0.1 size=760431 2024-09-12T00:17:23.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.870+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=V9T6RWWFG2U0 tag=BDM1K7NL6UVO type=write size=2857583 2024-09-12T00:17:23.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.874+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=TEMLDS3DPGRN type=write size=781064 2024-09-12T00:17:23.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.878+0000 7febed3678c0 1 < completed write operation key=0KQK1CXHO096 tag=XH7LR9SHE8Y9 type=write size=26462 2024-09-12T00:17:23.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.878+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=WX4UP5NTLPS3 type=del size=3996971 2024-09-12T00:17:23.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.882+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=J20F7GYAOKOO type=del 2024-09-12T00:17:23.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.890+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~FTIMQXSS1JKU.0 size=683888 2024-09-12T00:17:23.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.890+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=FTIMQXSS1JKU tag=2KXNQ16AC2XJ type=write size=1732464 2024-09-12T00:17:23.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.890+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=ZWJRGNVK9TTS type=del 2024-09-12T00:17:23.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.898+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~5EEKAFJGZ55S.0 size=1048576 2024-09-12T00:17:23.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.898+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~5EEKAFJGZ55S.1 size=813784 2024-09-12T00:17:23.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.898+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=5EEKAFJGZ55S tag=1S246NYLTNUZ type=write size=2910936 2024-09-12T00:17:23.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.902+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=5CPPO0Q0THT2 type=del 2024-09-12T00:17:23.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.906+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=28BNXN196O51 type=del size=3374176 2024-09-12T00:17:23.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.910+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~VKM7HYU1X0JB.0 size=1048576 2024-09-12T00:17:23.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.910+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~VKM7HYU1X0JB.1 size=277989 2024-09-12T00:17:23.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.918+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=VKM7HYU1X0JB tag=ADXN9BLW6DP9 type=write size=2375141 2024-09-12T00:17:23.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.922+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=L3RDY5KBUU8I type=del size=3613598 2024-09-12T00:17:23.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.926+0000 7febed3678c0 1 < completed write operation key=3G9ABEEEDRI3 tag=MH922GPIJ0FR type=write size=122599 2024-09-12T00:17:23.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.926+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=WWSHD9RI2J8M type=del size=1293190 2024-09-12T00:17:23.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.930+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~WZ49PVXUNAI5.0 size=1048576 2024-09-12T00:17:23.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.934+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~WZ49PVXUNAI5.1 size=280100 2024-09-12T00:17:23.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.938+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=WZ49PVXUNAI5 tag=03UGV1XW1RZA type=write size=2377252 2024-09-12T00:17:23.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.942+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=WCOSFVV66DSP type=del size=1887707 2024-09-12T00:17:23.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.946+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=6T5HK6I0UZ69 type=del 2024-09-12T00:17:23.949 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.950+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~1EWGJNB1SVPT.0 size=1048576 2024-09-12T00:17:23.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.954+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~1EWGJNB1SVPT.1 size=1048576 2024-09-12T00:17:23.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.954+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~1EWGJNB1SVPT.2 size=810780 2024-09-12T00:17:23.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.954+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=1EWGJNB1SVPT tag=3UVDIDYAWH9P type=write size=3956508 2024-09-12T00:17:23.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.962+0000 7febed3678c0 1 < suggested update operation key=MAZHOU2CEUCU tag=1RGAIIMMR1CP type=write size=225901 2024-09-12T00:17:23.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.962+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=PQEUZ6DXKEIQ type=del size=1885215 2024-09-12T00:17:23.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.966+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=FGTC8DIDQLY1 type=del 2024-09-12T00:17:23.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.970+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=8I6PK231OLAN type=del size=942268 2024-09-12T00:17:23.972 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.974+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=WQYP0NVXF0V8 type=del 2024-09-12T00:17:23.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.978+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~7E4T1VB51SZD.0 size=1048576 2024-09-12T00:17:23.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.982+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~7E4T1VB51SZD.1 size=295002 2024-09-12T00:17:23.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.982+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=7E4T1VB51SZD tag=5ER17C9E77YF type=write size=2392154 2024-09-12T00:17:23.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.986+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=PDBPQAGENU3K type=del 2024-09-12T00:17:23.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.990+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=KGVTR6P9DM1N type=del size=177713 2024-09-12T00:17:23.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.990+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=50U4QDTIZDQN type=del 2024-09-12T00:17:23.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.994+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=7CVAJA8I3DJU type=del size=2128650 2024-09-12T00:17:23.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.998+0000 7febed3678c0 1 < canceled part key=_multipart_3G9ABEEEDRI3.2~BQNVYL4RAQD4.0 size=1048576 2024-09-12T00:17:23.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.998+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~BQNVYL4RAQD4.1 size=1048576 2024-09-12T00:17:23.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:23.998+0000 7febed3678c0 1 < canceled part key=_multipart_3G9ABEEEDRI3.2~BQNVYL4RAQD4.2 size=1046115 2024-09-12T00:17:24.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.002+0000 7febed3678c0 1 < canceled multipart upload key=3G9ABEEEDRI3 upload=BQNVYL4RAQD4 tag=ROVVJBSH6TID type=write size=4191843 2024-09-12T00:17:24.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.010+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~Q04BQE93BV4A.0 size=1048576 2024-09-12T00:17:24.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.014+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~Q04BQE93BV4A.1 size=808954 2024-09-12T00:17:24.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.014+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=Q04BQE93BV4A tag=6N6S880EMIZ8 type=write size=2906106 2024-09-12T00:17:24.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.014+0000 7febed3678c0 1 < completed write operation key=KABJD0GYBVF4 tag=SOES2VPBKXV2 type=write size=47410 2024-09-12T00:17:24.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.022+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~I2GUNH831FRH.0 size=1048576 2024-09-12T00:17:24.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.026+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~I2GUNH831FRH.1 size=554282 2024-09-12T00:17:24.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.026+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=I2GUNH831FRH tag=7TEUZCU1DSPG type=write size=2651434 2024-09-12T00:17:24.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.030+0000 7febed3678c0 1 < completed write operation key=9CBI4FHAT3H2 tag=TEMLDS3DPGRN type=write size=781064 2024-09-12T00:17:24.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.030+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=JQ0HFRQISQED type=del size=146978 2024-09-12T00:17:24.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.034+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=WX4UP5NTLPS3 type=del 2024-09-12T00:17:24.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.038+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=DWDZE2T7RSNI type=del size=770144 2024-09-12T00:17:24.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.038+0000 7febed3678c0 1 < canceled part key=_multipart_G22WTRRGIQKE.2~FTIMQXSS1JKU.0 size=683888 2024-09-12T00:17:24.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.042+0000 7febed3678c0 1 < canceled multipart upload key=G22WTRRGIQKE upload=FTIMQXSS1JKU tag=2KXNQ16AC2XJ type=write size=1732464 2024-09-12T00:17:24.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.046+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=FXQF83JFV376 type=del size=3713724 2024-09-12T00:17:24.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.050+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~5EEKAFJGZ55S.0 size=1048576 2024-09-12T00:17:24.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.050+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~5EEKAFJGZ55S.1 size=813784 2024-09-12T00:17:24.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.058+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=5EEKAFJGZ55S tag=1S246NYLTNUZ type=write size=2910936 2024-09-12T00:17:24.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.062+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~C97EP8UVF7L3.0 size=1048576 2024-09-12T00:17:24.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.066+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~C97EP8UVF7L3.1 size=1017874 2024-09-12T00:17:24.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.066+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=C97EP8UVF7L3 tag=K8UPN9VFOBB1 type=write size=3115026 2024-09-12T00:17:24.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.066+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=28BNXN196O51 type=del 2024-09-12T00:17:24.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.070+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=AVYON4C6QMZZ type=write size=538835 2024-09-12T00:17:24.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.074+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=L3RDY5KBUU8I type=del 2024-09-12T00:17:24.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.078+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=QS99EMEW7KGI type=del size=3357038 2024-09-12T00:17:24.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.082+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=WWSHD9RI2J8M type=del 2024-09-12T00:17:24.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.086+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=SZ383N0QQ5T5 type=del size=3936261 2024-09-12T00:17:24.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.094+0000 7febed3678c0 1 < suggested update operation key=LGFKY0CP299H tag=WCOSFVV66DSP type=del size=1887707 2024-09-12T00:17:24.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.094+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=1SDZ6XDXMUWL type=del size=1209563 2024-09-12T00:17:24.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.098+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~1EWGJNB1SVPT.0 size=1048576 2024-09-12T00:17:24.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.102+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~1EWGJNB1SVPT.1 size=1048576 2024-09-12T00:17:24.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.106+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~1EWGJNB1SVPT.2 size=810780 2024-09-12T00:17:24.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.110+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=1EWGJNB1SVPT tag=3UVDIDYAWH9P type=write size=3956508 2024-09-12T00:17:24.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.118+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~P96YV9FC2SNL.0 size=775871 2024-09-12T00:17:24.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.118+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=P96YV9FC2SNL tag=VNYD4CBYF7IP type=write size=1824447 2024-09-12T00:17:24.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.122+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=PQEUZ6DXKEIQ type=del 2024-09-12T00:17:24.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.126+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=RUFSMX7DDTJP type=write size=987960 2024-09-12T00:17:24.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.130+0000 7febed3678c0 1 < suggested update operation key=UGV3WQR0ADYH tag=8I6PK231OLAN type=del size=942268 2024-09-12T00:17:24.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.134+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=2HYPCRQGAU2L type=write size=4054 2024-09-12T00:17:24.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.138+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~7E4T1VB51SZD.0 size=1048576 2024-09-12T00:17:24.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.138+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~7E4T1VB51SZD.1 size=295002 2024-09-12T00:17:24.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.146+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=7E4T1VB51SZD tag=5ER17C9E77YF type=write size=2392154 2024-09-12T00:17:24.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.150+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~H97OU1YEC4HU.0 size=1048576 2024-09-12T00:17:24.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.154+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~H97OU1YEC4HU.1 size=1048576 2024-09-12T00:17:24.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.154+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~H97OU1YEC4HU.2 size=723984 2024-09-12T00:17:24.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.154+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=H97OU1YEC4HU tag=HEB0KZXPJRF8 type=write size=3869712 2024-09-12T00:17:24.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.158+0000 7febed3678c0 -1 < failed to complete operation key=UGV3WQR0ADYH tag=KGVTR6P9DM1N type=del size=177713: (22) Invalid argument 2024-09-12T00:17:24.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.166+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~R0DHLM5BY4S5.0 size=207923 2024-09-12T00:17:24.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.166+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=R0DHLM5BY4S5 tag=9FT3LJP4WYT2 type=write size=1256499 2024-09-12T00:17:24.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.166+0000 7febed3678c0 1 < canceled operation key=Z020UV2JRR0I tag=7CVAJA8I3DJU type=del size=2128650 2024-09-12T00:17:24.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.170+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=CO1J0H020A2D type=write size=12656 2024-09-12T00:17:24.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.174+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~Q04BQE93BV4A.0 size=1048576 2024-09-12T00:17:24.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.178+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~Q04BQE93BV4A.1 size=808954 2024-09-12T00:17:24.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.182+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=Q04BQE93BV4A tag=6N6S880EMIZ8 type=write size=2906106 2024-09-12T00:17:24.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.186+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=0YKURFJJD1EJ type=write size=963386 2024-09-12T00:17:24.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.190+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~I2GUNH831FRH.0 size=1048576 2024-09-12T00:17:24.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.190+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~I2GUNH831FRH.1 size=554282 2024-09-12T00:17:24.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.198+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=I2GUNH831FRH tag=7TEUZCU1DSPG type=write size=2651434 2024-09-12T00:17:24.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.198+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=HF3VU9LKW3IW type=del size=4145593 2024-09-12T00:17:24.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.202+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=JQ0HFRQISQED type=del 2024-09-12T00:17:24.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.210+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~44PVYHY71HO1.0 size=1048576 2024-09-12T00:17:24.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.210+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~44PVYHY71HO1.1 size=621435 2024-09-12T00:17:24.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.210+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=44PVYHY71HO1 tag=9FRCCVL73MLF type=write size=2718587 2024-09-12T00:17:24.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.214+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=DWDZE2T7RSNI type=del 2024-09-12T00:17:24.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.218+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=AVV28NPBUAYY type=del size=1947961 2024-09-12T00:17:24.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.222+0000 7febed3678c0 -1 < failed to complete operation key=LGFKY0CP299H tag=FXQF83JFV376 type=del size=3713724: (22) Invalid argument 2024-09-12T00:17:24.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.226+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=KJI769EYUVGZ type=del size=2137612 2024-09-12T00:17:24.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.226+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~C97EP8UVF7L3.0 size=1048576 2024-09-12T00:17:24.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.230+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~C97EP8UVF7L3.1 size=1017874 2024-09-12T00:17:24.234 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.234+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=C97EP8UVF7L3 tag=K8UPN9VFOBB1 type=write size=3115026 2024-09-12T00:17:24.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.238+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=JZMXGO0QXBAC type=del size=1675251 2024-09-12T00:17:24.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.242+0000 7febed3678c0 1 < completed write operation key=52SSW5KTCS15 tag=AVYON4C6QMZZ type=write size=538835 2024-09-12T00:17:24.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.246+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~9K9EKSIP8KG8.0 size=1048576 2024-09-12T00:17:24.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.250+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~9K9EKSIP8KG8.1 size=1032359 2024-09-12T00:17:24.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.250+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=9K9EKSIP8KG8 tag=2LSHJFJG0N6Q type=write size=3129511 2024-09-12T00:17:24.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.250+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=QS99EMEW7KGI type=del 2024-09-12T00:17:24.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.254+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=DPUR8OUKG815 type=del size=879881 2024-09-12T00:17:24.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.258+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=SZ383N0QQ5T5 type=del 2024-09-12T00:17:24.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.262+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=DMQ83YU8C0IJ type=del size=1120094 2024-09-12T00:17:24.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.262+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=1SDZ6XDXMUWL type=del 2024-09-12T00:17:24.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.266+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=TC0CAV8G7OW3 type=del size=919354 2024-09-12T00:17:24.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.270+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~P96YV9FC2SNL.0 size=775871 2024-09-12T00:17:24.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.274+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=P96YV9FC2SNL tag=VNYD4CBYF7IP type=write size=1824447 2024-09-12T00:17:24.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.278+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=I40YN6F4G22O type=del size=3515796 2024-09-12T00:17:24.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.282+0000 7febed3678c0 1 < completed write operation key=1HABX7YZ491W tag=RUFSMX7DDTJP type=write size=987960 2024-09-12T00:17:24.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.286+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=7N9SFOVFEB0F type=del size=2099777 2024-09-12T00:17:24.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.290+0000 7febed3678c0 1 < completed write operation key=70W3V7TFBUFJ tag=2HYPCRQGAU2L type=write size=4054 2024-09-12T00:17:24.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.294+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=N7KOLHAQWI97 type=del size=4108755 2024-09-12T00:17:24.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.294+0000 7febed3678c0 1 < canceled part key=_multipart_KABJD0GYBVF4.2~H97OU1YEC4HU.0 size=1048576 2024-09-12T00:17:24.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.298+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~H97OU1YEC4HU.1 size=1048576 2024-09-12T00:17:24.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.298+0000 7febed3678c0 1 < canceled part key=_multipart_KABJD0GYBVF4.2~H97OU1YEC4HU.2 size=723984 2024-09-12T00:17:24.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.302+0000 7febed3678c0 1 < canceled multipart upload key=KABJD0GYBVF4 upload=H97OU1YEC4HU tag=HEB0KZXPJRF8 type=write size=3869712 2024-09-12T00:17:24.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.306+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=CB2KY9H50XA4 type=del size=2226734 2024-09-12T00:17:24.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.310+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~R0DHLM5BY4S5.0 size=207923 2024-09-12T00:17:24.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.314+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=R0DHLM5BY4S5 tag=9FT3LJP4WYT2 type=write size=1256499 2024-09-12T00:17:24.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.318+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=3PDG96MTMEX5 type=del size=1236777 2024-09-12T00:17:24.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.326+0000 7febed3678c0 1 < suggested remove operation key=4K65QIB9F00S tag=CO1J0H020A2D type=write 2024-09-12T00:17:24.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.330+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=0C4VX9PB4V2W type=del size=2642895 2024-09-12T00:17:24.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.334+0000 7febed3678c0 1 < completed write operation key=MHS307JKNVCK tag=0YKURFJJD1EJ type=write size=963386 2024-09-12T00:17:24.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.338+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=VD9MO28QYGZ1 type=del size=2320651 2024-09-12T00:17:24.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.342+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=HF3VU9LKW3IW type=del 2024-09-12T00:17:24.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.346+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~Y26AHFQQMAN0.0 size=825899 2024-09-12T00:17:24.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.346+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=Y26AHFQQMAN0 tag=GPR3R0RZDYSZ type=write size=1874475 2024-09-12T00:17:24.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.350+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~44PVYHY71HO1.0 size=1048576 2024-09-12T00:17:24.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.354+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~44PVYHY71HO1.1 size=621435 2024-09-12T00:17:24.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.358+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=44PVYHY71HO1 tag=9FRCCVL73MLF type=write size=2718587 2024-09-12T00:17:24.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.358+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=HK782284JOWO type=del size=3972993 2024-09-12T00:17:24.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.362+0000 7febed3678c0 1 < canceled operation key=ELNXYXX5ZWOW tag=AVV28NPBUAYY type=del size=1947961 2024-09-12T00:17:24.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.366+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=J2CH6W1G6JN7 type=write size=196691 2024-09-12T00:17:24.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.370+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=KJI769EYUVGZ type=del 2024-09-12T00:17:24.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.374+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~TFXXYR4TR7YB.0 size=1048576 2024-09-12T00:17:24.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.378+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~TFXXYR4TR7YB.1 size=1048576 2024-09-12T00:17:24.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.378+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~TFXXYR4TR7YB.2 size=156735 2024-09-12T00:17:24.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.378+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=TFXXYR4TR7YB tag=CN1CAS2LD2WY type=write size=3302463 2024-09-12T00:17:24.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.382+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=JZMXGO0QXBAC type=del 2024-09-12T00:17:24.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.386+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=Z7XM5ZF18PXV type=del size=1102662 2024-09-12T00:17:24.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.390+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~9K9EKSIP8KG8.0 size=1048576 2024-09-12T00:17:24.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.398+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~9K9EKSIP8KG8.1 size=1032359 2024-09-12T00:17:24.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.402+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=9K9EKSIP8KG8 tag=2LSHJFJG0N6Q type=write size=3129511 2024-09-12T00:17:24.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.406+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=GILAW9NFPV2C type=del size=188726 2024-09-12T00:17:24.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.410+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=DPUR8OUKG815 type=del 2024-09-12T00:17:24.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.418+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~2OV79R50XQ3K.0 size=1048576 2024-09-12T00:17:24.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.418+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~2OV79R50XQ3K.1 size=668655 2024-09-12T00:17:24.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.418+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=2OV79R50XQ3K tag=UC8JGTQIC45S type=write size=2765807 2024-09-12T00:17:24.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.426+0000 7febed3678c0 1 < suggested remove operation key=1HABX7YZ491W tag=DMQ83YU8C0IJ type=del 2024-09-12T00:17:24.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.430+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=I7WDAFA2B2BI type=del size=2692534 2024-09-12T00:17:24.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.438+0000 7febed3678c0 1 < suggested update operation key=KLO47UYYACLU tag=TC0CAV8G7OW3 type=del size=919354 2024-09-12T00:17:24.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.438+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=TK6H7QFUOCMZ type=del size=2249480 2024-09-12T00:17:24.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.446+0000 7febed3678c0 1 < suggested remove operation key=9HCKHF5ZRZ5N tag=I40YN6F4G22O type=del 2024-09-12T00:17:24.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.450+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=HJATQPSID40D type=del size=1436420 2024-09-12T00:17:24.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.454+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=7N9SFOVFEB0F type=del 2024-09-12T00:17:24.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.458+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=LS62XOHZ1P8H type=del size=1817334 2024-09-12T00:17:24.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.458+0000 7febed3678c0 1 < canceled operation key=88BY5RHXSHD4 tag=N7KOLHAQWI97 type=del size=4108755 2024-09-12T00:17:24.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.462+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=SS0Q0D670MTM type=del size=3880238 2024-09-12T00:17:24.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.466+0000 7febed3678c0 1 < suggested update operation key=MHS307JKNVCK tag=CB2KY9H50XA4 type=del size=2226734 2024-09-12T00:17:24.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.470+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=VSD8PC65AEW1 type=del size=1688927 2024-09-12T00:17:24.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.474+0000 7febed3678c0 -1 < failed to complete operation key=4K65QIB9F00S tag=3PDG96MTMEX5 type=del size=1236777: (22) Invalid argument 2024-09-12T00:17:24.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.474+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=T372J74CD73N type=del size=2632995 2024-09-12T00:17:24.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.478+0000 7febed3678c0 1 < canceled operation key=MAZHOU2CEUCU tag=0C4VX9PB4V2W type=del size=2642895 2024-09-12T00:17:24.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.482+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~W6H56XAJT4HD.0 size=1048576 2024-09-12T00:17:24.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.486+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~W6H56XAJT4HD.1 size=28457 2024-09-12T00:17:24.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.486+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=W6H56XAJT4HD tag=UWMHZDJWUV8J type=write size=2125609 2024-09-12T00:17:24.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.490+0000 7febed3678c0 -1 < failed to complete operation key=1HABX7YZ491W tag=VD9MO28QYGZ1 type=del size=2320651: (22) Invalid argument 2024-09-12T00:17:24.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.490+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=1HY1ICU5O9LW type=del size=2266873 2024-09-12T00:17:24.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.494+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~Y26AHFQQMAN0.0 size=825899 2024-09-12T00:17:24.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.498+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=Y26AHFQQMAN0 tag=GPR3R0RZDYSZ type=write size=1874475 2024-09-12T00:17:24.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.502+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~GR74U9ULKKE7.0 size=1048576 2024-09-12T00:17:24.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.506+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~GR74U9ULKKE7.1 size=49998 2024-09-12T00:17:24.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.506+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=GR74U9ULKKE7 tag=GU5EOUCGBPGX type=write size=2147150 2024-09-12T00:17:24.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.510+0000 7febed3678c0 1 < canceled operation key=88BY5RHXSHD4 tag=HK782284JOWO type=del size=3972993 2024-09-12T00:17:24.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.510+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=25A7GVZ4XEZS type=del size=1208887 2024-09-12T00:17:24.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.514+0000 7febed3678c0 -1 < failed to complete operation key=9HCKHF5ZRZ5N tag=J2CH6W1G6JN7 type=write size=196691: (22) Invalid argument 2024-09-12T00:17:24.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.514+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=4XYL7QRU4NUX type=del size=1621979 2024-09-12T00:17:24.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.518+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~TFXXYR4TR7YB.0 size=1048576 2024-09-12T00:17:24.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.522+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~TFXXYR4TR7YB.1 size=1048576 2024-09-12T00:17:24.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.522+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~TFXXYR4TR7YB.2 size=156735 2024-09-12T00:17:24.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.526+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=TFXXYR4TR7YB tag=CN1CAS2LD2WY type=write size=3302463 2024-09-12T00:17:24.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.534+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~GIWUX17I3HIZ.0 size=1048576 2024-09-12T00:17:24.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.534+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~GIWUX17I3HIZ.1 size=1048576 2024-09-12T00:17:24.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.538+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~GIWUX17I3HIZ.2 size=295736 2024-09-12T00:17:24.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.538+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=GIWUX17I3HIZ tag=5JPV670NDRDY type=write size=3441464 2024-09-12T00:17:24.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.538+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=Z7XM5ZF18PXV type=del 2024-09-12T00:17:24.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.542+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=85WNCI30NRG4 type=del size=1211848 2024-09-12T00:17:24.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.542+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=GILAW9NFPV2C type=del 2024-09-12T00:17:24.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.546+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=56DQ2NOZBG9Y type=write size=273300 2024-09-12T00:17:24.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.550+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~2OV79R50XQ3K.0 size=1048576 2024-09-12T00:17:24.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.550+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~2OV79R50XQ3K.1 size=668655 2024-09-12T00:17:24.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.554+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=2OV79R50XQ3K tag=UC8JGTQIC45S type=write size=2765807 2024-09-12T00:17:24.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.562+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~188RTB5A6AFV.0 size=352997 2024-09-12T00:17:24.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.562+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=188RTB5A6AFV tag=AR1JYYGIKP3G type=write size=1401573 2024-09-12T00:17:24.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.566+0000 7febed3678c0 1 < suggested remove operation key=W2VEW3JJEJY7 tag=I7WDAFA2B2BI type=del 2024-09-12T00:17:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.570+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~3ZYUNMI47Z2Y.0 size=149895 2024-09-12T00:17:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.570+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=3ZYUNMI47Z2Y tag=GMYBB95RW61O type=write size=1198471 2024-09-12T00:17:24.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.574+0000 7febed3678c0 -1 < failed to complete operation key=W2VEW3JJEJY7 tag=TK6H7QFUOCMZ type=del size=2249480: (22) Invalid argument 2024-09-12T00:17:24.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.582+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~E2L8Z8FW8ZET.0 size=1048576 2024-09-12T00:17:24.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.582+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~E2L8Z8FW8ZET.1 size=1048576 2024-09-12T00:17:24.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.586+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~E2L8Z8FW8ZET.2 size=986300 2024-09-12T00:17:24.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.586+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=E2L8Z8FW8ZET tag=7TOB48S8L3ZN type=write size=4132028 2024-09-12T00:17:24.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.586+0000 7febed3678c0 -1 < no bi entry to suggest for operation key=W2VEW3JJEJY7 tag=HJATQPSID40D type=del size=1436420: (2) No such file or directory 2024-09-12T00:17:24.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.590+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=5V47UNAA210T type=write size=760525 2024-09-12T00:17:24.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.590+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=LS62XOHZ1P8H type=del 2024-09-12T00:17:24.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.594+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=RM39HN7PGWCH type=del size=1941606 2024-09-12T00:17:24.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.598+0000 7febed3678c0 1 < canceled operation key=KABJD0GYBVF4 tag=SS0Q0D670MTM type=del size=3880238 2024-09-12T00:17:24.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.602+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=005KK3HDB7AG type=write size=770553 2024-09-12T00:17:24.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.602+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=VSD8PC65AEW1 type=del 2024-09-12T00:17:24.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.606+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~QQI2IXU37T3O.0 size=886301 2024-09-12T00:17:24.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.606+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=QQI2IXU37T3O tag=R4DAVXYA2AVF type=write size=1934877 2024-09-12T00:17:24.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.614+0000 7febed3678c0 1 < suggested update operation key=MAZHOU2CEUCU tag=T372J74CD73N type=del size=2632995 2024-09-12T00:17:24.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.618+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~VQZM3L9WAGTR.0 size=938282 2024-09-12T00:17:24.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.618+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=VQZM3L9WAGTR tag=611STTZXRPQR type=write size=1986858 2024-09-12T00:17:24.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.622+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~W6H56XAJT4HD.0 size=1048576 2024-09-12T00:17:24.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.622+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~W6H56XAJT4HD.1 size=28457 2024-09-12T00:17:24.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.630+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=W6H56XAJT4HD tag=UWMHZDJWUV8J type=write size=2125609 2024-09-12T00:17:24.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.634+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~PJJXNEI277PZ.0 size=1048576 2024-09-12T00:17:24.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.638+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~PJJXNEI277PZ.1 size=1048576 2024-09-12T00:17:24.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.638+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~PJJXNEI277PZ.2 size=164002 2024-09-12T00:17:24.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.638+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=PJJXNEI277PZ tag=3B3EQRIBJX5M type=write size=3309730 2024-09-12T00:17:24.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.642+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=1HY1ICU5O9LW type=del 2024-09-12T00:17:24.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.650+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~06TSPEBDRU59.0 size=1048576 2024-09-12T00:17:24.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.650+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~06TSPEBDRU59.1 size=242626 2024-09-12T00:17:24.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.650+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=06TSPEBDRU59 tag=145USJ3D0D2H type=write size=2339778 2024-09-12T00:17:24.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.654+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~GR74U9ULKKE7.0 size=1048576 2024-09-12T00:17:24.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.654+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~GR74U9ULKKE7.1 size=49998 2024-09-12T00:17:24.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.662+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=GR74U9ULKKE7 tag=GU5EOUCGBPGX type=write size=2147150 2024-09-12T00:17:24.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.666+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~5LLZ286A6ROR.0 size=1048576 2024-09-12T00:17:24.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.670+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~5LLZ286A6ROR.1 size=1048576 2024-09-12T00:17:24.672 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.674+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~5LLZ286A6ROR.2 size=80092 2024-09-12T00:17:24.672 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.674+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=5LLZ286A6ROR tag=JJYLN0LLOU5J type=write size=3225820 2024-09-12T00:17:24.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.674+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=25A7GVZ4XEZS type=del 2024-09-12T00:17:24.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.678+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=0NJ6XL1EGZ03 type=del size=869127 2024-09-12T00:17:24.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.682+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=4XYL7QRU4NUX type=del 2024-09-12T00:17:24.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.686+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~BBI1NTJU54EU.0 size=1048576 2024-09-12T00:17:24.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.690+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~BBI1NTJU54EU.1 size=1048576 2024-09-12T00:17:24.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.690+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~BBI1NTJU54EU.2 size=145141 2024-09-12T00:17:24.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.690+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=BBI1NTJU54EU tag=GZQC007BN3WO type=write size=3290869 2024-09-12T00:17:24.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.694+0000 7febed3678c0 1 < canceled part key=_multipart_9CBI4FHAT3H2.2~GIWUX17I3HIZ.0 size=1048576 2024-09-12T00:17:24.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.694+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~GIWUX17I3HIZ.1 size=1048576 2024-09-12T00:17:24.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.698+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~GIWUX17I3HIZ.2 size=295736 2024-09-12T00:17:24.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.702+0000 7febed3678c0 1 < canceled multipart upload key=9CBI4FHAT3H2 upload=GIWUX17I3HIZ tag=5JPV670NDRDY type=write size=3441464 2024-09-12T00:17:24.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.706+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~RH11IE97X32M.0 size=1048576 2024-09-12T00:17:24.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.710+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~RH11IE97X32M.1 size=230692 2024-09-12T00:17:24.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.710+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=RH11IE97X32M tag=1EONAL25X74Q type=write size=2327844 2024-09-12T00:17:24.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.714+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=85WNCI30NRG4 type=del 2024-09-12T00:17:24.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.718+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~EKYOIF6FYWF6.0 size=620149 2024-09-12T00:17:24.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.718+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=EKYOIF6FYWF6 tag=KOQOGCJ52N5V type=write size=1668725 2024-09-12T00:17:24.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.722+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=56DQ2NOZBG9Y type=write size=273300 2024-09-12T00:17:24.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.726+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~5W71M67L9KSE.0 size=813144 2024-09-12T00:17:24.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.726+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=5W71M67L9KSE tag=13M085GSAHOK type=write size=1861720 2024-09-12T00:17:24.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.730+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~188RTB5A6AFV.0 size=352997 2024-09-12T00:17:24.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.734+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=188RTB5A6AFV tag=AR1JYYGIKP3G type=write size=1401573 2024-09-12T00:17:24.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.738+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=JUGFPXTWGYUS type=del size=1816969 2024-09-12T00:17:24.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.738+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~3ZYUNMI47Z2Y.0 size=149895 2024-09-12T00:17:24.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.746+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=3ZYUNMI47Z2Y tag=GMYBB95RW61O type=write size=1198471 2024-09-12T00:17:24.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.750+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=QERUXTRCQM45 type=write size=368461 2024-09-12T00:17:24.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.750+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~E2L8Z8FW8ZET.0 size=1048576 2024-09-12T00:17:24.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.754+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~E2L8Z8FW8ZET.1 size=1048576 2024-09-12T00:17:24.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.758+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~E2L8Z8FW8ZET.2 size=986300 2024-09-12T00:17:24.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.762+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=E2L8Z8FW8ZET tag=7TOB48S8L3ZN type=write size=4132028 2024-09-12T00:17:24.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.766+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~SMNTPJRDSQ5V.0 size=1048576 2024-09-12T00:17:24.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.766+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~SMNTPJRDSQ5V.1 size=1048576 2024-09-12T00:17:24.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.770+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~SMNTPJRDSQ5V.2 size=951656 2024-09-12T00:17:24.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.770+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=SMNTPJRDSQ5V tag=HDRFJEZIZM29 type=write size=4097384 2024-09-12T00:17:24.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.774+0000 7febed3678c0 1 < completed write operation key=H017KWW59B8Z tag=5V47UNAA210T type=write size=760525 2024-09-12T00:17:24.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.778+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~97Q05KIPTJFF.0 size=1048576 2024-09-12T00:17:24.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.782+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~97Q05KIPTJFF.1 size=593689 2024-09-12T00:17:24.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.782+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=97Q05KIPTJFF tag=IDEHESLMYV6T type=write size=2690841 2024-09-12T00:17:24.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.786+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=RM39HN7PGWCH type=del 2024-09-12T00:17:24.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.790+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~6STXVKIUYW35.0 size=837231 2024-09-12T00:17:24.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.790+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=6STXVKIUYW35 tag=ER3CBMKF42IV type=write size=1885807 2024-09-12T00:17:24.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.794+0000 7febed3678c0 1 < completed write operation key=52SSW5KTCS15 tag=005KK3HDB7AG type=write size=770553 2024-09-12T00:17:24.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.798+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~6TY0I3K1VI9V.0 size=1048576 2024-09-12T00:17:24.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.798+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~6TY0I3K1VI9V.1 size=1048576 2024-09-12T00:17:24.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.802+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~6TY0I3K1VI9V.2 size=558867 2024-09-12T00:17:24.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.802+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=6TY0I3K1VI9V tag=CCN2MFWSV13W type=write size=3704595 2024-09-12T00:17:24.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.806+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~QQI2IXU37T3O.0 size=886301 2024-09-12T00:17:24.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.810+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=QQI2IXU37T3O tag=R4DAVXYA2AVF type=write size=1934877 2024-09-12T00:17:24.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.810+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=YIH9TWMK7W69 type=del size=3586086 2024-09-12T00:17:24.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.814+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~VQZM3L9WAGTR.0 size=938282 2024-09-12T00:17:24.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.818+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=VQZM3L9WAGTR tag=611STTZXRPQR type=write size=1986858 2024-09-12T00:17:24.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.822+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=NF3E2WDTBIJE type=del size=121221 2024-09-12T00:17:24.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.826+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~PJJXNEI277PZ.0 size=1048576 2024-09-12T00:17:24.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.826+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~PJJXNEI277PZ.1 size=1048576 2024-09-12T00:17:24.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.830+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~PJJXNEI277PZ.2 size=164002 2024-09-12T00:17:24.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.834+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=PJJXNEI277PZ tag=3B3EQRIBJX5M type=write size=3309730 2024-09-12T00:17:24.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.838+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=EX86ZI0JFQT0 type=del size=4054004 2024-09-12T00:17:24.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.838+0000 7febed3678c0 1 < canceled part key=_multipart_Z020UV2JRR0I.2~06TSPEBDRU59.0 size=1048576 2024-09-12T00:17:24.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.842+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~06TSPEBDRU59.1 size=242626 2024-09-12T00:17:24.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.846+0000 7febed3678c0 1 < canceled multipart upload key=Z020UV2JRR0I upload=06TSPEBDRU59 tag=145USJ3D0D2H type=write size=2339778 2024-09-12T00:17:24.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.850+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=UM93UNHHH6K9 type=del size=2581347 2024-09-12T00:17:24.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.854+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~5LLZ286A6ROR.0 size=1048576 2024-09-12T00:17:24.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.854+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~5LLZ286A6ROR.1 size=1048576 2024-09-12T00:17:24.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.858+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~5LLZ286A6ROR.2 size=80092 2024-09-12T00:17:24.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.862+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=5LLZ286A6ROR tag=JJYLN0LLOU5J type=write size=3225820 2024-09-12T00:17:24.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.866+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~QWRJ1DF08HY2.0 size=1048576 2024-09-12T00:17:24.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.870+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~QWRJ1DF08HY2.1 size=1048576 2024-09-12T00:17:24.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.874+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~QWRJ1DF08HY2.2 size=280234 2024-09-12T00:17:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.874+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=QWRJ1DF08HY2 tag=MA8WKQ157RJ2 type=write size=3425962 2024-09-12T00:17:24.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.874+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=0NJ6XL1EGZ03 type=del 2024-09-12T00:17:24.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.878+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~FP05JAH89I9W.0 size=364696 2024-09-12T00:17:24.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.878+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=FP05JAH89I9W tag=LY7H8YEJ36AL type=write size=1413272 2024-09-12T00:17:24.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.882+0000 7febed3678c0 1 < canceled part key=_multipart_8RVDLW1VC8LP.2~BBI1NTJU54EU.0 size=1048576 2024-09-12T00:17:24.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.882+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~BBI1NTJU54EU.1 size=1048576 2024-09-12T00:17:24.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.882+0000 7febed3678c0 1 < canceled part key=_multipart_8RVDLW1VC8LP.2~BBI1NTJU54EU.2 size=145141 2024-09-12T00:17:24.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.886+0000 7febed3678c0 1 < canceled multipart upload key=8RVDLW1VC8LP upload=BBI1NTJU54EU tag=GZQC007BN3WO type=write size=3290869 2024-09-12T00:17:24.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.890+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=CIPMBHYSH1D1 type=del size=949922 2024-09-12T00:17:24.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.894+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~RH11IE97X32M.0 size=1048576 2024-09-12T00:17:24.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.898+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~RH11IE97X32M.1 size=230692 2024-09-12T00:17:24.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.902+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=RH11IE97X32M tag=1EONAL25X74Q type=write size=2327844 2024-09-12T00:17:24.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.906+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~N1CSCM4R333A.0 size=1048576 2024-09-12T00:17:24.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.910+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~N1CSCM4R333A.1 size=1048576 2024-09-12T00:17:24.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.910+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~N1CSCM4R333A.2 size=638017 2024-09-12T00:17:24.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.910+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=N1CSCM4R333A tag=GTYPYWNV9B6N type=write size=3783745 2024-09-12T00:17:24.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.914+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~EKYOIF6FYWF6.0 size=620149 2024-09-12T00:17:24.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.918+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=EKYOIF6FYWF6 tag=KOQOGCJ52N5V type=write size=1668725 2024-09-12T00:17:24.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.926+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~YF6I3W40CHS0.0 size=1048576 2024-09-12T00:17:24.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.926+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~YF6I3W40CHS0.1 size=518385 2024-09-12T00:17:24.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.926+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=YF6I3W40CHS0 tag=J2UICK4LC578 type=write size=2615537 2024-09-12T00:17:24.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.930+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~5W71M67L9KSE.0 size=813144 2024-09-12T00:17:24.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.938+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=5W71M67L9KSE tag=13M085GSAHOK type=write size=1861720 2024-09-12T00:17:24.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.942+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=NML0HO2Z0OWV type=write size=448306 2024-09-12T00:17:24.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.946+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=JUGFPXTWGYUS type=del 2024-09-12T00:17:24.947 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.946+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=YG513GJQKGZ0 type=del size=2601655 2024-09-12T00:17:24.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.950+0000 7febed3678c0 1 < completed write operation key=25THATWGX4WS tag=QERUXTRCQM45 type=write size=368461 2024-09-12T00:17:24.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.954+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=FNPP445CP8OK type=del size=2642412 2024-09-12T00:17:24.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.958+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~SMNTPJRDSQ5V.0 size=1048576 2024-09-12T00:17:24.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.958+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~SMNTPJRDSQ5V.1 size=1048576 2024-09-12T00:17:24.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.962+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~SMNTPJRDSQ5V.2 size=951656 2024-09-12T00:17:24.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.966+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=SMNTPJRDSQ5V tag=HDRFJEZIZM29 type=write size=4097384 2024-09-12T00:17:24.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.970+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=KFCSM19K5E6F type=del size=2327728 2024-09-12T00:17:24.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.974+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~97Q05KIPTJFF.0 size=1048576 2024-09-12T00:17:24.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.978+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~97Q05KIPTJFF.1 size=593689 2024-09-12T00:17:24.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.982+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=97Q05KIPTJFF tag=IDEHESLMYV6T type=write size=2690841 2024-09-12T00:17:24.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.990+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~IQ9QTBEYE4D1.0 size=842059 2024-09-12T00:17:24.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.990+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=IQ9QTBEYE4D1 tag=JJQGIAIKGXZW type=write size=1890635 2024-09-12T00:17:24.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.994+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~6STXVKIUYW35.0 size=837231 2024-09-12T00:17:24.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:24.998+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=6STXVKIUYW35 tag=ER3CBMKF42IV type=write size=1885807 2024-09-12T00:17:25.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.002+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KCZUTO6UZU1F.0 size=1048576 2024-09-12T00:17:25.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.006+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KCZUTO6UZU1F.1 size=418936 2024-09-12T00:17:25.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.006+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=KCZUTO6UZU1F tag=7J1CAN7BGHO2 type=write size=2516088 2024-09-12T00:17:25.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.010+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~6TY0I3K1VI9V.0 size=1048576 2024-09-12T00:17:25.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.010+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~6TY0I3K1VI9V.1 size=1048576 2024-09-12T00:17:25.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.014+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~6TY0I3K1VI9V.2 size=558867 2024-09-12T00:17:25.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.018+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=6TY0I3K1VI9V tag=CCN2MFWSV13W type=write size=3704595 2024-09-12T00:17:25.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.022+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=WY15096NPENX type=del size=272129 2024-09-12T00:17:25.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.026+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=YIH9TWMK7W69 type=del 2024-09-12T00:17:25.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.034+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~TEASKMKXZRSK.0 size=1048576 2024-09-12T00:17:25.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.034+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~TEASKMKXZRSK.1 size=1048576 2024-09-12T00:17:25.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.038+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~TEASKMKXZRSK.2 size=924455 2024-09-12T00:17:25.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.038+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=TEASKMKXZRSK tag=EWWSGBRZCE27 type=write size=4070183 2024-09-12T00:17:25.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.042+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=NF3E2WDTBIJE type=del 2024-09-12T00:17:25.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.046+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=NGWFNKE16HZX type=del size=2444750 2024-09-12T00:17:25.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.050+0000 7febed3678c0 1 < suggested remove operation key=AHTIFXX3SGK7 tag=EX86ZI0JFQT0 type=del 2024-09-12T00:17:25.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.054+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=40UR0L45DOVD type=del size=524133 2024-09-12T00:17:25.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.062+0000 7febed3678c0 1 < suggested update operation key=KABJD0GYBVF4 tag=UM93UNHHH6K9 type=del size=2581347 2024-09-12T00:17:25.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.066+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~Z9DXMYDCVPAQ.0 size=1048576 2024-09-12T00:17:25.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.070+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~Z9DXMYDCVPAQ.1 size=1048576 2024-09-12T00:17:25.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.070+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~Z9DXMYDCVPAQ.2 size=664391 2024-09-12T00:17:25.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.070+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=Z9DXMYDCVPAQ tag=JDHQSY17WG57 type=write size=3810119 2024-09-12T00:17:25.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.074+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~QWRJ1DF08HY2.0 size=1048576 2024-09-12T00:17:25.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.078+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~QWRJ1DF08HY2.1 size=1048576 2024-09-12T00:17:25.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.078+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~QWRJ1DF08HY2.2 size=280234 2024-09-12T00:17:25.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.086+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=QWRJ1DF08HY2 tag=MA8WKQ157RJ2 type=write size=3425962 2024-09-12T00:17:25.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.090+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=EB2QKT4N7BM3 type=del size=2812339 2024-09-12T00:17:25.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.094+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~FP05JAH89I9W.0 size=364696 2024-09-12T00:17:25.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.098+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=FP05JAH89I9W tag=LY7H8YEJ36AL type=write size=1413272 2024-09-12T00:17:25.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.102+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=V2XZR9J6B8MP type=del size=1719431 2024-09-12T00:17:25.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.106+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=CIPMBHYSH1D1 type=del 2024-09-12T00:17:25.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.110+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=LX8KR4UN39PZ type=write size=580730 2024-09-12T00:17:25.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.110+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~N1CSCM4R333A.0 size=1048576 2024-09-12T00:17:25.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.114+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~N1CSCM4R333A.1 size=1048576 2024-09-12T00:17:25.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.118+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~N1CSCM4R333A.2 size=638017 2024-09-12T00:17:25.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.122+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=N1CSCM4R333A tag=GTYPYWNV9B6N type=write size=3783745 2024-09-12T00:17:25.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.130+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~CTP5PSYFTND6.0 size=1048576 2024-09-12T00:17:25.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.130+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~CTP5PSYFTND6.1 size=364795 2024-09-12T00:17:25.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.130+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=CTP5PSYFTND6 tag=ST4SJY49HP50 type=write size=2461947 2024-09-12T00:17:25.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.134+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~YF6I3W40CHS0.0 size=1048576 2024-09-12T00:17:25.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.138+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~YF6I3W40CHS0.1 size=518385 2024-09-12T00:17:25.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.142+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=YF6I3W40CHS0 tag=J2UICK4LC578 type=write size=2615537 2024-09-12T00:17:25.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.146+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=DGB8SA14GKDG type=del size=875462 2024-09-12T00:17:25.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.150+0000 7febed3678c0 1 < suggested remove operation key=HR9MVC82R7GL tag=NML0HO2Z0OWV type=write 2024-09-12T00:17:25.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.154+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=ZQDK7WQQFJZW type=del size=3999325 2024-09-12T00:17:25.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.158+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=YG513GJQKGZ0 type=del 2024-09-12T00:17:25.159 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.158+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=TGBWXHYJ001U type=del size=3519505 2024-09-12T00:17:25.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.162+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=FNPP445CP8OK type=del 2024-09-12T00:17:25.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.166+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=QWG7CMZPE29D type=del size=2137603 2024-09-12T00:17:25.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.170+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=KFCSM19K5E6F type=del 2024-09-12T00:17:25.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.174+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~54FDFVU4FQUX.0 size=1048576 2024-09-12T00:17:25.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.178+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~54FDFVU4FQUX.1 size=1048576 2024-09-12T00:17:25.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.178+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~54FDFVU4FQUX.2 size=115131 2024-09-12T00:17:25.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.178+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=54FDFVU4FQUX tag=CE61ALCJQDPI type=write size=3260859 2024-09-12T00:17:25.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.182+0000 7febed3678c0 1 < canceled part key=_multipart_25THATWGX4WS.2~IQ9QTBEYE4D1.0 size=842059 2024-09-12T00:17:25.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.186+0000 7febed3678c0 1 < canceled multipart upload key=25THATWGX4WS upload=IQ9QTBEYE4D1 tag=JJQGIAIKGXZW type=write size=1890635 2024-09-12T00:17:25.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.190+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=LL89J6NLMIXO type=del size=1170340 2024-09-12T00:17:25.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.190+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~KCZUTO6UZU1F.0 size=1048576 2024-09-12T00:17:25.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.194+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~KCZUTO6UZU1F.1 size=418936 2024-09-12T00:17:25.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.198+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=KCZUTO6UZU1F tag=7J1CAN7BGHO2 type=write size=2516088 2024-09-12T00:17:25.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.202+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=4ZD64UI4TB17 type=del size=2551116 2024-09-12T00:17:25.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.206+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=WY15096NPENX type=del 2024-09-12T00:17:25.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.210+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=RATY242FYVXS type=del size=1649405 2024-09-12T00:17:25.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.210+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~TEASKMKXZRSK.0 size=1048576 2024-09-12T00:17:25.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.214+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~TEASKMKXZRSK.1 size=1048576 2024-09-12T00:17:25.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.214+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~TEASKMKXZRSK.2 size=924455 2024-09-12T00:17:25.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.222+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=TEASKMKXZRSK tag=EWWSGBRZCE27 type=write size=4070183 2024-09-12T00:17:25.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.230+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~34R0803YSY2M.0 size=160752 2024-09-12T00:17:25.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.230+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=34R0803YSY2M tag=N0E7J5KLKBKU type=write size=1209328 2024-09-12T00:17:25.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.234+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=NGWFNKE16HZX type=del 2024-09-12T00:17:25.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.238+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~9V2Q3LJCDFQF.0 size=1048576 2024-09-12T00:17:25.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.242+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~9V2Q3LJCDFQF.1 size=324628 2024-09-12T00:17:25.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.242+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=9V2Q3LJCDFQF tag=1HHH5NCGO8BS type=write size=2421780 2024-09-12T00:17:25.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.242+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=40UR0L45DOVD type=del 2024-09-12T00:17:25.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.246+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=VWAU1S8EFPV0 type=del size=2014314 2024-09-12T00:17:25.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.250+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~Z9DXMYDCVPAQ.0 size=1048576 2024-09-12T00:17:25.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.254+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~Z9DXMYDCVPAQ.1 size=1048576 2024-09-12T00:17:25.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.254+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~Z9DXMYDCVPAQ.2 size=664391 2024-09-12T00:17:25.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.258+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=Z9DXMYDCVPAQ tag=JDHQSY17WG57 type=write size=3810119 2024-09-12T00:17:25.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.262+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=2UIZFA97JJ8Q type=del size=1886198 2024-09-12T00:17:25.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.266+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=EB2QKT4N7BM3 type=del 2024-09-12T00:17:25.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.266+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=ZU0DLH2FYKDN type=write size=148296 2024-09-12T00:17:25.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.270+0000 7febed3678c0 1 < canceled operation key=3G9ABEEEDRI3 tag=V2XZR9J6B8MP type=del size=1719431 2024-09-12T00:17:25.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.274+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~LVRS2EDILCRX.0 size=1048576 2024-09-12T00:17:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.278+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~LVRS2EDILCRX.1 size=497766 2024-09-12T00:17:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.278+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=LVRS2EDILCRX tag=K7DQUIHBH5H4 type=write size=2594918 2024-09-12T00:17:25.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.282+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=LX8KR4UN39PZ type=write size=580730 2024-09-12T00:17:25.284 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.286+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=3G59C1G6P74Q type=del size=3763889 2024-09-12T00:17:25.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.290+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~CTP5PSYFTND6.0 size=1048576 2024-09-12T00:17:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.290+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~CTP5PSYFTND6.1 size=364795 2024-09-12T00:17:25.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.294+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=CTP5PSYFTND6 tag=ST4SJY49HP50 type=write size=2461947 2024-09-12T00:17:25.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.302+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~DPKVKQ7YMY6Q.0 size=163306 2024-09-12T00:17:25.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.302+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=DPKVKQ7YMY6Q tag=NSHK9P8V295J type=write size=1211882 2024-09-12T00:17:25.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.302+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=DGB8SA14GKDG type=del 2024-09-12T00:17:25.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.306+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=HFZ7P7R712SG type=write size=878244 2024-09-12T00:17:25.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.310+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=ZQDK7WQQFJZW type=del 2024-09-12T00:17:25.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.314+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~NF38UJERWW85.0 size=1048576 2024-09-12T00:17:25.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.318+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~NF38UJERWW85.1 size=789461 2024-09-12T00:17:25.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.318+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=NF38UJERWW85 tag=HLL4M4D9DPWN type=write size=2886613 2024-09-12T00:17:25.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.318+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=TGBWXHYJ001U type=del 2024-09-12T00:17:25.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.322+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=KEG4ZAUFKS85 type=del size=431462 2024-09-12T00:17:25.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.326+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=QWG7CMZPE29D type=del 2024-09-12T00:17:25.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.330+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~UBU7EYOF2144.0 size=593992 2024-09-12T00:17:25.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.330+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=UBU7EYOF2144 tag=SQ1MIZXUJOBJ type=write size=1642568 2024-09-12T00:17:25.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.334+0000 7febed3678c0 1 < canceled part key=_multipart_HR9MVC82R7GL.2~54FDFVU4FQUX.0 size=1048576 2024-09-12T00:17:25.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.334+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~54FDFVU4FQUX.1 size=1048576 2024-09-12T00:17:25.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.338+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~54FDFVU4FQUX.2 size=115131 2024-09-12T00:17:25.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.342+0000 7febed3678c0 1 < canceled multipart upload key=HR9MVC82R7GL upload=54FDFVU4FQUX tag=CE61ALCJQDPI type=write size=3260859 2024-09-12T00:17:25.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.350+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~ZSU8TT0Q71YF.0 size=1048576 2024-09-12T00:17:25.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.350+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~ZSU8TT0Q71YF.1 size=1048576 2024-09-12T00:17:25.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.354+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~ZSU8TT0Q71YF.2 size=277251 2024-09-12T00:17:25.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.354+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=ZSU8TT0Q71YF tag=857US9N21JBU type=write size=3422979 2024-09-12T00:17:25.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.354+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=LL89J6NLMIXO type=del 2024-09-12T00:17:25.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.358+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=Q0Q3FYT3MWUV type=del size=2684900 2024-09-12T00:17:25.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.362+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=4ZD64UI4TB17 type=del 2024-09-12T00:17:25.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.366+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=A63UGGS05R50 type=write size=387157 2024-09-12T00:17:25.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.366+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=RATY242FYVXS type=del 2024-09-12T00:17:25.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.370+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=5E50019WQEE6 type=del size=4133055 2024-09-12T00:17:25.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.374+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~34R0803YSY2M.0 size=160752 2024-09-12T00:17:25.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.378+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=34R0803YSY2M tag=N0E7J5KLKBKU type=write size=1209328 2024-09-12T00:17:25.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.382+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=3XSX9M49GWKL type=del size=1754672 2024-09-12T00:17:25.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.386+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~9V2Q3LJCDFQF.0 size=1048576 2024-09-12T00:17:25.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.386+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~9V2Q3LJCDFQF.1 size=324628 2024-09-12T00:17:25.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.394+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=9V2Q3LJCDFQF tag=1HHH5NCGO8BS type=write size=2421780 2024-09-12T00:17:25.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.394+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=VDYCIY9M2RXF type=del size=4136543 2024-09-12T00:17:25.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.402+0000 7febed3678c0 1 < suggested update operation key=MLPN8PH72VQ9 tag=VWAU1S8EFPV0 type=del size=2014314 2024-09-12T00:17:25.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.406+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=LQ2B2O020S8H type=del size=501860 2024-09-12T00:17:25.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.406+0000 7febed3678c0 1 < canceled operation key=AHTIFXX3SGK7 tag=2UIZFA97JJ8Q type=del size=1886198 2024-09-12T00:17:25.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.414+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~7VCL4OOOWT1F.0 size=1048576 2024-09-12T00:17:25.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.418+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~7VCL4OOOWT1F.1 size=1048576 2024-09-12T00:17:25.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.418+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~7VCL4OOOWT1F.2 size=523563 2024-09-12T00:17:25.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.418+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=7VCL4OOOWT1F tag=RA5605EOAWE5 type=write size=3669291 2024-09-12T00:17:25.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.422+0000 7febed3678c0 1 < completed write operation key=W2VEW3JJEJY7 tag=ZU0DLH2FYKDN type=write size=148296 2024-09-12T00:17:25.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.426+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=ECC825PHP3PI type=del size=4042883 2024-09-12T00:17:25.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.426+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~LVRS2EDILCRX.0 size=1048576 2024-09-12T00:17:25.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.430+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~LVRS2EDILCRX.1 size=497766 2024-09-12T00:17:25.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.434+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=LVRS2EDILCRX tag=K7DQUIHBH5H4 type=write size=2594918 2024-09-12T00:17:25.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.438+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=DI1YQNVIH0X2 type=write size=754565 2024-09-12T00:17:25.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.442+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=3G59C1G6P74Q type=del 2024-09-12T00:17:25.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.446+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~M140IC9CP9KM.0 size=1048576 2024-09-12T00:17:25.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.450+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~M140IC9CP9KM.1 size=1048576 2024-09-12T00:17:25.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.454+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~M140IC9CP9KM.2 size=533401 2024-09-12T00:17:25.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.454+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=M140IC9CP9KM tag=E56FPQFYEJV8 type=write size=3679129 2024-09-12T00:17:25.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.454+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~DPKVKQ7YMY6Q.0 size=163306 2024-09-12T00:17:25.458 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.458+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=DPKVKQ7YMY6Q tag=NSHK9P8V295J type=write size=1211882 2024-09-12T00:17:25.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.462+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=J23MOFC38JI3 type=del size=3077158 2024-09-12T00:17:25.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.462+0000 7febed3678c0 1 < completed write operation key=UGV3WQR0ADYH tag=HFZ7P7R712SG type=write size=878244 2024-09-12T00:17:25.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.466+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=DJ20IWFUHW7X type=write size=944543 2024-09-12T00:17:25.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.470+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~NF38UJERWW85.0 size=1048576 2024-09-12T00:17:25.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.470+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~NF38UJERWW85.1 size=789461 2024-09-12T00:17:25.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.474+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=NF38UJERWW85 tag=HLL4M4D9DPWN type=write size=2886613 2024-09-12T00:17:25.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.478+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=353KMU1H9X7I type=del size=1025954 2024-09-12T00:17:25.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.482+0000 7febed3678c0 1 < canceled operation key=MHS307JKNVCK tag=KEG4ZAUFKS85 type=del size=431462 2024-09-12T00:17:25.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.486+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=LG0B7D4ZQ5EY type=del size=2071268 2024-09-12T00:17:25.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.486+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~UBU7EYOF2144.0 size=593992 2024-09-12T00:17:25.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.494+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=UBU7EYOF2144 tag=SQ1MIZXUJOBJ type=write size=1642568 2024-09-12T00:17:25.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.498+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~VF4BQH3EMUCT.0 size=488836 2024-09-12T00:17:25.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.498+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=VF4BQH3EMUCT tag=VGPEQD7GVE45 type=write size=1537412 2024-09-12T00:17:25.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.502+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~ZSU8TT0Q71YF.0 size=1048576 2024-09-12T00:17:25.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.506+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~ZSU8TT0Q71YF.1 size=1048576 2024-09-12T00:17:25.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.510+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~ZSU8TT0Q71YF.2 size=277251 2024-09-12T00:17:25.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.514+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=ZSU8TT0Q71YF tag=857US9N21JBU type=write size=3422979 2024-09-12T00:17:25.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.518+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=ECU3EOIAL4N8 type=write size=539059 2024-09-12T00:17:25.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.522+0000 7febed3678c0 -1 < failed to complete operation key=MLPN8PH72VQ9 tag=Q0Q3FYT3MWUV type=del size=2684900: (22) Invalid argument 2024-09-12T00:17:25.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.526+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=HGKU7LWXZSDR type=del size=1002108 2024-09-12T00:17:25.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.530+0000 7febed3678c0 1 < completed write operation key=25THATWGX4WS tag=A63UGGS05R50 type=write size=387157 2024-09-12T00:17:25.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.534+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~L2KHZ8BNWEMS.0 size=1048576 2024-09-12T00:17:25.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.534+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~L2KHZ8BNWEMS.1 size=666919 2024-09-12T00:17:25.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.538+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=L2KHZ8BNWEMS tag=L89H1WFFO4IR type=write size=2764071 2024-09-12T00:17:25.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.542+0000 7febed3678c0 1 < suggested remove operation key=CIOINUP503WY tag=5E50019WQEE6 type=del 2024-09-12T00:17:25.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.546+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=2XICQKH6TQRJ type=del size=1597137 2024-09-12T00:17:25.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.550+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=3XSX9M49GWKL type=del 2024-09-12T00:17:25.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.554+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=UPLLIZLXW9IP type=del size=3105720 2024-09-12T00:17:25.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.554+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=VDYCIY9M2RXF type=del 2024-09-12T00:17:25.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.558+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=Z2SK6RWP2L6A type=del size=1857497 2024-09-12T00:17:25.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.562+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=LQ2B2O020S8H type=del 2024-09-12T00:17:25.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.566+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=IG2GQQIGUSJJ type=del size=3367350 2024-09-12T00:17:25.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.570+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~7VCL4OOOWT1F.0 size=1048576 2024-09-12T00:17:25.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.570+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~7VCL4OOOWT1F.1 size=1048576 2024-09-12T00:17:25.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.574+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~7VCL4OOOWT1F.2 size=523563 2024-09-12T00:17:25.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.578+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=7VCL4OOOWT1F tag=RA5605EOAWE5 type=write size=3669291 2024-09-12T00:17:25.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.582+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=64KD4CF2UN63 type=write size=346709 2024-09-12T00:17:25.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.586+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=ECC825PHP3PI type=del 2024-09-12T00:17:25.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.594+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~MTUJJ54CXWD6.0 size=1048576 2024-09-12T00:17:25.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.594+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~MTUJJ54CXWD6.1 size=311229 2024-09-12T00:17:25.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.594+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=MTUJJ54CXWD6 tag=LWTM54SQNHH4 type=write size=2408381 2024-09-12T00:17:25.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.598+0000 7febed3678c0 1 < completed write operation key=VW69JRC5JYX5 tag=DI1YQNVIH0X2 type=write size=754565 2024-09-12T00:17:25.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.602+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=0LX54T2VANTN type=del size=1879085 2024-09-12T00:17:25.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.606+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~M140IC9CP9KM.0 size=1048576 2024-09-12T00:17:25.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.610+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~M140IC9CP9KM.1 size=1048576 2024-09-12T00:17:25.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.610+0000 7febed3678c0 1 < canceled part key=_multipart_9CBI4FHAT3H2.2~M140IC9CP9KM.2 size=533401 2024-09-12T00:17:25.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.614+0000 7febed3678c0 1 < canceled multipart upload key=9CBI4FHAT3H2 upload=M140IC9CP9KM tag=E56FPQFYEJV8 type=write size=3679129 2024-09-12T00:17:25.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.618+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=ZF34HWP7CMQF type=del size=1159978 2024-09-12T00:17:25.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.622+0000 7febed3678c0 1 < canceled operation key=9CBI4FHAT3H2 tag=J23MOFC38JI3 type=del size=3077158 2024-09-12T00:17:25.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.626+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~SUH90XHRVLM6.0 size=121889 2024-09-12T00:17:25.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.626+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=SUH90XHRVLM6 tag=73QGH5YTZ073 type=write size=1170465 2024-09-12T00:17:25.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.630+0000 7febed3678c0 1 < canceled operation key=HR9MVC82R7GL tag=DJ20IWFUHW7X type=write size=944543 2024-09-12T00:17:25.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.634+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=W31QDYVOCZL5 type=del size=1026486 2024-09-12T00:17:25.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.642+0000 7febed3678c0 1 < suggested update operation key=MAZHOU2CEUCU tag=353KMU1H9X7I type=del size=1025954 2024-09-12T00:17:25.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.646+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~XM6U8X6KYI2U.0 size=1048576 2024-09-12T00:17:25.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.650+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~XM6U8X6KYI2U.1 size=1048576 2024-09-12T00:17:25.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.654+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~XM6U8X6KYI2U.2 size=1592 2024-09-12T00:17:25.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.654+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=XM6U8X6KYI2U tag=F8TRNH9L1W11 type=write size=3147320 2024-09-12T00:17:25.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.654+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=LG0B7D4ZQ5EY type=del 2024-09-12T00:17:25.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.662+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~4CUSPGSBLG3K.0 size=1031294 2024-09-12T00:17:25.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.662+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=4CUSPGSBLG3K tag=VJUL6HQ7KBPD type=write size=2079870 2024-09-12T00:17:25.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.666+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~VF4BQH3EMUCT.0 size=488836 2024-09-12T00:17:25.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.670+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=VF4BQH3EMUCT tag=VGPEQD7GVE45 type=write size=1537412 2024-09-12T00:17:25.674 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.674+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=SBJN90NTOK1W type=del size=1165519 2024-09-12T00:17:25.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.682+0000 7febed3678c0 1 < suggested remove operation key=W2VEW3JJEJY7 tag=ECU3EOIAL4N8 type=write 2024-09-12T00:17:25.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.686+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=P73ULMEMEXQX type=del size=2427523 2024-09-12T00:17:25.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.690+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=HGKU7LWXZSDR type=del 2024-09-12T00:17:25.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.694+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~3ERUDMGJXA6R.0 size=1048576 2024-09-12T00:17:25.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.698+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~3ERUDMGJXA6R.1 size=1048576 2024-09-12T00:17:25.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.702+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~3ERUDMGJXA6R.2 size=162372 2024-09-12T00:17:25.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.702+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=3ERUDMGJXA6R tag=0LPYYDMLSQEN type=write size=3308100 2024-09-12T00:17:25.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.706+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~L2KHZ8BNWEMS.0 size=1048576 2024-09-12T00:17:25.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.706+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~L2KHZ8BNWEMS.1 size=666919 2024-09-12T00:17:25.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.714+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=L2KHZ8BNWEMS tag=L89H1WFFO4IR type=write size=2764071 2024-09-12T00:17:25.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.718+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~OGNTG1Z9DVJ6.0 size=1048576 2024-09-12T00:17:25.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.722+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~OGNTG1Z9DVJ6.1 size=1029471 2024-09-12T00:17:25.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.722+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=OGNTG1Z9DVJ6 tag=NEAF6U24AEHZ type=write size=3126623 2024-09-12T00:17:25.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.722+0000 7febed3678c0 -1 < no bi entry to suggest for operation key=W2VEW3JJEJY7 tag=2XICQKH6TQRJ type=del size=1597137: (2) No such file or directory 2024-09-12T00:17:25.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.726+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=GE8PS4CUKOH9 type=del size=3154293 2024-09-12T00:17:25.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.730+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=UPLLIZLXW9IP type=del 2024-09-12T00:17:25.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.734+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=AM8TAQ91BBK9 type=del size=2672692 2024-09-12T00:17:25.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.734+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=Z2SK6RWP2L6A type=del 2024-09-12T00:17:25.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.742+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~VI0EX5VG2HQ0.0 size=1048576 2024-09-12T00:17:25.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.746+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~VI0EX5VG2HQ0.1 size=1048576 2024-09-12T00:17:25.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.746+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~VI0EX5VG2HQ0.2 size=538650 2024-09-12T00:17:25.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.746+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=VI0EX5VG2HQ0 tag=AC2U1DW1B175 type=write size=3684378 2024-09-12T00:17:25.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.750+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=IG2GQQIGUSJJ type=del 2024-09-12T00:17:25.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.758+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~8RRLDYG6EWDP.0 size=134277 2024-09-12T00:17:25.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.758+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=8RRLDYG6EWDP tag=UA2SVUAV2IDI type=write size=1182853 2024-09-12T00:17:25.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.758+0000 7febed3678c0 1 < completed write operation key=HR9MVC82R7GL tag=64KD4CF2UN63 type=write size=346709 2024-09-12T00:17:25.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.766+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~B6Y7GFVH2OS8.0 size=854667 2024-09-12T00:17:25.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.766+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=B6Y7GFVH2OS8 tag=TAA9A9ZFGLQI type=write size=1903243 2024-09-12T00:17:25.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.770+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~MTUJJ54CXWD6.0 size=1048576 2024-09-12T00:17:25.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.770+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~MTUJJ54CXWD6.1 size=311229 2024-09-12T00:17:25.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.778+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=MTUJJ54CXWD6 tag=LWTM54SQNHH4 type=write size=2408381 2024-09-12T00:17:25.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.778+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=JW7DZ9CGPDEI type=write size=721193 2024-09-12T00:17:25.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.786+0000 7febed3678c0 1 < suggested remove operation key=MAZHOU2CEUCU tag=0LX54T2VANTN type=del 2024-09-12T00:17:25.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.790+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=I3PR5WTLOF78 type=del size=2883926 2024-09-12T00:17:25.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.794+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=ZF34HWP7CMQF type=del 2024-09-12T00:17:25.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.798+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~LYNNLG0QY7UE.0 size=1048576 2024-09-12T00:17:25.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.802+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~LYNNLG0QY7UE.1 size=325926 2024-09-12T00:17:25.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.802+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=LYNNLG0QY7UE tag=QHK4MQ0NJC9W type=write size=2423078 2024-09-12T00:17:25.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.806+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~SUH90XHRVLM6.0 size=121889 2024-09-12T00:17:25.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.814+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=SUH90XHRVLM6 tag=73QGH5YTZ073 type=write size=1170465 2024-09-12T00:17:25.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.822+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~KMEGCKNGIE8E.0 size=490032 2024-09-12T00:17:25.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.822+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=KMEGCKNGIE8E tag=ITF14J1GEBX0 type=write size=1538608 2024-09-12T00:17:25.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.826+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=W31QDYVOCZL5 type=del 2024-09-12T00:17:25.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.826+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=TQBF1BBT2IUG type=del size=1766929 2024-09-12T00:17:25.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.830+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~XM6U8X6KYI2U.0 size=1048576 2024-09-12T00:17:25.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.834+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~XM6U8X6KYI2U.1 size=1048576 2024-09-12T00:17:25.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.838+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~XM6U8X6KYI2U.2 size=1592 2024-09-12T00:17:25.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.842+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=XM6U8X6KYI2U tag=F8TRNH9L1W11 type=write size=3147320 2024-09-12T00:17:25.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.846+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~4REY6P1RXAHH.0 size=1048576 2024-09-12T00:17:25.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.850+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~4REY6P1RXAHH.1 size=189965 2024-09-12T00:17:25.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.850+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=4REY6P1RXAHH tag=2SERTTT5O7MM type=write size=2287117 2024-09-12T00:17:25.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.854+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~4CUSPGSBLG3K.0 size=1031294 2024-09-12T00:17:25.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.858+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=4CUSPGSBLG3K tag=VJUL6HQ7KBPD type=write size=2079870 2024-09-12T00:17:25.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.862+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=5K4AUXXQ1TX0 type=del size=3746007 2024-09-12T00:17:25.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.866+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=SBJN90NTOK1W type=del 2024-09-12T00:17:25.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.874+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~D5D98YFX44SF.0 size=1048576 2024-09-12T00:17:25.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.874+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~D5D98YFX44SF.1 size=320695 2024-09-12T00:17:25.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.874+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=D5D98YFX44SF tag=Z0MPSJAVH2SI type=write size=2417847 2024-09-12T00:17:25.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.878+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=P73ULMEMEXQX type=del 2024-09-12T00:17:25.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.886+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~6HSBT5U6P94K.0 size=1048576 2024-09-12T00:17:25.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.886+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~6HSBT5U6P94K.1 size=240913 2024-09-12T00:17:25.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.886+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=6HSBT5U6P94K tag=JDREFB636Z3H type=write size=2338065 2024-09-12T00:17:25.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.890+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~3ERUDMGJXA6R.0 size=1048576 2024-09-12T00:17:25.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.894+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~3ERUDMGJXA6R.1 size=1048576 2024-09-12T00:17:25.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.898+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~3ERUDMGJXA6R.2 size=162372 2024-09-12T00:17:25.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.902+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=3ERUDMGJXA6R tag=0LPYYDMLSQEN type=write size=3308100 2024-09-12T00:17:25.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.906+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~5EOZKLONOSKM.0 size=1048576 2024-09-12T00:17:25.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.910+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~5EOZKLONOSKM.1 size=1048576 2024-09-12T00:17:25.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.914+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~5EOZKLONOSKM.2 size=633954 2024-09-12T00:17:25.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.914+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=5EOZKLONOSKM tag=G0FF32RY8RXP type=write size=3779682 2024-09-12T00:17:25.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.918+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~OGNTG1Z9DVJ6.0 size=1048576 2024-09-12T00:17:25.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.918+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~OGNTG1Z9DVJ6.1 size=1029471 2024-09-12T00:17:25.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.926+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=OGNTG1Z9DVJ6 tag=NEAF6U24AEHZ type=write size=3126623 2024-09-12T00:17:25.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.930+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~SCFIK43Z49S2.0 size=1048576 2024-09-12T00:17:25.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.934+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~SCFIK43Z49S2.1 size=779039 2024-09-12T00:17:25.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.934+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=SCFIK43Z49S2 tag=F65Z37BIYZAI type=write size=2876191 2024-09-12T00:17:25.936 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.938+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=GE8PS4CUKOH9 type=del 2024-09-12T00:17:25.939 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.938+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=2OJG1WES6RL1 type=write size=277672 2024-09-12T00:17:25.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.942+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=AM8TAQ91BBK9 type=del 2024-09-12T00:17:25.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.946+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=HWHVM9K63F0I type=del size=1110461 2024-09-12T00:17:25.947 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.946+0000 7febed3678c0 1 < canceled part key=_multipart_CIOINUP503WY.2~VI0EX5VG2HQ0.0 size=1048576 2024-09-12T00:17:25.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.950+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~VI0EX5VG2HQ0.1 size=1048576 2024-09-12T00:17:25.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.954+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~VI0EX5VG2HQ0.2 size=538650 2024-09-12T00:17:25.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.958+0000 7febed3678c0 1 < canceled multipart upload key=CIOINUP503WY upload=VI0EX5VG2HQ0 tag=AC2U1DW1B175 type=write size=3684378 2024-09-12T00:17:25.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.962+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=J6YXVAPAJ051 type=del size=2524958 2024-09-12T00:17:25.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.966+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~8RRLDYG6EWDP.0 size=134277 2024-09-12T00:17:25.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.970+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=8RRLDYG6EWDP tag=UA2SVUAV2IDI type=write size=1182853 2024-09-12T00:17:25.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.974+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=YLESZZN470WA type=del size=3114589 2024-09-12T00:17:25.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.974+0000 7febed3678c0 1 < canceled part key=_multipart_W2VEW3JJEJY7.2~B6Y7GFVH2OS8.0 size=854667 2024-09-12T00:17:25.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.982+0000 7febed3678c0 1 < canceled multipart upload key=W2VEW3JJEJY7 upload=B6Y7GFVH2OS8 tag=TAA9A9ZFGLQI type=write size=1903243 2024-09-12T00:17:25.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.982+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=F0YYJU1H05OE type=del size=3152046 2024-09-12T00:17:25.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.986+0000 7febed3678c0 1 < completed write operation key=Z020UV2JRR0I tag=JW7DZ9CGPDEI type=write size=721193 2024-09-12T00:17:25.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.990+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=VGO1652CFT6Y type=write size=218957 2024-09-12T00:17:25.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.994+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=I3PR5WTLOF78 type=del 2024-09-12T00:17:25.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:25.998+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=P83YM00VJPC0 type=del size=543997 2024-09-12T00:17:26.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.002+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~LYNNLG0QY7UE.0 size=1048576 2024-09-12T00:17:26.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.002+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~LYNNLG0QY7UE.1 size=325926 2024-09-12T00:17:26.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.010+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=LYNNLG0QY7UE tag=QHK4MQ0NJC9W type=write size=2423078 2024-09-12T00:17:26.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.014+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~CKFIFYYKC61Z.0 size=1048576 2024-09-12T00:17:26.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.018+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~CKFIFYYKC61Z.1 size=947052 2024-09-12T00:17:26.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.018+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=CKFIFYYKC61Z tag=66442J0TB2DK type=write size=3044204 2024-09-12T00:17:26.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.022+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~KMEGCKNGIE8E.0 size=490032 2024-09-12T00:17:26.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.026+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=KMEGCKNGIE8E tag=ITF14J1GEBX0 type=write size=1538608 2024-09-12T00:17:26.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.030+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=L3CKWZCWOIUB type=del size=2519860 2024-09-12T00:17:26.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.030+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=TQBF1BBT2IUG type=del 2024-09-12T00:17:26.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.034+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=FIS5KHVADNLN type=del size=1440661 2024-09-12T00:17:26.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.038+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~4REY6P1RXAHH.0 size=1048576 2024-09-12T00:17:26.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.038+0000 7febed3678c0 1 < canceled part key=_multipart_W2VEW3JJEJY7.2~4REY6P1RXAHH.1 size=189965 2024-09-12T00:17:26.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.046+0000 7febed3678c0 1 < canceled multipart upload key=W2VEW3JJEJY7 upload=4REY6P1RXAHH tag=2SERTTT5O7MM type=write size=2287117 2024-09-12T00:17:26.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.050+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KW9O5EJU34HY.0 size=1048576 2024-09-12T00:17:26.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.054+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KW9O5EJU34HY.1 size=1048576 2024-09-12T00:17:26.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.054+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KW9O5EJU34HY.2 size=674813 2024-09-12T00:17:26.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.054+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=KW9O5EJU34HY tag=SO1DP0QC15MC type=write size=3820541 2024-09-12T00:17:26.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.058+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=5K4AUXXQ1TX0 type=del 2024-09-12T00:17:26.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.066+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~4JB73YZXV55D.0 size=1048576 2024-09-12T00:17:26.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.066+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~4JB73YZXV55D.1 size=1048576 2024-09-12T00:17:26.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.070+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~4JB73YZXV55D.2 size=516300 2024-09-12T00:17:26.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.070+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=4JB73YZXV55D tag=ROGH3H4U3G5S type=write size=3662028 2024-09-12T00:17:26.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.074+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~D5D98YFX44SF.0 size=1048576 2024-09-12T00:17:26.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.078+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~D5D98YFX44SF.1 size=320695 2024-09-12T00:17:26.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.082+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=D5D98YFX44SF tag=Z0MPSJAVH2SI type=write size=2417847 2024-09-12T00:17:26.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.086+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=8DNTEL40E11Q type=del size=2665273 2024-09-12T00:17:26.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.090+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~6HSBT5U6P94K.0 size=1048576 2024-09-12T00:17:26.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.094+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~6HSBT5U6P94K.1 size=240913 2024-09-12T00:17:26.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.098+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=6HSBT5U6P94K tag=JDREFB636Z3H type=write size=2338065 2024-09-12T00:17:26.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.102+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=VPK3X06W3LL9 type=del size=3200448 2024-09-12T00:17:26.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.106+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~5EOZKLONOSKM.0 size=1048576 2024-09-12T00:17:26.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.110+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~5EOZKLONOSKM.1 size=1048576 2024-09-12T00:17:26.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.110+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~5EOZKLONOSKM.2 size=633954 2024-09-12T00:17:26.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.118+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=5EOZKLONOSKM tag=G0FF32RY8RXP type=write size=3779682 2024-09-12T00:17:26.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.126+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~9HQI0F1MU48K.0 size=1048576 2024-09-12T00:17:26.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.130+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~9HQI0F1MU48K.1 size=1048576 2024-09-12T00:17:26.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.134+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~9HQI0F1MU48K.2 size=898093 2024-09-12T00:17:26.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.134+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=9HQI0F1MU48K tag=H1JZB1JSEY3F type=write size=4043821 2024-09-12T00:17:26.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.138+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~SCFIK43Z49S2.0 size=1048576 2024-09-12T00:17:26.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.138+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~SCFIK43Z49S2.1 size=779039 2024-09-12T00:17:26.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.146+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=SCFIK43Z49S2 tag=F65Z37BIYZAI type=write size=2876191 2024-09-12T00:17:26.148 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.150+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=LBVPMR5E0O4L type=del size=3802665 2024-09-12T00:17:26.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.154+0000 7febed3678c0 1 < completed write operation key=8RVDLW1VC8LP tag=2OJG1WES6RL1 type=write size=277672 2024-09-12T00:17:26.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.154+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=VQAWF29XK7JT type=del size=2280522 2024-09-12T00:17:26.159 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.158+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=HWHVM9K63F0I type=del 2024-09-12T00:17:26.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.162+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=8LPYBG14P5X5 type=del size=629280 2024-09-12T00:17:26.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.166+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=J6YXVAPAJ051 type=del 2024-09-12T00:17:26.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.170+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~LKAYPIU3ULMB.0 size=1048576 2024-09-12T00:17:26.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.174+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~LKAYPIU3ULMB.1 size=1048576 2024-09-12T00:17:26.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.178+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~LKAYPIU3ULMB.2 size=799537 2024-09-12T00:17:26.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.178+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=LKAYPIU3ULMB tag=O4PHC3IS1HYJ type=write size=3945265 2024-09-12T00:17:26.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.186+0000 7febed3678c0 1 < suggested update operation key=53T1415UK7GE tag=YLESZZN470WA type=del size=3114589 2024-09-12T00:17:26.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.186+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=QXM668EZX3I1 type=del size=2321476 2024-09-12T00:17:26.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.194+0000 7febed3678c0 1 < suggested remove operation key=H017KWW59B8Z tag=F0YYJU1H05OE type=del 2024-09-12T00:17:26.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.198+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=T06VIN3XI302 type=del size=1563621 2024-09-12T00:17:26.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.202+0000 7febed3678c0 -1 < failed to complete operation key=H017KWW59B8Z tag=VGO1652CFT6Y type=write size=218957: (22) Invalid argument 2024-09-12T00:17:26.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.206+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=JLULQZ53X1IZ type=del size=376949 2024-09-12T00:17:26.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.210+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=P83YM00VJPC0 type=del 2024-09-12T00:17:26.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.214+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~D0G9KUGI9BAJ.0 size=1048576 2024-09-12T00:17:26.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.218+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~D0G9KUGI9BAJ.1 size=1048576 2024-09-12T00:17:26.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.222+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~D0G9KUGI9BAJ.2 size=523140 2024-09-12T00:17:26.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.222+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=D0G9KUGI9BAJ tag=RCKI5CWGMEMQ type=write size=3668868 2024-09-12T00:17:26.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.226+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~CKFIFYYKC61Z.0 size=1048576 2024-09-12T00:17:26.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.226+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~CKFIFYYKC61Z.1 size=947052 2024-09-12T00:17:26.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.234+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=CKFIFYYKC61Z tag=66442J0TB2DK type=write size=3044204 2024-09-12T00:17:26.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.238+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~G6AAA4FE0WRB.0 size=1048576 2024-09-12T00:17:26.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.242+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~G6AAA4FE0WRB.1 size=1048576 2024-09-12T00:17:26.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.246+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~G6AAA4FE0WRB.2 size=201567 2024-09-12T00:17:26.244 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.246+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=G6AAA4FE0WRB tag=XE01RCXPN4LS type=write size=3347295 2024-09-12T00:17:26.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.246+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=L3CKWZCWOIUB type=del 2024-09-12T00:17:26.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.250+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=XR3W5JUYNW7X type=del size=1798114 2024-09-12T00:17:26.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.258+0000 7febed3678c0 1 < suggested update operation key=HR9MVC82R7GL tag=FIS5KHVADNLN type=del size=1440661 2024-09-12T00:17:26.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.262+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=5SC1O89AIQXC type=del size=3665366 2024-09-12T00:17:26.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.266+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~KW9O5EJU34HY.0 size=1048576 2024-09-12T00:17:26.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.266+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~KW9O5EJU34HY.1 size=1048576 2024-09-12T00:17:26.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.266+0000 7febed3678c0 1 < canceled part key=_multipart_8RVDLW1VC8LP.2~KW9O5EJU34HY.2 size=674813 2024-09-12T00:17:26.272 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.274+0000 7febed3678c0 1 < canceled multipart upload key=8RVDLW1VC8LP upload=KW9O5EJU34HY tag=SO1DP0QC15MC type=write size=3820541 2024-09-12T00:17:26.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.278+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=8KBXR3N0X413 type=del size=3670111 2024-09-12T00:17:26.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.278+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~4JB73YZXV55D.0 size=1048576 2024-09-12T00:17:26.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.278+0000 7febed3678c0 1 < canceled part key=_multipart_VW69JRC5JYX5.2~4JB73YZXV55D.1 size=1048576 2024-09-12T00:17:26.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.282+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~4JB73YZXV55D.2 size=516300 2024-09-12T00:17:26.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.290+0000 7febed3678c0 1 < canceled multipart upload key=VW69JRC5JYX5 upload=4JB73YZXV55D tag=ROGH3H4U3G5S type=write size=3662028 2024-09-12T00:17:26.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.294+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=DZ64PTZ4RFMF type=del size=3479834 2024-09-12T00:17:26.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.298+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=8DNTEL40E11Q type=del 2024-09-12T00:17:26.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.298+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=2WSTGKEHY4ZS type=del size=1032905 2024-09-12T00:17:26.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.302+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=VPK3X06W3LL9 type=del 2024-09-12T00:17:26.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.306+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=H50IMLJMAGMC type=del size=2377126 2024-09-12T00:17:26.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.310+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~9HQI0F1MU48K.0 size=1048576 2024-09-12T00:17:26.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.314+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~9HQI0F1MU48K.1 size=1048576 2024-09-12T00:17:26.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.314+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~9HQI0F1MU48K.2 size=898093 2024-09-12T00:17:26.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.322+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=9HQI0F1MU48K tag=H1JZB1JSEY3F type=write size=4043821 2024-09-12T00:17:26.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.322+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=0TORGFCZDN6R type=del size=3853215 2024-09-12T00:17:26.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.358+0000 7febed3678c0 1 < canceled operation key=G22WTRRGIQKE tag=LBVPMR5E0O4L type=del size=3802665 2024-09-12T00:17:26.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.366+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=U3I1YLBDVHVN type=del size=353978 2024-09-12T00:17:26.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.370+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=VQAWF29XK7JT type=del 2024-09-12T00:17:26.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.370+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=IMMF0X8BTRKP type=del size=2049327 2024-09-12T00:17:26.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.374+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=8LPYBG14P5X5 type=del 2024-09-12T00:17:26.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.378+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=09BGSRC5L89X type=del size=625896 2024-09-12T00:17:26.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.382+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~LKAYPIU3ULMB.0 size=1048576 2024-09-12T00:17:26.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.386+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~LKAYPIU3ULMB.1 size=1048576 2024-09-12T00:17:26.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.386+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~LKAYPIU3ULMB.2 size=799537 2024-09-12T00:17:26.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.394+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=LKAYPIU3ULMB tag=O4PHC3IS1HYJ type=write size=3945265 2024-09-12T00:17:26.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.398+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~MUF88I6Z6I8L.0 size=1048576 2024-09-12T00:17:26.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.402+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~MUF88I6Z6I8L.1 size=1048576 2024-09-12T00:17:26.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.406+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~MUF88I6Z6I8L.2 size=142669 2024-09-12T00:17:26.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.406+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=MUF88I6Z6I8L tag=0WHEKXI39HY0 type=write size=3288397 2024-09-12T00:17:26.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.410+0000 7febed3678c0 1 < suggested remove operation key=CIOINUP503WY tag=QXM668EZX3I1 type=del 2024-09-12T00:17:26.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.414+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=QWVHAOKS7VC2 type=write size=703240 2024-09-12T00:17:26.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.418+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=T06VIN3XI302 type=del 2024-09-12T00:17:26.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.422+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=OAEUGZY0PKW0 type=del size=603260 2024-09-12T00:17:26.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.426+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=JLULQZ53X1IZ type=del 2024-09-12T00:17:26.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.430+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=UYGL3YDNXUTF type=del size=2570805 2024-09-12T00:17:26.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.434+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~D0G9KUGI9BAJ.0 size=1048576 2024-09-12T00:17:26.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.434+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~D0G9KUGI9BAJ.1 size=1048576 2024-09-12T00:17:26.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.438+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~D0G9KUGI9BAJ.2 size=523140 2024-09-12T00:17:26.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.446+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=D0G9KUGI9BAJ tag=RCKI5CWGMEMQ type=write size=3668868 2024-09-12T00:17:26.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.450+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=KSI26DD1JGSA type=del size=3838603 2024-09-12T00:17:26.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.454+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~G6AAA4FE0WRB.0 size=1048576 2024-09-12T00:17:26.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.454+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~G6AAA4FE0WRB.1 size=1048576 2024-09-12T00:17:26.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.458+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~G6AAA4FE0WRB.2 size=201567 2024-09-12T00:17:26.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.466+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=G6AAA4FE0WRB tag=XE01RCXPN4LS type=write size=3347295 2024-09-12T00:17:26.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.466+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=HCGO1L3S7R8O type=del size=3047275 2024-09-12T00:17:26.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.470+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=XR3W5JUYNW7X type=del 2024-09-12T00:17:26.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.474+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=WCN685UB88YY type=write size=614098 2024-09-12T00:17:26.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.478+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=5SC1O89AIQXC type=del 2024-09-12T00:17:26.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.486+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=97Y5CJGU1B9P type=del size=934894 2024-09-12T00:17:26.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.490+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=8KBXR3N0X413 type=del 2024-09-12T00:17:26.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.494+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=TUU7NSQ8KLO2 type=del size=347478 2024-09-12T00:17:26.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.498+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=DZ64PTZ4RFMF type=del 2024-09-12T00:17:26.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.502+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=6U1KCSQCTYJQ type=del size=2274318 2024-09-12T00:17:26.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.506+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=2WSTGKEHY4ZS type=del 2024-09-12T00:17:26.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.506+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=PNVGSN2X01TY type=del size=1061054 2024-09-12T00:17:26.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.510+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=H50IMLJMAGMC type=del 2024-09-12T00:17:26.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.514+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=QIAVSE624YLU type=del size=2137166 2024-09-12T00:17:26.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.522+0000 7febed3678c0 1 < suggested update operation key=VW69JRC5JYX5 tag=0TORGFCZDN6R type=del size=3853215 2024-09-12T00:17:26.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.526+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=EXOCLYVQK3F0 type=del size=3031757 2024-09-12T00:17:26.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.530+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=U3I1YLBDVHVN type=del 2024-09-12T00:17:26.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.530+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=YIVG85PUV5E7 type=del size=408093 2024-09-12T00:17:26.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.534+0000 7febed3678c0 1 < canceled operation key=Z020UV2JRR0I tag=IMMF0X8BTRKP type=del size=2049327 2024-09-12T00:17:26.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.538+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=DHSPFPOQNLXB type=del size=1888328 2024-09-12T00:17:26.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.542+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=09BGSRC5L89X type=del 2024-09-12T00:17:26.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.546+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=8G38N418QUUQ type=write size=773023 2024-09-12T00:17:26.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.550+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~MUF88I6Z6I8L.0 size=1048576 2024-09-12T00:17:26.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.554+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~MUF88I6Z6I8L.1 size=1048576 2024-09-12T00:17:26.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.554+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~MUF88I6Z6I8L.2 size=142669 2024-09-12T00:17:26.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.562+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=MUF88I6Z6I8L tag=0WHEKXI39HY0 type=write size=3288397 2024-09-12T00:17:26.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.566+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=ZLG5KHJEMNE1 type=write size=74967 2024-09-12T00:17:26.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.570+0000 7febed3678c0 1 < completed write operation key=MAZHOU2CEUCU tag=QWVHAOKS7VC2 type=write size=703240 2024-09-12T00:17:26.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.574+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=JLXGB7OKDAIR type=del size=3399316 2024-09-12T00:17:26.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.578+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=OAEUGZY0PKW0 type=del 2024-09-12T00:17:26.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.582+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=O8SZ0MYOOVG2 type=del size=2577869 2024-09-12T00:17:26.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.586+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=UYGL3YDNXUTF type=del 2024-09-12T00:17:26.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.590+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=D0WR2R77FUE0 type=del size=2297162 2024-09-12T00:17:26.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.590+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=KSI26DD1JGSA type=del 2024-09-12T00:17:26.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.598+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~YPMV6U9PHBVU.0 size=1048576 2024-09-12T00:17:26.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.602+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~YPMV6U9PHBVU.1 size=221859 2024-09-12T00:17:26.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.602+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=YPMV6U9PHBVU tag=QJMSKQT1FUMH type=write size=2319011 2024-09-12T00:17:26.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.606+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=HCGO1L3S7R8O type=del 2024-09-12T00:17:26.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.610+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=M34N208BXHZ4 type=del size=3809130 2024-09-12T00:17:26.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.614+0000 7febed3678c0 1 < completed write operation key=AHTIFXX3SGK7 tag=WCN685UB88YY type=write size=614098 2024-09-12T00:17:26.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.618+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=3PXZEA5WW0DM type=del size=3052652 2024-09-12T00:17:26.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.622+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=97Y5CJGU1B9P type=del 2024-09-12T00:17:26.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.626+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=NI20WZZQQZ04 type=del size=1799809 2024-09-12T00:17:26.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.630+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=TUU7NSQ8KLO2 type=del 2024-09-12T00:17:26.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.634+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=D6VRE4UI375E type=del size=884885 2024-09-12T00:17:26.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.638+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=6U1KCSQCTYJQ type=del 2024-09-12T00:17:26.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.642+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=D5EIP22VJW30 type=del size=824292 2024-09-12T00:17:26.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.646+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=PNVGSN2X01TY type=del 2024-09-12T00:17:26.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.650+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=4KBKR01SEZJN type=write size=836070 2024-09-12T00:17:26.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.650+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=QIAVSE624YLU type=del 2024-09-12T00:17:26.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.654+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=7XBO6RIEV1I2 type=write size=610668 2024-09-12T00:17:26.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.662+0000 7febed3678c0 1 < suggested remove operation key=KLO47UYYACLU tag=EXOCLYVQK3F0 type=del 2024-09-12T00:17:26.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.666+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~5L5NV02J18CZ.0 size=63229 2024-09-12T00:17:26.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.666+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=5L5NV02J18CZ tag=UKWAZ52DS88C type=write size=1111805 2024-09-12T00:17:26.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.670+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=YIVG85PUV5E7 type=del 2024-09-12T00:17:26.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.674+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~N5F05HSMF153.0 size=179474 2024-09-12T00:17:26.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.674+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=N5F05HSMF153 tag=CCNR8R07ZDTN type=write size=1228050 2024-09-12T00:17:26.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.678+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=DHSPFPOQNLXB type=del 2024-09-12T00:17:26.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.682+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=CRMA7SUUPONA type=write size=937084 2024-09-12T00:17:26.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.686+0000 7febed3678c0 1 < completed write operation key=W2VEW3JJEJY7 tag=8G38N418QUUQ type=write size=773023 2024-09-12T00:17:26.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.686+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=2E8V51ME4W7M type=del size=3954773 2024-09-12T00:17:26.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.694+0000 7febed3678c0 1 < suggested remove operation key=MHS307JKNVCK tag=ZLG5KHJEMNE1 type=write 2024-09-12T00:17:26.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.694+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=C3OKPP994V9J type=del size=2565398 2024-09-12T00:17:26.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.698+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=JLXGB7OKDAIR type=del 2024-09-12T00:17:26.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.706+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~XNLNACK2NXG6.0 size=1048576 2024-09-12T00:17:26.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.706+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~XNLNACK2NXG6.1 size=1048576 2024-09-12T00:17:26.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.710+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~XNLNACK2NXG6.2 size=212450 2024-09-12T00:17:26.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.710+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=XNLNACK2NXG6 tag=FA43GFL3FCK0 type=write size=3358178 2024-09-12T00:17:26.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.718+0000 7febed3678c0 1 < suggested remove operation key=CIOINUP503WY tag=O8SZ0MYOOVG2 type=del 2024-09-12T00:17:26.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.718+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=XMKE8751B6EG type=write size=791662 2024-09-12T00:17:26.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.722+0000 7febed3678c0 1 < canceled operation key=G22WTRRGIQKE tag=D0WR2R77FUE0 type=del size=2297162 2024-09-12T00:17:26.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.726+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=JHGD9P2K5Z8Y type=del size=745097 2024-09-12T00:17:26.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.730+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~YPMV6U9PHBVU.0 size=1048576 2024-09-12T00:17:26.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.734+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~YPMV6U9PHBVU.1 size=221859 2024-09-12T00:17:26.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.738+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=YPMV6U9PHBVU tag=QJMSKQT1FUMH type=write size=2319011 2024-09-12T00:17:26.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.742+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=OVNZDSCIAR0P type=del size=3136989 2024-09-12T00:17:26.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.742+0000 7febed3678c0 -1 < failed to complete operation key=CIOINUP503WY tag=M34N208BXHZ4 type=del size=3809130: (22) Invalid argument 2024-09-12T00:17:26.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.750+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~431N8BLC8WUQ.0 size=1048576 2024-09-12T00:17:26.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.754+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~431N8BLC8WUQ.1 size=5393 2024-09-12T00:17:26.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.754+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=431N8BLC8WUQ tag=L7UF9EQIM99G type=write size=2102545 2024-09-12T00:17:26.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.758+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=3PXZEA5WW0DM type=del 2024-09-12T00:17:26.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.762+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~5JM2OKMFMNVT.0 size=1048576 2024-09-12T00:17:26.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.766+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~5JM2OKMFMNVT.1 size=505216 2024-09-12T00:17:26.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.766+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=5JM2OKMFMNVT tag=CWLCHEQNOB1P type=write size=2602368 2024-09-12T00:17:26.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.770+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=NI20WZZQQZ04 type=del 2024-09-12T00:17:26.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.770+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=SZBN6AV8LLA5 type=del size=2371509 2024-09-12T00:17:26.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.774+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=D6VRE4UI375E type=del 2024-09-12T00:17:26.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.778+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=C3L3POJ3DK4O type=del size=444672 2024-09-12T00:17:26.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.782+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=D5EIP22VJW30 type=del 2024-09-12T00:17:26.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.786+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=LHW6SK59C5L3 type=del size=2374642 2024-09-12T00:17:26.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.790+0000 7febed3678c0 1 < completed write operation key=MLPN8PH72VQ9 tag=4KBKR01SEZJN type=write size=836070 2024-09-12T00:17:26.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.794+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=9CSXIUBPEZS6 type=del size=3246907 2024-09-12T00:17:26.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.798+0000 7febed3678c0 1 < suggested remove operation key=52SSW5KTCS15 tag=7XBO6RIEV1I2 type=write 2024-09-12T00:17:26.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.802+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=G033ANW0JKZD type=del size=1631530 2024-09-12T00:17:26.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.806+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~5L5NV02J18CZ.0 size=63229 2024-09-12T00:17:26.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.810+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=5L5NV02J18CZ tag=UKWAZ52DS88C type=write size=1111805 2024-09-12T00:17:26.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.822+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~USQHNC1X9HPK.0 size=1048576 2024-09-12T00:17:26.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.822+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~USQHNC1X9HPK.1 size=1048576 2024-09-12T00:17:26.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.826+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~USQHNC1X9HPK.2 size=405891 2024-09-12T00:17:26.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.826+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=USQHNC1X9HPK tag=JDMISREN7ELO type=write size=3551619 2024-09-12T00:17:26.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.830+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~N5F05HSMF153.0 size=179474 2024-09-12T00:17:26.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.834+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=N5F05HSMF153 tag=CCNR8R07ZDTN type=write size=1228050 2024-09-12T00:17:26.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.838+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=66X9X3JE9RO7 type=write size=66048 2024-09-12T00:17:26.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.842+0000 7febed3678c0 1 < suggested update operation key=HR9MVC82R7GL tag=CRMA7SUUPONA type=write size=937084 2024-09-12T00:17:26.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.846+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=2KGOC5CG51NQ type=del size=3311378 2024-09-12T00:17:26.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.854+0000 7febed3678c0 1 < suggested update operation key=LGFKY0CP299H tag=2E8V51ME4W7M type=del size=3954773 2024-09-12T00:17:26.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.862+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~CG1UB5E08BOX.0 size=1001323 2024-09-12T00:17:26.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.862+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=CG1UB5E08BOX tag=T0TMQMCARJQ8 type=write size=2049899 2024-09-12T00:17:26.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.866+0000 7febed3678c0 1 < suggested update operation key=G22WTRRGIQKE tag=C3OKPP994V9J type=del size=2565398 2024-09-12T00:17:26.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.870+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=7G0FDCHM2JYS type=del size=3360808 2024-09-12T00:17:26.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.874+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~XNLNACK2NXG6.0 size=1048576 2024-09-12T00:17:26.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.874+0000 7febed3678c0 1 < canceled part key=_multipart_Z020UV2JRR0I.2~XNLNACK2NXG6.1 size=1048576 2024-09-12T00:17:26.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.874+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~XNLNACK2NXG6.2 size=212450 2024-09-12T00:17:26.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.882+0000 7febed3678c0 1 < canceled multipart upload key=Z020UV2JRR0I upload=XNLNACK2NXG6 tag=FA43GFL3FCK0 type=write size=3358178 2024-09-12T00:17:26.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.886+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=LFDUCU10CKJ0 type=del size=3627342 2024-09-12T00:17:26.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.886+0000 7febed3678c0 1 < completed write operation key=8RVDLW1VC8LP tag=XMKE8751B6EG type=write size=791662 2024-09-12T00:17:26.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.894+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~9AB1QTQ20N5S.0 size=929963 2024-09-12T00:17:26.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.894+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=9AB1QTQ20N5S tag=UEXOI5ARAC30 type=write size=1978539 2024-09-12T00:17:26.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.894+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=JHGD9P2K5Z8Y type=del 2024-09-12T00:17:26.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.898+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~EZJIHRCK3S3W.0 size=1048576 2024-09-12T00:17:26.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.902+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~EZJIHRCK3S3W.1 size=64214 2024-09-12T00:17:26.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.902+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=EZJIHRCK3S3W tag=OI0DKIBTV353 type=write size=2161366 2024-09-12T00:17:26.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.906+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=OVNZDSCIAR0P type=del 2024-09-12T00:17:26.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.906+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=DCXATI1CY8B7 type=del size=3714878 2024-09-12T00:17:26.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.910+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~431N8BLC8WUQ.0 size=1048576 2024-09-12T00:17:26.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.914+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~431N8BLC8WUQ.1 size=5393 2024-09-12T00:17:26.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.918+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=431N8BLC8WUQ tag=L7UF9EQIM99G type=write size=2102545 2024-09-12T00:17:26.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.922+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~VKTP1M3BDDEJ.0 size=409128 2024-09-12T00:17:26.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.922+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=VKTP1M3BDDEJ tag=DGDSTBNXWHQ5 type=write size=1457704 2024-09-12T00:17:26.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.926+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~5JM2OKMFMNVT.0 size=1048576 2024-09-12T00:17:26.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.926+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~5JM2OKMFMNVT.1 size=505216 2024-09-12T00:17:26.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.930+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=5JM2OKMFMNVT tag=CWLCHEQNOB1P type=write size=2602368 2024-09-12T00:17:26.937 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.938+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~S5V0GIAM33TM.0 size=1048576 2024-09-12T00:17:26.939 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.938+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~S5V0GIAM33TM.1 size=1048576 2024-09-12T00:17:26.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.942+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~S5V0GIAM33TM.2 size=125638 2024-09-12T00:17:26.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.942+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=S5V0GIAM33TM tag=1HIMTCM383L0 type=write size=3271366 2024-09-12T00:17:26.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.946+0000 7febed3678c0 1 < canceled operation key=VU1AF57EUA0R tag=SZBN6AV8LLA5 type=del size=2371509 2024-09-12T00:17:26.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.950+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=AMKCHIXBFLID type=del size=3516590 2024-09-12T00:17:26.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.950+0000 7febed3678c0 -1 < failed to complete operation key=LGFKY0CP299H tag=C3L3POJ3DK4O type=del size=444672: (22) Invalid argument 2024-09-12T00:17:26.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.958+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~XSA40X5GJGJW.0 size=886028 2024-09-12T00:17:26.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.958+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=XSA40X5GJGJW tag=PGGIFM33N71E type=write size=1934604 2024-09-12T00:17:26.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.962+0000 7febed3678c0 1 < canceled operation key=9CBI4FHAT3H2 tag=LHW6SK59C5L3 type=del size=2374642 2024-09-12T00:17:26.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.966+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=C11VI3ZKK90J type=del size=237377 2024-09-12T00:17:26.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.966+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=9CSXIUBPEZS6 type=del 2024-09-12T00:17:26.972 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.974+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~YPHFIHMHZ6EA.0 size=1048576 2024-09-12T00:17:26.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.974+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~YPHFIHMHZ6EA.1 size=1048576 2024-09-12T00:17:26.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.978+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~YPHFIHMHZ6EA.2 size=934771 2024-09-12T00:17:26.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.978+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=YPHFIHMHZ6EA tag=3HV4PR7TY3HV type=write size=4080499 2024-09-12T00:17:26.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.982+0000 7febed3678c0 1 < canceled operation key=ELNXYXX5ZWOW tag=G033ANW0JKZD type=del size=1631530 2024-09-12T00:17:26.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.986+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=RB10GDD3I5EY type=del size=1710841 2024-09-12T00:17:26.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.986+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~USQHNC1X9HPK.0 size=1048576 2024-09-12T00:17:26.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.990+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~USQHNC1X9HPK.1 size=1048576 2024-09-12T00:17:26.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.994+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~USQHNC1X9HPK.2 size=405891 2024-09-12T00:17:26.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:26.998+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=USQHNC1X9HPK tag=JDMISREN7ELO type=write size=3551619 2024-09-12T00:17:27.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.002+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=1RNJNUA1GL3S type=del size=2067120 2024-09-12T00:17:27.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.002+0000 7febed3678c0 1 < completed write operation key=H017KWW59B8Z tag=66X9X3JE9RO7 type=write size=66048 2024-09-12T00:17:27.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.006+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=ADDKGBTH77L5 type=write size=843313 2024-09-12T00:17:27.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.010+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=2KGOC5CG51NQ type=del 2024-09-12T00:17:27.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.010+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=LYIGXX50RAUY type=del size=1670946 2024-09-12T00:17:27.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.014+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~CG1UB5E08BOX.0 size=1001323 2024-09-12T00:17:27.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.018+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=CG1UB5E08BOX tag=T0TMQMCARJQ8 type=write size=2049899 2024-09-12T00:17:27.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.022+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=7OE00J8VL9A7 type=del size=4088981 2024-09-12T00:17:27.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.026+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=7G0FDCHM2JYS type=del 2024-09-12T00:17:27.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.030+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~4UTC7MXJ7NPD.0 size=107685 2024-09-12T00:17:27.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.030+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=4UTC7MXJ7NPD tag=BOEWN3UBGPPA type=write size=1156261 2024-09-12T00:17:27.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.034+0000 7febed3678c0 1 < suggested remove operation key=MHS307JKNVCK tag=LFDUCU10CKJ0 type=del 2024-09-12T00:17:27.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.042+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~3RNSBG6J0YHI.0 size=340711 2024-09-12T00:17:27.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.042+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=3RNSBG6J0YHI tag=7LUF6BD7XGKS type=write size=1389287 2024-09-12T00:17:27.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.042+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~9AB1QTQ20N5S.0 size=929963 2024-09-12T00:17:27.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.046+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=9AB1QTQ20N5S tag=UEXOI5ARAC30 type=write size=1978539 2024-09-12T00:17:27.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.050+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=AAN95BLWW1FT type=write size=526623 2024-09-12T00:17:27.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.050+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~EZJIHRCK3S3W.0 size=1048576 2024-09-12T00:17:27.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.054+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~EZJIHRCK3S3W.1 size=64214 2024-09-12T00:17:27.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.058+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=EZJIHRCK3S3W tag=OI0DKIBTV353 type=write size=2161366 2024-09-12T00:17:27.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.058+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=5RXZLU9P1WK9 type=write size=46276 2024-09-12T00:17:27.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.062+0000 7febed3678c0 -1 < failed to complete operation key=MHS307JKNVCK tag=DCXATI1CY8B7 type=del size=3714878: (22) Invalid argument 2024-09-12T00:17:27.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.066+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~ZJ1318VIY7OX.0 size=1048576 2024-09-12T00:17:27.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.070+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~ZJ1318VIY7OX.1 size=650955 2024-09-12T00:17:27.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.070+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=ZJ1318VIY7OX tag=ZH6G8ESZS52G type=write size=2748107 2024-09-12T00:17:27.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.070+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~VKTP1M3BDDEJ.0 size=409128 2024-09-12T00:17:27.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.074+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=VKTP1M3BDDEJ tag=DGDSTBNXWHQ5 type=write size=1457704 2024-09-12T00:17:27.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.078+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=689M6185PLKY type=del size=358355 2024-09-12T00:17:27.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.082+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~S5V0GIAM33TM.0 size=1048576 2024-09-12T00:17:27.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.082+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~S5V0GIAM33TM.1 size=1048576 2024-09-12T00:17:27.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.086+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~S5V0GIAM33TM.2 size=125638 2024-09-12T00:17:27.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.090+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=S5V0GIAM33TM tag=1HIMTCM383L0 type=write size=3271366 2024-09-12T00:17:27.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.094+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~GMIQ8UI8WOUV.0 size=800912 2024-09-12T00:17:27.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.094+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=GMIQ8UI8WOUV tag=S83LP73GY51I type=write size=1849488 2024-09-12T00:17:27.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.098+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=AMKCHIXBFLID type=del 2024-09-12T00:17:27.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.102+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~2M4PI3CA0G3M.0 size=1048576 2024-09-12T00:17:27.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.106+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~2M4PI3CA0G3M.1 size=491442 2024-09-12T00:17:27.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.106+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=2M4PI3CA0G3M tag=Z2ZKAIVIMG8F type=write size=2588594 2024-09-12T00:17:27.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.106+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~XSA40X5GJGJW.0 size=886028 2024-09-12T00:17:27.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.110+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=XSA40X5GJGJW tag=PGGIFM33N71E type=write size=1934604 2024-09-12T00:17:27.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.114+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=VTHVURAWPY6Y type=write size=98035 2024-09-12T00:17:27.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.118+0000 7febed3678c0 1 < canceled operation key=RGQ4KY26RKYI tag=C11VI3ZKK90J type=del size=237377 2024-09-12T00:17:27.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.122+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~VQL74LO0MX1K.0 size=756283 2024-09-12T00:17:27.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.122+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=VQL74LO0MX1K tag=9J3FQ8LYLL3A type=write size=1804859 2024-09-12T00:17:27.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.126+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~YPHFIHMHZ6EA.0 size=1048576 2024-09-12T00:17:27.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.126+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~YPHFIHMHZ6EA.1 size=1048576 2024-09-12T00:17:27.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.130+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~YPHFIHMHZ6EA.2 size=934771 2024-09-12T00:17:27.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.134+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=YPHFIHMHZ6EA tag=3HV4PR7TY3HV type=write size=4080499 2024-09-12T00:17:27.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.138+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=2YIQOQVWY5AW type=del size=363926 2024-09-12T00:17:27.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.138+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=RB10GDD3I5EY type=del 2024-09-12T00:17:27.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.146+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~2FMRLLIQ2XWO.0 size=358857 2024-09-12T00:17:27.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.146+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=2FMRLLIQ2XWO tag=0QQFR5J1HHEF type=write size=1407433 2024-09-12T00:17:27.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.146+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=1RNJNUA1GL3S type=del 2024-09-12T00:17:27.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.150+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=RF9W71DKNS1O type=del size=1766524 2024-09-12T00:17:27.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.154+0000 7febed3678c0 1 < completed write operation key=H017KWW59B8Z tag=ADDKGBTH77L5 type=write size=843313 2024-09-12T00:17:27.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.154+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=R3T7DXHJM6PL type=del size=304509 2024-09-12T00:17:27.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.158+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=LYIGXX50RAUY type=del 2024-09-12T00:17:27.160 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.158+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=CSL3ZRVW6W1M type=del size=1418064 2024-09-12T00:17:27.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.166+0000 7febed3678c0 1 < suggested remove operation key=KLO47UYYACLU tag=7OE00J8VL9A7 type=del 2024-09-12T00:17:27.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.170+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~UQP7HTUXPL82.0 size=1048576 2024-09-12T00:17:27.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.174+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~UQP7HTUXPL82.1 size=330288 2024-09-12T00:17:27.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.174+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=UQP7HTUXPL82 tag=RPUGFNWY44G2 type=write size=2427440 2024-09-12T00:17:27.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.174+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~4UTC7MXJ7NPD.0 size=107685 2024-09-12T00:17:27.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.178+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=4UTC7MXJ7NPD tag=BOEWN3UBGPPA type=write size=1156261 2024-09-12T00:17:27.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.182+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=DBA4399HTVO7 type=del size=2649355 2024-09-12T00:17:27.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.182+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~3RNSBG6J0YHI.0 size=340711 2024-09-12T00:17:27.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.186+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=3RNSBG6J0YHI tag=7LUF6BD7XGKS type=write size=1389287 2024-09-12T00:17:27.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.190+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~DXWXT8JFHOF6.0 size=1048576 2024-09-12T00:17:27.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.194+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~DXWXT8JFHOF6.1 size=808358 2024-09-12T00:17:27.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.194+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=DXWXT8JFHOF6 tag=ERE2J683X92D type=write size=2905510 2024-09-12T00:17:27.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.194+0000 7febed3678c0 1 < completed write operation key=KABJD0GYBVF4 tag=AAN95BLWW1FT type=write size=526623 2024-09-12T00:17:27.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.198+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=Q5CUAHRNGA6M type=del size=902274 2024-09-12T00:17:27.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.202+0000 7febed3678c0 1 < completed write operation key=VW69JRC5JYX5 tag=5RXZLU9P1WK9 type=write size=46276 2024-09-12T00:17:27.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.202+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=JE029C1DUA7B type=del size=1439680 2024-09-12T00:17:27.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.206+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~ZJ1318VIY7OX.0 size=1048576 2024-09-12T00:17:27.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.206+0000 7febed3678c0 1 < canceled part key=_multipart_9CBI4FHAT3H2.2~ZJ1318VIY7OX.1 size=650955 2024-09-12T00:17:27.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.210+0000 7febed3678c0 1 < canceled multipart upload key=9CBI4FHAT3H2 upload=ZJ1318VIY7OX tag=ZH6G8ESZS52G type=write size=2748107 2024-09-12T00:17:27.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.210+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=H2YSD2HXYDNZ type=del size=754800 2024-09-12T00:17:27.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.214+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=689M6185PLKY type=del 2024-09-12T00:17:27.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.218+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~I3PLEZPYTIYW.0 size=1048576 2024-09-12T00:17:27.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.222+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~I3PLEZPYTIYW.1 size=637819 2024-09-12T00:17:27.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.222+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=I3PLEZPYTIYW tag=4ADQJQPN6UJ0 type=write size=2734971 2024-09-12T00:17:27.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.222+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~GMIQ8UI8WOUV.0 size=800912 2024-09-12T00:17:27.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.226+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=GMIQ8UI8WOUV tag=S83LP73GY51I type=write size=1849488 2024-09-12T00:17:27.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.230+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=NHVOUIAHEWR1 type=del size=3631745 2024-09-12T00:17:27.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.230+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~2M4PI3CA0G3M.0 size=1048576 2024-09-12T00:17:27.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.234+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~2M4PI3CA0G3M.1 size=491442 2024-09-12T00:17:27.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.238+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=2M4PI3CA0G3M tag=Z2ZKAIVIMG8F type=write size=2588594 2024-09-12T00:17:27.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.238+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=EPDEU7M23DCO type=del size=1073904 2024-09-12T00:17:27.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.242+0000 7febed3678c0 1 < completed write operation key=ASFLGSKWYHG5 tag=VTHVURAWPY6Y type=write size=98035 2024-09-12T00:17:27.244 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.246+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=3OOW99UYZ829 type=del size=1280503 2024-09-12T00:17:27.244 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.246+0000 7febed3678c0 1 < canceled part key=_multipart_VW69JRC5JYX5.2~VQL74LO0MX1K.0 size=756283 2024-09-12T00:17:27.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.250+0000 7febed3678c0 1 < canceled multipart upload key=VW69JRC5JYX5 upload=VQL74LO0MX1K tag=9J3FQ8LYLL3A type=write size=1804859 2024-09-12T00:17:27.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.254+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~5I8MXIB1PKKB.0 size=356653 2024-09-12T00:17:27.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.254+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=5I8MXIB1PKKB tag=Z0PJ3LQL4GJ9 type=write size=1405229 2024-09-12T00:17:27.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.258+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=2YIQOQVWY5AW type=del 2024-09-12T00:17:27.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.262+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~8JFBU1MBRN8C.0 size=1048576 2024-09-12T00:17:27.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.262+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~8JFBU1MBRN8C.1 size=1048576 2024-09-12T00:17:27.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.266+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~8JFBU1MBRN8C.2 size=122563 2024-09-12T00:17:27.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.266+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=8JFBU1MBRN8C tag=C3L4Y1JEO91Y type=write size=3268291 2024-09-12T00:17:27.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.266+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~2FMRLLIQ2XWO.0 size=358857 2024-09-12T00:17:27.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.270+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=2FMRLLIQ2XWO tag=0QQFR5J1HHEF type=write size=1407433 2024-09-12T00:17:27.272 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.274+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=7APF1QY0SG1M type=del size=1344235 2024-09-12T00:17:27.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.278+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=RF9W71DKNS1O type=del 2024-09-12T00:17:27.279 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.278+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~TZKUA03NJRFC.0 size=1048576 2024-09-12T00:17:27.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.282+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~TZKUA03NJRFC.1 size=1048576 2024-09-12T00:17:27.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.282+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~TZKUA03NJRFC.2 size=394162 2024-09-12T00:17:27.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.282+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=TZKUA03NJRFC tag=7A7QAKJR2AM1 type=write size=3539890 2024-09-12T00:17:27.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.286+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=R3T7DXHJM6PL type=del 2024-09-12T00:17:27.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.290+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=IV4DWYN130VF type=del size=630858 2024-09-12T00:17:27.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.294+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=CSL3ZRVW6W1M type=del 2024-09-12T00:17:27.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.294+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=FTMRNTFA8M2H type=del size=397900 2024-09-12T00:17:27.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.298+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~UQP7HTUXPL82.0 size=1048576 2024-09-12T00:17:27.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.298+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~UQP7HTUXPL82.1 size=330288 2024-09-12T00:17:27.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.302+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=UQP7HTUXPL82 tag=RPUGFNWY44G2 type=write size=2427440 2024-09-12T00:17:27.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.306+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~77LAOYYD9YVJ.0 size=1048576 2024-09-12T00:17:27.308 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.310+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~77LAOYYD9YVJ.1 size=1048576 2024-09-12T00:17:27.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.310+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~77LAOYYD9YVJ.2 size=444179 2024-09-12T00:17:27.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.310+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=77LAOYYD9YVJ tag=8OT6YSRV5Y2T type=write size=3589907 2024-09-12T00:17:27.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.314+0000 7febed3678c0 1 < canceled operation key=ASFLGSKWYHG5 tag=DBA4399HTVO7 type=del size=2649355 2024-09-12T00:17:27.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.318+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~1UVF5AE49TB9.0 size=1048576 2024-09-12T00:17:27.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.322+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~1UVF5AE49TB9.1 size=1048576 2024-09-12T00:17:27.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.322+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~1UVF5AE49TB9.2 size=259086 2024-09-12T00:17:27.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.322+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=1UVF5AE49TB9 tag=FE6G2KQ97UGY type=write size=3404814 2024-09-12T00:17:27.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.326+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~DXWXT8JFHOF6.0 size=1048576 2024-09-12T00:17:27.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.326+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~DXWXT8JFHOF6.1 size=808358 2024-09-12T00:17:27.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.330+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=DXWXT8JFHOF6 tag=ERE2J683X92D type=write size=2905510 2024-09-12T00:17:27.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.334+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~YRY1E6M3W5G1.0 size=1048576 2024-09-12T00:17:27.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.334+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~YRY1E6M3W5G1.1 size=1048576 2024-09-12T00:17:27.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.338+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~YRY1E6M3W5G1.2 size=273879 2024-09-12T00:17:27.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.338+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=YRY1E6M3W5G1 tag=C017P1YR0TAB type=write size=3419607 2024-09-12T00:17:27.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.338+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=Q5CUAHRNGA6M type=del 2024-09-12T00:17:27.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.342+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=Q7KXBZ0GYCBC type=del size=3963117 2024-09-12T00:17:27.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.346+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=JE029C1DUA7B type=del 2024-09-12T00:17:27.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.346+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=IHOVPVLPNR1G type=del size=3118622 2024-09-12T00:17:27.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.350+0000 7febed3678c0 1 < suggested remove operation key=LGFKY0CP299H tag=H2YSD2HXYDNZ type=del 2024-09-12T00:17:27.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.354+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=96E7DX3DDKQO type=del size=2066773 2024-09-12T00:17:27.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.358+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~I3PLEZPYTIYW.0 size=1048576 2024-09-12T00:17:27.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.358+0000 7febed3678c0 1 < canceled part key=_multipart_0KQK1CXHO096.2~I3PLEZPYTIYW.1 size=637819 2024-09-12T00:17:27.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.362+0000 7febed3678c0 1 < canceled multipart upload key=0KQK1CXHO096 upload=I3PLEZPYTIYW tag=4ADQJQPN6UJ0 type=write size=2734971 2024-09-12T00:17:27.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.362+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=M8K3PWABAHCE type=del size=73130 2024-09-12T00:17:27.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.366+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=NHVOUIAHEWR1 type=del 2024-09-12T00:17:27.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.370+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=QFRUKPPCQ6QY type=del size=532828 2024-09-12T00:17:27.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.370+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=EPDEU7M23DCO type=del 2024-09-12T00:17:27.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.374+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=OZ42CD8JPV4W type=del size=1417321 2024-09-12T00:17:27.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.378+0000 7febed3678c0 1 < suggested remove operation key=MAZHOU2CEUCU tag=3OOW99UYZ829 type=del 2024-09-12T00:17:27.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.382+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~959CG84PWXPL.0 size=419014 2024-09-12T00:17:27.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.382+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=959CG84PWXPL tag=H5SQWU7AAWC2 type=write size=1467590 2024-09-12T00:17:27.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.382+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~5I8MXIB1PKKB.0 size=356653 2024-09-12T00:17:27.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.386+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=5I8MXIB1PKKB tag=Z0PJ3LQL4GJ9 type=write size=1405229 2024-09-12T00:17:27.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.390+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~3IZBFEE7GH26.0 size=1048576 2024-09-12T00:17:27.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.390+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~3IZBFEE7GH26.1 size=478992 2024-09-12T00:17:27.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.390+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=3IZBFEE7GH26 tag=69RND1ZAJ9YM type=write size=2576144 2024-09-12T00:17:27.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.394+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~8JFBU1MBRN8C.0 size=1048576 2024-09-12T00:17:27.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.394+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~8JFBU1MBRN8C.1 size=1048576 2024-09-12T00:17:27.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.398+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~8JFBU1MBRN8C.2 size=122563 2024-09-12T00:17:27.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.402+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=8JFBU1MBRN8C tag=C3L4Y1JEO91Y type=write size=3268291 2024-09-12T00:17:27.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.406+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~Z4KN66MEU791.0 size=1048576 2024-09-12T00:17:27.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.410+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~Z4KN66MEU791.1 size=595185 2024-09-12T00:17:27.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.410+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=Z4KN66MEU791 tag=Z7SHYR98Z4TV type=write size=2692337 2024-09-12T00:17:27.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.410+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=7APF1QY0SG1M type=del 2024-09-12T00:17:27.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.414+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~DWTX3URW0B5V.0 size=1048576 2024-09-12T00:17:27.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.418+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~DWTX3URW0B5V.1 size=969941 2024-09-12T00:17:27.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.418+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=DWTX3URW0B5V tag=SHJT10I8Y5WQ type=write size=3067093 2024-09-12T00:17:27.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.418+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~TZKUA03NJRFC.0 size=1048576 2024-09-12T00:17:27.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.422+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~TZKUA03NJRFC.1 size=1048576 2024-09-12T00:17:27.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.422+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~TZKUA03NJRFC.2 size=394162 2024-09-12T00:17:27.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.426+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=TZKUA03NJRFC tag=7A7QAKJR2AM1 type=write size=3539890 2024-09-12T00:17:27.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.430+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=BPFPUZI3CC5K type=del size=3267901 2024-09-12T00:17:27.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.434+0000 7febed3678c0 1 < suggested remove operation key=ELNXYXX5ZWOW tag=IV4DWYN130VF type=del 2024-09-12T00:17:27.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.434+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=RBGZ32E5V6QZ type=write size=991488 2024-09-12T00:17:27.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.438+0000 7febed3678c0 1 < suggested remove operation key=1HABX7YZ491W tag=FTMRNTFA8M2H type=del 2024-09-12T00:17:27.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.442+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~B7B1JDP92OB1.0 size=1048576 2024-09-12T00:17:27.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.442+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~B7B1JDP92OB1.1 size=340218 2024-09-12T00:17:27.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.442+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=B7B1JDP92OB1 tag=AAL8C72H2C6L type=write size=2437370 2024-09-12T00:17:27.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.446+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~77LAOYYD9YVJ.0 size=1048576 2024-09-12T00:17:27.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.446+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~77LAOYYD9YVJ.1 size=1048576 2024-09-12T00:17:27.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.450+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~77LAOYYD9YVJ.2 size=444179 2024-09-12T00:17:27.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.454+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=77LAOYYD9YVJ tag=8OT6YSRV5Y2T type=write size=3589907 2024-09-12T00:17:27.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.454+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=0K9K8AYHTXEC type=del size=7517 2024-09-12T00:17:27.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.458+0000 7febed3678c0 1 < canceled part key=_multipart_MAZHOU2CEUCU.2~1UVF5AE49TB9.0 size=1048576 2024-09-12T00:17:27.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.458+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~1UVF5AE49TB9.1 size=1048576 2024-09-12T00:17:27.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.458+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~1UVF5AE49TB9.2 size=259086 2024-09-12T00:17:27.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.462+0000 7febed3678c0 1 < canceled multipart upload key=MAZHOU2CEUCU upload=1UVF5AE49TB9 tag=FE6G2KQ97UGY type=write size=3404814 2024-09-12T00:17:27.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.466+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=JUI99BBMEHV2 type=del size=2153284 2024-09-12T00:17:27.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.466+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~YRY1E6M3W5G1.0 size=1048576 2024-09-12T00:17:27.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.470+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~YRY1E6M3W5G1.1 size=1048576 2024-09-12T00:17:27.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.470+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~YRY1E6M3W5G1.2 size=273879 2024-09-12T00:17:27.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.474+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=YRY1E6M3W5G1 tag=C017P1YR0TAB type=write size=3419607 2024-09-12T00:17:27.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.478+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=L021J96PDOC4 type=del size=1912289 2024-09-12T00:17:27.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.482+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=Q7KXBZ0GYCBC type=del 2024-09-12T00:17:27.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.486+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~7V0D52ZDB7AM.0 size=790852 2024-09-12T00:17:27.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.486+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=7V0D52ZDB7AM tag=T2QDA85QRB2M type=write size=1839428 2024-09-12T00:17:27.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.486+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=IHOVPVLPNR1G type=del 2024-09-12T00:17:27.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.490+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=YYWTXDL5AVSB type=del size=3773817 2024-09-12T00:17:27.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.490+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=96E7DX3DDKQO type=del 2024-09-12T00:17:27.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.494+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~RXH8JYDN0I4K.0 size=1048576 2024-09-12T00:17:27.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.498+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~RXH8JYDN0I4K.1 size=1048576 2024-09-12T00:17:27.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.498+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~RXH8JYDN0I4K.2 size=43261 2024-09-12T00:17:27.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.498+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=RXH8JYDN0I4K tag=IY0CKXFEI2L6 type=write size=3188989 2024-09-12T00:17:27.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.502+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=M8K3PWABAHCE type=del 2024-09-12T00:17:27.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.502+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=3N6UPG0TOI4P type=del size=2595336 2024-09-12T00:17:27.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.506+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=QFRUKPPCQ6QY type=del 2024-09-12T00:17:27.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.506+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=HJ5ACVNUJ77D type=del size=2996666 2024-09-12T00:17:27.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.510+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=OZ42CD8JPV4W type=del 2024-09-12T00:17:27.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.510+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=0K6WISTGFBE5 type=write size=347060 2024-09-12T00:17:27.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.514+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~959CG84PWXPL.0 size=419014 2024-09-12T00:17:27.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.518+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=959CG84PWXPL tag=H5SQWU7AAWC2 type=write size=1467590 2024-09-12T00:17:27.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.518+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=Q9J2G9U9YOH5 type=del size=2620266 2024-09-12T00:17:27.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.522+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~3IZBFEE7GH26.0 size=1048576 2024-09-12T00:17:27.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.526+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~3IZBFEE7GH26.1 size=478992 2024-09-12T00:17:27.529 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.530+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=3IZBFEE7GH26 tag=69RND1ZAJ9YM type=write size=2576144 2024-09-12T00:17:27.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.530+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=NBI33IQXDTBZ type=del size=3235147 2024-09-12T00:17:27.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.534+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~Z4KN66MEU791.0 size=1048576 2024-09-12T00:17:27.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.538+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~Z4KN66MEU791.1 size=595185 2024-09-12T00:17:27.539 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.538+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=Z4KN66MEU791 tag=Z7SHYR98Z4TV type=write size=2692337 2024-09-12T00:17:27.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.542+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~GJ2PA09IPEVG.0 size=1048576 2024-09-12T00:17:27.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.546+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~GJ2PA09IPEVG.1 size=1048576 2024-09-12T00:17:27.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.546+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~GJ2PA09IPEVG.2 size=174727 2024-09-12T00:17:27.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.546+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=GJ2PA09IPEVG tag=IYUVJ7K6UGI7 type=write size=3320455 2024-09-12T00:17:27.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.550+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~DWTX3URW0B5V.0 size=1048576 2024-09-12T00:17:27.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.550+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~DWTX3URW0B5V.1 size=969941 2024-09-12T00:17:27.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.554+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=DWTX3URW0B5V tag=SHJT10I8Y5WQ type=write size=3067093 2024-09-12T00:17:27.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.558+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=AW14XT70YGZ1 type=del size=2849349 2024-09-12T00:17:27.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.558+0000 7febed3678c0 -1 < failed to complete operation key=1HABX7YZ491W tag=BPFPUZI3CC5K type=del size=3267901: (22) Invalid argument 2024-09-12T00:17:27.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.562+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=CMLM1BEX2WTX type=del size=3622045 2024-09-12T00:17:27.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.566+0000 7febed3678c0 1 < completed write operation key=W2VEW3JJEJY7 tag=RBGZ32E5V6QZ type=write size=991488 2024-09-12T00:17:27.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.566+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=Z0R2ES7WBO2N type=del size=2754276 2024-09-12T00:17:27.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.570+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~B7B1JDP92OB1.0 size=1048576 2024-09-12T00:17:27.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.570+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~B7B1JDP92OB1.1 size=340218 2024-09-12T00:17:27.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.574+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=B7B1JDP92OB1 tag=AAL8C72H2C6L type=write size=2437370 2024-09-12T00:17:27.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.574+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=7DCOD0CP4PZI type=del size=2129730 2024-09-12T00:17:27.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.578+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=0K9K8AYHTXEC type=del 2024-09-12T00:17:27.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.582+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~6STDTFEG3C2P.0 size=885146 2024-09-12T00:17:27.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.582+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=6STDTFEG3C2P tag=V2QK92ZFTD7N type=write size=1933722 2024-09-12T00:17:27.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.582+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=JUI99BBMEHV2 type=del 2024-09-12T00:17:27.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.586+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=W7751T6HEKGH type=del size=2177147 2024-09-12T00:17:27.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.586+0000 7febed3678c0 1 < canceled operation key=52SSW5KTCS15 tag=L021J96PDOC4 type=del size=1912289 2024-09-12T00:17:27.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.590+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~3A1QWRZ13OUI.0 size=1048576 2024-09-12T00:17:27.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.594+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~3A1QWRZ13OUI.1 size=300828 2024-09-12T00:17:27.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.594+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=3A1QWRZ13OUI tag=LRYL5QEP9JRR type=write size=2397980 2024-09-12T00:17:27.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.594+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~7V0D52ZDB7AM.0 size=790852 2024-09-12T00:17:27.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.598+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=7V0D52ZDB7AM tag=T2QDA85QRB2M type=write size=1839428 2024-09-12T00:17:27.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.602+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=VOYGDSVQLORZ type=del size=454451 2024-09-12T00:17:27.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.602+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=YYWTXDL5AVSB type=del 2024-09-12T00:17:27.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.606+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=NJ2WN3AB9ENS type=del size=647298 2024-09-12T00:17:27.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.606+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~RXH8JYDN0I4K.0 size=1048576 2024-09-12T00:17:27.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.610+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~RXH8JYDN0I4K.1 size=1048576 2024-09-12T00:17:27.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.610+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~RXH8JYDN0I4K.2 size=43261 2024-09-12T00:17:27.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.614+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=RXH8JYDN0I4K tag=IY0CKXFEI2L6 type=write size=3188989 2024-09-12T00:17:27.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.618+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=MKLBH7TUNX0E type=del size=2372986 2024-09-12T00:17:27.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.622+0000 7febed3678c0 1 < suggested remove operation key=HR9MVC82R7GL tag=3N6UPG0TOI4P type=del 2024-09-12T00:17:27.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.626+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=TF9JXB7LUHVN type=write size=254063 2024-09-12T00:17:27.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.626+0000 7febed3678c0 1 < canceled operation key=ELNXYXX5ZWOW tag=HJ5ACVNUJ77D type=del size=2996666 2024-09-12T00:17:27.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.630+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~1KXPRL6GNLMT.0 size=1048576 2024-09-12T00:17:27.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.634+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~1KXPRL6GNLMT.1 size=667309 2024-09-12T00:17:27.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.634+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=1KXPRL6GNLMT tag=5D700IVKKL80 type=write size=2764461 2024-09-12T00:17:27.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.634+0000 7febed3678c0 1 < completed write operation key=VW69JRC5JYX5 tag=0K6WISTGFBE5 type=write size=347060 2024-09-12T00:17:27.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.638+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=XH5FH2J31HWK type=del size=1724252 2024-09-12T00:17:27.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.638+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=Q9J2G9U9YOH5 type=del 2024-09-12T00:17:27.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.642+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=3IJXPE5D9LJS type=del size=2786615 2024-09-12T00:17:27.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.642+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=NBI33IQXDTBZ type=del 2024-09-12T00:17:27.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.650+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~5XSUHI5V8VDI.0 size=1048576 2024-09-12T00:17:27.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.650+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~5XSUHI5V8VDI.1 size=102374 2024-09-12T00:17:27.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.650+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=5XSUHI5V8VDI tag=707VKAGN9M0Z type=write size=2199526 2024-09-12T00:17:27.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.654+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~GJ2PA09IPEVG.0 size=1048576 2024-09-12T00:17:27.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.654+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~GJ2PA09IPEVG.1 size=1048576 2024-09-12T00:17:27.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.658+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~GJ2PA09IPEVG.2 size=174727 2024-09-12T00:17:27.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.662+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=GJ2PA09IPEVG tag=IYUVJ7K6UGI7 type=write size=3320455 2024-09-12T00:17:27.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.662+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=20Q7SPFVA25P type=del size=3763767 2024-09-12T00:17:27.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.666+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=AW14XT70YGZ1 type=del 2024-09-12T00:17:27.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.670+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~WIJCD07GH26Q.0 size=554059 2024-09-12T00:17:27.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.670+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=WIJCD07GH26Q tag=MPM2UG28CFOJ type=write size=1602635 2024-09-12T00:17:27.672 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.674+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=CMLM1BEX2WTX type=del 2024-09-12T00:17:27.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.674+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=T0OBH9W0FNX0 type=del size=1356024 2024-09-12T00:17:27.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.678+0000 7febed3678c0 1 < suggested update operation key=ELNXYXX5ZWOW tag=Z0R2ES7WBO2N type=del size=2754276 2024-09-12T00:17:27.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.682+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~U319B4GKO090.0 size=329026 2024-09-12T00:17:27.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.682+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=U319B4GKO090 tag=QIC12KW0MPS2 type=write size=1377602 2024-09-12T00:17:27.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.686+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=7DCOD0CP4PZI type=del 2024-09-12T00:17:27.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.686+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=54RFGMSVOD59 type=del size=1801030 2024-09-12T00:17:27.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.690+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~6STDTFEG3C2P.0 size=885146 2024-09-12T00:17:27.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.694+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=6STDTFEG3C2P tag=V2QK92ZFTD7N type=write size=1933722 2024-09-12T00:17:27.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.698+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=UL3XAC2LK4OD type=del size=3081344 2024-09-12T00:17:27.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.702+0000 7febed3678c0 1 < suggested update operation key=9CBI4FHAT3H2 tag=W7751T6HEKGH type=del size=2177147 2024-09-12T00:17:27.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.702+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=VJ3J1BAOX6IT type=del size=2654522 2024-09-12T00:17:27.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.706+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~3A1QWRZ13OUI.0 size=1048576 2024-09-12T00:17:27.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.706+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~3A1QWRZ13OUI.1 size=300828 2024-09-12T00:17:27.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.710+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=3A1QWRZ13OUI tag=LRYL5QEP9JRR type=write size=2397980 2024-09-12T00:17:27.712 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.714+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=A49IAFK3DIHV type=write size=1014204 2024-09-12T00:17:27.714 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.714+0000 7febed3678c0 -1 < failed to complete operation key=9CBI4FHAT3H2 tag=VOYGDSVQLORZ type=del size=454451: (22) Invalid argument 2024-09-12T00:17:27.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.718+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=H9B2VK1D2GTD type=write size=771142 2024-09-12T00:17:27.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.718+0000 7febed3678c0 1 < canceled operation key=70W3V7TFBUFJ tag=NJ2WN3AB9ENS type=del size=647298 2024-09-12T00:17:27.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.722+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=AKIC20R1URHW type=write size=1042327 2024-09-12T00:17:27.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.726+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=MKLBH7TUNX0E type=del 2024-09-12T00:17:27.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.726+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=WCP9SN1LY6V5 type=del size=4119862 2024-09-12T00:17:27.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.730+0000 7febed3678c0 1 < completed write operation key=KABJD0GYBVF4 tag=TF9JXB7LUHVN type=write size=254063 2024-09-12T00:17:27.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.734+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~A12KNFPY5NF7.0 size=1048576 2024-09-12T00:17:27.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.738+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~A12KNFPY5NF7.1 size=379443 2024-09-12T00:17:27.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.738+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=A12KNFPY5NF7 tag=ZBMXGXCNRVSG type=write size=2476595 2024-09-12T00:17:27.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.742+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~1KXPRL6GNLMT.0 size=1048576 2024-09-12T00:17:27.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.742+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~1KXPRL6GNLMT.1 size=667309 2024-09-12T00:17:27.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.746+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=1KXPRL6GNLMT tag=5D700IVKKL80 type=write size=2764461 2024-09-12T00:17:27.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.750+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=7SAXCMUIDCP0 type=del size=1656781 2024-09-12T00:17:27.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.754+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=XH5FH2J31HWK type=del 2024-09-12T00:17:27.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.758+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~ZKVRSIQZJ1S1.0 size=1048576 2024-09-12T00:17:27.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.758+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~ZKVRSIQZJ1S1.1 size=1048576 2024-09-12T00:17:27.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.762+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~ZKVRSIQZJ1S1.2 size=556180 2024-09-12T00:17:27.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.762+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=ZKVRSIQZJ1S1 tag=Q9ILM0QXO3XL type=write size=3701908 2024-09-12T00:17:27.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.762+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=3IJXPE5D9LJS type=del 2024-09-12T00:17:27.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.766+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~93R1RDRH3ZJ0.0 size=1048576 2024-09-12T00:17:27.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.770+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~93R1RDRH3ZJ0.1 size=1048576 2024-09-12T00:17:27.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.770+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~93R1RDRH3ZJ0.2 size=160874 2024-09-12T00:17:27.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.770+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=93R1RDRH3ZJ0 tag=QUV9G2VDZ3LO type=write size=3306602 2024-09-12T00:17:27.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.770+0000 7febed3678c0 1 < canceled part key=_multipart_LWAMFA0RSW6S.2~5XSUHI5V8VDI.0 size=1048576 2024-09-12T00:17:27.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.774+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~5XSUHI5V8VDI.1 size=102374 2024-09-12T00:17:27.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.778+0000 7febed3678c0 1 < canceled multipart upload key=LWAMFA0RSW6S upload=5XSUHI5V8VDI tag=707VKAGN9M0Z type=write size=2199526 2024-09-12T00:17:27.782 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.782+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~3I6E9183M2Q8.0 size=660868 2024-09-12T00:17:27.782 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.782+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=3I6E9183M2Q8 tag=47IZ0B6NGA6P type=write size=1709444 2024-09-12T00:17:27.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.786+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=20Q7SPFVA25P type=del 2024-09-12T00:17:27.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.790+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~DRBVYAM29ZR4.0 size=1048576 2024-09-12T00:17:27.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.794+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~DRBVYAM29ZR4.1 size=974033 2024-09-12T00:17:27.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.794+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=DRBVYAM29ZR4 tag=HQ0I95X1VNTK type=write size=3071185 2024-09-12T00:17:27.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.794+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~WIJCD07GH26Q.0 size=554059 2024-09-12T00:17:27.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.798+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=WIJCD07GH26Q tag=MPM2UG28CFOJ type=write size=1602635 2024-09-12T00:17:27.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.802+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=1IULS77QYFVC type=del size=2489931 2024-09-12T00:17:27.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.806+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=T0OBH9W0FNX0 type=del 2024-09-12T00:17:27.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.806+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=JVQK0XTKHS4M type=del size=662648 2024-09-12T00:17:27.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.810+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~U319B4GKO090.0 size=329026 2024-09-12T00:17:27.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.814+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=U319B4GKO090 tag=QIC12KW0MPS2 type=write size=1377602 2024-09-12T00:17:27.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.814+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=K7LTF47JHM51 type=del size=1229634 2024-09-12T00:17:27.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.818+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=54RFGMSVOD59 type=del 2024-09-12T00:17:27.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.822+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=I1M1HSDGQ8EV type=del size=349668 2024-09-12T00:17:27.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.822+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=UL3XAC2LK4OD type=del 2024-09-12T00:17:27.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.826+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=MWV46B8KRFSO type=del size=572556 2024-09-12T00:17:27.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.826+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=VJ3J1BAOX6IT type=del 2024-09-12T00:17:27.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.830+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~S02OTEJTRIEN.0 size=1048576 2024-09-12T00:17:27.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.834+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~S02OTEJTRIEN.1 size=1048576 2024-09-12T00:17:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.838+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~S02OTEJTRIEN.2 size=255896 2024-09-12T00:17:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.838+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=S02OTEJTRIEN tag=MXIMKNEE7C9W type=write size=3401624 2024-09-12T00:17:27.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.838+0000 7febed3678c0 1 < canceled operation key=VU1AF57EUA0R tag=A49IAFK3DIHV type=write size=1014204 2024-09-12T00:17:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.842+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=4N3XP601GZ08 type=write size=1007194 2024-09-12T00:17:27.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.842+0000 7febed3678c0 1 < canceled operation key=LWAMFA0RSW6S tag=H9B2VK1D2GTD type=write size=771142 2024-09-12T00:17:27.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.846+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=3T28F224F9HK type=del size=646517 2024-09-12T00:17:27.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.850+0000 7febed3678c0 1 < completed write operation key=70W3V7TFBUFJ tag=AKIC20R1URHW type=write size=1042327 2024-09-12T00:17:27.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.850+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=SYIFN3PV5U1Q type=del size=3133458 2024-09-12T00:17:27.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.854+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=WCP9SN1LY6V5 type=del 2024-09-12T00:17:27.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.858+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~YXV91IRMVJ9G.0 size=1048576 2024-09-12T00:17:27.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.862+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~YXV91IRMVJ9G.1 size=1048576 2024-09-12T00:17:27.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.862+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~YXV91IRMVJ9G.2 size=800256 2024-09-12T00:17:27.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.862+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=YXV91IRMVJ9G tag=UZN3FZHJLI4A type=write size=3945984 2024-09-12T00:17:27.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.862+0000 7febed3678c0 1 < canceled part key=_multipart_AHTIFXX3SGK7.2~A12KNFPY5NF7.0 size=1048576 2024-09-12T00:17:27.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.866+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~A12KNFPY5NF7.1 size=379443 2024-09-12T00:17:27.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.870+0000 7febed3678c0 1 < canceled multipart upload key=AHTIFXX3SGK7 upload=A12KNFPY5NF7 tag=ZBMXGXCNRVSG type=write size=2476595 2024-09-12T00:17:27.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.874+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=D8XD70N41C9V type=del size=2597521 2024-09-12T00:17:27.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.878+0000 7febed3678c0 1 < suggested update operation key=LWAMFA0RSW6S tag=7SAXCMUIDCP0 type=del size=1656781 2024-09-12T00:17:27.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.878+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=2HGO0IAVQ7FF type=del size=2278083 2024-09-12T00:17:27.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.882+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~ZKVRSIQZJ1S1.0 size=1048576 2024-09-12T00:17:27.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.886+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~ZKVRSIQZJ1S1.1 size=1048576 2024-09-12T00:17:27.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.886+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~ZKVRSIQZJ1S1.2 size=556180 2024-09-12T00:17:27.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.890+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=ZKVRSIQZJ1S1 tag=Q9ILM0QXO3XL type=write size=3701908 2024-09-12T00:17:27.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.894+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~1L38MO7M9VKX.0 size=678144 2024-09-12T00:17:27.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.894+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=1L38MO7M9VKX tag=DIS6N1MP8MXV type=write size=1726720 2024-09-12T00:17:27.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.898+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~93R1RDRH3ZJ0.0 size=1048576 2024-09-12T00:17:27.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.898+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~93R1RDRH3ZJ0.1 size=1048576 2024-09-12T00:17:27.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.902+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~93R1RDRH3ZJ0.2 size=160874 2024-09-12T00:17:27.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.906+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=93R1RDRH3ZJ0 tag=QUV9G2VDZ3LO type=write size=3306602 2024-09-12T00:17:27.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.910+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=A2A24GL8Y6HM type=write size=818580 2024-09-12T00:17:27.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.910+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~3I6E9183M2Q8.0 size=660868 2024-09-12T00:17:27.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.918+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=3I6E9183M2Q8 tag=47IZ0B6NGA6P type=write size=1709444 2024-09-12T00:17:27.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.918+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=2S649ST7NW1T type=del size=940658 2024-09-12T00:17:27.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.922+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~DRBVYAM29ZR4.0 size=1048576 2024-09-12T00:17:27.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.922+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~DRBVYAM29ZR4.1 size=974033 2024-09-12T00:17:27.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.926+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=DRBVYAM29ZR4 tag=HQ0I95X1VNTK type=write size=3071185 2024-09-12T00:17:27.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.930+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=LL3W82P1WYXR type=del size=3125820 2024-09-12T00:17:27.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.934+0000 7febed3678c0 1 < canceled operation key=ELNXYXX5ZWOW tag=1IULS77QYFVC type=del size=2489931 2024-09-12T00:17:27.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.934+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=418OQW9QTQQA type=del size=62801 2024-09-12T00:17:27.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.942+0000 7febed3678c0 1 < suggested update operation key=ELNXYXX5ZWOW tag=JVQK0XTKHS4M type=del size=662648 2024-09-12T00:17:27.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.946+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=J7MCCEBHFMLV type=del size=2748429 2024-09-12T00:17:27.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.950+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=K7LTF47JHM51 type=del 2024-09-12T00:17:27.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.954+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=F9UD2HVSRBHK type=del size=609723 2024-09-12T00:17:27.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.954+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=I1M1HSDGQ8EV type=del 2024-09-12T00:17:27.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.962+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~FKR96EC8ZYMF.0 size=1048576 2024-09-12T00:17:27.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.966+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~FKR96EC8ZYMF.1 size=1048576 2024-09-12T00:17:27.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.970+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~FKR96EC8ZYMF.2 size=1036343 2024-09-12T00:17:27.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.970+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=FKR96EC8ZYMF tag=YO0W2D1MN3A2 type=write size=4182071 2024-09-12T00:17:27.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.974+0000 7febed3678c0 1 < suggested remove operation key=VU1AF57EUA0R tag=MWV46B8KRFSO type=del 2024-09-12T00:17:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.978+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=PZJ2LW902PTL type=del size=1741546 2024-09-12T00:17:27.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.982+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~S02OTEJTRIEN.0 size=1048576 2024-09-12T00:17:27.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.986+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~S02OTEJTRIEN.1 size=1048576 2024-09-12T00:17:27.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.990+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~S02OTEJTRIEN.2 size=255896 2024-09-12T00:17:27.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.994+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=S02OTEJTRIEN tag=MXIMKNEE7C9W type=write size=3401624 2024-09-12T00:17:27.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.998+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=RQVP3METVYN2 type=write size=414322 2024-09-12T00:17:27.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:27.998+0000 7febed3678c0 1 < completed write operation key=3G9ABEEEDRI3 tag=4N3XP601GZ08 type=write size=1007194 2024-09-12T00:17:28.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.002+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=XJDXIJUEY2B8 type=del size=408862 2024-09-12T00:17:28.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.010+0000 7febed3678c0 1 < suggested update operation key=25THATWGX4WS tag=3T28F224F9HK type=del size=646517 2024-09-12T00:17:28.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.014+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~PXTSGD5N51M4.0 size=575914 2024-09-12T00:17:28.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.014+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=PXTSGD5N51M4 tag=ZFII20ZYQSZL type=write size=1624490 2024-09-12T00:17:28.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.018+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=SYIFN3PV5U1Q type=del 2024-09-12T00:17:28.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.022+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~YYK35IRLL9MP.0 size=1048576 2024-09-12T00:17:28.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.026+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~YYK35IRLL9MP.1 size=127112 2024-09-12T00:17:28.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.026+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=YYK35IRLL9MP tag=024QM364QBUH type=write size=2224264 2024-09-12T00:17:28.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.026+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~YXV91IRMVJ9G.0 size=1048576 2024-09-12T00:17:28.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.030+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~YXV91IRMVJ9G.1 size=1048576 2024-09-12T00:17:28.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.034+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~YXV91IRMVJ9G.2 size=800256 2024-09-12T00:17:28.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.038+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=YXV91IRMVJ9G tag=UZN3FZHJLI4A type=write size=3945984 2024-09-12T00:17:28.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.042+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~Z57O88PFUIQ4.0 size=1048576 2024-09-12T00:17:28.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.046+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~Z57O88PFUIQ4.1 size=1048576 2024-09-12T00:17:28.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.046+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~Z57O88PFUIQ4.2 size=235467 2024-09-12T00:17:28.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.046+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=Z57O88PFUIQ4 tag=V2NWX3WFEVC2 type=write size=3381195 2024-09-12T00:17:28.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.050+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=D8XD70N41C9V type=del 2024-09-12T00:17:28.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.054+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=JODCTGAQJ71J type=del size=2629210 2024-09-12T00:17:28.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.054+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=2HGO0IAVQ7FF type=del 2024-09-12T00:17:28.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.058+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=PJ6O1Q2H6LCZ type=write size=788962 2024-09-12T00:17:28.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.062+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~1L38MO7M9VKX.0 size=678144 2024-09-12T00:17:28.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.066+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=1L38MO7M9VKX tag=DIS6N1MP8MXV type=write size=1726720 2024-09-12T00:17:28.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.070+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=PD6SPUUWYNSE type=del size=263653 2024-09-12T00:17:28.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.070+0000 7febed3678c0 1 < completed write operation key=0KQK1CXHO096 tag=A2A24GL8Y6HM type=write size=818580 2024-09-12T00:17:28.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.078+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~PUBOVE2AYMXK.0 size=685174 2024-09-12T00:17:28.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.078+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=PUBOVE2AYMXK tag=DS5XLQP4HTHV type=write size=1733750 2024-09-12T00:17:28.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.078+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=2S649ST7NW1T type=del 2024-09-12T00:17:28.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.086+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~XDG6PLMF93YB.0 size=1048576 2024-09-12T00:17:28.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.086+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~XDG6PLMF93YB.1 size=1048576 2024-09-12T00:17:28.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.090+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~XDG6PLMF93YB.2 size=121809 2024-09-12T00:17:28.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.090+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=XDG6PLMF93YB tag=TN6YOMW01SSC type=write size=3267537 2024-09-12T00:17:28.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.094+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=LL3W82P1WYXR type=del 2024-09-12T00:17:28.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.098+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=ISKR5NKJX48X type=del size=3108292 2024-09-12T00:17:28.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.102+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=418OQW9QTQQA type=del 2024-09-12T00:17:28.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.106+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=2SIMIIUEZ6D7 type=del size=1052703 2024-09-12T00:17:28.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.106+0000 7febed3678c0 1 < canceled operation key=LWAMFA0RSW6S tag=J7MCCEBHFMLV type=del size=2748429 2024-09-12T00:17:28.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.110+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=LEN0NOREDG38 type=del size=3927835 2024-09-12T00:17:28.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.114+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=F9UD2HVSRBHK type=del 2024-09-12T00:17:28.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.118+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~ZTEB6DE8FIFH.0 size=1048576 2024-09-12T00:17:28.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.122+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~ZTEB6DE8FIFH.1 size=1048576 2024-09-12T00:17:28.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.126+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~ZTEB6DE8FIFH.2 size=429084 2024-09-12T00:17:28.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.126+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=ZTEB6DE8FIFH tag=FG9658G74WGZ type=write size=3574812 2024-09-12T00:17:28.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.130+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~FKR96EC8ZYMF.0 size=1048576 2024-09-12T00:17:28.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.130+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~FKR96EC8ZYMF.1 size=1048576 2024-09-12T00:17:28.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.134+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~FKR96EC8ZYMF.2 size=1036343 2024-09-12T00:17:28.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.138+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=FKR96EC8ZYMF tag=YO0W2D1MN3A2 type=write size=4182071 2024-09-12T00:17:28.142 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.142+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=MCIL2M72ON16 type=del size=3651497 2024-09-12T00:17:28.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.146+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=PZJ2LW902PTL type=del 2024-09-12T00:17:28.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.150+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=JQ4D83VEYP5J type=del size=2707132 2024-09-12T00:17:28.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.154+0000 7febed3678c0 1 < completed write operation key=RGQ4KY26RKYI tag=RQVP3METVYN2 type=write size=414322 2024-09-12T00:17:28.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.158+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=0N4DEWTQZADR type=del size=1571840 2024-09-12T00:17:28.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.162+0000 7febed3678c0 1 < suggested remove operation key=88BY5RHXSHD4 tag=XJDXIJUEY2B8 type=del 2024-09-12T00:17:28.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.166+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=GIMP5A9T380T type=del size=4157597 2024-09-12T00:17:28.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.170+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~PXTSGD5N51M4.0 size=575914 2024-09-12T00:17:28.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.174+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=PXTSGD5N51M4 tag=ZFII20ZYQSZL type=write size=1624490 2024-09-12T00:17:28.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.178+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~A3IHYSVV1K5K.0 size=1048576 2024-09-12T00:17:28.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.182+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~A3IHYSVV1K5K.1 size=211902 2024-09-12T00:17:28.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.182+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=A3IHYSVV1K5K tag=BWQHXUSX0KBL type=write size=2309054 2024-09-12T00:17:28.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.186+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~YYK35IRLL9MP.0 size=1048576 2024-09-12T00:17:28.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.190+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~YYK35IRLL9MP.1 size=127112 2024-09-12T00:17:28.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.194+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=YYK35IRLL9MP tag=024QM364QBUH type=write size=2224264 2024-09-12T00:17:28.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.198+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=WDA3OKWNR9DL type=del size=4078090 2024-09-12T00:17:28.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.202+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~Z57O88PFUIQ4.0 size=1048576 2024-09-12T00:17:28.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.202+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~Z57O88PFUIQ4.1 size=1048576 2024-09-12T00:17:28.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.206+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~Z57O88PFUIQ4.2 size=235467 2024-09-12T00:17:28.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.210+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=Z57O88PFUIQ4 tag=V2NWX3WFEVC2 type=write size=3381195 2024-09-12T00:17:28.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.214+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=T3BI8GOAA44G type=del size=185060 2024-09-12T00:17:28.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.222+0000 7febed3678c0 1 < suggested update operation key=VW69JRC5JYX5 tag=JODCTGAQJ71J type=del size=2629210 2024-09-12T00:17:28.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.226+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=W5H2XLKJ3YKA type=write size=491548 2024-09-12T00:17:28.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.230+0000 7febed3678c0 1 < completed write operation key=KABJD0GYBVF4 tag=PJ6O1Q2H6LCZ type=write size=788962 2024-09-12T00:17:28.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.234+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=FYKPMH8OBN8G type=del size=3621559 2024-09-12T00:17:28.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.238+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=PD6SPUUWYNSE type=del 2024-09-12T00:17:28.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.238+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=WLX3LSLOGRNM type=del size=3350321 2024-09-12T00:17:28.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.242+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~PUBOVE2AYMXK.0 size=685174 2024-09-12T00:17:28.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.250+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=PUBOVE2AYMXK tag=DS5XLQP4HTHV type=write size=1733750 2024-09-12T00:17:28.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.254+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=ZY65T4KHQ2MP type=write size=1040438 2024-09-12T00:17:28.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.254+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~XDG6PLMF93YB.0 size=1048576 2024-09-12T00:17:28.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.258+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~XDG6PLMF93YB.1 size=1048576 2024-09-12T00:17:28.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.262+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~XDG6PLMF93YB.2 size=121809 2024-09-12T00:17:28.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.266+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=XDG6PLMF93YB tag=TN6YOMW01SSC type=write size=3267537 2024-09-12T00:17:28.268 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.270+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=5TLSXA0UXSX9 type=del size=3826595 2024-09-12T00:17:28.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.270+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=ISKR5NKJX48X type=del 2024-09-12T00:17:28.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.274+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=2PGPIF2PJ49P type=del size=3392820 2024-09-12T00:17:28.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.282+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=2SIMIIUEZ6D7 type=del 2024-09-12T00:17:28.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.286+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=O49BDPNIBJH9 type=del size=2448903 2024-09-12T00:17:28.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.290+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=LEN0NOREDG38 type=del 2024-09-12T00:17:28.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.294+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=VL18ZMVR0YFR type=del size=1984574 2024-09-12T00:17:28.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.298+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~ZTEB6DE8FIFH.0 size=1048576 2024-09-12T00:17:28.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.302+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~ZTEB6DE8FIFH.1 size=1048576 2024-09-12T00:17:28.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.302+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~ZTEB6DE8FIFH.2 size=429084 2024-09-12T00:17:28.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.310+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=ZTEB6DE8FIFH tag=FG9658G74WGZ type=write size=3574812 2024-09-12T00:17:28.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.314+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=LJB2WMD0YZ5O type=del size=2603391 2024-09-12T00:17:28.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.318+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=MCIL2M72ON16 type=del 2024-09-12T00:17:28.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.322+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=I23BATIKVB0P type=del size=641842 2024-09-12T00:17:28.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.326+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=JQ4D83VEYP5J type=del 2024-09-12T00:17:28.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.330+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~1R7WDECKY6WF.0 size=631776 2024-09-12T00:17:28.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.330+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=1R7WDECKY6WF tag=XSKP8ICCTN5Z type=write size=1680352 2024-09-12T00:17:28.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.334+0000 7febed3678c0 1 < suggested update operation key=53T1415UK7GE tag=0N4DEWTQZADR type=del size=1571840 2024-09-12T00:17:28.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.338+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=3PL7MRA0IZJK type=del size=1093967 2024-09-12T00:17:28.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.342+0000 7febed3678c0 1 < canceled operation key=LWAMFA0RSW6S tag=GIMP5A9T380T type=del size=4157597 2024-09-12T00:17:28.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.346+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=9UNBS6C2R63F type=del size=187495 2024-09-12T00:17:28.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.350+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~A3IHYSVV1K5K.0 size=1048576 2024-09-12T00:17:28.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.350+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~A3IHYSVV1K5K.1 size=211902 2024-09-12T00:17:28.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.354+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=A3IHYSVV1K5K tag=BWQHXUSX0KBL type=write size=2309054 2024-09-12T00:17:28.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.358+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=OCUVMEQRAZZN type=del size=558695 2024-09-12T00:17:28.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.362+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=WDA3OKWNR9DL type=del 2024-09-12T00:17:28.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.366+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=16JK0A77I9XR type=del size=3635687 2024-09-12T00:17:28.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.370+0000 7febed3678c0 1 < suggested update operation key=CIOINUP503WY tag=T3BI8GOAA44G type=del size=185060 2024-09-12T00:17:28.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.374+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=FK1U107PKGLG type=del size=2883240 2024-09-12T00:17:28.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.378+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=W5H2XLKJ3YKA type=write size=491548 2024-09-12T00:17:28.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.378+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=6Y3XPCOR2I99 type=del size=1795712 2024-09-12T00:17:28.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.382+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=FYKPMH8OBN8G type=del 2024-09-12T00:17:28.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.386+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=4PE8G2Y4TP87 type=del size=1992146 2024-09-12T00:17:28.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.390+0000 7febed3678c0 1 < suggested update operation key=H017KWW59B8Z tag=WLX3LSLOGRNM type=del size=3350321 2024-09-12T00:17:28.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.394+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=AEAH6MZ0PCLX type=del size=1331945 2024-09-12T00:17:28.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.394+0000 7febed3678c0 1 < completed write operation key=KLO47UYYACLU tag=ZY65T4KHQ2MP type=write size=1040438 2024-09-12T00:17:28.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.402+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~GTKI5BF63AGV.0 size=1048576 2024-09-12T00:17:28.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.402+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~GTKI5BF63AGV.1 size=1048576 2024-09-12T00:17:28.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.406+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~GTKI5BF63AGV.2 size=98398 2024-09-12T00:17:28.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.406+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=GTKI5BF63AGV tag=B1WK5YYCVZC2 type=write size=3244126 2024-09-12T00:17:28.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.410+0000 7febed3678c0 1 < suggested update operation key=HR9MVC82R7GL tag=5TLSXA0UXSX9 type=del size=3826595 2024-09-12T00:17:28.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.414+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=GSXSO2N6ZIUO type=write size=954394 2024-09-12T00:17:28.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.414+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=2PGPIF2PJ49P type=del 2024-09-12T00:17:28.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.422+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~G6OP2UX8WB9L.0 size=1048576 2024-09-12T00:17:28.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.422+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~G6OP2UX8WB9L.1 size=76016 2024-09-12T00:17:28.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.422+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=G6OP2UX8WB9L tag=A4NVFWIST612 type=write size=2173168 2024-09-12T00:17:28.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.426+0000 7febed3678c0 1 < canceled operation key=KLO47UYYACLU tag=O49BDPNIBJH9 type=del size=2448903 2024-09-12T00:17:28.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.430+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=HIWN3OUUXSPX type=del size=3740043 2024-09-12T00:17:28.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.434+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=VL18ZMVR0YFR type=del 2024-09-12T00:17:28.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.438+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~4E97SW1CF34X.0 size=268926 2024-09-12T00:17:28.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.438+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=4E97SW1CF34X tag=N61LDNG0HP87 type=write size=1317502 2024-09-12T00:17:28.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.442+0000 7febed3678c0 1 < canceled operation key=KABJD0GYBVF4 tag=LJB2WMD0YZ5O type=del size=2603391 2024-09-12T00:17:28.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.446+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~3BAQFUF01AQE.0 size=1048576 2024-09-12T00:17:28.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.446+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~3BAQFUF01AQE.1 size=1048576 2024-09-12T00:17:28.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.450+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~3BAQFUF01AQE.2 size=708814 2024-09-12T00:17:28.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.450+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=3BAQFUF01AQE tag=PLJ5ENW9IZDW type=write size=3854542 2024-09-12T00:17:28.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.454+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=I23BATIKVB0P type=del 2024-09-12T00:17:28.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.458+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~Y04ED5F32BQ4.0 size=1048576 2024-09-12T00:17:28.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.458+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~Y04ED5F32BQ4.1 size=284075 2024-09-12T00:17:28.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.458+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=Y04ED5F32BQ4 tag=7DTAAMRBW7C9 type=write size=2381227 2024-09-12T00:17:28.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.462+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~1R7WDECKY6WF.0 size=631776 2024-09-12T00:17:28.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.466+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=1R7WDECKY6WF tag=XSKP8ICCTN5Z type=write size=1680352 2024-09-12T00:17:28.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.470+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~1N75YVJXH949.0 size=1048576 2024-09-12T00:17:28.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.470+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~1N75YVJXH949.1 size=646551 2024-09-12T00:17:28.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.470+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=1N75YVJXH949 tag=QYH6JD4HG1Y4 type=write size=2743703 2024-09-12T00:17:28.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.474+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=3PL7MRA0IZJK type=del 2024-09-12T00:17:28.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.478+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=WE8KHEMYBVVE type=del size=702915 2024-09-12T00:17:28.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.482+0000 7febed3678c0 1 < suggested update operation key=W2VEW3JJEJY7 tag=9UNBS6C2R63F type=del size=187495 2024-09-12T00:17:28.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.486+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~57FL505WJH3D.0 size=1048576 2024-09-12T00:17:28.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.490+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~57FL505WJH3D.1 size=1048576 2024-09-12T00:17:28.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.490+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~57FL505WJH3D.2 size=753909 2024-09-12T00:17:28.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.490+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=57FL505WJH3D tag=EUR7YPZWPBVM type=write size=3899637 2024-09-12T00:17:28.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.494+0000 7febed3678c0 -1 < failed to complete operation key=CIOINUP503WY tag=OCUVMEQRAZZN type=del size=558695: (22) Invalid argument 2024-09-12T00:17:28.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.498+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=YW4F6ITV1PE8 type=del size=1619646 2024-09-12T00:17:28.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.502+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=16JK0A77I9XR type=del 2024-09-12T00:17:28.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.506+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~1M4YI4Z97V5T.0 size=1048576 2024-09-12T00:17:28.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.510+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~1M4YI4Z97V5T.1 size=1048576 2024-09-12T00:17:28.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.510+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~1M4YI4Z97V5T.2 size=646635 2024-09-12T00:17:28.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.510+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=1M4YI4Z97V5T tag=IQHCC1BTBTQI type=write size=3792363 2024-09-12T00:17:28.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.514+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=FK1U107PKGLG type=del 2024-09-12T00:17:28.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.518+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=UB5YXKLD0168 type=del size=2395453 2024-09-12T00:17:28.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.518+0000 7febed3678c0 1 < canceled operation key=MHS307JKNVCK tag=6Y3XPCOR2I99 type=del size=1795712 2024-09-12T00:17:28.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.522+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=Z9WXBC13FAP5 type=del size=2897427 2024-09-12T00:17:28.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.526+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=4PE8G2Y4TP87 type=del 2024-09-12T00:17:28.529 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.530+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=U9ZIVU9N9356 type=del size=1209337 2024-09-12T00:17:28.532 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.534+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=AEAH6MZ0PCLX type=del 2024-09-12T00:17:28.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.534+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=TWUL323QGI00 type=del size=1823480 2024-09-12T00:17:28.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.538+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~GTKI5BF63AGV.0 size=1048576 2024-09-12T00:17:28.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.542+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~GTKI5BF63AGV.1 size=1048576 2024-09-12T00:17:28.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.542+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~GTKI5BF63AGV.2 size=98398 2024-09-12T00:17:28.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.550+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=GTKI5BF63AGV tag=B1WK5YYCVZC2 type=write size=3244126 2024-09-12T00:17:28.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.554+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~Z5RYOFXBK7V9.0 size=313378 2024-09-12T00:17:28.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.554+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=Z5RYOFXBK7V9 tag=8AKCTYFVBITD type=write size=1361954 2024-09-12T00:17:28.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.558+0000 7febed3678c0 1 < completed write operation key=UGV3WQR0ADYH tag=GSXSO2N6ZIUO type=write size=954394 2024-09-12T00:17:28.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.566+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=8FZV8W6K2SY7 type=write size=646509 2024-09-12T00:17:28.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.566+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~G6OP2UX8WB9L.0 size=1048576 2024-09-12T00:17:28.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.570+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~G6OP2UX8WB9L.1 size=76016 2024-09-12T00:17:28.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.574+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=G6OP2UX8WB9L tag=A4NVFWIST612 type=write size=2173168 2024-09-12T00:17:28.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.582+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~NK2RIJ28K9IS.0 size=1048576 2024-09-12T00:17:28.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.586+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~NK2RIJ28K9IS.1 size=511941 2024-09-12T00:17:28.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.586+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=NK2RIJ28K9IS tag=EKES4KEXYRMX type=write size=2609093 2024-09-12T00:17:28.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.586+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=HIWN3OUUXSPX type=del 2024-09-12T00:17:28.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.594+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~I1S2DMJ1GDRH.0 size=204964 2024-09-12T00:17:28.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.594+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=I1S2DMJ1GDRH tag=UYIU2IDAZ40E type=write size=1253540 2024-09-12T00:17:28.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.594+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~4E97SW1CF34X.0 size=268926 2024-09-12T00:17:28.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.602+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=4E97SW1CF34X tag=N61LDNG0HP87 type=write size=1317502 2024-09-12T00:17:28.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.606+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=LK7B082KLG4Y type=write size=142701 2024-09-12T00:17:28.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.610+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~3BAQFUF01AQE.0 size=1048576 2024-09-12T00:17:28.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.610+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~3BAQFUF01AQE.1 size=1048576 2024-09-12T00:17:28.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.614+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~3BAQFUF01AQE.2 size=708814 2024-09-12T00:17:28.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.618+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=3BAQFUF01AQE tag=PLJ5ENW9IZDW type=write size=3854542 2024-09-12T00:17:28.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.626+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~K6WLBKLB16SE.0 size=1048576 2024-09-12T00:17:28.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.626+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~K6WLBKLB16SE.1 size=1048576 2024-09-12T00:17:28.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.630+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~K6WLBKLB16SE.2 size=699498 2024-09-12T00:17:28.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.630+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=K6WLBKLB16SE tag=JOLQV5L9T5KZ type=write size=3845226 2024-09-12T00:17:28.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.634+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~Y04ED5F32BQ4.0 size=1048576 2024-09-12T00:17:28.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.634+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~Y04ED5F32BQ4.1 size=284075 2024-09-12T00:17:28.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.642+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=Y04ED5F32BQ4 tag=7DTAAMRBW7C9 type=write size=2381227 2024-09-12T00:17:28.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.646+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~RRMC8K6HPH3P.0 size=1048576 2024-09-12T00:17:28.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.650+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~RRMC8K6HPH3P.1 size=19257 2024-09-12T00:17:28.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.650+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=RRMC8K6HPH3P tag=E9OWRPY0SAUG type=write size=2116409 2024-09-12T00:17:28.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.650+0000 7febed3678c0 1 < canceled part key=_multipart_LGFKY0CP299H.2~1N75YVJXH949.0 size=1048576 2024-09-12T00:17:28.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.650+0000 7febed3678c0 1 < canceled part key=_multipart_LGFKY0CP299H.2~1N75YVJXH949.1 size=646551 2024-09-12T00:17:28.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.654+0000 7febed3678c0 1 < canceled multipart upload key=LGFKY0CP299H upload=1N75YVJXH949 tag=QYH6JD4HG1Y4 type=write size=2743703 2024-09-12T00:17:28.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.658+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=CTJ80C886DWE type=del size=393598 2024-09-12T00:17:28.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.662+0000 7febed3678c0 1 < suggested update operation key=88BY5RHXSHD4 tag=WE8KHEMYBVVE type=del size=702915 2024-09-12T00:17:28.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.670+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~J9M7RNJUUG19.0 size=302126 2024-09-12T00:17:28.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.670+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=J9M7RNJUUG19 tag=9CMX4MOBORMM type=write size=1350702 2024-09-12T00:17:28.672 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.674+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~57FL505WJH3D.0 size=1048576 2024-09-12T00:17:28.674 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.674+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~57FL505WJH3D.1 size=1048576 2024-09-12T00:17:28.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.678+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~57FL505WJH3D.2 size=753909 2024-09-12T00:17:28.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.682+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=57FL505WJH3D tag=EUR7YPZWPBVM type=write size=3899637 2024-09-12T00:17:28.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.686+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=IACF5RAJ82AB type=write size=269723 2024-09-12T00:17:28.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.690+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=YW4F6ITV1PE8 type=del 2024-09-12T00:17:28.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.690+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=1VVVJT6AGP39 type=del size=2463347 2024-09-12T00:17:28.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.694+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~1M4YI4Z97V5T.0 size=1048576 2024-09-12T00:17:28.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.698+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~1M4YI4Z97V5T.1 size=1048576 2024-09-12T00:17:28.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.698+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~1M4YI4Z97V5T.2 size=646635 2024-09-12T00:17:28.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.706+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=1M4YI4Z97V5T tag=IQHCC1BTBTQI type=write size=3792363 2024-09-12T00:17:28.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.710+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=4P5T3A30AEGT type=del size=3723881 2024-09-12T00:17:28.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.710+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=UB5YXKLD0168 type=del 2024-09-12T00:17:28.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.718+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~5N42U6JTHFSC.0 size=1048576 2024-09-12T00:17:28.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.718+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~5N42U6JTHFSC.1 size=1048576 2024-09-12T00:17:28.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.722+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~5N42U6JTHFSC.2 size=469037 2024-09-12T00:17:28.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.722+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=5N42U6JTHFSC tag=VABYIGMGSKER type=write size=3614765 2024-09-12T00:17:28.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.726+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=Z9WXBC13FAP5 type=del 2024-09-12T00:17:28.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.730+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~EUETJVB2XFC6.0 size=1048576 2024-09-12T00:17:28.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.734+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~EUETJVB2XFC6.1 size=12928 2024-09-12T00:17:28.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.734+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=EUETJVB2XFC6 tag=1SRFZXG2CMZ2 type=write size=2110080 2024-09-12T00:17:28.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.738+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=U9ZIVU9N9356 type=del 2024-09-12T00:17:28.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.742+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=34ZOEWGFEWSS type=write size=272563 2024-09-12T00:17:28.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.742+0000 7febed3678c0 1 < canceled operation key=W2VEW3JJEJY7 tag=TWUL323QGI00 type=del size=1823480 2024-09-12T00:17:28.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.750+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~3PF4ALM445R3.0 size=1048576 2024-09-12T00:17:28.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.750+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~3PF4ALM445R3.1 size=764275 2024-09-12T00:17:28.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.750+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=3PF4ALM445R3 tag=IUEI524WUOIM type=write size=2861427 2024-09-12T00:17:28.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.754+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~Z5RYOFXBK7V9.0 size=313378 2024-09-12T00:17:28.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.762+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=Z5RYOFXBK7V9 tag=8AKCTYFVBITD type=write size=1361954 2024-09-12T00:17:28.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.762+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=HCTM8K4X3DXC type=del size=2476205 2024-09-12T00:17:28.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.766+0000 7febed3678c0 1 < canceled operation key=LWAMFA0RSW6S tag=8FZV8W6K2SY7 type=write size=646509 2024-09-12T00:17:28.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.770+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=NK2VCMO9F3GF type=del size=2106226 2024-09-12T00:17:28.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.774+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~NK2RIJ28K9IS.0 size=1048576 2024-09-12T00:17:28.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.774+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~NK2RIJ28K9IS.1 size=511941 2024-09-12T00:17:28.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.782+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=NK2RIJ28K9IS tag=EKES4KEXYRMX type=write size=2609093 2024-09-12T00:17:28.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.790+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~QCEYK0USKW5C.0 size=1048576 2024-09-12T00:17:28.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.790+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~QCEYK0USKW5C.1 size=986330 2024-09-12T00:17:28.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.790+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=QCEYK0USKW5C tag=LC3HEG937FKA type=write size=3083482 2024-09-12T00:17:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.794+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~I1S2DMJ1GDRH.0 size=204964 2024-09-12T00:17:28.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.802+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=I1S2DMJ1GDRH tag=UYIU2IDAZ40E type=write size=1253540 2024-09-12T00:17:28.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.802+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=OJJ57A8BUXNV type=del size=2297520 2024-09-12T00:17:28.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.806+0000 7febed3678c0 1 < completed write operation key=VU1AF57EUA0R tag=LK7B082KLG4Y type=write size=142701 2024-09-12T00:17:28.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.810+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=YIB3AZUUL2JZ type=write size=824086 2024-09-12T00:17:28.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.814+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~K6WLBKLB16SE.0 size=1048576 2024-09-12T00:17:28.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.818+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~K6WLBKLB16SE.1 size=1048576 2024-09-12T00:17:28.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.818+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~K6WLBKLB16SE.2 size=699498 2024-09-12T00:17:28.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.826+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=K6WLBKLB16SE tag=JOLQV5L9T5KZ type=write size=3845226 2024-09-12T00:17:28.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.830+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=Q8WL5RRT6OI6 type=write size=953642 2024-09-12T00:17:28.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.834+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~RRMC8K6HPH3P.0 size=1048576 2024-09-12T00:17:28.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.834+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~RRMC8K6HPH3P.1 size=19257 2024-09-12T00:17:28.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.842+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=RRMC8K6HPH3P tag=E9OWRPY0SAUG type=write size=2116409 2024-09-12T00:17:28.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.846+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~2IB71QWWG5AZ.0 size=1048576 2024-09-12T00:17:28.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.850+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~2IB71QWWG5AZ.1 size=1048576 2024-09-12T00:17:28.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.854+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~2IB71QWWG5AZ.2 size=179301 2024-09-12T00:17:28.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.854+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=2IB71QWWG5AZ tag=5B1B6MTA4WNT type=write size=3325029 2024-09-12T00:17:28.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.862+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=CTJ80C886DWE type=del 2024-09-12T00:17:28.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.866+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=YL231ZCR6VU5 type=write size=258211 2024-09-12T00:17:28.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.870+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~J9M7RNJUUG19.0 size=302126 2024-09-12T00:17:28.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.874+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=J9M7RNJUUG19 tag=9CMX4MOBORMM type=write size=1350702 2024-09-12T00:17:28.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.882+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~DV0GAPY4I78R.0 size=1048576 2024-09-12T00:17:28.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.882+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~DV0GAPY4I78R.1 size=1048576 2024-09-12T00:17:28.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.886+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~DV0GAPY4I78R.2 size=380665 2024-09-12T00:17:28.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.886+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=DV0GAPY4I78R tag=GN71TKJ56Z09 type=write size=3526393 2024-09-12T00:17:28.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.890+0000 7febed3678c0 1 < canceled operation key=CIOINUP503WY tag=IACF5RAJ82AB type=write size=269723 2024-09-12T00:17:28.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.894+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=999NLIZTTL6T type=del size=391957 2024-09-12T00:17:28.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.898+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=1VVVJT6AGP39 type=del 2024-09-12T00:17:28.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.902+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=PL6YOCK362QU type=del size=1665610 2024-09-12T00:17:28.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.906+0000 7febed3678c0 1 < suggested remove operation key=Z020UV2JRR0I tag=4P5T3A30AEGT type=del 2024-09-12T00:17:28.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.910+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=SBAEOS4XWX4R type=write size=491356 2024-09-12T00:17:28.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.910+0000 7febed3678c0 1 < canceled part key=_multipart_KLO47UYYACLU.2~5N42U6JTHFSC.0 size=1048576 2024-09-12T00:17:28.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.914+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~5N42U6JTHFSC.1 size=1048576 2024-09-12T00:17:28.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.918+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~5N42U6JTHFSC.2 size=469037 2024-09-12T00:17:28.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.922+0000 7febed3678c0 1 < canceled multipart upload key=KLO47UYYACLU upload=5N42U6JTHFSC tag=VABYIGMGSKER type=write size=3614765 2024-09-12T00:17:28.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.926+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=8Z1VSDDSJDXZ type=write size=476935 2024-09-12T00:17:28.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.930+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~EUETJVB2XFC6.0 size=1048576 2024-09-12T00:17:28.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.934+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~EUETJVB2XFC6.1 size=12928 2024-09-12T00:17:28.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.938+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=EUETJVB2XFC6 tag=1SRFZXG2CMZ2 type=write size=2110080 2024-09-12T00:17:28.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.946+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~6WPZTNTWXZ5X.0 size=980327 2024-09-12T00:17:28.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.946+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=6WPZTNTWXZ5X tag=UA4IXC4T9LIJ type=write size=2028903 2024-09-12T00:17:28.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.950+0000 7febed3678c0 1 < suggested update operation key=UGV3WQR0ADYH tag=34ZOEWGFEWSS type=write size=272563 2024-09-12T00:17:28.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.954+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=EXHWDEK5FX2G type=del size=1360590 2024-09-12T00:17:28.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.958+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~3PF4ALM445R3.0 size=1048576 2024-09-12T00:17:28.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.962+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~3PF4ALM445R3.1 size=764275 2024-09-12T00:17:28.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.966+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=3PF4ALM445R3 tag=IUEI524WUOIM type=write size=2861427 2024-09-12T00:17:28.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.970+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=P8H003KYWS9Z type=write size=124583 2024-09-12T00:17:28.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.978+0000 7febed3678c0 1 < suggested remove operation key=70W3V7TFBUFJ tag=HCTM8K4X3DXC type=del 2024-09-12T00:17:28.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.982+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=PJKL7VYERMDJ type=del size=1445526 2024-09-12T00:17:28.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.982+0000 7febed3678c0 1 < canceled operation key=53T1415UK7GE tag=NK2VCMO9F3GF type=del size=2106226 2024-09-12T00:17:28.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.986+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=XDLBVIS1J3Q9 type=del size=2437098 2024-09-12T00:17:28.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.990+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~QCEYK0USKW5C.0 size=1048576 2024-09-12T00:17:28.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.994+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~QCEYK0USKW5C.1 size=986330 2024-09-12T00:17:29.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:28.998+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=QCEYK0USKW5C tag=LC3HEG937FKA type=write size=3083482 2024-09-12T00:17:29.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.002+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=VK87BOHMGWLW type=del size=2713315 2024-09-12T00:17:29.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.006+0000 7febed3678c0 1 < suggested remove operation key=25THATWGX4WS tag=OJJ57A8BUXNV type=del 2024-09-12T00:17:29.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.010+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=5DYMJHMCSOQH type=del size=2562813 2024-09-12T00:17:29.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.014+0000 7febed3678c0 1 < completed write operation key=H017KWW59B8Z tag=YIB3AZUUL2JZ type=write size=824086 2024-09-12T00:17:29.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.018+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~RHLP9WV7FZ9J.0 size=361625 2024-09-12T00:17:29.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.018+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=RHLP9WV7FZ9J tag=6M8T5QHX5VDP type=write size=1410201 2024-09-12T00:17:29.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.022+0000 7febed3678c0 -1 < failed to complete operation key=25THATWGX4WS tag=Q8WL5RRT6OI6 type=write size=953642: (22) Invalid argument 2024-09-12T00:17:29.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.026+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~BM4JK337UG4T.0 size=415928 2024-09-12T00:17:29.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.026+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=BM4JK337UG4T tag=OF0MBMK441CI type=write size=1464504 2024-09-12T00:17:29.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.030+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~2IB71QWWG5AZ.0 size=1048576 2024-09-12T00:17:29.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.034+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~2IB71QWWG5AZ.1 size=1048576 2024-09-12T00:17:29.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.034+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~2IB71QWWG5AZ.2 size=179301 2024-09-12T00:17:29.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.042+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=2IB71QWWG5AZ tag=5B1B6MTA4WNT type=write size=3325029 2024-09-12T00:17:29.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.046+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~HG7466XY3D1T.0 size=232176 2024-09-12T00:17:29.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.046+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=HG7466XY3D1T tag=00T9F7SJH5QK type=write size=1280752 2024-09-12T00:17:29.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.050+0000 7febed3678c0 -1 < failed to complete operation key=25THATWGX4WS tag=YL231ZCR6VU5 type=write size=258211: (22) Invalid argument 2024-09-12T00:17:29.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.050+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=5X706UIH76LD type=write size=123770 2024-09-12T00:17:29.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.054+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~DV0GAPY4I78R.0 size=1048576 2024-09-12T00:17:29.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.058+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~DV0GAPY4I78R.1 size=1048576 2024-09-12T00:17:29.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.058+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~DV0GAPY4I78R.2 size=380665 2024-09-12T00:17:29.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.066+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=DV0GAPY4I78R tag=GN71TKJ56Z09 type=write size=3526393 2024-09-12T00:17:29.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.066+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=XV1CWI4R1LLJ type=del size=51530 2024-09-12T00:17:29.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.070+0000 7febed3678c0 -1 < failed to complete operation key=Z020UV2JRR0I tag=999NLIZTTL6T type=del size=391957: (22) Invalid argument 2024-09-12T00:17:29.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.074+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=AHV50Z724ZV4 type=del size=2121559 2024-09-12T00:17:29.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.078+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=PL6YOCK362QU type=del 2024-09-12T00:17:29.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.082+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~JT0YNH6139G9.0 size=1048576 2024-09-12T00:17:29.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.086+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~JT0YNH6139G9.1 size=1048576 2024-09-12T00:17:29.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.086+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~JT0YNH6139G9.2 size=677939 2024-09-12T00:17:29.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.086+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=JT0YNH6139G9 tag=P6RFBZL047CT type=write size=3823667 2024-09-12T00:17:29.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.090+0000 7febed3678c0 1 < completed write operation key=LGFKY0CP299H tag=SBAEOS4XWX4R type=write size=491356 2024-09-12T00:17:29.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.094+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=Z9I00R7O30A3 type=del size=2232792 2024-09-12T00:17:29.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.098+0000 7febed3678c0 1 < completed write operation key=52SSW5KTCS15 tag=8Z1VSDDSJDXZ type=write size=476935 2024-09-12T00:17:29.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.102+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=BMC247XHRVMQ type=write size=363888 2024-09-12T00:17:29.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.106+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~6WPZTNTWXZ5X.0 size=980327 2024-09-12T00:17:29.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.114+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=6WPZTNTWXZ5X tag=UA4IXC4T9LIJ type=write size=2028903 2024-09-12T00:17:29.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.122+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~7ZQKSK714SEY.0 size=1048576 2024-09-12T00:17:29.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.122+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~7ZQKSK714SEY.1 size=545336 2024-09-12T00:17:29.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.122+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=7ZQKSK714SEY tag=A9OWYPEEU31P type=write size=2642488 2024-09-12T00:17:29.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.126+0000 7febed3678c0 1 < canceled operation key=RGQ4KY26RKYI tag=EXHWDEK5FX2G type=del size=1360590 2024-09-12T00:17:29.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.130+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=N3K4VIPAEBK6 type=del size=2283591 2024-09-12T00:17:29.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.134+0000 7febed3678c0 1 < completed write operation key=8RVDLW1VC8LP tag=P8H003KYWS9Z type=write size=124583 2024-09-12T00:17:29.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.138+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=OBI8JQLCA6HR type=del size=3861023 2024-09-12T00:17:29.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.146+0000 7febed3678c0 1 < suggested remove operation key=9CBI4FHAT3H2 tag=PJKL7VYERMDJ type=del 2024-09-12T00:17:29.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.150+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=QRIZ7RI7FH0R type=del size=558710 2024-09-12T00:17:29.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.154+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=XDLBVIS1J3Q9 type=del 2024-09-12T00:17:29.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.158+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=9UHWESV2WPW4 type=del size=1248988 2024-09-12T00:17:29.160 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.162+0000 7febed3678c0 1 < canceled operation key=H017KWW59B8Z tag=VK87BOHMGWLW type=del size=2713315 2024-09-12T00:17:29.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.166+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=LQT4506UGKSD type=del size=3316145 2024-09-12T00:17:29.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.170+0000 7febed3678c0 1 < suggested update operation key=Z020UV2JRR0I tag=5DYMJHMCSOQH type=del size=2562813 2024-09-12T00:17:29.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.182+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~IA0ERKE5CYTY.0 size=549544 2024-09-12T00:17:29.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.182+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=IA0ERKE5CYTY tag=2935MJN40HNZ type=write size=1598120 2024-09-12T00:17:29.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.186+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~RHLP9WV7FZ9J.0 size=361625 2024-09-12T00:17:29.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.194+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=RHLP9WV7FZ9J tag=6M8T5QHX5VDP type=write size=1410201 2024-09-12T00:17:29.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.198+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~WUFL97BWMYLH.0 size=1048576 2024-09-12T00:17:29.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.202+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~WUFL97BWMYLH.1 size=723869 2024-09-12T00:17:29.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.202+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=WUFL97BWMYLH tag=3YRQ3Z3ZNGJQ type=write size=2821021 2024-09-12T00:17:29.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.202+0000 7febed3678c0 1 < canceled part key=_multipart_UGV3WQR0ADYH.2~BM4JK337UG4T.0 size=415928 2024-09-12T00:17:29.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.206+0000 7febed3678c0 1 < canceled multipart upload key=UGV3WQR0ADYH upload=BM4JK337UG4T tag=OF0MBMK441CI type=write size=1464504 2024-09-12T00:17:29.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.214+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~GSX4C7DUNKGM.0 size=1048576 2024-09-12T00:17:29.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.214+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~GSX4C7DUNKGM.1 size=1048576 2024-09-12T00:17:29.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.218+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~GSX4C7DUNKGM.2 size=574710 2024-09-12T00:17:29.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.218+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=GSX4C7DUNKGM tag=S0MFQ7J2KQ1N type=write size=3720438 2024-09-12T00:17:29.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.218+0000 7febed3678c0 1 < canceled part key=_multipart_RGQ4KY26RKYI.2~HG7466XY3D1T.0 size=232176 2024-09-12T00:17:29.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.226+0000 7febed3678c0 1 < canceled multipart upload key=RGQ4KY26RKYI upload=HG7466XY3D1T tag=00T9F7SJH5QK type=write size=1280752 2024-09-12T00:17:29.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.230+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=L5VT67BKYJO0 type=del size=118180 2024-09-12T00:17:29.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.234+0000 7febed3678c0 1 < completed write operation key=4K65QIB9F00S tag=5X706UIH76LD type=write size=123770 2024-09-12T00:17:29.235 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.234+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=VBKCILKQA2ED type=del size=1606567 2024-09-12T00:17:29.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.242+0000 7febed3678c0 1 < suggested update operation key=KLO47UYYACLU tag=XV1CWI4R1LLJ type=del size=51530 2024-09-12T00:17:29.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.250+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~5UNPME6DOLSW.0 size=856750 2024-09-12T00:17:29.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.250+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=5UNPME6DOLSW tag=4UFKJ1IKI0VJ type=write size=1905326 2024-09-12T00:17:29.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.254+0000 7febed3678c0 -1 < failed to complete operation key=Z020UV2JRR0I tag=AHV50Z724ZV4 type=del size=2121559: (22) Invalid argument 2024-09-12T00:17:29.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.258+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~DOPTBTSIIIR5.0 size=710203 2024-09-12T00:17:29.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.258+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=DOPTBTSIIIR5 tag=J8EAEC6RBSR6 type=write size=1758779 2024-09-12T00:17:29.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.262+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~JT0YNH6139G9.0 size=1048576 2024-09-12T00:17:29.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.266+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~JT0YNH6139G9.1 size=1048576 2024-09-12T00:17:29.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.266+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~JT0YNH6139G9.2 size=677939 2024-09-12T00:17:29.272 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.274+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=JT0YNH6139G9 tag=P6RFBZL047CT type=write size=3823667 2024-09-12T00:17:29.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.274+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=RA52UG2IOVW4 type=del size=1619029 2024-09-12T00:17:29.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.278+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=Z9I00R7O30A3 type=del 2024-09-12T00:17:29.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.282+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=PSDBO4SI0Y43 type=del size=461910 2024-09-12T00:17:29.284 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.286+0000 7febed3678c0 1 < completed write operation key=MHS307JKNVCK tag=BMC247XHRVMQ type=write size=363888 2024-09-12T00:17:29.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.290+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~CKQINJT4MWGZ.0 size=1048576 2024-09-12T00:17:29.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.294+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~CKQINJT4MWGZ.1 size=450313 2024-09-12T00:17:29.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.294+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=CKQINJT4MWGZ tag=68C4OTAUNGUP type=write size=2547465 2024-09-12T00:17:29.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.294+0000 7febed3678c0 1 < canceled part key=_multipart_ELNXYXX5ZWOW.2~7ZQKSK714SEY.0 size=1048576 2024-09-12T00:17:29.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.294+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~7ZQKSK714SEY.1 size=545336 2024-09-12T00:17:29.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.302+0000 7febed3678c0 1 < canceled multipart upload key=ELNXYXX5ZWOW upload=7ZQKSK714SEY tag=A9OWYPEEU31P type=write size=2642488 2024-09-12T00:17:29.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.306+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~FYG0P226EUD5.0 size=982206 2024-09-12T00:17:29.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.306+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=FYG0P226EUD5 tag=WEAEWJG065F8 type=write size=2030782 2024-09-12T00:17:29.308 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.310+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=N3K4VIPAEBK6 type=del 2024-09-12T00:17:29.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.310+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=MGEX5M1TG413 type=del size=3726414 2024-09-12T00:17:29.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.314+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=OBI8JQLCA6HR type=del 2024-09-12T00:17:29.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.322+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~P588JZZYXO82.0 size=895451 2024-09-12T00:17:29.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.322+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=P588JZZYXO82 tag=3UCAKT91ZNSK type=write size=1944027 2024-09-12T00:17:29.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.322+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=QRIZ7RI7FH0R type=del 2024-09-12T00:17:29.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.330+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~CIAHNG3XG34Y.0 size=1048576 2024-09-12T00:17:29.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.330+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~CIAHNG3XG34Y.1 size=394199 2024-09-12T00:17:29.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.330+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=CIAHNG3XG34Y tag=WITE42HHQKHG type=write size=2491351 2024-09-12T00:17:29.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.334+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=9UHWESV2WPW4 type=del 2024-09-12T00:17:29.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.338+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=DJRR163O5TF1 type=del size=3613056 2024-09-12T00:17:29.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.342+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=LQT4506UGKSD type=del 2024-09-12T00:17:29.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.346+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~H23F925Q5CNE.0 size=605997 2024-09-12T00:17:29.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.346+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=H23F925Q5CNE tag=SCNIG37NF9XI type=write size=1654573 2024-09-12T00:17:29.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.346+0000 7febed3678c0 1 < canceled part key=_multipart_LWAMFA0RSW6S.2~IA0ERKE5CYTY.0 size=549544 2024-09-12T00:17:29.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.354+0000 7febed3678c0 1 < canceled multipart upload key=LWAMFA0RSW6S upload=IA0ERKE5CYTY tag=2935MJN40HNZ type=write size=1598120 2024-09-12T00:17:29.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.358+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~Y4HTXDWFV4HT.0 size=1048576 2024-09-12T00:17:29.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.358+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~Y4HTXDWFV4HT.1 size=802020 2024-09-12T00:17:29.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.358+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=Y4HTXDWFV4HT tag=4BOG4O2K96UA type=write size=2899172 2024-09-12T00:17:29.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.362+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~WUFL97BWMYLH.0 size=1048576 2024-09-12T00:17:29.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.366+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~WUFL97BWMYLH.1 size=723869 2024-09-12T00:17:29.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.370+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=WUFL97BWMYLH tag=3YRQ3Z3ZNGJQ type=write size=2821021 2024-09-12T00:17:29.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.374+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~49E3ZJNK162U.0 size=1048576 2024-09-12T00:17:29.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.374+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~49E3ZJNK162U.1 size=598782 2024-09-12T00:17:29.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.374+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=49E3ZJNK162U tag=Z8VLCQYO2N1B type=write size=2695934 2024-09-12T00:17:29.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.378+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~GSX4C7DUNKGM.0 size=1048576 2024-09-12T00:17:29.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.382+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~GSX4C7DUNKGM.1 size=1048576 2024-09-12T00:17:29.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.382+0000 7febed3678c0 1 < canceled part key=_multipart_VW69JRC5JYX5.2~GSX4C7DUNKGM.2 size=574710 2024-09-12T00:17:29.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.386+0000 7febed3678c0 1 < canceled multipart upload key=VW69JRC5JYX5 upload=GSX4C7DUNKGM tag=S0MFQ7J2KQ1N type=write size=3720438 2024-09-12T00:17:29.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.390+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=237143WJT8VD type=write size=834085 2024-09-12T00:17:29.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.394+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=L5VT67BKYJO0 type=del 2024-09-12T00:17:29.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.398+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=PTVIFJREYRVG type=del size=2374701 2024-09-12T00:17:29.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.398+0000 7febed3678c0 1 < canceled operation key=ASFLGSKWYHG5 tag=VBKCILKQA2ED type=del size=1606567 2024-09-12T00:17:29.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.406+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~8Q1K1M31LZQ5.0 size=376486 2024-09-12T00:17:29.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.406+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=8Q1K1M31LZQ5 tag=41QVW6K3S0B4 type=write size=1425062 2024-09-12T00:17:29.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.406+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~5UNPME6DOLSW.0 size=856750 2024-09-12T00:17:29.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.414+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=5UNPME6DOLSW tag=4UFKJ1IKI0VJ type=write size=1905326 2024-09-12T00:17:29.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.418+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~NY90H1OTPY2Z.0 size=1048576 2024-09-12T00:17:29.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.422+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~NY90H1OTPY2Z.1 size=805967 2024-09-12T00:17:29.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.422+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=NY90H1OTPY2Z tag=DJ1S3MK9PRM6 type=write size=2903119 2024-09-12T00:17:29.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.422+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~DOPTBTSIIIR5.0 size=710203 2024-09-12T00:17:29.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.430+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=DOPTBTSIIIR5 tag=J8EAEC6RBSR6 type=write size=1758779 2024-09-12T00:17:29.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.430+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=TCIWYAG4ISM8 type=del size=294243 2024-09-12T00:17:29.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.434+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=RA52UG2IOVW4 type=del 2024-09-12T00:17:29.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.438+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=IOZEC1OJVUXQ type=write size=925198 2024-09-12T00:17:29.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.442+0000 7febed3678c0 1 < suggested update operation key=ASFLGSKWYHG5 tag=PSDBO4SI0Y43 type=del size=461910 2024-09-12T00:17:29.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.446+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=310JQMJXBAQA type=write size=484596 2024-09-12T00:17:29.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.446+0000 7febed3678c0 1 < canceled part key=_multipart_KABJD0GYBVF4.2~CKQINJT4MWGZ.0 size=1048576 2024-09-12T00:17:29.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.450+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~CKQINJT4MWGZ.1 size=450313 2024-09-12T00:17:29.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.454+0000 7febed3678c0 1 < canceled multipart upload key=KABJD0GYBVF4 upload=CKQINJT4MWGZ tag=68C4OTAUNGUP type=write size=2547465 2024-09-12T00:17:29.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.458+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=C3TCWDE7ECYT type=del size=188367 2024-09-12T00:17:29.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.462+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~FYG0P226EUD5.0 size=982206 2024-09-12T00:17:29.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.466+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=FYG0P226EUD5 tag=WEAEWJG065F8 type=write size=2030782 2024-09-12T00:17:29.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.474+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~88IDUMJ0CNLA.0 size=1048576 2024-09-12T00:17:29.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.478+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~88IDUMJ0CNLA.1 size=741442 2024-09-12T00:17:29.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.478+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=88IDUMJ0CNLA tag=AD1O0KLDD408 type=write size=2838594 2024-09-12T00:17:29.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.478+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=MGEX5M1TG413 type=del 2024-09-12T00:17:29.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.482+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=Z4R9GGE5UDMA type=del size=2213638 2024-09-12T00:17:29.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.486+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~P588JZZYXO82.0 size=895451 2024-09-12T00:17:29.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.490+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=P588JZZYXO82 tag=3UCAKT91ZNSK type=write size=1944027 2024-09-12T00:17:29.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.490+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=KHGOA0JU940M type=del size=2977202 2024-09-12T00:17:29.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.494+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~CIAHNG3XG34Y.0 size=1048576 2024-09-12T00:17:29.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.498+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~CIAHNG3XG34Y.1 size=394199 2024-09-12T00:17:29.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.502+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=CIAHNG3XG34Y tag=WITE42HHQKHG type=write size=2491351 2024-09-12T00:17:29.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.502+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=04K6RS8PUJ5N type=del size=2799610 2024-09-12T00:17:29.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.506+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=DJRR163O5TF1 type=del 2024-09-12T00:17:29.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.510+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=SV8XAAFMUK8Z type=del size=42314 2024-09-12T00:17:29.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.510+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~H23F925Q5CNE.0 size=605997 2024-09-12T00:17:29.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.518+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=H23F925Q5CNE tag=SCNIG37NF9XI type=write size=1654573 2024-09-12T00:17:29.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.518+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=AMV8A8KT4KAP type=write size=864335 2024-09-12T00:17:29.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.522+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~Y4HTXDWFV4HT.0 size=1048576 2024-09-12T00:17:29.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.526+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~Y4HTXDWFV4HT.1 size=802020 2024-09-12T00:17:29.529 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.530+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=Y4HTXDWFV4HT tag=4BOG4O2K96UA type=write size=2899172 2024-09-12T00:17:29.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.530+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=9W4AHJ7YI9ZW type=del size=36963 2024-09-12T00:17:29.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.534+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~49E3ZJNK162U.0 size=1048576 2024-09-12T00:17:29.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.538+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~49E3ZJNK162U.1 size=598782 2024-09-12T00:17:29.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.542+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=49E3ZJNK162U tag=Z8VLCQYO2N1B type=write size=2695934 2024-09-12T00:17:29.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.546+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~9N6YZIEF016A.0 size=1048576 2024-09-12T00:17:29.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.550+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~9N6YZIEF016A.1 size=1048576 2024-09-12T00:17:29.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.550+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~9N6YZIEF016A.2 size=980884 2024-09-12T00:17:29.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.550+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=9N6YZIEF016A tag=NGOG2RT6YNCF type=write size=4126612 2024-09-12T00:17:29.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.554+0000 7febed3678c0 1 < completed write operation key=MAZHOU2CEUCU tag=237143WJT8VD type=write size=834085 2024-09-12T00:17:29.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.558+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=QJNX6JBQVMGQ type=del size=1998516 2024-09-12T00:17:29.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.562+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=PTVIFJREYRVG type=del 2024-09-12T00:17:29.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.562+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=P2222X1CQRHH type=del size=4053215 2024-09-12T00:17:29.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.566+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~8Q1K1M31LZQ5.0 size=376486 2024-09-12T00:17:29.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.570+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=8Q1K1M31LZQ5 tag=41QVW6K3S0B4 type=write size=1425062 2024-09-12T00:17:29.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.574+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=66MK4VEXOMNY type=del size=2324001 2024-09-12T00:17:29.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.574+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~NY90H1OTPY2Z.0 size=1048576 2024-09-12T00:17:29.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.578+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~NY90H1OTPY2Z.1 size=805967 2024-09-12T00:17:29.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.582+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=NY90H1OTPY2Z tag=DJ1S3MK9PRM6 type=write size=2903119 2024-09-12T00:17:29.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.586+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=O50WWLBM1GTU type=del size=3911476 2024-09-12T00:17:29.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.586+0000 7febed3678c0 1 < canceled operation key=3G9ABEEEDRI3 tag=TCIWYAG4ISM8 type=del size=294243 2024-09-12T00:17:29.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.590+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=DMNW6WJHOS3E type=del size=715525 2024-09-12T00:17:29.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.594+0000 7febed3678c0 1 < completed write operation key=AHTIFXX3SGK7 tag=IOZEC1OJVUXQ type=write size=925198 2024-09-12T00:17:29.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.594+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=6RBZTA58PA38 type=del size=3548173 2024-09-12T00:17:29.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.602+0000 7febed3678c0 1 < suggested update operation key=8RVDLW1VC8LP tag=310JQMJXBAQA type=write size=484596 2024-09-12T00:17:29.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.606+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~53W7MWZWR4GJ.0 size=1048576 2024-09-12T00:17:29.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.606+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~53W7MWZWR4GJ.1 size=392907 2024-09-12T00:17:29.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.606+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=53W7MWZWR4GJ tag=PK0FVLOFLKNJ type=write size=2490059 2024-09-12T00:17:29.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.610+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=C3TCWDE7ECYT type=del 2024-09-12T00:17:29.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.614+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~3N58PXI6WDMO.0 size=1048576 2024-09-12T00:17:29.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.618+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~3N58PXI6WDMO.1 size=1048576 2024-09-12T00:17:29.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.622+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~3N58PXI6WDMO.2 size=1012318 2024-09-12T00:17:29.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.622+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=3N58PXI6WDMO tag=5MU39H1MVA2R type=write size=4158046 2024-09-12T00:17:29.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.622+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~88IDUMJ0CNLA.0 size=1048576 2024-09-12T00:17:29.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.626+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~88IDUMJ0CNLA.1 size=741442 2024-09-12T00:17:29.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.630+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=88IDUMJ0CNLA tag=AD1O0KLDD408 type=write size=2838594 2024-09-12T00:17:29.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.634+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=3TOUDU4IGMFC type=del size=2025055 2024-09-12T00:17:29.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.634+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=Z4R9GGE5UDMA type=del 2024-09-12T00:17:29.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.638+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=FUH7QQ4AKI1F type=del size=2776151 2024-09-12T00:17:29.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.642+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=KHGOA0JU940M type=del 2024-09-12T00:17:29.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.646+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=1Q1ZQGVFJQP2 type=write size=273336 2024-09-12T00:17:29.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.650+0000 7febed3678c0 1 < suggested update operation key=Z020UV2JRR0I tag=04K6RS8PUJ5N type=del size=2799610 2024-09-12T00:17:29.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.654+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=GZ0EF0ODJYFJ type=del size=3577775 2024-09-12T00:17:29.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.654+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=SV8XAAFMUK8Z type=del 2024-09-12T00:17:29.659 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.658+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~UF6UIXSWXDPR.0 size=1048576 2024-09-12T00:17:29.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.662+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~UF6UIXSWXDPR.1 size=1048576 2024-09-12T00:17:29.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.666+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~UF6UIXSWXDPR.2 size=620665 2024-09-12T00:17:29.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.666+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=UF6UIXSWXDPR tag=92DK61Q8B2YD type=write size=3766393 2024-09-12T00:17:29.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.666+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=AMV8A8KT4KAP type=write size=864335 2024-09-12T00:17:29.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.670+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=C2378RP4MN2G type=del size=253855 2024-09-12T00:17:29.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.674+0000 7febed3678c0 1 < suggested remove operation key=8RVDLW1VC8LP tag=9W4AHJ7YI9ZW type=del 2024-09-12T00:17:29.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.682+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~UZ6GT65TG3SY.0 size=1048576 2024-09-12T00:17:29.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.682+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~UZ6GT65TG3SY.1 size=651258 2024-09-12T00:17:29.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.682+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=UZ6GT65TG3SY tag=I1SWSPV3M6H7 type=write size=2748410 2024-09-12T00:17:29.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.686+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~9N6YZIEF016A.0 size=1048576 2024-09-12T00:17:29.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.686+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~9N6YZIEF016A.1 size=1048576 2024-09-12T00:17:29.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.690+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~9N6YZIEF016A.2 size=980884 2024-09-12T00:17:29.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.694+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=9N6YZIEF016A tag=NGOG2RT6YNCF type=write size=4126612 2024-09-12T00:17:29.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.698+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=40KCT8N492TI type=del size=893438 2024-09-12T00:17:29.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.702+0000 7febed3678c0 1 < suggested update operation key=70W3V7TFBUFJ tag=QJNX6JBQVMGQ type=del size=1998516 2024-09-12T00:17:29.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.706+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~4DFQZHD629JI.0 size=1048576 2024-09-12T00:17:29.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.710+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~4DFQZHD629JI.1 size=193047 2024-09-12T00:17:29.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.710+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=4DFQZHD629JI tag=8LHJ5PHSAN3W type=write size=2290199 2024-09-12T00:17:29.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.714+0000 7febed3678c0 1 < suggested update operation key=9HCKHF5ZRZ5N tag=P2222X1CQRHH type=del size=4053215 2024-09-12T00:17:29.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.718+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~UUR8U61S57GN.0 size=1048576 2024-09-12T00:17:29.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.722+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~UUR8U61S57GN.1 size=776329 2024-09-12T00:17:29.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.722+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=UUR8U61S57GN tag=IBK4P37F1PFC type=write size=2873481 2024-09-12T00:17:29.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.726+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=66MK4VEXOMNY type=del 2024-09-12T00:17:29.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.730+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=J21D6326FFXD type=del size=923965 2024-09-12T00:17:29.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.738+0000 7febed3678c0 1 < suggested update operation key=KLO47UYYACLU tag=O50WWLBM1GTU type=del size=3911476 2024-09-12T00:17:29.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.738+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=Y4HBLAELNRJY type=del size=1765147 2024-09-12T00:17:29.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.742+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=DMNW6WJHOS3E type=del 2024-09-12T00:17:29.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.746+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=Z6Z2BM5GGMRT type=del size=4000013 2024-09-12T00:17:29.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.750+0000 7febed3678c0 1 < suggested update operation key=VW69JRC5JYX5 tag=6RBZTA58PA38 type=del size=3548173 2024-09-12T00:17:29.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.754+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~QK4WDZ7GA3WY.0 size=455556 2024-09-12T00:17:29.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.754+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=QK4WDZ7GA3WY tag=A3DUY81TW481 type=write size=1504132 2024-09-12T00:17:29.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.758+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~53W7MWZWR4GJ.0 size=1048576 2024-09-12T00:17:29.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.758+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~53W7MWZWR4GJ.1 size=392907 2024-09-12T00:17:29.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.762+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=53W7MWZWR4GJ tag=PK0FVLOFLKNJ type=write size=2490059 2024-09-12T00:17:29.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.766+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=WCMZOW8B0NG8 type=del size=3582503 2024-09-12T00:17:29.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.770+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~3N58PXI6WDMO.0 size=1048576 2024-09-12T00:17:29.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.770+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~3N58PXI6WDMO.1 size=1048576 2024-09-12T00:17:29.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.774+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~3N58PXI6WDMO.2 size=1012318 2024-09-12T00:17:29.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.778+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=3N58PXI6WDMO tag=5MU39H1MVA2R type=write size=4158046 2024-09-12T00:17:29.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.778+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=XYNF2FQ06XUV type=del size=897412 2024-09-12T00:17:29.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.782+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=3TOUDU4IGMFC type=del 2024-09-12T00:17:29.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.786+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~2FI7I6CZ1ULA.0 size=403453 2024-09-12T00:17:29.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.786+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=2FI7I6CZ1ULA tag=1OXO9MFUF6V9 type=write size=1452029 2024-09-12T00:17:29.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.790+0000 7febed3678c0 1 < canceled operation key=1HABX7YZ491W tag=FUH7QQ4AKI1F type=del size=2776151 2024-09-12T00:17:29.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.790+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=17439R1R8GIU type=del size=2836887 2024-09-12T00:17:29.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.794+0000 7febed3678c0 1 < completed write operation key=LGFKY0CP299H tag=1Q1ZQGVFJQP2 type=write size=273336 2024-09-12T00:17:29.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.798+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=UMD20K2YP2P6 type=del size=3072109 2024-09-12T00:17:29.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.806+0000 7febed3678c0 1 < suggested remove operation key=KABJD0GYBVF4 tag=GZ0EF0ODJYFJ type=del 2024-09-12T00:17:29.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.810+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~HSN8CMKHKETY.0 size=1048576 2024-09-12T00:17:29.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.814+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~HSN8CMKHKETY.1 size=1048576 2024-09-12T00:17:29.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.814+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~HSN8CMKHKETY.2 size=696794 2024-09-12T00:17:29.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.814+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=HSN8CMKHKETY tag=8JUEOEOROONI type=write size=3842522 2024-09-12T00:17:29.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.818+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~UF6UIXSWXDPR.0 size=1048576 2024-09-12T00:17:29.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.822+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~UF6UIXSWXDPR.1 size=1048576 2024-09-12T00:17:29.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.822+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~UF6UIXSWXDPR.2 size=620665 2024-09-12T00:17:29.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.830+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=UF6UIXSWXDPR tag=92DK61Q8B2YD type=write size=3766393 2024-09-12T00:17:29.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.834+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~G0WUPQAVZNH3.0 size=1048576 2024-09-12T00:17:29.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.838+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~G0WUPQAVZNH3.1 size=1048576 2024-09-12T00:17:29.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.838+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~G0WUPQAVZNH3.2 size=273384 2024-09-12T00:17:29.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.838+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=G0WUPQAVZNH3 tag=L377WSAPS3HR type=write size=3419112 2024-09-12T00:17:29.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.842+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=C2378RP4MN2G type=del 2024-09-12T00:17:29.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.846+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=H59HORGMJCTO type=write size=1014926 2024-09-12T00:17:29.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.850+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~UZ6GT65TG3SY.0 size=1048576 2024-09-12T00:17:29.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.850+0000 7febed3678c0 1 < canceled part key=_multipart_9CBI4FHAT3H2.2~UZ6GT65TG3SY.1 size=651258 2024-09-12T00:17:29.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.854+0000 7febed3678c0 1 < canceled multipart upload key=9CBI4FHAT3H2 upload=UZ6GT65TG3SY tag=I1SWSPV3M6H7 type=write size=2748410 2024-09-12T00:17:29.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.858+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=6TB9WRNO028F type=del size=743515 2024-09-12T00:17:29.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.858+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=40KCT8N492TI type=del 2024-09-12T00:17:29.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.866+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~EQQIKDSDXMZI.0 size=1048576 2024-09-12T00:17:29.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.866+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~EQQIKDSDXMZI.1 size=414119 2024-09-12T00:17:29.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.866+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=EQQIKDSDXMZI tag=55CX7KBKH493 type=write size=2511271 2024-09-12T00:17:29.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.870+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~4DFQZHD629JI.0 size=1048576 2024-09-12T00:17:29.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.874+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~4DFQZHD629JI.1 size=193047 2024-09-12T00:17:29.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.878+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=4DFQZHD629JI tag=8LHJ5PHSAN3W type=write size=2290199 2024-09-12T00:17:29.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.886+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~JDNLR1H16N8H.0 size=1048576 2024-09-12T00:17:29.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.890+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~JDNLR1H16N8H.1 size=366498 2024-09-12T00:17:29.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.890+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=JDNLR1H16N8H tag=S3EAOSI9S8MW type=write size=2463650 2024-09-12T00:17:29.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.894+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~UUR8U61S57GN.0 size=1048576 2024-09-12T00:17:29.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.894+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~UUR8U61S57GN.1 size=776329 2024-09-12T00:17:29.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.902+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=UUR8U61S57GN tag=IBK4P37F1PFC type=write size=2873481 2024-09-12T00:17:29.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.910+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~J40CGXKN7APT.0 size=995891 2024-09-12T00:17:29.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.910+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=J40CGXKN7APT tag=5CMJNYB2T11J type=write size=2044467 2024-09-12T00:17:29.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.914+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=J21D6326FFXD type=del 2024-09-12T00:17:29.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.918+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=OKA3EUUN8VMQ type=del size=3682097 2024-09-12T00:17:29.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.922+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=Y4HBLAELNRJY type=del 2024-09-12T00:17:29.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.930+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~M2ZTGIGRZOLV.0 size=579086 2024-09-12T00:17:29.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.930+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=M2ZTGIGRZOLV tag=23IGUY535FCF type=write size=1627662 2024-09-12T00:17:29.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.934+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=Z6Z2BM5GGMRT type=del 2024-09-12T00:17:29.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.938+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=5ZTRW15BTX6S type=del size=1432346 2024-09-12T00:17:29.939 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.942+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~QK4WDZ7GA3WY.0 size=455556 2024-09-12T00:17:29.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.946+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=QK4WDZ7GA3WY tag=A3DUY81TW481 type=write size=1504132 2024-09-12T00:17:29.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.950+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=ZB1PK9MJ5SNZ type=del size=1932947 2024-09-12T00:17:29.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.954+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=WCMZOW8B0NG8 type=del 2024-09-12T00:17:29.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.958+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=292J4HBWBCES type=del size=1033629 2024-09-12T00:17:29.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.962+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=XYNF2FQ06XUV type=del 2024-09-12T00:17:29.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.970+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~TY3SXHSPCX1G.0 size=1048576 2024-09-12T00:17:29.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.974+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~TY3SXHSPCX1G.1 size=944486 2024-09-12T00:17:29.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.974+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=TY3SXHSPCX1G tag=PC99YIMZP5EJ type=write size=3041638 2024-09-12T00:17:29.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.978+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~2FI7I6CZ1ULA.0 size=403453 2024-09-12T00:17:29.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.986+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=2FI7I6CZ1ULA tag=1OXO9MFUF6V9 type=write size=1452029 2024-09-12T00:17:29.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.986+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=X9MGKPYSITC9 type=del size=4188820 2024-09-12T00:17:29.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.994+0000 7febed3678c0 1 < suggested remove operation key=1HABX7YZ491W tag=17439R1R8GIU type=del 2024-09-12T00:17:29.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:29.998+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~ZUIA3EJEIIUF.0 size=1048576 2024-09-12T00:17:30.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.002+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~ZUIA3EJEIIUF.1 size=988116 2024-09-12T00:17:30.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.002+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=ZUIA3EJEIIUF tag=HT79YH31OYS7 type=write size=3085268 2024-09-12T00:17:30.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.006+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=UMD20K2YP2P6 type=del 2024-09-12T00:17:30.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.010+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=Z0M1JMG75ZXM type=del size=1978359 2024-09-12T00:17:30.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.014+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~HSN8CMKHKETY.0 size=1048576 2024-09-12T00:17:30.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.014+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~HSN8CMKHKETY.1 size=1048576 2024-09-12T00:17:30.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.014+0000 7febed3678c0 1 < canceled part key=_multipart_AHTIFXX3SGK7.2~HSN8CMKHKETY.2 size=696794 2024-09-12T00:17:30.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.018+0000 7febed3678c0 1 < canceled multipart upload key=AHTIFXX3SGK7 upload=HSN8CMKHKETY tag=8JUEOEOROONI type=write size=3842522 2024-09-12T00:17:30.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.022+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=354A5RF4065V type=del size=1545976 2024-09-12T00:17:30.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.030+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~G0WUPQAVZNH3.0 size=1048576 2024-09-12T00:17:30.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.034+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~G0WUPQAVZNH3.1 size=1048576 2024-09-12T00:17:30.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.034+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~G0WUPQAVZNH3.2 size=273384 2024-09-12T00:17:30.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.042+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=G0WUPQAVZNH3 tag=L377WSAPS3HR type=write size=3419112 2024-09-12T00:17:30.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.046+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=YX1R88K7ZTXH type=del size=1764589 2024-09-12T00:17:30.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.050+0000 7febed3678c0 1 < canceled operation key=52SSW5KTCS15 tag=H59HORGMJCTO type=write size=1014926 2024-09-12T00:17:30.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.050+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=O4CZCF9BLWNJ type=del size=3959863 2024-09-12T00:17:30.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.054+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=6TB9WRNO028F type=del 2024-09-12T00:17:30.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.058+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~IIQ9FYPOFEGG.0 size=1048576 2024-09-12T00:17:30.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.062+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~IIQ9FYPOFEGG.1 size=938836 2024-09-12T00:17:30.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.062+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=IIQ9FYPOFEGG tag=AG9EV4VC531B type=write size=3035988 2024-09-12T00:17:30.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.062+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~EQQIKDSDXMZI.0 size=1048576 2024-09-12T00:17:30.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.066+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~EQQIKDSDXMZI.1 size=414119 2024-09-12T00:17:30.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.070+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=EQQIKDSDXMZI tag=55CX7KBKH493 type=write size=2511271 2024-09-12T00:17:30.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.074+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=QNN7Z02ZGM47 type=del size=4191229 2024-09-12T00:17:30.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.074+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~JDNLR1H16N8H.0 size=1048576 2024-09-12T00:17:30.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.078+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~JDNLR1H16N8H.1 size=366498 2024-09-12T00:17:30.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.082+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=JDNLR1H16N8H tag=S3EAOSI9S8MW type=write size=2463650 2024-09-12T00:17:30.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.086+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=2FDS0OL2ON5F type=del size=2733063 2024-09-12T00:17:30.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.086+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~J40CGXKN7APT.0 size=995891 2024-09-12T00:17:30.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.090+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=J40CGXKN7APT tag=5CMJNYB2T11J type=write size=2044467 2024-09-12T00:17:30.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.094+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=6YD6G0EHR0QE type=del size=1738985 2024-09-12T00:17:30.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.098+0000 7febed3678c0 -1 < failed to complete operation key=1HABX7YZ491W tag=OKA3EUUN8VMQ type=del size=3682097: (22) Invalid argument 2024-09-12T00:17:30.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.098+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=NQQXKSQ889TK type=del size=759820 2024-09-12T00:17:30.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.102+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~M2ZTGIGRZOLV.0 size=579086 2024-09-12T00:17:30.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.106+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=M2ZTGIGRZOLV tag=23IGUY535FCF type=write size=1627662 2024-09-12T00:17:30.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.110+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~L2ZA4VEHTJ3N.0 size=24407 2024-09-12T00:17:30.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.110+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=L2ZA4VEHTJ3N tag=H6N79K0MT9UG type=write size=1072983 2024-09-12T00:17:30.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.114+0000 7febed3678c0 1 < suggested update operation key=4K65QIB9F00S tag=5ZTRW15BTX6S type=del size=1432346 2024-09-12T00:17:30.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.118+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=KVNH5U478RXP type=del size=111252 2024-09-12T00:17:30.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.118+0000 7febed3678c0 -1 < failed to complete operation key=4K65QIB9F00S tag=ZB1PK9MJ5SNZ type=del size=1932947: (22) Invalid argument 2024-09-12T00:17:30.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.126+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~HA5PSOJ5K69K.0 size=1048576 2024-09-12T00:17:30.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.126+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~HA5PSOJ5K69K.1 size=1048576 2024-09-12T00:17:30.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.130+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~HA5PSOJ5K69K.2 size=481003 2024-09-12T00:17:30.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.130+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=HA5PSOJ5K69K tag=BCI1OUSKRJ5H type=write size=3626731 2024-09-12T00:17:30.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.134+0000 7febed3678c0 1 < suggested remove operation key=70W3V7TFBUFJ tag=292J4HBWBCES type=del 2024-09-12T00:17:30.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.138+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~CMFWFW2ADRYB.0 size=1048576 2024-09-12T00:17:30.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.142+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~CMFWFW2ADRYB.1 size=1048576 2024-09-12T00:17:30.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.146+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~CMFWFW2ADRYB.2 size=571000 2024-09-12T00:17:30.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.146+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=CMFWFW2ADRYB tag=G5E087TD7NY7 type=write size=3716728 2024-09-12T00:17:30.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.146+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~TY3SXHSPCX1G.0 size=1048576 2024-09-12T00:17:30.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.150+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~TY3SXHSPCX1G.1 size=944486 2024-09-12T00:17:30.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.154+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=TY3SXHSPCX1G tag=PC99YIMZP5EJ type=write size=3041638 2024-09-12T00:17:30.160 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.162+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~U523J953L7H5.0 size=1048576 2024-09-12T00:17:30.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.162+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~U523J953L7H5.1 size=1048576 2024-09-12T00:17:30.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.166+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~U523J953L7H5.2 size=844383 2024-09-12T00:17:30.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.166+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=U523J953L7H5 tag=O51HW9LM7BT1 type=write size=3990111 2024-09-12T00:17:30.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.170+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=X9MGKPYSITC9 type=del 2024-09-12T00:17:30.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.174+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~MN0G23GSEI95.0 size=1048576 2024-09-12T00:17:30.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.174+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~MN0G23GSEI95.1 size=206906 2024-09-12T00:17:30.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.174+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=MN0G23GSEI95 tag=SEQTKVJ8Y37E type=write size=2304058 2024-09-12T00:17:30.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.178+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~ZUIA3EJEIIUF.0 size=1048576 2024-09-12T00:17:30.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.182+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~ZUIA3EJEIIUF.1 size=988116 2024-09-12T00:17:30.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.186+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=ZUIA3EJEIIUF tag=HT79YH31OYS7 type=write size=3085268 2024-09-12T00:17:30.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.190+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=GJCHEUNOWBCQ type=write size=49937 2024-09-12T00:17:30.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.190+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=Z0M1JMG75ZXM type=del 2024-09-12T00:17:30.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.198+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~ER13CTBTFE2U.0 size=517036 2024-09-12T00:17:30.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.198+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=ER13CTBTFE2U tag=N1Z46XY29TKB type=write size=1565612 2024-09-12T00:17:30.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.198+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=354A5RF4065V type=del 2024-09-12T00:17:30.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.202+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=YZ02KK5C9YJB type=del size=1596279 2024-09-12T00:17:30.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.206+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=YX1R88K7ZTXH type=del 2024-09-12T00:17:30.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.210+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=OBZJ609N9G2Y type=write size=418614 2024-09-12T00:17:30.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.214+0000 7febed3678c0 1 < suggested update operation key=MAZHOU2CEUCU tag=O4CZCF9BLWNJ type=del size=3959863 2024-09-12T00:17:30.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.218+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~LV143LHY966U.0 size=451756 2024-09-12T00:17:30.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.218+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=LV143LHY966U tag=XZTT0ZN3UEX1 type=write size=1500332 2024-09-12T00:17:30.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.222+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~IIQ9FYPOFEGG.0 size=1048576 2024-09-12T00:17:30.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.226+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~IIQ9FYPOFEGG.1 size=938836 2024-09-12T00:17:30.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.230+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=IIQ9FYPOFEGG tag=AG9EV4VC531B type=write size=3035988 2024-09-12T00:17:30.235 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.234+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~QPMF9RJLL97C.0 size=1048576 2024-09-12T00:17:30.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.238+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~QPMF9RJLL97C.1 size=402494 2024-09-12T00:17:30.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.238+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=QPMF9RJLL97C tag=U4ZMC2CH05IZ type=write size=2499646 2024-09-12T00:17:30.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.242+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=QNN7Z02ZGM47 type=del 2024-09-12T00:17:30.246 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.246+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~7VMNE7SOZCQM.0 size=1048576 2024-09-12T00:17:30.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.250+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~7VMNE7SOZCQM.1 size=1048576 2024-09-12T00:17:30.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.250+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~7VMNE7SOZCQM.2 size=459443 2024-09-12T00:17:30.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.250+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=7VMNE7SOZCQM tag=2YVXHNM5DCMO type=write size=3605171 2024-09-12T00:17:30.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.254+0000 7febed3678c0 1 < canceled operation key=ELNXYXX5ZWOW tag=2FDS0OL2ON5F type=del size=2733063 2024-09-12T00:17:30.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.258+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=W10WZ6337E6X type=del size=4187875 2024-09-12T00:17:30.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.262+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=6YD6G0EHR0QE type=del 2024-09-12T00:17:30.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.266+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~XPJO0Q52Y2I7.0 size=1048576 2024-09-12T00:17:30.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.266+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~XPJO0Q52Y2I7.1 size=1048576 2024-09-12T00:17:30.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.270+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~XPJO0Q52Y2I7.2 size=515039 2024-09-12T00:17:30.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.270+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=XPJO0Q52Y2I7 tag=5KPYUJ89278V type=write size=3660767 2024-09-12T00:17:30.272 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.274+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=NQQXKSQ889TK type=del 2024-09-12T00:17:30.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.278+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~22WO9KR8Z4BF.0 size=1048576 2024-09-12T00:17:30.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.282+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~22WO9KR8Z4BF.1 size=1048576 2024-09-12T00:17:30.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.282+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~22WO9KR8Z4BF.2 size=218597 2024-09-12T00:17:30.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.282+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=22WO9KR8Z4BF tag=4AF7MB39SLMQ type=write size=3364325 2024-09-12T00:17:30.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.286+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~L2ZA4VEHTJ3N.0 size=24407 2024-09-12T00:17:30.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.294+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=L2ZA4VEHTJ3N tag=H6N79K0MT9UG type=write size=1072983 2024-09-12T00:17:30.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.298+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=VKBUV120J4T5 type=del size=399044 2024-09-12T00:17:30.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.298+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=KVNH5U478RXP type=del 2024-09-12T00:17:30.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.306+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~IS635YC1ITWO.0 size=49093 2024-09-12T00:17:30.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.306+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=IS635YC1ITWO tag=Z9BXQDL4S51T type=write size=1097669 2024-09-12T00:17:30.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.306+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~HA5PSOJ5K69K.0 size=1048576 2024-09-12T00:17:30.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.310+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~HA5PSOJ5K69K.1 size=1048576 2024-09-12T00:17:30.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.310+0000 7febed3678c0 1 < canceled part key=_multipart_CIOINUP503WY.2~HA5PSOJ5K69K.2 size=481003 2024-09-12T00:17:30.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.314+0000 7febed3678c0 1 < canceled multipart upload key=CIOINUP503WY upload=HA5PSOJ5K69K tag=BCI1OUSKRJ5H type=write size=3626731 2024-09-12T00:17:30.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.318+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~1ZZL09JJSLOC.0 size=1048576 2024-09-12T00:17:30.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.322+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~1ZZL09JJSLOC.1 size=622043 2024-09-12T00:17:30.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.322+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=1ZZL09JJSLOC tag=WQUR6HU5TMG8 type=write size=2719195 2024-09-12T00:17:30.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.322+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~CMFWFW2ADRYB.0 size=1048576 2024-09-12T00:17:30.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.326+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~CMFWFW2ADRYB.1 size=1048576 2024-09-12T00:17:30.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.330+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~CMFWFW2ADRYB.2 size=571000 2024-09-12T00:17:30.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.334+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=CMFWFW2ADRYB tag=G5E087TD7NY7 type=write size=3716728 2024-09-12T00:17:30.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.338+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=RF2Y1KKJ6PTW type=del size=3492572 2024-09-12T00:17:30.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.342+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~U523J953L7H5.0 size=1048576 2024-09-12T00:17:30.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.342+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~U523J953L7H5.1 size=1048576 2024-09-12T00:17:30.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.346+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~U523J953L7H5.2 size=844383 2024-09-12T00:17:30.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.350+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=U523J953L7H5 tag=O51HW9LM7BT1 type=write size=3990111 2024-09-12T00:17:30.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.354+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~LWJ7KP8Y09PH.0 size=454033 2024-09-12T00:17:30.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.354+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=LWJ7KP8Y09PH tag=C0XBCJYH053R type=write size=1502609 2024-09-12T00:17:30.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.358+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~MN0G23GSEI95.0 size=1048576 2024-09-12T00:17:30.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.362+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~MN0G23GSEI95.1 size=206906 2024-09-12T00:17:30.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.366+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=MN0G23GSEI95 tag=SEQTKVJ8Y37E type=write size=2304058 2024-09-12T00:17:30.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.370+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=V2FM8SKTDFRH type=del size=2029893 2024-09-12T00:17:30.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.374+0000 7febed3678c0 1 < canceled operation key=VU1AF57EUA0R tag=GJCHEUNOWBCQ type=write size=49937 2024-09-12T00:17:30.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.374+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=IC88XNDR3TWG type=write size=1001133 2024-09-12T00:17:30.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.378+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~ER13CTBTFE2U.0 size=517036 2024-09-12T00:17:30.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.382+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=ER13CTBTFE2U tag=N1Z46XY29TKB type=write size=1565612 2024-09-12T00:17:30.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.386+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=GS21A8WJOP9O type=del size=1345890 2024-09-12T00:17:30.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.386+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=YZ02KK5C9YJB type=del 2024-09-12T00:17:30.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.390+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=0J4A0XIHMKTV type=del size=1088009 2024-09-12T00:17:30.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.394+0000 7febed3678c0 1 < suggested remove operation key=ASFLGSKWYHG5 tag=OBZJ609N9G2Y type=write 2024-09-12T00:17:30.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.398+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=UM1BZ3GLA8GW type=write size=173017 2024-09-12T00:17:30.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.402+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~LV143LHY966U.0 size=451756 2024-09-12T00:17:30.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.406+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=LV143LHY966U tag=XZTT0ZN3UEX1 type=write size=1500332 2024-09-12T00:17:30.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.410+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=AATMNIOZIE5V type=del size=1782696 2024-09-12T00:17:30.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.410+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~QPMF9RJLL97C.0 size=1048576 2024-09-12T00:17:30.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.414+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~QPMF9RJLL97C.1 size=402494 2024-09-12T00:17:30.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.418+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=QPMF9RJLL97C tag=U4ZMC2CH05IZ type=write size=2499646 2024-09-12T00:17:30.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.426+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~L366YWDKCTMC.0 size=119689 2024-09-12T00:17:30.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.426+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=L366YWDKCTMC tag=NS18ATFNMPU9 type=write size=1168265 2024-09-12T00:17:30.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.426+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~7VMNE7SOZCQM.0 size=1048576 2024-09-12T00:17:30.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.430+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~7VMNE7SOZCQM.1 size=1048576 2024-09-12T00:17:30.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.434+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~7VMNE7SOZCQM.2 size=459443 2024-09-12T00:17:30.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.438+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=7VMNE7SOZCQM tag=2YVXHNM5DCMO type=write size=3605171 2024-09-12T00:17:30.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.442+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~5K2OHLD33V3H.0 size=342321 2024-09-12T00:17:30.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.442+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=5K2OHLD33V3H tag=I6GHP7KOEJT5 type=write size=1390897 2024-09-12T00:17:30.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.446+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=W10WZ6337E6X type=del 2024-09-12T00:17:30.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.450+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~56BXIYKB072M.0 size=1048576 2024-09-12T00:17:30.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.454+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~56BXIYKB072M.1 size=95799 2024-09-12T00:17:30.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.454+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=56BXIYKB072M tag=5MC48CIRU0FV type=write size=2192951 2024-09-12T00:17:30.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.458+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~XPJO0Q52Y2I7.0 size=1048576 2024-09-12T00:17:30.458 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.458+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~XPJO0Q52Y2I7.1 size=1048576 2024-09-12T00:17:30.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.462+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~XPJO0Q52Y2I7.2 size=515039 2024-09-12T00:17:30.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.466+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=XPJO0Q52Y2I7 tag=5KPYUJ89278V type=write size=3660767 2024-09-12T00:17:30.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.470+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~XPKF8E13O61J.0 size=1048576 2024-09-12T00:17:30.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.470+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~XPKF8E13O61J.1 size=1048576 2024-09-12T00:17:30.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.474+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~XPKF8E13O61J.2 size=901408 2024-09-12T00:17:30.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.474+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=XPKF8E13O61J tag=1N9G0CUJEWVZ type=write size=4047136 2024-09-12T00:17:30.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.478+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~22WO9KR8Z4BF.0 size=1048576 2024-09-12T00:17:30.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.478+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~22WO9KR8Z4BF.1 size=1048576 2024-09-12T00:17:30.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.482+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~22WO9KR8Z4BF.2 size=218597 2024-09-12T00:17:30.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.486+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=22WO9KR8Z4BF tag=4AF7MB39SLMQ type=write size=3364325 2024-09-12T00:17:30.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.490+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=4X09ZGTD0M02 type=del size=3398743 2024-09-12T00:17:30.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.494+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=VKBUV120J4T5 type=del 2024-09-12T00:17:30.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.494+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=TG3YEKICZBZP type=del size=2325934 2024-09-12T00:17:30.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.494+0000 7febed3678c0 1 < canceled part key=_multipart_53T1415UK7GE.2~IS635YC1ITWO.0 size=49093 2024-09-12T00:17:30.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.502+0000 7febed3678c0 1 < canceled multipart upload key=53T1415UK7GE upload=IS635YC1ITWO tag=Z9BXQDL4S51T type=write size=1097669 2024-09-12T00:17:30.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.506+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~5CN5C5ZQ3D80.0 size=1048576 2024-09-12T00:17:30.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.506+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~5CN5C5ZQ3D80.1 size=1048576 2024-09-12T00:17:30.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.510+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~5CN5C5ZQ3D80.2 size=978757 2024-09-12T00:17:30.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.510+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=5CN5C5ZQ3D80 tag=X6O90QZJ0O47 type=write size=4124485 2024-09-12T00:17:30.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.514+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~1ZZL09JJSLOC.0 size=1048576 2024-09-12T00:17:30.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.514+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~1ZZL09JJSLOC.1 size=622043 2024-09-12T00:17:30.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.518+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=1ZZL09JJSLOC tag=WQUR6HU5TMG8 type=write size=2719195 2024-09-12T00:17:30.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.522+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=VREUCB70BUEL type=write size=382093 2024-09-12T00:17:30.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.526+0000 7febed3678c0 1 < canceled operation key=4K65QIB9F00S tag=RF2Y1KKJ6PTW type=del size=3492572 2024-09-12T00:17:30.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.530+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=D9B23GCFK9BS type=del size=2053384 2024-09-12T00:17:30.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.530+0000 7febed3678c0 1 < canceled part key=_multipart_Z020UV2JRR0I.2~LWJ7KP8Y09PH.0 size=454033 2024-09-12T00:17:30.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.534+0000 7febed3678c0 1 < canceled multipart upload key=Z020UV2JRR0I upload=LWJ7KP8Y09PH tag=C0XBCJYH053R type=write size=1502609 2024-09-12T00:17:30.539 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.538+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~WIS3YKF4ZG1G.0 size=1048576 2024-09-12T00:17:30.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.542+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~WIS3YKF4ZG1G.1 size=1048576 2024-09-12T00:17:30.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.546+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~WIS3YKF4ZG1G.2 size=488638 2024-09-12T00:17:30.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.546+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=WIS3YKF4ZG1G tag=OP4FLAFKQG8K type=write size=3634366 2024-09-12T00:17:30.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.546+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=V2FM8SKTDFRH type=del 2024-09-12T00:17:30.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.554+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=HDF3ALCTZ3I1 type=del size=781233 2024-09-12T00:17:30.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.558+0000 7febed3678c0 1 < completed write operation key=RGQ4KY26RKYI tag=IC88XNDR3TWG type=write size=1001133 2024-09-12T00:17:30.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.562+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=8VK4E0GKI0SC type=del size=3758103 2024-09-12T00:17:30.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.566+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=GS21A8WJOP9O type=del 2024-09-12T00:17:30.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.570+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~077HWDSHOIDT.0 size=1048576 2024-09-12T00:17:30.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.570+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~077HWDSHOIDT.1 size=1048576 2024-09-12T00:17:30.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.574+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~077HWDSHOIDT.2 size=283229 2024-09-12T00:17:30.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.574+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=077HWDSHOIDT tag=T8T3226CNN2F type=write size=3428957 2024-09-12T00:17:30.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.578+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=0J4A0XIHMKTV type=del 2024-09-12T00:17:30.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.582+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~KV05IZDGPWTP.0 size=1048576 2024-09-12T00:17:30.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.582+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~KV05IZDGPWTP.1 size=473809 2024-09-12T00:17:30.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.582+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=KV05IZDGPWTP tag=V8FMGUVD8S7K type=write size=2570961 2024-09-12T00:17:30.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.586+0000 7febed3678c0 1 < completed write operation key=W2VEW3JJEJY7 tag=UM1BZ3GLA8GW type=write size=173017 2024-09-12T00:17:30.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.590+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=2QVZRZTYGZJM type=del size=929249 2024-09-12T00:17:30.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.594+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=AATMNIOZIE5V type=del 2024-09-12T00:17:30.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.594+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=KUPMB6EFT3KX type=del size=959002 2024-09-12T00:17:30.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.598+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~L366YWDKCTMC.0 size=119689 2024-09-12T00:17:30.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.602+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=L366YWDKCTMC tag=NS18ATFNMPU9 type=write size=1168265 2024-09-12T00:17:30.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.606+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=44AWKI12P8IZ type=del size=2737875 2024-09-12T00:17:30.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.610+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~5K2OHLD33V3H.0 size=342321 2024-09-12T00:17:30.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.614+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=5K2OHLD33V3H tag=I6GHP7KOEJT5 type=write size=1390897 2024-09-12T00:17:30.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.618+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=865S2QHYA2KW type=del size=3280794 2024-09-12T00:17:30.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.622+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~56BXIYKB072M.0 size=1048576 2024-09-12T00:17:30.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.626+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~56BXIYKB072M.1 size=95799 2024-09-12T00:17:30.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.630+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=56BXIYKB072M tag=5MC48CIRU0FV type=write size=2192951 2024-09-12T00:17:30.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.634+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~44MYIGOMPDWV.0 size=122983 2024-09-12T00:17:30.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.634+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=44MYIGOMPDWV tag=VF4E8M7OEY02 type=write size=1171559 2024-09-12T00:17:30.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.638+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~XPKF8E13O61J.0 size=1048576 2024-09-12T00:17:30.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.642+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~XPKF8E13O61J.1 size=1048576 2024-09-12T00:17:30.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.646+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~XPKF8E13O61J.2 size=901408 2024-09-12T00:17:30.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.650+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=XPKF8E13O61J tag=1N9G0CUJEWVZ type=write size=4047136 2024-09-12T00:17:30.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.654+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~VDDMU97OY0YA.0 size=88538 2024-09-12T00:17:30.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.654+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=VDDMU97OY0YA tag=JG3LTVAZRVHJ type=write size=1137114 2024-09-12T00:17:30.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.658+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=4X09ZGTD0M02 type=del 2024-09-12T00:17:30.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.662+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=0507I0Y0UI75 type=del size=3773975 2024-09-12T00:17:30.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.666+0000 7febed3678c0 1 < suggested update operation key=4K65QIB9F00S tag=TG3YEKICZBZP type=del size=2325934 2024-09-12T00:17:30.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.670+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=DE4NYS39VCSK type=del size=526698 2024-09-12T00:17:30.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.670+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~5CN5C5ZQ3D80.0 size=1048576 2024-09-12T00:17:30.673 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.674+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~5CN5C5ZQ3D80.1 size=1048576 2024-09-12T00:17:30.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.674+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~5CN5C5ZQ3D80.2 size=978757 2024-09-12T00:17:30.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.682+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=5CN5C5ZQ3D80 tag=X6O90QZJ0O47 type=write size=4124485 2024-09-12T00:17:30.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.686+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~89M3O6PG1V7U.0 size=1048576 2024-09-12T00:17:30.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.686+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~89M3O6PG1V7U.1 size=1048576 2024-09-12T00:17:30.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.690+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~89M3O6PG1V7U.2 size=955160 2024-09-12T00:17:30.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.690+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=89M3O6PG1V7U tag=VGZO2LL7RVMO type=write size=4100888 2024-09-12T00:17:30.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.690+0000 7febed3678c0 1 < completed write operation key=Z020UV2JRR0I tag=VREUCB70BUEL type=write size=382093 2024-09-12T00:17:30.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.698+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~KWEPWOYRB4FS.0 size=473428 2024-09-12T00:17:30.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.698+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=KWEPWOYRB4FS tag=NZ3JYHZ0A7J0 type=write size=1522004 2024-09-12T00:17:30.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.698+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=D9B23GCFK9BS type=del 2024-09-12T00:17:30.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.706+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~220X9JAU8Z4I.0 size=146769 2024-09-12T00:17:30.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.706+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=220X9JAU8Z4I tag=WOA0EJKNMY8L type=write size=1195345 2024-09-12T00:17:30.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.706+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~WIS3YKF4ZG1G.0 size=1048576 2024-09-12T00:17:30.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.710+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~WIS3YKF4ZG1G.1 size=1048576 2024-09-12T00:17:30.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.710+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~WIS3YKF4ZG1G.2 size=488638 2024-09-12T00:17:30.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.718+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=WIS3YKF4ZG1G tag=OP4FLAFKQG8K type=write size=3634366 2024-09-12T00:17:30.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.718+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=TL4K2XNWDZXY type=del size=684619 2024-09-12T00:17:30.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.722+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=HDF3ALCTZ3I1 type=del 2024-09-12T00:17:30.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.726+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~PLD7BWJG3F5K.0 size=64016 2024-09-12T00:17:30.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.726+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=PLD7BWJG3F5K tag=MMPPHNN8YA9D type=write size=1112592 2024-09-12T00:17:30.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.730+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=8VK4E0GKI0SC type=del 2024-09-12T00:17:30.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.730+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=E2EW79WO0GH9 type=del size=308838 2024-09-12T00:17:30.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.734+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~077HWDSHOIDT.0 size=1048576 2024-09-12T00:17:30.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.738+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~077HWDSHOIDT.1 size=1048576 2024-09-12T00:17:30.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.738+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~077HWDSHOIDT.2 size=283229 2024-09-12T00:17:30.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.742+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=077HWDSHOIDT tag=T8T3226CNN2F type=write size=3428957 2024-09-12T00:17:30.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.746+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~LSV1A3OED53J.0 size=1048576 2024-09-12T00:17:30.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.750+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~LSV1A3OED53J.1 size=1048576 2024-09-12T00:17:30.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.754+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~LSV1A3OED53J.2 size=210461 2024-09-12T00:17:30.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.754+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=LSV1A3OED53J tag=ABZ72J8X3UXH type=write size=3356189 2024-09-12T00:17:30.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.758+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~KV05IZDGPWTP.0 size=1048576 2024-09-12T00:17:30.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.758+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~KV05IZDGPWTP.1 size=473809 2024-09-12T00:17:30.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.762+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=KV05IZDGPWTP tag=V8FMGUVD8S7K type=write size=2570961 2024-09-12T00:17:30.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.770+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~1HGJ3XEGB6E2.0 size=241100 2024-09-12T00:17:30.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.770+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=1HGJ3XEGB6E2 tag=ZAU34L24U0L8 type=write size=1289676 2024-09-12T00:17:30.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.770+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=2QVZRZTYGZJM type=del 2024-09-12T00:17:30.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.774+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=I5QKF1ALB8PC type=del size=3223092 2024-09-12T00:17:30.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.778+0000 7febed3678c0 1 < canceled operation key=CIOINUP503WY tag=KUPMB6EFT3KX type=del size=959002 2024-09-12T00:17:30.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.782+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~B44K4XD1AQI4.0 size=1048576 2024-09-12T00:17:30.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.786+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~B44K4XD1AQI4.1 size=1048576 2024-09-12T00:17:30.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.786+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~B44K4XD1AQI4.2 size=199446 2024-09-12T00:17:30.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.786+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=B44K4XD1AQI4 tag=7WP07CUOR3NR type=write size=3345174 2024-09-12T00:17:30.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.790+0000 7febed3678c0 1 < suggested remove operation key=25THATWGX4WS tag=44AWKI12P8IZ type=del 2024-09-12T00:17:30.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.798+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~LR2THM0E39Z9.0 size=1048576 2024-09-12T00:17:30.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.798+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~LR2THM0E39Z9.1 size=1048576 2024-09-12T00:17:30.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.802+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~LR2THM0E39Z9.2 size=367529 2024-09-12T00:17:30.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.802+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=LR2THM0E39Z9 tag=GBOWPQ0UIT03 type=write size=3513257 2024-09-12T00:17:30.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.802+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=865S2QHYA2KW type=del 2024-09-12T00:17:30.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.806+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=9HC2OF64M2T2 type=del size=3345824 2024-09-12T00:17:30.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.810+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~44MYIGOMPDWV.0 size=122983 2024-09-12T00:17:30.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.818+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=44MYIGOMPDWV tag=VF4E8M7OEY02 type=write size=1171559 2024-09-12T00:17:30.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.818+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=W8E98RL4QRNT type=del size=1280812 2024-09-12T00:17:30.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.822+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~VDDMU97OY0YA.0 size=88538 2024-09-12T00:17:30.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.826+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=VDDMU97OY0YA tag=JG3LTVAZRVHJ type=write size=1137114 2024-09-12T00:17:30.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.830+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=3AZGECPQBROW type=del size=1780056 2024-09-12T00:17:30.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.830+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=0507I0Y0UI75 type=del 2024-09-12T00:17:30.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.834+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=304HGOBZ26HV type=write size=616952 2024-09-12T00:17:30.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.838+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=DE4NYS39VCSK type=del 2024-09-12T00:17:30.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.838+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=F38SQ80N1TMI type=write size=835911 2024-09-12T00:17:30.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.838+0000 7febed3678c0 1 < canceled part key=_multipart_UGV3WQR0ADYH.2~89M3O6PG1V7U.0 size=1048576 2024-09-12T00:17:30.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.842+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~89M3O6PG1V7U.1 size=1048576 2024-09-12T00:17:30.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.842+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~89M3O6PG1V7U.2 size=955160 2024-09-12T00:17:30.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.846+0000 7febed3678c0 1 < canceled multipart upload key=UGV3WQR0ADYH upload=89M3O6PG1V7U tag=VGZO2LL7RVMO type=write size=4100888 2024-09-12T00:17:30.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.850+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~XCT6I6B8U5X4.0 size=207222 2024-09-12T00:17:30.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.850+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=XCT6I6B8U5X4 tag=FYK0NWI53X6Z type=write size=1255798 2024-09-12T00:17:30.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.854+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~KWEPWOYRB4FS.0 size=473428 2024-09-12T00:17:30.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.858+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=KWEPWOYRB4FS tag=NZ3JYHZ0A7J0 type=write size=1522004 2024-09-12T00:17:30.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.862+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=MLVWF2YTF9R5 type=del size=2275368 2024-09-12T00:17:30.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.862+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~220X9JAU8Z4I.0 size=146769 2024-09-12T00:17:30.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.870+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=220X9JAU8Z4I tag=WOA0EJKNMY8L type=write size=1195345 2024-09-12T00:17:30.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.870+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=Y5WD6328HQGJ type=del size=4157557 2024-09-12T00:17:30.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.878+0000 7febed3678c0 1 < suggested remove operation key=CIOINUP503WY tag=TL4K2XNWDZXY type=del 2024-09-12T00:17:30.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.878+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=RGFLJIMWR4WP type=write size=1021835 2024-09-12T00:17:30.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.882+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~PLD7BWJG3F5K.0 size=64016 2024-09-12T00:17:30.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.886+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=PLD7BWJG3F5K tag=MMPPHNN8YA9D type=write size=1112592 2024-09-12T00:17:30.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.890+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=7Z63LEQ0XGFE type=write size=868224 2024-09-12T00:17:30.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.898+0000 7febed3678c0 1 < suggested remove operation key=88BY5RHXSHD4 tag=E2EW79WO0GH9 type=del 2024-09-12T00:17:30.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.902+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~UX543HRWOKME.0 size=417668 2024-09-12T00:17:30.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.902+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=UX543HRWOKME tag=X63S0QIH81MD type=write size=1466244 2024-09-12T00:17:30.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.906+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~LSV1A3OED53J.0 size=1048576 2024-09-12T00:17:30.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.910+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~LSV1A3OED53J.1 size=1048576 2024-09-12T00:17:30.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.910+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~LSV1A3OED53J.2 size=210461 2024-09-12T00:17:30.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.918+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=LSV1A3OED53J tag=ABZ72J8X3UXH type=write size=3356189 2024-09-12T00:17:30.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.922+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~SAAE7CZGSZE9.0 size=1048576 2024-09-12T00:17:30.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.926+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~SAAE7CZGSZE9.1 size=1048576 2024-09-12T00:17:30.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.930+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~SAAE7CZGSZE9.2 size=1034210 2024-09-12T00:17:30.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.930+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=SAAE7CZGSZE9 tag=VK4OCT1VVZVB type=write size=4179938 2024-09-12T00:17:30.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.930+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~1HGJ3XEGB6E2.0 size=241100 2024-09-12T00:17:30.936 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.938+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=1HGJ3XEGB6E2 tag=ZAU34L24U0L8 type=write size=1289676 2024-09-12T00:17:30.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.938+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=V2IA81SLZ9EJ type=del size=1568596 2024-09-12T00:17:30.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.946+0000 7febed3678c0 1 < suggested remove operation key=3G9ABEEEDRI3 tag=I5QKF1ALB8PC type=del 2024-09-12T00:17:30.949 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.950+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=R3D94B729KVS type=del size=741996 2024-09-12T00:17:30.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.954+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~B44K4XD1AQI4.0 size=1048576 2024-09-12T00:17:30.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.954+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~B44K4XD1AQI4.1 size=1048576 2024-09-12T00:17:30.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.958+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~B44K4XD1AQI4.2 size=199446 2024-09-12T00:17:30.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.962+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=B44K4XD1AQI4 tag=7WP07CUOR3NR type=write size=3345174 2024-09-12T00:17:30.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.966+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=OA8BX030L9GD type=del size=2934104 2024-09-12T00:17:30.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.970+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~LR2THM0E39Z9.0 size=1048576 2024-09-12T00:17:30.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.970+0000 7febed3678c0 1 < canceled part key=_multipart_RGQ4KY26RKYI.2~LR2THM0E39Z9.1 size=1048576 2024-09-12T00:17:30.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.970+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~LR2THM0E39Z9.2 size=367529 2024-09-12T00:17:30.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.978+0000 7febed3678c0 1 < canceled multipart upload key=RGQ4KY26RKYI upload=LR2THM0E39Z9 tag=GBOWPQ0UIT03 type=write size=3513257 2024-09-12T00:17:30.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.978+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=02ENRH3REHN0 type=del size=3539639 2024-09-12T00:17:30.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.982+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=9HC2OF64M2T2 type=del 2024-09-12T00:17:30.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.986+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=3NCYO1IKQC7N type=del size=1013720 2024-09-12T00:17:30.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.990+0000 7febed3678c0 1 < suggested update operation key=W2VEW3JJEJY7 tag=W8E98RL4QRNT type=del size=1280812 2024-09-12T00:17:30.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.994+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=KE9T8KXC22B4 type=write size=22707 2024-09-12T00:17:30.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:30.998+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=3AZGECPQBROW type=del 2024-09-12T00:17:31.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.002+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=7PA2L92JTI49 type=del size=3002846 2024-09-12T00:17:31.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.006+0000 7febed3678c0 1 < suggested remove operation key=KABJD0GYBVF4 tag=304HGOBZ26HV type=write 2024-09-12T00:17:31.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.010+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=GWE80OXJE5CO type=del size=962977 2024-09-12T00:17:31.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.018+0000 7febed3678c0 1 < suggested remove operation key=ELNXYXX5ZWOW tag=F38SQ80N1TMI type=write 2024-09-12T00:17:31.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.022+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=R48QG2WCME6C type=del size=1182484 2024-09-12T00:17:31.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.022+0000 7febed3678c0 1 < canceled part key=_multipart_LWAMFA0RSW6S.2~XCT6I6B8U5X4.0 size=207222 2024-09-12T00:17:31.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.026+0000 7febed3678c0 1 < canceled multipart upload key=LWAMFA0RSW6S upload=XCT6I6B8U5X4 tag=FYK0NWI53X6Z type=write size=1255798 2024-09-12T00:17:31.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.030+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=IJRCRYE9ACNH type=del size=2688385 2024-09-12T00:17:31.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.034+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=MLVWF2YTF9R5 type=del 2024-09-12T00:17:31.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.038+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~CZQLXOD92PBH.0 size=1048576 2024-09-12T00:17:31.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.042+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~CZQLXOD92PBH.1 size=644913 2024-09-12T00:17:31.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.042+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=CZQLXOD92PBH tag=FT71LN6DJ8MZ type=write size=2742065 2024-09-12T00:17:31.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.050+0000 7febed3678c0 1 < suggested remove operation key=CIOINUP503WY tag=Y5WD6328HQGJ type=del 2024-09-12T00:17:31.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.054+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=INUEWUUPW7TL type=del size=3785891 2024-09-12T00:17:31.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.058+0000 7febed3678c0 -1 < failed to complete operation key=3G9ABEEEDRI3 tag=RGFLJIMWR4WP type=write size=1021835: (22) Invalid argument 2024-09-12T00:17:31.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.062+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~3O6XEW6EC7LE.0 size=423874 2024-09-12T00:17:31.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.062+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=3O6XEW6EC7LE tag=20KOQ7ODIXLB type=write size=1472450 2024-09-12T00:17:31.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.066+0000 7febed3678c0 1 < completed write operation key=52SSW5KTCS15 tag=7Z63LEQ0XGFE type=write size=868224 2024-09-12T00:17:31.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.066+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=JDA2FZMH4DXB type=del size=1851018 2024-09-12T00:17:31.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.070+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~UX543HRWOKME.0 size=417668 2024-09-12T00:17:31.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.074+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=UX543HRWOKME tag=X63S0QIH81MD type=write size=1466244 2024-09-12T00:17:31.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.082+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~5XR4AQ21YENA.0 size=260267 2024-09-12T00:17:31.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.082+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=5XR4AQ21YENA tag=0TUBPRS2D19L type=write size=1308843 2024-09-12T00:17:31.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.082+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~SAAE7CZGSZE9.0 size=1048576 2024-09-12T00:17:31.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.086+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~SAAE7CZGSZE9.1 size=1048576 2024-09-12T00:17:31.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.090+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~SAAE7CZGSZE9.2 size=1034210 2024-09-12T00:17:31.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.094+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=SAAE7CZGSZE9 tag=VK4OCT1VVZVB type=write size=4179938 2024-09-12T00:17:31.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.102+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=5ABM3TCGBHGE type=del size=1141416 2024-09-12T00:17:31.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.102+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=V2IA81SLZ9EJ type=del 2024-09-12T00:17:31.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.110+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~0PA0Y0E8GOOL.0 size=1048576 2024-09-12T00:17:31.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.110+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~0PA0Y0E8GOOL.1 size=883524 2024-09-12T00:17:31.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.110+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=0PA0Y0E8GOOL tag=29WGBUROFUT4 type=write size=2980676 2024-09-12T00:17:31.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.114+0000 7febed3678c0 -1 < failed to complete operation key=CIOINUP503WY tag=R3D94B729KVS type=del size=741996: (22) Invalid argument 2024-09-12T00:17:31.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.118+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=UKENK5HUCL03 type=del size=247897 2024-09-12T00:17:31.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.122+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=OA8BX030L9GD type=del 2024-09-12T00:17:31.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.126+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~XZXMEVYKNLC4.0 size=415120 2024-09-12T00:17:31.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.126+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=XZXMEVYKNLC4 tag=G03FNRL0MONF type=write size=1463696 2024-09-12T00:17:31.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.130+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=02ENRH3REHN0 type=del 2024-09-12T00:17:31.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.134+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=4KJ9EWJB1LW6 type=write size=823739 2024-09-12T00:17:31.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.134+0000 7febed3678c0 -1 < failed to complete operation key=KABJD0GYBVF4 tag=3NCYO1IKQC7N type=del size=1013720: (22) Invalid argument 2024-09-12T00:17:31.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.138+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=0C1YIC2SW5JE type=del size=447859 2024-09-12T00:17:31.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.146+0000 7febed3678c0 1 < suggested update operation key=70W3V7TFBUFJ tag=KE9T8KXC22B4 type=write size=22707 2024-09-12T00:17:31.148 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.150+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=9J5XMRQ1F4SB type=del size=835937 2024-09-12T00:17:31.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.154+0000 7febed3678c0 1 < suggested update operation key=53T1415UK7GE tag=7PA2L92JTI49 type=del size=3002846 2024-09-12T00:17:31.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.158+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=QXZK8O3W6LZ0 type=del size=649261 2024-09-12T00:17:31.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.162+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=GWE80OXJE5CO type=del 2024-09-12T00:17:31.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.166+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=3G9JA69MSJOS type=del size=2137467 2024-09-12T00:17:31.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.166+0000 7febed3678c0 -1 < failed to complete operation key=53T1415UK7GE tag=R48QG2WCME6C type=del size=1182484: (22) Invalid argument 2024-09-12T00:17:31.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.170+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=XLMBCU97PE3U type=del size=339668 2024-09-12T00:17:31.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.174+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=IJRCRYE9ACNH type=del 2024-09-12T00:17:31.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.178+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=VQSNDHNHWYQL type=del size=128349 2024-09-12T00:17:31.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.182+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~CZQLXOD92PBH.0 size=1048576 2024-09-12T00:17:31.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.186+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~CZQLXOD92PBH.1 size=644913 2024-09-12T00:17:31.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.190+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=CZQLXOD92PBH tag=FT71LN6DJ8MZ type=write size=2742065 2024-09-12T00:17:31.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.194+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=QIB1ZHNFDO2T type=del size=500643 2024-09-12T00:17:31.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.198+0000 7febed3678c0 1 < suggested remove operation key=VW69JRC5JYX5 tag=INUEWUUPW7TL type=del 2024-09-12T00:17:31.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.202+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=NBRQM1HPDWMJ type=del size=2571003 2024-09-12T00:17:31.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.202+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~3O6XEW6EC7LE.0 size=423874 2024-09-12T00:17:31.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.210+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=3O6XEW6EC7LE tag=20KOQ7ODIXLB type=write size=1472450 2024-09-12T00:17:31.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.210+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=NDP230UU1LBO type=del size=900011 2024-09-12T00:17:31.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.214+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=JDA2FZMH4DXB type=del 2024-09-12T00:17:31.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.218+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~LQ69NB2TT9GG.0 size=653930 2024-09-12T00:17:31.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.218+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=LQ69NB2TT9GG tag=5T8AEFLOKJMK type=write size=1702506 2024-09-12T00:17:31.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.222+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~5XR4AQ21YENA.0 size=260267 2024-09-12T00:17:31.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.230+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=5XR4AQ21YENA tag=0TUBPRS2D19L type=write size=1308843 2024-09-12T00:17:31.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.230+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=6XPXY8XLM29R type=write size=149066 2024-09-12T00:17:31.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.238+0000 7febed3678c0 1 < suggested update operation key=LGFKY0CP299H tag=5ABM3TCGBHGE type=del size=1141416 2024-09-12T00:17:31.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.242+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=XVE2J545WS9N type=del size=3195760 2024-09-12T00:17:31.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.242+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~0PA0Y0E8GOOL.0 size=1048576 2024-09-12T00:17:31.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.246+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~0PA0Y0E8GOOL.1 size=883524 2024-09-12T00:17:31.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.250+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=0PA0Y0E8GOOL tag=29WGBUROFUT4 type=write size=2980676 2024-09-12T00:17:31.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.258+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~XL6RCGYZ9OYL.0 size=71618 2024-09-12T00:17:31.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.258+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=XL6RCGYZ9OYL tag=UQND1UOFWLEI type=write size=1120194 2024-09-12T00:17:31.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.258+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=UKENK5HUCL03 type=del 2024-09-12T00:17:31.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.262+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=A6IZ1HU60N34 type=del size=573213 2024-09-12T00:17:31.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.266+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~XZXMEVYKNLC4.0 size=415120 2024-09-12T00:17:31.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.270+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=XZXMEVYKNLC4 tag=G03FNRL0MONF type=write size=1463696 2024-09-12T00:17:31.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.270+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=1M9SQUX533IS type=write size=714922 2024-09-12T00:17:31.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.278+0000 7febed3678c0 1 < suggested update operation key=LWAMFA0RSW6S tag=4KJ9EWJB1LW6 type=write size=823739 2024-09-12T00:17:31.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.282+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~EHCR10FZEODC.0 size=1048576 2024-09-12T00:17:31.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.282+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~EHCR10FZEODC.1 size=274103 2024-09-12T00:17:31.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.282+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=EHCR10FZEODC tag=J3EEYHY24E14 type=write size=2371255 2024-09-12T00:17:31.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.286+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=0C1YIC2SW5JE type=del 2024-09-12T00:17:31.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.290+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~P24WOC3MVWG3.0 size=1048576 2024-09-12T00:17:31.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.294+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~P24WOC3MVWG3.1 size=1048576 2024-09-12T00:17:31.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.294+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~P24WOC3MVWG3.2 size=758125 2024-09-12T00:17:31.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.294+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=P24WOC3MVWG3 tag=FDJN29T3FRSW type=write size=3903853 2024-09-12T00:17:31.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.298+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=9J5XMRQ1F4SB type=del 2024-09-12T00:17:31.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.298+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=9YCCSGW6TLXU type=del size=713272 2024-09-12T00:17:31.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.302+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=QXZK8O3W6LZ0 type=del 2024-09-12T00:17:31.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.306+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=16C9D7SD6SB6 type=del size=1195253 2024-09-12T00:17:31.308 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.310+0000 7febed3678c0 1 < suggested update operation key=KABJD0GYBVF4 tag=3G9JA69MSJOS type=del size=2137467 2024-09-12T00:17:31.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.310+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=DFPXPJFN1E0T type=del size=2684564 2024-09-12T00:17:31.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.314+0000 7febed3678c0 -1 < failed to complete operation key=LWAMFA0RSW6S tag=XLMBCU97PE3U type=del size=339668: (22) Invalid argument 2024-09-12T00:17:31.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.314+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=QHK1K1IOYQ97 type=del size=4134376 2024-09-12T00:17:31.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.318+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=VQSNDHNHWYQL type=del 2024-09-12T00:17:31.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.322+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=8D7UHZHS9JCQ type=del size=632902 2024-09-12T00:17:31.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.326+0000 7febed3678c0 1 < suggested update operation key=MHS307JKNVCK tag=QIB1ZHNFDO2T type=del size=500643 2024-09-12T00:17:31.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.326+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=W88U68RQGDUR type=del size=2817552 2024-09-12T00:17:31.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.334+0000 7febed3678c0 1 < suggested update operation key=MLPN8PH72VQ9 tag=NBRQM1HPDWMJ type=del size=2571003 2024-09-12T00:17:31.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.334+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=8BVMJCZWKJI1 type=del size=1795087 2024-09-12T00:17:31.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.338+0000 7febed3678c0 1 < canceled operation key=VU1AF57EUA0R tag=NDP230UU1LBO type=del size=900011 2024-09-12T00:17:31.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.338+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=XOE6Z24MQ1YO type=write size=935786 2024-09-12T00:17:31.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.342+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~LQ69NB2TT9GG.0 size=653930 2024-09-12T00:17:31.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.346+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=LQ69NB2TT9GG tag=5T8AEFLOKJMK type=write size=1702506 2024-09-12T00:17:31.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.346+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=YQ8XIPCTFRJS type=del size=3036362 2024-09-12T00:17:31.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.350+0000 7febed3678c0 1 < suggested remove operation key=W2VEW3JJEJY7 tag=6XPXY8XLM29R type=write 2024-09-12T00:17:31.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.354+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=N9HILZ5LBCFK type=del size=605604 2024-09-12T00:17:31.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.358+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=XVE2J545WS9N type=del 2024-09-12T00:17:31.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.362+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~39X39QYS2Y9L.0 size=1048576 2024-09-12T00:17:31.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.362+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~39X39QYS2Y9L.1 size=1048576 2024-09-12T00:17:31.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.366+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~39X39QYS2Y9L.2 size=248680 2024-09-12T00:17:31.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.366+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=39X39QYS2Y9L tag=EC9JC0848MY9 type=write size=3394408 2024-09-12T00:17:31.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.370+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~XL6RCGYZ9OYL.0 size=71618 2024-09-12T00:17:31.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.374+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=XL6RCGYZ9OYL tag=UQND1UOFWLEI type=write size=1120194 2024-09-12T00:17:31.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.374+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=0F363794L27M type=del size=854215 2024-09-12T00:17:31.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.382+0000 7febed3678c0 1 < suggested remove operation key=53T1415UK7GE tag=A6IZ1HU60N34 type=del 2024-09-12T00:17:31.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.386+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~TEZF6F8QALAG.0 size=1048576 2024-09-12T00:17:31.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.386+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~TEZF6F8QALAG.1 size=1048576 2024-09-12T00:17:31.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.390+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~TEZF6F8QALAG.2 size=816178 2024-09-12T00:17:31.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.390+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=TEZF6F8QALAG tag=LD2ZVEJZRJP3 type=write size=3961906 2024-09-12T00:17:31.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.394+0000 7febed3678c0 -1 < failed to complete operation key=W2VEW3JJEJY7 tag=1M9SQUX533IS type=write size=714922: (22) Invalid argument 2024-09-12T00:17:31.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.394+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=7MZ0R1MUGNJZ type=del size=2445025 2024-09-12T00:17:31.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.398+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~EHCR10FZEODC.0 size=1048576 2024-09-12T00:17:31.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.402+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~EHCR10FZEODC.1 size=274103 2024-09-12T00:17:31.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.406+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=EHCR10FZEODC tag=J3EEYHY24E14 type=write size=2371255 2024-09-12T00:17:31.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.410+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~N23ZN5CMHNZI.0 size=190444 2024-09-12T00:17:31.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.410+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=N23ZN5CMHNZI tag=NXRV2Q251FUW type=write size=1239020 2024-09-12T00:17:31.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.410+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~P24WOC3MVWG3.0 size=1048576 2024-09-12T00:17:31.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.414+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~P24WOC3MVWG3.1 size=1048576 2024-09-12T00:17:31.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.418+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~P24WOC3MVWG3.2 size=758125 2024-09-12T00:17:31.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.422+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=P24WOC3MVWG3 tag=FDJN29T3FRSW type=write size=3903853 2024-09-12T00:17:31.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.426+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~VV0N1KM08MQW.0 size=1048576 2024-09-12T00:17:31.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.426+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~VV0N1KM08MQW.1 size=1023037 2024-09-12T00:17:31.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.426+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=VV0N1KM08MQW tag=D2AH20NEQI34 type=write size=3120189 2024-09-12T00:17:31.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.430+0000 7febed3678c0 -1 < failed to complete operation key=MHS307JKNVCK tag=9YCCSGW6TLXU type=del size=713272: (22) Invalid argument 2024-09-12T00:17:31.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.434+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~D25QSVYV9DHT.0 size=1048576 2024-09-12T00:17:31.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.434+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~D25QSVYV9DHT.1 size=1048576 2024-09-12T00:17:31.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.438+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~D25QSVYV9DHT.2 size=415072 2024-09-12T00:17:31.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.438+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=D25QSVYV9DHT tag=PNX3JD4K8ISQ type=write size=3560800 2024-09-12T00:17:31.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.438+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=16C9D7SD6SB6 type=del 2024-09-12T00:17:31.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.442+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=GID1FRRAGO1M type=del size=2138501 2024-09-12T00:17:31.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.446+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=DFPXPJFN1E0T type=del 2024-09-12T00:17:31.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.450+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~NU85NUTFBDF0.0 size=1048576 2024-09-12T00:17:31.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.450+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~NU85NUTFBDF0.1 size=1048576 2024-09-12T00:17:31.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.454+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~NU85NUTFBDF0.2 size=262513 2024-09-12T00:17:31.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.454+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=NU85NUTFBDF0 tag=CDBJ1IE3IZGE type=write size=3408241 2024-09-12T00:17:31.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.458+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=QHK1K1IOYQ97 type=del 2024-09-12T00:17:31.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.462+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~CURKUJJCW9NA.0 size=783474 2024-09-12T00:17:31.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.462+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=CURKUJJCW9NA tag=NUTYKV2FV6C0 type=write size=1832050 2024-09-12T00:17:31.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.466+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=8D7UHZHS9JCQ type=del 2024-09-12T00:17:31.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.470+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~OL9HOGRRIO09.0 size=776937 2024-09-12T00:17:31.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.470+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=OL9HOGRRIO09 tag=F4PB47R0M5PW type=write size=1825513 2024-09-12T00:17:31.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.474+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=W88U68RQGDUR type=del 2024-09-12T00:17:31.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.474+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=733U0GXH7SWB type=del size=3381416 2024-09-12T00:17:31.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.482+0000 7febed3678c0 1 < suggested remove operation key=ELNXYXX5ZWOW tag=8BVMJCZWKJI1 type=del 2024-09-12T00:17:31.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.486+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~TZ2FXOYR16JH.0 size=1048576 2024-09-12T00:17:31.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.486+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~TZ2FXOYR16JH.1 size=1048576 2024-09-12T00:17:31.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.490+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~TZ2FXOYR16JH.2 size=676298 2024-09-12T00:17:31.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.490+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=TZ2FXOYR16JH tag=KO9N68F22ZPI type=write size=3822026 2024-09-12T00:17:31.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.494+0000 7febed3678c0 1 < completed write operation key=MAZHOU2CEUCU tag=XOE6Z24MQ1YO type=write size=935786 2024-09-12T00:17:31.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.498+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~H2MCV3LYZ88Z.0 size=1048576 2024-09-12T00:17:31.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.498+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~H2MCV3LYZ88Z.1 size=1019796 2024-09-12T00:17:31.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.498+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=H2MCV3LYZ88Z tag=3S2SMSYXR28P type=write size=3116948 2024-09-12T00:17:31.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.502+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=YQ8XIPCTFRJS type=del 2024-09-12T00:17:31.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.506+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=P4ZXKNURTOI8 type=write size=739991 2024-09-12T00:17:31.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.510+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=N9HILZ5LBCFK type=del 2024-09-12T00:17:31.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.514+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~3XEVOMF2C5KR.0 size=1048576 2024-09-12T00:17:31.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.514+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~3XEVOMF2C5KR.1 size=1048576 2024-09-12T00:17:31.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.518+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~3XEVOMF2C5KR.2 size=121572 2024-09-12T00:17:31.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.518+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=3XEVOMF2C5KR tag=ZJZ01GKGBQAR type=write size=3267300 2024-09-12T00:17:31.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.518+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~39X39QYS2Y9L.0 size=1048576 2024-09-12T00:17:31.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.522+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~39X39QYS2Y9L.1 size=1048576 2024-09-12T00:17:31.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.526+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~39X39QYS2Y9L.2 size=248680 2024-09-12T00:17:31.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.530+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=39X39QYS2Y9L tag=EC9JC0848MY9 type=write size=3394408 2024-09-12T00:17:31.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.530+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=B39SY9R4SQM8 type=del size=714111 2024-09-12T00:17:31.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.534+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=0F363794L27M type=del 2024-09-12T00:17:31.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.538+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=QKNHO37QZQ7X type=del size=1625621 2024-09-12T00:17:31.539 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.542+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~TEZF6F8QALAG.0 size=1048576 2024-09-12T00:17:31.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.542+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~TEZF6F8QALAG.1 size=1048576 2024-09-12T00:17:31.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.546+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~TEZF6F8QALAG.2 size=816178 2024-09-12T00:17:31.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.550+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=TEZF6F8QALAG tag=LD2ZVEJZRJP3 type=write size=3961906 2024-09-12T00:17:31.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.554+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=D5WOOQGJKBGM type=del size=1698114 2024-09-12T00:17:31.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.558+0000 7febed3678c0 1 < suggested remove operation key=RGQ4KY26RKYI tag=7MZ0R1MUGNJZ type=del 2024-09-12T00:17:31.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.562+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=7ORFUK3198M5 type=write size=927627 2024-09-12T00:17:31.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.566+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~N23ZN5CMHNZI.0 size=190444 2024-09-12T00:17:31.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.570+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=N23ZN5CMHNZI tag=NXRV2Q251FUW type=write size=1239020 2024-09-12T00:17:31.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.570+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=IB2ZZ4G1UVXR type=del size=466632 2024-09-12T00:17:31.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.574+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~VV0N1KM08MQW.0 size=1048576 2024-09-12T00:17:31.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.578+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~VV0N1KM08MQW.1 size=1023037 2024-09-12T00:17:31.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.582+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=VV0N1KM08MQW tag=D2AH20NEQI34 type=write size=3120189 2024-09-12T00:17:31.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.582+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=63B36T16TT45 type=del size=3415691 2024-09-12T00:17:31.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.586+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~D25QSVYV9DHT.0 size=1048576 2024-09-12T00:17:31.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.590+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~D25QSVYV9DHT.1 size=1048576 2024-09-12T00:17:31.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.590+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~D25QSVYV9DHT.2 size=415072 2024-09-12T00:17:31.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.594+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=D25QSVYV9DHT tag=PNX3JD4K8ISQ type=write size=3560800 2024-09-12T00:17:31.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.598+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=6ODILRKI5Z7A type=del size=1933473 2024-09-12T00:17:31.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.602+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=GID1FRRAGO1M type=del 2024-09-12T00:17:31.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.606+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=D2PN7FRQY8E6 type=del size=3047155 2024-09-12T00:17:31.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.606+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~NU85NUTFBDF0.0 size=1048576 2024-09-12T00:17:31.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.610+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~NU85NUTFBDF0.1 size=1048576 2024-09-12T00:17:31.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.614+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~NU85NUTFBDF0.2 size=262513 2024-09-12T00:17:31.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.622+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=NU85NUTFBDF0 tag=CDBJ1IE3IZGE type=write size=3408241 2024-09-12T00:17:31.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.622+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=7JVZ50AWRNIJ type=del size=2338352 2024-09-12T00:17:31.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.626+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~CURKUJJCW9NA.0 size=783474 2024-09-12T00:17:31.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.630+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=CURKUJJCW9NA tag=NUTYKV2FV6C0 type=write size=1832050 2024-09-12T00:17:31.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.634+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=03549VQZ6USQ type=del size=1715853 2024-09-12T00:17:31.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.638+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~OL9HOGRRIO09.0 size=776937 2024-09-12T00:17:31.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.642+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=OL9HOGRRIO09 tag=F4PB47R0M5PW type=write size=1825513 2024-09-12T00:17:31.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.646+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=2X9UOZ9238NY type=del size=2731669 2024-09-12T00:17:31.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.646+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=733U0GXH7SWB type=del 2024-09-12T00:17:31.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.654+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~FQS5H14X17GV.0 size=283281 2024-09-12T00:17:31.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.654+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=FQS5H14X17GV tag=51CC5V59KSI9 type=write size=1331857 2024-09-12T00:17:31.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.654+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~TZ2FXOYR16JH.0 size=1048576 2024-09-12T00:17:31.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.658+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~TZ2FXOYR16JH.1 size=1048576 2024-09-12T00:17:31.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.662+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~TZ2FXOYR16JH.2 size=676298 2024-09-12T00:17:31.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.666+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=TZ2FXOYR16JH tag=KO9N68F22ZPI type=write size=3822026 2024-09-12T00:17:31.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.670+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=4KU2H66GTOX3 type=write size=49337 2024-09-12T00:17:31.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.670+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~H2MCV3LYZ88Z.0 size=1048576 2024-09-12T00:17:31.672 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.674+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~H2MCV3LYZ88Z.1 size=1019796 2024-09-12T00:17:31.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.678+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=H2MCV3LYZ88Z tag=3S2SMSYXR28P type=write size=3116948 2024-09-12T00:17:31.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.682+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~RPHULLTX8I3O.0 size=1048576 2024-09-12T00:17:31.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.686+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~RPHULLTX8I3O.1 size=1048576 2024-09-12T00:17:31.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.686+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~RPHULLTX8I3O.2 size=835618 2024-09-12T00:17:31.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.686+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=RPHULLTX8I3O tag=5YX94YC1XZLP type=write size=3981346 2024-09-12T00:17:31.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.690+0000 7febed3678c0 1 < completed write operation key=LGFKY0CP299H tag=P4ZXKNURTOI8 type=write size=739991 2024-09-12T00:17:31.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.694+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~NJ6R88P2C658.0 size=1048576 2024-09-12T00:17:31.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.698+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~NJ6R88P2C658.1 size=928729 2024-09-12T00:17:31.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.698+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=NJ6R88P2C658 tag=5E9CFIXFRXSK type=write size=3025881 2024-09-12T00:17:31.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.702+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~3XEVOMF2C5KR.0 size=1048576 2024-09-12T00:17:31.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.702+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~3XEVOMF2C5KR.1 size=1048576 2024-09-12T00:17:31.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.706+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~3XEVOMF2C5KR.2 size=121572 2024-09-12T00:17:31.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.710+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=3XEVOMF2C5KR tag=ZJZ01GKGBQAR type=write size=3267300 2024-09-12T00:17:31.714 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.714+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=BH9PB6S1OPTG type=del size=3255094 2024-09-12T00:17:31.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.718+0000 7febed3678c0 1 < canceled operation key=AHTIFXX3SGK7 tag=B39SY9R4SQM8 type=del size=714111 2024-09-12T00:17:31.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.726+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~B6NDLEEI9ILX.0 size=965981 2024-09-12T00:17:31.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.726+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=B6NDLEEI9ILX tag=GV0MXJXLMQNA type=write size=2014557 2024-09-12T00:17:31.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.730+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=QKNHO37QZQ7X type=del 2024-09-12T00:17:31.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.734+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~Y0Z4RH0QKZD1.0 size=962198 2024-09-12T00:17:31.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.734+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=Y0Z4RH0QKZD1 tag=D1VTD3ZAHG0N type=write size=2010774 2024-09-12T00:17:31.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.738+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=D5WOOQGJKBGM type=del 2024-09-12T00:17:31.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.742+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~UIR7OWXALDAS.0 size=584122 2024-09-12T00:17:31.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.742+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=UIR7OWXALDAS tag=VK1UC3XXYKS6 type=write size=1632698 2024-09-12T00:17:31.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.746+0000 7febed3678c0 1 < completed write operation key=VW69JRC5JYX5 tag=7ORFUK3198M5 type=write size=927627 2024-09-12T00:17:31.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.750+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=2IXAUFARR0E0 type=del size=2918348 2024-09-12T00:17:31.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.758+0000 7febed3678c0 1 < suggested remove operation key=9CBI4FHAT3H2 tag=IB2ZZ4G1UVXR type=del 2024-09-12T00:17:31.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.762+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=MQMDPA2KKHHH type=del size=2420006 2024-09-12T00:17:31.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.766+0000 7febed3678c0 1 < suggested remove operation key=LGFKY0CP299H tag=63B36T16TT45 type=del 2024-09-12T00:17:31.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.770+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=IQJLM3XSOO0R type=del size=1890493 2024-09-12T00:17:31.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.774+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=6ODILRKI5Z7A type=del 2024-09-12T00:17:31.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.782+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~7ZD4CTNZFFNX.0 size=1048576 2024-09-12T00:17:31.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.786+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~7ZD4CTNZFFNX.1 size=1048576 2024-09-12T00:17:31.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.786+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~7ZD4CTNZFFNX.2 size=762321 2024-09-12T00:17:31.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.786+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=7ZD4CTNZFFNX tag=NXG5STPG51RL type=write size=3908049 2024-09-12T00:17:31.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.790+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=D2PN7FRQY8E6 type=del 2024-09-12T00:17:31.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.798+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~C8E24KK9QUW7.0 size=1048576 2024-09-12T00:17:31.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.802+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~C8E24KK9QUW7.1 size=1048576 2024-09-12T00:17:31.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.802+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~C8E24KK9QUW7.2 size=298971 2024-09-12T00:17:31.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.802+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=C8E24KK9QUW7 tag=OECYEK5R0W02 type=write size=3444699 2024-09-12T00:17:31.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.810+0000 7febed3678c0 1 < suggested remove operation key=AHTIFXX3SGK7 tag=7JVZ50AWRNIJ type=del 2024-09-12T00:17:31.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.814+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=9JA4G2NW4IER type=del size=3765764 2024-09-12T00:17:31.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.814+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=03549VQZ6USQ type=del 2024-09-12T00:17:31.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.822+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~09WHKWK22A2W.0 size=586191 2024-09-12T00:17:31.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.822+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=09WHKWK22A2W tag=GW4QRDNT28XU type=write size=1634767 2024-09-12T00:17:31.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.826+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=2X9UOZ9238NY type=del 2024-09-12T00:17:31.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.830+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~QBIUALW06W9X.0 size=1048576 2024-09-12T00:17:31.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.834+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~QBIUALW06W9X.1 size=1048576 2024-09-12T00:17:31.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.834+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~QBIUALW06W9X.2 size=225140 2024-09-12T00:17:31.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.834+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=QBIUALW06W9X tag=AVXDOLQUWV1R type=write size=3370868 2024-09-12T00:17:31.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.834+0000 7febed3678c0 1 < canceled part key=_multipart_CIOINUP503WY.2~FQS5H14X17GV.0 size=283281 2024-09-12T00:17:31.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.842+0000 7febed3678c0 1 < canceled multipart upload key=CIOINUP503WY upload=FQS5H14X17GV tag=51CC5V59KSI9 type=write size=1331857 2024-09-12T00:17:31.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.846+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=TQ2827O6LYXH type=del size=2174050 2024-09-12T00:17:31.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.846+0000 7febed3678c0 -1 < failed to complete operation key=LGFKY0CP299H tag=4KU2H66GTOX3 type=write size=49337: (22) Invalid argument 2024-09-12T00:17:31.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.854+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~XPX987257E1V.0 size=1048576 2024-09-12T00:17:31.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.854+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~XPX987257E1V.1 size=1048576 2024-09-12T00:17:31.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.858+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~XPX987257E1V.2 size=42767 2024-09-12T00:17:31.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.858+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=XPX987257E1V tag=HIUVCWFBUFDV type=write size=3188495 2024-09-12T00:17:31.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.862+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~RPHULLTX8I3O.0 size=1048576 2024-09-12T00:17:31.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.862+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~RPHULLTX8I3O.1 size=1048576 2024-09-12T00:17:31.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.866+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~RPHULLTX8I3O.2 size=835618 2024-09-12T00:17:31.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.870+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=RPHULLTX8I3O tag=5YX94YC1XZLP type=write size=3981346 2024-09-12T00:17:31.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.878+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~R7TCZXFRT8LG.0 size=1048576 2024-09-12T00:17:31.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.882+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~R7TCZXFRT8LG.1 size=960755 2024-09-12T00:17:31.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.882+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=R7TCZXFRT8LG tag=N7R5GULGNR0K type=write size=3057907 2024-09-12T00:17:31.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.882+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~NJ6R88P2C658.0 size=1048576 2024-09-12T00:17:31.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.886+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~NJ6R88P2C658.1 size=928729 2024-09-12T00:17:31.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.890+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=NJ6R88P2C658 tag=5E9CFIXFRXSK type=write size=3025881 2024-09-12T00:17:31.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.894+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=VXCAYYD0XMQC type=del size=650275 2024-09-12T00:17:31.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.898+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=BH9PB6S1OPTG type=del 2024-09-12T00:17:31.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.902+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=PLZA7LMEA8CF type=del size=2402182 2024-09-12T00:17:31.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.910+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~B6NDLEEI9ILX.0 size=965981 2024-09-12T00:17:31.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.914+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=B6NDLEEI9ILX tag=GV0MXJXLMQNA type=write size=2014557 2024-09-12T00:17:31.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.922+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~2ONIP6UF4PGM.0 size=67227 2024-09-12T00:17:31.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.922+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=2ONIP6UF4PGM tag=G59EUDDI0SCE type=write size=1115803 2024-09-12T00:17:31.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.926+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~Y0Z4RH0QKZD1.0 size=962198 2024-09-12T00:17:31.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.930+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=Y0Z4RH0QKZD1 tag=D1VTD3ZAHG0N type=write size=2010774 2024-09-12T00:17:31.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.934+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=S1C0UG08MHBP type=del size=2334439 2024-09-12T00:17:31.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.934+0000 7febed3678c0 1 < canceled part key=_multipart_VU1AF57EUA0R.2~UIR7OWXALDAS.0 size=584122 2024-09-12T00:17:31.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.942+0000 7febed3678c0 1 < canceled multipart upload key=VU1AF57EUA0R upload=UIR7OWXALDAS tag=VK1UC3XXYKS6 type=write size=1632698 2024-09-12T00:17:31.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.946+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~UKBX8JAY6YK8.0 size=800671 2024-09-12T00:17:31.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.946+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=UKBX8JAY6YK8 tag=V9IZYSTYCZSU type=write size=1849247 2024-09-12T00:17:31.949 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.950+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=2IXAUFARR0E0 type=del 2024-09-12T00:17:31.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.954+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=9N1MLLIZ8MAI type=del size=233796 2024-09-12T00:17:31.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.954+0000 7febed3678c0 1 < canceled operation key=VW69JRC5JYX5 tag=MQMDPA2KKHHH type=del size=2420006 2024-09-12T00:17:31.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.962+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~4OFOMKIAJV1Z.0 size=1048576 2024-09-12T00:17:31.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.962+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~4OFOMKIAJV1Z.1 size=347671 2024-09-12T00:17:31.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.962+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=4OFOMKIAJV1Z tag=52T2TKHYWH0D type=write size=2444823 2024-09-12T00:17:31.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.966+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=IQJLM3XSOO0R type=del 2024-09-12T00:17:31.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.970+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=UXXXUNSB4S10 type=del size=2334708 2024-09-12T00:17:31.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.974+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~7ZD4CTNZFFNX.0 size=1048576 2024-09-12T00:17:31.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.978+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~7ZD4CTNZFFNX.1 size=1048576 2024-09-12T00:17:31.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.978+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~7ZD4CTNZFFNX.2 size=762321 2024-09-12T00:17:31.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.982+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=7ZD4CTNZFFNX tag=NXG5STPG51RL type=write size=3908049 2024-09-12T00:17:31.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.986+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=UNMR3Q6KOF3F type=del size=3983792 2024-09-12T00:17:31.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.990+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~C8E24KK9QUW7.0 size=1048576 2024-09-12T00:17:31.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.994+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~C8E24KK9QUW7.1 size=1048576 2024-09-12T00:17:31.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.994+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~C8E24KK9QUW7.2 size=298971 2024-09-12T00:17:31.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:31.998+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=C8E24KK9QUW7 tag=OECYEK5R0W02 type=write size=3444699 2024-09-12T00:17:32.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.002+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=DQQZ71ST0LVJ type=del size=2215998 2024-09-12T00:17:32.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.006+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=9JA4G2NW4IER type=del 2024-09-12T00:17:32.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.010+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~EWN96A2NYFXY.0 size=1048576 2024-09-12T00:17:32.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.014+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~EWN96A2NYFXY.1 size=49896 2024-09-12T00:17:32.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.014+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=EWN96A2NYFXY tag=ZXVYDYGORG1O type=write size=2147048 2024-09-12T00:17:32.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.014+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~09WHKWK22A2W.0 size=586191 2024-09-12T00:17:32.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.022+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=09WHKWK22A2W tag=GW4QRDNT28XU type=write size=1634767 2024-09-12T00:17:32.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.026+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~CV8JGKJLMVXQ.0 size=1048576 2024-09-12T00:17:32.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.030+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~CV8JGKJLMVXQ.1 size=610642 2024-09-12T00:17:32.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.030+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=CV8JGKJLMVXQ tag=9LR5Z118TXI0 type=write size=2707794 2024-09-12T00:17:32.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.034+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~QBIUALW06W9X.0 size=1048576 2024-09-12T00:17:32.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.034+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~QBIUALW06W9X.1 size=1048576 2024-09-12T00:17:32.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.038+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~QBIUALW06W9X.2 size=225140 2024-09-12T00:17:32.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.042+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=QBIUALW06W9X tag=AVXDOLQUWV1R type=write size=3370868 2024-09-12T00:17:32.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.050+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~30C41EELWR9F.0 size=505882 2024-09-12T00:17:32.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.050+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=30C41EELWR9F tag=V5OX36XAKOAG type=write size=1554458 2024-09-12T00:17:32.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.050+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=TQ2827O6LYXH type=del 2024-09-12T00:17:32.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.054+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=XP23CIIIYHRU type=del size=2263085 2024-09-12T00:17:32.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.058+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~XPX987257E1V.0 size=1048576 2024-09-12T00:17:32.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.058+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~XPX987257E1V.1 size=1048576 2024-09-12T00:17:32.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.062+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~XPX987257E1V.2 size=42767 2024-09-12T00:17:32.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.066+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=XPX987257E1V tag=HIUVCWFBUFDV type=write size=3188495 2024-09-12T00:17:32.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.070+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~GPNVHQVTGW4X.0 size=1048576 2024-09-12T00:17:32.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.074+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~GPNVHQVTGW4X.1 size=73496 2024-09-12T00:17:32.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.074+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=GPNVHQVTGW4X tag=ZHMFN0ZPD4AC type=write size=2170648 2024-09-12T00:17:32.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.074+0000 7febed3678c0 1 < canceled part key=_multipart_KLO47UYYACLU.2~R7TCZXFRT8LG.0 size=1048576 2024-09-12T00:17:32.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.078+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~R7TCZXFRT8LG.1 size=960755 2024-09-12T00:17:32.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.082+0000 7febed3678c0 1 < canceled multipart upload key=KLO47UYYACLU upload=R7TCZXFRT8LG tag=N7R5GULGNR0K type=write size=3057907 2024-09-12T00:17:32.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.086+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~OFFGXUQ0AYPT.0 size=1048576 2024-09-12T00:17:32.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.090+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~OFFGXUQ0AYPT.1 size=636458 2024-09-12T00:17:32.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.090+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=OFFGXUQ0AYPT tag=C9NYFVMVYYI6 type=write size=2733610 2024-09-12T00:17:32.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.094+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=VXCAYYD0XMQC type=del 2024-09-12T00:17:32.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.098+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=N54IGI7Y48RG type=del size=3626058 2024-09-12T00:17:32.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.098+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=PLZA7LMEA8CF type=del 2024-09-12T00:17:32.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.106+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~XJBI4DM6Y058.0 size=1048576 2024-09-12T00:17:32.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.106+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~XJBI4DM6Y058.1 size=617063 2024-09-12T00:17:32.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.106+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=XJBI4DM6Y058 tag=P5VHAY251K0F type=write size=2714215 2024-09-12T00:17:32.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.110+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~2ONIP6UF4PGM.0 size=67227 2024-09-12T00:17:32.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.114+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=2ONIP6UF4PGM tag=G59EUDDI0SCE type=write size=1115803 2024-09-12T00:17:32.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.118+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=GW5DIP2RCNFU type=del size=1673450 2024-09-12T00:17:32.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.122+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=S1C0UG08MHBP type=del 2024-09-12T00:17:32.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.126+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~WDES8Z5E8GXT.0 size=772068 2024-09-12T00:17:32.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.126+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=WDES8Z5E8GXT tag=404C9Z24KI8X type=write size=1820644 2024-09-12T00:17:32.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.130+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~UKBX8JAY6YK8.0 size=800671 2024-09-12T00:17:32.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.138+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=UKBX8JAY6YK8 tag=V9IZYSTYCZSU type=write size=1849247 2024-09-12T00:17:32.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.138+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=5E0UAOH2S54A type=del size=1475171 2024-09-12T00:17:32.142 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.142+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=9N1MLLIZ8MAI type=del 2024-09-12T00:17:32.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.146+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=M5W2RL5UE8GG type=del size=2329889 2024-09-12T00:17:32.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.150+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~4OFOMKIAJV1Z.0 size=1048576 2024-09-12T00:17:32.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.154+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~4OFOMKIAJV1Z.1 size=347671 2024-09-12T00:17:32.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.158+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=4OFOMKIAJV1Z tag=52T2TKHYWH0D type=write size=2444823 2024-09-12T00:17:32.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.166+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~7R0HEL506HWZ.0 size=1048576 2024-09-12T00:17:32.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.166+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~7R0HEL506HWZ.1 size=532107 2024-09-12T00:17:32.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.166+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=7R0HEL506HWZ tag=36INTYZVC86Z type=write size=2629259 2024-09-12T00:17:32.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.174+0000 7febed3678c0 1 < suggested update operation key=VW69JRC5JYX5 tag=UXXXUNSB4S10 type=del size=2334708 2024-09-12T00:17:32.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.178+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=262ZEQEQWYMY type=del size=181586 2024-09-12T00:17:32.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.186+0000 7febed3678c0 1 < suggested remove operation key=Z020UV2JRR0I tag=UNMR3Q6KOF3F type=del 2024-09-12T00:17:32.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.186+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=WGZFGONPONAE type=del size=1444907 2024-09-12T00:17:32.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.190+0000 7febed3678c0 -1 < failed to complete operation key=Z020UV2JRR0I tag=DQQZ71ST0LVJ type=del size=2215998: (22) Invalid argument 2024-09-12T00:17:32.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.194+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=CTK6X4NI282K type=write size=127671 2024-09-12T00:17:32.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.202+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~EWN96A2NYFXY.0 size=1048576 2024-09-12T00:17:32.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.202+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~EWN96A2NYFXY.1 size=49896 2024-09-12T00:17:32.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.210+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=EWN96A2NYFXY tag=ZXVYDYGORG1O type=write size=2147048 2024-09-12T00:17:32.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.214+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~WFIFLF93RVBK.0 size=1048576 2024-09-12T00:17:32.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.218+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~WFIFLF93RVBK.1 size=838465 2024-09-12T00:17:32.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.218+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=WFIFLF93RVBK tag=N7BMF2EKWKU3 type=write size=2935617 2024-09-12T00:17:32.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.222+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~CV8JGKJLMVXQ.0 size=1048576 2024-09-12T00:17:32.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.222+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~CV8JGKJLMVXQ.1 size=610642 2024-09-12T00:17:32.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.230+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=CV8JGKJLMVXQ tag=9LR5Z118TXI0 type=write size=2707794 2024-09-12T00:17:32.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.234+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=7PX8XPWR0KE1 type=del size=810012 2024-09-12T00:17:32.235 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.234+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~30C41EELWR9F.0 size=505882 2024-09-12T00:17:32.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.242+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=30C41EELWR9F tag=V5OX36XAKOAG type=write size=1554458 2024-09-12T00:17:32.244 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.246+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=MCL22GJE2342 type=del size=2077257 2024-09-12T00:17:32.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.250+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=XP23CIIIYHRU type=del 2024-09-12T00:17:32.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.250+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=LRK82DG99E3K type=del size=4190513 2024-09-12T00:17:32.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.254+0000 7febed3678c0 1 < canceled part key=_multipart_4K65QIB9F00S.2~GPNVHQVTGW4X.0 size=1048576 2024-09-12T00:17:32.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.254+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~GPNVHQVTGW4X.1 size=73496 2024-09-12T00:17:32.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.262+0000 7febed3678c0 1 < canceled multipart upload key=4K65QIB9F00S upload=GPNVHQVTGW4X tag=ZHMFN0ZPD4AC type=write size=2170648 2024-09-12T00:17:32.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.266+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~LCP7E06P7ROK.0 size=1048576 2024-09-12T00:17:32.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.266+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~LCP7E06P7ROK.1 size=1048576 2024-09-12T00:17:32.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.270+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~LCP7E06P7ROK.2 size=237650 2024-09-12T00:17:32.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.270+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=LCP7E06P7ROK tag=12GI33CLHBKF type=write size=3383378 2024-09-12T00:17:32.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.270+0000 7febed3678c0 1 < canceled part key=_multipart_52SSW5KTCS15.2~OFFGXUQ0AYPT.0 size=1048576 2024-09-12T00:17:32.273 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.274+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~OFFGXUQ0AYPT.1 size=636458 2024-09-12T00:17:32.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.278+0000 7febed3678c0 1 < canceled multipart upload key=52SSW5KTCS15 upload=OFFGXUQ0AYPT tag=C9NYFVMVYYI6 type=write size=2733610 2024-09-12T00:17:32.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.282+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=O3EZS60OJHGZ type=del size=800568 2024-09-12T00:17:32.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.286+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=N54IGI7Y48RG type=del 2024-09-12T00:17:32.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.290+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~0YGMTFCTMGL4.0 size=1048576 2024-09-12T00:17:32.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.294+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~0YGMTFCTMGL4.1 size=535135 2024-09-12T00:17:32.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.294+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=0YGMTFCTMGL4 tag=GBJKENYCEV6U type=write size=2632287 2024-09-12T00:17:32.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.298+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~XJBI4DM6Y058.0 size=1048576 2024-09-12T00:17:32.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.298+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~XJBI4DM6Y058.1 size=617063 2024-09-12T00:17:32.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.306+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=XJBI4DM6Y058 tag=P5VHAY251K0F type=write size=2714215 2024-09-12T00:17:32.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.310+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~QB8SSQ1J6FRD.0 size=1048576 2024-09-12T00:17:32.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.314+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~QB8SSQ1J6FRD.1 size=606746 2024-09-12T00:17:32.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.314+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=QB8SSQ1J6FRD tag=OND64BKM0Q4Z type=write size=2703898 2024-09-12T00:17:32.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.314+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=GW5DIP2RCNFU type=del 2024-09-12T00:17:32.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.318+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=H14SX905TYRU type=write size=731565 2024-09-12T00:17:32.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.322+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~WDES8Z5E8GXT.0 size=772068 2024-09-12T00:17:32.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.326+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=WDES8Z5E8GXT tag=404C9Z24KI8X type=write size=1820644 2024-09-12T00:17:32.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.334+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~0M28J0G0LDXM.0 size=1048576 2024-09-12T00:17:32.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.334+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~0M28J0G0LDXM.1 size=1012608 2024-09-12T00:17:32.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.334+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=0M28J0G0LDXM tag=1Y1Z6U22O9T9 type=write size=3109760 2024-09-12T00:17:32.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.338+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=5E0UAOH2S54A type=del 2024-09-12T00:17:32.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.342+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~4FL2XO15CJST.0 size=1048576 2024-09-12T00:17:32.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.346+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~4FL2XO15CJST.1 size=429974 2024-09-12T00:17:32.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.346+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=4FL2XO15CJST tag=VFUOHZOW3PC3 type=write size=2527126 2024-09-12T00:17:32.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.350+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=M5W2RL5UE8GG type=del 2024-09-12T00:17:32.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.350+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=TYPMBG0IPHK6 type=del size=2292383 2024-09-12T00:17:32.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.354+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~7R0HEL506HWZ.0 size=1048576 2024-09-12T00:17:32.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.354+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~7R0HEL506HWZ.1 size=532107 2024-09-12T00:17:32.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.362+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=7R0HEL506HWZ tag=36INTYZVC86Z type=write size=2629259 2024-09-12T00:17:32.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.366+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~9IDZKT4MK7ZQ.0 size=1048576 2024-09-12T00:17:32.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.366+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~9IDZKT4MK7ZQ.1 size=626106 2024-09-12T00:17:32.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.366+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=9IDZKT4MK7ZQ tag=0FU844RA9LB8 type=write size=2723258 2024-09-12T00:17:32.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.370+0000 7febed3678c0 1 < canceled operation key=LWAMFA0RSW6S tag=262ZEQEQWYMY type=del size=181586 2024-09-12T00:17:32.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.374+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=SZQMXYYKZCCD type=del size=2452834 2024-09-12T00:17:32.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.378+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=WGZFGONPONAE type=del 2024-09-12T00:17:32.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.382+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~YUPXA3FNA38U.0 size=1048576 2024-09-12T00:17:32.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.382+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~YUPXA3FNA38U.1 size=81318 2024-09-12T00:17:32.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.382+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=YUPXA3FNA38U tag=DIB8F5QOE6R2 type=write size=2178470 2024-09-12T00:17:32.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.390+0000 7febed3678c0 1 < suggested remove operation key=53T1415UK7GE tag=CTK6X4NI282K type=write 2024-09-12T00:17:32.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.390+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=5GO0NMXN4DE5 type=del size=319088 2024-09-12T00:17:32.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.394+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~WFIFLF93RVBK.0 size=1048576 2024-09-12T00:17:32.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.398+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~WFIFLF93RVBK.1 size=838465 2024-09-12T00:17:32.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.402+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=WFIFLF93RVBK tag=N7BMF2EKWKU3 type=write size=2935617 2024-09-12T00:17:32.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.406+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=2V4P052YNAYY type=del size=597973 2024-09-12T00:17:32.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.406+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=7PX8XPWR0KE1 type=del 2024-09-12T00:17:32.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.410+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=ROF0P0WYNG4N type=del size=922510 2024-09-12T00:17:32.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.414+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=MCL22GJE2342 type=del 2024-09-12T00:17:32.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.414+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=SJ319PPHMR6I type=del size=1365737 2024-09-12T00:17:32.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.418+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=LRK82DG99E3K type=del 2024-09-12T00:17:32.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.426+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~X3SBKQ4MPID3.0 size=1048576 2024-09-12T00:17:32.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.426+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~X3SBKQ4MPID3.1 size=1048576 2024-09-12T00:17:32.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.430+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~X3SBKQ4MPID3.2 size=399681 2024-09-12T00:17:32.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.430+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=X3SBKQ4MPID3 tag=72H5CWNZ3K6K type=write size=3545409 2024-09-12T00:17:32.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.430+0000 7febed3678c0 1 < canceled part key=_multipart_AHTIFXX3SGK7.2~LCP7E06P7ROK.0 size=1048576 2024-09-12T00:17:32.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.430+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~LCP7E06P7ROK.1 size=1048576 2024-09-12T00:17:32.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.434+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~LCP7E06P7ROK.2 size=237650 2024-09-12T00:17:32.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.438+0000 7febed3678c0 1 < canceled multipart upload key=AHTIFXX3SGK7 upload=LCP7E06P7ROK tag=12GI33CLHBKF type=write size=3383378 2024-09-12T00:17:32.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.442+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=A3PSXVU3D8C3 type=del size=4116054 2024-09-12T00:17:32.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.446+0000 7febed3678c0 1 < suggested remove operation key=8RVDLW1VC8LP tag=O3EZS60OJHGZ type=del 2024-09-12T00:17:32.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.450+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~EF0P6NS0BWE8.0 size=963068 2024-09-12T00:17:32.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.450+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=EF0P6NS0BWE8 tag=SWR0AC3D5V10 type=write size=2011644 2024-09-12T00:17:32.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.454+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~0YGMTFCTMGL4.0 size=1048576 2024-09-12T00:17:32.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.454+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~0YGMTFCTMGL4.1 size=535135 2024-09-12T00:17:32.458 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.458+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=0YGMTFCTMGL4 tag=GBJKENYCEV6U type=write size=2632287 2024-09-12T00:17:32.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.462+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=F6I3001CHGTP type=del size=3166938 2024-09-12T00:17:32.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.466+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~QB8SSQ1J6FRD.0 size=1048576 2024-09-12T00:17:32.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.466+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~QB8SSQ1J6FRD.1 size=606746 2024-09-12T00:17:32.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.474+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=QB8SSQ1J6FRD tag=OND64BKM0Q4Z type=write size=2703898 2024-09-12T00:17:32.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.478+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=NNS7Y8LOCT94 type=write size=819266 2024-09-12T00:17:32.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.482+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=H14SX905TYRU type=write size=731565 2024-09-12T00:17:32.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.486+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=L2PTSCERBXUX type=del size=1973580 2024-09-12T00:17:32.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.486+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~0M28J0G0LDXM.0 size=1048576 2024-09-12T00:17:32.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.490+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~0M28J0G0LDXM.1 size=1012608 2024-09-12T00:17:32.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.494+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=0M28J0G0LDXM tag=1Y1Z6U22O9T9 type=write size=3109760 2024-09-12T00:17:32.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.494+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=FP2CGS0K237D type=del size=557535 2024-09-12T00:17:32.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.498+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~4FL2XO15CJST.0 size=1048576 2024-09-12T00:17:32.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.498+0000 7febed3678c0 1 < canceled part key=_multipart_53T1415UK7GE.2~4FL2XO15CJST.1 size=429974 2024-09-12T00:17:32.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.502+0000 7febed3678c0 1 < canceled multipart upload key=53T1415UK7GE upload=4FL2XO15CJST tag=VFUOHZOW3PC3 type=write size=2527126 2024-09-12T00:17:32.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.506+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~72E0Y08RUGBM.0 size=1048576 2024-09-12T00:17:32.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.506+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~72E0Y08RUGBM.1 size=1048576 2024-09-12T00:17:32.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.510+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~72E0Y08RUGBM.2 size=1013396 2024-09-12T00:17:32.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.510+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=72E0Y08RUGBM tag=X7DF44CW58VT type=write size=4159124 2024-09-12T00:17:32.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.514+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=TYPMBG0IPHK6 type=del 2024-09-12T00:17:32.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.514+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=LBSFYLBWM96P type=del size=3724159 2024-09-12T00:17:32.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.518+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~9IDZKT4MK7ZQ.0 size=1048576 2024-09-12T00:17:32.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.518+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~9IDZKT4MK7ZQ.1 size=626106 2024-09-12T00:17:32.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.522+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=9IDZKT4MK7ZQ tag=0FU844RA9LB8 type=write size=2723258 2024-09-12T00:17:32.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.526+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=T5AJONVEAT1T type=write size=747139 2024-09-12T00:17:32.529 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.530+0000 7febed3678c0 1 < canceled operation key=H017KWW59B8Z tag=SZQMXYYKZCCD type=del size=2452834 2024-09-12T00:17:32.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.534+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~F214D3JPR07Q.0 size=1048576 2024-09-12T00:17:32.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.538+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~F214D3JPR07Q.1 size=250872 2024-09-12T00:17:32.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.538+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=F214D3JPR07Q tag=RA16HIV8KZ7E type=write size=2348024 2024-09-12T00:17:32.539 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.538+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~YUPXA3FNA38U.0 size=1048576 2024-09-12T00:17:32.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.542+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~YUPXA3FNA38U.1 size=81318 2024-09-12T00:17:32.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.546+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=YUPXA3FNA38U tag=DIB8F5QOE6R2 type=write size=2178470 2024-09-12T00:17:32.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.550+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=VN961A3NWQDS type=del size=2277816 2024-09-12T00:17:32.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.554+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=5GO0NMXN4DE5 type=del 2024-09-12T00:17:32.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.558+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=73ARQXSTRURX type=write size=420203 2024-09-12T00:17:32.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.558+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=2V4P052YNAYY type=del 2024-09-12T00:17:32.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.562+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~3B0DO5FZR06F.0 size=1048576 2024-09-12T00:17:32.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.566+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~3B0DO5FZR06F.1 size=750592 2024-09-12T00:17:32.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.566+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=3B0DO5FZR06F tag=S3Q53H0O70IQ type=write size=2847744 2024-09-12T00:17:32.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.570+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=ROF0P0WYNG4N type=del 2024-09-12T00:17:32.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.570+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=0018ELVKA51C type=del size=2819883 2024-09-12T00:17:32.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.574+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=SJ319PPHMR6I type=del 2024-09-12T00:17:32.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.578+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~P0JFD6H68CJ0.0 size=1048576 2024-09-12T00:17:32.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.582+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~P0JFD6H68CJ0.1 size=1048576 2024-09-12T00:17:32.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.582+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~P0JFD6H68CJ0.2 size=826845 2024-09-12T00:17:32.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.582+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=P0JFD6H68CJ0 tag=40LRQUTLPS3T type=write size=3972573 2024-09-12T00:17:32.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.586+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~X3SBKQ4MPID3.0 size=1048576 2024-09-12T00:17:32.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.590+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~X3SBKQ4MPID3.1 size=1048576 2024-09-12T00:17:32.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.590+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~X3SBKQ4MPID3.2 size=399681 2024-09-12T00:17:32.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.594+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=X3SBKQ4MPID3 tag=72H5CWNZ3K6K type=write size=3545409 2024-09-12T00:17:32.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.598+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=LZHH98D1QNTG type=del size=1305365 2024-09-12T00:17:32.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.602+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=A3PSXVU3D8C3 type=del 2024-09-12T00:17:32.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.606+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~C2PWOWO8LKQW.0 size=1048576 2024-09-12T00:17:32.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.610+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~C2PWOWO8LKQW.1 size=1048576 2024-09-12T00:17:32.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.610+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~C2PWOWO8LKQW.2 size=1003073 2024-09-12T00:17:32.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.610+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=C2PWOWO8LKQW tag=V131TO3VNZPC type=write size=4148801 2024-09-12T00:17:32.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.614+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~EF0P6NS0BWE8.0 size=963068 2024-09-12T00:17:32.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.618+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=EF0P6NS0BWE8 tag=SWR0AC3D5V10 type=write size=2011644 2024-09-12T00:17:32.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.622+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=C10HLQ0HW703 type=del size=3174591 2024-09-12T00:17:32.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.622+0000 7febed3678c0 1 < canceled operation key=70W3V7TFBUFJ tag=F6I3001CHGTP type=del size=3166938 2024-09-12T00:17:32.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.630+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~LQVW82XZJEXG.0 size=1048576 2024-09-12T00:17:32.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.630+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~LQVW82XZJEXG.1 size=565644 2024-09-12T00:17:32.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.630+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=LQVW82XZJEXG tag=BVVCYQD04EB9 type=write size=2662796 2024-09-12T00:17:32.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.634+0000 7febed3678c0 1 < suggested remove operation key=Z020UV2JRR0I tag=NNS7Y8LOCT94 type=write 2024-09-12T00:17:32.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.638+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~4TXTDD9QLWP8.0 size=1048576 2024-09-12T00:17:32.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.642+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~4TXTDD9QLWP8.1 size=373123 2024-09-12T00:17:32.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.642+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=4TXTDD9QLWP8 tag=JDTL7CPFS245 type=write size=2470275 2024-09-12T00:17:32.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.646+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=L2PTSCERBXUX type=del 2024-09-12T00:17:32.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.650+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~JA05MKKJO951.0 size=1048576 2024-09-12T00:17:32.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.650+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~JA05MKKJO951.1 size=1048576 2024-09-12T00:17:32.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.654+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~JA05MKKJO951.2 size=704244 2024-09-12T00:17:32.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.654+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=JA05MKKJO951 tag=B8F1K3R2S24M type=write size=3849972 2024-09-12T00:17:32.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.658+0000 7febed3678c0 1 < canceled operation key=88BY5RHXSHD4 tag=FP2CGS0K237D type=del size=557535 2024-09-12T00:17:32.659 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.658+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=40ID6F2OX1UE type=del size=2163365 2024-09-12T00:17:32.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.662+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~72E0Y08RUGBM.0 size=1048576 2024-09-12T00:17:32.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.666+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~72E0Y08RUGBM.1 size=1048576 2024-09-12T00:17:32.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.666+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~72E0Y08RUGBM.2 size=1013396 2024-09-12T00:17:32.673 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.670+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=72E0Y08RUGBM tag=X7DF44CW58VT type=write size=4159124 2024-09-12T00:17:32.673 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.674+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=4DDTOJSHUFN5 type=del size=3304532 2024-09-12T00:17:32.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.678+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=LBSFYLBWM96P type=del 2024-09-12T00:17:32.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.682+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~W92ILKR3CWMX.0 size=1048576 2024-09-12T00:17:32.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.682+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~W92ILKR3CWMX.1 size=1048576 2024-09-12T00:17:32.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.686+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~W92ILKR3CWMX.2 size=49365 2024-09-12T00:17:32.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.686+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=W92ILKR3CWMX tag=CLM98TOCL0VZ type=write size=3195093 2024-09-12T00:17:32.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.686+0000 7febed3678c0 1 < canceled operation key=MLPN8PH72VQ9 tag=T5AJONVEAT1T type=write size=747139 2024-09-12T00:17:32.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.694+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~L4VGJMMQ9R5R.0 size=1048576 2024-09-12T00:17:32.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.694+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~L4VGJMMQ9R5R.1 size=696192 2024-09-12T00:17:32.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.694+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=L4VGJMMQ9R5R tag=VLPHE0GTB19U type=write size=2793344 2024-09-12T00:17:32.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.698+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~F214D3JPR07Q.0 size=1048576 2024-09-12T00:17:32.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.702+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~F214D3JPR07Q.1 size=250872 2024-09-12T00:17:32.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.706+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=F214D3JPR07Q tag=RA16HIV8KZ7E type=write size=2348024 2024-09-12T00:17:32.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.710+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=7UYW4KYHS3ZF type=del size=294747 2024-09-12T00:17:32.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.714+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=VN961A3NWQDS type=del 2024-09-12T00:17:32.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.718+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=ISQRMG5FS0A3 type=del size=464728 2024-09-12T00:17:32.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.718+0000 7febed3678c0 -1 < failed to complete operation key=Z020UV2JRR0I tag=73ARQXSTRURX type=write size=420203: (22) Invalid argument 2024-09-12T00:17:32.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.730+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~YTFMTZQ9JX56.0 size=367792 2024-09-12T00:17:32.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.730+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=YTFMTZQ9JX56 tag=RJ3DKCLOT3OX type=write size=1416368 2024-09-12T00:17:32.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.734+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~3B0DO5FZR06F.0 size=1048576 2024-09-12T00:17:32.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.738+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~3B0DO5FZR06F.1 size=750592 2024-09-12T00:17:32.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.742+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=3B0DO5FZR06F tag=S3Q53H0O70IQ type=write size=2847744 2024-09-12T00:17:32.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.746+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=K84IIWV1MHUM type=del size=1184759 2024-09-12T00:17:32.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.750+0000 7febed3678c0 1 < suggested update operation key=9CBI4FHAT3H2 tag=0018ELVKA51C type=del size=2819883 2024-09-12T00:17:32.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.754+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=1TQT0ICQO5SX type=del size=2671775 2024-09-12T00:17:32.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.758+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~P0JFD6H68CJ0.0 size=1048576 2024-09-12T00:17:32.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.762+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~P0JFD6H68CJ0.1 size=1048576 2024-09-12T00:17:32.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.762+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~P0JFD6H68CJ0.2 size=826845 2024-09-12T00:17:32.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.770+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=P0JFD6H68CJ0 tag=40LRQUTLPS3T type=write size=3972573 2024-09-12T00:17:32.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.774+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~2PRXGMYG2QBD.0 size=1048576 2024-09-12T00:17:32.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.778+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~2PRXGMYG2QBD.1 size=130977 2024-09-12T00:17:32.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.778+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=2PRXGMYG2QBD tag=VYNZ6O61MR2P type=write size=2228129 2024-09-12T00:17:32.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.778+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=LZHH98D1QNTG type=del 2024-09-12T00:17:32.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.786+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~S34EQFCSVCNS.0 size=1048576 2024-09-12T00:17:32.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.786+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~S34EQFCSVCNS.1 size=1048576 2024-09-12T00:17:32.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.790+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~S34EQFCSVCNS.2 size=499389 2024-09-12T00:17:32.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.790+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=S34EQFCSVCNS tag=34YNZ4AIUROY type=write size=3645117 2024-09-12T00:17:32.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.794+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~C2PWOWO8LKQW.0 size=1048576 2024-09-12T00:17:32.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.798+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~C2PWOWO8LKQW.1 size=1048576 2024-09-12T00:17:32.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.798+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~C2PWOWO8LKQW.2 size=1003073 2024-09-12T00:17:32.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.806+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=C2PWOWO8LKQW tag=V131TO3VNZPC type=write size=4148801 2024-09-12T00:17:32.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.810+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~VLM42CC7F1X8.0 size=1048576 2024-09-12T00:17:32.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.814+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~VLM42CC7F1X8.1 size=944047 2024-09-12T00:17:32.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.814+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=VLM42CC7F1X8 tag=VDGU2F8T1YES type=write size=3041199 2024-09-12T00:17:32.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.818+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=C10HLQ0HW703 type=del 2024-09-12T00:17:32.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.822+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~XNCXUHUVW4MS.0 size=1048576 2024-09-12T00:17:32.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.826+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~XNCXUHUVW4MS.1 size=1048576 2024-09-12T00:17:32.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.830+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~XNCXUHUVW4MS.2 size=350937 2024-09-12T00:17:32.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.830+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=XNCXUHUVW4MS tag=JBWJV778ZQ9R type=write size=3496665 2024-09-12T00:17:32.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.834+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~LQVW82XZJEXG.0 size=1048576 2024-09-12T00:17:32.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.834+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~LQVW82XZJEXG.1 size=565644 2024-09-12T00:17:32.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.842+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=LQVW82XZJEXG tag=BVVCYQD04EB9 type=write size=2662796 2024-09-12T00:17:32.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.850+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~BVIOV3Y6P70I.0 size=557920 2024-09-12T00:17:32.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.850+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=BVIOV3Y6P70I tag=VIVX51WZ0Z3O type=write size=1606496 2024-09-12T00:17:32.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.854+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~4TXTDD9QLWP8.0 size=1048576 2024-09-12T00:17:32.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.854+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~4TXTDD9QLWP8.1 size=373123 2024-09-12T00:17:32.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.862+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=4TXTDD9QLWP8 tag=JDTL7CPFS245 type=write size=2470275 2024-09-12T00:17:32.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.866+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=33LYPDVPTI1B type=del size=1534191 2024-09-12T00:17:32.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.866+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~JA05MKKJO951.0 size=1048576 2024-09-12T00:17:32.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.870+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~JA05MKKJO951.1 size=1048576 2024-09-12T00:17:32.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.874+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~JA05MKKJO951.2 size=704244 2024-09-12T00:17:32.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.878+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=JA05MKKJO951 tag=B8F1K3R2S24M type=write size=3849972 2024-09-12T00:17:32.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.886+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~QR24KMHFEFFK.0 size=1048576 2024-09-12T00:17:32.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.890+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~QR24KMHFEFFK.1 size=1048576 2024-09-12T00:17:32.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.890+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~QR24KMHFEFFK.2 size=588867 2024-09-12T00:17:32.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.890+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=QR24KMHFEFFK tag=JIWZ0BIKJ62L type=write size=3734595 2024-09-12T00:17:32.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.894+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=40ID6F2OX1UE type=del 2024-09-12T00:17:32.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.898+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=WFNK8OQHZGWS type=del size=2781311 2024-09-12T00:17:32.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.906+0000 7febed3678c0 1 < suggested remove operation key=Z020UV2JRR0I tag=4DDTOJSHUFN5 type=del 2024-09-12T00:17:32.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.910+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~8NZITSTD4CGK.0 size=1048576 2024-09-12T00:17:32.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.914+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~8NZITSTD4CGK.1 size=126036 2024-09-12T00:17:32.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.914+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=8NZITSTD4CGK tag=B7IUCGGEUI09 type=write size=2223188 2024-09-12T00:17:32.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.918+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~W92ILKR3CWMX.0 size=1048576 2024-09-12T00:17:32.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.918+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~W92ILKR3CWMX.1 size=1048576 2024-09-12T00:17:32.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.922+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~W92ILKR3CWMX.2 size=49365 2024-09-12T00:17:32.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.930+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=W92ILKR3CWMX tag=CLM98TOCL0VZ type=write size=3195093 2024-09-12T00:17:32.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.934+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~29L47WNN0WB6.0 size=465457 2024-09-12T00:17:32.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.934+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=29L47WNN0WB6 tag=Z6P0VE1BA2E4 type=write size=1514033 2024-09-12T00:17:32.936 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.938+0000 7febed3678c0 1 < canceled part key=_multipart_VU1AF57EUA0R.2~L4VGJMMQ9R5R.0 size=1048576 2024-09-12T00:17:32.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.938+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~L4VGJMMQ9R5R.1 size=696192 2024-09-12T00:17:32.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.946+0000 7febed3678c0 1 < canceled multipart upload key=VU1AF57EUA0R upload=L4VGJMMQ9R5R tag=VLPHE0GTB19U type=write size=2793344 2024-09-12T00:17:32.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.950+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~8AWFM63NZDQ3.0 size=773 2024-09-12T00:17:32.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.950+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=8AWFM63NZDQ3 tag=0OSNSXG1AOGZ type=write size=1049349 2024-09-12T00:17:32.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.954+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=7UYW4KYHS3ZF type=del 2024-09-12T00:17:32.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.958+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=T2NAJ7DIU4WE type=del size=258203 2024-09-12T00:17:32.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.962+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=ISQRMG5FS0A3 type=del 2024-09-12T00:17:32.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.966+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=VNCDBMAFRM8Q type=del size=1126548 2024-09-12T00:17:32.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.970+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~YTFMTZQ9JX56.0 size=367792 2024-09-12T00:17:32.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.974+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=YTFMTZQ9JX56 tag=RJ3DKCLOT3OX type=write size=1416368 2024-09-12T00:17:32.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.978+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=SUQ4CVUZ35MN type=del size=955643 2024-09-12T00:17:32.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.982+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=K84IIWV1MHUM type=del 2024-09-12T00:17:32.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.990+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~I0367G1SXSZN.0 size=758778 2024-09-12T00:17:32.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.990+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=I0367G1SXSZN tag=1UE58UBWRUNF type=write size=1807354 2024-09-12T00:17:32.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:32.998+0000 7febed3678c0 1 < suggested update operation key=KABJD0GYBVF4 tag=1TQT0ICQO5SX type=del size=2671775 2024-09-12T00:17:33.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.002+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~I8N62XBVW0OY.0 size=73971 2024-09-12T00:17:33.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.002+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=I8N62XBVW0OY tag=K5OAUNLNIH13 type=write size=1122547 2024-09-12T00:17:33.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.006+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~2PRXGMYG2QBD.0 size=1048576 2024-09-12T00:17:33.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.006+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~2PRXGMYG2QBD.1 size=130977 2024-09-12T00:17:33.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.014+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=2PRXGMYG2QBD tag=VYNZ6O61MR2P type=write size=2228129 2024-09-12T00:17:33.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.018+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=7H8Q3Y32ES6A type=del size=1913165 2024-09-12T00:17:33.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.018+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~S34EQFCSVCNS.0 size=1048576 2024-09-12T00:17:33.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.022+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~S34EQFCSVCNS.1 size=1048576 2024-09-12T00:17:33.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.026+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~S34EQFCSVCNS.2 size=499389 2024-09-12T00:17:33.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.030+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=S34EQFCSVCNS tag=34YNZ4AIUROY type=write size=3645117 2024-09-12T00:17:33.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.038+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=UIPM1HQQALN1 type=del size=4157078 2024-09-12T00:17:33.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.042+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~VLM42CC7F1X8.0 size=1048576 2024-09-12T00:17:33.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.042+0000 7febed3678c0 1 < canceled part key=_multipart_HR9MVC82R7GL.2~VLM42CC7F1X8.1 size=944047 2024-09-12T00:17:33.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.046+0000 7febed3678c0 1 < canceled multipart upload key=HR9MVC82R7GL upload=VLM42CC7F1X8 tag=VDGU2F8T1YES type=write size=3041199 2024-09-12T00:17:33.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.050+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=M1JPHNZ90E7Y type=write size=27504 2024-09-12T00:17:33.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.054+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~XNCXUHUVW4MS.0 size=1048576 2024-09-12T00:17:33.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.054+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~XNCXUHUVW4MS.1 size=1048576 2024-09-12T00:17:33.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.058+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~XNCXUHUVW4MS.2 size=350937 2024-09-12T00:17:33.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.062+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=XNCXUHUVW4MS tag=JBWJV778ZQ9R type=write size=3496665 2024-09-12T00:17:33.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.066+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=Y9XBL11VGJL6 type=write size=124285 2024-09-12T00:17:33.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.070+0000 7febed3678c0 1 < canceled part key=_multipart_H017KWW59B8Z.2~BVIOV3Y6P70I.0 size=557920 2024-09-12T00:17:33.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.074+0000 7febed3678c0 1 < canceled multipart upload key=H017KWW59B8Z upload=BVIOV3Y6P70I tag=VIVX51WZ0Z3O type=write size=1606496 2024-09-12T00:17:33.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.078+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=CWJ2PV8MK1B0 type=del size=961510 2024-09-12T00:17:33.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.082+0000 7febed3678c0 -1 < failed to complete operation key=Z020UV2JRR0I tag=33LYPDVPTI1B type=del size=1534191: (22) Invalid argument 2024-09-12T00:17:33.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.082+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=21Q5U3UONOGG type=del size=2490398 2024-09-12T00:17:33.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.086+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~QR24KMHFEFFK.0 size=1048576 2024-09-12T00:17:33.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.090+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~QR24KMHFEFFK.1 size=1048576 2024-09-12T00:17:33.091 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.090+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~QR24KMHFEFFK.2 size=588867 2024-09-12T00:17:33.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.098+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=QR24KMHFEFFK tag=JIWZ0BIKJ62L type=write size=3734595 2024-09-12T00:17:33.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.102+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=Q0G59NJXW3Z9 type=del size=3217357 2024-09-12T00:17:33.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.106+0000 7febed3678c0 1 < canceled operation key=53T1415UK7GE tag=WFNK8OQHZGWS type=del size=2781311 2024-09-12T00:17:33.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.106+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=IXLD8AYTVE8Z type=write size=554491 2024-09-12T00:17:33.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.110+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~8NZITSTD4CGK.0 size=1048576 2024-09-12T00:17:33.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.114+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~8NZITSTD4CGK.1 size=126036 2024-09-12T00:17:33.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.118+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=8NZITSTD4CGK tag=B7IUCGGEUI09 type=write size=2223188 2024-09-12T00:17:33.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.122+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=CFQTEBMPPPID type=del size=3971744 2024-09-12T00:17:33.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.122+0000 7febed3678c0 1 < canceled part key=_multipart_ASFLGSKWYHG5.2~29L47WNN0WB6.0 size=465457 2024-09-12T00:17:33.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.126+0000 7febed3678c0 1 < canceled multipart upload key=ASFLGSKWYHG5 upload=29L47WNN0WB6 tag=Z6P0VE1BA2E4 type=write size=1514033 2024-09-12T00:17:33.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.130+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=0I7WGPMIHIC8 type=del size=2010702 2024-09-12T00:17:33.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.134+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~8AWFM63NZDQ3.0 size=773 2024-09-12T00:17:33.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.138+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=8AWFM63NZDQ3 tag=0OSNSXG1AOGZ type=write size=1049349 2024-09-12T00:17:33.142 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.142+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=FR4D6Z9CWY0W type=del size=2925950 2024-09-12T00:17:33.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.146+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=T2NAJ7DIU4WE type=del 2024-09-12T00:17:33.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.150+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~GKRISK5QTDM9.0 size=241689 2024-09-12T00:17:33.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.150+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=GKRISK5QTDM9 tag=0305IVBEWRVU type=write size=1290265 2024-09-12T00:17:33.159 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.158+0000 7febed3678c0 1 < suggested update operation key=H017KWW59B8Z tag=VNCDBMAFRM8Q type=del size=1126548 2024-09-12T00:17:33.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.166+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=HPVV53RID7XC type=write size=528904 2024-09-12T00:17:33.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.174+0000 7febed3678c0 1 < suggested remove operation key=1HABX7YZ491W tag=SUQ4CVUZ35MN type=del 2024-09-12T00:17:33.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.174+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=46P9F20HKK0J type=del size=2129367 2024-09-12T00:17:33.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.178+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~I0367G1SXSZN.0 size=758778 2024-09-12T00:17:33.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.186+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=I0367G1SXSZN tag=1UE58UBWRUNF type=write size=1807354 2024-09-12T00:17:33.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.194+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~XCHPX41OLK00.0 size=293342 2024-09-12T00:17:33.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.194+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=XCHPX41OLK00 tag=4P3TYAMD0K1F type=write size=1341918 2024-09-12T00:17:33.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.198+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~I8N62XBVW0OY.0 size=73971 2024-09-12T00:17:33.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.206+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=I8N62XBVW0OY tag=K5OAUNLNIH13 type=write size=1122547 2024-09-12T00:17:33.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.210+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~XZBS883MKXTN.0 size=1048576 2024-09-12T00:17:33.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.210+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~XZBS883MKXTN.1 size=1048576 2024-09-12T00:17:33.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.214+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~XZBS883MKXTN.2 size=182426 2024-09-12T00:17:33.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.214+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=XZBS883MKXTN tag=ESXM3EPD1A1I type=write size=3328154 2024-09-12T00:17:33.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.222+0000 7febed3678c0 1 < suggested remove operation key=LGFKY0CP299H tag=7H8Q3Y32ES6A type=del 2024-09-12T00:17:33.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.226+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~VV2WQGTXB70L.0 size=434928 2024-09-12T00:17:33.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.226+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=VV2WQGTXB70L tag=Y130UE03P6PY type=write size=1483504 2024-09-12T00:17:33.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.230+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=UIPM1HQQALN1 type=del 2024-09-12T00:17:33.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.234+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~VTMW5R4TN1IY.0 size=10350 2024-09-12T00:17:33.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.234+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=VTMW5R4TN1IY tag=4B1K85GF8VHC type=write size=1058926 2024-09-12T00:17:33.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.238+0000 7febed3678c0 -1 < failed to complete operation key=1HABX7YZ491W tag=M1JPHNZ90E7Y type=write size=27504: (22) Invalid argument 2024-09-12T00:17:33.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.242+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=O9UE0UQQJTU1 type=del size=4142875 2024-09-12T00:17:33.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.246+0000 7febed3678c0 1 < completed write operation key=ASFLGSKWYHG5 tag=Y9XBL11VGJL6 type=write size=124285 2024-09-12T00:17:33.246 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.246+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=ARAAWTENSHEV type=del size=3809313 2024-09-12T00:17:33.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.250+0000 7febed3678c0 -1 < failed to complete operation key=1HABX7YZ491W tag=CWJ2PV8MK1B0 type=del size=961510: (22) Invalid argument 2024-09-12T00:17:33.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.254+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=HWDQZ12K109L type=del size=2005056 2024-09-12T00:17:33.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.258+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=21Q5U3UONOGG type=del 2024-09-12T00:17:33.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.262+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~M970YPN8ME9T.0 size=1048576 2024-09-12T00:17:33.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.266+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~M970YPN8ME9T.1 size=771286 2024-09-12T00:17:33.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.266+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=M970YPN8ME9T tag=1V4Q00ANXFJW type=write size=2868438 2024-09-12T00:17:33.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.270+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=Q0G59NJXW3Z9 type=del 2024-09-12T00:17:33.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.274+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~GYDJ11IV1XT8.0 size=1048576 2024-09-12T00:17:33.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.278+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~GYDJ11IV1XT8.1 size=250023 2024-09-12T00:17:33.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.278+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=GYDJ11IV1XT8 tag=HJSRK9XIXL4V type=write size=2347175 2024-09-12T00:17:33.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.282+0000 7febed3678c0 1 < completed write operation key=3G9ABEEEDRI3 tag=IXLD8AYTVE8Z type=write size=554491 2024-09-12T00:17:33.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.286+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~3NWBXG41E12E.0 size=1048576 2024-09-12T00:17:33.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.290+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~3NWBXG41E12E.1 size=1048576 2024-09-12T00:17:33.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.290+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~3NWBXG41E12E.2 size=849069 2024-09-12T00:17:33.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.290+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=3NWBXG41E12E tag=LR3FYHBU7G3F type=write size=3994797 2024-09-12T00:17:33.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.298+0000 7febed3678c0 1 < suggested remove operation key=9CBI4FHAT3H2 tag=CFQTEBMPPPID type=del 2024-09-12T00:17:33.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.302+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=BIW2XEVNU8EK type=del size=2509478 2024-09-12T00:17:33.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.306+0000 7febed3678c0 1 < canceled operation key=70W3V7TFBUFJ tag=0I7WGPMIHIC8 type=del size=2010702 2024-09-12T00:17:33.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.306+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=F5HHDRFIO3NX type=del size=2308647 2024-09-12T00:17:33.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.310+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=FR4D6Z9CWY0W type=del 2024-09-12T00:17:33.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.314+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=HKO9H7SOT5FX type=del size=550204 2024-09-12T00:17:33.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.314+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~GKRISK5QTDM9.0 size=241689 2024-09-12T00:17:33.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.318+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=GKRISK5QTDM9 tag=0305IVBEWRVU type=write size=1290265 2024-09-12T00:17:33.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.326+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~UN8X9522CNDN.0 size=893749 2024-09-12T00:17:33.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.326+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=UN8X9522CNDN tag=U4V5IW7SEZ1L type=write size=1942325 2024-09-12T00:17:33.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.330+0000 7febed3678c0 1 < completed write operation key=Z020UV2JRR0I tag=HPVV53RID7XC type=write size=528904 2024-09-12T00:17:33.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.334+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~Q391OLJ8OYSH.0 size=1048576 2024-09-12T00:17:33.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.334+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~Q391OLJ8OYSH.1 size=846599 2024-09-12T00:17:33.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.334+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=Q391OLJ8OYSH tag=C62ZXKVIXG0B type=write size=2943751 2024-09-12T00:17:33.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.338+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=46P9F20HKK0J type=del 2024-09-12T00:17:33.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.342+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=39THJYU32IF6 type=write size=152349 2024-09-12T00:17:33.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.346+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~XCHPX41OLK00.0 size=293342 2024-09-12T00:17:33.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.350+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=XCHPX41OLK00 tag=4P3TYAMD0K1F type=write size=1341918 2024-09-12T00:17:33.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.354+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~3JEPAKF9WHHZ.0 size=1048576 2024-09-12T00:17:33.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.358+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~3JEPAKF9WHHZ.1 size=286903 2024-09-12T00:17:33.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.358+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=3JEPAKF9WHHZ tag=EMGN5BIFU7QT type=write size=2384055 2024-09-12T00:17:33.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.358+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~XZBS883MKXTN.0 size=1048576 2024-09-12T00:17:33.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.362+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~XZBS883MKXTN.1 size=1048576 2024-09-12T00:17:33.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.362+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~XZBS883MKXTN.2 size=182426 2024-09-12T00:17:33.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.366+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=XZBS883MKXTN tag=ESXM3EPD1A1I type=write size=3328154 2024-09-12T00:17:33.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.370+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=4Q9J6ZXSHSXT type=del size=3524953 2024-09-12T00:17:33.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.374+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~VV2WQGTXB70L.0 size=434928 2024-09-12T00:17:33.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.378+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=VV2WQGTXB70L tag=Y130UE03P6PY type=write size=1483504 2024-09-12T00:17:33.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.382+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~VR7P6U3OHC67.0 size=600023 2024-09-12T00:17:33.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.382+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=VR7P6U3OHC67 tag=JUFXJ19JXYWQ type=write size=1648599 2024-09-12T00:17:33.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.386+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~VTMW5R4TN1IY.0 size=10350 2024-09-12T00:17:33.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.390+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=VTMW5R4TN1IY tag=4B1K85GF8VHC type=write size=1058926 2024-09-12T00:17:33.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.394+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=W0O8WG93K5HU type=del size=3897440 2024-09-12T00:17:33.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.398+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=O9UE0UQQJTU1 type=del 2024-09-12T00:17:33.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.402+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~O2YWILWN9VZM.0 size=348343 2024-09-12T00:17:33.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.402+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=O2YWILWN9VZM tag=2LUC8FPBOU9V type=write size=1396919 2024-09-12T00:17:33.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.406+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=ARAAWTENSHEV type=del 2024-09-12T00:17:33.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.410+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=ZD0KO7IPVKDH type=del size=1230801 2024-09-12T00:17:33.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.414+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=HWDQZ12K109L type=del 2024-09-12T00:17:33.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.418+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~6BAZIA1AZLT3.0 size=1048576 2024-09-12T00:17:33.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.418+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~6BAZIA1AZLT3.1 size=835162 2024-09-12T00:17:33.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.418+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=6BAZIA1AZLT3 tag=1N4S6R5722MA type=write size=2932314 2024-09-12T00:17:33.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.422+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~M970YPN8ME9T.0 size=1048576 2024-09-12T00:17:33.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.426+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~M970YPN8ME9T.1 size=771286 2024-09-12T00:17:33.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.430+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=M970YPN8ME9T tag=1V4Q00ANXFJW type=write size=2868438 2024-09-12T00:17:33.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.434+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=ZPF1DBUJ2A46 type=write size=959696 2024-09-12T00:17:33.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.434+0000 7febed3678c0 1 < canceled part key=_multipart_LGFKY0CP299H.2~GYDJ11IV1XT8.0 size=1048576 2024-09-12T00:17:33.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.434+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~GYDJ11IV1XT8.1 size=250023 2024-09-12T00:17:33.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.442+0000 7febed3678c0 1 < canceled multipart upload key=LGFKY0CP299H upload=GYDJ11IV1XT8 tag=HJSRK9XIXL4V type=write size=2347175 2024-09-12T00:17:33.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.446+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~JQVUUPNKP21V.0 size=1048576 2024-09-12T00:17:33.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.446+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~JQVUUPNKP21V.1 size=957013 2024-09-12T00:17:33.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.446+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=JQVUUPNKP21V tag=FUSI9BH0T1AI type=write size=3054165 2024-09-12T00:17:33.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.450+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~3NWBXG41E12E.0 size=1048576 2024-09-12T00:17:33.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.454+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~3NWBXG41E12E.1 size=1048576 2024-09-12T00:17:33.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.454+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~3NWBXG41E12E.2 size=849069 2024-09-12T00:17:33.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.458+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=3NWBXG41E12E tag=LR3FYHBU7G3F type=write size=3994797 2024-09-12T00:17:33.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.462+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=D8M84CZNNNSF type=write size=938056 2024-09-12T00:17:33.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.466+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=BIW2XEVNU8EK type=del 2024-09-12T00:17:33.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.466+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=W3A70L1ME706 type=del size=1466388 2024-09-12T00:17:33.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.470+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=F5HHDRFIO3NX type=del 2024-09-12T00:17:33.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.474+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=G7EVIFVAR6AN type=del size=802833 2024-09-12T00:17:33.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.474+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=HKO9H7SOT5FX type=del 2024-09-12T00:17:33.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.478+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=PR57YVVLU91N type=del size=707421 2024-09-12T00:17:33.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.482+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~UN8X9522CNDN.0 size=893749 2024-09-12T00:17:33.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.486+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=UN8X9522CNDN tag=U4V5IW7SEZ1L type=write size=1942325 2024-09-12T00:17:33.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.486+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=WGOSWV172KMA type=del size=3919748 2024-09-12T00:17:33.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.490+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~Q391OLJ8OYSH.0 size=1048576 2024-09-12T00:17:33.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.490+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~Q391OLJ8OYSH.1 size=846599 2024-09-12T00:17:33.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.494+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=Q391OLJ8OYSH tag=C62ZXKVIXG0B type=write size=2943751 2024-09-12T00:17:33.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.498+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~3JGIWVNQHZD7.0 size=681840 2024-09-12T00:17:33.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.498+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=3JGIWVNQHZD7 tag=QYPUYINYIV20 type=write size=1730416 2024-09-12T00:17:33.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.502+0000 7febed3678c0 1 < completed write operation key=HR9MVC82R7GL tag=39THJYU32IF6 type=write size=152349 2024-09-12T00:17:33.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.502+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=V4ZLJULUT16R type=del size=3536330 2024-09-12T00:17:33.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.506+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~3JEPAKF9WHHZ.0 size=1048576 2024-09-12T00:17:33.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.510+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~3JEPAKF9WHHZ.1 size=286903 2024-09-12T00:17:33.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.514+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=3JEPAKF9WHHZ tag=EMGN5BIFU7QT type=write size=2384055 2024-09-12T00:17:33.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.514+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=YYOOH4CR0R31 type=del size=1546631 2024-09-12T00:17:33.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.518+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=4Q9J6ZXSHSXT type=del 2024-09-12T00:17:33.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.522+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=BHJSVMBCB0RC type=write size=245019 2024-09-12T00:17:33.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.522+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~VR7P6U3OHC67.0 size=600023 2024-09-12T00:17:33.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.526+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=VR7P6U3OHC67 tag=JUFXJ19JXYWQ type=write size=1648599 2024-09-12T00:17:33.529 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.530+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=ZS9IE16FS7K4 type=del size=3788679 2024-09-12T00:17:33.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.530+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=W0O8WG93K5HU type=del 2024-09-12T00:17:33.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.534+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=Q7O877CRHBV3 type=del size=1727281 2024-09-12T00:17:33.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.538+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~O2YWILWN9VZM.0 size=348343 2024-09-12T00:17:33.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.542+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=O2YWILWN9VZM tag=2LUC8FPBOU9V type=write size=1396919 2024-09-12T00:17:33.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.546+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~B4K3U8NEZOFT.0 size=1048576 2024-09-12T00:17:33.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.550+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~B4K3U8NEZOFT.1 size=1048576 2024-09-12T00:17:33.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.554+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~B4K3U8NEZOFT.2 size=41357 2024-09-12T00:17:33.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.554+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=B4K3U8NEZOFT tag=ZYN9HMES27V3 type=write size=3187085 2024-09-12T00:17:33.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.554+0000 7febed3678c0 1 < canceled operation key=W2VEW3JJEJY7 tag=ZD0KO7IPVKDH type=del size=1230801 2024-09-12T00:17:33.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.562+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~6A93ED4740HF.0 size=1048576 2024-09-12T00:17:33.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.562+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~6A93ED4740HF.1 size=1048576 2024-09-12T00:17:33.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.566+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~6A93ED4740HF.2 size=368658 2024-09-12T00:17:33.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.566+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=6A93ED4740HF tag=N4T2JVEX9SRD type=write size=3514386 2024-09-12T00:17:33.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.570+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~6BAZIA1AZLT3.0 size=1048576 2024-09-12T00:17:33.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.570+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~6BAZIA1AZLT3.1 size=835162 2024-09-12T00:17:33.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.574+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=6BAZIA1AZLT3 tag=1N4S6R5722MA type=write size=2932314 2024-09-12T00:17:33.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.578+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=6U2177EZL2WF type=del size=2656505 2024-09-12T00:17:33.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.578+0000 7febed3678c0 1 < canceled operation key=3G9ABEEEDRI3 tag=ZPF1DBUJ2A46 type=write size=959696 2024-09-12T00:17:33.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.582+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=6GMC0ZYN14UC type=del size=3484068 2024-09-12T00:17:33.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.586+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~JQVUUPNKP21V.0 size=1048576 2024-09-12T00:17:33.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.586+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~JQVUUPNKP21V.1 size=957013 2024-09-12T00:17:33.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.598+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=JQVUUPNKP21V tag=FUSI9BH0T1AI type=write size=3054165 2024-09-12T00:17:33.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.602+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~G2YH8ZJNY7DN.0 size=1048576 2024-09-12T00:17:33.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.606+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~G2YH8ZJNY7DN.1 size=1019765 2024-09-12T00:17:33.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.606+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=G2YH8ZJNY7DN tag=EVNID0JZ8FU6 type=write size=3116917 2024-09-12T00:17:33.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.610+0000 7febed3678c0 1 < completed write operation key=MHS307JKNVCK tag=D8M84CZNNNSF type=write size=938056 2024-09-12T00:17:33.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.610+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=LLGGVT62SLJ6 type=write size=280540 2024-09-12T00:17:33.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.614+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=W3A70L1ME706 type=del 2024-09-12T00:17:33.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.618+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=C26MQO7RBOD0 type=write size=198821 2024-09-12T00:17:33.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.622+0000 7febed3678c0 1 < suggested update operation key=3G9ABEEEDRI3 tag=G7EVIFVAR6AN type=del size=802833 2024-09-12T00:17:33.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.630+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~DBW3AFF1BA5K.0 size=1048576 2024-09-12T00:17:33.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.630+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~DBW3AFF1BA5K.1 size=1048576 2024-09-12T00:17:33.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.634+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~DBW3AFF1BA5K.2 size=939260 2024-09-12T00:17:33.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.634+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=DBW3AFF1BA5K tag=EJZ4MD42YQSD type=write size=4084988 2024-09-12T00:17:33.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.638+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=PR57YVVLU91N type=del 2024-09-12T00:17:33.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.642+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=6DFGO3Q0OYOT type=del size=1561459 2024-09-12T00:17:33.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.642+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=WGOSWV172KMA type=del 2024-09-12T00:17:33.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.646+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=6LZTQ7SXB6KI type=del size=1336275 2024-09-12T00:17:33.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.650+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~3JGIWVNQHZD7.0 size=681840 2024-09-12T00:17:33.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.654+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=3JGIWVNQHZD7 tag=QYPUYINYIV20 type=write size=1730416 2024-09-12T00:17:33.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.658+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=P6SN22EFHR67 type=del size=1362808 2024-09-12T00:17:33.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.666+0000 7febed3678c0 1 < suggested remove operation key=KLO47UYYACLU tag=V4ZLJULUT16R type=del 2024-09-12T00:17:33.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.666+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=FE34U0G4AMYI type=del size=3428021 2024-09-12T00:17:33.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.670+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=YYOOH4CR0R31 type=del 2024-09-12T00:17:33.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.678+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~EL9JX52GZQML.0 size=552801 2024-09-12T00:17:33.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.678+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=EL9JX52GZQML tag=FUP5BYZLVWN1 type=write size=1601377 2024-09-12T00:17:33.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.682+0000 7febed3678c0 -1 < failed to complete operation key=KLO47UYYACLU tag=BHJSVMBCB0RC type=write size=245019: (22) Invalid argument 2024-09-12T00:17:33.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.682+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=BLKJYPGJ2YYZ type=del size=200941 2024-09-12T00:17:33.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.686+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=ZS9IE16FS7K4 type=del 2024-09-12T00:17:33.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.694+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~7BTJ9V3FSYLJ.0 size=1048576 2024-09-12T00:17:33.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.694+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~7BTJ9V3FSYLJ.1 size=1048576 2024-09-12T00:17:33.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.698+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~7BTJ9V3FSYLJ.2 size=929898 2024-09-12T00:17:33.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.698+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=7BTJ9V3FSYLJ tag=CDEVBD8IWQVA type=write size=4075626 2024-09-12T00:17:33.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.702+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=Q7O877CRHBV3 type=del 2024-09-12T00:17:33.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.706+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~849NK0E9QN3B.0 size=490339 2024-09-12T00:17:33.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.706+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=849NK0E9QN3B tag=9U7J84TXJFL5 type=write size=1538915 2024-09-12T00:17:33.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.710+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~B4K3U8NEZOFT.0 size=1048576 2024-09-12T00:17:33.714 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.714+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~B4K3U8NEZOFT.1 size=1048576 2024-09-12T00:17:33.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.718+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~B4K3U8NEZOFT.2 size=41357 2024-09-12T00:17:33.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.726+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=B4K3U8NEZOFT tag=ZYN9HMES27V3 type=write size=3187085 2024-09-12T00:17:33.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.730+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~W12BON96411Y.0 size=554740 2024-09-12T00:17:33.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.730+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=W12BON96411Y tag=CB0Y2QKMPQ1Y type=write size=1603316 2024-09-12T00:17:33.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.730+0000 7febed3678c0 1 < canceled part key=_multipart_G22WTRRGIQKE.2~6A93ED4740HF.0 size=1048576 2024-09-12T00:17:33.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.734+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~6A93ED4740HF.1 size=1048576 2024-09-12T00:17:33.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.738+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~6A93ED4740HF.2 size=368658 2024-09-12T00:17:33.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.742+0000 7febed3678c0 1 < canceled multipart upload key=G22WTRRGIQKE upload=6A93ED4740HF tag=N4T2JVEX9SRD type=write size=3514386 2024-09-12T00:17:33.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.746+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=8F4F2UUJHUKS type=write size=942635 2024-09-12T00:17:33.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.750+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=6U2177EZL2WF type=del 2024-09-12T00:17:33.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.754+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=M9C9IMJYWNFA type=del size=3332956 2024-09-12T00:17:33.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.758+0000 7febed3678c0 -1 < failed to complete operation key=3G9ABEEEDRI3 tag=6GMC0ZYN14UC type=del size=3484068: (22) Invalid argument 2024-09-12T00:17:33.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.762+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=NXQ5AW9PO91X type=del size=130462 2024-09-12T00:17:33.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.762+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~G2YH8ZJNY7DN.0 size=1048576 2024-09-12T00:17:33.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.766+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~G2YH8ZJNY7DN.1 size=1019765 2024-09-12T00:17:33.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.774+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=G2YH8ZJNY7DN tag=EVNID0JZ8FU6 type=write size=3116917 2024-09-12T00:17:33.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.774+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=N2K304UEVZCI type=del size=2106585 2024-09-12T00:17:33.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.778+0000 7febed3678c0 1 < completed write operation key=8RVDLW1VC8LP tag=LLGGVT62SLJ6 type=write size=280540 2024-09-12T00:17:33.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.782+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=ALA78JSD1UFK type=del size=3585626 2024-09-12T00:17:33.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.786+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=C26MQO7RBOD0 type=write size=198821 2024-09-12T00:17:33.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.794+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~O77AK2LRDCE5.0 size=502261 2024-09-12T00:17:33.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.794+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=O77AK2LRDCE5 tag=1ABX2PLF2OP6 type=write size=1550837 2024-09-12T00:17:33.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.794+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~DBW3AFF1BA5K.0 size=1048576 2024-09-12T00:17:33.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.798+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~DBW3AFF1BA5K.1 size=1048576 2024-09-12T00:17:33.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.802+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~DBW3AFF1BA5K.2 size=939260 2024-09-12T00:17:33.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.806+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=DBW3AFF1BA5K tag=EJZ4MD42YQSD type=write size=4084988 2024-09-12T00:17:33.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.814+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~ZWBHO06WIUZB.0 size=1048576 2024-09-12T00:17:33.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.818+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~ZWBHO06WIUZB.1 size=1021250 2024-09-12T00:17:33.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.818+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=ZWBHO06WIUZB tag=B2F7DZBWCRZU type=write size=3118402 2024-09-12T00:17:33.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.822+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=6DFGO3Q0OYOT type=del 2024-09-12T00:17:33.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.822+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=T337T8RCTPTZ type=write size=782030 2024-09-12T00:17:33.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.826+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=6LZTQ7SXB6KI type=del 2024-09-12T00:17:33.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.830+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=KIGKO8U6LI45 type=del size=3354994 2024-09-12T00:17:33.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.834+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=P6SN22EFHR67 type=del 2024-09-12T00:17:33.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.838+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=WYSCJ02V46S3 type=write size=646200 2024-09-12T00:17:33.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.842+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=FE34U0G4AMYI type=del 2024-09-12T00:17:33.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.846+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=0IES3G33N2QW type=del size=234906 2024-09-12T00:17:33.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.846+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~EL9JX52GZQML.0 size=552801 2024-09-12T00:17:33.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.854+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=EL9JX52GZQML tag=FUP5BYZLVWN1 type=write size=1601377 2024-09-12T00:17:33.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.858+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=Y82ZM7ZM8DT9 type=write size=466415 2024-09-12T00:17:33.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.862+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=BLKJYPGJ2YYZ type=del 2024-09-12T00:17:33.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.862+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=QKTQK69IWST6 type=del size=282722 2024-09-12T00:17:33.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.866+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~7BTJ9V3FSYLJ.0 size=1048576 2024-09-12T00:17:33.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.870+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~7BTJ9V3FSYLJ.1 size=1048576 2024-09-12T00:17:33.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.874+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~7BTJ9V3FSYLJ.2 size=929898 2024-09-12T00:17:33.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.878+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=7BTJ9V3FSYLJ tag=CDEVBD8IWQVA type=write size=4075626 2024-09-12T00:17:33.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.882+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~AFXCBWL542VD.0 size=1048576 2024-09-12T00:17:33.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.886+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~AFXCBWL542VD.1 size=990687 2024-09-12T00:17:33.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.886+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=AFXCBWL542VD tag=GDC4DEBKVDVU type=write size=3087839 2024-09-12T00:17:33.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.890+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~849NK0E9QN3B.0 size=490339 2024-09-12T00:17:33.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.894+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=849NK0E9QN3B tag=9U7J84TXJFL5 type=write size=1538915 2024-09-12T00:17:33.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.902+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~VWT4S33UFSU5.0 size=1048576 2024-09-12T00:17:33.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.906+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~VWT4S33UFSU5.1 size=330930 2024-09-12T00:17:33.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.906+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=VWT4S33UFSU5 tag=ORKJQEHTWO6Q type=write size=2428082 2024-09-12T00:17:33.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.910+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~W12BON96411Y.0 size=554740 2024-09-12T00:17:33.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.914+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=W12BON96411Y tag=CB0Y2QKMPQ1Y type=write size=1603316 2024-09-12T00:17:33.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.922+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~J4J91N34WFDR.0 size=1048576 2024-09-12T00:17:33.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.926+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~J4J91N34WFDR.1 size=26568 2024-09-12T00:17:33.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.926+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=J4J91N34WFDR tag=7PSF8HDNWO6Z type=write size=2123720 2024-09-12T00:17:33.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.930+0000 7febed3678c0 1 < completed write operation key=3G9ABEEEDRI3 tag=8F4F2UUJHUKS type=write size=942635 2024-09-12T00:17:33.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.934+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~Z4V8CUBUFO99.0 size=1048576 2024-09-12T00:17:33.937 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.938+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~Z4V8CUBUFO99.1 size=317891 2024-09-12T00:17:33.937 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.938+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=Z4V8CUBUFO99 tag=1VXF1KRYUL35 type=write size=2415043 2024-09-12T00:17:33.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.942+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=M9C9IMJYWNFA type=del 2024-09-12T00:17:33.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.946+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~S9JHLSLF3TGT.0 size=1048576 2024-09-12T00:17:33.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.950+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~S9JHLSLF3TGT.1 size=813007 2024-09-12T00:17:33.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.950+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=S9JHLSLF3TGT tag=45YS94JADJ70 type=write size=2910159 2024-09-12T00:17:33.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.950+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=NXQ5AW9PO91X type=del 2024-09-12T00:17:33.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.954+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=G6ZTI7DS9K03 type=del size=545041 2024-09-12T00:17:33.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.958+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=N2K304UEVZCI type=del 2024-09-12T00:17:33.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.962+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~57C7N5305FIQ.0 size=1048576 2024-09-12T00:17:33.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.966+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~57C7N5305FIQ.1 size=13068 2024-09-12T00:17:33.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.966+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=57C7N5305FIQ tag=UEY29XANBXPU type=write size=2110220 2024-09-12T00:17:33.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.970+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=ALA78JSD1UFK type=del 2024-09-12T00:17:33.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.970+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=XGS9F2B3B8TE type=write size=283092 2024-09-12T00:17:33.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.974+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~O77AK2LRDCE5.0 size=502261 2024-09-12T00:17:33.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.978+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=O77AK2LRDCE5 tag=1ABX2PLF2OP6 type=write size=1550837 2024-09-12T00:17:33.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.982+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~BCGZ633775BC.0 size=1048576 2024-09-12T00:17:33.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.986+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~BCGZ633775BC.1 size=684950 2024-09-12T00:17:33.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.986+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=BCGZ633775BC tag=9L53AZTT3LGA type=write size=2782102 2024-09-12T00:17:33.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.990+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~ZWBHO06WIUZB.0 size=1048576 2024-09-12T00:17:33.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.990+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~ZWBHO06WIUZB.1 size=1021250 2024-09-12T00:17:33.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.998+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=ZWBHO06WIUZB tag=B2F7DZBWCRZU type=write size=3118402 2024-09-12T00:17:33.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:33.998+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=VG5CL6SM55B6 type=del size=3636563 2024-09-12T00:17:34.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.002+0000 7febed3678c0 1 < completed write operation key=53T1415UK7GE tag=T337T8RCTPTZ type=write size=782030 2024-09-12T00:17:34.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.006+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=ZBKIK7EUB26W type=del size=1253685 2024-09-12T00:17:34.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.010+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=KIGKO8U6LI45 type=del 2024-09-12T00:17:34.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.014+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=3L7P7LG4DCQR type=del size=4113362 2024-09-12T00:17:34.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.014+0000 7febed3678c0 1 < completed write operation key=Z020UV2JRR0I tag=WYSCJ02V46S3 type=write size=646200 2024-09-12T00:17:34.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.018+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=TX7ZP7UGG4DS type=write size=710198 2024-09-12T00:17:34.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.026+0000 7febed3678c0 1 < suggested remove operation key=AHTIFXX3SGK7 tag=0IES3G33N2QW type=del 2024-09-12T00:17:34.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.030+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=G938HFR2XZTK type=del size=1908953 2024-09-12T00:17:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.030+0000 7febed3678c0 1 < completed write operation key=88BY5RHXSHD4 tag=Y82ZM7ZM8DT9 type=write size=466415 2024-09-12T00:17:34.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.034+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=IRVKJD5ZOPSM type=del size=2026633 2024-09-12T00:17:34.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.038+0000 7febed3678c0 1 < canceled operation key=RGQ4KY26RKYI tag=QKTQK69IWST6 type=del size=282722 2024-09-12T00:17:34.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.042+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~S8Z3QS6PF0XR.0 size=1048576 2024-09-12T00:17:34.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.046+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~S8Z3QS6PF0XR.1 size=326104 2024-09-12T00:17:34.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.046+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=S8Z3QS6PF0XR tag=7XAQL0OVCY82 type=write size=2423256 2024-09-12T00:17:34.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.050+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~AFXCBWL542VD.0 size=1048576 2024-09-12T00:17:34.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.050+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~AFXCBWL542VD.1 size=990687 2024-09-12T00:17:34.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.058+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=AFXCBWL542VD tag=GDC4DEBKVDVU type=write size=3087839 2024-09-12T00:17:34.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.058+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=STUT17TDGP3W type=write size=432004 2024-09-12T00:17:34.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.062+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~VWT4S33UFSU5.0 size=1048576 2024-09-12T00:17:34.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.066+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~VWT4S33UFSU5.1 size=330930 2024-09-12T00:17:34.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.070+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=VWT4S33UFSU5 tag=ORKJQEHTWO6Q type=write size=2428082 2024-09-12T00:17:34.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.074+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=KD5LVO31DG48 type=write size=971964 2024-09-12T00:17:34.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.078+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~J4J91N34WFDR.0 size=1048576 2024-09-12T00:17:34.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.078+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~J4J91N34WFDR.1 size=26568 2024-09-12T00:17:34.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.086+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=J4J91N34WFDR tag=7PSF8HDNWO6Z type=write size=2123720 2024-09-12T00:17:34.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.090+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~UAD80EW4JK1B.0 size=1048576 2024-09-12T00:17:34.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.094+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~UAD80EW4JK1B.1 size=11339 2024-09-12T00:17:34.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.094+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=UAD80EW4JK1B tag=78RJFFS01ZR2 type=write size=2108491 2024-09-12T00:17:34.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.098+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~Z4V8CUBUFO99.0 size=1048576 2024-09-12T00:17:34.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.098+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~Z4V8CUBUFO99.1 size=317891 2024-09-12T00:17:34.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.102+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=Z4V8CUBUFO99 tag=1VXF1KRYUL35 type=write size=2415043 2024-09-12T00:17:34.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.110+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~JWUHO8C976LG.0 size=1048576 2024-09-12T00:17:34.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.110+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~JWUHO8C976LG.1 size=190591 2024-09-12T00:17:34.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.110+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=JWUHO8C976LG tag=285R46AXHPLX type=write size=2287743 2024-09-12T00:17:34.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.114+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~S9JHLSLF3TGT.0 size=1048576 2024-09-12T00:17:34.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.118+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~S9JHLSLF3TGT.1 size=813007 2024-09-12T00:17:34.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.126+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=S9JHLSLF3TGT tag=45YS94JADJ70 type=write size=2910159 2024-09-12T00:17:34.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.130+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~TZPEJFZSCU2L.0 size=655650 2024-09-12T00:17:34.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.130+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=TZPEJFZSCU2L tag=G79XOUPOOUOY type=write size=1704226 2024-09-12T00:17:34.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.134+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=G6ZTI7DS9K03 type=del 2024-09-12T00:17:34.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.138+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=IXKQ715ZI9SV type=del size=3777170 2024-09-12T00:17:34.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.142+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~57C7N5305FIQ.0 size=1048576 2024-09-12T00:17:34.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.142+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~57C7N5305FIQ.1 size=13068 2024-09-12T00:17:34.148 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.150+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=57C7N5305FIQ tag=UEY29XANBXPU type=write size=2110220 2024-09-12T00:17:34.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.150+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=4JMWYOQAOP0S type=del size=706635 2024-09-12T00:17:34.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.154+0000 7febed3678c0 1 < canceled operation key=52SSW5KTCS15 tag=XGS9F2B3B8TE type=write size=283092 2024-09-12T00:17:34.160 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.162+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~I226QQQKQ4ZM.0 size=1048576 2024-09-12T00:17:34.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.162+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~I226QQQKQ4ZM.1 size=310947 2024-09-12T00:17:34.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.162+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=I226QQQKQ4ZM tag=ZS1Z6UEJ7ISP type=write size=2408099 2024-09-12T00:17:34.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.166+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~BCGZ633775BC.0 size=1048576 2024-09-12T00:17:34.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.170+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~BCGZ633775BC.1 size=684950 2024-09-12T00:17:34.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.174+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=BCGZ633775BC tag=9L53AZTT3LGA type=write size=2782102 2024-09-12T00:17:34.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.178+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=AIY2EDALYPWT type=del size=2716258 2024-09-12T00:17:34.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.182+0000 7febed3678c0 1 < canceled operation key=3G9ABEEEDRI3 tag=VG5CL6SM55B6 type=del size=3636563 2024-09-12T00:17:34.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.186+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~2XL7PNRXALR6.0 size=1048576 2024-09-12T00:17:34.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.190+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~2XL7PNRXALR6.1 size=1048576 2024-09-12T00:17:34.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.194+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~2XL7PNRXALR6.2 size=493465 2024-09-12T00:17:34.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.194+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=2XL7PNRXALR6 tag=V5I3BXXIK902 type=write size=3639193 2024-09-12T00:17:34.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.202+0000 7febed3678c0 1 < suggested update operation key=ELNXYXX5ZWOW tag=ZBKIK7EUB26W type=del size=1253685 2024-09-12T00:17:34.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.206+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~BC280XYFMWNS.0 size=1048576 2024-09-12T00:17:34.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.210+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~BC280XYFMWNS.1 size=1048576 2024-09-12T00:17:34.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.214+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~BC280XYFMWNS.2 size=933152 2024-09-12T00:17:34.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.214+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=BC280XYFMWNS tag=EP6M43E4V9UJ type=write size=4078880 2024-09-12T00:17:34.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.214+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=3L7P7LG4DCQR type=del 2024-09-12T00:17:34.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.218+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=44MEX07QXKB8 type=del size=3894613 2024-09-12T00:17:34.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.222+0000 7febed3678c0 1 < completed write operation key=UGV3WQR0ADYH tag=TX7ZP7UGG4DS type=write size=710198 2024-09-12T00:17:34.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.226+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~951TMJBQ5YB2.0 size=1037065 2024-09-12T00:17:34.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.226+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=951TMJBQ5YB2 tag=LDRT5E3KQQGM type=write size=2085641 2024-09-12T00:17:34.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.230+0000 7febed3678c0 1 < canceled operation key=MAZHOU2CEUCU tag=G938HFR2XZTK type=del size=1908953 2024-09-12T00:17:34.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.234+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=3J9Z7GYVC9GI type=del size=3720045 2024-09-12T00:17:34.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.238+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=IRVKJD5ZOPSM type=del 2024-09-12T00:17:34.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.238+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=VWT20SKGUHL4 type=del size=2775881 2024-09-12T00:17:34.242 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.242+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~S8Z3QS6PF0XR.0 size=1048576 2024-09-12T00:17:34.244 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.246+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~S8Z3QS6PF0XR.1 size=326104 2024-09-12T00:17:34.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.250+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=S8Z3QS6PF0XR tag=7XAQL0OVCY82 type=write size=2423256 2024-09-12T00:17:34.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.254+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=4FU82BY9VD0P type=del size=3665614 2024-09-12T00:17:34.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.254+0000 7febed3678c0 1 < completed write operation key=MAZHOU2CEUCU tag=STUT17TDGP3W type=write size=432004 2024-09-12T00:17:34.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.258+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~Z86SX2J4H31T.0 size=827273 2024-09-12T00:17:34.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.258+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=Z86SX2J4H31T tag=0549SNO1Y5U9 type=write size=1875849 2024-09-12T00:17:34.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.262+0000 7febed3678c0 1 < canceled operation key=3G9ABEEEDRI3 tag=KD5LVO31DG48 type=write size=971964 2024-09-12T00:17:34.268 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.270+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~K8W30A1CTXVD.0 size=1048576 2024-09-12T00:17:34.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.270+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~K8W30A1CTXVD.1 size=624724 2024-09-12T00:17:34.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.270+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=K8W30A1CTXVD tag=WC306Z2HOBON type=write size=2721876 2024-09-12T00:17:34.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.274+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~UAD80EW4JK1B.0 size=1048576 2024-09-12T00:17:34.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.278+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~UAD80EW4JK1B.1 size=11339 2024-09-12T00:17:34.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.282+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=UAD80EW4JK1B tag=78RJFFS01ZR2 type=write size=2108491 2024-09-12T00:17:34.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.286+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=87IV87SBOFSW type=del size=3403163 2024-09-12T00:17:34.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.290+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~JWUHO8C976LG.0 size=1048576 2024-09-12T00:17:34.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.290+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~JWUHO8C976LG.1 size=190591 2024-09-12T00:17:34.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.294+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=JWUHO8C976LG tag=285R46AXHPLX type=write size=2287743 2024-09-12T00:17:34.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.302+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~AK188IHPQ3NZ.0 size=913706 2024-09-12T00:17:34.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.302+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=AK188IHPQ3NZ tag=CRZ0T7HI1Z84 type=write size=1962282 2024-09-12T00:17:34.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.302+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~TZPEJFZSCU2L.0 size=655650 2024-09-12T00:17:34.308 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.310+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=TZPEJFZSCU2L tag=G79XOUPOOUOY type=write size=1704226 2024-09-12T00:17:34.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.314+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=DY62JXP38DR7 type=del size=3547774 2024-09-12T00:17:34.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.314+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=IXKQ715ZI9SV type=del 2024-09-12T00:17:34.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.318+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=50DE8MJRHUTQ type=del size=3932119 2024-09-12T00:17:34.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.322+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=4JMWYOQAOP0S type=del 2024-09-12T00:17:34.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.326+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~9U2ZBF72W2Q5.0 size=1048576 2024-09-12T00:17:34.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.330+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~9U2ZBF72W2Q5.1 size=866344 2024-09-12T00:17:34.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.330+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=9U2ZBF72W2Q5 tag=U3YQOUMQ9CY9 type=write size=2963496 2024-09-12T00:17:34.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.334+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~I226QQQKQ4ZM.0 size=1048576 2024-09-12T00:17:34.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.338+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~I226QQQKQ4ZM.1 size=310947 2024-09-12T00:17:34.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.346+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=I226QQQKQ4ZM tag=ZS1Z6UEJ7ISP type=write size=2408099 2024-09-12T00:17:34.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.350+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~SD22PHJYO6II.0 size=199481 2024-09-12T00:17:34.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.350+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=SD22PHJYO6II tag=HD82588Y0GX9 type=write size=1248057 2024-09-12T00:17:34.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.354+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=AIY2EDALYPWT type=del 2024-09-12T00:17:34.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.358+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=G9LD5CLGB0IV type=write size=78876 2024-09-12T00:17:34.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.358+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~2XL7PNRXALR6.0 size=1048576 2024-09-12T00:17:34.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.362+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~2XL7PNRXALR6.1 size=1048576 2024-09-12T00:17:34.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.366+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~2XL7PNRXALR6.2 size=493465 2024-09-12T00:17:34.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.370+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=2XL7PNRXALR6 tag=V5I3BXXIK902 type=write size=3639193 2024-09-12T00:17:34.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.370+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=U114D7PK0723 type=del size=1458254 2024-09-12T00:17:34.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.374+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~BC280XYFMWNS.0 size=1048576 2024-09-12T00:17:34.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.378+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~BC280XYFMWNS.1 size=1048576 2024-09-12T00:17:34.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.382+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~BC280XYFMWNS.2 size=933152 2024-09-12T00:17:34.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.386+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=BC280XYFMWNS tag=EP6M43E4V9UJ type=write size=4078880 2024-09-12T00:17:34.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.386+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=L1HJR2NWPAW8 type=del size=1762545 2024-09-12T00:17:34.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.390+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=44MEX07QXKB8 type=del 2024-09-12T00:17:34.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.394+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=7ZACQPN7HGKJ type=del size=1514833 2024-09-12T00:17:34.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.398+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~951TMJBQ5YB2.0 size=1037065 2024-09-12T00:17:34.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.402+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=951TMJBQ5YB2 tag=LDRT5E3KQQGM type=write size=2085641 2024-09-12T00:17:34.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.402+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=I8ZN4B6DCU84 type=del size=3335829 2024-09-12T00:17:34.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.406+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=3J9Z7GYVC9GI type=del 2024-09-12T00:17:34.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.410+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=R1LL7Q0B1NPX type=del size=1311447 2024-09-12T00:17:34.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.414+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=VWT20SKGUHL4 type=del 2024-09-12T00:17:34.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.418+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~HFSA38A7F6P9.0 size=1048576 2024-09-12T00:17:34.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.418+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~HFSA38A7F6P9.1 size=3259 2024-09-12T00:17:34.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.418+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=HFSA38A7F6P9 tag=5GU89NQNQ979 type=write size=2100411 2024-09-12T00:17:34.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.426+0000 7febed3678c0 1 < suggested update operation key=0KQK1CXHO096 tag=4FU82BY9VD0P type=del size=3665614 2024-09-12T00:17:34.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.430+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=R42BEJ5LHL8V type=del size=1498870 2024-09-12T00:17:34.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.434+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~Z86SX2J4H31T.0 size=827273 2024-09-12T00:17:34.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.438+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=Z86SX2J4H31T tag=0549SNO1Y5U9 type=write size=1875849 2024-09-12T00:17:34.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.442+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~YOKG8HKWKV27.0 size=1048576 2024-09-12T00:17:34.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.446+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~YOKG8HKWKV27.1 size=1048576 2024-09-12T00:17:34.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.450+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~YOKG8HKWKV27.2 size=666924 2024-09-12T00:17:34.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.450+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=YOKG8HKWKV27 tag=ZQCOMC3IOJXX type=write size=3812652 2024-09-12T00:17:34.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.450+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~K8W30A1CTXVD.0 size=1048576 2024-09-12T00:17:34.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.454+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~K8W30A1CTXVD.1 size=624724 2024-09-12T00:17:34.458 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.458+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=K8W30A1CTXVD tag=WC306Z2HOBON type=write size=2721876 2024-09-12T00:17:34.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.462+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=913W8F3A16QQ type=del size=4123650 2024-09-12T00:17:34.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.466+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=87IV87SBOFSW type=del 2024-09-12T00:17:34.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.470+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~3C5F5G9OCQXP.0 size=1048576 2024-09-12T00:17:34.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.470+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~3C5F5G9OCQXP.1 size=1048576 2024-09-12T00:17:34.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.474+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~3C5F5G9OCQXP.2 size=315524 2024-09-12T00:17:34.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.474+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=3C5F5G9OCQXP tag=MNRJ6ANZJS4N type=write size=3461252 2024-09-12T00:17:34.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.482+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~AK188IHPQ3NZ.0 size=913706 2024-09-12T00:17:34.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.486+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=AK188IHPQ3NZ tag=CRZ0T7HI1Z84 type=write size=1962282 2024-09-12T00:17:34.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.486+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=2CX3QZP6JFXI type=write size=852336 2024-09-12T00:17:34.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.490+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=DY62JXP38DR7 type=del 2024-09-12T00:17:34.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.494+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=B6LKJ2I15OMN type=del size=715170 2024-09-12T00:17:34.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.498+0000 7febed3678c0 1 < suggested update operation key=G22WTRRGIQKE tag=50DE8MJRHUTQ type=del size=3932119 2024-09-12T00:17:34.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.502+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=OETNH2GAUXGK type=del size=798295 2024-09-12T00:17:34.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.502+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~9U2ZBF72W2Q5.0 size=1048576 2024-09-12T00:17:34.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.506+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~9U2ZBF72W2Q5.1 size=866344 2024-09-12T00:17:34.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.510+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=9U2ZBF72W2Q5 tag=U3YQOUMQ9CY9 type=write size=2963496 2024-09-12T00:17:34.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.510+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=2IXYGPU53ZYC type=del size=1104141 2024-09-12T00:17:34.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.514+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~SD22PHJYO6II.0 size=199481 2024-09-12T00:17:34.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.518+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=SD22PHJYO6II tag=HD82588Y0GX9 type=write size=1248057 2024-09-12T00:17:34.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.522+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~7KYM2111F6UW.0 size=1048576 2024-09-12T00:17:34.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.526+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~7KYM2111F6UW.1 size=583951 2024-09-12T00:17:34.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.526+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=7KYM2111F6UW tag=MRV2XIZJCXLY type=write size=2681103 2024-09-12T00:17:34.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.526+0000 7febed3678c0 1 < completed write operation key=H017KWW59B8Z tag=G9LD5CLGB0IV type=write size=78876 2024-09-12T00:17:34.532 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.534+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~RRK06EMILQQ3.0 size=1048576 2024-09-12T00:17:34.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.534+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~RRK06EMILQQ3.1 size=1048576 2024-09-12T00:17:34.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.538+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~RRK06EMILQQ3.2 size=745920 2024-09-12T00:17:34.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.538+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=RRK06EMILQQ3 tag=0IQAJF33B4TC type=write size=3891648 2024-09-12T00:17:34.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.538+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=U114D7PK0723 type=del 2024-09-12T00:17:34.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.542+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=PZPBN00TPSKF type=del size=331008 2024-09-12T00:17:34.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.546+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=L1HJR2NWPAW8 type=del 2024-09-12T00:17:34.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.546+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=I84L5ARWC1YI type=write size=2102 2024-09-12T00:17:34.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.550+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=7ZACQPN7HGKJ type=del 2024-09-12T00:17:34.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.550+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=GO7SEGDENOE7 type=del size=2623647 2024-09-12T00:17:34.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.554+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=I8ZN4B6DCU84 type=del 2024-09-12T00:17:34.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.558+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=VNAFARFRTL7K type=del size=1921596 2024-09-12T00:17:34.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.558+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=R1LL7Q0B1NPX type=del 2024-09-12T00:17:34.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.562+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=CH7H2K7IUKSM type=del size=181079 2024-09-12T00:17:34.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.566+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~HFSA38A7F6P9.0 size=1048576 2024-09-12T00:17:34.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.566+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~HFSA38A7F6P9.1 size=3259 2024-09-12T00:17:34.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.570+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=HFSA38A7F6P9 tag=5GU89NQNQ979 type=write size=2100411 2024-09-12T00:17:34.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.574+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=JU5ZHRM6XJZU type=write size=142029 2024-09-12T00:17:34.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.578+0000 7febed3678c0 1 < canceled operation key=CIOINUP503WY tag=R42BEJ5LHL8V type=del size=1498870 2024-09-12T00:17:34.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.578+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=PIX3WN4NQLHS type=del size=661559 2024-09-12T00:17:34.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.582+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~YOKG8HKWKV27.0 size=1048576 2024-09-12T00:17:34.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.582+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~YOKG8HKWKV27.1 size=1048576 2024-09-12T00:17:34.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.586+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~YOKG8HKWKV27.2 size=666924 2024-09-12T00:17:34.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.590+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=YOKG8HKWKV27 tag=ZQCOMC3IOJXX type=write size=3812652 2024-09-12T00:17:34.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.594+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=93HML5NCXA6H type=del size=1315659 2024-09-12T00:17:34.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.594+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=913W8F3A16QQ type=del 2024-09-12T00:17:34.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.598+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=B5ASNJB1VBTS type=write size=22137 2024-09-12T00:17:34.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.602+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~3C5F5G9OCQXP.0 size=1048576 2024-09-12T00:17:34.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.602+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~3C5F5G9OCQXP.1 size=1048576 2024-09-12T00:17:34.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.606+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~3C5F5G9OCQXP.2 size=315524 2024-09-12T00:17:34.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.610+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=3C5F5G9OCQXP tag=MNRJ6ANZJS4N type=write size=3461252 2024-09-12T00:17:34.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.614+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~HLRUDBLDWSRV.0 size=1048576 2024-09-12T00:17:34.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.618+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~HLRUDBLDWSRV.1 size=513842 2024-09-12T00:17:34.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.618+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=HLRUDBLDWSRV tag=ENPQATR89E15 type=write size=2610994 2024-09-12T00:17:34.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.622+0000 7febed3678c0 1 < canceled operation key=MAZHOU2CEUCU tag=2CX3QZP6JFXI type=write size=852336 2024-09-12T00:17:34.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.626+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~KR48ENE0GXKL.0 size=1048576 2024-09-12T00:17:34.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.630+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~KR48ENE0GXKL.1 size=932192 2024-09-12T00:17:34.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.630+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=KR48ENE0GXKL tag=4XQUYT8Y7VN0 type=write size=3029344 2024-09-12T00:17:34.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.634+0000 7febed3678c0 1 < suggested update operation key=9CBI4FHAT3H2 tag=B6LKJ2I15OMN type=del size=715170 2024-09-12T00:17:34.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.638+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=BG0GJROUWCSY type=write size=993247 2024-09-12T00:17:34.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.642+0000 7febed3678c0 1 < suggested remove operation key=9HCKHF5ZRZ5N tag=OETNH2GAUXGK type=del 2024-09-12T00:17:34.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.646+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~KVHO6DM6098C.0 size=324060 2024-09-12T00:17:34.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.646+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=KVHO6DM6098C tag=PBC3T4ZX3RNF type=write size=1372636 2024-09-12T00:17:34.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.650+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=2IXYGPU53ZYC type=del 2024-09-12T00:17:34.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.654+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=QISGF062YVET type=del size=3839758 2024-09-12T00:17:34.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.654+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~7KYM2111F6UW.0 size=1048576 2024-09-12T00:17:34.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.658+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~7KYM2111F6UW.1 size=583951 2024-09-12T00:17:34.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.662+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=7KYM2111F6UW tag=MRV2XIZJCXLY type=write size=2681103 2024-09-12T00:17:34.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.666+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~C0EUGQFK1X96.0 size=262212 2024-09-12T00:17:34.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.666+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=C0EUGQFK1X96 tag=2DFROPZ7KQ8I type=write size=1310788 2024-09-12T00:17:34.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.670+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~RRK06EMILQQ3.0 size=1048576 2024-09-12T00:17:34.672 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.674+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~RRK06EMILQQ3.1 size=1048576 2024-09-12T00:17:34.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.674+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~RRK06EMILQQ3.2 size=745920 2024-09-12T00:17:34.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.678+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=RRK06EMILQQ3 tag=0IQAJF33B4TC type=write size=3891648 2024-09-12T00:17:34.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.682+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=GTVHDF1VH1N3 type=write size=546055 2024-09-12T00:17:34.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.686+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=PZPBN00TPSKF type=del 2024-09-12T00:17:34.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.690+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=KH887KSY3ESY type=del size=1865661 2024-09-12T00:17:34.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.694+0000 7febed3678c0 1 < suggested remove operation key=VU1AF57EUA0R tag=I84L5ARWC1YI type=write 2024-09-12T00:17:34.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.698+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=FOQMCCEQ2XEL type=del size=3601561 2024-09-12T00:17:34.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.698+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=GO7SEGDENOE7 type=del 2024-09-12T00:17:34.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.706+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~Y1YBD31438VS.0 size=1048576 2024-09-12T00:17:34.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.706+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~Y1YBD31438VS.1 size=1048576 2024-09-12T00:17:34.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.710+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~Y1YBD31438VS.2 size=272786 2024-09-12T00:17:34.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.710+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=Y1YBD31438VS tag=TRFX17633DCU type=write size=3418514 2024-09-12T00:17:34.712 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.714+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=VNAFARFRTL7K type=del 2024-09-12T00:17:34.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.718+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~BS1K0UHYG2Y7.0 size=1048576 2024-09-12T00:17:34.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.718+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~BS1K0UHYG2Y7.1 size=442542 2024-09-12T00:17:34.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.718+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=BS1K0UHYG2Y7 tag=MX4ZGX48SFP2 type=write size=2539694 2024-09-12T00:17:34.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.722+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=CH7H2K7IUKSM type=del 2024-09-12T00:17:34.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.726+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~KURBPOEQXSC7.0 size=853747 2024-09-12T00:17:34.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.726+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=KURBPOEQXSC7 tag=OR27UMT0PGD2 type=write size=1902323 2024-09-12T00:17:34.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.734+0000 7febed3678c0 1 < completed write operation key=3G9ABEEEDRI3 tag=JU5ZHRM6XJZU type=write size=142029 2024-09-12T00:17:34.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.738+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=4LPIE095C3F9 type=write size=474309 2024-09-12T00:17:34.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.742+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=PIX3WN4NQLHS type=del 2024-09-12T00:17:34.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.742+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=1PY6R6NI03E7 type=del size=1830953 2024-09-12T00:17:34.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.746+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=93HML5NCXA6H type=del 2024-09-12T00:17:34.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.750+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=ERTIT8MUWJIZ type=del size=25070 2024-09-12T00:17:34.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.758+0000 7febed3678c0 1 < suggested remove operation key=1HABX7YZ491W tag=B5ASNJB1VBTS type=write 2024-09-12T00:17:34.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.762+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~EMFRCCTGOGEA.0 size=1048576 2024-09-12T00:17:34.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.766+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~EMFRCCTGOGEA.1 size=163022 2024-09-12T00:17:34.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.766+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=EMFRCCTGOGEA tag=0THCFDHNDDXI type=write size=2260174 2024-09-12T00:17:34.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.766+0000 7febed3678c0 1 < canceled part key=_multipart_3G9ABEEEDRI3.2~HLRUDBLDWSRV.0 size=1048576 2024-09-12T00:17:34.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.766+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~HLRUDBLDWSRV.1 size=513842 2024-09-12T00:17:34.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.774+0000 7febed3678c0 1 < canceled multipart upload key=3G9ABEEEDRI3 upload=HLRUDBLDWSRV tag=ENPQATR89E15 type=write size=2610994 2024-09-12T00:17:34.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.778+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~GPMYOT6ALHWL.0 size=1048576 2024-09-12T00:17:34.782 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.782+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~GPMYOT6ALHWL.1 size=72652 2024-09-12T00:17:34.782 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.782+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=GPMYOT6ALHWL tag=0W14YFW0D4FT type=write size=2169804 2024-09-12T00:17:34.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.786+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~KR48ENE0GXKL.0 size=1048576 2024-09-12T00:17:34.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.790+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~KR48ENE0GXKL.1 size=932192 2024-09-12T00:17:34.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.794+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=KR48ENE0GXKL tag=4XQUYT8Y7VN0 type=write size=3029344 2024-09-12T00:17:34.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.798+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~SCFLVXPO24FF.0 size=1048576 2024-09-12T00:17:34.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.802+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~SCFLVXPO24FF.1 size=50769 2024-09-12T00:17:34.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.802+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=SCFLVXPO24FF tag=0C7DG185FARO type=write size=2147921 2024-09-12T00:17:34.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.806+0000 7febed3678c0 1 < suggested update operation key=MHS307JKNVCK tag=BG0GJROUWCSY type=write size=993247 2024-09-12T00:17:34.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.810+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=4P3FOM4XAF1X type=del size=709079 2024-09-12T00:17:34.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.814+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~KVHO6DM6098C.0 size=324060 2024-09-12T00:17:34.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.818+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=KVHO6DM6098C tag=PBC3T4ZX3RNF type=write size=1372636 2024-09-12T00:17:34.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.826+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~CYF92SH18Q5L.0 size=125310 2024-09-12T00:17:34.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.826+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=CYF92SH18Q5L tag=2PBHYWW1PGPU type=write size=1173886 2024-09-12T00:17:34.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.830+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=QISGF062YVET type=del 2024-09-12T00:17:34.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.834+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=M6JBO9FEN6RI type=del size=185498 2024-09-12T00:17:34.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.838+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~C0EUGQFK1X96.0 size=262212 2024-09-12T00:17:34.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.842+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=C0EUGQFK1X96 tag=2DFROPZ7KQ8I type=write size=1310788 2024-09-12T00:17:34.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.846+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=0RCF5DJOEBBW type=del size=2504090 2024-09-12T00:17:34.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.850+0000 7febed3678c0 1 < completed write operation key=3G9ABEEEDRI3 tag=GTVHDF1VH1N3 type=write size=546055 2024-09-12T00:17:34.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.850+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=WDSGOL881G5E type=del size=2396680 2024-09-12T00:17:34.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.854+0000 7febed3678c0 -1 < failed to complete operation key=1HABX7YZ491W tag=KH887KSY3ESY type=del size=1865661: (22) Invalid argument 2024-09-12T00:17:34.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.858+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=5NZEO2UK2PB6 type=del size=4168202 2024-09-12T00:17:34.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.862+0000 7febed3678c0 -1 < failed to complete operation key=1HABX7YZ491W tag=FOQMCCEQ2XEL type=del size=3601561: (22) Invalid argument 2024-09-12T00:17:34.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.866+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=0T75V4O8JQ10 type=write size=778166 2024-09-12T00:17:34.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.866+0000 7febed3678c0 1 < canceled part key=_multipart_52SSW5KTCS15.2~Y1YBD31438VS.0 size=1048576 2024-09-12T00:17:34.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.866+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~Y1YBD31438VS.1 size=1048576 2024-09-12T00:17:34.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.870+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~Y1YBD31438VS.2 size=272786 2024-09-12T00:17:34.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.874+0000 7febed3678c0 1 < canceled multipart upload key=52SSW5KTCS15 upload=Y1YBD31438VS tag=TRFX17633DCU type=write size=3418514 2024-09-12T00:17:34.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.882+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~BH15NEW10QLK.0 size=504372 2024-09-12T00:17:34.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.882+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=BH15NEW10QLK tag=WOWTGVLGBEA8 type=write size=1552948 2024-09-12T00:17:34.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.886+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~BS1K0UHYG2Y7.0 size=1048576 2024-09-12T00:17:34.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.890+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~BS1K0UHYG2Y7.1 size=442542 2024-09-12T00:17:34.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.894+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=BS1K0UHYG2Y7 tag=MX4ZGX48SFP2 type=write size=2539694 2024-09-12T00:17:34.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.902+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~P0L3DFXQ8ZVT.0 size=1048576 2024-09-12T00:17:34.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.902+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~P0L3DFXQ8ZVT.1 size=14199 2024-09-12T00:17:34.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.902+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=P0L3DFXQ8ZVT tag=PZKBY2XNNPYD type=write size=2111351 2024-09-12T00:17:34.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.906+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~KURBPOEQXSC7.0 size=853747 2024-09-12T00:17:34.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.914+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=KURBPOEQXSC7 tag=OR27UMT0PGD2 type=write size=1902323 2024-09-12T00:17:34.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.918+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~RKTVGKKA11FB.0 size=1048576 2024-09-12T00:17:34.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.922+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~RKTVGKKA11FB.1 size=1048576 2024-09-12T00:17:34.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.922+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~RKTVGKKA11FB.2 size=906880 2024-09-12T00:17:34.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.922+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=RKTVGKKA11FB tag=A1BKU74KVRDS type=write size=4052608 2024-09-12T00:17:34.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.926+0000 7febed3678c0 1 < completed write operation key=25THATWGX4WS tag=4LPIE095C3F9 type=write size=474309 2024-09-12T00:17:34.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.930+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=XIKOF5YJCQ9X type=del size=2413905 2024-09-12T00:17:34.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.934+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=1PY6R6NI03E7 type=del 2024-09-12T00:17:34.939 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.938+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~ZRYPX2D00OBP.0 size=1048576 2024-09-12T00:17:34.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.942+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~ZRYPX2D00OBP.1 size=1048576 2024-09-12T00:17:34.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.946+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~ZRYPX2D00OBP.2 size=276115 2024-09-12T00:17:34.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.946+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=ZRYPX2D00OBP tag=XF9G340MAUPS type=write size=3421843 2024-09-12T00:17:34.947 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.946+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=ERTIT8MUWJIZ type=del 2024-09-12T00:17:34.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.950+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=HTS723DLDE1R type=write size=685584 2024-09-12T00:17:34.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.954+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~EMFRCCTGOGEA.0 size=1048576 2024-09-12T00:17:34.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.958+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~EMFRCCTGOGEA.1 size=163022 2024-09-12T00:17:34.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.966+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=EMFRCCTGOGEA tag=0THCFDHNDDXI type=write size=2260174 2024-09-12T00:17:34.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.970+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=AKHSA734HB5W type=write size=568886 2024-09-12T00:17:34.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.974+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~GPMYOT6ALHWL.0 size=1048576 2024-09-12T00:17:34.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.978+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~GPMYOT6ALHWL.1 size=72652 2024-09-12T00:17:34.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.986+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=GPMYOT6ALHWL tag=0W14YFW0D4FT type=write size=2169804 2024-09-12T00:17:34.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.994+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~NZARN2UOHKA9.0 size=148092 2024-09-12T00:17:34.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.994+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=NZARN2UOHKA9 tag=YJ47DQ81S20D type=write size=1196668 2024-09-12T00:17:34.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.998+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~SCFLVXPO24FF.0 size=1048576 2024-09-12T00:17:34.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:34.998+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~SCFLVXPO24FF.1 size=50769 2024-09-12T00:17:35.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.006+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=SCFLVXPO24FF tag=0C7DG185FARO type=write size=2147921 2024-09-12T00:17:35.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.010+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=6UQVQ0J3Y3GW type=write size=860255 2024-09-12T00:17:35.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.010+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=4P3FOM4XAF1X type=del 2024-09-12T00:17:35.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.018+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~5NM5UK1YHFUP.0 size=1048576 2024-09-12T00:17:35.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.022+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~5NM5UK1YHFUP.1 size=574613 2024-09-12T00:17:35.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.022+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=5NM5UK1YHFUP tag=82LTBL79W79Q type=write size=2671765 2024-09-12T00:17:35.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.026+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~CYF92SH18Q5L.0 size=125310 2024-09-12T00:17:35.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.030+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=CYF92SH18Q5L tag=2PBHYWW1PGPU type=write size=1173886 2024-09-12T00:17:35.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.034+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=0V2NOBD8O0BY type=del size=3666442 2024-09-12T00:17:35.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.042+0000 7febed3678c0 1 < suggested update operation key=H017KWW59B8Z tag=M6JBO9FEN6RI type=del size=185498 2024-09-12T00:17:35.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.050+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~0ZTKB66JNQO6.0 size=1048576 2024-09-12T00:17:35.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.054+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~0ZTKB66JNQO6.1 size=787717 2024-09-12T00:17:35.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.054+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=0ZTKB66JNQO6 tag=VF85P43ZEKKQ type=write size=2884869 2024-09-12T00:17:35.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.058+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=0RCF5DJOEBBW type=del 2024-09-12T00:17:35.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.062+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~ANBZUQDRVQO5.0 size=1048576 2024-09-12T00:17:35.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.066+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~ANBZUQDRVQO5.1 size=555646 2024-09-12T00:17:35.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.066+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=ANBZUQDRVQO5 tag=QBSJ5X0K9PX2 type=write size=2652798 2024-09-12T00:17:35.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.070+0000 7febed3678c0 1 < suggested remove operation key=4K65QIB9F00S tag=WDSGOL881G5E type=del 2024-09-12T00:17:35.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.074+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=O11750ZFY8CV type=del size=3743638 2024-09-12T00:17:35.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.078+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=5NZEO2UK2PB6 type=del 2024-09-12T00:17:35.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.082+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~PLIV9UCQOSIA.0 size=1048576 2024-09-12T00:17:35.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.086+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~PLIV9UCQOSIA.1 size=5522 2024-09-12T00:17:35.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.086+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=PLIV9UCQOSIA tag=F9MCBGC0Y30R type=write size=2102674 2024-09-12T00:17:35.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.094+0000 7febed3678c0 1 < suggested update operation key=LWAMFA0RSW6S tag=0T75V4O8JQ10 type=write size=778166 2024-09-12T00:17:35.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.098+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=F8YME3LCB0QA type=del size=3704752 2024-09-12T00:17:35.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.102+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~BH15NEW10QLK.0 size=504372 2024-09-12T00:17:35.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.106+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=BH15NEW10QLK tag=WOWTGVLGBEA8 type=write size=1552948 2024-09-12T00:17:35.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.110+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=EY8JXXMBG296 type=del size=348651 2024-09-12T00:17:35.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.114+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~P0L3DFXQ8ZVT.0 size=1048576 2024-09-12T00:17:35.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.114+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~P0L3DFXQ8ZVT.1 size=14199 2024-09-12T00:17:35.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.122+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=P0L3DFXQ8ZVT tag=PZKBY2XNNPYD type=write size=2111351 2024-09-12T00:17:35.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.126+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=2Q0UTG1ZX2JU type=del size=1088507 2024-09-12T00:17:35.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.130+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~RKTVGKKA11FB.0 size=1048576 2024-09-12T00:17:35.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.130+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~RKTVGKKA11FB.1 size=1048576 2024-09-12T00:17:35.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.134+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~RKTVGKKA11FB.2 size=906880 2024-09-12T00:17:35.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.142+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=RKTVGKKA11FB tag=A1BKU74KVRDS type=write size=4052608 2024-09-12T00:17:35.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.146+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~WNLQ0K9L7RL8.0 size=1048576 2024-09-12T00:17:35.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.150+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~WNLQ0K9L7RL8.1 size=1048576 2024-09-12T00:17:35.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.154+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~WNLQ0K9L7RL8.2 size=562604 2024-09-12T00:17:35.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.154+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=WNLQ0K9L7RL8 tag=OQ9IBLNBKRLU type=write size=3708332 2024-09-12T00:17:35.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.154+0000 7febed3678c0 -1 < failed to complete operation key=4K65QIB9F00S tag=XIKOF5YJCQ9X type=del size=2413905: (22) Invalid argument 2024-09-12T00:17:35.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.162+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~B1PL1ZJMABZD.0 size=1048576 2024-09-12T00:17:35.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.166+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~B1PL1ZJMABZD.1 size=1015849 2024-09-12T00:17:35.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.166+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=B1PL1ZJMABZD tag=XG0WUUWLSB75 type=write size=3113001 2024-09-12T00:17:35.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.166+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~ZRYPX2D00OBP.0 size=1048576 2024-09-12T00:17:35.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.170+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~ZRYPX2D00OBP.1 size=1048576 2024-09-12T00:17:35.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.174+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~ZRYPX2D00OBP.2 size=276115 2024-09-12T00:17:35.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.178+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=ZRYPX2D00OBP tag=XF9G340MAUPS type=write size=3421843 2024-09-12T00:17:35.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.186+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~88CR3BFOI83S.0 size=960329 2024-09-12T00:17:35.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.186+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=88CR3BFOI83S tag=6ULD6D5AKRR1 type=write size=2008905 2024-09-12T00:17:35.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.190+0000 7febed3678c0 1 < suggested update operation key=LWAMFA0RSW6S tag=HTS723DLDE1R type=write size=685584 2024-09-12T00:17:35.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.194+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=FR7XTLCO3U7A type=del size=3516028 2024-09-12T00:17:35.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.198+0000 7febed3678c0 1 < completed write operation key=MLPN8PH72VQ9 tag=AKHSA734HB5W type=write size=568886 2024-09-12T00:17:35.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.202+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~0WY1VSFG9SLD.0 size=1048576 2024-09-12T00:17:35.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.206+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~0WY1VSFG9SLD.1 size=1030206 2024-09-12T00:17:35.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.206+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=0WY1VSFG9SLD tag=I3QLSVZEGSKV type=write size=3127358 2024-09-12T00:17:35.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.210+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~NZARN2UOHKA9.0 size=148092 2024-09-12T00:17:35.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.214+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=NZARN2UOHKA9 tag=YJ47DQ81S20D type=write size=1196668 2024-09-12T00:17:35.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.222+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~I9I2L1FBFV2F.0 size=985245 2024-09-12T00:17:35.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.222+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=I9I2L1FBFV2F tag=V5136JNFY8P3 type=write size=2033821 2024-09-12T00:17:35.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.226+0000 7febed3678c0 1 < completed write operation key=25THATWGX4WS tag=6UQVQ0J3Y3GW type=write size=860255 2024-09-12T00:17:35.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.230+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~YWG59Z00PSNX.0 size=1048576 2024-09-12T00:17:35.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.234+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~YWG59Z00PSNX.1 size=907890 2024-09-12T00:17:35.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.234+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=YWG59Z00PSNX tag=KBC4OT1L37QN type=write size=3005042 2024-09-12T00:17:35.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.238+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~5NM5UK1YHFUP.0 size=1048576 2024-09-12T00:17:35.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.242+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~5NM5UK1YHFUP.1 size=574613 2024-09-12T00:17:35.246 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.246+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=5NM5UK1YHFUP tag=82LTBL79W79Q type=write size=2671765 2024-09-12T00:17:35.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.254+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~I9Y2TQJ53NP7.0 size=1048576 2024-09-12T00:17:35.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.254+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~I9Y2TQJ53NP7.1 size=1048576 2024-09-12T00:17:35.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.258+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~I9Y2TQJ53NP7.2 size=830855 2024-09-12T00:17:35.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.258+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=I9Y2TQJ53NP7 tag=XJE9I9D5F340 type=write size=3976583 2024-09-12T00:17:35.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.262+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=0V2NOBD8O0BY type=del 2024-09-12T00:17:35.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.266+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=ZJKDCJVVWM7J type=del size=3850749 2024-09-12T00:17:35.268 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.270+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~0ZTKB66JNQO6.0 size=1048576 2024-09-12T00:17:35.268 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.270+0000 7febed3678c0 1 < canceled part key=_multipart_H017KWW59B8Z.2~0ZTKB66JNQO6.1 size=787717 2024-09-12T00:17:35.273 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.274+0000 7febed3678c0 1 < canceled multipart upload key=H017KWW59B8Z upload=0ZTKB66JNQO6 tag=VF85P43ZEKKQ type=write size=2884869 2024-09-12T00:17:35.279 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.282+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~4AQG610BHWSL.0 size=1048576 2024-09-12T00:17:35.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.282+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~4AQG610BHWSL.1 size=1048576 2024-09-12T00:17:35.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.286+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~4AQG610BHWSL.2 size=290310 2024-09-12T00:17:35.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.286+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=4AQG610BHWSL tag=92PI9PS0KTVC type=write size=3436038 2024-09-12T00:17:35.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.290+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~ANBZUQDRVQO5.0 size=1048576 2024-09-12T00:17:35.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.290+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~ANBZUQDRVQO5.1 size=555646 2024-09-12T00:17:35.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.298+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=ANBZUQDRVQO5 tag=QBSJ5X0K9PX2 type=write size=2652798 2024-09-12T00:17:35.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.302+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=4H9HQMNB7MR0 type=write size=945903 2024-09-12T00:17:35.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.306+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=O11750ZFY8CV type=del 2024-09-12T00:17:35.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.306+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=MC2WWTSHQKER type=del size=3921356 2024-09-12T00:17:35.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.310+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~PLIV9UCQOSIA.0 size=1048576 2024-09-12T00:17:35.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.314+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~PLIV9UCQOSIA.1 size=5522 2024-09-12T00:17:35.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.318+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=PLIV9UCQOSIA tag=F9MCBGC0Y30R type=write size=2102674 2024-09-12T00:17:35.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.322+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=Z79IEJK19GXO type=del size=931140 2024-09-12T00:17:35.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.326+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=F8YME3LCB0QA type=del 2024-09-12T00:17:35.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.330+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=32ZQ7GFQHWJS type=del size=2973770 2024-09-12T00:17:35.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.334+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=EY8JXXMBG296 type=del 2024-09-12T00:17:35.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.338+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~MESIBUUNQ8LG.0 size=1048576 2024-09-12T00:17:35.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.342+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~MESIBUUNQ8LG.1 size=1048576 2024-09-12T00:17:35.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.346+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~MESIBUUNQ8LG.2 size=771460 2024-09-12T00:17:35.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.346+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=MESIBUUNQ8LG tag=TJ0RPR4PW4MT type=write size=3917188 2024-09-12T00:17:35.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.346+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=2Q0UTG1ZX2JU type=del 2024-09-12T00:17:35.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.350+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=CVM1F64K59SL type=write size=900474 2024-09-12T00:17:35.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.354+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~WNLQ0K9L7RL8.0 size=1048576 2024-09-12T00:17:35.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.358+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~WNLQ0K9L7RL8.1 size=1048576 2024-09-12T00:17:35.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.362+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~WNLQ0K9L7RL8.2 size=562604 2024-09-12T00:17:35.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.366+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=WNLQ0K9L7RL8 tag=OQ9IBLNBKRLU type=write size=3708332 2024-09-12T00:17:35.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.366+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=V9YE0059DIV0 type=del size=2954849 2024-09-12T00:17:35.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.370+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~B1PL1ZJMABZD.0 size=1048576 2024-09-12T00:17:35.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.374+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~B1PL1ZJMABZD.1 size=1015849 2024-09-12T00:17:35.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.378+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=B1PL1ZJMABZD tag=XG0WUUWLSB75 type=write size=3113001 2024-09-12T00:17:35.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.382+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~GHU4CJCOI18V.0 size=1048576 2024-09-12T00:17:35.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.382+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~GHU4CJCOI18V.1 size=1048576 2024-09-12T00:17:35.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.386+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~GHU4CJCOI18V.2 size=337749 2024-09-12T00:17:35.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.386+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=GHU4CJCOI18V tag=EOYVK54FUF2Q type=write size=3483477 2024-09-12T00:17:35.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.390+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~88CR3BFOI83S.0 size=960329 2024-09-12T00:17:35.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.394+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=88CR3BFOI83S tag=6ULD6D5AKRR1 type=write size=2008905 2024-09-12T00:17:35.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.398+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~THUJMIMEKBYV.0 size=338122 2024-09-12T00:17:35.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.398+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=THUJMIMEKBYV tag=V3Q2LVHMUPUP type=write size=1386698 2024-09-12T00:17:35.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.402+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=FR7XTLCO3U7A type=del 2024-09-12T00:17:35.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.406+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~0GIBB30SGJ2Y.0 size=25351 2024-09-12T00:17:35.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.406+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=0GIBB30SGJ2Y tag=HGG51LA9459K type=write size=1073927 2024-09-12T00:17:35.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.410+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~0WY1VSFG9SLD.0 size=1048576 2024-09-12T00:17:35.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.410+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~0WY1VSFG9SLD.1 size=1030206 2024-09-12T00:17:35.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.414+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=0WY1VSFG9SLD tag=I3QLSVZEGSKV type=write size=3127358 2024-09-12T00:17:35.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.418+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=XL09AEL0N4P0 type=del size=1683447 2024-09-12T00:17:35.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.422+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~I9I2L1FBFV2F.0 size=985245 2024-09-12T00:17:35.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.426+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=I9I2L1FBFV2F tag=V5136JNFY8P3 type=write size=2033821 2024-09-12T00:17:35.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.430+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=CX0JIZ7PLQEY type=del size=1771811 2024-09-12T00:17:35.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.430+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~YWG59Z00PSNX.0 size=1048576 2024-09-12T00:17:35.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.434+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~YWG59Z00PSNX.1 size=907890 2024-09-12T00:17:35.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.438+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=YWG59Z00PSNX tag=KBC4OT1L37QN type=write size=3005042 2024-09-12T00:17:35.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.442+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~DQB4RLTT6YFJ.0 size=1048576 2024-09-12T00:17:35.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.446+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~DQB4RLTT6YFJ.1 size=200200 2024-09-12T00:17:35.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.446+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=DQB4RLTT6YFJ tag=18VLW71ZZU1C type=write size=2297352 2024-09-12T00:17:35.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.450+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~I9Y2TQJ53NP7.0 size=1048576 2024-09-12T00:17:35.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.450+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~I9Y2TQJ53NP7.1 size=1048576 2024-09-12T00:17:35.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.454+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~I9Y2TQJ53NP7.2 size=830855 2024-09-12T00:17:35.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.458+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=I9Y2TQJ53NP7 tag=XJE9I9D5F340 type=write size=3976583 2024-09-12T00:17:35.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.462+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~8UBYYAALJ891.0 size=533949 2024-09-12T00:17:35.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.462+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=8UBYYAALJ891 tag=SHOCULIBDYDK type=write size=1582525 2024-09-12T00:17:35.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.466+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=ZJKDCJVVWM7J type=del 2024-09-12T00:17:35.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.470+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~62R5DTGE5R3Y.0 size=1048576 2024-09-12T00:17:35.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.470+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~62R5DTGE5R3Y.1 size=156001 2024-09-12T00:17:35.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.470+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=62R5DTGE5R3Y tag=3A23URYZQZPL type=write size=2253153 2024-09-12T00:17:35.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.474+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~4AQG610BHWSL.0 size=1048576 2024-09-12T00:17:35.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.478+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~4AQG610BHWSL.1 size=1048576 2024-09-12T00:17:35.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.478+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~4AQG610BHWSL.2 size=290310 2024-09-12T00:17:35.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.486+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=4AQG610BHWSL tag=92PI9PS0KTVC type=write size=3436038 2024-09-12T00:17:35.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.486+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=XRT6M344PEKU type=del size=4121885 2024-09-12T00:17:35.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.490+0000 7febed3678c0 1 < completed write operation key=UGV3WQR0ADYH tag=4H9HQMNB7MR0 type=write size=945903 2024-09-12T00:17:35.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.494+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=AS28NHGOCRZ7 type=del size=3500093 2024-09-12T00:17:35.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.498+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=MC2WWTSHQKER type=del 2024-09-12T00:17:35.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.502+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~IQI03O1L0CQC.0 size=1048576 2024-09-12T00:17:35.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.502+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~IQI03O1L0CQC.1 size=996118 2024-09-12T00:17:35.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.502+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=IQI03O1L0CQC tag=W1QQ8FM069NL type=write size=3093270 2024-09-12T00:17:35.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.506+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=Z79IEJK19GXO type=del 2024-09-12T00:17:35.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.510+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=OS06PIAWAJWO type=del size=1084315 2024-09-12T00:17:35.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.510+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=32ZQ7GFQHWJS type=del 2024-09-12T00:17:35.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.514+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=7F286XCA7LE7 type=del size=1235748 2024-09-12T00:17:35.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.514+0000 7febed3678c0 1 < canceled part key=_multipart_Z020UV2JRR0I.2~MESIBUUNQ8LG.0 size=1048576 2024-09-12T00:17:35.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.514+0000 7febed3678c0 1 < canceled part key=_multipart_Z020UV2JRR0I.2~MESIBUUNQ8LG.1 size=1048576 2024-09-12T00:17:35.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.518+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~MESIBUUNQ8LG.2 size=771460 2024-09-12T00:17:35.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.522+0000 7febed3678c0 1 < canceled multipart upload key=Z020UV2JRR0I upload=MESIBUUNQ8LG tag=TJ0RPR4PW4MT type=write size=3917188 2024-09-12T00:17:35.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.526+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~TVF82PO7NFBZ.0 size=1048576 2024-09-12T00:17:35.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.526+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~TVF82PO7NFBZ.1 size=143301 2024-09-12T00:17:35.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.530+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=TVF82PO7NFBZ tag=FGCSHDMBWYTC type=write size=2240453 2024-09-12T00:17:35.532 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.534+0000 7febed3678c0 1 < suggested update operation key=KLO47UYYACLU tag=CVM1F64K59SL type=write size=900474 2024-09-12T00:17:35.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.534+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=A75VXMZB6RKQ type=del size=2738293 2024-09-12T00:17:35.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.542+0000 7febed3678c0 1 < suggested update operation key=MAZHOU2CEUCU tag=V9YE0059DIV0 type=del size=2954849 2024-09-12T00:17:35.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.546+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=N2XCBP2H9ZC1 type=del size=997539 2024-09-12T00:17:35.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.546+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~GHU4CJCOI18V.0 size=1048576 2024-09-12T00:17:35.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.550+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~GHU4CJCOI18V.1 size=1048576 2024-09-12T00:17:35.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.550+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~GHU4CJCOI18V.2 size=337749 2024-09-12T00:17:35.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.554+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=GHU4CJCOI18V tag=EOYVK54FUF2Q type=write size=3483477 2024-09-12T00:17:35.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.558+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=EL3R8UGN6AAU type=del size=2588698 2024-09-12T00:17:35.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.558+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~THUJMIMEKBYV.0 size=338122 2024-09-12T00:17:35.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.566+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=THUJMIMEKBYV tag=V3Q2LVHMUPUP type=write size=1386698 2024-09-12T00:17:35.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.570+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~E2CLVI29DO66.0 size=372702 2024-09-12T00:17:35.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.570+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=E2CLVI29DO66 tag=TA5D3Y26HYB3 type=write size=1421278 2024-09-12T00:17:35.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.570+0000 7febed3678c0 1 < canceled part key=_multipart_H017KWW59B8Z.2~0GIBB30SGJ2Y.0 size=25351 2024-09-12T00:17:35.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.574+0000 7febed3678c0 1 < canceled multipart upload key=H017KWW59B8Z upload=0GIBB30SGJ2Y tag=HGG51LA9459K type=write size=1073927 2024-09-12T00:17:35.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.574+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=Q41JQLXIMDZV type=del size=597561 2024-09-12T00:17:35.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.578+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=XL09AEL0N4P0 type=del 2024-09-12T00:17:35.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.582+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~OYUT50EH6J19.0 size=1048576 2024-09-12T00:17:35.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.586+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~OYUT50EH6J19.1 size=832316 2024-09-12T00:17:35.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.586+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=OYUT50EH6J19 tag=GC560OYZARDR type=write size=2929468 2024-09-12T00:17:35.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.586+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=CX0JIZ7PLQEY type=del 2024-09-12T00:17:35.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.590+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~TFR9ZZDEV5HX.0 size=1048576 2024-09-12T00:17:35.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.594+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~TFR9ZZDEV5HX.1 size=349363 2024-09-12T00:17:35.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.594+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=TFR9ZZDEV5HX tag=0ZBU763Q9X5B type=write size=2446515 2024-09-12T00:17:35.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.594+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~DQB4RLTT6YFJ.0 size=1048576 2024-09-12T00:17:35.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.598+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~DQB4RLTT6YFJ.1 size=200200 2024-09-12T00:17:35.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.602+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=DQB4RLTT6YFJ tag=18VLW71ZZU1C type=write size=2297352 2024-09-12T00:17:35.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.606+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~75V1LO1U7WJ8.0 size=1048576 2024-09-12T00:17:35.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.610+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~75V1LO1U7WJ8.1 size=799101 2024-09-12T00:17:35.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.610+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=75V1LO1U7WJ8 tag=PW845EL3TJEH type=write size=2896253 2024-09-12T00:17:35.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.610+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~8UBYYAALJ891.0 size=533949 2024-09-12T00:17:35.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.614+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=8UBYYAALJ891 tag=SHOCULIBDYDK type=write size=1582525 2024-09-12T00:17:35.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.622+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~0STCLABA1J9S.0 size=589078 2024-09-12T00:17:35.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.622+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=0STCLABA1J9S tag=AZL4L1BZQ7R1 type=write size=1637654 2024-09-12T00:17:35.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.622+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~62R5DTGE5R3Y.0 size=1048576 2024-09-12T00:17:35.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.626+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~62R5DTGE5R3Y.1 size=156001 2024-09-12T00:17:35.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.630+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=62R5DTGE5R3Y tag=3A23URYZQZPL type=write size=2253153 2024-09-12T00:17:35.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.630+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=TQ252OQDD6V1 type=del size=4151124 2024-09-12T00:17:35.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.634+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=XRT6M344PEKU type=del 2024-09-12T00:17:35.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.634+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=TV2CPSLPBNSN type=write size=491384 2024-09-12T00:17:35.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.638+0000 7febed3678c0 1 < suggested update operation key=53T1415UK7GE tag=AS28NHGOCRZ7 type=del size=3500093 2024-09-12T00:17:35.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.642+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~H2LBTDGW1JXD.0 size=951688 2024-09-12T00:17:35.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.642+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=H2LBTDGW1JXD tag=XVZU5ZSNC715 type=write size=2000264 2024-09-12T00:17:35.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.646+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~IQI03O1L0CQC.0 size=1048576 2024-09-12T00:17:35.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.646+0000 7febed3678c0 1 < canceled part key=_multipart_MAZHOU2CEUCU.2~IQI03O1L0CQC.1 size=996118 2024-09-12T00:17:35.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.650+0000 7febed3678c0 1 < canceled multipart upload key=MAZHOU2CEUCU upload=IQI03O1L0CQC tag=W1QQ8FM069NL type=write size=3093270 2024-09-12T00:17:35.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.654+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~ZW7AUJINKDF9.0 size=1048576 2024-09-12T00:17:35.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.658+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~ZW7AUJINKDF9.1 size=1048576 2024-09-12T00:17:35.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.658+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~ZW7AUJINKDF9.2 size=928732 2024-09-12T00:17:35.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.658+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=ZW7AUJINKDF9 tag=UVCAWTOZZADM type=write size=4074460 2024-09-12T00:17:35.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.662+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=OS06PIAWAJWO type=del 2024-09-12T00:17:35.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.666+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=4ZCSJYM0BBFY type=del size=388231 2024-09-12T00:17:35.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.666+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=7F286XCA7LE7 type=del 2024-09-12T00:17:35.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.670+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=U8UOGSJHSEM3 type=write size=395488 2024-09-12T00:17:35.672 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.674+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~TVF82PO7NFBZ.0 size=1048576 2024-09-12T00:17:35.674 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.674+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~TVF82PO7NFBZ.1 size=143301 2024-09-12T00:17:35.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.678+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=TVF82PO7NFBZ tag=FGCSHDMBWYTC type=write size=2240453 2024-09-12T00:17:35.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.682+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~WULP1IBAG0HW.0 size=343386 2024-09-12T00:17:35.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.682+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=WULP1IBAG0HW tag=SWNYJOQF6SB5 type=write size=1391962 2024-09-12T00:17:35.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.686+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=A75VXMZB6RKQ type=del 2024-09-12T00:17:35.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.690+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=80IJ07MH794B type=del size=1954007 2024-09-12T00:17:35.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.690+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=N2XCBP2H9ZC1 type=del 2024-09-12T00:17:35.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.694+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~ARFSCN4XWL9U.0 size=1048576 2024-09-12T00:17:35.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.698+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~ARFSCN4XWL9U.1 size=1048576 2024-09-12T00:17:35.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.698+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~ARFSCN4XWL9U.2 size=87834 2024-09-12T00:17:35.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.698+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=ARFSCN4XWL9U tag=D8ERXHKIADXA type=write size=3233562 2024-09-12T00:17:35.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.702+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=EL3R8UGN6AAU type=del 2024-09-12T00:17:35.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.706+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=JW1O5T658L69 type=write size=261153 2024-09-12T00:17:35.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.706+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~E2CLVI29DO66.0 size=372702 2024-09-12T00:17:35.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.710+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=E2CLVI29DO66 tag=TA5D3Y26HYB3 type=write size=1421278 2024-09-12T00:17:35.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.714+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=BGAZ50RD34J5 type=del size=522177 2024-09-12T00:17:35.715 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.714+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=Q41JQLXIMDZV type=del 2024-09-12T00:17:35.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.718+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=36OLMKBV19FQ type=write size=135649 2024-09-12T00:17:35.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.722+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~OYUT50EH6J19.0 size=1048576 2024-09-12T00:17:35.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.722+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~OYUT50EH6J19.1 size=832316 2024-09-12T00:17:35.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.726+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=OYUT50EH6J19 tag=GC560OYZARDR type=write size=2929468 2024-09-12T00:17:35.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.730+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=8N37CQY9UFQ8 type=del size=508806 2024-09-12T00:17:35.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.730+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~TFR9ZZDEV5HX.0 size=1048576 2024-09-12T00:17:35.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.734+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~TFR9ZZDEV5HX.1 size=349363 2024-09-12T00:17:35.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.738+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=TFR9ZZDEV5HX tag=0ZBU763Q9X5B type=write size=2446515 2024-09-12T00:17:35.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.738+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=02658692F9UX type=del size=1316550 2024-09-12T00:17:35.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.742+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~75V1LO1U7WJ8.0 size=1048576 2024-09-12T00:17:35.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.742+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~75V1LO1U7WJ8.1 size=799101 2024-09-12T00:17:35.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.746+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=75V1LO1U7WJ8 tag=PW845EL3TJEH type=write size=2896253 2024-09-12T00:17:35.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.750+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~80KCZ00WCWQ3.0 size=1048576 2024-09-12T00:17:35.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.754+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~80KCZ00WCWQ3.1 size=947208 2024-09-12T00:17:35.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.754+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=80KCZ00WCWQ3 tag=M1971XWP2B4O type=write size=3044360 2024-09-12T00:17:35.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.754+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~0STCLABA1J9S.0 size=589078 2024-09-12T00:17:35.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.758+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=0STCLABA1J9S tag=AZL4L1BZQ7R1 type=write size=1637654 2024-09-12T00:17:35.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.762+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=E64W33AEAI5P type=del size=1859295 2024-09-12T00:17:35.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.766+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=TQ252OQDD6V1 type=del 2024-09-12T00:17:35.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.770+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~8AOZ3K2IEQC2.0 size=1048576 2024-09-12T00:17:35.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.770+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~8AOZ3K2IEQC2.1 size=1048576 2024-09-12T00:17:35.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.774+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~8AOZ3K2IEQC2.2 size=176699 2024-09-12T00:17:35.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.774+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=8AOZ3K2IEQC2 tag=ZTRSDVTS3EU8 type=write size=3322427 2024-09-12T00:17:35.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.778+0000 7febed3678c0 1 < suggested remove operation key=VU1AF57EUA0R tag=TV2CPSLPBNSN type=write 2024-09-12T00:17:35.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.782+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~IPG9R2FJ6T3S.0 size=231874 2024-09-12T00:17:35.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.782+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=IPG9R2FJ6T3S tag=UEG2CW6MAQK9 type=write size=1280450 2024-09-12T00:17:35.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.786+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~H2LBTDGW1JXD.0 size=951688 2024-09-12T00:17:35.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.790+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=H2LBTDGW1JXD tag=XVZU5ZSNC715 type=write size=2000264 2024-09-12T00:17:35.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.794+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=74H7M56L1OJN type=del size=4162303 2024-09-12T00:17:35.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.798+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~ZW7AUJINKDF9.0 size=1048576 2024-09-12T00:17:35.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.798+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~ZW7AUJINKDF9.1 size=1048576 2024-09-12T00:17:35.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.798+0000 7febed3678c0 1 < canceled part key=_multipart_AHTIFXX3SGK7.2~ZW7AUJINKDF9.2 size=928732 2024-09-12T00:17:35.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.802+0000 7febed3678c0 1 < canceled multipart upload key=AHTIFXX3SGK7 upload=ZW7AUJINKDF9 tag=UVCAWTOZZADM type=write size=4074460 2024-09-12T00:17:35.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.806+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=KU5CAIFL3FMF type=del size=2077871 2024-09-12T00:17:35.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.810+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=4ZCSJYM0BBFY type=del 2024-09-12T00:17:35.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.810+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=YXOYWYG3552Q type=del size=2254200 2024-09-12T00:17:35.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.818+0000 7febed3678c0 1 < suggested update operation key=8RVDLW1VC8LP tag=U8UOGSJHSEM3 type=write size=395488 2024-09-12T00:17:35.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.822+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~EUICZA7ABU45.0 size=221438 2024-09-12T00:17:35.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.822+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=EUICZA7ABU45 tag=WIJ5YEHHV1I2 type=write size=1270014 2024-09-12T00:17:35.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.826+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~WULP1IBAG0HW.0 size=343386 2024-09-12T00:17:35.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.834+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=WULP1IBAG0HW tag=SWNYJOQF6SB5 type=write size=1391962 2024-09-12T00:17:35.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.838+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=JTOIQPSKEEB8 type=del size=578847 2024-09-12T00:17:35.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.838+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=80IJ07MH794B type=del 2024-09-12T00:17:35.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.846+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~CAC7Z3RTCAGF.0 size=1048576 2024-09-12T00:17:35.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.846+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~CAC7Z3RTCAGF.1 size=1048576 2024-09-12T00:17:35.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.850+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~CAC7Z3RTCAGF.2 size=33053 2024-09-12T00:17:35.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.850+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=CAC7Z3RTCAGF tag=4K6NY220QQAN type=write size=3178781 2024-09-12T00:17:35.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.854+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~ARFSCN4XWL9U.0 size=1048576 2024-09-12T00:17:35.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.854+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~ARFSCN4XWL9U.1 size=1048576 2024-09-12T00:17:35.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.858+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~ARFSCN4XWL9U.2 size=87834 2024-09-12T00:17:35.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.862+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=ARFSCN4XWL9U tag=D8ERXHKIADXA type=write size=3233562 2024-09-12T00:17:35.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.866+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=8K4WZI4YALDM type=del size=1990065 2024-09-12T00:17:35.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.866+0000 7febed3678c0 1 < completed write operation key=1HABX7YZ491W tag=JW1O5T658L69 type=write size=261153 2024-09-12T00:17:35.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.870+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=8O3KQMV5MSUR type=del size=413472 2024-09-12T00:17:35.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.874+0000 7febed3678c0 -1 < failed to complete operation key=VU1AF57EUA0R tag=BGAZ50RD34J5 type=del size=522177: (22) Invalid argument 2024-09-12T00:17:35.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.878+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=0KPWKD4RE5NG type=write size=752789 2024-09-12T00:17:35.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.878+0000 7febed3678c0 1 < completed write operation key=88BY5RHXSHD4 tag=36OLMKBV19FQ type=write size=135649 2024-09-12T00:17:35.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.882+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=9IFZD7Z45ZME type=del size=3641341 2024-09-12T00:17:35.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.886+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=8N37CQY9UFQ8 type=del 2024-09-12T00:17:35.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.890+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~WCUYG63HHGI7.0 size=1048576 2024-09-12T00:17:35.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.890+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~WCUYG63HHGI7.1 size=1048576 2024-09-12T00:17:35.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.894+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~WCUYG63HHGI7.2 size=1032279 2024-09-12T00:17:35.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.894+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=WCUYG63HHGI7 tag=7HV6LIMFISZ7 type=write size=4178007 2024-09-12T00:17:35.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.898+0000 7febed3678c0 -1 < failed to complete operation key=VU1AF57EUA0R tag=02658692F9UX type=del size=1316550: (22) Invalid argument 2024-09-12T00:17:35.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.902+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=JXATQY32D5E1 type=del size=419723 2024-09-12T00:17:35.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.902+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~80KCZ00WCWQ3.0 size=1048576 2024-09-12T00:17:35.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.906+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~80KCZ00WCWQ3.1 size=947208 2024-09-12T00:17:35.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.910+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=80KCZ00WCWQ3 tag=M1971XWP2B4O type=write size=3044360 2024-09-12T00:17:35.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.914+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~ERK7A9TYEVRS.0 size=1004958 2024-09-12T00:17:35.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.914+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=ERK7A9TYEVRS tag=O84TRBIQ2ZPF type=write size=2053534 2024-09-12T00:17:35.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.918+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=E64W33AEAI5P type=del 2024-09-12T00:17:35.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.922+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~38T5S8CKJ1NK.0 size=1048576 2024-09-12T00:17:35.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.926+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~38T5S8CKJ1NK.1 size=1048576 2024-09-12T00:17:35.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.930+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~38T5S8CKJ1NK.2 size=985283 2024-09-12T00:17:35.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.930+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=38T5S8CKJ1NK tag=TRY8QGA9KEH8 type=write size=4131011 2024-09-12T00:17:35.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.930+0000 7febed3678c0 1 < canceled part key=_multipart_52SSW5KTCS15.2~8AOZ3K2IEQC2.0 size=1048576 2024-09-12T00:17:35.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.930+0000 7febed3678c0 1 < canceled part key=_multipart_52SSW5KTCS15.2~8AOZ3K2IEQC2.1 size=1048576 2024-09-12T00:17:35.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.930+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~8AOZ3K2IEQC2.2 size=176699 2024-09-12T00:17:35.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.934+0000 7febed3678c0 1 < canceled multipart upload key=52SSW5KTCS15 upload=8AOZ3K2IEQC2 tag=ZTRSDVTS3EU8 type=write size=3322427 2024-09-12T00:17:35.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.938+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=XMGEXPUESDPV type=del size=2741013 2024-09-12T00:17:35.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.938+0000 7febed3678c0 1 < canceled part key=_multipart_MLPN8PH72VQ9.2~IPG9R2FJ6T3S.0 size=231874 2024-09-12T00:17:35.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.942+0000 7febed3678c0 1 < canceled multipart upload key=MLPN8PH72VQ9 upload=IPG9R2FJ6T3S tag=UEG2CW6MAQK9 type=write size=1280450 2024-09-12T00:17:35.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.950+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~ECVYSD0XZ0WO.0 size=735569 2024-09-12T00:17:35.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.950+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=ECVYSD0XZ0WO tag=O14891309OAN type=write size=1784145 2024-09-12T00:17:35.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.954+0000 7febed3678c0 1 < suggested remove operation key=ASFLGSKWYHG5 tag=74H7M56L1OJN type=del 2024-09-12T00:17:35.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.958+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~CK1X4DISBOLG.0 size=607399 2024-09-12T00:17:35.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.958+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=CK1X4DISBOLG tag=3FEQI02M3XI2 type=write size=1655975 2024-09-12T00:17:35.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.962+0000 7febed3678c0 -1 < failed to complete operation key=8RVDLW1VC8LP tag=KU5CAIFL3FMF type=del size=2077871: (22) Invalid argument 2024-09-12T00:17:35.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.966+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~IX224BO1X3EG.0 size=113405 2024-09-12T00:17:35.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.966+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=IX224BO1X3EG tag=AMI9IWGGLTOL type=write size=1161981 2024-09-12T00:17:35.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.970+0000 7febed3678c0 1 < canceled operation key=MHS307JKNVCK tag=YXOYWYG3552Q type=del size=2254200 2024-09-12T00:17:35.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.974+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~ZSGDRIRJPVWA.0 size=1048576 2024-09-12T00:17:35.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.978+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~ZSGDRIRJPVWA.1 size=450860 2024-09-12T00:17:35.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.978+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=ZSGDRIRJPVWA tag=3KK0LB1FSXOZ type=write size=2548012 2024-09-12T00:17:35.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.978+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~EUICZA7ABU45.0 size=221438 2024-09-12T00:17:35.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.986+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=EUICZA7ABU45 tag=WIJ5YEHHV1I2 type=write size=1270014 2024-09-12T00:17:35.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.990+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~F6UKP1RVEG9P.0 size=1048576 2024-09-12T00:17:35.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.990+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~F6UKP1RVEG9P.1 size=1048576 2024-09-12T00:17:35.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.994+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~F6UKP1RVEG9P.2 size=757173 2024-09-12T00:17:35.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.994+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=F6UKP1RVEG9P tag=DSXL561P0GVI type=write size=3902901 2024-09-12T00:17:35.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:35.998+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=JTOIQPSKEEB8 type=del 2024-09-12T00:17:36.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.002+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~6SL2V3JU9MWJ.0 size=1048576 2024-09-12T00:17:36.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.002+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~6SL2V3JU9MWJ.1 size=117302 2024-09-12T00:17:36.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.002+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=6SL2V3JU9MWJ tag=3150O3SRSJ6G type=write size=2214454 2024-09-12T00:17:36.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.006+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~CAC7Z3RTCAGF.0 size=1048576 2024-09-12T00:17:36.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.010+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~CAC7Z3RTCAGF.1 size=1048576 2024-09-12T00:17:36.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.010+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~CAC7Z3RTCAGF.2 size=33053 2024-09-12T00:17:36.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.018+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=CAC7Z3RTCAGF tag=4K6NY220QQAN type=write size=3178781 2024-09-12T00:17:36.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.022+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=EIIRYIWJPT6R type=del size=3362752 2024-09-12T00:17:36.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.022+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=8K4WZI4YALDM type=del 2024-09-12T00:17:36.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.030+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~CI29B3LI9EUG.0 size=1048576 2024-09-12T00:17:36.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.034+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~CI29B3LI9EUG.1 size=489828 2024-09-12T00:17:36.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.034+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=CI29B3LI9EUG tag=R8AQVM91SWBT type=write size=2586980 2024-09-12T00:17:36.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.038+0000 7febed3678c0 1 < canceled operation key=KLO47UYYACLU tag=8O3KQMV5MSUR type=del size=413472 2024-09-12T00:17:36.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.042+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~0DKIHM4PO9O4.0 size=1048576 2024-09-12T00:17:36.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.046+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~0DKIHM4PO9O4.1 size=1048576 2024-09-12T00:17:36.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.046+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~0DKIHM4PO9O4.2 size=823147 2024-09-12T00:17:36.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.046+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=0DKIHM4PO9O4 tag=6FUSVSC23PO8 type=write size=3968875 2024-09-12T00:17:36.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.050+0000 7febed3678c0 1 < completed write operation key=VW69JRC5JYX5 tag=0KPWKD4RE5NG type=write size=752789 2024-09-12T00:17:36.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.054+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=CM20NA19ADRW type=del size=12195 2024-09-12T00:17:36.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.058+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=9IFZD7Z45ZME type=del 2024-09-12T00:17:36.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.058+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=UAYDUDLHVQ3P type=del size=2349137 2024-09-12T00:17:36.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.062+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~WCUYG63HHGI7.0 size=1048576 2024-09-12T00:17:36.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.062+0000 7febed3678c0 1 < canceled part key=_multipart_52SSW5KTCS15.2~WCUYG63HHGI7.1 size=1048576 2024-09-12T00:17:36.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.062+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~WCUYG63HHGI7.2 size=1032279 2024-09-12T00:17:36.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.070+0000 7febed3678c0 1 < canceled multipart upload key=52SSW5KTCS15 upload=WCUYG63HHGI7 tag=7HV6LIMFISZ7 type=write size=4178007 2024-09-12T00:17:36.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.070+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=MJOQ9LRQG684 type=write size=402145 2024-09-12T00:17:36.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.078+0000 7febed3678c0 1 < suggested remove operation key=CIOINUP503WY tag=JXATQY32D5E1 type=del 2024-09-12T00:17:36.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.078+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=1Y2F0B4BPDDG type=del size=3212856 2024-09-12T00:17:36.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.082+0000 7febed3678c0 1 < canceled part key=_multipart_G22WTRRGIQKE.2~ERK7A9TYEVRS.0 size=1004958 2024-09-12T00:17:36.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.086+0000 7febed3678c0 1 < canceled multipart upload key=G22WTRRGIQKE upload=ERK7A9TYEVRS tag=O84TRBIQ2ZPF type=write size=2053534 2024-09-12T00:17:36.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.090+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=EE20P895FRDX type=del size=2097568 2024-09-12T00:17:36.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.094+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~38T5S8CKJ1NK.0 size=1048576 2024-09-12T00:17:36.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.094+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~38T5S8CKJ1NK.1 size=1048576 2024-09-12T00:17:36.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.098+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~38T5S8CKJ1NK.2 size=985283 2024-09-12T00:17:36.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.106+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=38T5S8CKJ1NK tag=TRY8QGA9KEH8 type=write size=4131011 2024-09-12T00:17:36.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.110+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=41RDOPSHIXJL type=del size=3576623 2024-09-12T00:17:36.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.114+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=XMGEXPUESDPV type=del 2024-09-12T00:17:36.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.118+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~K4XST1NOB28X.0 size=1048576 2024-09-12T00:17:36.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.118+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~K4XST1NOB28X.1 size=275149 2024-09-12T00:17:36.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.118+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=K4XST1NOB28X tag=5WUH7YX6DHQ5 type=write size=2372301 2024-09-12T00:17:36.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.122+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~ECVYSD0XZ0WO.0 size=735569 2024-09-12T00:17:36.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.130+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=ECVYSD0XZ0WO tag=O14891309OAN type=write size=1784145 2024-09-12T00:17:36.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.134+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~ME8I0D82PUSN.0 size=1048576 2024-09-12T00:17:36.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.138+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~ME8I0D82PUSN.1 size=1048576 2024-09-12T00:17:36.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.138+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~ME8I0D82PUSN.2 size=971053 2024-09-12T00:17:36.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.138+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=ME8I0D82PUSN tag=KEE60VWJWIKH type=write size=4116781 2024-09-12T00:17:36.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.142+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~CK1X4DISBOLG.0 size=607399 2024-09-12T00:17:36.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.146+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=CK1X4DISBOLG tag=3FEQI02M3XI2 type=write size=1655975 2024-09-12T00:17:36.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.154+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~UGY065M9YF1T.0 size=634576 2024-09-12T00:17:36.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.154+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=UGY065M9YF1T tag=VXUGL260RBUB type=write size=1683152 2024-09-12T00:17:36.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.158+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~IX224BO1X3EG.0 size=113405 2024-09-12T00:17:36.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.162+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=IX224BO1X3EG tag=AMI9IWGGLTOL type=write size=1161981 2024-09-12T00:17:36.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.166+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=Y2QG7J9CTS2N type=del size=2104288 2024-09-12T00:17:36.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.170+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~ZSGDRIRJPVWA.0 size=1048576 2024-09-12T00:17:36.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.170+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~ZSGDRIRJPVWA.1 size=450860 2024-09-12T00:17:36.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.178+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=ZSGDRIRJPVWA tag=3KK0LB1FSXOZ type=write size=2548012 2024-09-12T00:17:36.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.182+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=7TDFOWZJSM3D type=del size=1708093 2024-09-12T00:17:36.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.186+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~F6UKP1RVEG9P.0 size=1048576 2024-09-12T00:17:36.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.186+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~F6UKP1RVEG9P.1 size=1048576 2024-09-12T00:17:36.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.190+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~F6UKP1RVEG9P.2 size=757173 2024-09-12T00:17:36.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.194+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=F6UKP1RVEG9P tag=DSXL561P0GVI type=write size=3902901 2024-09-12T00:17:36.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.198+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=NYW1BK7KBUV0 type=del size=2394170 2024-09-12T00:17:36.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.202+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~6SL2V3JU9MWJ.0 size=1048576 2024-09-12T00:17:36.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.206+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~6SL2V3JU9MWJ.1 size=117302 2024-09-12T00:17:36.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.210+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=6SL2V3JU9MWJ tag=3150O3SRSJ6G type=write size=2214454 2024-09-12T00:17:36.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.214+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=U4UWMHR21S2P type=write size=740981 2024-09-12T00:17:36.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.218+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=EIIRYIWJPT6R type=del 2024-09-12T00:17:36.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.222+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=L61X6MNN5DVL type=del size=4142198 2024-09-12T00:17:36.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.226+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~CI29B3LI9EUG.0 size=1048576 2024-09-12T00:17:36.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.226+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~CI29B3LI9EUG.1 size=489828 2024-09-12T00:17:36.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.234+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=CI29B3LI9EUG tag=R8AQVM91SWBT type=write size=2586980 2024-09-12T00:17:36.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.238+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=JNZWOMZWNPKJ type=del size=377410 2024-09-12T00:17:36.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.242+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~0DKIHM4PO9O4.0 size=1048576 2024-09-12T00:17:36.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.242+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~0DKIHM4PO9O4.1 size=1048576 2024-09-12T00:17:36.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.246+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~0DKIHM4PO9O4.2 size=823147 2024-09-12T00:17:36.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.250+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=0DKIHM4PO9O4 tag=6FUSVSC23PO8 type=write size=3968875 2024-09-12T00:17:36.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.258+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~XJU4HG2E7L7V.0 size=1048576 2024-09-12T00:17:36.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.258+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~XJU4HG2E7L7V.1 size=40900 2024-09-12T00:17:36.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.258+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=XJU4HG2E7L7V tag=0A9S4O246JZU type=write size=2138052 2024-09-12T00:17:36.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.262+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=CM20NA19ADRW type=del 2024-09-12T00:17:36.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.270+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~POKF7MAR5U8V.0 size=1048576 2024-09-12T00:17:36.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.270+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~POKF7MAR5U8V.1 size=1048576 2024-09-12T00:17:36.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.274+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~POKF7MAR5U8V.2 size=64942 2024-09-12T00:17:36.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.274+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=POKF7MAR5U8V tag=LQQE2FMW02TT type=write size=3210670 2024-09-12T00:17:36.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.278+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=UAYDUDLHVQ3P type=del 2024-09-12T00:17:36.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.282+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~GVKIH2VA6TOU.0 size=61793 2024-09-12T00:17:36.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.282+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=GVKIH2VA6TOU tag=IRITHTT23F33 type=write size=1110369 2024-09-12T00:17:36.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.286+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=MJOQ9LRQG684 type=write size=402145 2024-09-12T00:17:36.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.290+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=Y3XLRPPBBCUI type=del size=3848306 2024-09-12T00:17:36.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.294+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=1Y2F0B4BPDDG type=del 2024-09-12T00:17:36.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.298+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=T86LB924DC0M type=write size=961399 2024-09-12T00:17:36.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.298+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=EE20P895FRDX type=del 2024-09-12T00:17:36.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.302+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=MWYHCRV8PIDS type=del size=2666017 2024-09-12T00:17:36.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.310+0000 7febed3678c0 1 < suggested update operation key=KLO47UYYACLU tag=41RDOPSHIXJL type=del size=3576623 2024-09-12T00:17:36.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.314+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=7D5124W1V0GW type=del size=1100969 2024-09-12T00:17:36.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.314+0000 7febed3678c0 1 < canceled part key=_multipart_70W3V7TFBUFJ.2~K4XST1NOB28X.0 size=1048576 2024-09-12T00:17:36.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.314+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~K4XST1NOB28X.1 size=275149 2024-09-12T00:17:36.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.322+0000 7febed3678c0 1 < canceled multipart upload key=70W3V7TFBUFJ upload=K4XST1NOB28X tag=5WUH7YX6DHQ5 type=write size=2372301 2024-09-12T00:17:36.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.326+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~CUL28KQ4TVGB.0 size=6592 2024-09-12T00:17:36.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.326+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=CUL28KQ4TVGB tag=61C7IVXBSISS type=write size=1055168 2024-09-12T00:17:36.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.330+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~ME8I0D82PUSN.0 size=1048576 2024-09-12T00:17:36.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.330+0000 7febed3678c0 1 < canceled part key=_multipart_4K65QIB9F00S.2~ME8I0D82PUSN.1 size=1048576 2024-09-12T00:17:36.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.334+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~ME8I0D82PUSN.2 size=971053 2024-09-12T00:17:36.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.338+0000 7febed3678c0 1 < canceled multipart upload key=4K65QIB9F00S upload=ME8I0D82PUSN tag=KEE60VWJWIKH type=write size=4116781 2024-09-12T00:17:36.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.346+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~S8333PTSEQIF.0 size=1048576 2024-09-12T00:17:36.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.346+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~S8333PTSEQIF.1 size=1048576 2024-09-12T00:17:36.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.350+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~S8333PTSEQIF.2 size=522895 2024-09-12T00:17:36.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.350+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=S8333PTSEQIF tag=EQ7BEN05PFVR type=write size=3668623 2024-09-12T00:17:36.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.354+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~UGY065M9YF1T.0 size=634576 2024-09-12T00:17:36.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.358+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=UGY065M9YF1T tag=VXUGL260RBUB type=write size=1683152 2024-09-12T00:17:36.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.362+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~SG83M3VN9UOU.0 size=1048576 2024-09-12T00:17:36.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.366+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~SG83M3VN9UOU.1 size=1048576 2024-09-12T00:17:36.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.366+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~SG83M3VN9UOU.2 size=655090 2024-09-12T00:17:36.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.366+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=SG83M3VN9UOU tag=Q40OI6FFRZ2C type=write size=3800818 2024-09-12T00:17:36.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.370+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=Y2QG7J9CTS2N type=del 2024-09-12T00:17:36.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.374+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~0BRTP50FKFH3.0 size=1048576 2024-09-12T00:17:36.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.378+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~0BRTP50FKFH3.1 size=516144 2024-09-12T00:17:36.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.378+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=0BRTP50FKFH3 tag=OXFNEW3AMKS8 type=write size=2613296 2024-09-12T00:17:36.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.382+0000 7febed3678c0 1 < suggested remove operation key=ASFLGSKWYHG5 tag=7TDFOWZJSM3D type=del 2024-09-12T00:17:36.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.386+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=16BQQTD6EWN6 type=write size=472589 2024-09-12T00:17:36.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.390+0000 7febed3678c0 1 < canceled operation key=KABJD0GYBVF4 tag=NYW1BK7KBUV0 type=del size=2394170 2024-09-12T00:17:36.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.390+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=PECN8ZOMPA0D type=del size=62497 2024-09-12T00:17:36.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.398+0000 7febed3678c0 1 < completed write operation key=53T1415UK7GE tag=U4UWMHR21S2P type=write size=740981 2024-09-12T00:17:36.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.406+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~ZHJFMQJA2EJR.0 size=579268 2024-09-12T00:17:36.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.406+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=ZHJFMQJA2EJR tag=4XPM146TJ0PV type=write size=1627844 2024-09-12T00:17:36.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.410+0000 7febed3678c0 1 < suggested update operation key=UGV3WQR0ADYH tag=L61X6MNN5DVL type=del size=4142198 2024-09-12T00:17:36.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.414+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~34JQGH46EQ97.0 size=45537 2024-09-12T00:17:36.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.414+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=34JQGH46EQ97 tag=EKUWY911NARH type=write size=1094113 2024-09-12T00:17:36.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.418+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=JNZWOMZWNPKJ type=del 2024-09-12T00:17:36.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.422+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~N9TTJD56ECBC.0 size=1048576 2024-09-12T00:17:36.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.426+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~N9TTJD56ECBC.1 size=804522 2024-09-12T00:17:36.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.426+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=N9TTJD56ECBC tag=AJH8TWPFDGMM type=write size=2901674 2024-09-12T00:17:36.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.430+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~XJU4HG2E7L7V.0 size=1048576 2024-09-12T00:17:36.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.430+0000 7febed3678c0 1 < canceled part key=_multipart_70W3V7TFBUFJ.2~XJU4HG2E7L7V.1 size=40900 2024-09-12T00:17:36.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.434+0000 7febed3678c0 1 < canceled multipart upload key=70W3V7TFBUFJ upload=XJU4HG2E7L7V tag=0A9S4O246JZU type=write size=2138052 2024-09-12T00:17:36.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.438+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~PFH39J5VDDBO.0 size=1048576 2024-09-12T00:17:36.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.442+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~PFH39J5VDDBO.1 size=1048576 2024-09-12T00:17:36.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.442+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~PFH39J5VDDBO.2 size=286358 2024-09-12T00:17:36.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.442+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=PFH39J5VDDBO tag=3X7EV8A779X2 type=write size=3432086 2024-09-12T00:17:36.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.446+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~POKF7MAR5U8V.0 size=1048576 2024-09-12T00:17:36.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.450+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~POKF7MAR5U8V.1 size=1048576 2024-09-12T00:17:36.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.450+0000 7febed3678c0 1 < canceled part key=_multipart_VU1AF57EUA0R.2~POKF7MAR5U8V.2 size=64942 2024-09-12T00:17:36.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.454+0000 7febed3678c0 1 < canceled multipart upload key=VU1AF57EUA0R upload=POKF7MAR5U8V tag=LQQE2FMW02TT type=write size=3210670 2024-09-12T00:17:36.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.458+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=8PA5SQ795QQR type=del size=2826443 2024-09-12T00:17:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.462+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~GVKIH2VA6TOU.0 size=61793 2024-09-12T00:17:36.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.466+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=GVKIH2VA6TOU tag=IRITHTT23F33 type=write size=1110369 2024-09-12T00:17:36.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.470+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~400STARH91X6.0 size=1048576 2024-09-12T00:17:36.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.474+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~400STARH91X6.1 size=815880 2024-09-12T00:17:36.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.474+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=400STARH91X6 tag=U1XHH0CTRTPP type=write size=2913032 2024-09-12T00:17:36.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.478+0000 7febed3678c0 -1 < failed to complete operation key=KLO47UYYACLU tag=Y3XLRPPBBCUI type=del size=3848306: (22) Invalid argument 2024-09-12T00:17:36.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.482+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~2L64FE04J3Q7.0 size=1048576 2024-09-12T00:17:36.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.486+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~2L64FE04J3Q7.1 size=1048576 2024-09-12T00:17:36.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.490+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~2L64FE04J3Q7.2 size=951184 2024-09-12T00:17:36.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.490+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=2L64FE04J3Q7 tag=KU29GP7BF1B1 type=write size=4096912 2024-09-12T00:17:36.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.490+0000 7febed3678c0 1 < completed write operation key=LGFKY0CP299H tag=T86LB924DC0M type=write size=961399 2024-09-12T00:17:36.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.498+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~JZLAPXFX17LB.0 size=1048576 2024-09-12T00:17:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.498+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~JZLAPXFX17LB.1 size=347090 2024-09-12T00:17:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.498+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=JZLAPXFX17LB tag=CTC3RW0E1Y1H type=write size=2444242 2024-09-12T00:17:36.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.506+0000 7febed3678c0 1 < suggested update operation key=Z020UV2JRR0I tag=MWYHCRV8PIDS type=del size=2666017 2024-09-12T00:17:36.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.506+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=4C2U8MICK237 type=del size=1838007 2024-09-12T00:17:36.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.510+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=7D5124W1V0GW type=del 2024-09-12T00:17:36.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.514+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=O9FI0PH5AD4O type=del size=3415998 2024-09-12T00:17:36.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.514+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~CUL28KQ4TVGB.0 size=6592 2024-09-12T00:17:36.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.518+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=CUL28KQ4TVGB tag=61C7IVXBSISS type=write size=1055168 2024-09-12T00:17:36.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.526+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~9GS6OSMP864Y.0 size=1048576 2024-09-12T00:17:36.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.526+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~9GS6OSMP864Y.1 size=497369 2024-09-12T00:17:36.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.526+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=9GS6OSMP864Y tag=4TSRP1GN54LU type=write size=2594521 2024-09-12T00:17:36.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.530+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~S8333PTSEQIF.0 size=1048576 2024-09-12T00:17:36.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.534+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~S8333PTSEQIF.1 size=1048576 2024-09-12T00:17:36.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.534+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~S8333PTSEQIF.2 size=522895 2024-09-12T00:17:36.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.542+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=S8333PTSEQIF tag=EQ7BEN05PFVR type=write size=3668623 2024-09-12T00:17:36.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.542+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=5M89R6QBNXH8 type=write size=993364 2024-09-12T00:17:36.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.546+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~SG83M3VN9UOU.0 size=1048576 2024-09-12T00:17:36.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.550+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~SG83M3VN9UOU.1 size=1048576 2024-09-12T00:17:36.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.550+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~SG83M3VN9UOU.2 size=655090 2024-09-12T00:17:36.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.558+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=SG83M3VN9UOU tag=Q40OI6FFRZ2C type=write size=3800818 2024-09-12T00:17:36.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.558+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=SJW86B9YAA4F type=del size=3898466 2024-09-12T00:17:36.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.558+0000 7febed3678c0 1 < canceled part key=_multipart_52SSW5KTCS15.2~0BRTP50FKFH3.0 size=1048576 2024-09-12T00:17:36.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.562+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~0BRTP50FKFH3.1 size=516144 2024-09-12T00:17:36.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.566+0000 7febed3678c0 1 < canceled multipart upload key=52SSW5KTCS15 upload=0BRTP50FKFH3 tag=OXFNEW3AMKS8 type=write size=2613296 2024-09-12T00:17:36.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.570+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=00MWNNWG4X3J type=del size=1942159 2024-09-12T00:17:36.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.574+0000 7febed3678c0 1 < suggested remove operation key=MAZHOU2CEUCU tag=16BQQTD6EWN6 type=write 2024-09-12T00:17:36.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.582+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~5O42FIMULMDC.0 size=1048576 2024-09-12T00:17:36.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.582+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~5O42FIMULMDC.1 size=1015153 2024-09-12T00:17:36.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.582+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=5O42FIMULMDC tag=LRXDIIKS1S0Q type=write size=3112305 2024-09-12T00:17:36.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.586+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=PECN8ZOMPA0D type=del 2024-09-12T00:17:36.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.594+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~4BHKPXDBUWCZ.0 size=1048576 2024-09-12T00:17:36.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.594+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~4BHKPXDBUWCZ.1 size=52022 2024-09-12T00:17:36.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.594+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=4BHKPXDBUWCZ tag=ZGQEQ1LMI690 type=write size=2149174 2024-09-12T00:17:36.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.598+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~ZHJFMQJA2EJR.0 size=579268 2024-09-12T00:17:36.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.606+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=ZHJFMQJA2EJR tag=4XPM146TJ0PV type=write size=1627844 2024-09-12T00:17:36.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.610+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=IZTED6E9948P type=del size=1349508 2024-09-12T00:17:36.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.610+0000 7febed3678c0 1 < canceled part key=_multipart_MHS307JKNVCK.2~34JQGH46EQ97.0 size=45537 2024-09-12T00:17:36.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.614+0000 7febed3678c0 1 < canceled multipart upload key=MHS307JKNVCK upload=34JQGH46EQ97 tag=EKUWY911NARH type=write size=1094113 2024-09-12T00:17:36.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.618+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=EZ0P5LZ3BPH3 type=del size=184477 2024-09-12T00:17:36.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.622+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~N9TTJD56ECBC.0 size=1048576 2024-09-12T00:17:36.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.622+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~N9TTJD56ECBC.1 size=804522 2024-09-12T00:17:36.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.626+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=N9TTJD56ECBC tag=AJH8TWPFDGMM type=write size=2901674 2024-09-12T00:17:36.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.630+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=61EERTNOWJC3 type=del size=2715485 2024-09-12T00:17:36.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.634+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~PFH39J5VDDBO.0 size=1048576 2024-09-12T00:17:36.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.638+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~PFH39J5VDDBO.1 size=1048576 2024-09-12T00:17:36.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.638+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~PFH39J5VDDBO.2 size=286358 2024-09-12T00:17:36.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.642+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=PFH39J5VDDBO tag=3X7EV8A779X2 type=write size=3432086 2024-09-12T00:17:36.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.650+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~2GA91OTJX5ST.0 size=1048576 2024-09-12T00:17:36.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.654+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~2GA91OTJX5ST.1 size=1048576 2024-09-12T00:17:36.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.654+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~2GA91OTJX5ST.2 size=266429 2024-09-12T00:17:36.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.654+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=2GA91OTJX5ST tag=IQ07R5JCIWAM type=write size=3412157 2024-09-12T00:17:36.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.662+0000 7febed3678c0 1 < suggested update operation key=AHTIFXX3SGK7 tag=8PA5SQ795QQR type=del size=2826443 2024-09-12T00:17:36.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.662+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=NIWUQRYC2872 type=del size=3615800 2024-09-12T00:17:36.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.666+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~400STARH91X6.0 size=1048576 2024-09-12T00:17:36.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.670+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~400STARH91X6.1 size=815880 2024-09-12T00:17:36.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.678+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=400STARH91X6 tag=U1XHH0CTRTPP type=write size=2913032 2024-09-12T00:17:36.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.682+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=HRFZGD3JUIG9 type=del size=2506008 2024-09-12T00:17:36.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.682+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~2L64FE04J3Q7.0 size=1048576 2024-09-12T00:17:36.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.686+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~2L64FE04J3Q7.1 size=1048576 2024-09-12T00:17:36.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.690+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~2L64FE04J3Q7.2 size=951184 2024-09-12T00:17:36.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.694+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=2L64FE04J3Q7 tag=KU29GP7BF1B1 type=write size=4096912 2024-09-12T00:17:36.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.698+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=KXZYUC4X5F88 type=del size=2512497 2024-09-12T00:17:36.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.702+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~JZLAPXFX17LB.0 size=1048576 2024-09-12T00:17:36.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.702+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~JZLAPXFX17LB.1 size=347090 2024-09-12T00:17:36.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.706+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=JZLAPXFX17LB tag=CTC3RW0E1Y1H type=write size=2444242 2024-09-12T00:17:36.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.710+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=7K7WINMAO2K0 type=del size=2879759 2024-09-12T00:17:36.714 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.714+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=4C2U8MICK237 type=del 2024-09-12T00:17:36.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.722+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~ZQVK57PSP23F.0 size=1048576 2024-09-12T00:17:36.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.722+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~ZQVK57PSP23F.1 size=431245 2024-09-12T00:17:36.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.722+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=ZQVK57PSP23F tag=HN97WDHG6BJH type=write size=2528397 2024-09-12T00:17:36.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.726+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=O9FI0PH5AD4O type=del 2024-09-12T00:17:36.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.730+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=22OXYXDTWD0Z type=del size=923133 2024-09-12T00:17:36.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.730+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~9GS6OSMP864Y.0 size=1048576 2024-09-12T00:17:36.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.734+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~9GS6OSMP864Y.1 size=497369 2024-09-12T00:17:36.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.738+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=9GS6OSMP864Y tag=4TSRP1GN54LU type=write size=2594521 2024-09-12T00:17:36.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.746+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~JL2KYGPT2ZJM.0 size=1048576 2024-09-12T00:17:36.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.746+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~JL2KYGPT2ZJM.1 size=1048576 2024-09-12T00:17:36.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.750+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~JL2KYGPT2ZJM.2 size=513122 2024-09-12T00:17:36.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.750+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=JL2KYGPT2ZJM tag=NTZYFI27H27F type=write size=3658850 2024-09-12T00:17:36.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.754+0000 7febed3678c0 1 < completed write operation key=9HCKHF5ZRZ5N tag=5M89R6QBNXH8 type=write size=993364 2024-09-12T00:17:36.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.758+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=OQKKXY60GQ3I type=del size=1119152 2024-09-12T00:17:36.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.758+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=SJW86B9YAA4F type=del 2024-09-12T00:17:36.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.766+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~P8V5BUVKWA4F.0 size=345976 2024-09-12T00:17:36.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.766+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=P8V5BUVKWA4F tag=AOTW3G6Z9BYI type=write size=1394552 2024-09-12T00:17:36.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.774+0000 7febed3678c0 1 < suggested update operation key=CIOINUP503WY tag=00MWNNWG4X3J type=del size=1942159 2024-09-12T00:17:36.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.778+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=EKSRLY7JN6U2 type=write size=174314 2024-09-12T00:17:36.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.778+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~5O42FIMULMDC.0 size=1048576 2024-09-12T00:17:36.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.782+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~5O42FIMULMDC.1 size=1015153 2024-09-12T00:17:36.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.786+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=5O42FIMULMDC tag=LRXDIIKS1S0Q type=write size=3112305 2024-09-12T00:17:36.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.790+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=NJ8DVG3OVHN5 type=del size=479271 2024-09-12T00:17:36.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.794+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~4BHKPXDBUWCZ.0 size=1048576 2024-09-12T00:17:36.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.794+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~4BHKPXDBUWCZ.1 size=52022 2024-09-12T00:17:36.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.802+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=4BHKPXDBUWCZ tag=ZGQEQ1LMI690 type=write size=2149174 2024-09-12T00:17:36.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.806+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~ZY8S1HKX5KO0.0 size=1048576 2024-09-12T00:17:36.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.810+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~ZY8S1HKX5KO0.1 size=615446 2024-09-12T00:17:36.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.810+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=ZY8S1HKX5KO0 tag=DB3TQUCSTX5R type=write size=2712598 2024-09-12T00:17:36.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.814+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=IZTED6E9948P type=del 2024-09-12T00:17:36.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.818+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~3P5QABC8IREB.0 size=1048576 2024-09-12T00:17:36.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.822+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~3P5QABC8IREB.1 size=1048576 2024-09-12T00:17:36.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.822+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~3P5QABC8IREB.2 size=127976 2024-09-12T00:17:36.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.822+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=3P5QABC8IREB tag=CYRMEJEJK82K type=write size=3273704 2024-09-12T00:17:36.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.826+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=EZ0P5LZ3BPH3 type=del 2024-09-12T00:17:36.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.830+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=OKZIPPDHHL7X type=del size=3917468 2024-09-12T00:17:36.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.830+0000 7febed3678c0 1 < canceled operation key=LGFKY0CP299H tag=61EERTNOWJC3 type=del size=2715485 2024-09-12T00:17:36.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.834+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=56H4S5YPO327 type=del size=2819027 2024-09-12T00:17:36.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.834+0000 7febed3678c0 1 < canceled part key=_multipart_4K65QIB9F00S.2~2GA91OTJX5ST.0 size=1048576 2024-09-12T00:17:36.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.834+0000 7febed3678c0 1 < canceled part key=_multipart_4K65QIB9F00S.2~2GA91OTJX5ST.1 size=1048576 2024-09-12T00:17:36.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.838+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~2GA91OTJX5ST.2 size=266429 2024-09-12T00:17:36.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.842+0000 7febed3678c0 1 < canceled multipart upload key=4K65QIB9F00S upload=2GA91OTJX5ST tag=IQ07R5JCIWAM type=write size=3412157 2024-09-12T00:17:36.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.846+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=KHFNIJHRC1G3 type=del size=2143197 2024-09-12T00:17:36.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.850+0000 7febed3678c0 1 < suggested remove operation key=MLPN8PH72VQ9 tag=NIWUQRYC2872 type=del 2024-09-12T00:17:36.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.854+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=0ESS3TEPCIO3 type=del size=3658338 2024-09-12T00:17:36.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.858+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=HRFZGD3JUIG9 type=del 2024-09-12T00:17:36.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.862+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=Q9XUP2TYSFYA type=del size=2815005 2024-09-12T00:17:36.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.866+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=KXZYUC4X5F88 type=del 2024-09-12T00:17:36.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.866+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=0IG1DRUCMTYP type=write size=549361 2024-09-12T00:17:36.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.870+0000 7febed3678c0 1 < canceled operation key=0KQK1CXHO096 tag=7K7WINMAO2K0 type=del size=2879759 2024-09-12T00:17:36.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.874+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=FNHE251YORXP type=del size=1612258 2024-09-12T00:17:36.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.878+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~ZQVK57PSP23F.0 size=1048576 2024-09-12T00:17:36.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.878+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~ZQVK57PSP23F.1 size=431245 2024-09-12T00:17:36.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.882+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=ZQVK57PSP23F tag=HN97WDHG6BJH type=write size=2528397 2024-09-12T00:17:36.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.890+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~UQBFA4ZH0DPC.0 size=1048576 2024-09-12T00:17:36.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.890+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~UQBFA4ZH0DPC.1 size=322427 2024-09-12T00:17:36.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.890+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=UQBFA4ZH0DPC tag=31TIU1O2WG73 type=write size=2419579 2024-09-12T00:17:36.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.894+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=22OXYXDTWD0Z type=del 2024-09-12T00:17:36.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.898+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=PKM5XGNZG198 type=write size=907258 2024-09-12T00:17:36.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.898+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~JL2KYGPT2ZJM.0 size=1048576 2024-09-12T00:17:36.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.902+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~JL2KYGPT2ZJM.1 size=1048576 2024-09-12T00:17:36.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.902+0000 7febed3678c0 1 < canceled part key=_multipart_KLO47UYYACLU.2~JL2KYGPT2ZJM.2 size=513122 2024-09-12T00:17:36.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.906+0000 7febed3678c0 1 < canceled multipart upload key=KLO47UYYACLU upload=JL2KYGPT2ZJM tag=NTZYFI27H27F type=write size=3658850 2024-09-12T00:17:36.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.910+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=DK2IFAVXGNQM type=del size=1981919 2024-09-12T00:17:36.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.918+0000 7febed3678c0 1 < suggested remove operation key=HR9MVC82R7GL tag=OQKKXY60GQ3I type=del 2024-09-12T00:17:36.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.922+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~3H066HR4KTD1.0 size=1048576 2024-09-12T00:17:36.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.926+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~3H066HR4KTD1.1 size=1048576 2024-09-12T00:17:36.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.926+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~3H066HR4KTD1.2 size=862346 2024-09-12T00:17:36.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.926+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=3H066HR4KTD1 tag=M572I30CDACI type=write size=4008074 2024-09-12T00:17:36.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.930+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~P8V5BUVKWA4F.0 size=345976 2024-09-12T00:17:36.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.934+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=P8V5BUVKWA4F tag=AOTW3G6Z9BYI type=write size=1394552 2024-09-12T00:17:36.937 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.938+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=R6INWMRPX1ZZ type=del size=1631256 2024-09-12T00:17:36.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.942+0000 7febed3678c0 1 < completed write operation key=88BY5RHXSHD4 tag=EKSRLY7JN6U2 type=write size=174314 2024-09-12T00:17:36.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.946+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~210F9K4WCLH6.0 size=1048576 2024-09-12T00:17:36.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.950+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~210F9K4WCLH6.1 size=1048576 2024-09-12T00:17:36.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.950+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~210F9K4WCLH6.2 size=707772 2024-09-12T00:17:36.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.950+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=210F9K4WCLH6 tag=Q3WVLEOPW0C9 type=write size=3853500 2024-09-12T00:17:36.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.962+0000 7febed3678c0 1 < suggested remove operation key=H017KWW59B8Z tag=NJ8DVG3OVHN5 type=del 2024-09-12T00:17:36.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.966+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=CB10ZRPKCKK5 type=del size=3741826 2024-09-12T00:17:36.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.966+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~ZY8S1HKX5KO0.0 size=1048576 2024-09-12T00:17:36.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.970+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~ZY8S1HKX5KO0.1 size=615446 2024-09-12T00:17:36.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.974+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=ZY8S1HKX5KO0 tag=DB3TQUCSTX5R type=write size=2712598 2024-09-12T00:17:36.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.978+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=GETEJM2UD7PM type=del size=1019516 2024-09-12T00:17:36.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.982+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~3P5QABC8IREB.0 size=1048576 2024-09-12T00:17:36.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.982+0000 7febed3678c0 1 < canceled part key=_multipart_88BY5RHXSHD4.2~3P5QABC8IREB.1 size=1048576 2024-09-12T00:17:36.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.982+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~3P5QABC8IREB.2 size=127976 2024-09-12T00:17:36.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.990+0000 7febed3678c0 1 < canceled multipart upload key=88BY5RHXSHD4 upload=3P5QABC8IREB tag=CYRMEJEJK82K type=write size=3273704 2024-09-12T00:17:36.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.994+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~XYOPTYZQKLCB.0 size=1048576 2024-09-12T00:17:36.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:36.998+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~XYOPTYZQKLCB.1 size=1048576 2024-09-12T00:17:37.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.002+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~XYOPTYZQKLCB.2 size=657051 2024-09-12T00:17:37.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.002+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=XYOPTYZQKLCB tag=4ADSKEIDUMMP type=write size=3802779 2024-09-12T00:17:37.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.006+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=OKZIPPDHHL7X type=del 2024-09-12T00:17:37.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.010+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=F04DEE4AZ91A type=del size=3550620 2024-09-12T00:17:37.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.010+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=56H4S5YPO327 type=del 2024-09-12T00:17:37.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.018+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~V4PRNKWP73MC.0 size=1048576 2024-09-12T00:17:37.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.022+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~V4PRNKWP73MC.1 size=734186 2024-09-12T00:17:37.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.022+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=V4PRNKWP73MC tag=1R26FJLHGZW4 type=write size=2831338 2024-09-12T00:17:37.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.026+0000 7febed3678c0 1 < suggested remove operation key=4K65QIB9F00S tag=KHFNIJHRC1G3 type=del 2024-09-12T00:17:37.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.034+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~327KHK18H7UM.0 size=1048576 2024-09-12T00:17:37.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.038+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~327KHK18H7UM.1 size=1048576 2024-09-12T00:17:37.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.038+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~327KHK18H7UM.2 size=346145 2024-09-12T00:17:37.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.038+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=327KHK18H7UM tag=5LAJMS3W7T2W type=write size=3491873 2024-09-12T00:17:37.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.042+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=0ESS3TEPCIO3 type=del 2024-09-12T00:17:37.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.046+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=6D7OJRWL0U4Q type=del size=2620467 2024-09-12T00:17:37.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.050+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=Q9XUP2TYSFYA type=del 2024-09-12T00:17:37.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.054+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~DL1WUC2W61QU.0 size=567282 2024-09-12T00:17:37.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.054+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=DL1WUC2W61QU tag=G7RJFVDWDMT8 type=write size=1615858 2024-09-12T00:17:37.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.062+0000 7febed3678c0 1 < suggested remove operation key=LGFKY0CP299H tag=0IG1DRUCMTYP type=write 2024-09-12T00:17:37.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.066+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=1MYG343OORMZ type=del size=3316980 2024-09-12T00:17:37.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.070+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=FNHE251YORXP type=del 2024-09-12T00:17:37.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.074+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=29M7V5TJO59G type=del size=1585599 2024-09-12T00:17:37.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.078+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~UQBFA4ZH0DPC.0 size=1048576 2024-09-12T00:17:37.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.078+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~UQBFA4ZH0DPC.1 size=322427 2024-09-12T00:17:37.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.086+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=UQBFA4ZH0DPC tag=31TIU1O2WG73 type=write size=2419579 2024-09-12T00:17:37.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.090+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~33B8FSD5YVJR.0 size=1048576 2024-09-12T00:17:37.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.094+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~33B8FSD5YVJR.1 size=1048576 2024-09-12T00:17:37.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.098+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~33B8FSD5YVJR.2 size=635613 2024-09-12T00:17:37.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.098+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=33B8FSD5YVJR tag=I9VTQHK1RIYN type=write size=3781341 2024-09-12T00:17:37.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.098+0000 7febed3678c0 -1 < failed to complete operation key=HR9MVC82R7GL tag=PKM5XGNZG198 type=write size=907258: (22) Invalid argument 2024-09-12T00:17:37.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.102+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=5JDX5TNOUBMT type=write size=485158 2024-09-12T00:17:37.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.110+0000 7febed3678c0 1 < suggested remove operation key=CIOINUP503WY tag=DK2IFAVXGNQM type=del 2024-09-12T00:17:37.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.114+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=X3HLLHN3TB4N type=del size=1609744 2024-09-12T00:17:37.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.114+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~3H066HR4KTD1.0 size=1048576 2024-09-12T00:17:37.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.118+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~3H066HR4KTD1.1 size=1048576 2024-09-12T00:17:37.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.122+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~3H066HR4KTD1.2 size=862346 2024-09-12T00:17:37.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.126+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=3H066HR4KTD1 tag=M572I30CDACI type=write size=4008074 2024-09-12T00:17:37.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.130+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=OFPZ830TAWJB type=del size=714265 2024-09-12T00:17:37.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.134+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=R6INWMRPX1ZZ type=del 2024-09-12T00:17:37.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.138+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=ERQU3MMDS5OA type=del size=2818810 2024-09-12T00:17:37.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.142+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~210F9K4WCLH6.0 size=1048576 2024-09-12T00:17:37.142 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.142+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~210F9K4WCLH6.1 size=1048576 2024-09-12T00:17:37.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.146+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~210F9K4WCLH6.2 size=707772 2024-09-12T00:17:37.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.150+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=210F9K4WCLH6 tag=Q3WVLEOPW0C9 type=write size=3853500 2024-09-12T00:17:37.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.154+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=UHWR190XQIII type=del size=2111343 2024-09-12T00:17:37.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.158+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=CB10ZRPKCKK5 type=del 2024-09-12T00:17:37.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.162+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~B0KYAUIFOTKM.0 size=1048576 2024-09-12T00:17:37.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.166+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~B0KYAUIFOTKM.1 size=96837 2024-09-12T00:17:37.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.166+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=B0KYAUIFOTKM tag=NZDRAT0FCT3J type=write size=2193989 2024-09-12T00:17:37.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.170+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=GETEJM2UD7PM type=del 2024-09-12T00:17:37.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.174+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~5WQZ857HSU2E.0 size=616979 2024-09-12T00:17:37.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.174+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=5WQZ857HSU2E tag=5D7SBACF66E9 type=write size=1665555 2024-09-12T00:17:37.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.174+0000 7febed3678c0 1 < canceled part key=_multipart_Z020UV2JRR0I.2~XYOPTYZQKLCB.0 size=1048576 2024-09-12T00:17:37.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.178+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~XYOPTYZQKLCB.1 size=1048576 2024-09-12T00:17:37.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.178+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~XYOPTYZQKLCB.2 size=657051 2024-09-12T00:17:37.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.186+0000 7febed3678c0 1 < canceled multipart upload key=Z020UV2JRR0I upload=XYOPTYZQKLCB tag=4ADSKEIDUMMP type=write size=3802779 2024-09-12T00:17:37.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.190+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~NAE5CCBHPFIS.0 size=1048576 2024-09-12T00:17:37.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.194+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~NAE5CCBHPFIS.1 size=902655 2024-09-12T00:17:37.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.194+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=NAE5CCBHPFIS tag=NSMPKU06KE7W type=write size=2999807 2024-09-12T00:17:37.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.198+0000 7febed3678c0 1 < canceled operation key=Z020UV2JRR0I tag=F04DEE4AZ91A type=del size=3550620 2024-09-12T00:17:37.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.198+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=FVB0EH1K5G7J type=del size=1278793 2024-09-12T00:17:37.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.202+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~V4PRNKWP73MC.0 size=1048576 2024-09-12T00:17:37.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.202+0000 7febed3678c0 1 < canceled part key=_multipart_25THATWGX4WS.2~V4PRNKWP73MC.1 size=734186 2024-09-12T00:17:37.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.210+0000 7febed3678c0 1 < canceled multipart upload key=25THATWGX4WS upload=V4PRNKWP73MC tag=1R26FJLHGZW4 type=write size=2831338 2024-09-12T00:17:37.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.214+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~YB78K88QCW34.0 size=1048576 2024-09-12T00:17:37.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.218+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~YB78K88QCW34.1 size=494168 2024-09-12T00:17:37.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.218+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=YB78K88QCW34 tag=VMZ5GRQ66S3L type=write size=2591320 2024-09-12T00:17:37.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.218+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~327KHK18H7UM.0 size=1048576 2024-09-12T00:17:37.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.222+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~327KHK18H7UM.1 size=1048576 2024-09-12T00:17:37.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.226+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~327KHK18H7UM.2 size=346145 2024-09-12T00:17:37.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.230+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=327KHK18H7UM tag=5LAJMS3W7T2W type=write size=3491873 2024-09-12T00:17:37.235 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.234+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~0YG5ZNWO8FKH.0 size=1048576 2024-09-12T00:17:37.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.238+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~0YG5ZNWO8FKH.1 size=1048576 2024-09-12T00:17:37.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.242+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~0YG5ZNWO8FKH.2 size=438721 2024-09-12T00:17:37.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.242+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=0YG5ZNWO8FKH tag=AK355H0UV37E type=write size=3584449 2024-09-12T00:17:37.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.246+0000 7febed3678c0 1 < suggested update operation key=LWAMFA0RSW6S tag=6D7OJRWL0U4Q type=del size=2620467 2024-09-12T00:17:37.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.250+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=8PE1KXNX7HEQ type=del size=116090 2024-09-12T00:17:37.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.250+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~DL1WUC2W61QU.0 size=567282 2024-09-12T00:17:37.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.262+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=DL1WUC2W61QU tag=G7RJFVDWDMT8 type=write size=1615858 2024-09-12T00:17:37.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.262+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=2POSAHMPNUKM type=del size=811038 2024-09-12T00:17:37.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.266+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=1MYG343OORMZ type=del 2024-09-12T00:17:37.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.270+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~IUJBBL2JT61G.0 size=1048576 2024-09-12T00:17:37.273 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.274+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~IUJBBL2JT61G.1 size=11750 2024-09-12T00:17:37.273 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.274+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=IUJBBL2JT61G tag=HDFPJBRWNBZ6 type=write size=2108902 2024-09-12T00:17:37.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.278+0000 7febed3678c0 1 < canceled operation key=88BY5RHXSHD4 tag=29M7V5TJO59G type=del size=1585599 2024-09-12T00:17:37.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.282+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~16IE6FDTAWT6.0 size=1048576 2024-09-12T00:17:37.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.286+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~16IE6FDTAWT6.1 size=1048576 2024-09-12T00:17:37.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.290+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~16IE6FDTAWT6.2 size=933311 2024-09-12T00:17:37.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.290+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=16IE6FDTAWT6 tag=UAHO93Q7OH5P type=write size=4079039 2024-09-12T00:17:37.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.294+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~33B8FSD5YVJR.0 size=1048576 2024-09-12T00:17:37.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.294+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~33B8FSD5YVJR.1 size=1048576 2024-09-12T00:17:37.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.298+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~33B8FSD5YVJR.2 size=635613 2024-09-12T00:17:37.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.302+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=33B8FSD5YVJR tag=I9VTQHK1RIYN type=write size=3781341 2024-09-12T00:17:37.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.306+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=1JE0SWKU5JYR type=del size=1654318 2024-09-12T00:17:37.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.310+0000 7febed3678c0 1 < canceled operation key=9CBI4FHAT3H2 tag=5JDX5TNOUBMT type=write size=485158 2024-09-12T00:17:37.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.314+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=Q6SVBFRFSJUV type=del size=686031 2024-09-12T00:17:37.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.318+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=X3HLLHN3TB4N type=del 2024-09-12T00:17:37.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.322+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~ZTJOZ5Y1MC5W.0 size=1048576 2024-09-12T00:17:37.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.326+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~ZTJOZ5Y1MC5W.1 size=71347 2024-09-12T00:17:37.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.326+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=ZTJOZ5Y1MC5W tag=LDF0AOHQ4B4T type=write size=2168499 2024-09-12T00:17:37.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.326+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=OFPZ830TAWJB type=del 2024-09-12T00:17:37.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.330+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=E05ZUY27TAXK type=del size=528526 2024-09-12T00:17:37.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.334+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=ERQU3MMDS5OA type=del 2024-09-12T00:17:37.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.338+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=0TQH5N2Y3TGY type=write size=824364 2024-09-12T00:17:37.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.338+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=UHWR190XQIII type=del 2024-09-12T00:17:37.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.346+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~QUU9B3ZRW6J9.0 size=735354 2024-09-12T00:17:37.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.346+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=QUU9B3ZRW6J9 tag=A17JEMO786XC type=write size=1783930 2024-09-12T00:17:37.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.350+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~B0KYAUIFOTKM.0 size=1048576 2024-09-12T00:17:37.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.350+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~B0KYAUIFOTKM.1 size=96837 2024-09-12T00:17:37.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.358+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=B0KYAUIFOTKM tag=NZDRAT0FCT3J type=write size=2193989 2024-09-12T00:17:37.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.358+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=HQ1FH8A5369G type=write size=201532 2024-09-12T00:17:37.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.362+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~5WQZ857HSU2E.0 size=616979 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.366+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=5WQZ857HSU2E tag=5D7SBACF66E9 type=write size=1665555 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.370+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=XXPHSZ6R3UCC type=del size=664216 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.374+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~NAE5CCBHPFIS.0 size=1048576 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.374+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~NAE5CCBHPFIS.1 size=902655 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.378+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=NAE5CCBHPFIS tag=NSMPKU06KE7W type=write size=2999807 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.382+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=G26EWJREVUBV type=del size=1423369 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.386+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=FVB0EH1K5G7J type=del 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.390+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~L3OZI92XREVI.0 size=1048576 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.390+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~L3OZI92XREVI.1 size=727901 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.390+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=L3OZI92XREVI tag=OH061CK9J8D8 type=write size=2825053 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.394+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~YB78K88QCW34.0 size=1048576 2024-09-12T00:17:37.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.394+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~YB78K88QCW34.1 size=494168 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.398+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=YB78K88QCW34 tag=VMZ5GRQ66S3L type=write size=2591320 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.402+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=JOV3E7KCADHX type=del size=807105 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.406+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~0YG5ZNWO8FKH.0 size=1048576 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.406+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~0YG5ZNWO8FKH.1 size=1048576 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.410+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~0YG5ZNWO8FKH.2 size=438721 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.414+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=0YG5ZNWO8FKH tag=AK355H0UV37E type=write size=3584449 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.414+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=OE8DF07UKPPB type=del size=3164621 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.422+0000 7febed3678c0 1 < suggested update operation key=52SSW5KTCS15 tag=8PE1KXNX7HEQ type=del size=116090 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.426+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~M6X4XMDWRPAL.0 size=1048576 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.430+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~M6X4XMDWRPAL.1 size=625144 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.430+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=M6X4XMDWRPAL tag=YPR7PGOUQG7M type=write size=2722296 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.434+0000 7febed3678c0 1 < suggested remove operation key=8RVDLW1VC8LP tag=2POSAHMPNUKM type=del 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.438+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~XD1RSXMV9O8O.0 size=1048576 2024-09-12T00:17:37.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.442+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~XD1RSXMV9O8O.1 size=1048576 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.442+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~XD1RSXMV9O8O.2 size=825551 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.442+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=XD1RSXMV9O8O tag=597LP4FJP91S type=write size=3971279 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.446+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~IUJBBL2JT61G.0 size=1048576 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.446+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~IUJBBL2JT61G.1 size=11750 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.450+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=IUJBBL2JT61G tag=HDFPJBRWNBZ6 type=write size=2108902 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.454+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=S4IUOGN91PF5 type=del size=735983 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.458+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~16IE6FDTAWT6.0 size=1048576 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.458+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~16IE6FDTAWT6.1 size=1048576 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.462+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~16IE6FDTAWT6.2 size=933311 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.466+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=16IE6FDTAWT6 tag=UAHO93Q7OH5P type=write size=4079039 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.474+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~WXFGNVE1S3IF.0 size=757479 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.474+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=WXFGNVE1S3IF tag=XQLGVBGREBMW type=write size=1806055 2024-09-12T00:17:37.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.474+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=1JE0SWKU5JYR type=del 2024-09-12T00:17:37.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.482+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~UM7O4PO9DZT4.0 size=591 2024-09-12T00:17:37.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.482+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=UM7O4PO9DZT4 tag=ATWSXR9UQ2B5 type=write size=1049167 2024-09-12T00:17:37.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.482+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=Q6SVBFRFSJUV type=del 2024-09-12T00:17:37.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.490+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~U9C42DUV1I8E.0 size=1048576 2024-09-12T00:17:37.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.490+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~U9C42DUV1I8E.1 size=572775 2024-09-12T00:17:37.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.490+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=U9C42DUV1I8E tag=GT5H2DCP8D36 type=write size=2669927 2024-09-12T00:17:37.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.494+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~ZTJOZ5Y1MC5W.0 size=1048576 2024-09-12T00:17:37.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.494+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~ZTJOZ5Y1MC5W.1 size=71347 2024-09-12T00:17:37.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.498+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=ZTJOZ5Y1MC5W tag=LDF0AOHQ4B4T type=write size=2168499 2024-09-12T00:17:37.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.506+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~BH32HH90MIDD.0 size=1048576 2024-09-12T00:17:37.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.506+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~BH32HH90MIDD.1 size=1048576 2024-09-12T00:17:37.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.510+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~BH32HH90MIDD.2 size=800580 2024-09-12T00:17:37.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.510+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=BH32HH90MIDD tag=O23HTVHJ2USQ type=write size=3946308 2024-09-12T00:17:37.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.514+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=E05ZUY27TAXK type=del 2024-09-12T00:17:37.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.514+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=6GG6F6LLM38G type=del size=3117921 2024-09-12T00:17:37.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.518+0000 7febed3678c0 1 < completed write operation key=MLPN8PH72VQ9 tag=0TQH5N2Y3TGY type=write size=824364 2024-09-12T00:17:37.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.530+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~D4TG2YWAT1D8.0 size=1048576 2024-09-12T00:17:37.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.530+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~D4TG2YWAT1D8.1 size=832322 2024-09-12T00:17:37.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.530+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=D4TG2YWAT1D8 tag=DEGDNKRYDE0G type=write size=2929474 2024-09-12T00:17:37.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.534+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~QUU9B3ZRW6J9.0 size=735354 2024-09-12T00:17:37.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.538+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=QUU9B3ZRW6J9 tag=A17JEMO786XC type=write size=1783930 2024-09-12T00:17:37.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.542+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=GO7KRV42BFWN type=write size=720056 2024-09-12T00:17:37.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.546+0000 7febed3678c0 1 < completed write operation key=70W3V7TFBUFJ tag=HQ1FH8A5369G type=write size=201532 2024-09-12T00:17:37.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.550+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=5MK3ZVGKGDBO type=del size=1318190 2024-09-12T00:17:37.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.550+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=XXPHSZ6R3UCC type=del 2024-09-12T00:17:37.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.558+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~1PF6RQ9CRH0M.0 size=1048576 2024-09-12T00:17:37.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.558+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~1PF6RQ9CRH0M.1 size=1048576 2024-09-12T00:17:37.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.562+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~1PF6RQ9CRH0M.2 size=688758 2024-09-12T00:17:37.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.562+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=1PF6RQ9CRH0M tag=VKE412KR612K type=write size=3834486 2024-09-12T00:17:37.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.566+0000 7febed3678c0 1 < suggested update operation key=MHS307JKNVCK tag=G26EWJREVUBV type=del size=1423369 2024-09-12T00:17:37.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.570+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=4G4NFZ6Z0MFD type=del size=3273632 2024-09-12T00:17:37.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.574+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~L3OZI92XREVI.0 size=1048576 2024-09-12T00:17:37.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.574+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~L3OZI92XREVI.1 size=727901 2024-09-12T00:17:37.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.578+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=L3OZI92XREVI tag=OH061CK9J8D8 type=write size=2825053 2024-09-12T00:17:37.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.582+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=YLQDE5GNL1O0 type=del size=3603154 2024-09-12T00:17:37.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.582+0000 7febed3678c0 -1 < failed to complete operation key=8RVDLW1VC8LP tag=JOV3E7KCADHX type=del size=807105: (22) Invalid argument 2024-09-12T00:17:37.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.586+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=0NXT7Z77KEQP type=del size=177506 2024-09-12T00:17:37.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.590+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=OE8DF07UKPPB type=del 2024-09-12T00:17:37.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.594+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~AXFV88Y7ME5C.0 size=1032071 2024-09-12T00:17:37.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.594+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=AXFV88Y7ME5C tag=ZOKUGJVOB17P type=write size=2080647 2024-09-12T00:17:37.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.594+0000 7febed3678c0 1 < canceled part key=_multipart_VW69JRC5JYX5.2~M6X4XMDWRPAL.0 size=1048576 2024-09-12T00:17:37.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.594+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~M6X4XMDWRPAL.1 size=625144 2024-09-12T00:17:37.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.598+0000 7febed3678c0 1 < canceled multipart upload key=VW69JRC5JYX5 upload=M6X4XMDWRPAL tag=YPR7PGOUQG7M type=write size=2722296 2024-09-12T00:17:37.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.602+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=57P6F9CT3XAJ type=del size=4095384 2024-09-12T00:17:37.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.606+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~XD1RSXMV9O8O.0 size=1048576 2024-09-12T00:17:37.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.606+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~XD1RSXMV9O8O.1 size=1048576 2024-09-12T00:17:37.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.610+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~XD1RSXMV9O8O.2 size=825551 2024-09-12T00:17:37.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.614+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=XD1RSXMV9O8O tag=597LP4FJP91S type=write size=3971279 2024-09-12T00:17:37.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.614+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=MEEXU59UV7N4 type=del size=2221693 2024-09-12T00:17:37.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.622+0000 7febed3678c0 1 < suggested update operation key=W2VEW3JJEJY7 tag=S4IUOGN91PF5 type=del size=735983 2024-09-12T00:17:37.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.622+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=820LYGU2WC6V type=del size=434594 2024-09-12T00:17:37.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.622+0000 7febed3678c0 1 < canceled part key=_multipart_VW69JRC5JYX5.2~WXFGNVE1S3IF.0 size=757479 2024-09-12T00:17:37.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.630+0000 7febed3678c0 1 < canceled multipart upload key=VW69JRC5JYX5 upload=WXFGNVE1S3IF tag=XQLGVBGREBMW type=write size=1806055 2024-09-12T00:17:37.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.634+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~5G88FNJY0J87.0 size=1048576 2024-09-12T00:17:37.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.634+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~5G88FNJY0J87.1 size=979592 2024-09-12T00:17:37.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.634+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=5G88FNJY0J87 tag=8617M7ED7Y5R type=write size=3076744 2024-09-12T00:17:37.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.638+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~UM7O4PO9DZT4.0 size=591 2024-09-12T00:17:37.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.642+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=UM7O4PO9DZT4 tag=ATWSXR9UQ2B5 type=write size=1049167 2024-09-12T00:17:37.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.646+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~SFNBHMPNJ3HX.0 size=1048576 2024-09-12T00:17:37.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.646+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~SFNBHMPNJ3HX.1 size=1048576 2024-09-12T00:17:37.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.650+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~SFNBHMPNJ3HX.2 size=738802 2024-09-12T00:17:37.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.650+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=SFNBHMPNJ3HX tag=12DHMA8DMG0B type=write size=3884530 2024-09-12T00:17:37.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.650+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~U9C42DUV1I8E.0 size=1048576 2024-09-12T00:17:37.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.654+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~U9C42DUV1I8E.1 size=572775 2024-09-12T00:17:37.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.658+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=U9C42DUV1I8E tag=GT5H2DCP8D36 type=write size=2669927 2024-09-12T00:17:37.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.658+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=DQ0EEM3YYGK7 type=del size=671702 2024-09-12T00:17:37.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.662+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~BH32HH90MIDD.0 size=1048576 2024-09-12T00:17:37.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.662+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~BH32HH90MIDD.1 size=1048576 2024-09-12T00:17:37.664 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.666+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~BH32HH90MIDD.2 size=800580 2024-09-12T00:17:37.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.670+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=BH32HH90MIDD tag=O23HTVHJ2USQ type=write size=3946308 2024-09-12T00:17:37.673 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.674+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~Q6CNKMBKQF8Z.0 size=1048576 2024-09-12T00:17:37.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.674+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~Q6CNKMBKQF8Z.1 size=1048576 2024-09-12T00:17:37.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.678+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~Q6CNKMBKQF8Z.2 size=248902 2024-09-12T00:17:37.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.678+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=Q6CNKMBKQF8Z tag=6SAUA48KJ44G type=write size=3394630 2024-09-12T00:17:37.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.682+0000 7febed3678c0 1 < canceled operation key=AHTIFXX3SGK7 tag=6GG6F6LLM38G type=del size=3117921 2024-09-12T00:17:37.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.686+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~9N1PWFMMFWUD.0 size=1048576 2024-09-12T00:17:37.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.686+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~9N1PWFMMFWUD.1 size=1048576 2024-09-12T00:17:37.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.690+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~9N1PWFMMFWUD.2 size=299349 2024-09-12T00:17:37.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.690+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=9N1PWFMMFWUD tag=AX3WQLDHR0NS type=write size=3445077 2024-09-12T00:17:37.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.690+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~D4TG2YWAT1D8.0 size=1048576 2024-09-12T00:17:37.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.690+0000 7febed3678c0 1 < canceled part key=_multipart_LWAMFA0RSW6S.2~D4TG2YWAT1D8.1 size=832322 2024-09-12T00:17:37.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.694+0000 7febed3678c0 1 < canceled multipart upload key=LWAMFA0RSW6S upload=D4TG2YWAT1D8 tag=DEGDNKRYDE0G type=write size=2929474 2024-09-12T00:17:37.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.702+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~C71NCCEY149G.0 size=1048576 2024-09-12T00:17:37.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.702+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~C71NCCEY149G.1 size=1048576 2024-09-12T00:17:37.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.706+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~C71NCCEY149G.2 size=888351 2024-09-12T00:17:37.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.706+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=C71NCCEY149G tag=HHEAZMQPC6D2 type=write size=4034079 2024-09-12T00:17:37.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.706+0000 7febed3678c0 1 < completed write operation key=UGV3WQR0ADYH tag=GO7KRV42BFWN type=write size=720056 2024-09-12T00:17:37.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.710+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=PVW3I14U2XOD type=del size=3175396 2024-09-12T00:17:37.714 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.714+0000 7febed3678c0 1 < suggested remove operation key=MHS307JKNVCK tag=5MK3ZVGKGDBO type=del 2024-09-12T00:17:37.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.718+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=DM5E13EYVCGK type=write size=269236 2024-09-12T00:17:37.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.722+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~1PF6RQ9CRH0M.0 size=1048576 2024-09-12T00:17:37.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.722+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~1PF6RQ9CRH0M.1 size=1048576 2024-09-12T00:17:37.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.726+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~1PF6RQ9CRH0M.2 size=688758 2024-09-12T00:17:37.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.730+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=1PF6RQ9CRH0M tag=VKE412KR612K type=write size=3834486 2024-09-12T00:17:37.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.730+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=UF4J2SOCDZVT type=del size=2008784 2024-09-12T00:17:37.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.734+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=4G4NFZ6Z0MFD type=del 2024-09-12T00:17:37.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.738+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~Q04KOQ9LFUKA.0 size=1048576 2024-09-12T00:17:37.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.742+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~Q04KOQ9LFUKA.1 size=1048576 2024-09-12T00:17:37.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.742+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~Q04KOQ9LFUKA.2 size=181718 2024-09-12T00:17:37.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.742+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=Q04KOQ9LFUKA tag=IMGLYDYO3RJK type=write size=3327446 2024-09-12T00:17:37.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.746+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=YLQDE5GNL1O0 type=del 2024-09-12T00:17:37.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.750+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~6UGJH079AUQS.0 size=1048576 2024-09-12T00:17:37.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.754+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~6UGJH079AUQS.1 size=609418 2024-09-12T00:17:37.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.754+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=6UGJH079AUQS tag=EJ82ZNOB7YVL type=write size=2706570 2024-09-12T00:17:37.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.754+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=0NXT7Z77KEQP type=del 2024-09-12T00:17:37.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.762+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~IPSGDCQR0JRT.0 size=987008 2024-09-12T00:17:37.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.762+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=IPSGDCQR0JRT tag=JJWYFSG3PZZH type=write size=2035584 2024-09-12T00:17:37.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.766+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~AXFV88Y7ME5C.0 size=1032071 2024-09-12T00:17:37.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.770+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=AXFV88Y7ME5C tag=ZOKUGJVOB17P type=write size=2080647 2024-09-12T00:17:37.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.778+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~QMFIG0T0P15T.0 size=1048576 2024-09-12T00:17:37.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.778+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~QMFIG0T0P15T.1 size=216246 2024-09-12T00:17:37.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.778+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=QMFIG0T0P15T tag=8PUQXXG16C1E type=write size=2313398 2024-09-12T00:17:37.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.782+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=57P6F9CT3XAJ type=del 2024-09-12T00:17:37.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.786+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~QVNMY7WOSXWU.0 size=1048576 2024-09-12T00:17:37.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.790+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~QVNMY7WOSXWU.1 size=1048576 2024-09-12T00:17:37.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.790+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~QVNMY7WOSXWU.2 size=312237 2024-09-12T00:17:37.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.790+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=QVNMY7WOSXWU tag=BTVFKQD1RRXX type=write size=3457965 2024-09-12T00:17:37.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.794+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=MEEXU59UV7N4 type=del 2024-09-12T00:17:37.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.794+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=931RT20WF3SO type=del size=2962815 2024-09-12T00:17:37.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.798+0000 7febed3678c0 -1 < no bi entry to suggest for operation key=MHS307JKNVCK tag=820LYGU2WC6V type=del size=434594: (2) No such file or directory 2024-09-12T00:17:37.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.802+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~9NQIAL6ZUI4G.0 size=1048576 2024-09-12T00:17:37.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.806+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~9NQIAL6ZUI4G.1 size=1048576 2024-09-12T00:17:37.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.806+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~9NQIAL6ZUI4G.2 size=187075 2024-09-12T00:17:37.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.806+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=9NQIAL6ZUI4G tag=TO7Y57K40T50 type=write size=3332803 2024-09-12T00:17:37.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.810+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~5G88FNJY0J87.0 size=1048576 2024-09-12T00:17:37.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.810+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~5G88FNJY0J87.1 size=979592 2024-09-12T00:17:37.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.818+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=5G88FNJY0J87 tag=8617M7ED7Y5R type=write size=3076744 2024-09-12T00:17:37.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.822+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~62JIHJ6RMIN3.0 size=1048576 2024-09-12T00:17:37.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.826+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~62JIHJ6RMIN3.1 size=516403 2024-09-12T00:17:37.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.826+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=62JIHJ6RMIN3 tag=SQGUTPS5IAFL type=write size=2613555 2024-09-12T00:17:37.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.830+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~SFNBHMPNJ3HX.0 size=1048576 2024-09-12T00:17:37.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.830+0000 7febed3678c0 1 < canceled part key=_multipart_HR9MVC82R7GL.2~SFNBHMPNJ3HX.1 size=1048576 2024-09-12T00:17:37.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.830+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~SFNBHMPNJ3HX.2 size=738802 2024-09-12T00:17:37.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.834+0000 7febed3678c0 1 < canceled multipart upload key=HR9MVC82R7GL upload=SFNBHMPNJ3HX tag=12DHMA8DMG0B type=write size=3884530 2024-09-12T00:17:37.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.838+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=945TLSY7YQJ2 type=write size=1003413 2024-09-12T00:17:37.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.842+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=DQ0EEM3YYGK7 type=del 2024-09-12T00:17:37.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.846+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=9CTT3WGFGSSC type=write size=639567 2024-09-12T00:17:37.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.846+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~Q6CNKMBKQF8Z.0 size=1048576 2024-09-12T00:17:37.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.846+0000 7febed3678c0 1 < canceled part key=_multipart_UGV3WQR0ADYH.2~Q6CNKMBKQF8Z.1 size=1048576 2024-09-12T00:17:37.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.850+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~Q6CNKMBKQF8Z.2 size=248902 2024-09-12T00:17:37.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.858+0000 7febed3678c0 1 < canceled multipart upload key=UGV3WQR0ADYH upload=Q6CNKMBKQF8Z tag=6SAUA48KJ44G type=write size=3394630 2024-09-12T00:17:37.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.862+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~I01QA3H2IVCJ.0 size=459642 2024-09-12T00:17:37.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.862+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=I01QA3H2IVCJ tag=0Q0TGE07N5DU type=write size=1508218 2024-09-12T00:17:37.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.866+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~9N1PWFMMFWUD.0 size=1048576 2024-09-12T00:17:37.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.866+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~9N1PWFMMFWUD.1 size=1048576 2024-09-12T00:17:37.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.870+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~9N1PWFMMFWUD.2 size=299349 2024-09-12T00:17:37.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.874+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=9N1PWFMMFWUD tag=AX3WQLDHR0NS type=write size=3445077 2024-09-12T00:17:37.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.882+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~DVK2I7E8YVWK.0 size=1048576 2024-09-12T00:17:37.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.882+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~DVK2I7E8YVWK.1 size=1048576 2024-09-12T00:17:37.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.886+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~DVK2I7E8YVWK.2 size=333594 2024-09-12T00:17:37.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.886+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=DVK2I7E8YVWK tag=D3462VNWPAD9 type=write size=3479322 2024-09-12T00:17:37.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.890+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~C71NCCEY149G.0 size=1048576 2024-09-12T00:17:37.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.890+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~C71NCCEY149G.1 size=1048576 2024-09-12T00:17:37.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.890+0000 7febed3678c0 1 < canceled part key=_multipart_8RVDLW1VC8LP.2~C71NCCEY149G.2 size=888351 2024-09-12T00:17:37.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.898+0000 7febed3678c0 1 < canceled multipart upload key=8RVDLW1VC8LP upload=C71NCCEY149G tag=HHEAZMQPC6D2 type=write size=4034079 2024-09-12T00:17:37.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.902+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=E8I5Q5NINHPS type=del size=743004 2024-09-12T00:17:37.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.902+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=PVW3I14U2XOD type=del 2024-09-12T00:17:37.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.906+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=2YZ0FMQKA8R8 type=del size=1936025 2024-09-12T00:17:37.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.910+0000 7febed3678c0 1 < completed write operation key=3G9ABEEEDRI3 tag=DM5E13EYVCGK type=write size=269236 2024-09-12T00:17:37.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.914+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=PJT7471P78RL type=del size=1989313 2024-09-12T00:17:37.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.918+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=UF4J2SOCDZVT type=del 2024-09-12T00:17:37.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.922+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~F7LRE3ETEA4D.0 size=42057 2024-09-12T00:17:37.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.922+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=F7LRE3ETEA4D tag=P2T5E28GLTM3 type=write size=1090633 2024-09-12T00:17:37.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.926+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~Q04KOQ9LFUKA.0 size=1048576 2024-09-12T00:17:37.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.926+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~Q04KOQ9LFUKA.1 size=1048576 2024-09-12T00:17:37.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.930+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~Q04KOQ9LFUKA.2 size=181718 2024-09-12T00:17:37.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.934+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=Q04KOQ9LFUKA tag=IMGLYDYO3RJK type=write size=3327446 2024-09-12T00:17:37.937 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.938+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=QZ2G1SH8D0QU type=del size=3173093 2024-09-12T00:17:37.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.938+0000 7febed3678c0 1 < canceled part key=_multipart_1HABX7YZ491W.2~6UGJH079AUQS.0 size=1048576 2024-09-12T00:17:37.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.942+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~6UGJH079AUQS.1 size=609418 2024-09-12T00:17:37.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.946+0000 7febed3678c0 1 < canceled multipart upload key=1HABX7YZ491W upload=6UGJH079AUQS tag=EJ82ZNOB7YVL type=write size=2706570 2024-09-12T00:17:37.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.950+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=VFFOGF8HSNMQ type=write size=454108 2024-09-12T00:17:37.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.950+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~IPSGDCQR0JRT.0 size=987008 2024-09-12T00:17:37.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.958+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=IPSGDCQR0JRT tag=JJWYFSG3PZZH type=write size=2035584 2024-09-12T00:17:37.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.958+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=RNJCTFJ7I2FO type=del size=3901992 2024-09-12T00:17:37.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.962+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~QMFIG0T0P15T.0 size=1048576 2024-09-12T00:17:37.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.966+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~QMFIG0T0P15T.1 size=216246 2024-09-12T00:17:37.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.970+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=QMFIG0T0P15T tag=8PUQXXG16C1E type=write size=2313398 2024-09-12T00:17:37.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.974+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~13V3KI4W3D01.0 size=270880 2024-09-12T00:17:37.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.974+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=13V3KI4W3D01 tag=G8ETUZZ7NSYK type=write size=1319456 2024-09-12T00:17:37.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.978+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~QVNMY7WOSXWU.0 size=1048576 2024-09-12T00:17:37.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.978+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~QVNMY7WOSXWU.1 size=1048576 2024-09-12T00:17:37.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.982+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~QVNMY7WOSXWU.2 size=312237 2024-09-12T00:17:37.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.986+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=QVNMY7WOSXWU tag=BTVFKQD1RRXX type=write size=3457965 2024-09-12T00:17:37.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.990+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=A1W79KWQ3RIC type=del size=742124 2024-09-12T00:17:37.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.994+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=931RT20WF3SO type=del 2024-09-12T00:17:37.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.994+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=5QXFMEJQJEHU type=del size=3921500 2024-09-12T00:17:37.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:37.998+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~9NQIAL6ZUI4G.0 size=1048576 2024-09-12T00:17:38.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.002+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~9NQIAL6ZUI4G.1 size=1048576 2024-09-12T00:17:38.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.002+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~9NQIAL6ZUI4G.2 size=187075 2024-09-12T00:17:38.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.006+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=9NQIAL6ZUI4G tag=TO7Y57K40T50 type=write size=3332803 2024-09-12T00:17:38.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.010+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=XXSRFUIFFGTI type=del size=1637298 2024-09-12T00:17:38.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.010+0000 7febed3678c0 1 < canceled part key=_multipart_KLO47UYYACLU.2~62JIHJ6RMIN3.0 size=1048576 2024-09-12T00:17:38.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.010+0000 7febed3678c0 1 < canceled part key=_multipart_KLO47UYYACLU.2~62JIHJ6RMIN3.1 size=516403 2024-09-12T00:17:38.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.014+0000 7febed3678c0 1 < canceled multipart upload key=KLO47UYYACLU upload=62JIHJ6RMIN3 tag=SQGUTPS5IAFL type=write size=2613555 2024-09-12T00:17:38.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.018+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=EO3J2MTCZPI5 type=del size=2192418 2024-09-12T00:17:38.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.022+0000 7febed3678c0 1 < canceled operation key=88BY5RHXSHD4 tag=945TLSY7YQJ2 type=write size=1003413 2024-09-12T00:17:38.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.026+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~NS0OFPZES7NV.0 size=1048576 2024-09-12T00:17:38.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.026+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~NS0OFPZES7NV.1 size=1048576 2024-09-12T00:17:38.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.030+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~NS0OFPZES7NV.2 size=280079 2024-09-12T00:17:38.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.030+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=NS0OFPZES7NV tag=R48XWLU0LPFZ type=write size=3425807 2024-09-12T00:17:38.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.034+0000 7febed3678c0 1 < completed write operation key=9CBI4FHAT3H2 tag=9CTT3WGFGSSC type=write size=639567 2024-09-12T00:17:38.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.038+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=JQ2RZP1F31F5 type=del size=681685 2024-09-12T00:17:38.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.038+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~I01QA3H2IVCJ.0 size=459642 2024-09-12T00:17:38.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.046+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=I01QA3H2IVCJ tag=0Q0TGE07N5DU type=write size=1508218 2024-09-12T00:17:38.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.046+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=PSY3KMFRLF6H type=del size=1051764 2024-09-12T00:17:38.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.050+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~DVK2I7E8YVWK.0 size=1048576 2024-09-12T00:17:38.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.050+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~DVK2I7E8YVWK.1 size=1048576 2024-09-12T00:17:38.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.054+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~DVK2I7E8YVWK.2 size=333594 2024-09-12T00:17:38.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.058+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=DVK2I7E8YVWK tag=D3462VNWPAD9 type=write size=3479322 2024-09-12T00:17:38.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.062+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KIP71B090PDV.0 size=1048576 2024-09-12T00:17:38.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.066+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KIP71B090PDV.1 size=1048576 2024-09-12T00:17:38.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.070+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KIP71B090PDV.2 size=764388 2024-09-12T00:17:38.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.070+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=KIP71B090PDV tag=C335XSBZ5AME type=write size=3910116 2024-09-12T00:17:38.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.070+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=E8I5Q5NINHPS type=del 2024-09-12T00:17:38.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.074+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=H540ZVC8EZLW type=del size=3120537 2024-09-12T00:17:38.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.078+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=2YZ0FMQKA8R8 type=del 2024-09-12T00:17:38.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.082+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~1SW9R57TTBGV.0 size=491370 2024-09-12T00:17:38.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.082+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=1SW9R57TTBGV tag=TVOUXH5K6MMS type=write size=1539946 2024-09-12T00:17:38.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.086+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=PJT7471P78RL type=del 2024-09-12T00:17:38.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.090+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=012JINRYI0KY type=del size=429259 2024-09-12T00:17:38.091 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.094+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~F7LRE3ETEA4D.0 size=42057 2024-09-12T00:17:38.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.098+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=F7LRE3ETEA4D tag=P2T5E28GLTM3 type=write size=1090633 2024-09-12T00:17:38.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.102+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~N9271HJEFC2F.0 size=1048576 2024-09-12T00:17:38.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.106+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~N9271HJEFC2F.1 size=38459 2024-09-12T00:17:38.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.106+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=N9271HJEFC2F tag=7D37CPOS4C2S type=write size=2135611 2024-09-12T00:17:38.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.106+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=QZ2G1SH8D0QU type=del 2024-09-12T00:17:38.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.114+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~X53UBTNLHA3X.0 size=1048576 2024-09-12T00:17:38.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.114+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~X53UBTNLHA3X.1 size=949171 2024-09-12T00:17:38.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.114+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=X53UBTNLHA3X tag=C14MEP2YKPZ9 type=write size=3046323 2024-09-12T00:17:38.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.118+0000 7febed3678c0 1 < canceled operation key=52SSW5KTCS15 tag=VFFOGF8HSNMQ type=write size=454108 2024-09-12T00:17:38.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.122+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=SLYUYFDRMKJX type=del size=3441562 2024-09-12T00:17:38.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.122+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=RNJCTFJ7I2FO type=del 2024-09-12T00:17:38.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.126+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=CMFKG0ZVOW10 type=del size=310727 2024-09-12T00:17:38.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.130+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~13V3KI4W3D01.0 size=270880 2024-09-12T00:17:38.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.134+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=13V3KI4W3D01 tag=G8ETUZZ7NSYK type=write size=1319456 2024-09-12T00:17:38.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.138+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=PCV02KBFXC7E type=del size=2890100 2024-09-12T00:17:38.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.138+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=A1W79KWQ3RIC type=del 2024-09-12T00:17:38.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.146+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~L9XUUCCAWJJD.0 size=1048576 2024-09-12T00:17:38.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.146+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~L9XUUCCAWJJD.1 size=1048576 2024-09-12T00:17:38.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.150+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~L9XUUCCAWJJD.2 size=355384 2024-09-12T00:17:38.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.150+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=L9XUUCCAWJJD tag=E723HHOZ8A9F type=write size=3501112 2024-09-12T00:17:38.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.154+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=5QXFMEJQJEHU type=del 2024-09-12T00:17:38.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.154+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=K00GGOB266D8 type=del size=2029224 2024-09-12T00:17:38.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.158+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=XXSRFUIFFGTI type=del 2024-09-12T00:17:38.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.162+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~QI3VSVVQOHCG.0 size=1048576 2024-09-12T00:17:38.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.166+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~QI3VSVVQOHCG.1 size=10326 2024-09-12T00:17:38.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.166+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=QI3VSVVQOHCG tag=HDAL7KSPFE8W type=write size=2107478 2024-09-12T00:17:38.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.166+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=EO3J2MTCZPI5 type=del 2024-09-12T00:17:38.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.170+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=A8Y5ES22B2F0 type=del size=2840821 2024-09-12T00:17:38.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.174+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~NS0OFPZES7NV.0 size=1048576 2024-09-12T00:17:38.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.174+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~NS0OFPZES7NV.1 size=1048576 2024-09-12T00:17:38.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.178+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~NS0OFPZES7NV.2 size=280079 2024-09-12T00:17:38.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.182+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=NS0OFPZES7NV tag=R48XWLU0LPFZ type=write size=3425807 2024-09-12T00:17:38.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.190+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~E6NNM9PQ11QX.0 size=1048576 2024-09-12T00:17:38.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.190+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~E6NNM9PQ11QX.1 size=1048576 2024-09-12T00:17:38.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.194+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~E6NNM9PQ11QX.2 size=669608 2024-09-12T00:17:38.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.194+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=E6NNM9PQ11QX tag=G5ZQYQKO2FJB type=write size=3815336 2024-09-12T00:17:38.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.194+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=JQ2RZP1F31F5 type=del 2024-09-12T00:17:38.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.202+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~CUV406H0DGC0.0 size=888997 2024-09-12T00:17:38.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.202+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=CUV406H0DGC0 tag=HYZCKXKUV6EV type=write size=1937573 2024-09-12T00:17:38.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.202+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=PSY3KMFRLF6H type=del 2024-09-12T00:17:38.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.210+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~03AO2GE88THX.0 size=245861 2024-09-12T00:17:38.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.210+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=03AO2GE88THX tag=E9FBSIF944WU type=write size=1294437 2024-09-12T00:17:38.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.214+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~KIP71B090PDV.0 size=1048576 2024-09-12T00:17:38.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.214+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~KIP71B090PDV.1 size=1048576 2024-09-12T00:17:38.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.218+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~KIP71B090PDV.2 size=764388 2024-09-12T00:17:38.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.222+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=KIP71B090PDV tag=C335XSBZ5AME type=write size=3910116 2024-09-12T00:17:38.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.226+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=SPD8EUWUB1TE type=del size=436976 2024-09-12T00:17:38.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.230+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=H540ZVC8EZLW type=del 2024-09-12T00:17:38.234 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.234+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~0PS0CTEQC619.0 size=1048576 2024-09-12T00:17:38.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.238+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~0PS0CTEQC619.1 size=444260 2024-09-12T00:17:38.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.238+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=0PS0CTEQC619 tag=OAD1V2AUKR3X type=write size=2541412 2024-09-12T00:17:38.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.238+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~1SW9R57TTBGV.0 size=491370 2024-09-12T00:17:38.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.246+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=1SW9R57TTBGV tag=TVOUXH5K6MMS type=write size=1539946 2024-09-12T00:17:38.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.250+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~R9TK2UYOCOV7.0 size=1048576 2024-09-12T00:17:38.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.250+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~R9TK2UYOCOV7.1 size=894767 2024-09-12T00:17:38.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.250+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=R9TK2UYOCOV7 tag=QKIPSP0A6FKY type=write size=2991919 2024-09-12T00:17:38.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.254+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=012JINRYI0KY type=del 2024-09-12T00:17:38.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.258+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~J93X2WAUPXSV.0 size=748553 2024-09-12T00:17:38.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.258+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=J93X2WAUPXSV tag=5GIB3H14RCU3 type=write size=1797129 2024-09-12T00:17:38.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.262+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~N9271HJEFC2F.0 size=1048576 2024-09-12T00:17:38.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.266+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~N9271HJEFC2F.1 size=38459 2024-09-12T00:17:38.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.270+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=N9271HJEFC2F tag=7D37CPOS4C2S type=write size=2135611 2024-09-12T00:17:38.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.274+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=CY8ICM1PPX7G type=del size=9495 2024-09-12T00:17:38.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.274+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~X53UBTNLHA3X.0 size=1048576 2024-09-12T00:17:38.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.278+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~X53UBTNLHA3X.1 size=949171 2024-09-12T00:17:38.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.282+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=X53UBTNLHA3X tag=C14MEP2YKPZ9 type=write size=3046323 2024-09-12T00:17:38.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.286+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=3BKL4QA8H6N9 type=del size=3998302 2024-09-12T00:17:38.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.286+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=SLYUYFDRMKJX type=del 2024-09-12T00:17:38.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.294+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~9ZOQG5KK2VOL.0 size=1048576 2024-09-12T00:17:38.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.298+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~9ZOQG5KK2VOL.1 size=359857 2024-09-12T00:17:38.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.298+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=9ZOQG5KK2VOL tag=1EN79P4490L4 type=write size=2457009 2024-09-12T00:17:38.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.302+0000 7febed3678c0 1 < suggested remove operation key=1HABX7YZ491W tag=CMFKG0ZVOW10 type=del 2024-09-12T00:17:38.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.306+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~L1FLRNU587CU.0 size=390392 2024-09-12T00:17:38.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.306+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=L1FLRNU587CU tag=V4IV319GWC3E type=write size=1438968 2024-09-12T00:17:38.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.310+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=PCV02KBFXC7E type=del 2024-09-12T00:17:38.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.314+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~XT18IQGYB09X.0 size=1048576 2024-09-12T00:17:38.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.318+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~XT18IQGYB09X.1 size=1048576 2024-09-12T00:17:38.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.318+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~XT18IQGYB09X.2 size=624213 2024-09-12T00:17:38.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.318+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=XT18IQGYB09X tag=JV4HW2L6D2PQ type=write size=3769941 2024-09-12T00:17:38.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.318+0000 7febed3678c0 1 < canceled part key=_multipart_52SSW5KTCS15.2~L9XUUCCAWJJD.0 size=1048576 2024-09-12T00:17:38.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.322+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~L9XUUCCAWJJD.1 size=1048576 2024-09-12T00:17:38.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.322+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~L9XUUCCAWJJD.2 size=355384 2024-09-12T00:17:38.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.330+0000 7febed3678c0 1 < canceled multipart upload key=52SSW5KTCS15 upload=L9XUUCCAWJJD tag=E723HHOZ8A9F type=write size=3501112 2024-09-12T00:17:38.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.334+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~4Y5CLI61VTVJ.0 size=1048576 2024-09-12T00:17:38.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.338+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~4Y5CLI61VTVJ.1 size=87761 2024-09-12T00:17:38.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.338+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=4Y5CLI61VTVJ tag=ZADU9H9HKXEM type=write size=2184913 2024-09-12T00:17:38.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.338+0000 7febed3678c0 1 < canceled operation key=70W3V7TFBUFJ tag=K00GGOB266D8 type=del size=2029224 2024-09-12T00:17:38.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.342+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=KJFII4FSZ7MN type=del size=3736529 2024-09-12T00:17:38.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.346+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~QI3VSVVQOHCG.0 size=1048576 2024-09-12T00:17:38.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.346+0000 7febed3678c0 1 < canceled part key=_multipart_MLPN8PH72VQ9.2~QI3VSVVQOHCG.1 size=10326 2024-09-12T00:17:38.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.354+0000 7febed3678c0 1 < canceled multipart upload key=MLPN8PH72VQ9 upload=QI3VSVVQOHCG tag=HDAL7KSPFE8W type=write size=2107478 2024-09-12T00:17:38.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.354+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=HQQLR8KZ96DK type=del size=1681652 2024-09-12T00:17:38.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.358+0000 7febed3678c0 -1 < failed to complete operation key=1HABX7YZ491W tag=A8Y5ES22B2F0 type=del size=2840821: (22) Invalid argument 2024-09-12T00:17:38.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.362+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~YIVLHJ8S1GI3.0 size=1048576 2024-09-12T00:17:38.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.362+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~YIVLHJ8S1GI3.1 size=26802 2024-09-12T00:17:38.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.366+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=YIVLHJ8S1GI3 tag=6HN7VG99NBRA type=write size=2123954 2024-09-12T00:17:38.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.366+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~E6NNM9PQ11QX.0 size=1048576 2024-09-12T00:17:38.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.370+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~E6NNM9PQ11QX.1 size=1048576 2024-09-12T00:17:38.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.370+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~E6NNM9PQ11QX.2 size=669608 2024-09-12T00:17:38.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.374+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=E6NNM9PQ11QX tag=G5ZQYQKO2FJB type=write size=3815336 2024-09-12T00:17:38.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.378+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~4OKXURJDLP2H.0 size=1048576 2024-09-12T00:17:38.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.382+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~4OKXURJDLP2H.1 size=207727 2024-09-12T00:17:38.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.382+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=4OKXURJDLP2H tag=AE0Q99DWFBP4 type=write size=2304879 2024-09-12T00:17:38.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.386+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~CUV406H0DGC0.0 size=888997 2024-09-12T00:17:38.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.390+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=CUV406H0DGC0 tag=HYZCKXKUV6EV type=write size=1937573 2024-09-12T00:17:38.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.390+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=8UJOG9I2313J type=write size=320008 2024-09-12T00:17:38.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.394+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~03AO2GE88THX.0 size=245861 2024-09-12T00:17:38.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.398+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=03AO2GE88THX tag=E9FBSIF944WU type=write size=1294437 2024-09-12T00:17:38.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.398+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=YM5Q9UP31DTW type=write size=471910 2024-09-12T00:17:38.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.406+0000 7febed3678c0 1 < suggested remove operation key=8RVDLW1VC8LP tag=SPD8EUWUB1TE type=del 2024-09-12T00:17:38.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.410+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~SUJ6J0WO49MO.0 size=1048576 2024-09-12T00:17:38.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.410+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~SUJ6J0WO49MO.1 size=1048576 2024-09-12T00:17:38.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.414+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~SUJ6J0WO49MO.2 size=670812 2024-09-12T00:17:38.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.414+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=SUJ6J0WO49MO tag=Z56Q3YHVMF0K type=write size=3816540 2024-09-12T00:17:38.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.418+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~0PS0CTEQC619.0 size=1048576 2024-09-12T00:17:38.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.418+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~0PS0CTEQC619.1 size=444260 2024-09-12T00:17:38.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.422+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=0PS0CTEQC619 tag=OAD1V2AUKR3X type=write size=2541412 2024-09-12T00:17:38.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.426+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=367OZAQN0UPP type=write size=969617 2024-09-12T00:17:38.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.426+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~R9TK2UYOCOV7.0 size=1048576 2024-09-12T00:17:38.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.430+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~R9TK2UYOCOV7.1 size=894767 2024-09-12T00:17:38.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.434+0000 7febed3678c0 1 < completed multipart upload key=G22WTRRGIQKE upload=R9TK2UYOCOV7 tag=QKIPSP0A6FKY type=write size=2991919 2024-09-12T00:17:38.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.438+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~JN1JOZI163B1.0 size=1048576 2024-09-12T00:17:38.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.438+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~JN1JOZI163B1.1 size=1045481 2024-09-12T00:17:38.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.438+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=JN1JOZI163B1 tag=0NL7DUEQKQTO type=write size=3142633 2024-09-12T00:17:38.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.442+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~J93X2WAUPXSV.0 size=748553 2024-09-12T00:17:38.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.446+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=J93X2WAUPXSV tag=5GIB3H14RCU3 type=write size=1797129 2024-09-12T00:17:38.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.450+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=T7F6Z0GAYTQ4 type=del size=2086328 2024-09-12T00:17:38.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.450+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=CY8ICM1PPX7G type=del 2024-09-12T00:17:38.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.454+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=S7439DXFJQM9 type=del size=1417100 2024-09-12T00:17:38.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.454+0000 7febed3678c0 -1 < failed to complete operation key=1HABX7YZ491W tag=3BKL4QA8H6N9 type=del size=3998302: (22) Invalid argument 2024-09-12T00:17:38.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.462+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~ISOZDMF81LS4.0 size=614420 2024-09-12T00:17:38.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.462+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=ISOZDMF81LS4 tag=073MM1XJHM14 type=write size=1662996 2024-09-12T00:17:38.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.462+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~9ZOQG5KK2VOL.0 size=1048576 2024-09-12T00:17:38.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.466+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~9ZOQG5KK2VOL.1 size=359857 2024-09-12T00:17:38.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.470+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=9ZOQG5KK2VOL tag=1EN79P4490L4 type=write size=2457009 2024-09-12T00:17:38.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.474+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~XPKPE0BQTPWV.0 size=1048576 2024-09-12T00:17:38.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.474+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~XPKPE0BQTPWV.1 size=702163 2024-09-12T00:17:38.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.474+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=XPKPE0BQTPWV tag=FEF48BKQ7EJ6 type=write size=2799315 2024-09-12T00:17:38.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.478+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~L1FLRNU587CU.0 size=390392 2024-09-12T00:17:38.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.482+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=L1FLRNU587CU tag=V4IV319GWC3E type=write size=1438968 2024-09-12T00:17:38.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.482+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=ZKKXSSKWJG6A type=del size=4038042 2024-09-12T00:17:38.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.486+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~XT18IQGYB09X.0 size=1048576 2024-09-12T00:17:38.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.486+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~XT18IQGYB09X.1 size=1048576 2024-09-12T00:17:38.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.486+0000 7febed3678c0 1 < canceled part key=_multipart_Z020UV2JRR0I.2~XT18IQGYB09X.2 size=624213 2024-09-12T00:17:38.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.490+0000 7febed3678c0 1 < canceled multipart upload key=Z020UV2JRR0I upload=XT18IQGYB09X tag=JV4HW2L6D2PQ type=write size=3769941 2024-09-12T00:17:38.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.494+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~UUYL4XLTDG07.0 size=1048576 2024-09-12T00:17:38.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.498+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~UUYL4XLTDG07.1 size=1048576 2024-09-12T00:17:38.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.498+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~UUYL4XLTDG07.2 size=966027 2024-09-12T00:17:38.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.498+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=UUYL4XLTDG07 tag=K3XAE0DFD7T9 type=write size=4111755 2024-09-12T00:17:38.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.498+0000 7febed3678c0 1 < canceled part key=_multipart_RGQ4KY26RKYI.2~4Y5CLI61VTVJ.0 size=1048576 2024-09-12T00:17:38.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.502+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~4Y5CLI61VTVJ.1 size=87761 2024-09-12T00:17:38.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.506+0000 7febed3678c0 1 < canceled multipart upload key=RGQ4KY26RKYI upload=4Y5CLI61VTVJ tag=ZADU9H9HKXEM type=write size=2184913 2024-09-12T00:17:38.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.506+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=QVFB501DE6RH type=del size=3989933 2024-09-12T00:17:38.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.510+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=KJFII4FSZ7MN type=del 2024-09-12T00:17:38.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.514+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~1XCNEPHIEJQA.0 size=1048576 2024-09-12T00:17:38.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.514+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~1XCNEPHIEJQA.1 size=1048576 2024-09-12T00:17:38.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.518+0000 7febed3678c0 1 > prepared part key=_multipart_Z020UV2JRR0I.2~1XCNEPHIEJQA.2 size=780554 2024-09-12T00:17:38.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.518+0000 7febed3678c0 1 > prepared multipart upload key=Z020UV2JRR0I upload=1XCNEPHIEJQA tag=2AY8EPUVS8DY type=write size=3926282 2024-09-12T00:17:38.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.526+0000 7febed3678c0 1 < suggested remove operation key=0KQK1CXHO096 tag=HQQLR8KZ96DK type=del 2024-09-12T00:17:38.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.530+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=4IR1FN7X0V22 type=del size=2692231 2024-09-12T00:17:38.529 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.530+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~YIVLHJ8S1GI3.0 size=1048576 2024-09-12T00:17:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.534+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~YIVLHJ8S1GI3.1 size=26802 2024-09-12T00:17:38.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.534+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=YIVLHJ8S1GI3 tag=6HN7VG99NBRA type=write size=2123954 2024-09-12T00:17:38.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.542+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~1ZRU7M342I20.0 size=1048576 2024-09-12T00:17:38.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.542+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~1ZRU7M342I20.1 size=430519 2024-09-12T00:17:38.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.542+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=1ZRU7M342I20 tag=LJ2QN5NZ2ROP type=write size=2527671 2024-09-12T00:17:38.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.546+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~4OKXURJDLP2H.0 size=1048576 2024-09-12T00:17:38.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.546+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~4OKXURJDLP2H.1 size=207727 2024-09-12T00:17:38.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.550+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=4OKXURJDLP2H tag=AE0Q99DWFBP4 type=write size=2304879 2024-09-12T00:17:38.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.554+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=74540HM2B33A type=del size=2307742 2024-09-12T00:17:38.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.558+0000 7febed3678c0 1 < suggested remove operation key=53T1415UK7GE tag=8UJOG9I2313J type=write 2024-09-12T00:17:38.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.562+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~Z0XVQYZVSBN5.0 size=1048576 2024-09-12T00:17:38.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.562+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~Z0XVQYZVSBN5.1 size=1048576 2024-09-12T00:17:38.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.566+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~Z0XVQYZVSBN5.2 size=841236 2024-09-12T00:17:38.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.566+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=Z0XVQYZVSBN5 tag=S0ICY0SSVMMO type=write size=3986964 2024-09-12T00:17:38.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.570+0000 7febed3678c0 1 < completed write operation key=52SSW5KTCS15 tag=YM5Q9UP31DTW type=write size=471910 2024-09-12T00:17:38.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.570+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=3WEQATIBI4Z8 type=del size=2845129 2024-09-12T00:17:38.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.574+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~SUJ6J0WO49MO.0 size=1048576 2024-09-12T00:17:38.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.574+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~SUJ6J0WO49MO.1 size=1048576 2024-09-12T00:17:38.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.578+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~SUJ6J0WO49MO.2 size=670812 2024-09-12T00:17:38.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.582+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=SUJ6J0WO49MO tag=Z56Q3YHVMF0K type=write size=3816540 2024-09-12T00:17:38.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.586+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~MWUB0CB73T6I.0 size=140652 2024-09-12T00:17:38.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.586+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=MWUB0CB73T6I tag=WCPFYVBFD1SA type=write size=1189228 2024-09-12T00:17:38.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.590+0000 7febed3678c0 1 < canceled operation key=9HCKHF5ZRZ5N tag=367OZAQN0UPP type=write size=969617 2024-09-12T00:17:38.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.594+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=ZB29YU2Y6N5C type=del size=3044063 2024-09-12T00:17:38.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.594+0000 7febed3678c0 1 < canceled part key=_multipart_25THATWGX4WS.2~JN1JOZI163B1.0 size=1048576 2024-09-12T00:17:38.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.594+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~JN1JOZI163B1.1 size=1045481 2024-09-12T00:17:38.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.598+0000 7febed3678c0 1 < canceled multipart upload key=25THATWGX4WS upload=JN1JOZI163B1 tag=0NL7DUEQKQTO type=write size=3142633 2024-09-12T00:17:38.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.602+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~R9OJEVF18GBJ.0 size=1048576 2024-09-12T00:17:38.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.606+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~R9OJEVF18GBJ.1 size=182521 2024-09-12T00:17:38.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.606+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=R9OJEVF18GBJ tag=2IA2IN58E6OR type=write size=2279673 2024-09-12T00:17:38.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.606+0000 7febed3678c0 1 < canceled operation key=AHTIFXX3SGK7 tag=T7F6Z0GAYTQ4 type=del size=2086328 2024-09-12T00:17:38.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.610+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=KO0UO4MS5DZ8 type=del size=2495134 2024-09-12T00:17:38.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.610+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=S7439DXFJQM9 type=del 2024-09-12T00:17:38.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.614+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~N1VF09OPXL1T.0 size=1048576 2024-09-12T00:17:38.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.618+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~N1VF09OPXL1T.1 size=999312 2024-09-12T00:17:38.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.618+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=N1VF09OPXL1T tag=FBXOAU87WU10 type=write size=3096464 2024-09-12T00:17:38.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.618+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~ISOZDMF81LS4.0 size=614420 2024-09-12T00:17:38.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.622+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=ISOZDMF81LS4 tag=073MM1XJHM14 type=write size=1662996 2024-09-12T00:17:38.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.630+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KSFOAVBQOH2U.0 size=1048576 2024-09-12T00:17:38.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.834+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KSFOAVBQOH2U.1 size=1048576 2024-09-12T00:17:38.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.834+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~KSFOAVBQOH2U.2 size=597435 2024-09-12T00:17:38.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.834+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=KSFOAVBQOH2U tag=HJMZJRCEV5AV type=write size=3743163 2024-09-12T00:17:38.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.838+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~XPKPE0BQTPWV.0 size=1048576 2024-09-12T00:17:38.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.842+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~XPKPE0BQTPWV.1 size=702163 2024-09-12T00:17:38.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.846+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=XPKPE0BQTPWV tag=FEF48BKQ7EJ6 type=write size=2799315 2024-09-12T00:17:38.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.850+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=J279KH5I1WKE type=del size=759961 2024-09-12T00:17:38.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.858+0000 7febed3678c0 1 < suggested remove operation key=4K65QIB9F00S tag=ZKKXSSKWJG6A type=del 2024-09-12T00:17:38.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.862+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=FDMRBXD4DNN5 type=del size=1253098 2024-09-12T00:17:38.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.866+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~UUYL4XLTDG07.0 size=1048576 2024-09-12T00:17:38.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.870+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~UUYL4XLTDG07.1 size=1048576 2024-09-12T00:17:38.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.870+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~UUYL4XLTDG07.2 size=966027 2024-09-12T00:17:38.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.878+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=UUYL4XLTDG07 tag=K3XAE0DFD7T9 type=write size=4111755 2024-09-12T00:17:38.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.882+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=9MSPVQ85FSC5 type=del size=676021 2024-09-12T00:17:38.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.886+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=QVFB501DE6RH type=del 2024-09-12T00:17:38.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.886+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=6XF37T9SK16E type=write size=317450 2024-09-12T00:17:38.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.894+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~1XCNEPHIEJQA.0 size=1048576 2024-09-12T00:17:38.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.894+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~1XCNEPHIEJQA.1 size=1048576 2024-09-12T00:17:38.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.898+0000 7febed3678c0 1 < completed part key=_multipart_Z020UV2JRR0I.2~1XCNEPHIEJQA.2 size=780554 2024-09-12T00:17:38.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.902+0000 7febed3678c0 1 < completed multipart upload key=Z020UV2JRR0I upload=1XCNEPHIEJQA tag=2AY8EPUVS8DY type=write size=3926282 2024-09-12T00:17:38.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.906+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=34YO9NP3ROGZ type=del size=1201199 2024-09-12T00:17:38.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.910+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=4IR1FN7X0V22 type=del 2024-09-12T00:17:38.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.914+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=4BLHKD7HIN19 type=del size=389674 2024-09-12T00:17:38.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.918+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~1ZRU7M342I20.0 size=1048576 2024-09-12T00:17:38.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.918+0000 7febed3678c0 1 < canceled part key=_multipart_1HABX7YZ491W.2~1ZRU7M342I20.1 size=430519 2024-09-12T00:17:38.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.926+0000 7febed3678c0 1 < canceled multipart upload key=1HABX7YZ491W upload=1ZRU7M342I20 tag=LJ2QN5NZ2ROP type=write size=2527671 2024-09-12T00:17:38.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.926+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=8RRGWDWP1TL4 type=write size=469118 2024-09-12T00:17:38.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.934+0000 7febed3678c0 1 < suggested update operation key=ASFLGSKWYHG5 tag=74540HM2B33A type=del size=2307742 2024-09-12T00:17:38.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.942+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~CQWBMYA8N2SS.0 size=1048576 2024-09-12T00:17:38.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.946+0000 7febed3678c0 1 > prepared part key=_multipart_0KQK1CXHO096.2~CQWBMYA8N2SS.1 size=132895 2024-09-12T00:17:38.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.946+0000 7febed3678c0 1 > prepared multipart upload key=0KQK1CXHO096 upload=CQWBMYA8N2SS tag=3UCI3CFXXG30 type=write size=2230047 2024-09-12T00:17:38.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.950+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~Z0XVQYZVSBN5.0 size=1048576 2024-09-12T00:17:38.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.954+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~Z0XVQYZVSBN5.1 size=1048576 2024-09-12T00:17:38.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.954+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~Z0XVQYZVSBN5.2 size=841236 2024-09-12T00:17:38.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.962+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=Z0XVQYZVSBN5 tag=S0ICY0SSVMMO type=write size=3986964 2024-09-12T00:17:38.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.966+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=QBILNJ9EQ1V8 type=del size=3943849 2024-09-12T00:17:38.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.970+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=3WEQATIBI4Z8 type=del 2024-09-12T00:17:38.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.978+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~0IDPM795XUUS.0 size=1048576 2024-09-12T00:17:38.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.978+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~0IDPM795XUUS.1 size=1048576 2024-09-12T00:17:38.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.982+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~0IDPM795XUUS.2 size=175648 2024-09-12T00:17:38.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.982+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=0IDPM795XUUS tag=ZSNNTKAG6PLJ type=write size=3321376 2024-09-12T00:17:38.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.982+0000 7febed3678c0 1 < canceled part key=_multipart_4K65QIB9F00S.2~MWUB0CB73T6I.0 size=140652 2024-09-12T00:17:38.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.990+0000 7febed3678c0 1 < canceled multipart upload key=4K65QIB9F00S upload=MWUB0CB73T6I tag=WCPFYVBFD1SA type=write size=1189228 2024-09-12T00:17:38.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.994+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~PMO8C379L3YO.0 size=1048576 2024-09-12T00:17:38.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.998+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~PMO8C379L3YO.1 size=1048576 2024-09-12T00:17:38.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.998+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~PMO8C379L3YO.2 size=377264 2024-09-12T00:17:38.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:38.998+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=PMO8C379L3YO tag=TCG2FLQGYYUJ type=write size=3522992 2024-09-12T00:17:39.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.006+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=ZB29YU2Y6N5C type=del 2024-09-12T00:17:39.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.014+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~VCZE1PG2DBJN.0 size=1048576 2024-09-12T00:17:39.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.014+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~VCZE1PG2DBJN.1 size=1048576 2024-09-12T00:17:39.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.018+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~VCZE1PG2DBJN.2 size=98160 2024-09-12T00:17:39.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.018+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=VCZE1PG2DBJN tag=09BBVB3PFJX2 type=write size=3243888 2024-09-12T00:17:39.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.022+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~R9OJEVF18GBJ.0 size=1048576 2024-09-12T00:17:39.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.022+0000 7febed3678c0 1 < canceled part key=_multipart_MAZHOU2CEUCU.2~R9OJEVF18GBJ.1 size=182521 2024-09-12T00:17:39.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.026+0000 7febed3678c0 1 < canceled multipart upload key=MAZHOU2CEUCU upload=R9OJEVF18GBJ tag=2IA2IN58E6OR type=write size=2279673 2024-09-12T00:17:39.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.034+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~P4F31RV5SD6L.0 size=1048576 2024-09-12T00:17:39.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.034+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~P4F31RV5SD6L.1 size=1006533 2024-09-12T00:17:39.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.034+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=P4F31RV5SD6L tag=R8U3TTW4B013 type=write size=3103685 2024-09-12T00:17:39.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.038+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=KO0UO4MS5DZ8 type=del 2024-09-12T00:17:39.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.042+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=ZVDF2KQ96GE2 type=del size=3683750 2024-09-12T00:17:39.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.046+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~N1VF09OPXL1T.0 size=1048576 2024-09-12T00:17:39.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.046+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~N1VF09OPXL1T.1 size=999312 2024-09-12T00:17:39.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.054+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=N1VF09OPXL1T tag=FBXOAU87WU10 type=write size=3096464 2024-09-12T00:17:39.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.058+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=5FICRTQFFNUP type=del size=947784 2024-09-12T00:17:39.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.062+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~KSFOAVBQOH2U.0 size=1048576 2024-09-12T00:17:39.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.062+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~KSFOAVBQOH2U.1 size=1048576 2024-09-12T00:17:39.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.066+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~KSFOAVBQOH2U.2 size=597435 2024-09-12T00:17:39.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.070+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=KSFOAVBQOH2U tag=HJMZJRCEV5AV type=write size=3743163 2024-09-12T00:17:39.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.078+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~3JYE9GHP6KVT.0 size=1048576 2024-09-12T00:17:39.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.082+0000 7febed3678c0 1 > prepared part key=_multipart_VW69JRC5JYX5.2~3JYE9GHP6KVT.1 size=263143 2024-09-12T00:17:39.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.082+0000 7febed3678c0 1 > prepared multipart upload key=VW69JRC5JYX5 upload=3JYE9GHP6KVT tag=683RM1RTAHO8 type=write size=2360295 2024-09-12T00:17:39.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.086+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=J279KH5I1WKE type=del 2024-09-12T00:17:39.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.090+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~NQXSV81231BU.0 size=1048576 2024-09-12T00:17:39.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.094+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~NQXSV81231BU.1 size=1048576 2024-09-12T00:17:39.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.098+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~NQXSV81231BU.2 size=735643 2024-09-12T00:17:39.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.098+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=NQXSV81231BU tag=XTAMS69S4QMS type=write size=3881371 2024-09-12T00:17:39.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.098+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=FDMRBXD4DNN5 type=del 2024-09-12T00:17:39.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.102+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=5OV7QCR0FI10 type=write size=924103 2024-09-12T00:17:39.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.106+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=9MSPVQ85FSC5 type=del 2024-09-12T00:17:39.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.110+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=30B0XTJ5KBT5 type=write size=877079 2024-09-12T00:17:39.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.114+0000 7febed3678c0 1 < completed write operation key=1HABX7YZ491W tag=6XF37T9SK16E type=write size=317450 2024-09-12T00:17:39.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.118+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=JXJYD8QRHQQ0 type=del size=663302 2024-09-12T00:17:39.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.122+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=34YO9NP3ROGZ type=del 2024-09-12T00:17:39.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.126+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=H82LXPZTC9BP type=del size=1749025 2024-09-12T00:17:39.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.130+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=4BLHKD7HIN19 type=del 2024-09-12T00:17:39.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.130+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=5N2BGNO3SRSP type=del size=1955915 2024-09-12T00:17:39.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.138+0000 7febed3678c0 1 < suggested remove operation key=4K65QIB9F00S tag=8RRGWDWP1TL4 type=write 2024-09-12T00:17:39.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.142+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=DLNXHLBONSK2 type=del size=917916 2024-09-12T00:17:39.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.146+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~CQWBMYA8N2SS.0 size=1048576 2024-09-12T00:17:39.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.146+0000 7febed3678c0 1 < completed part key=_multipart_0KQK1CXHO096.2~CQWBMYA8N2SS.1 size=132895 2024-09-12T00:17:39.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.154+0000 7febed3678c0 1 < completed multipart upload key=0KQK1CXHO096 upload=CQWBMYA8N2SS tag=3UCI3CFXXG30 type=write size=2230047 2024-09-12T00:17:39.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.158+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=R0HV81GEUEZO type=del size=3827637 2024-09-12T00:17:39.160 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.162+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=QBILNJ9EQ1V8 type=del 2024-09-12T00:17:39.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.166+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~2EESYV75811Z.0 size=1048576 2024-09-12T00:17:39.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.170+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~2EESYV75811Z.1 size=1048576 2024-09-12T00:17:39.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.174+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~2EESYV75811Z.2 size=748105 2024-09-12T00:17:39.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.174+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=2EESYV75811Z tag=T6VH7X6LMGHE type=write size=3893833 2024-09-12T00:17:39.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.182+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~0IDPM795XUUS.0 size=1048576 2024-09-12T00:17:39.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.182+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~0IDPM795XUUS.1 size=1048576 2024-09-12T00:17:39.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.186+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~0IDPM795XUUS.2 size=175648 2024-09-12T00:17:39.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.190+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=0IDPM795XUUS tag=ZSNNTKAG6PLJ type=write size=3321376 2024-09-12T00:17:39.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.198+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~YME13SDL6XZD.0 size=1048576 2024-09-12T00:17:39.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.202+0000 7febed3678c0 1 > prepared part key=_multipart_AHTIFXX3SGK7.2~YME13SDL6XZD.1 size=38099 2024-09-12T00:17:39.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.202+0000 7febed3678c0 1 > prepared multipart upload key=AHTIFXX3SGK7 upload=YME13SDL6XZD tag=CDHE9FZ7GJZ6 type=write size=2135251 2024-09-12T00:17:39.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.206+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~PMO8C379L3YO.0 size=1048576 2024-09-12T00:17:39.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.206+0000 7febed3678c0 1 < canceled part key=_multipart_9HCKHF5ZRZ5N.2~PMO8C379L3YO.1 size=1048576 2024-09-12T00:17:39.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.206+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~PMO8C379L3YO.2 size=377264 2024-09-12T00:17:39.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.214+0000 7febed3678c0 1 < canceled multipart upload key=9HCKHF5ZRZ5N upload=PMO8C379L3YO tag=TCG2FLQGYYUJ type=write size=3522992 2024-09-12T00:17:39.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.214+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=ELQON9TG10EF type=write size=35428 2024-09-12T00:17:39.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.218+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~VCZE1PG2DBJN.0 size=1048576 2024-09-12T00:17:39.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.218+0000 7febed3678c0 1 < canceled part key=_multipart_70W3V7TFBUFJ.2~VCZE1PG2DBJN.1 size=1048576 2024-09-12T00:17:39.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.222+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~VCZE1PG2DBJN.2 size=98160 2024-09-12T00:17:39.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.226+0000 7febed3678c0 1 < canceled multipart upload key=70W3V7TFBUFJ upload=VCZE1PG2DBJN tag=09BBVB3PFJX2 type=write size=3243888 2024-09-12T00:17:39.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.230+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=ARIJ72G8E8OC type=del size=3347760 2024-09-12T00:17:39.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.234+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~P4F31RV5SD6L.0 size=1048576 2024-09-12T00:17:39.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.234+0000 7febed3678c0 1 < canceled part key=_multipart_LGFKY0CP299H.2~P4F31RV5SD6L.1 size=1006533 2024-09-12T00:17:39.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.242+0000 7febed3678c0 1 < canceled multipart upload key=LGFKY0CP299H upload=P4F31RV5SD6L tag=R8U3TTW4B013 type=write size=3103685 2024-09-12T00:17:39.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.242+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=WU5GTAIIEFNR type=del size=1758515 2024-09-12T00:17:39.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.246+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=ZVDF2KQ96GE2 type=del 2024-09-12T00:17:39.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.250+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=O3QPM12N6FG0 type=del size=1834699 2024-09-12T00:17:39.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.254+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=5FICRTQFFNUP type=del 2024-09-12T00:17:39.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.258+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=JA90Q72LGPNS type=del size=3310065 2024-09-12T00:17:39.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.262+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~3JYE9GHP6KVT.0 size=1048576 2024-09-12T00:17:39.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.266+0000 7febed3678c0 1 < completed part key=_multipart_VW69JRC5JYX5.2~3JYE9GHP6KVT.1 size=263143 2024-09-12T00:17:39.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.270+0000 7febed3678c0 1 < completed multipart upload key=VW69JRC5JYX5 upload=3JYE9GHP6KVT tag=683RM1RTAHO8 type=write size=2360295 2024-09-12T00:17:39.272 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.274+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=DIGRF1IFYFRV type=del size=2246522 2024-09-12T00:17:39.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.278+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~NQXSV81231BU.0 size=1048576 2024-09-12T00:17:39.279 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.278+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~NQXSV81231BU.1 size=1048576 2024-09-12T00:17:39.279 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.278+0000 7febed3678c0 1 < canceled part key=_multipart_8RVDLW1VC8LP.2~NQXSV81231BU.2 size=735643 2024-09-12T00:17:39.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.286+0000 7febed3678c0 1 < canceled multipart upload key=8RVDLW1VC8LP upload=NQXSV81231BU tag=XTAMS69S4QMS type=write size=3881371 2024-09-12T00:17:39.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.290+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=XJZYC4VVW0R5 type=del size=2888169 2024-09-12T00:17:39.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.294+0000 7febed3678c0 1 < completed write operation key=9HCKHF5ZRZ5N tag=5OV7QCR0FI10 type=write size=924103 2024-09-12T00:17:39.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.298+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=H3OBBTKVON0H type=write size=1027921 2024-09-12T00:17:39.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.302+0000 7febed3678c0 1 < completed write operation key=1HABX7YZ491W tag=30B0XTJ5KBT5 type=write size=877079 2024-09-12T00:17:39.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.306+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=HH0XUEBBDDWU type=del size=3401330 2024-09-12T00:17:39.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.306+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=JXJYD8QRHQQ0 type=del 2024-09-12T00:17:39.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.310+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=BDRXAU21S215 type=write size=910021 2024-09-12T00:17:39.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.318+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=H82LXPZTC9BP type=del 2024-09-12T00:17:39.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.322+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=O1UN8IIHIT59 type=del size=2475032 2024-09-12T00:17:39.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.326+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=5N2BGNO3SRSP type=del 2024-09-12T00:17:39.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.326+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=RBWK63P50KAV type=del size=584932 2024-09-12T00:17:39.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.334+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=DLNXHLBONSK2 type=del 2024-09-12T00:17:39.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.338+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=ILJHG2N2VY8G type=del size=15472 2024-09-12T00:17:39.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.342+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=R0HV81GEUEZO type=del 2024-09-12T00:17:39.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.346+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~B0K0H54IK9M3.0 size=481511 2024-09-12T00:17:39.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.346+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=B0K0H54IK9M3 tag=GK9HN8S047P8 type=write size=1530087 2024-09-12T00:17:39.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.350+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~2EESYV75811Z.0 size=1048576 2024-09-12T00:17:39.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.354+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~2EESYV75811Z.1 size=1048576 2024-09-12T00:17:39.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.354+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~2EESYV75811Z.2 size=748105 2024-09-12T00:17:39.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.362+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=2EESYV75811Z tag=T6VH7X6LMGHE type=write size=3893833 2024-09-12T00:17:39.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.366+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=975GR9N1U2H5 type=del size=508541 2024-09-12T00:17:39.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.366+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~YME13SDL6XZD.0 size=1048576 2024-09-12T00:17:39.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.370+0000 7febed3678c0 1 < completed part key=_multipart_AHTIFXX3SGK7.2~YME13SDL6XZD.1 size=38099 2024-09-12T00:17:39.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.374+0000 7febed3678c0 1 < completed multipart upload key=AHTIFXX3SGK7 upload=YME13SDL6XZD tag=CDHE9FZ7GJZ6 type=write size=2135251 2024-09-12T00:17:39.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.378+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=WQKGGPY0Z8M7 type=del size=1828618 2024-09-12T00:17:39.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.386+0000 7febed3678c0 1 < suggested update operation key=VU1AF57EUA0R tag=ELQON9TG10EF type=write size=35428 2024-09-12T00:17:39.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.390+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=EN50M3INC5MJ type=del size=2112550 2024-09-12T00:17:39.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.390+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=ARIJ72G8E8OC type=del 2024-09-12T00:17:39.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.394+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=U2NCERVMOMHO type=del size=2454684 2024-09-12T00:17:39.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.398+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=WU5GTAIIEFNR type=del 2024-09-12T00:17:39.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.402+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~13QW3TN0HIUS.0 size=1048576 2024-09-12T00:17:39.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.406+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~13QW3TN0HIUS.1 size=902760 2024-09-12T00:17:39.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.406+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=13QW3TN0HIUS tag=6B87D1DWV5YP type=write size=2999912 2024-09-12T00:17:39.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.410+0000 7febed3678c0 1 < completed delete operation key=52SSW5KTCS15 tag=O3QPM12N6FG0 type=del 2024-09-12T00:17:39.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.410+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=FRY1KICCTT2U type=del size=968019 2024-09-12T00:17:39.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.414+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=JA90Q72LGPNS type=del 2024-09-12T00:17:39.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.422+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~8GCMR3TPYKD2.0 size=1048576 2024-09-12T00:17:39.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.422+0000 7febed3678c0 1 > prepared part key=_multipart_LGFKY0CP299H.2~8GCMR3TPYKD2.1 size=780217 2024-09-12T00:17:39.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.422+0000 7febed3678c0 1 > prepared multipart upload key=LGFKY0CP299H upload=8GCMR3TPYKD2 tag=DI3F1Z09O254 type=write size=2877369 2024-09-12T00:17:39.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.426+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=DIGRF1IFYFRV type=del 2024-09-12T00:17:39.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.430+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=AIW9JROEFIDR type=del size=1868251 2024-09-12T00:17:39.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.434+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=XJZYC4VVW0R5 type=del 2024-09-12T00:17:39.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.438+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=HUJRCNMT0991 type=write size=1032882 2024-09-12T00:17:39.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.442+0000 7febed3678c0 1 < completed write operation key=9HCKHF5ZRZ5N tag=H3OBBTKVON0H type=write size=1027921 2024-09-12T00:17:39.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.446+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=R98NFXOGY3W8 type=del size=3883941 2024-09-12T00:17:39.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.450+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=HH0XUEBBDDWU type=del 2024-09-12T00:17:39.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.450+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=CR1MP1HLLMSW type=del size=1869345 2024-09-12T00:17:39.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.454+0000 7febed3678c0 1 < canceled operation key=9CBI4FHAT3H2 tag=BDRXAU21S215 type=write size=910021 2024-09-12T00:17:39.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.462+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~PBF1EPI2FVYQ.0 size=1048576 2024-09-12T00:17:39.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.466+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~PBF1EPI2FVYQ.1 size=1048576 2024-09-12T00:17:39.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.466+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~PBF1EPI2FVYQ.2 size=872315 2024-09-12T00:17:39.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.466+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=PBF1EPI2FVYQ tag=J5ZBR103HJRU type=write size=4018043 2024-09-12T00:17:39.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.470+0000 7febed3678c0 1 < suggested remove operation key=RGQ4KY26RKYI tag=O1UN8IIHIT59 type=del 2024-09-12T00:17:39.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.478+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~BX81XP8NKJGS.0 size=1048576 2024-09-12T00:17:39.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.478+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~BX81XP8NKJGS.1 size=1048576 2024-09-12T00:17:39.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.482+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~BX81XP8NKJGS.2 size=974875 2024-09-12T00:17:39.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.482+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=BX81XP8NKJGS tag=8CBNXPD5PN7P type=write size=4120603 2024-09-12T00:17:39.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.486+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=RBWK63P50KAV type=del 2024-09-12T00:17:39.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.490+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~9LYAH51JFBBD.0 size=1021775 2024-09-12T00:17:39.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.490+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=9LYAH51JFBBD tag=TL5WLQJ5CKBP type=write size=2070351 2024-09-12T00:17:39.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.494+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=ILJHG2N2VY8G type=del 2024-09-12T00:17:39.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.494+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=YXY5YV3LKB4Z type=del size=841037 2024-09-12T00:17:39.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.498+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~B0K0H54IK9M3.0 size=481511 2024-09-12T00:17:39.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.502+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=B0K0H54IK9M3 tag=GK9HN8S047P8 type=write size=1530087 2024-09-12T00:17:39.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.510+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~EBHTFR0BSR7B.0 size=217704 2024-09-12T00:17:39.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.510+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=EBHTFR0BSR7B tag=DW6A2PO7PJYE type=write size=1266280 2024-09-12T00:17:39.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.514+0000 7febed3678c0 1 < suggested remove operation key=Z020UV2JRR0I tag=975GR9N1U2H5 type=del 2024-09-12T00:17:39.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.522+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~GZ0LMPDOS5OQ.0 size=258460 2024-09-12T00:17:39.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.522+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=GZ0LMPDOS5OQ tag=VMNI04S1G570 type=write size=1307036 2024-09-12T00:17:39.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.526+0000 7febed3678c0 1 < suggested update operation key=UGV3WQR0ADYH tag=WQKGGPY0Z8M7 type=del size=1828618 2024-09-12T00:17:39.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.530+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=T9835GJEFVXN type=del size=1756801 2024-09-12T00:17:39.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.534+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=EN50M3INC5MJ type=del 2024-09-12T00:17:39.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.538+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~UX6AW6BI1S7F.0 size=79441 2024-09-12T00:17:39.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.538+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=UX6AW6BI1S7F tag=MIQPCT3YSPEQ type=write size=1128017 2024-09-12T00:17:39.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.542+0000 7febed3678c0 -1 < no bi entry to suggest for operation key=Z020UV2JRR0I tag=U2NCERVMOMHO type=del size=2454684: (2) No such file or directory 2024-09-12T00:17:39.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.546+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~J5ZPBDI77NTI.0 size=284770 2024-09-12T00:17:39.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.546+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=J5ZPBDI77NTI tag=TOILKI0RGCEL type=write size=1333346 2024-09-12T00:17:39.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.550+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~13QW3TN0HIUS.0 size=1048576 2024-09-12T00:17:39.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.554+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~13QW3TN0HIUS.1 size=902760 2024-09-12T00:17:39.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.558+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=13QW3TN0HIUS tag=6B87D1DWV5YP type=write size=2999912 2024-09-12T00:17:39.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.562+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=OZ14ZJUCW0TA type=del size=2879389 2024-09-12T00:17:39.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.562+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=FRY1KICCTT2U type=del 2024-09-12T00:17:39.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.566+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=4R7ZBN3XY3MA type=write size=243630 2024-09-12T00:17:39.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.570+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~8GCMR3TPYKD2.0 size=1048576 2024-09-12T00:17:39.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.574+0000 7febed3678c0 1 < completed part key=_multipart_LGFKY0CP299H.2~8GCMR3TPYKD2.1 size=780217 2024-09-12T00:17:39.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.578+0000 7febed3678c0 1 < completed multipart upload key=LGFKY0CP299H upload=8GCMR3TPYKD2 tag=DI3F1Z09O254 type=write size=2877369 2024-09-12T00:17:39.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.582+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=O4NC11V0HS23 type=del size=3164891 2024-09-12T00:17:39.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.586+0000 7febed3678c0 1 < suggested remove operation key=LWAMFA0RSW6S tag=AIW9JROEFIDR type=del 2024-09-12T00:17:39.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.594+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~FSCUUVIMNWFB.0 size=173881 2024-09-12T00:17:39.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.594+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=FSCUUVIMNWFB tag=YWABYHPD0016 type=write size=1222457 2024-09-12T00:17:39.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.594+0000 7febed3678c0 1 < completed write operation key=1HABX7YZ491W tag=HUJRCNMT0991 type=write size=1032882 2024-09-12T00:17:39.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.602+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~MMBCZK3U9WYK.0 size=1048576 2024-09-12T00:17:39.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.606+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~MMBCZK3U9WYK.1 size=1048576 2024-09-12T00:17:39.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.606+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~MMBCZK3U9WYK.2 size=747428 2024-09-12T00:17:39.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.606+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=MMBCZK3U9WYK tag=4M5RBKBTGW6P type=write size=3893156 2024-09-12T00:17:39.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.610+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=R98NFXOGY3W8 type=del 2024-09-12T00:17:39.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.614+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~OCWJHB76JLYT.0 size=1048576 2024-09-12T00:17:39.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.618+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~OCWJHB76JLYT.1 size=711857 2024-09-12T00:17:39.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.618+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=OCWJHB76JLYT tag=9J2BTU3V614O type=write size=2809009 2024-09-12T00:17:39.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.622+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=CR1MP1HLLMSW type=del 2024-09-12T00:17:39.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.626+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=YU42P4N2GKKI type=del size=1134820 2024-09-12T00:17:39.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.630+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~PBF1EPI2FVYQ.0 size=1048576 2024-09-12T00:17:39.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.630+0000 7febed3678c0 1 < canceled part key=_multipart_3G9ABEEEDRI3.2~PBF1EPI2FVYQ.1 size=1048576 2024-09-12T00:17:39.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.634+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~PBF1EPI2FVYQ.2 size=872315 2024-09-12T00:17:39.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.642+0000 7febed3678c0 1 < canceled multipart upload key=3G9ABEEEDRI3 upload=PBF1EPI2FVYQ tag=J5ZBR103HJRU type=write size=4018043 2024-09-12T00:17:39.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.646+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=YIG7DTBVIJE4 type=del size=3728261 2024-09-12T00:17:39.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.650+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~BX81XP8NKJGS.0 size=1048576 2024-09-12T00:17:39.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.650+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~BX81XP8NKJGS.1 size=1048576 2024-09-12T00:17:39.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.654+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~BX81XP8NKJGS.2 size=974875 2024-09-12T00:17:39.659 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.658+0000 7febed3678c0 1 < completed multipart upload key=MAZHOU2CEUCU upload=BX81XP8NKJGS tag=8CBNXPD5PN7P type=write size=4120603 2024-09-12T00:17:39.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.666+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~TWF24AC20647.0 size=1048576 2024-09-12T00:17:39.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.670+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~TWF24AC20647.1 size=372552 2024-09-12T00:17:39.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.670+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=TWF24AC20647 tag=C7ZS56V5ELKE type=write size=2469704 2024-09-12T00:17:39.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.670+0000 7febed3678c0 1 < canceled part key=_multipart_3G9ABEEEDRI3.2~9LYAH51JFBBD.0 size=1021775 2024-09-12T00:17:39.673 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.674+0000 7febed3678c0 1 < canceled multipart upload key=3G9ABEEEDRI3 upload=9LYAH51JFBBD tag=TL5WLQJ5CKBP type=write size=2070351 2024-09-12T00:17:39.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.678+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=LHV9IGQ8KMW4 type=write size=359992 2024-09-12T00:17:39.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.678+0000 7febed3678c0 -1 < failed to complete operation key=LWAMFA0RSW6S tag=YXY5YV3LKB4Z type=del size=841037: (22) Invalid argument 2024-09-12T00:17:39.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.682+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=GWVEDA228YPF type=del size=2518205 2024-09-12T00:17:39.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.686+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~EBHTFR0BSR7B.0 size=217704 2024-09-12T00:17:39.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.690+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=EBHTFR0BSR7B tag=DW6A2PO7PJYE type=write size=1266280 2024-09-12T00:17:39.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.698+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~8ZPMJH4ZRJ75.0 size=1048576 2024-09-12T00:17:39.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.702+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~8ZPMJH4ZRJ75.1 size=1048576 2024-09-12T00:17:39.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.702+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~8ZPMJH4ZRJ75.2 size=772872 2024-09-12T00:17:39.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.702+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=8ZPMJH4ZRJ75 tag=4S5NX0FB7ZLE type=write size=3918600 2024-09-12T00:17:39.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.706+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~GZ0LMPDOS5OQ.0 size=258460 2024-09-12T00:17:39.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.710+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=GZ0LMPDOS5OQ tag=VMNI04S1G570 type=write size=1307036 2024-09-12T00:17:39.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.718+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~1507G48RIA80.0 size=1048576 2024-09-12T00:17:39.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.722+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~1507G48RIA80.1 size=1048576 2024-09-12T00:17:39.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.722+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~1507G48RIA80.2 size=484481 2024-09-12T00:17:39.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.722+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=1507G48RIA80 tag=5DP21OZM9NR1 type=write size=3630209 2024-09-12T00:17:39.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.730+0000 7febed3678c0 1 < suggested remove operation key=H017KWW59B8Z tag=T9835GJEFVXN type=del 2024-09-12T00:17:39.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.734+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=DUCALG38HJTO type=del size=3781403 2024-09-12T00:17:39.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.734+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~UX6AW6BI1S7F.0 size=79441 2024-09-12T00:17:39.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.742+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=UX6AW6BI1S7F tag=MIQPCT3YSPEQ type=write size=1128017 2024-09-12T00:17:39.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.746+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=338RNPQWGNVL type=del size=1332296 2024-09-12T00:17:39.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.746+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~J5ZPBDI77NTI.0 size=284770 2024-09-12T00:17:39.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.754+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=J5ZPBDI77NTI tag=TOILKI0RGCEL type=write size=1333346 2024-09-12T00:17:39.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.754+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=6BM6F7X2X9NF type=del size=427878 2024-09-12T00:17:39.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.758+0000 7febed3678c0 -1 < no bi entry to suggest for operation key=LWAMFA0RSW6S tag=OZ14ZJUCW0TA type=del size=2879389: (2) No such file or directory 2024-09-12T00:17:39.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.762+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~S8R21LOZ4E6I.0 size=678364 2024-09-12T00:17:39.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.762+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=S8R21LOZ4E6I tag=XI8805LGN4I4 type=write size=1726940 2024-09-12T00:17:39.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.766+0000 7febed3678c0 1 < completed write operation key=9HCKHF5ZRZ5N tag=4R7ZBN3XY3MA type=write size=243630 2024-09-12T00:17:39.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.770+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=Q51TA85S963B type=del size=2442770 2024-09-12T00:17:39.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.770+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=O4NC11V0HS23 type=del 2024-09-12T00:17:39.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.778+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~8B5H5SPGKLB7.0 size=1048576 2024-09-12T00:17:39.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.782+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~8B5H5SPGKLB7.1 size=1047320 2024-09-12T00:17:39.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.782+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=8B5H5SPGKLB7 tag=MUMBZX5JI26H type=write size=3144472 2024-09-12T00:17:39.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.786+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~FSCUUVIMNWFB.0 size=173881 2024-09-12T00:17:39.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.790+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=FSCUUVIMNWFB tag=YWABYHPD0016 type=write size=1222457 2024-09-12T00:17:39.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.794+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=TIDSS56SHF7U type=write size=37013 2024-09-12T00:17:39.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.794+0000 7febed3678c0 1 < canceled part key=_multipart_W2VEW3JJEJY7.2~MMBCZK3U9WYK.0 size=1048576 2024-09-12T00:17:39.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.798+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~MMBCZK3U9WYK.1 size=1048576 2024-09-12T00:17:39.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.798+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~MMBCZK3U9WYK.2 size=747428 2024-09-12T00:17:39.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.806+0000 7febed3678c0 1 < canceled multipart upload key=W2VEW3JJEJY7 upload=MMBCZK3U9WYK tag=4M5RBKBTGW6P type=write size=3893156 2024-09-12T00:17:39.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.806+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=DJ5E82547Z2Z type=del size=3850889 2024-09-12T00:17:39.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.810+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~OCWJHB76JLYT.0 size=1048576 2024-09-12T00:17:39.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.814+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~OCWJHB76JLYT.1 size=711857 2024-09-12T00:17:39.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.818+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=OCWJHB76JLYT tag=9J2BTU3V614O type=write size=2809009 2024-09-12T00:17:39.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.826+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~DSPN5KZVGBPQ.0 size=1048576 2024-09-12T00:17:39.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.826+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~DSPN5KZVGBPQ.1 size=1048576 2024-09-12T00:17:39.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.830+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~DSPN5KZVGBPQ.2 size=436131 2024-09-12T00:17:39.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.830+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=DSPN5KZVGBPQ tag=LWL2V0KCXAFE type=write size=3581859 2024-09-12T00:17:39.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.834+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=YU42P4N2GKKI type=del 2024-09-12T00:17:39.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.838+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=SF90ZT1D87E3 type=del size=629477 2024-09-12T00:17:39.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.838+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=YIG7DTBVIJE4 type=del 2024-09-12T00:17:39.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.842+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=Y6FB8BYQOOEU type=del size=976503 2024-09-12T00:17:39.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.846+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~TWF24AC20647.0 size=1048576 2024-09-12T00:17:39.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.850+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~TWF24AC20647.1 size=372552 2024-09-12T00:17:39.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.854+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=TWF24AC20647 tag=C7ZS56V5ELKE type=write size=2469704 2024-09-12T00:17:39.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.858+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~P8ZE1MFH5E4N.0 size=556471 2024-09-12T00:17:39.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.858+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=P8ZE1MFH5E4N tag=3QI6SEBARK0L type=write size=1605047 2024-09-12T00:17:39.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.862+0000 7febed3678c0 1 < canceled operation key=70W3V7TFBUFJ tag=LHV9IGQ8KMW4 type=write size=359992 2024-09-12T00:17:39.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.870+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~Q2238JEL6UYN.0 size=1048576 2024-09-12T00:17:39.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.870+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~Q2238JEL6UYN.1 size=1032815 2024-09-12T00:17:39.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.870+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=Q2238JEL6UYN tag=BJZGLEVDL5ND type=write size=3129967 2024-09-12T00:17:39.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.874+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=GWVEDA228YPF type=del 2024-09-12T00:17:39.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.878+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=2NO33ULLWNPI type=del size=3848936 2024-09-12T00:17:39.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.882+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~8ZPMJH4ZRJ75.0 size=1048576 2024-09-12T00:17:39.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.886+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~8ZPMJH4ZRJ75.1 size=1048576 2024-09-12T00:17:39.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.886+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~8ZPMJH4ZRJ75.2 size=772872 2024-09-12T00:17:39.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.894+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=8ZPMJH4ZRJ75 tag=4S5NX0FB7ZLE type=write size=3918600 2024-09-12T00:17:39.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.898+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=60I42AG7O2ZY type=del size=3482093 2024-09-12T00:17:39.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.902+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~1507G48RIA80.0 size=1048576 2024-09-12T00:17:39.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.902+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~1507G48RIA80.1 size=1048576 2024-09-12T00:17:39.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.906+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~1507G48RIA80.2 size=484481 2024-09-12T00:17:39.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.910+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=1507G48RIA80 tag=5DP21OZM9NR1 type=write size=3630209 2024-09-12T00:17:39.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.914+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=19IUYGI99HFR type=write size=483926 2024-09-12T00:17:39.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.918+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=DUCALG38HJTO type=del 2024-09-12T00:17:39.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.922+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=G5WXBB5YYN36 type=del size=1753763 2024-09-12T00:17:39.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.926+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=338RNPQWGNVL type=del 2024-09-12T00:17:39.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.930+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=6HI46DHMKVTD type=del size=3593018 2024-09-12T00:17:39.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.934+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=6BM6F7X2X9NF type=del 2024-09-12T00:17:39.939 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.938+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=9DY1Z40N3VMP type=del size=2622579 2024-09-12T00:17:39.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.942+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~S8R21LOZ4E6I.0 size=678364 2024-09-12T00:17:39.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.950+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=S8R21LOZ4E6I tag=XI8805LGN4I4 type=write size=1726940 2024-09-12T00:17:39.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.954+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~0KPGK9UBZO2U.0 size=1048576 2024-09-12T00:17:39.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.958+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~0KPGK9UBZO2U.1 size=1048576 2024-09-12T00:17:39.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.962+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~0KPGK9UBZO2U.2 size=762884 2024-09-12T00:17:39.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.962+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=0KPGK9UBZO2U tag=3P23P7DL6TG9 type=write size=3908612 2024-09-12T00:17:39.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.966+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=Q51TA85S963B type=del 2024-09-12T00:17:39.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.966+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=3711J5N2LHLL type=del size=3648026 2024-09-12T00:17:39.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.970+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~8B5H5SPGKLB7.0 size=1048576 2024-09-12T00:17:39.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.974+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~8B5H5SPGKLB7.1 size=1047320 2024-09-12T00:17:39.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.982+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=8B5H5SPGKLB7 tag=MUMBZX5JI26H type=write size=3144472 2024-09-12T00:17:39.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.982+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=P6TPDANAXXYW type=del size=1910549 2024-09-12T00:17:39.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.986+0000 7febed3678c0 1 < completed write operation key=LWAMFA0RSW6S tag=TIDSS56SHF7U type=write size=37013 2024-09-12T00:17:39.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.990+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=WSQ0W1O5QMPM type=del size=3522953 2024-09-12T00:17:39.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:39.998+0000 7febed3678c0 1 < suggested remove operation key=LGFKY0CP299H tag=DJ5E82547Z2Z type=del 2024-09-12T00:17:40.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.002+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~6JDW6WLO0IJK.0 size=1048576 2024-09-12T00:17:40.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.006+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~6JDW6WLO0IJK.1 size=506424 2024-09-12T00:17:40.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.006+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=6JDW6WLO0IJK tag=LPS0F6I2CXWW type=write size=2603576 2024-09-12T00:17:40.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.010+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~DSPN5KZVGBPQ.0 size=1048576 2024-09-12T00:17:40.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.010+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~DSPN5KZVGBPQ.1 size=1048576 2024-09-12T00:17:40.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.014+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~DSPN5KZVGBPQ.2 size=436131 2024-09-12T00:17:40.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.018+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=DSPN5KZVGBPQ tag=LWL2V0KCXAFE type=write size=3581859 2024-09-12T00:17:40.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.026+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~AYJ13RRJ6HEI.0 size=1048576 2024-09-12T00:17:40.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.026+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~AYJ13RRJ6HEI.1 size=199754 2024-09-12T00:17:40.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.026+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=AYJ13RRJ6HEI tag=4ME91XI5T4F5 type=write size=2296906 2024-09-12T00:17:40.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.030+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=SF90ZT1D87E3 type=del 2024-09-12T00:17:40.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.034+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~GNCLXIMPWLIR.0 size=127957 2024-09-12T00:17:40.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.034+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=GNCLXIMPWLIR tag=OIJXC59F5SUU type=write size=1176533 2024-09-12T00:17:40.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.042+0000 7febed3678c0 1 < suggested remove operation key=W2VEW3JJEJY7 tag=Y6FB8BYQOOEU type=del 2024-09-12T00:17:40.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.046+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~HHTWRIFLPTUG.0 size=1048576 2024-09-12T00:17:40.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.050+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~HHTWRIFLPTUG.1 size=785638 2024-09-12T00:17:40.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.050+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=HHTWRIFLPTUG tag=K4557M9YTYF7 type=write size=2882790 2024-09-12T00:17:40.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.050+0000 7febed3678c0 1 < canceled part key=_multipart_MHS307JKNVCK.2~P8ZE1MFH5E4N.0 size=556471 2024-09-12T00:17:40.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.054+0000 7febed3678c0 1 < canceled multipart upload key=MHS307JKNVCK upload=P8ZE1MFH5E4N tag=3QI6SEBARK0L type=write size=1605047 2024-09-12T00:17:40.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.058+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~T0A7ZJ82VML3.0 size=1048576 2024-09-12T00:17:40.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.062+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~T0A7ZJ82VML3.1 size=1048576 2024-09-12T00:17:40.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.066+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~T0A7ZJ82VML3.2 size=1003225 2024-09-12T00:17:40.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.066+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=T0A7ZJ82VML3 tag=QYUEGBW78PE5 type=write size=4148953 2024-09-12T00:17:40.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.066+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~Q2238JEL6UYN.0 size=1048576 2024-09-12T00:17:40.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.070+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~Q2238JEL6UYN.1 size=1032815 2024-09-12T00:17:40.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.074+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=Q2238JEL6UYN tag=BJZGLEVDL5ND type=write size=3129967 2024-09-12T00:17:40.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.078+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=CQUMY10SI1H0 type=del size=3809321 2024-09-12T00:17:40.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.078+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=2NO33ULLWNPI type=del 2024-09-12T00:17:40.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.082+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=CF2HM30XXXBI type=del size=262365 2024-09-12T00:17:40.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.090+0000 7febed3678c0 1 < suggested remove operation key=9HCKHF5ZRZ5N tag=60I42AG7O2ZY type=del 2024-09-12T00:17:40.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.094+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~5KCYCXUZ9AX2.0 size=1048576 2024-09-12T00:17:40.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.098+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~5KCYCXUZ9AX2.1 size=239084 2024-09-12T00:17:40.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.098+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=5KCYCXUZ9AX2 tag=CHORQNPFLFR8 type=write size=2336236 2024-09-12T00:17:40.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.106+0000 7febed3678c0 1 < suggested remove operation key=ASFLGSKWYHG5 tag=19IUYGI99HFR type=write 2024-09-12T00:17:40.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.106+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=TVRNIIS8J9NZ type=del size=1227216 2024-09-12T00:17:40.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.110+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=G5WXBB5YYN36 type=del 2024-09-12T00:17:40.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.114+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=W162DOCNQHKW type=del size=1368916 2024-09-12T00:17:40.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.118+0000 7febed3678c0 1 < completed delete operation key=3G9ABEEEDRI3 tag=6HI46DHMKVTD type=del 2024-09-12T00:17:40.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.118+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=LZL380U9QUB3 type=del size=3184076 2024-09-12T00:17:40.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.122+0000 7febed3678c0 -1 < failed to complete operation key=LGFKY0CP299H tag=9DY1Z40N3VMP type=del size=2622579: (22) Invalid argument 2024-09-12T00:17:40.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.126+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=F9SISXJMGLU6 type=del size=2665975 2024-09-12T00:17:40.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.130+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~0KPGK9UBZO2U.0 size=1048576 2024-09-12T00:17:40.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.130+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~0KPGK9UBZO2U.1 size=1048576 2024-09-12T00:17:40.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.134+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~0KPGK9UBZO2U.2 size=762884 2024-09-12T00:17:40.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.138+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=0KPGK9UBZO2U tag=3P23P7DL6TG9 type=write size=3908612 2024-09-12T00:17:40.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.146+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~3W7IZMQID7AP.0 size=1048576 2024-09-12T00:17:40.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.150+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~3W7IZMQID7AP.1 size=293459 2024-09-12T00:17:40.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.150+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=3W7IZMQID7AP tag=FMISTGGF38O9 type=write size=2390611 2024-09-12T00:17:40.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.150+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=3711J5N2LHLL type=del 2024-09-12T00:17:40.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.154+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=IKCTUTAUE3UN type=write size=947769 2024-09-12T00:17:40.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.158+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=P6TPDANAXXYW type=del 2024-09-12T00:17:40.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.166+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~W7ZGGCKRDRF4.0 size=1048576 2024-09-12T00:17:40.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.166+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~W7ZGGCKRDRF4.1 size=1048576 2024-09-12T00:17:40.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.170+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~W7ZGGCKRDRF4.2 size=230883 2024-09-12T00:17:40.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.170+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=W7ZGGCKRDRF4 tag=ZKYSG6L5F2LK type=write size=3376611 2024-09-12T00:17:40.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.174+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=WSQ0W1O5QMPM type=del 2024-09-12T00:17:40.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.178+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=0C40D95QVX05 type=del size=343846 2024-09-12T00:17:40.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.182+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~6JDW6WLO0IJK.0 size=1048576 2024-09-12T00:17:40.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.186+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~6JDW6WLO0IJK.1 size=506424 2024-09-12T00:17:40.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.190+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=6JDW6WLO0IJK tag=LPS0F6I2CXWW type=write size=2603576 2024-09-12T00:17:40.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.194+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=3ADGUHG0ASDT type=del size=1649327 2024-09-12T00:17:40.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.198+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~AYJ13RRJ6HEI.0 size=1048576 2024-09-12T00:17:40.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.198+0000 7febed3678c0 1 < completed part key=_multipart_8RVDLW1VC8LP.2~AYJ13RRJ6HEI.1 size=199754 2024-09-12T00:17:40.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.202+0000 7febed3678c0 1 < completed multipart upload key=8RVDLW1VC8LP upload=AYJ13RRJ6HEI tag=4ME91XI5T4F5 type=write size=2296906 2024-09-12T00:17:40.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.210+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~QX9MARR84FXE.0 size=596724 2024-09-12T00:17:40.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.210+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=QX9MARR84FXE tag=6FLQE2HA0B09 type=write size=1645300 2024-09-12T00:17:40.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.210+0000 7febed3678c0 1 < canceled part key=_multipart_70W3V7TFBUFJ.2~GNCLXIMPWLIR.0 size=127957 2024-09-12T00:17:40.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.214+0000 7febed3678c0 1 < canceled multipart upload key=70W3V7TFBUFJ upload=GNCLXIMPWLIR tag=OIJXC59F5SUU type=write size=1176533 2024-09-12T00:17:40.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.218+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=SQ4IU3MYREZ2 type=write size=388740 2024-09-12T00:17:40.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.222+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~HHTWRIFLPTUG.0 size=1048576 2024-09-12T00:17:40.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.222+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~HHTWRIFLPTUG.1 size=785638 2024-09-12T00:17:40.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.230+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=HHTWRIFLPTUG tag=K4557M9YTYF7 type=write size=2882790 2024-09-12T00:17:40.235 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.238+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=5IAAKH9B9I1W type=del size=1671855 2024-09-12T00:17:40.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.238+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~T0A7ZJ82VML3.0 size=1048576 2024-09-12T00:17:40.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.238+0000 7febed3678c0 1 < canceled part key=_multipart_RGQ4KY26RKYI.2~T0A7ZJ82VML3.1 size=1048576 2024-09-12T00:17:40.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.242+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~T0A7ZJ82VML3.2 size=1003225 2024-09-12T00:17:40.246 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.246+0000 7febed3678c0 1 < canceled multipart upload key=RGQ4KY26RKYI upload=T0A7ZJ82VML3 tag=QYUEGBW78PE5 type=write size=4148953 2024-09-12T00:17:40.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.250+0000 7febed3678c0 1 > prepared operation key=3G9ABEEEDRI3 tag=TRF201I8DG3D type=write size=470563 2024-09-12T00:17:40.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.254+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=CQUMY10SI1H0 type=del 2024-09-12T00:17:40.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.262+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~P9URDTUKFP2Y.0 size=1048576 2024-09-12T00:17:40.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.262+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~P9URDTUKFP2Y.1 size=1048576 2024-09-12T00:17:40.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.266+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~P9URDTUKFP2Y.2 size=735345 2024-09-12T00:17:40.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.266+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=P9URDTUKFP2Y tag=KJPLEWE30WOQ type=write size=3881073 2024-09-12T00:17:40.268 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.270+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=CF2HM30XXXBI type=del 2024-09-12T00:17:40.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.270+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=SZJP149C3NZB type=del size=3320246 2024-09-12T00:17:40.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.274+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~5KCYCXUZ9AX2.0 size=1048576 2024-09-12T00:17:40.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.274+0000 7febed3678c0 1 < canceled part key=_multipart_MAZHOU2CEUCU.2~5KCYCXUZ9AX2.1 size=239084 2024-09-12T00:17:40.279 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.278+0000 7febed3678c0 1 < canceled multipart upload key=MAZHOU2CEUCU upload=5KCYCXUZ9AX2 tag=CHORQNPFLFR8 type=write size=2336236 2024-09-12T00:17:40.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.282+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=PCX5H8HYMDTX type=del size=2416933 2024-09-12T00:17:40.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.286+0000 7febed3678c0 1 < completed delete operation key=Z020UV2JRR0I tag=TVRNIIS8J9NZ type=del 2024-09-12T00:17:40.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.290+0000 7febed3678c0 1 > prepared part key=_multipart_W2VEW3JJEJY7.2~8PN1U2MLJFM8.0 size=363039 2024-09-12T00:17:40.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.290+0000 7febed3678c0 1 > prepared multipart upload key=W2VEW3JJEJY7 upload=8PN1U2MLJFM8 tag=2PPYSEJVOPI4 type=write size=1411615 2024-09-12T00:17:40.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.294+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=W162DOCNQHKW type=del 2024-09-12T00:17:40.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.298+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~S994YOO7CINZ.0 size=1048576 2024-09-12T00:17:40.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.302+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~S994YOO7CINZ.1 size=1048576 2024-09-12T00:17:40.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.306+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~S994YOO7CINZ.2 size=333255 2024-09-12T00:17:40.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.306+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=S994YOO7CINZ tag=P0O7WYF8S8MJ type=write size=3478983 2024-09-12T00:17:40.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.306+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=LZL380U9QUB3 type=del 2024-09-12T00:17:40.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.314+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~3PBUH58T3Z24.0 size=1048576 2024-09-12T00:17:40.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.318+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~3PBUH58T3Z24.1 size=470293 2024-09-12T00:17:40.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.318+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=3PBUH58T3Z24 tag=ZO6IOLVAD2I4 type=write size=2567445 2024-09-12T00:17:40.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.318+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=F9SISXJMGLU6 type=del 2024-09-12T00:17:40.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.322+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=JNSDHL40P1D1 type=del size=2950556 2024-09-12T00:17:40.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.322+0000 7febed3678c0 1 < canceled part key=_multipart_CIOINUP503WY.2~3W7IZMQID7AP.0 size=1048576 2024-09-12T00:17:40.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.326+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~3W7IZMQID7AP.1 size=293459 2024-09-12T00:17:40.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.330+0000 7febed3678c0 1 < canceled multipart upload key=CIOINUP503WY upload=3W7IZMQID7AP tag=FMISTGGF38O9 type=write size=2390611 2024-09-12T00:17:40.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.334+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=3K2BJLKDEPFE type=del size=179819 2024-09-12T00:17:40.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.342+0000 7febed3678c0 1 < suggested update operation key=UGV3WQR0ADYH tag=IKCTUTAUE3UN type=write size=947769 2024-09-12T00:17:40.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.346+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=2QUF0X1ZQ3QW type=del size=2920156 2024-09-12T00:17:40.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.350+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~W7ZGGCKRDRF4.0 size=1048576 2024-09-12T00:17:40.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.350+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~W7ZGGCKRDRF4.1 size=1048576 2024-09-12T00:17:40.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.350+0000 7febed3678c0 1 < canceled part key=_multipart_1HABX7YZ491W.2~W7ZGGCKRDRF4.2 size=230883 2024-09-12T00:17:40.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.358+0000 7febed3678c0 1 < canceled multipart upload key=1HABX7YZ491W upload=W7ZGGCKRDRF4 tag=ZKYSG6L5F2LK type=write size=3376611 2024-09-12T00:17:40.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.362+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=HV2ZDVG3KTOP type=del size=1795328 2024-09-12T00:17:40.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.362+0000 7febed3678c0 1 < canceled operation key=4K65QIB9F00S tag=0C40D95QVX05 type=del size=343846 2024-09-12T00:17:40.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.366+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=RNAQXZC5ST1U type=del size=38785 2024-09-12T00:17:40.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.374+0000 7febed3678c0 1 < suggested update operation key=ASFLGSKWYHG5 tag=3ADGUHG0ASDT type=del size=1649327 2024-09-12T00:17:40.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.374+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=3Z3JMOP78L8Q type=del size=3322730 2024-09-12T00:17:40.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.378+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~QX9MARR84FXE.0 size=596724 2024-09-12T00:17:40.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.382+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=QX9MARR84FXE tag=6FLQE2HA0B09 type=write size=1645300 2024-09-12T00:17:40.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.386+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=8D3ACAE7XS7C type=del size=2808557 2024-09-12T00:17:40.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.394+0000 7febed3678c0 1 < suggested update operation key=53T1415UK7GE tag=SQ4IU3MYREZ2 type=write size=388740 2024-09-12T00:17:40.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.398+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=NOXF7GSKF7HW type=del size=2206035 2024-09-12T00:17:40.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.398+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=5IAAKH9B9I1W type=del 2024-09-12T00:17:40.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.402+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=5PM8NEI9DXFL type=del size=2678910 2024-09-12T00:17:40.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.406+0000 7febed3678c0 1 < completed write operation key=3G9ABEEEDRI3 tag=TRF201I8DG3D type=write size=470563 2024-09-12T00:17:40.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.410+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=LHX3MIN1LOBK type=write size=792176 2024-09-12T00:17:40.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.414+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~P9URDTUKFP2Y.0 size=1048576 2024-09-12T00:17:40.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.414+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~P9URDTUKFP2Y.1 size=1048576 2024-09-12T00:17:40.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.418+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~P9URDTUKFP2Y.2 size=735345 2024-09-12T00:17:40.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.422+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=P9URDTUKFP2Y tag=KJPLEWE30WOQ type=write size=3881073 2024-09-12T00:17:40.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.426+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=MDUGK2UF9IF2 type=del size=3115532 2024-09-12T00:17:40.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.430+0000 7febed3678c0 1 < completed delete operation key=LGFKY0CP299H tag=SZJP149C3NZB type=del 2024-09-12T00:17:40.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.434+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~TL1CPMZHS58L.0 size=1048576 2024-09-12T00:17:40.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.438+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~TL1CPMZHS58L.1 size=1048576 2024-09-12T00:17:40.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.442+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~TL1CPMZHS58L.2 size=429718 2024-09-12T00:17:40.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.442+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=TL1CPMZHS58L tag=46PFI7YB909E type=write size=3575446 2024-09-12T00:17:40.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.446+0000 7febed3678c0 1 < suggested update operation key=AHTIFXX3SGK7 tag=PCX5H8HYMDTX type=del size=2416933 2024-09-12T00:17:40.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.450+0000 7febed3678c0 1 > prepared operation key=Z020UV2JRR0I tag=J71I0UHIK4S4 type=del size=2615313 2024-09-12T00:17:40.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.454+0000 7febed3678c0 1 < completed part key=_multipart_W2VEW3JJEJY7.2~8PN1U2MLJFM8.0 size=363039 2024-09-12T00:17:40.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.458+0000 7febed3678c0 1 < completed multipart upload key=W2VEW3JJEJY7 upload=8PN1U2MLJFM8 tag=2PPYSEJVOPI4 type=write size=1411615 2024-09-12T00:17:40.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.462+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=I0BVP28YJ8QN type=del size=368444 2024-09-12T00:17:40.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.466+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~S994YOO7CINZ.0 size=1048576 2024-09-12T00:17:40.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.470+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~S994YOO7CINZ.1 size=1048576 2024-09-12T00:17:40.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.470+0000 7febed3678c0 1 < canceled part key=_multipart_25THATWGX4WS.2~S994YOO7CINZ.2 size=333255 2024-09-12T00:17:40.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.474+0000 7febed3678c0 1 < canceled multipart upload key=25THATWGX4WS upload=S994YOO7CINZ tag=P0O7WYF8S8MJ type=write size=3478983 2024-09-12T00:17:40.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.478+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=B64TZUMTAGEZ type=del size=3503961 2024-09-12T00:17:40.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.482+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~3PBUH58T3Z24.0 size=1048576 2024-09-12T00:17:40.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.482+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~3PBUH58T3Z24.1 size=470293 2024-09-12T00:17:40.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.486+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=3PBUH58T3Z24 tag=ZO6IOLVAD2I4 type=write size=2567445 2024-09-12T00:17:40.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.490+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=M1RNBQ9LL053 type=del size=3514346 2024-09-12T00:17:40.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.494+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=JNSDHL40P1D1 type=del 2024-09-12T00:17:40.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.498+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~889SRSP4PGUN.0 size=1042565 2024-09-12T00:17:40.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.498+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=889SRSP4PGUN tag=1BMF0RBUB304 type=write size=2091141 2024-09-12T00:17:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.502+0000 7febed3678c0 1 < canceled operation key=52SSW5KTCS15 tag=3K2BJLKDEPFE type=del size=179819 2024-09-12T00:17:40.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.506+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=MZRMQKPUB86Q type=del size=3655967 2024-09-12T00:17:40.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.510+0000 7febed3678c0 1 < suggested remove operation key=88BY5RHXSHD4 tag=2QUF0X1ZQ3QW type=del 2024-09-12T00:17:40.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.518+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~GSSQLWFOUWQQ.0 size=1048576 2024-09-12T00:17:40.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.518+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~GSSQLWFOUWQQ.1 size=1048576 2024-09-12T00:17:40.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.522+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~GSSQLWFOUWQQ.2 size=662702 2024-09-12T00:17:40.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.522+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=GSSQLWFOUWQQ tag=WJJ4TY4PC259 type=write size=3808430 2024-09-12T00:17:40.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.526+0000 7febed3678c0 -1 < failed to complete operation key=AHTIFXX3SGK7 tag=HV2ZDVG3KTOP type=del size=1795328: (22) Invalid argument 2024-09-12T00:17:40.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.526+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=0FXPI22AMMVQ type=del size=3523550 2024-09-12T00:17:40.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.534+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=RNAQXZC5ST1U type=del 2024-09-12T00:17:40.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.542+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~M8OGVHY98KBI.0 size=1048576 2024-09-12T00:17:40.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.542+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~M8OGVHY98KBI.1 size=463770 2024-09-12T00:17:40.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.542+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=M8OGVHY98KBI tag=5NKP46V41DP2 type=write size=2560922 2024-09-12T00:17:40.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.546+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=3Z3JMOP78L8Q type=del 2024-09-12T00:17:40.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.550+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~9K23XJWPIT98.0 size=1048576 2024-09-12T00:17:40.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.554+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~9K23XJWPIT98.1 size=1048576 2024-09-12T00:17:40.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.554+0000 7febed3678c0 1 > prepared part key=_multipart_H017KWW59B8Z.2~9K23XJWPIT98.2 size=865633 2024-09-12T00:17:40.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.554+0000 7febed3678c0 1 > prepared multipart upload key=H017KWW59B8Z upload=9K23XJWPIT98 tag=3DNHPO1PZJZM type=write size=4011361 2024-09-12T00:17:40.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.558+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=8D3ACAE7XS7C type=del 2024-09-12T00:17:40.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.562+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=WOXN6WY9RQAN type=del size=2456983 2024-09-12T00:17:40.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.566+0000 7febed3678c0 1 < suggested update operation key=25THATWGX4WS tag=NOXF7GSKF7HW type=del size=2206035 2024-09-12T00:17:40.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.570+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=7SAA6F7F1FHV type=del size=1336374 2024-09-12T00:17:40.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.574+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=5PM8NEI9DXFL type=del 2024-09-12T00:17:40.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.578+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=97B51DXADQ2K type=del size=2460934 2024-09-12T00:17:40.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.578+0000 7febed3678c0 1 < completed write operation key=ELNXYXX5ZWOW tag=LHX3MIN1LOBK type=write size=792176 2024-09-12T00:17:40.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.582+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=C16EF6D0VE3K type=del size=3609048 2024-09-12T00:17:40.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.586+0000 7febed3678c0 1 < completed delete operation key=KABJD0GYBVF4 tag=MDUGK2UF9IF2 type=del 2024-09-12T00:17:40.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.586+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=RTIPLE2TR3FD type=del size=3405795 2024-09-12T00:17:40.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.590+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~TL1CPMZHS58L.0 size=1048576 2024-09-12T00:17:40.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.590+0000 7febed3678c0 1 < canceled part key=_multipart_1HABX7YZ491W.2~TL1CPMZHS58L.1 size=1048576 2024-09-12T00:17:40.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.594+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~TL1CPMZHS58L.2 size=429718 2024-09-12T00:17:40.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.598+0000 7febed3678c0 1 < canceled multipart upload key=1HABX7YZ491W upload=TL1CPMZHS58L tag=46PFI7YB909E type=write size=3575446 2024-09-12T00:17:40.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.602+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=C734Q6HT3OKX type=del size=4176779 2024-09-12T00:17:40.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.602+0000 7febed3678c0 1 < canceled operation key=Z020UV2JRR0I tag=J71I0UHIK4S4 type=del size=2615313 2024-09-12T00:17:40.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.606+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=422SX1AHH1MU type=del size=3563337 2024-09-12T00:17:40.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.610+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=I0BVP28YJ8QN type=del 2024-09-12T00:17:40.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.614+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~G794R6V49F7G.0 size=1048576 2024-09-12T00:17:40.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.618+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~G794R6V49F7G.1 size=489294 2024-09-12T00:17:40.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.618+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=G794R6V49F7G tag=ABHVCIQ7G2KQ type=write size=2586446 2024-09-12T00:17:40.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.622+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=B64TZUMTAGEZ type=del 2024-09-12T00:17:40.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.622+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=JYLWNWXVZY4Z type=del size=2809269 2024-09-12T00:17:40.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.626+0000 7febed3678c0 1 < canceled operation key=53T1415UK7GE tag=M1RNBQ9LL053 type=del size=3514346 2024-09-12T00:17:40.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.634+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~A4DYDPTRO531.0 size=625042 2024-09-12T00:17:40.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.634+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=A4DYDPTRO531 tag=BBWF77K9GJ0F type=write size=1673618 2024-09-12T00:17:40.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.634+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~889SRSP4PGUN.0 size=1042565 2024-09-12T00:17:40.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.642+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=889SRSP4PGUN tag=1BMF0RBUB304 type=write size=2091141 2024-09-12T00:17:40.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.646+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~4A350OVZP77D.0 size=812912 2024-09-12T00:17:40.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.646+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=4A350OVZP77D tag=7TEHZJOYTTAD type=write size=1861488 2024-09-12T00:17:40.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.650+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=MZRMQKPUB86Q type=del 2024-09-12T00:17:40.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.650+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=YTS0IQIVA07P type=del size=981103 2024-09-12T00:17:40.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.654+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~GSSQLWFOUWQQ.0 size=1048576 2024-09-12T00:17:40.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.658+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~GSSQLWFOUWQQ.1 size=1048576 2024-09-12T00:17:40.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.658+0000 7febed3678c0 1 < completed part key=_multipart_VU1AF57EUA0R.2~GSSQLWFOUWQQ.2 size=662702 2024-09-12T00:17:40.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.662+0000 7febed3678c0 1 < completed multipart upload key=VU1AF57EUA0R upload=GSSQLWFOUWQQ tag=WJJ4TY4PC259 type=write size=3808430 2024-09-12T00:17:40.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.666+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=PZ1M7ODMX8OA type=del size=1179529 2024-09-12T00:17:40.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.670+0000 7febed3678c0 1 < suggested remove operation key=RGQ4KY26RKYI tag=0FXPI22AMMVQ type=del 2024-09-12T00:17:40.673 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.674+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=WTXOH2QGZCHD type=del size=2310606 2024-09-12T00:17:40.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.678+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~M8OGVHY98KBI.0 size=1048576 2024-09-12T00:17:40.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.678+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~M8OGVHY98KBI.1 size=463770 2024-09-12T00:17:40.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.682+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=M8OGVHY98KBI tag=5NKP46V41DP2 type=write size=2560922 2024-09-12T00:17:40.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.686+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=VEUVZWH2NDUN type=del size=1673241 2024-09-12T00:17:40.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.690+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~9K23XJWPIT98.0 size=1048576 2024-09-12T00:17:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.690+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~9K23XJWPIT98.1 size=1048576 2024-09-12T00:17:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.694+0000 7febed3678c0 1 < completed part key=_multipart_H017KWW59B8Z.2~9K23XJWPIT98.2 size=865633 2024-09-12T00:17:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.698+0000 7febed3678c0 1 < completed multipart upload key=H017KWW59B8Z upload=9K23XJWPIT98 tag=3DNHPO1PZJZM type=write size=4011361 2024-09-12T00:17:40.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.702+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~J1V2GD7MXZ9T.0 size=796132 2024-09-12T00:17:40.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.702+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=J1V2GD7MXZ9T tag=2OAZ0GIN9BGE type=write size=1844708 2024-09-12T00:17:40.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.706+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=WOXN6WY9RQAN type=del 2024-09-12T00:17:40.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.710+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~1ZT41X5296K8.0 size=597259 2024-09-12T00:17:40.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.710+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=1ZT41X5296K8 tag=QKBWSC69KK9R type=write size=1645835 2024-09-12T00:17:40.714 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.714+0000 7febed3678c0 1 < suggested update operation key=LWAMFA0RSW6S tag=7SAA6F7F1FHV type=del size=1336374 2024-09-12T00:17:40.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.722+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~OCGGIG0F6CKN.0 size=1048576 2024-09-12T00:17:40.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.722+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~OCGGIG0F6CKN.1 size=935273 2024-09-12T00:17:40.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.722+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=OCGGIG0F6CKN tag=6GR16U4JL8AB type=write size=3032425 2024-09-12T00:17:40.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.726+0000 7febed3678c0 1 < completed delete operation key=CIOINUP503WY tag=97B51DXADQ2K type=del 2024-09-12T00:17:40.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.726+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=D0AUBAGMXYH1 type=del size=1850595 2024-09-12T00:17:40.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.730+0000 7febed3678c0 1 < canceled operation key=9HCKHF5ZRZ5N tag=C16EF6D0VE3K type=del size=3609048 2024-09-12T00:17:40.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.734+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=10VL4273J8DH type=del size=111252 2024-09-12T00:17:40.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.734+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=RTIPLE2TR3FD type=del 2024-09-12T00:17:40.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.742+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~QS0G3Y01HV1Y.0 size=17519 2024-09-12T00:17:40.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.742+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=QS0G3Y01HV1Y tag=WY0XI0MFNVD5 type=write size=1066095 2024-09-12T00:17:40.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.746+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=C734Q6HT3OKX type=del 2024-09-12T00:17:40.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.750+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=J7T7WW1HTIKV type=write size=914045 2024-09-12T00:17:40.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.750+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=422SX1AHH1MU type=del 2024-09-12T00:17:40.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.754+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=4JHAAAGN9TEB type=del size=3244541 2024-09-12T00:17:40.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.758+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~G794R6V49F7G.0 size=1048576 2024-09-12T00:17:40.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.762+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~G794R6V49F7G.1 size=489294 2024-09-12T00:17:40.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.766+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=G794R6V49F7G tag=ABHVCIQ7G2KQ type=write size=2586446 2024-09-12T00:17:40.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.770+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=T3RFEAGDG3A4 type=del size=2160124 2024-09-12T00:17:40.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.774+0000 7febed3678c0 1 < completed delete operation key=MHS307JKNVCK tag=JYLWNWXVZY4Z type=del 2024-09-12T00:17:40.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.774+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=6L5I4N05WCNI type=del size=252720 2024-09-12T00:17:40.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.782+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~A4DYDPTRO531.0 size=625042 2024-09-12T00:17:40.782 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.782+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=A4DYDPTRO531 tag=BBWF77K9GJ0F type=write size=1673618 2024-09-12T00:17:40.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.790+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~U6BOBY54B87N.0 size=1048576 2024-09-12T00:17:40.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.790+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~U6BOBY54B87N.1 size=1048576 2024-09-12T00:17:40.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.794+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~U6BOBY54B87N.2 size=197920 2024-09-12T00:17:40.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.794+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=U6BOBY54B87N tag=BAA4YKJKQMRR type=write size=3343648 2024-09-12T00:17:40.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.794+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~4A350OVZP77D.0 size=812912 2024-09-12T00:17:40.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.802+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=4A350OVZP77D tag=7TEHZJOYTTAD type=write size=1861488 2024-09-12T00:17:40.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.806+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=VYQMERLOXZTA type=del size=2577438 2024-09-12T00:17:40.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.810+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=YTS0IQIVA07P type=del 2024-09-12T00:17:40.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.814+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=2JBLMIQHEKZR type=del size=3315654 2024-09-12T00:17:40.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.818+0000 7febed3678c0 1 < suggested remove operation key=VU1AF57EUA0R tag=PZ1M7ODMX8OA type=del 2024-09-12T00:17:40.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.826+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~XGXQZDN26B5W.0 size=666818 2024-09-12T00:17:40.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.826+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=XGXQZDN26B5W tag=XRODTPI8IJUV type=write size=1715394 2024-09-12T00:17:40.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.830+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=WTXOH2QGZCHD type=del 2024-09-12T00:17:40.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.834+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=8HBNXYQB797P type=del size=2808945 2024-09-12T00:17:40.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.834+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=VEUVZWH2NDUN type=del 2024-09-12T00:17:40.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.838+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=DO9FG0CRJAHP type=del size=395844 2024-09-12T00:17:40.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.838+0000 7febed3678c0 1 < canceled part key=_multipart_ASFLGSKWYHG5.2~J1V2GD7MXZ9T.0 size=796132 2024-09-12T00:17:40.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.842+0000 7febed3678c0 1 < canceled multipart upload key=ASFLGSKWYHG5 upload=J1V2GD7MXZ9T tag=2OAZ0GIN9BGE type=write size=1844708 2024-09-12T00:17:40.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.846+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=NG8FQW8WUP7J type=del size=1839108 2024-09-12T00:17:40.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.846+0000 7febed3678c0 1 < canceled part key=_multipart_88BY5RHXSHD4.2~1ZT41X5296K8.0 size=597259 2024-09-12T00:17:40.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.850+0000 7febed3678c0 1 < canceled multipart upload key=88BY5RHXSHD4 upload=1ZT41X5296K8 tag=QKBWSC69KK9R type=write size=1645835 2024-09-12T00:17:40.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.854+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~DUJA0OUXQCDX.0 size=374325 2024-09-12T00:17:40.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.854+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=DUJA0OUXQCDX tag=12AP5TE3QKOG type=write size=1422901 2024-09-12T00:17:40.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.858+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~OCGGIG0F6CKN.0 size=1048576 2024-09-12T00:17:40.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.862+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~OCGGIG0F6CKN.1 size=935273 2024-09-12T00:17:40.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.866+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=OCGGIG0F6CKN tag=6GR16U4JL8AB type=write size=3032425 2024-09-12T00:17:40.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.874+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~85TP08MO0W29.0 size=1032613 2024-09-12T00:17:40.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.874+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=85TP08MO0W29 tag=J4PPO0HXEM8I type=write size=2081189 2024-09-12T00:17:40.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.878+0000 7febed3678c0 1 < suggested remove operation key=KABJD0GYBVF4 tag=D0AUBAGMXYH1 type=del 2024-09-12T00:17:40.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.882+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=J4ZKY5N37FMA type=write size=1014624 2024-09-12T00:17:40.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.882+0000 7febed3678c0 1 < completed delete operation key=MLPN8PH72VQ9 tag=10VL4273J8DH type=del 2024-09-12T00:17:40.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.886+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=06IWF35S287F type=del size=2678095 2024-09-12T00:17:40.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.890+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~QS0G3Y01HV1Y.0 size=17519 2024-09-12T00:17:40.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.894+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=QS0G3Y01HV1Y tag=WY0XI0MFNVD5 type=write size=1066095 2024-09-12T00:17:40.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.898+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=2OREHLQHG85F type=write size=79009 2024-09-12T00:17:40.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.898+0000 7febed3678c0 1 < completed write operation key=88BY5RHXSHD4 tag=J7T7WW1HTIKV type=write size=914045 2024-09-12T00:17:40.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.902+0000 7febed3678c0 1 > prepared operation key=UGV3WQR0ADYH tag=KE1C68O7GI5C type=del size=3675177 2024-09-12T00:17:40.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.906+0000 7febed3678c0 1 < canceled operation key=H017KWW59B8Z tag=4JHAAAGN9TEB type=del size=3244541 2024-09-12T00:17:40.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.910+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=EHHGQMP1YGQK type=del size=3071654 2024-09-12T00:17:40.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.910+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=T3RFEAGDG3A4 type=del 2024-09-12T00:17:40.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.914+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=5DS9YTELR0VL type=write size=693542 2024-09-12T00:17:40.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.918+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=6L5I4N05WCNI type=del 2024-09-12T00:17:40.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.922+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~K655DHNOSA6T.0 size=1048576 2024-09-12T00:17:40.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.926+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~K655DHNOSA6T.1 size=936453 2024-09-12T00:17:40.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.926+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=K655DHNOSA6T tag=134IPS4RJ3QC type=write size=3033605 2024-09-12T00:17:40.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.930+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~U6BOBY54B87N.0 size=1048576 2024-09-12T00:17:40.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.930+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~U6BOBY54B87N.1 size=1048576 2024-09-12T00:17:40.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.934+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~U6BOBY54B87N.2 size=197920 2024-09-12T00:17:40.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.938+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=U6BOBY54B87N tag=BAA4YKJKQMRR type=write size=3343648 2024-09-12T00:17:40.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.942+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=FH0D93NUNAQ1 type=del size=2725102 2024-09-12T00:17:40.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.946+0000 7febed3678c0 1 < completed delete operation key=RGQ4KY26RKYI tag=VYQMERLOXZTA type=del 2024-09-12T00:17:40.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.950+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~OLZI6KNYA6JC.0 size=1048576 2024-09-12T00:17:40.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.954+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~OLZI6KNYA6JC.1 size=1048576 2024-09-12T00:17:40.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.954+0000 7febed3678c0 1 > prepared part key=_multipart_ELNXYXX5ZWOW.2~OLZI6KNYA6JC.2 size=458925 2024-09-12T00:17:40.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.954+0000 7febed3678c0 1 > prepared multipart upload key=ELNXYXX5ZWOW upload=OLZI6KNYA6JC tag=GQFP5541Z0BZ type=write size=3604653 2024-09-12T00:17:40.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.958+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=2JBLMIQHEKZR type=del 2024-09-12T00:17:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.966+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~4YQWGNVKIL9E.0 size=559425 2024-09-12T00:17:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.966+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=4YQWGNVKIL9E tag=T4VZL7YO9VP8 type=write size=1608001 2024-09-12T00:17:40.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.966+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~XGXQZDN26B5W.0 size=666818 2024-09-12T00:17:40.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.974+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=XGXQZDN26B5W tag=XRODTPI8IJUV type=write size=1715394 2024-09-12T00:17:40.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.978+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=W1ORS512KALH type=del size=1294657 2024-09-12T00:17:40.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.982+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=8HBNXYQB797P type=del 2024-09-12T00:17:40.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.986+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~UD4ES7X87YB2.0 size=1048576 2024-09-12T00:17:40.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.990+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~UD4ES7X87YB2.1 size=1048576 2024-09-12T00:17:40.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.994+0000 7febed3678c0 1 > prepared part key=_multipart_25THATWGX4WS.2~UD4ES7X87YB2.2 size=833184 2024-09-12T00:17:40.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.994+0000 7febed3678c0 1 > prepared multipart upload key=25THATWGX4WS upload=UD4ES7X87YB2 tag=KZI1AR0JXK5E type=write size=3978912 2024-09-12T00:17:40.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:40.998+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=DO9FG0CRJAHP type=del 2024-09-12T00:17:41.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.002+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~WJM5WORE33VZ.0 size=1048576 2024-09-12T00:17:41.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.006+0000 7febed3678c0 1 > prepared part key=_multipart_MHS307JKNVCK.2~WJM5WORE33VZ.1 size=347971 2024-09-12T00:17:41.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.006+0000 7febed3678c0 1 > prepared multipart upload key=MHS307JKNVCK upload=WJM5WORE33VZ tag=H2HVAU0JILTG type=write size=2445123 2024-09-12T00:17:41.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.010+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=NG8FQW8WUP7J type=del 2024-09-12T00:17:41.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.014+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=WBEST11VJ2SM type=write size=685259 2024-09-12T00:17:41.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.014+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~DUJA0OUXQCDX.0 size=374325 2024-09-12T00:17:41.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.022+0000 7febed3678c0 1 < completed multipart upload key=ELNXYXX5ZWOW upload=DUJA0OUXQCDX tag=12AP5TE3QKOG type=write size=1422901 2024-09-12T00:17:41.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.026+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~FG4Z8FCVYVPN.0 size=1048576 2024-09-12T00:17:41.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.030+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~FG4Z8FCVYVPN.1 size=1048576 2024-09-12T00:17:41.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.030+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~FG4Z8FCVYVPN.2 size=207848 2024-09-12T00:17:41.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.030+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=FG4Z8FCVYVPN tag=Z934HNTK661N type=write size=3353576 2024-09-12T00:17:41.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.034+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~85TP08MO0W29.0 size=1032613 2024-09-12T00:17:41.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.038+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=85TP08MO0W29 tag=J4PPO0HXEM8I type=write size=2081189 2024-09-12T00:17:41.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.042+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=AJCWM7GRM0K1 type=del size=302135 2024-09-12T00:17:41.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.046+0000 7febed3678c0 1 < completed write operation key=1HABX7YZ491W tag=J4ZKY5N37FMA type=write size=1014624 2024-09-12T00:17:41.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.050+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~GOUSV4T1X969.0 size=1048576 2024-09-12T00:17:41.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.054+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~GOUSV4T1X969.1 size=1048576 2024-09-12T00:17:41.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.054+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~GOUSV4T1X969.2 size=794096 2024-09-12T00:17:41.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.054+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=GOUSV4T1X969 tag=PHK06O4GRULA type=write size=3939824 2024-09-12T00:17:41.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.058+0000 7febed3678c0 1 < completed delete operation key=0KQK1CXHO096 tag=06IWF35S287F type=del 2024-09-12T00:17:41.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.062+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=OSZUYTJUTTJR type=write size=584573 2024-09-12T00:17:41.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.066+0000 7febed3678c0 1 < completed write operation key=CIOINUP503WY tag=2OREHLQHG85F type=write size=79009 2024-09-12T00:17:41.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.070+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=95CE50XX9W6S type=del size=523803 2024-09-12T00:17:41.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.074+0000 7febed3678c0 1 < completed delete operation key=UGV3WQR0ADYH tag=KE1C68O7GI5C type=del 2024-09-12T00:17:41.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.078+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=61MFJBRHU10F type=del size=2583010 2024-09-12T00:17:41.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.082+0000 7febed3678c0 1 < suggested update operation key=CIOINUP503WY tag=EHHGQMP1YGQK type=del size=3071654 2024-09-12T00:17:41.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.086+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=SKTSEYSOG8UM type=write size=665959 2024-09-12T00:17:41.091 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.090+0000 7febed3678c0 1 < completed write operation key=8RVDLW1VC8LP tag=5DS9YTELR0VL type=write size=693542 2024-09-12T00:17:41.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.098+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~AUJMNETQTWJH.0 size=1048576 2024-09-12T00:17:41.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.106+0000 7febed3678c0 1 > prepared part key=_multipart_CIOINUP503WY.2~AUJMNETQTWJH.1 size=590240 2024-09-12T00:17:41.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.106+0000 7febed3678c0 1 > prepared multipart upload key=CIOINUP503WY upload=AUJMNETQTWJH tag=8C11L5E00QLP type=write size=2687392 2024-09-12T00:17:41.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.106+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~K655DHNOSA6T.0 size=1048576 2024-09-12T00:17:41.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.106+0000 7febed3678c0 1 < canceled part key=_multipart_3G9ABEEEDRI3.2~K655DHNOSA6T.1 size=936453 2024-09-12T00:17:41.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.114+0000 7febed3678c0 1 < canceled multipart upload key=3G9ABEEEDRI3 upload=K655DHNOSA6T tag=134IPS4RJ3QC type=write size=3033605 2024-09-12T00:17:41.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.118+0000 7febed3678c0 1 > prepared operation key=LGFKY0CP299H tag=FUUPQ0WOGZ7V type=del size=2285442 2024-09-12T00:17:41.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.122+0000 7febed3678c0 1 < suggested update operation key=8RVDLW1VC8LP tag=FH0D93NUNAQ1 type=del size=2725102 2024-09-12T00:17:41.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.126+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=N9H2YU8ZSBVT type=write size=421943 2024-09-12T00:17:41.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.130+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~OLZI6KNYA6JC.0 size=1048576 2024-09-12T00:17:41.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.134+0000 7febed3678c0 1 < completed part key=_multipart_ELNXYXX5ZWOW.2~OLZI6KNYA6JC.1 size=1048576 2024-09-12T00:17:41.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.134+0000 7febed3678c0 1 < canceled part key=_multipart_ELNXYXX5ZWOW.2~OLZI6KNYA6JC.2 size=458925 2024-09-12T00:17:41.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.138+0000 7febed3678c0 1 < canceled multipart upload key=ELNXYXX5ZWOW upload=OLZI6KNYA6JC tag=GQFP5541Z0BZ type=write size=3604653 2024-09-12T00:17:41.142 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.142+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~ZQ4IVDN14NNB.0 size=803024 2024-09-12T00:17:41.142 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.142+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=ZQ4IVDN14NNB tag=B54XTOW1Z100 type=write size=1851600 2024-09-12T00:17:41.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.142+0000 7febed3678c0 1 < canceled part key=_multipart_VU1AF57EUA0R.2~4YQWGNVKIL9E.0 size=559425 2024-09-12T00:17:41.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.150+0000 7febed3678c0 1 < canceled multipart upload key=VU1AF57EUA0R upload=4YQWGNVKIL9E tag=T4VZL7YO9VP8 type=write size=1608001 2024-09-12T00:17:41.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.150+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=CTQOZ0WG9MFG type=del size=2991712 2024-09-12T00:17:41.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.154+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=W1ORS512KALH type=del 2024-09-12T00:17:41.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.158+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~OATMMQWSNJV1.0 size=1048576 2024-09-12T00:17:41.159 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.162+0000 7febed3678c0 1 > prepared part key=_multipart_G22WTRRGIQKE.2~OATMMQWSNJV1.1 size=352962 2024-09-12T00:17:41.159 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.162+0000 7febed3678c0 1 > prepared multipart upload key=G22WTRRGIQKE upload=OATMMQWSNJV1 tag=AMK4VTOHJ091 type=write size=2450114 2024-09-12T00:17:41.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.162+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~UD4ES7X87YB2.0 size=1048576 2024-09-12T00:17:41.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.166+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~UD4ES7X87YB2.1 size=1048576 2024-09-12T00:17:41.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.170+0000 7febed3678c0 1 < completed part key=_multipart_25THATWGX4WS.2~UD4ES7X87YB2.2 size=833184 2024-09-12T00:17:41.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.174+0000 7febed3678c0 1 < completed multipart upload key=25THATWGX4WS upload=UD4ES7X87YB2 tag=KZI1AR0JXK5E type=write size=3978912 2024-09-12T00:17:41.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.178+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=E66K794OI866 type=write size=197322 2024-09-12T00:17:41.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.182+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~WJM5WORE33VZ.0 size=1048576 2024-09-12T00:17:41.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.182+0000 7febed3678c0 1 < completed part key=_multipart_MHS307JKNVCK.2~WJM5WORE33VZ.1 size=347971 2024-09-12T00:17:41.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.190+0000 7febed3678c0 1 < completed multipart upload key=MHS307JKNVCK upload=WJM5WORE33VZ tag=H2HVAU0JILTG type=write size=2445123 2024-09-12T00:17:41.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.194+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=V0OAESUL4VJY type=del size=586601 2024-09-12T00:17:41.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.194+0000 7febed3678c0 1 < completed write operation key=KLO47UYYACLU tag=WBEST11VJ2SM type=write size=685259 2024-09-12T00:17:41.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.198+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=FDD1KL09DT89 type=write size=4698 2024-09-12T00:17:41.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.202+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~FG4Z8FCVYVPN.0 size=1048576 2024-09-12T00:17:41.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.206+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~FG4Z8FCVYVPN.1 size=1048576 2024-09-12T00:17:41.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.206+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~FG4Z8FCVYVPN.2 size=207848 2024-09-12T00:17:41.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.214+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=FG4Z8FCVYVPN tag=Z934HNTK661N type=write size=3353576 2024-09-12T00:17:41.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.218+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~F1XD0XBUDII9.0 size=805867 2024-09-12T00:17:41.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.218+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=F1XD0XBUDII9 tag=0VIUZAFF30RN type=write size=1854443 2024-09-12T00:17:41.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.222+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=AJCWM7GRM0K1 type=del 2024-09-12T00:17:41.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.226+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~N0GF52IHRM4P.0 size=970679 2024-09-12T00:17:41.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.226+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=N0GF52IHRM4P tag=RSSCAC2H9LTA type=write size=2019255 2024-09-12T00:17:41.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.230+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~GOUSV4T1X969.0 size=1048576 2024-09-12T00:17:41.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.234+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~GOUSV4T1X969.1 size=1048576 2024-09-12T00:17:41.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.238+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~GOUSV4T1X969.2 size=794096 2024-09-12T00:17:41.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.242+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=GOUSV4T1X969 tag=PHK06O4GRULA type=write size=3939824 2024-09-12T00:17:41.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.246+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=VU21E4239YH7 type=del size=197854 2024-09-12T00:17:41.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.254+0000 7febed3678c0 1 < suggested remove operation key=CIOINUP503WY tag=OSZUYTJUTTJR type=write 2024-09-12T00:17:41.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.258+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~LED21TWF4CLE.0 size=794298 2024-09-12T00:17:41.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.258+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=LED21TWF4CLE tag=UNX6L9I0LEGE type=write size=1842874 2024-09-12T00:17:41.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.266+0000 7febed3678c0 1 < suggested update operation key=LGFKY0CP299H tag=95CE50XX9W6S type=del size=523803 2024-09-12T00:17:41.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.270+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=OIFCPVRSBU7V type=del size=1922985 2024-09-12T00:17:41.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.270+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=61MFJBRHU10F type=del 2024-09-12T00:17:41.273 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.274+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=MET3SYGLE4E7 type=del size=2260584 2024-09-12T00:17:41.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.278+0000 7febed3678c0 1 < completed write operation key=H017KWW59B8Z tag=SKTSEYSOG8UM type=write size=665959 2024-09-12T00:17:41.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.282+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~XOBB6JY7PRFD.0 size=1048576 2024-09-12T00:17:41.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.286+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~XOBB6JY7PRFD.1 size=224655 2024-09-12T00:17:41.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.286+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=XOBB6JY7PRFD tag=217N6JTV7B9J type=write size=2321807 2024-09-12T00:17:41.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.290+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~AUJMNETQTWJH.0 size=1048576 2024-09-12T00:17:41.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.294+0000 7febed3678c0 1 < completed part key=_multipart_CIOINUP503WY.2~AUJMNETQTWJH.1 size=590240 2024-09-12T00:17:41.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.298+0000 7febed3678c0 1 < completed multipart upload key=CIOINUP503WY upload=AUJMNETQTWJH tag=8C11L5E00QLP type=write size=2687392 2024-09-12T00:17:41.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.306+0000 7febed3678c0 1 > prepared part key=_multipart_8RVDLW1VC8LP.2~WZDKJWC1GZD0.0 size=178439 2024-09-12T00:17:41.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.306+0000 7febed3678c0 1 > prepared multipart upload key=8RVDLW1VC8LP upload=WZDKJWC1GZD0 tag=IMG77BMQNE9A type=write size=1227015 2024-09-12T00:17:41.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.310+0000 7febed3678c0 1 < suggested update operation key=LGFKY0CP299H tag=FUUPQ0WOGZ7V type=del size=2285442 2024-09-12T00:17:41.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.318+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~3GOLNMHLF0L4.0 size=1048576 2024-09-12T00:17:41.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.322+0000 7febed3678c0 1 > prepared part key=_multipart_MAZHOU2CEUCU.2~3GOLNMHLF0L4.1 size=721080 2024-09-12T00:17:41.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.322+0000 7febed3678c0 1 > prepared multipart upload key=MAZHOU2CEUCU upload=3GOLNMHLF0L4 tag=DVRQ8RODS29L type=write size=2818232 2024-09-12T00:17:41.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.322+0000 7febed3678c0 1 < completed write operation key=4K65QIB9F00S tag=N9H2YU8ZSBVT type=write size=421943 2024-09-12T00:17:41.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.326+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=S9MT65IDOS5A type=del size=2822629 2024-09-12T00:17:41.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.330+0000 7febed3678c0 1 < completed part key=_multipart_70W3V7TFBUFJ.2~ZQ4IVDN14NNB.0 size=803024 2024-09-12T00:17:41.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.338+0000 7febed3678c0 1 < completed multipart upload key=70W3V7TFBUFJ upload=ZQ4IVDN14NNB tag=B54XTOW1Z100 type=write size=1851600 2024-09-12T00:17:41.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.342+0000 7febed3678c0 1 > prepared part key=_multipart_UGV3WQR0ADYH.2~C5AXWVX9FQCP.0 size=116029 2024-09-12T00:17:41.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.342+0000 7febed3678c0 1 > prepared multipart upload key=UGV3WQR0ADYH upload=C5AXWVX9FQCP tag=7LMH3DAMZ2WG type=write size=1164605 2024-09-12T00:17:41.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.346+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=CTQOZ0WG9MFG type=del 2024-09-12T00:17:41.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.350+0000 7febed3678c0 1 > prepared operation key=VW69JRC5JYX5 tag=EVYL4SUENRIX type=del size=1566942 2024-09-12T00:17:41.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.354+0000 7febed3678c0 1 < completed part key=_multipart_G22WTRRGIQKE.2~OATMMQWSNJV1.0 size=1048576 2024-09-12T00:17:41.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.354+0000 7febed3678c0 1 < canceled part key=_multipart_G22WTRRGIQKE.2~OATMMQWSNJV1.1 size=352962 2024-09-12T00:17:41.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.362+0000 7febed3678c0 1 < canceled multipart upload key=G22WTRRGIQKE upload=OATMMQWSNJV1 tag=AMK4VTOHJ091 type=write size=2450114 2024-09-12T00:17:41.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.362+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=JHEPX0UR1HWJ type=write size=729892 2024-09-12T00:17:41.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.366+0000 7febed3678c0 1 < canceled operation key=ELNXYXX5ZWOW tag=E66K794OI866 type=write size=197322 2024-09-12T00:17:41.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.374+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~9W0G4YV79XV8.0 size=1048576 2024-09-12T00:17:41.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.374+0000 7febed3678c0 1 > prepared part key=_multipart_3G9ABEEEDRI3.2~9W0G4YV79XV8.1 size=892157 2024-09-12T00:17:41.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.374+0000 7febed3678c0 1 > prepared multipart upload key=3G9ABEEEDRI3 upload=9W0G4YV79XV8 tag=AE2R6PFYB33V type=write size=2989309 2024-09-12T00:17:41.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.378+0000 7febed3678c0 1 < canceled operation key=9HCKHF5ZRZ5N tag=V0OAESUL4VJY type=del size=586601 2024-09-12T00:17:41.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.382+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=CSGOJFKSTIJG type=del size=2920183 2024-09-12T00:17:41.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.386+0000 7febed3678c0 1 < completed write operation key=RGQ4KY26RKYI tag=FDD1KL09DT89 type=write size=4698 2024-09-12T00:17:41.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.386+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=P0RIW2T0GM6Y type=del size=2280490 2024-09-12T00:17:41.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.390+0000 7febed3678c0 1 < completed part key=_multipart_88BY5RHXSHD4.2~F1XD0XBUDII9.0 size=805867 2024-09-12T00:17:41.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.394+0000 7febed3678c0 1 < completed multipart upload key=88BY5RHXSHD4 upload=F1XD0XBUDII9 tag=0VIUZAFF30RN type=write size=1854443 2024-09-12T00:17:41.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.402+0000 7febed3678c0 1 > prepared part key=_multipart_KLO47UYYACLU.2~OU5A3FLNSTVA.0 size=201 2024-09-12T00:17:41.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.402+0000 7febed3678c0 1 > prepared multipart upload key=KLO47UYYACLU upload=OU5A3FLNSTVA tag=SFYAME0CVUW6 type=write size=1048777 2024-09-12T00:17:41.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.410+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~N0GF52IHRM4P.0 size=970679 2024-09-12T00:17:41.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.414+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=N0GF52IHRM4P tag=RSSCAC2H9LTA type=write size=2019255 2024-09-12T00:17:41.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.418+0000 7febed3678c0 1 > prepared operation key=AHTIFXX3SGK7 tag=HK5PAZ6YW2G3 type=del size=393627 2024-09-12T00:17:41.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.422+0000 7febed3678c0 1 < suggested remove operation key=MHS307JKNVCK tag=VU21E4239YH7 type=del 2024-09-12T00:17:41.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.430+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~QZL0S8UJAZKW.0 size=1048576 2024-09-12T00:17:41.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.434+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~QZL0S8UJAZKW.1 size=1048576 2024-09-12T00:17:41.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.434+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~QZL0S8UJAZKW.2 size=190795 2024-09-12T00:17:41.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.434+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=QZL0S8UJAZKW tag=QHYA0W1P53CN type=write size=3336523 2024-09-12T00:17:41.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.438+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~LED21TWF4CLE.0 size=794298 2024-09-12T00:17:41.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.442+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=LED21TWF4CLE tag=UNX6L9I0LEGE type=write size=1842874 2024-09-12T00:17:41.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.446+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=JJ9RYC7OC8Z1 type=del size=3046293 2024-09-12T00:17:41.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.450+0000 7febed3678c0 1 < completed delete operation key=LWAMFA0RSW6S tag=OIFCPVRSBU7V type=del 2024-09-12T00:17:41.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.454+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=O4W1ASJVMMLY type=del size=3597066 2024-09-12T00:17:41.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.454+0000 7febed3678c0 1 < completed delete operation key=70W3V7TFBUFJ tag=MET3SYGLE4E7 type=del 2024-09-12T00:17:41.458 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.458+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=I9HK1DSAYLOE type=write size=261081 2024-09-12T00:17:41.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.462+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~XOBB6JY7PRFD.0 size=1048576 2024-09-12T00:17:41.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.466+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~XOBB6JY7PRFD.1 size=224655 2024-09-12T00:17:41.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.470+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=XOBB6JY7PRFD tag=217N6JTV7B9J type=write size=2321807 2024-09-12T00:17:41.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.474+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=0TT0XGWR64JH type=del size=2047142 2024-09-12T00:17:41.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.474+0000 7febed3678c0 1 < canceled part key=_multipart_8RVDLW1VC8LP.2~WZDKJWC1GZD0.0 size=178439 2024-09-12T00:17:41.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.478+0000 7febed3678c0 1 < canceled multipart upload key=8RVDLW1VC8LP upload=WZDKJWC1GZD0 tag=IMG77BMQNE9A type=write size=1227015 2024-09-12T00:17:41.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.482+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~8Z9LL02MGZOM.0 size=1048576 2024-09-12T00:17:41.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.486+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~8Z9LL02MGZOM.1 size=863145 2024-09-12T00:17:41.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.486+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=8Z9LL02MGZOM tag=3W8XCC5ATJK0 type=write size=2960297 2024-09-12T00:17:41.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.486+0000 7febed3678c0 1 < canceled part key=_multipart_MAZHOU2CEUCU.2~3GOLNMHLF0L4.0 size=1048576 2024-09-12T00:17:41.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.486+0000 7febed3678c0 1 < completed part key=_multipart_MAZHOU2CEUCU.2~3GOLNMHLF0L4.1 size=721080 2024-09-12T00:17:41.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.490+0000 7febed3678c0 1 < canceled multipart upload key=MAZHOU2CEUCU upload=3GOLNMHLF0L4 tag=DVRQ8RODS29L type=write size=2818232 2024-09-12T00:17:41.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.494+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=5P9OIB93767N type=del size=3788451 2024-09-12T00:17:41.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.498+0000 7febed3678c0 1 < canceled operation key=KABJD0GYBVF4 tag=S9MT65IDOS5A type=del size=2822629 2024-09-12T00:17:41.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.502+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=BE1ABEBQ0UQH type=write size=825031 2024-09-12T00:17:41.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.502+0000 7febed3678c0 1 < completed part key=_multipart_UGV3WQR0ADYH.2~C5AXWVX9FQCP.0 size=116029 2024-09-12T00:17:41.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.506+0000 7febed3678c0 1 < completed multipart upload key=UGV3WQR0ADYH upload=C5AXWVX9FQCP tag=7LMH3DAMZ2WG type=write size=1164605 2024-09-12T00:17:41.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.510+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=LAUV0RRPH1AP type=del size=1956196 2024-09-12T00:17:41.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.514+0000 7febed3678c0 1 < completed delete operation key=VW69JRC5JYX5 tag=EVYL4SUENRIX type=del 2024-09-12T00:17:41.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.514+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=O3A0SMQEXX0G type=del size=1240299 2024-09-12T00:17:41.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.522+0000 7febed3678c0 1 < suggested remove operation key=MAZHOU2CEUCU tag=JHEPX0UR1HWJ type=write 2024-09-12T00:17:41.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.526+0000 7febed3678c0 1 > prepared part key=_multipart_MLPN8PH72VQ9.2~GBMTLIY8QFQP.0 size=658879 2024-09-12T00:17:41.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.526+0000 7febed3678c0 1 > prepared multipart upload key=MLPN8PH72VQ9 upload=GBMTLIY8QFQP tag=XC0KAAQVTTL2 type=write size=1707455 2024-09-12T00:17:41.529 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.530+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~9W0G4YV79XV8.0 size=1048576 2024-09-12T00:17:41.532 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.534+0000 7febed3678c0 1 < completed part key=_multipart_3G9ABEEEDRI3.2~9W0G4YV79XV8.1 size=892157 2024-09-12T00:17:41.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.538+0000 7febed3678c0 1 < completed multipart upload key=3G9ABEEEDRI3 upload=9W0G4YV79XV8 tag=AE2R6PFYB33V type=write size=2989309 2024-09-12T00:17:41.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.546+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~9JLSK3I567XO.0 size=1048576 2024-09-12T00:17:41.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.546+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~9JLSK3I567XO.1 size=973087 2024-09-12T00:17:41.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.546+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=9JLSK3I567XO tag=I0OF2ROAH6GB type=write size=3070239 2024-09-12T00:17:41.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.550+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=CSGOJFKSTIJG type=del 2024-09-12T00:17:41.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.558+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~G98CPR08XYHD.0 size=1048576 2024-09-12T00:17:41.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.558+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~G98CPR08XYHD.1 size=1048576 2024-09-12T00:17:41.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.562+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~G98CPR08XYHD.2 size=105522 2024-09-12T00:17:41.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.562+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=G98CPR08XYHD tag=5NSTUK4IT3HZ type=write size=3251250 2024-09-12T00:17:41.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.566+0000 7febed3678c0 1 < completed delete operation key=VU1AF57EUA0R tag=P0RIW2T0GM6Y type=del 2024-09-12T00:17:41.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.570+0000 7febed3678c0 1 > prepared part key=_multipart_RGQ4KY26RKYI.2~DCJUDF7T239X.0 size=535648 2024-09-12T00:17:41.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.570+0000 7febed3678c0 1 > prepared multipart upload key=RGQ4KY26RKYI upload=DCJUDF7T239X tag=4NVN9SHY36FN type=write size=1584224 2024-09-12T00:17:41.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.574+0000 7febed3678c0 1 < completed part key=_multipart_KLO47UYYACLU.2~OU5A3FLNSTVA.0 size=201 2024-09-12T00:17:41.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.578+0000 7febed3678c0 1 < completed multipart upload key=KLO47UYYACLU upload=OU5A3FLNSTVA tag=SFYAME0CVUW6 type=write size=1048777 2024-09-12T00:17:41.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.582+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~20Q1OYA4T7U5.0 size=1048576 2024-09-12T00:17:41.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.586+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~20Q1OYA4T7U5.1 size=1048576 2024-09-12T00:17:41.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.590+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~20Q1OYA4T7U5.2 size=243335 2024-09-12T00:17:41.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.590+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=20Q1OYA4T7U5 tag=QLTY5RLB97OV type=write size=3389063 2024-09-12T00:17:41.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.594+0000 7febed3678c0 1 < completed delete operation key=AHTIFXX3SGK7 tag=HK5PAZ6YW2G3 type=del 2024-09-12T00:17:41.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.594+0000 7febed3678c0 1 > prepared operation key=MLPN8PH72VQ9 tag=J588HH6VOMO7 type=del size=3034172 2024-09-12T00:17:41.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.598+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~QZL0S8UJAZKW.0 size=1048576 2024-09-12T00:17:41.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.602+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~QZL0S8UJAZKW.1 size=1048576 2024-09-12T00:17:41.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.606+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~QZL0S8UJAZKW.2 size=190795 2024-09-12T00:17:41.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.610+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=QZL0S8UJAZKW tag=QHYA0W1P53CN type=write size=3336523 2024-09-12T00:17:41.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.614+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=CBS23LADOP73 type=write size=1011475 2024-09-12T00:17:41.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.614+0000 7febed3678c0 -1 < no bi entry to suggest for operation key=MAZHOU2CEUCU tag=JJ9RYC7OC8Z1 type=del size=3046293: (2) No such file or directory 2024-09-12T00:17:41.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.618+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~WJQN88XRB5FN.0 size=1048576 2024-09-12T00:17:41.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.622+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~WJQN88XRB5FN.1 size=948498 2024-09-12T00:17:41.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.622+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=WJQN88XRB5FN tag=N6NW7LBSNA27 type=write size=3045650 2024-09-12T00:17:41.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.622+0000 7febed3678c0 1 < completed delete operation key=H017KWW59B8Z tag=O4W1ASJVMMLY type=del 2024-09-12T00:17:41.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.626+0000 7febed3678c0 1 > prepared operation key=8RVDLW1VC8LP tag=9BRS09XIHE4K type=del size=417673 2024-09-12T00:17:41.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.630+0000 7febed3678c0 1 < completed write operation key=4K65QIB9F00S tag=I9HK1DSAYLOE type=write size=261081 2024-09-12T00:17:41.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.634+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~ABTNP20Q1LLV.0 size=1048576 2024-09-12T00:17:41.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.638+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~ABTNP20Q1LLV.1 size=1048576 2024-09-12T00:17:41.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.638+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~ABTNP20Q1LLV.2 size=383680 2024-09-12T00:17:41.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.638+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=ABTNP20Q1LLV tag=0JDHVBJSSTO3 type=write size=3529408 2024-09-12T00:17:41.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.642+0000 7febed3678c0 1 < canceled operation key=MHS307JKNVCK tag=0TT0XGWR64JH type=del size=2047142 2024-09-12T00:17:41.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.646+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=42XQBNM9GDWY type=write size=526562 2024-09-12T00:17:41.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.650+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~8Z9LL02MGZOM.0 size=1048576 2024-09-12T00:17:41.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.650+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~8Z9LL02MGZOM.1 size=863145 2024-09-12T00:17:41.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.654+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=8Z9LL02MGZOM tag=3W8XCC5ATJK0 type=write size=2960297 2024-09-12T00:17:41.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.658+0000 7febed3678c0 1 > prepared operation key=ASFLGSKWYHG5 tag=UZ6N17L7Y0BF type=del size=2074292 2024-09-12T00:17:41.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.662+0000 7febed3678c0 1 < completed delete operation key=HR9MVC82R7GL tag=5P9OIB93767N type=del 2024-09-12T00:17:41.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.662+0000 7febed3678c0 1 > prepared operation key=KABJD0GYBVF4 tag=DXAXSU8MSSZJ type=write size=636207 2024-09-12T00:17:41.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.666+0000 7febed3678c0 1 < completed write operation key=H017KWW59B8Z tag=BE1ABEBQ0UQH type=write size=825031 2024-09-12T00:17:41.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.670+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=AMSZ70DZOEO4 type=write size=217355 2024-09-12T00:17:41.674 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.674+0000 7febed3678c0 1 < suggested remove operation key=VU1AF57EUA0R tag=LAUV0RRPH1AP type=del 2024-09-12T00:17:41.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.682+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~I3LL51K3OLQY.0 size=1048576 2024-09-12T00:17:41.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.682+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~I3LL51K3OLQY.1 size=1048576 2024-09-12T00:17:41.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.686+0000 7febed3678c0 1 > prepared part key=_multipart_KABJD0GYBVF4.2~I3LL51K3OLQY.2 size=694387 2024-09-12T00:17:41.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.686+0000 7febed3678c0 1 > prepared multipart upload key=KABJD0GYBVF4 upload=I3LL51K3OLQY tag=AFK5D72Z6Q3O type=write size=3840115 2024-09-12T00:17:41.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.690+0000 7febed3678c0 1 < completed delete operation key=8RVDLW1VC8LP tag=O3A0SMQEXX0G type=del 2024-09-12T00:17:41.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.694+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=9Q8L83EY5AUG type=del size=17497 2024-09-12T00:17:41.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.698+0000 7febed3678c0 1 < completed part key=_multipart_MLPN8PH72VQ9.2~GBMTLIY8QFQP.0 size=658879 2024-09-12T00:17:41.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.702+0000 7febed3678c0 1 < completed multipart upload key=MLPN8PH72VQ9 upload=GBMTLIY8QFQP tag=XC0KAAQVTTL2 type=write size=1707455 2024-09-12T00:17:41.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.706+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~EQI4YLGEPYO4.0 size=729778 2024-09-12T00:17:41.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.706+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=EQI4YLGEPYO4 tag=Z4A77WS1PU8T type=write size=1778354 2024-09-12T00:17:41.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.710+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~9JLSK3I567XO.0 size=1048576 2024-09-12T00:17:41.712 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.714+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~9JLSK3I567XO.1 size=973087 2024-09-12T00:17:41.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.718+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=9JLSK3I567XO tag=I0OF2ROAH6GB type=write size=3070239 2024-09-12T00:17:41.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.726+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~CPTU3Z0RRK95.0 size=1048576 2024-09-12T00:17:41.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.726+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~CPTU3Z0RRK95.1 size=1048576 2024-09-12T00:17:41.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.730+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~CPTU3Z0RRK95.2 size=696381 2024-09-12T00:17:41.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.730+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=CPTU3Z0RRK95 tag=MEUQY0LWNBNF type=write size=3842109 2024-09-12T00:17:41.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.734+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~G98CPR08XYHD.0 size=1048576 2024-09-12T00:17:41.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.734+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~G98CPR08XYHD.1 size=1048576 2024-09-12T00:17:41.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.738+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~G98CPR08XYHD.2 size=105522 2024-09-12T00:17:41.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.742+0000 7febed3678c0 1 < completed multipart upload key=52SSW5KTCS15 upload=G98CPR08XYHD tag=5NSTUK4IT3HZ type=write size=3251250 2024-09-12T00:17:41.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.746+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=ZZU323FZI737 type=del size=782639 2024-09-12T00:17:41.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.750+0000 7febed3678c0 1 < completed part key=_multipart_RGQ4KY26RKYI.2~DCJUDF7T239X.0 size=535648 2024-09-12T00:17:41.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.754+0000 7febed3678c0 1 < completed multipart upload key=RGQ4KY26RKYI upload=DCJUDF7T239X tag=4NVN9SHY36FN type=write size=1584224 2024-09-12T00:17:41.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.758+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=HG1U6FEF2NCQ type=del size=1576994 2024-09-12T00:17:41.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.758+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~20Q1OYA4T7U5.0 size=1048576 2024-09-12T00:17:41.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.762+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~20Q1OYA4T7U5.1 size=1048576 2024-09-12T00:17:41.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.766+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~20Q1OYA4T7U5.2 size=243335 2024-09-12T00:17:41.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.770+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=20Q1OYA4T7U5 tag=QLTY5RLB97OV type=write size=3389063 2024-09-12T00:17:41.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.774+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=BTCI39RJL6RC type=del size=1670562 2024-09-12T00:17:41.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.774+0000 7febed3678c0 1 < canceled operation key=MLPN8PH72VQ9 tag=J588HH6VOMO7 type=del size=3034172 2024-09-12T00:17:41.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.778+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=VLQ2VOQIFCA9 type=del size=275972 2024-09-12T00:17:41.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.782+0000 7febed3678c0 1 < completed write operation key=H017KWW59B8Z tag=CBS23LADOP73 type=write size=1011475 2024-09-12T00:17:41.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.782+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=906NV962WPVM type=write size=981308 2024-09-12T00:17:41.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.786+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~WJQN88XRB5FN.0 size=1048576 2024-09-12T00:17:41.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.790+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~WJQN88XRB5FN.1 size=948498 2024-09-12T00:17:41.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.794+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=WJQN88XRB5FN tag=N6NW7LBSNA27 type=write size=3045650 2024-09-12T00:17:41.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.798+0000 7febed3678c0 1 > prepared operation key=0KQK1CXHO096 tag=PPBYQJ3T276H type=del size=1135744 2024-09-12T00:17:41.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.802+0000 7febed3678c0 1 < suggested update operation key=8RVDLW1VC8LP tag=9BRS09XIHE4K type=del size=417673 2024-09-12T00:17:41.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.806+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~67EM5BTULXOM.0 size=1048576 2024-09-12T00:17:41.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.810+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~67EM5BTULXOM.1 size=1048576 2024-09-12T00:17:41.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.810+0000 7febed3678c0 1 > prepared part key=_multipart_1HABX7YZ491W.2~67EM5BTULXOM.2 size=369935 2024-09-12T00:17:41.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.810+0000 7febed3678c0 1 > prepared multipart upload key=1HABX7YZ491W upload=67EM5BTULXOM tag=ESDWYBDZR4O3 type=write size=3515663 2024-09-12T00:17:41.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.814+0000 7febed3678c0 1 < canceled part key=_multipart_1HABX7YZ491W.2~ABTNP20Q1LLV.0 size=1048576 2024-09-12T00:17:41.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.814+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~ABTNP20Q1LLV.1 size=1048576 2024-09-12T00:17:41.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.814+0000 7febed3678c0 1 < canceled part key=_multipart_1HABX7YZ491W.2~ABTNP20Q1LLV.2 size=383680 2024-09-12T00:17:41.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.818+0000 7febed3678c0 1 < canceled multipart upload key=1HABX7YZ491W upload=ABTNP20Q1LLV tag=0JDHVBJSSTO3 type=write size=3529408 2024-09-12T00:17:41.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.822+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~LB7LS9E298U1.0 size=1048576 2024-09-12T00:17:41.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.826+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~LB7LS9E298U1.1 size=1048576 2024-09-12T00:17:41.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.830+0000 7febed3678c0 1 > prepared part key=_multipart_ASFLGSKWYHG5.2~LB7LS9E298U1.2 size=428874 2024-09-12T00:17:41.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.830+0000 7febed3678c0 1 > prepared multipart upload key=ASFLGSKWYHG5 upload=LB7LS9E298U1 tag=HAW2LLVNFW13 type=write size=3574602 2024-09-12T00:17:41.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.830+0000 7febed3678c0 1 < completed write operation key=52SSW5KTCS15 tag=42XQBNM9GDWY type=write size=526562 2024-09-12T00:17:41.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.834+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=1ZCY264DZYQQ type=del size=1745985 2024-09-12T00:17:41.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.838+0000 7febed3678c0 1 < completed delete operation key=ASFLGSKWYHG5 tag=UZ6N17L7Y0BF type=del 2024-09-12T00:17:41.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.838+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=JZJ4TWCCV9IY type=del size=1658740 2024-09-12T00:17:41.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.842+0000 7febed3678c0 1 < completed write operation key=KABJD0GYBVF4 tag=DXAXSU8MSSZJ type=write size=636207 2024-09-12T00:17:41.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.846+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=TLTZ7PAP5NZT type=del size=2759935 2024-09-12T00:17:41.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.850+0000 7febed3678c0 1 < completed write operation key=25THATWGX4WS tag=AMSZ70DZOEO4 type=write size=217355 2024-09-12T00:17:41.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.854+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~XHLXWFFDPE8R.0 size=1048576 2024-09-12T00:17:41.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.858+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~XHLXWFFDPE8R.1 size=1048576 2024-09-12T00:17:41.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.858+0000 7febed3678c0 1 > prepared part key=_multipart_9CBI4FHAT3H2.2~XHLXWFFDPE8R.2 size=815852 2024-09-12T00:17:41.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.858+0000 7febed3678c0 1 > prepared multipart upload key=9CBI4FHAT3H2 upload=XHLXWFFDPE8R tag=BW0Y9T4RHVUO type=write size=3961580 2024-09-12T00:17:41.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.862+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~I3LL51K3OLQY.0 size=1048576 2024-09-12T00:17:41.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.866+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~I3LL51K3OLQY.1 size=1048576 2024-09-12T00:17:41.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.866+0000 7febed3678c0 1 < completed part key=_multipart_KABJD0GYBVF4.2~I3LL51K3OLQY.2 size=694387 2024-09-12T00:17:41.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.874+0000 7febed3678c0 1 < completed multipart upload key=KABJD0GYBVF4 upload=I3LL51K3OLQY tag=AFK5D72Z6Q3O type=write size=3840115 2024-09-12T00:17:41.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.874+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=SOA5DD497CQA type=write size=757779 2024-09-12T00:17:41.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.878+0000 7febed3678c0 1 < completed delete operation key=9HCKHF5ZRZ5N tag=9Q8L83EY5AUG type=del 2024-09-12T00:17:41.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.882+0000 7febed3678c0 1 > prepared operation key=W2VEW3JJEJY7 tag=1BG0LGSBP42V type=del size=1180215 2024-09-12T00:17:41.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.882+0000 7febed3678c0 1 < canceled part key=_multipart_VU1AF57EUA0R.2~EQI4YLGEPYO4.0 size=729778 2024-09-12T00:17:41.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.886+0000 7febed3678c0 1 < canceled multipart upload key=VU1AF57EUA0R upload=EQI4YLGEPYO4 tag=Z4A77WS1PU8T type=write size=1778354 2024-09-12T00:17:41.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.890+0000 7febed3678c0 1 > prepared operation key=ELNXYXX5ZWOW tag=HI93L2VNAO3A type=del size=3950624 2024-09-12T00:17:41.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.890+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~CPTU3Z0RRK95.0 size=1048576 2024-09-12T00:17:41.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.894+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~CPTU3Z0RRK95.1 size=1048576 2024-09-12T00:17:41.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.894+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~CPTU3Z0RRK95.2 size=696381 2024-09-12T00:17:41.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.898+0000 7febed3678c0 1 < completed multipart upload key=9CBI4FHAT3H2 upload=CPTU3Z0RRK95 tag=MEUQY0LWNBNF type=write size=3842109 2024-09-12T00:17:41.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.902+0000 7febed3678c0 1 > prepared operation key=CIOINUP503WY tag=O7UIPGDXWM72 type=del size=2903439 2024-09-12T00:17:41.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.906+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=ZZU323FZI737 type=del 2024-09-12T00:17:41.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.910+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~20ZUWETVEYUU.0 size=1048576 2024-09-12T00:17:41.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.914+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~20ZUWETVEYUU.1 size=1048576 2024-09-12T00:17:41.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.914+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~20ZUWETVEYUU.2 size=478167 2024-09-12T00:17:41.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.914+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=20ZUWETVEYUU tag=MZ142DD0YVCC type=write size=3623895 2024-09-12T00:17:41.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.918+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=HG1U6FEF2NCQ type=del 2024-09-12T00:17:41.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.922+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=YVXDNTKJ26KS type=write size=697523 2024-09-12T00:17:41.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.922+0000 7febed3678c0 1 < completed delete operation key=4K65QIB9F00S tag=BTCI39RJL6RC type=del 2024-09-12T00:17:41.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.930+0000 7febed3678c0 1 > prepared part key=_multipart_LWAMFA0RSW6S.2~D97QBE6I0PX6.0 size=534805 2024-09-12T00:17:41.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.930+0000 7febed3678c0 1 > prepared multipart upload key=LWAMFA0RSW6S upload=D97QBE6I0PX6 tag=7CQM9OS2Y3I7 type=write size=1583381 2024-09-12T00:17:41.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.934+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=VLQ2VOQIFCA9 type=del 2024-09-12T00:17:41.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.934+0000 7febed3678c0 1 > prepared operation key=VU1AF57EUA0R tag=MW489EI2XXA3 type=write size=562266 2024-09-12T00:17:41.939 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.938+0000 7febed3678c0 1 < completed write operation key=CIOINUP503WY tag=906NV962WPVM type=write size=981308 2024-09-12T00:17:41.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.946+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~6FL7LLM9GSOW.0 size=407213 2024-09-12T00:17:41.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.946+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=6FL7LLM9GSOW tag=7MEPV5HYHGGP type=write size=1455789 2024-09-12T00:17:41.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.950+0000 7febed3678c0 1 < canceled operation key=0KQK1CXHO096 tag=PPBYQJ3T276H type=del size=1135744 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.954+0000 7febed3678c0 1 > prepared part key=_multipart_9HCKHF5ZRZ5N.2~296UT536HLV0.0 size=403718 2024-09-12T00:17:41.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.954+0000 7febed3678c0 1 > prepared multipart upload key=9HCKHF5ZRZ5N upload=296UT536HLV0 tag=SH4F3X3C7930 type=write size=1452294 2024-09-12T00:17:41.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.966+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~67EM5BTULXOM.0 size=1048576 2024-09-12T00:17:41.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.966+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~67EM5BTULXOM.1 size=1048576 2024-09-12T00:17:41.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.966+0000 7febed3678c0 1 < completed part key=_multipart_1HABX7YZ491W.2~67EM5BTULXOM.2 size=369935 2024-09-12T00:17:41.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.970+0000 7febed3678c0 1 < completed multipart upload key=1HABX7YZ491W upload=67EM5BTULXOM tag=ESDWYBDZR4O3 type=write size=3515663 2024-09-12T00:17:41.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.978+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~T7EMZT8RD3HG.0 size=1048576 2024-09-12T00:17:41.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.978+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~T7EMZT8RD3HG.1 size=583498 2024-09-12T00:17:41.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.978+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=T7EMZT8RD3HG tag=30E7JO2HFHRD type=write size=2680650 2024-09-12T00:17:41.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.982+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~LB7LS9E298U1.0 size=1048576 2024-09-12T00:17:41.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.986+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~LB7LS9E298U1.1 size=1048576 2024-09-12T00:17:41.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.986+0000 7febed3678c0 1 < completed part key=_multipart_ASFLGSKWYHG5.2~LB7LS9E298U1.2 size=428874 2024-09-12T00:17:41.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.994+0000 7febed3678c0 1 < completed multipart upload key=ASFLGSKWYHG5 upload=LB7LS9E298U1 tag=HAW2LLVNFW13 type=write size=3574602 2024-09-12T00:17:41.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.998+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=7CHW16ILJBNF type=write size=992328 2024-09-12T00:17:41.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:41.998+0000 7febed3678c0 1 < completed delete operation key=25THATWGX4WS tag=1ZCY264DZYQQ type=del 2024-09-12T00:17:42.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.002+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=12A4S4XBDV6X type=write size=219104 2024-09-12T00:17:42.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.010+0000 7febed3678c0 1 < suggested remove operation key=53T1415UK7GE tag=JZJ4TWCCV9IY type=del 2024-09-12T00:17:42.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.014+0000 7febed3678c0 1 > prepared operation key=H017KWW59B8Z tag=G82FPENZN5ZN type=del size=3170178 2024-09-12T00:17:42.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.014+0000 7febed3678c0 1 < completed delete operation key=KLO47UYYACLU tag=TLTZ7PAP5NZT type=del 2024-09-12T00:17:42.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.018+0000 7febed3678c0 1 > prepared operation key=MHS307JKNVCK tag=X40P3NUO8EGK type=del size=661592 2024-09-12T00:17:42.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.022+0000 7febed3678c0 1 < completed part key=_multipart_9CBI4FHAT3H2.2~XHLXWFFDPE8R.0 size=1048576 2024-09-12T00:17:42.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.022+0000 7febed3678c0 1 < canceled part key=_multipart_9CBI4FHAT3H2.2~XHLXWFFDPE8R.1 size=1048576 2024-09-12T00:17:42.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.022+0000 7febed3678c0 1 < canceled part key=_multipart_9CBI4FHAT3H2.2~XHLXWFFDPE8R.2 size=815852 2024-09-12T00:17:42.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.026+0000 7febed3678c0 1 < canceled multipart upload key=9CBI4FHAT3H2 upload=XHLXWFFDPE8R tag=BW0Y9T4RHVUO type=write size=3961580 2024-09-12T00:17:42.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.034+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~GT3PHR719U4W.0 size=1048576 2024-09-12T00:17:42.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.034+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~GT3PHR719U4W.1 size=1048576 2024-09-12T00:17:42.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.038+0000 7febed3678c0 1 > prepared part key=_multipart_4K65QIB9F00S.2~GT3PHR719U4W.2 size=959383 2024-09-12T00:17:42.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.038+0000 7febed3678c0 1 > prepared multipart upload key=4K65QIB9F00S upload=GT3PHR719U4W tag=G5Y8IWF2MD19 type=write size=4105111 2024-09-12T00:17:42.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.042+0000 7febed3678c0 -1 < failed to complete operation key=53T1415UK7GE tag=SOA5DD497CQA type=write size=757779: (22) Invalid argument 2024-09-12T00:17:42.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.046+0000 7febed3678c0 1 > prepared operation key=9CBI4FHAT3H2 tag=KLMW8FHSOCDP type=del size=3075450 2024-09-12T00:17:42.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.046+0000 7febed3678c0 1 < completed delete operation key=W2VEW3JJEJY7 tag=1BG0LGSBP42V type=del 2024-09-12T00:17:42.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.050+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=CZ6PH5JQG6FQ type=del size=2268546 2024-09-12T00:17:42.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.054+0000 7febed3678c0 1 < completed delete operation key=ELNXYXX5ZWOW tag=HI93L2VNAO3A type=del 2024-09-12T00:17:42.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.058+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=C8TUWEEIF7P4 type=write size=935425 2024-09-12T00:17:42.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.062+0000 7febed3678c0 1 < canceled operation key=CIOINUP503WY tag=O7UIPGDXWM72 type=del size=2903439 2024-09-12T00:17:42.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.066+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=D6O2VEYA5NEK type=del size=1443694 2024-09-12T00:17:42.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.070+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~20ZUWETVEYUU.0 size=1048576 2024-09-12T00:17:42.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.070+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~20ZUWETVEYUU.1 size=1048576 2024-09-12T00:17:42.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.074+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~20ZUWETVEYUU.2 size=478167 2024-09-12T00:17:42.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.078+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=20ZUWETVEYUU tag=MZ142DD0YVCC type=write size=3623895 2024-09-12T00:17:42.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.082+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=07S9RKU8QFEG type=write size=638522 2024-09-12T00:17:42.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.086+0000 7febed3678c0 1 < completed write operation key=88BY5RHXSHD4 tag=YVXDNTKJ26KS type=write size=697523 2024-09-12T00:17:42.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.090+0000 7febed3678c0 1 > prepared operation key=70W3V7TFBUFJ tag=5U7QVZN7PE85 type=write size=507264 2024-09-12T00:17:42.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.094+0000 7febed3678c0 1 < completed part key=_multipart_LWAMFA0RSW6S.2~D97QBE6I0PX6.0 size=534805 2024-09-12T00:17:42.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.098+0000 7febed3678c0 1 < completed multipart upload key=LWAMFA0RSW6S upload=D97QBE6I0PX6 tag=7CQM9OS2Y3I7 type=write size=1583381 2024-09-12T00:17:42.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.106+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~JIFFJ6JQH3PC.0 size=1048576 2024-09-12T00:17:42.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.110+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~JIFFJ6JQH3PC.1 size=1048576 2024-09-12T00:17:42.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.110+0000 7febed3678c0 1 > prepared part key=_multipart_HR9MVC82R7GL.2~JIFFJ6JQH3PC.2 size=1006650 2024-09-12T00:17:42.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.110+0000 7febed3678c0 1 > prepared multipart upload key=HR9MVC82R7GL upload=JIFFJ6JQH3PC tag=WYEYG6CLW3KZ type=write size=4152378 2024-09-12T00:17:42.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.114+0000 7febed3678c0 1 < completed write operation key=VU1AF57EUA0R tag=MW489EI2XXA3 type=write size=562266 2024-09-12T00:17:42.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.118+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=S4R14SWW2K1R type=del size=1710886 2024-09-12T00:17:42.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.122+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~6FL7LLM9GSOW.0 size=407213 2024-09-12T00:17:42.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.126+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=6FL7LLM9GSOW tag=7MEPV5HYHGGP type=write size=1455789 2024-09-12T00:17:42.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.130+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=FPKXLG7QVP56 type=write size=370276 2024-09-12T00:17:42.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.134+0000 7febed3678c0 1 < completed part key=_multipart_9HCKHF5ZRZ5N.2~296UT536HLV0.0 size=403718 2024-09-12T00:17:42.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.138+0000 7febed3678c0 1 < completed multipart upload key=9HCKHF5ZRZ5N upload=296UT536HLV0 tag=SH4F3X3C7930 type=write size=1452294 2024-09-12T00:17:42.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.142+0000 7febed3678c0 1 > prepared operation key=HR9MVC82R7GL tag=WUJMV5Y6ROHZ type=del size=1478712 2024-09-12T00:17:42.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.150+0000 7febed3678c0 1 < completed part key=_multipart_52SSW5KTCS15.2~T7EMZT8RD3HG.0 size=1048576 2024-09-12T00:17:42.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.150+0000 7febed3678c0 1 < canceled part key=_multipart_52SSW5KTCS15.2~T7EMZT8RD3HG.1 size=583498 2024-09-12T00:17:42.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.150+0000 7febed3678c0 1 < canceled multipart upload key=52SSW5KTCS15 upload=T7EMZT8RD3HG tag=30E7JO2HFHRD type=write size=2680650 2024-09-12T00:17:42.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.154+0000 7febed3678c0 1 > prepared operation key=G22WTRRGIQKE tag=75BZN3GTCNLQ type=del size=3638784 2024-09-12T00:17:42.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.158+0000 7febed3678c0 1 < completed write operation key=MAZHOU2CEUCU tag=7CHW16ILJBNF type=write size=992328 2024-09-12T00:17:42.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.162+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=FOVEK29ICCXL type=del size=732525 2024-09-12T00:17:42.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.166+0000 7febed3678c0 1 < completed write operation key=G22WTRRGIQKE tag=12A4S4XBDV6X type=write size=219104 2024-09-12T00:17:42.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.170+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~0PVH7XDHHTLO.0 size=1048576 2024-09-12T00:17:42.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.174+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~0PVH7XDHHTLO.1 size=1048576 2024-09-12T00:17:42.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.178+0000 7febed3678c0 1 > prepared part key=_multipart_53T1415UK7GE.2~0PVH7XDHHTLO.2 size=956586 2024-09-12T00:17:42.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.178+0000 7febed3678c0 1 > prepared multipart upload key=53T1415UK7GE upload=0PVH7XDHHTLO tag=918505F6OV6E type=write size=4102314 2024-09-12T00:17:42.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.182+0000 7febed3678c0 1 < suggested remove operation key=H017KWW59B8Z tag=G82FPENZN5ZN type=del 2024-09-12T00:17:42.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.186+0000 7febed3678c0 1 > prepared operation key=88BY5RHXSHD4 tag=56JZNO5F7JP3 type=del size=792413 2024-09-12T00:17:42.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.190+0000 7febed3678c0 1 < canceled operation key=MHS307JKNVCK tag=X40P3NUO8EGK type=del size=661592 2024-09-12T00:17:42.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.194+0000 7febed3678c0 1 > prepared operation key=1HABX7YZ491W tag=I7ZAKZO7YLM2 type=del size=567385 2024-09-12T00:17:42.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.198+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~GT3PHR719U4W.0 size=1048576 2024-09-12T00:17:42.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.202+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~GT3PHR719U4W.1 size=1048576 2024-09-12T00:17:42.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.206+0000 7febed3678c0 1 < completed part key=_multipart_4K65QIB9F00S.2~GT3PHR719U4W.2 size=959383 2024-09-12T00:17:42.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.210+0000 7febed3678c0 1 < completed multipart upload key=4K65QIB9F00S upload=GT3PHR719U4W tag=G5Y8IWF2MD19 type=write size=4105111 2024-09-12T00:17:42.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.214+0000 7febed3678c0 1 > prepared operation key=53T1415UK7GE tag=66NJLC7APNAA type=del size=1463121 2024-09-12T00:17:42.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.222+0000 7febed3678c0 1 < completed delete operation key=9CBI4FHAT3H2 tag=KLMW8FHSOCDP type=del 2024-09-12T00:17:42.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.222+0000 7febed3678c0 1 > prepared operation key=52SSW5KTCS15 tag=F5D8XXX3INBI type=del size=1604620 2024-09-12T00:17:42.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.222+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=CZ6PH5JQG6FQ type=del 2024-09-12T00:17:42.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.226+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=IN056SIBCJ7G type=del size=97335 2024-09-12T00:17:42.234 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.234+0000 7febed3678c0 1 < suggested remove operation key=25THATWGX4WS tag=C8TUWEEIF7P4 type=write 2024-09-12T00:17:42.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.238+0000 7febed3678c0 1 > prepared operation key=25THATWGX4WS tag=TZXBUR0AB49H type=del size=1728637 2024-09-12T00:17:42.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.246+0000 7febed3678c0 1 < suggested remove operation key=52SSW5KTCS15 tag=D6O2VEYA5NEK type=del 2024-09-12T00:17:42.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.250+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~2GL47APCZCFN.0 size=1048576 2024-09-12T00:17:42.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.254+0000 7febed3678c0 1 > prepared part key=_multipart_52SSW5KTCS15.2~2GL47APCZCFN.1 size=834621 2024-09-12T00:17:42.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.254+0000 7febed3678c0 1 > prepared multipart upload key=52SSW5KTCS15 upload=2GL47APCZCFN tag=91EIZC0O9VQ0 type=write size=2931773 2024-09-12T00:17:42.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.258+0000 7febed3678c0 1 < completed write operation key=MAZHOU2CEUCU tag=07S9RKU8QFEG type=write size=638522 2024-09-12T00:17:42.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.266+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~WO2DQYZ3OFJM.0 size=724410 2024-09-12T00:17:42.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.266+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=WO2DQYZ3OFJM tag=OURXEQ7M1D7F type=write size=1772986 2024-09-12T00:17:42.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.266+0000 7febed3678c0 1 < completed write operation key=70W3V7TFBUFJ tag=5U7QVZN7PE85 type=write size=507264 2024-09-12T00:17:42.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.270+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=XKZL9VWPDY3V type=del size=931145 2024-09-12T00:17:42.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.282+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~JIFFJ6JQH3PC.0 size=1048576 2024-09-12T00:17:42.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.282+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~JIFFJ6JQH3PC.1 size=1048576 2024-09-12T00:17:42.284 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.286+0000 7febed3678c0 1 < completed part key=_multipart_HR9MVC82R7GL.2~JIFFJ6JQH3PC.2 size=1006650 2024-09-12T00:17:42.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.290+0000 7febed3678c0 1 < completed multipart upload key=HR9MVC82R7GL upload=JIFFJ6JQH3PC tag=WYEYG6CLW3KZ type=write size=4152378 2024-09-12T00:17:42.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.294+0000 7febed3678c0 1 > prepared operation key=4K65QIB9F00S tag=OMJ4M3U9BXX6 type=write size=480913 2024-09-12T00:17:42.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.298+0000 7febed3678c0 1 < completed delete operation key=MAZHOU2CEUCU tag=S4R14SWW2K1R type=del 2024-09-12T00:17:42.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.298+0000 7febed3678c0 1 > prepared operation key=MAZHOU2CEUCU tag=W7HBRXAPU2ZT type=write size=242725 2024-09-12T00:17:42.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.302+0000 7febed3678c0 1 < completed write operation key=88BY5RHXSHD4 tag=FPKXLG7QVP56 type=write size=370276 2024-09-12T00:17:42.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.306+0000 7febed3678c0 1 > prepared operation key=LWAMFA0RSW6S tag=X4P0EFJTLTMR type=write size=278315 2024-09-12T00:17:42.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.310+0000 7febed3678c0 1 < canceled operation key=HR9MVC82R7GL tag=WUJMV5Y6ROHZ type=del size=1478712 2024-09-12T00:17:42.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.310+0000 7febed3678c0 1 > prepared operation key=9HCKHF5ZRZ5N tag=0U9UPX56I782 type=write size=848304 2024-09-12T00:17:42.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.314+0000 7febed3678c0 1 < completed delete operation key=G22WTRRGIQKE tag=75BZN3GTCNLQ type=del 2024-09-12T00:17:42.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.318+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~ZP986M4BVVAT.0 size=1048576 2024-09-12T00:17:42.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.322+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~ZP986M4BVVAT.1 size=1048576 2024-09-12T00:17:42.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.326+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~ZP986M4BVVAT.2 size=276428 2024-09-12T00:17:42.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.326+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=ZP986M4BVVAT tag=68396KVWHNAX type=write size=3422156 2024-09-12T00:17:42.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.330+0000 7febed3678c0 1 < suggested update operation key=9HCKHF5ZRZ5N tag=FOVEK29ICCXL type=del size=732525 2024-09-12T00:17:42.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.334+0000 7febed3678c0 1 > prepared part key=_multipart_88BY5RHXSHD4.2~GMDVGH5AVCPW.0 size=480782 2024-09-12T00:17:42.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.334+0000 7febed3678c0 1 > prepared multipart upload key=88BY5RHXSHD4 upload=GMDVGH5AVCPW tag=OR36PELSLBHC type=write size=1529358 2024-09-12T00:17:42.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.342+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~0PVH7XDHHTLO.0 size=1048576 2024-09-12T00:17:42.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.342+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~0PVH7XDHHTLO.1 size=1048576 2024-09-12T00:17:42.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.342+0000 7febed3678c0 1 < completed part key=_multipart_53T1415UK7GE.2~0PVH7XDHHTLO.2 size=956586 2024-09-12T00:17:42.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.346+0000 7febed3678c0 1 < completed multipart upload key=53T1415UK7GE upload=0PVH7XDHHTLO tag=918505F6OV6E type=write size=4102314 2024-09-12T00:17:42.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.354+0000 7febed3678c0 1 > prepared operation key=KLO47UYYACLU tag=0WWDF2LTS9ZP type=del size=2060343 2024-09-12T00:17:42.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.354+0000 7febed3678c0 1 < completed delete operation key=88BY5RHXSHD4 tag=56JZNO5F7JP3 type=del 2024-09-12T00:17:42.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.354+0000 7febed3678c0 1 > prepared operation key=RGQ4KY26RKYI tag=JWTUCOBD0VPL type=write size=619561 2024-09-12T00:17:42.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.362+0000 7febed3678c0 1 < completed delete operation key=1HABX7YZ491W tag=I7ZAKZO7YLM2 type=del 2024-09-12T00:17:42.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.370+0000 7febed3678c0 1 > prepared part key=_multipart_70W3V7TFBUFJ.2~HFBESYRWHWYP.0 size=340074 2024-09-12T00:17:42.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.370+0000 7febed3678c0 1 > prepared multipart upload key=70W3V7TFBUFJ upload=HFBESYRWHWYP tag=ZK5HASNQX7GA type=write size=1388650 2024-09-12T00:17:42.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.370+0000 7febed3678c0 1 < completed delete operation key=53T1415UK7GE tag=66NJLC7APNAA type=del 2024-09-12T00:17:42.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.374+0000 7febed3678c0 1 > prepared part key=_multipart_VU1AF57EUA0R.2~0Q37I4KUN17R.0 size=292704 2024-09-12T00:17:42.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:17:42.374+0000 7febed3678c0 1 > prepared multipart upload key=VU1AF57EUA0R upload=0Q37I4KUN17R tag=8JA72MUYNJFM type=write size=1341280 2024-09-12T00:17:42.374 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] cls_rgw_stats.simulate (22851 ms) 2024-09-12T00:17:42.374 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 1 test from cls_rgw_stats (22851 ms total) 2024-09-12T00:17:42.374 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:17:42.374 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:17:43.383 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 1 test from 1 test suite ran. (25737 ms total) 2024-09-12T00:17:43.383 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 1 test. 2024-09-12T00:17:43.389 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:17:43.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:17:43.444 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:17:43.445 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:17:43.446 DEBUG:teuthology.orchestra.run.smithi102:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:17:43.516 INFO:tasks.workunit.client.0.smithi102.stdout:Running main() from gmock_main.cc 2024-09-12T00:17:43.516 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:17:43.516 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:17:45.397 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:17:45.397 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:17:45.436 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (39 ms) 2024-09-12T00:17:45.436 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:17:45.447 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (11 ms) 2024-09-12T00:17:45.447 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:17:45.452 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (5 ms) 2024-09-12T00:17:45.452 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:17:45.458 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (7 ms) 2024-09-12T00:17:45.459 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:17:45.472 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_str (13 ms) 2024-09-12T00:17:45.472 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:17:45.484 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_u64 (13 ms) 2024-09-12T00:17:45.485 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:17:45.492 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (7 ms) 2024-09-12T00:17:45.492 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:17:45.501 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (9 ms) 2024-09-12T00:17:45.501 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:17:45.512 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (11 ms) 2024-09-12T00:17:45.512 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:17:45.522 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (10 ms) 2024-09-12T00:17:45.522 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:17:45.524 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-09-12T00:17:45.524 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:17:45.526 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-09-12T00:17:45.526 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:17:45.544 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (18 ms) 2024-09-12T00:17:45.544 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:17:45.560 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (17 ms) 2024-09-12T00:17:45.560 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:17:45.578 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (17 ms) 2024-09-12T00:17:45.578 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:17:45.596 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (18 ms) 2024-09-12T00:17:45.596 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:17:45.619 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_set_vals_str (23 ms) 2024-09-12T00:17:45.619 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:17:45.640 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (21 ms) 2024-09-12T00:17:45.640 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:17:45.647 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (7 ms) 2024-09-12T00:17:45.647 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:17:45.654 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-09-12T00:17:45.654 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:17:45.657 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-09-12T00:17:45.657 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:17:45.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-12T00:17:45.659 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:17:45.676 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (17 ms) 2024-09-12T00:17:45.676 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:17:45.693 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (17 ms) 2024-09-12T00:17:45.693 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:17:45.714 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (21 ms) 2024-09-12T00:17:45.715 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:17:45.736 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (22 ms) 2024-09-12T00:17:45.736 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:17:45.741 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (5 ms) 2024-09-12T00:17:45.741 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:17:45.748 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-12T00:17:45.748 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:17:45.750 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T00:17:45.750 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:17:45.752 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T00:17:45.752 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:17:45.772 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (19 ms) 2024-09-12T00:17:45.772 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 31 tests from CmpOmap (375 ms total) 2024-09-12T00:17:45.772 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:17:45.772 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:17:46.422 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 31 tests from 1 test suite ran. (2906 ms total) 2024-09-12T00:17:46.422 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 31 tests. 2024-09-12T00:17:46.427 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:17:46.427 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:17:46.484 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:17:46.486 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:17:46.486 DEBUG:teuthology.orchestra.run.smithi102:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:17:46.549 INFO:tasks.workunit.client.0.smithi102.stdout:Running main() from gmock_main.cc 2024-09-12T00:17:46.550 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:17:46.550 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:17:46.550 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:17:46.550 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:17:49.428 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2878 ms) 2024-09-12T00:17:49.428 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:17:52.454 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3026 ms) 2024-09-12T00:17:52.454 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:17:55.463 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.Reserve (3010 ms) 2024-09-12T00:17:55.464 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:17:58.545 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3081 ms) 2024-09-12T00:17:58.545 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:18:02.619 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.Commit (4074 ms) 2024-09-12T00:18:02.619 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:18:06.697 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.Stats (4078 ms) 2024-09-12T00:18:06.697 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:18:11.087 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4388 ms) 2024-09-12T00:18:11.088 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:18:14.109 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.Abort (3024 ms) 2024-09-12T00:18:14.109 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:18:17.124 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.ReserveError (3015 ms) 2024-09-12T00:18:17.124 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:18:20.170 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.CommitError (3046 ms) 2024-09-12T00:18:20.170 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:18:23.196 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.AbortError (3027 ms) 2024-09-12T00:18:23.197 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:18:26.253 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3056 ms) 2024-09-12T00:18:26.253 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:18:29.290 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3037 ms) 2024-09-12T00:18:29.290 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:18:32.319 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3030 ms) 2024-09-12T00:18:32.319 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:18:35.354 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3035 ms) 2024-09-12T00:18:35.355 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:18:38.396 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3042 ms) 2024-09-12T00:18:38.396 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:18:41.428 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3032 ms) 2024-09-12T00:18:41.428 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:18:44.461 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.Cleanup (3033 ms) 2024-09-12T00:18:44.462 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:18:57.399 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12934 ms) 2024-09-12T00:18:57.400 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:19:02.433 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5038 ms) 2024-09-12T00:19:02.433 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:19:16.419 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13985 ms) 2024-09-12T00:19:16.419 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:19:22.347 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (5929 ms) 2024-09-12T00:19:22.347 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:19:32.409 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10062 ms) 2024-09-12T00:19:32.409 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:19:42.430 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10021 ms) 2024-09-12T00:19:42.430 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 24 tests from TestCls2PCQueue (115881 ms total) 2024-09-12T00:19:42.430 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:19:42.430 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:19:42.430 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 24 tests from 1 test suite ran. (115881 ms total) 2024-09-12T00:19:42.431 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 24 tests. 2024-09-12T00:19:42.437 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:42.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:42.491 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:19:42.492 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:19:42.492 DEBUG:teuthology.orchestra.run.smithi102:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:19:42.568 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:42.569 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:42.569 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:19:42.569 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:19:44.430 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:19:44.437 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:19:44.485 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsAccount.add (48 ms) 2024-09-12T00:19:44.485 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:19:44.496 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsAccount.get (11 ms) 2024-09-12T00:19:44.496 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:19:44.509 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsAccount.rm (13 ms) 2024-09-12T00:19:44.509 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:19:44.549 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] ClsAccount.list (41 ms) 2024-09-12T00:19:44.550 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 4 tests from ClsAccount (113 ms total) 2024-09-12T00:19:44.550 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:19:44.550 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:19:45.436 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 4 tests from 1 test suite ran. (2867 ms total) 2024-09-12T00:19:45.436 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 4 tests. 2024-09-12T00:19:45.443 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:45.443 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:45.506 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:19:45.507 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:19:45.507 DEBUG:teuthology.orchestra.run.smithi102:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:19:45.580 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:45.580 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:45.580 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:19:45.581 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:19:47.481 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:19:47.481 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:19:47.517 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] rgw_gc_log.init_existing_queue (37 ms) 2024-09-12T00:19:47.517 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:19:47.523 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] rgw_gc_log.init_existing_omap (5 ms) 2024-09-12T00:19:47.523 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:19:47.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (8 ms) 2024-09-12T00:19:47.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:19:47.533 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-12T00:19:47.533 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:19:47.538 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] rgw_gc_log.defer1_after_init (6 ms) 2024-09-12T00:19:47.539 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:19:47.542 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] rgw_gc_log.defer2_before_init (4 ms) 2024-09-12T00:19:47.542 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 6 tests from rgw_gc_log (62 ms total) 2024-09-12T00:19:47.542 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:19:47.542 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:19:48.493 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 6 tests from 1 test suite ran. (2912 ms total) 2024-09-12T00:19:48.493 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 6 tests. 2024-09-12T00:19:48.498 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:48.498 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:48.551 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:19:48.552 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:19:48.553 DEBUG:teuthology.orchestra.run.smithi102:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:19:48.626 INFO:tasks.workunit.client.0.smithi102.stdout:Running main() from gmock_main.cc 2024-09-12T00:19:48.626 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns= i= 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns= i= 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns= i= 2024-09-12T00:19:48.627 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "obj1": { 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.628 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "obj2": { 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.629 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3": { 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.630 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.631 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3-2": { 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.632 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns=ns i= 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns=ns i= 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.633 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns=ns i= 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: "obj1": { 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.634 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: "obj2": { 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.635 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.636 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3": { 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.637 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3-2": { 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.638 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns= i=v1 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.639 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns= i=v1 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns= i=v1 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout: "obj1": { 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.640 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: "obj2": { 2024-09-12T00:19:48.641 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.642 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3": { 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.643 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3-2": { 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.644 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.645 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: _obj[v1] 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout: "obj1": { 2024-09-12T00:19:48.646 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.647 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "obj2": { 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.648 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3": { 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.649 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.650 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3-2": { 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.651 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_obj", 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.652 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestRGWObj.underscore (1 ms) 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns= i= 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns= i= 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns= i= 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout: "obj1": { 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.653 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.654 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "obj2": { 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.655 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3": { 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.656 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.657 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.660 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.660 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3-2": { 2024-09-12T00:19:48.660 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.660 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.660 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.661 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns=ns i= 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns=ns i= 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj 2024-09-12T00:19:48.662 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns=ns i= 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "obj1": { 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.663 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: "obj2": { 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.664 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3": { 2024-09-12T00:19:48.665 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.666 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3-2": { 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.667 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns= i=v1 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.668 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns= i=v1 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns= i=v1 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout: "obj1": { 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.669 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: "obj2": { 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.670 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.671 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3": { 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.672 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3-2": { 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.673 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.674 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout:parsed: obj[v1] 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout: "obj1": { 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.675 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: "obj2": { 2024-09-12T00:19:48.676 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.677 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3": { 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.678 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: "obj3-2": { 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.679 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "obj", 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "v1", 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.680 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.681 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.682 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.683 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker_myobj", 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.684 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.685 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.686 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.687 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker_myobj", 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.688 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.689 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.690 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.691 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.692 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.693 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.694 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.695 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.696 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.697 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.698 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.699 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.700 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.701 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.702 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.703 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.704 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.705 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.706 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.707 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.708 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.709 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.710 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.711 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.712 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.713 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.714 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.715 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.716 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.717 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.718 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.719 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker___myobj", 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj" 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.720 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.721 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.722 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.723 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker___myobj", 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj" 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.724 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.725 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.726 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.727 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.728 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.729 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.730 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.731 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.732 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.733 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.734 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.735 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.736 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.737 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj" 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.738 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.739 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.740 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.741 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.742 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj" 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.743 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.744 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.745 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.746 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.747 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.748 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.749 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.750 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.751 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.752 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.753 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.754 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.754 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.754 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.754 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.754 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.754 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.754 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.754 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.754 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.754 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.755 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.756 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker___myobj_", 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj_" 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.757 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.758 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.759 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.760 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker___myobj_", 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj_" 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.761 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.762 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.763 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.764 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.765 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.766 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.767 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.768 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.769 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:19:48.770 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.771 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.772 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.773 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.774 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj_" 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.775 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.776 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.777 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.778 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.779 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj_" 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.780 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.781 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.782 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.783 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": "default-placement.data", 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:19:48.784 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "test", 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": "", 2024-09-12T00:19:48.785 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": "" 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.786 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: "obj": { 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.787 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.788 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.789 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.790 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker_myobj", 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.791 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.792 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker_myobj", 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.793 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.794 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.795 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.796 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.797 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.798 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:19:48.799 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.800 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.801 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.802 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.803 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.804 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.805 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.806 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "myobj", 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:19:48.807 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker___myobj", 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj" 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.808 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.809 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker___myobj", 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj" 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.810 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.811 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.812 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.813 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.814 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.815 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj" 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.816 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.817 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj" 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.818 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.819 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.820 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:19:48.821 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.822 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj", 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:19:48.823 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker___myobj_", 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj_" 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.824 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.825 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker___myobj_", 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj_" 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.826 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.827 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.828 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.829 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.830 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.831 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "", 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj_" 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.832 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.833 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.834 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "marker__myobj_" 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.835 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "" 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj": { 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:19:48.836 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj": { 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.837 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: "raw_obj2": { 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: "pool": ".data-pool", 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: "loc": "" 2024-09-12T00:19:48.838 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "new_obj2": { 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket": { 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "ebtest", 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "marker": "marker", 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_id": "bucket-id", 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "tenant": "", 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "explicit_placement": { 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "data_pool": ".data-pool", 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "data_extra_pool": "", 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "index_pool": ".index-pool" 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:48.839 INFO:tasks.workunit.client.0.smithi102.stdout: "key": { 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout: "name": "_myobj_", 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout: "instance": "inst", 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout: "ns": "ns" 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 4 tests from TestRGWObj (2 ms total) 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 4 tests from 1 test suite ran. (2 ms total) 2024-09-12T00:19:48.840 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 4 tests. 2024-09-12T00:19:48.841 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:48.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:48.855 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:19:48.857 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:19:48.857 DEBUG:teuthology.orchestra.run.smithi102:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:19:48.965 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:48.966 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:49.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.040+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.044+0000 7faafba0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.044+0000 7faafba0a9c0 20 realm 2024-09-12T00:19:49.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.044+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.044+0000 7faafba0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.044+0000 7faafba0a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:49.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.044+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.044+0000 7faafba0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.044+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.044+0000 7faafba0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:49.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.044+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.048+0000 7faafba0a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:49.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.048+0000 7faafba0a9c0 20 searching for the correct realm 2024-09-12T00:19:49.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.048+0000 7faaf9d11640 0 -- 172.21.15.102:0/1136641120 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7faae40c1020 msgr2=0x7faae40f6df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:49.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.264+0000 7faaf8d0f640 0 -- 172.21.15.102:0/1136641120 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7faaec085930 msgr2=0x7faaec039960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:49.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:19:49.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:49.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:49.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:19:49.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:49.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:49.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:49.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:49.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 zone default found 2024-09-12T00:19:49.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 4 Realm: () 2024-09-12T00:19:49.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:19:49.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:19:49.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:49.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 zonegroup default 2024-09-12T00:19:49.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.484+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.488+0000 7faafba0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.488+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.488+0000 7faafba0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.488+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.488+0000 7faafba0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.488+0000 7faafba0a9c0 20 started sync module instance, tier type = 2024-09-12T00:19:49.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.488+0000 7faafba0a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:19:49.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.512+0000 7faafba0a9c0 20 add_watcher() i=0 2024-09-12T00:19:49.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.512+0000 7faafba0a9c0 20 add_watcher() i=1 2024-09-12T00:19:49.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.512+0000 7faafba0a9c0 20 add_watcher() i=2 2024-09-12T00:19:49.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.512+0000 7faafba0a9c0 20 add_watcher() i=3 2024-09-12T00:19:49.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.512+0000 7faafba0a9c0 20 add_watcher() i=4 2024-09-12T00:19:49.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.512+0000 7faafba0a9c0 20 add_watcher() i=5 2024-09-12T00:19:49.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.512+0000 7faafba0a9c0 20 add_watcher() i=6 2024-09-12T00:19:49.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.516+0000 7faafba0a9c0 20 add_watcher() i=7 2024-09-12T00:19:49.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.516+0000 7faafba0a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:49.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.520+0000 7fa9af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:49.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.520+0000 7faafba0a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:49.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.520+0000 7faafba0a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:49.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.520+0000 7faafba0a9c0 5 note: GC not initialized 2024-09-12T00:19:49.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.520+0000 7fa9ae7e4640 20 reqs_thread_entry: start 2024-09-12T00:19:49.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.520+0000 7faafba0a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:19:49.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.520+0000 7faafba0a9c0 20 Filter name: none 2024-09-12T00:19:49.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.520+0000 7fa91ffff640 20 reqs_thread_entry: start 2024-09-12T00:19:49.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.520+0000 7faafba0a9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:19:49.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.520+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:19:49.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:19:49.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:19:49.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:19:49.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:19:49.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 10 cache get: name=default.rgw.meta+users.keys+KDWff4pBXrMmsv0cA/Fq/6FANGs= : miss 2024-09-12T00:19:49.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:19:49.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:49.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 10 cache put: name=default.rgw.meta+users.keys+KDWff4pBXrMmsv0cA/Fq/6FANGs= info.flags=0x0 2024-09-12T00:19:49.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 10 adding default.rgw.meta+users.keys+KDWff4pBXrMmsv0cA/Fq/6FANGs= to cache LRU end 2024-09-12T00:19:49.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 10 cache get: name=default.rgw.meta+users.keys+KDWff4pBXrMmsv0cA/Fq/6FANGs= : hit (negative entry) 2024-09-12T00:19:49.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.524+0000 7faafba0a9c0 10 cache get: name=default.rgw.meta+users.keys+KDWff4pBXrMmsv0cA/Fq/6FANGs= : hit (negative entry) 2024-09-12T00:19:49.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.528+0000 7faafba0a9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:19:49.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.528+0000 7faafba0a9c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:19:49.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.528+0000 7faafba0a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:19:49.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.528+0000 7fa9cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758595 cookie 94775179690336 notifier 5535 bl.length()=697 2024-09-12T00:19:49.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.528+0000 7fa9cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:19:49.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.528+0000 7fa9cbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:19:49.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.532+0000 7faafba0a9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:19:49.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.532+0000 7faafba0a9c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:19:49.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.532+0000 7faafba0a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:19:49.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.536+0000 7fa9cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758595 cookie 94775179696960 notifier 5535 bl.length()=194 2024-09-12T00:19:49.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.536+0000 7fa9cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:19:49.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.536+0000 7fa9cbfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:19:49.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.540+0000 7faafba0a9c0 10 cache put: name=default.rgw.meta+users.keys+KDWff4pBXrMmsv0cA/Fq/6FANGs= info.flags=0x7 2024-09-12T00:19:49.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.540+0000 7faafba0a9c0 10 moving default.rgw.meta+users.keys+KDWff4pBXrMmsv0cA/Fq/6FANGs= to cache LRU end 2024-09-12T00:19:49.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.540+0000 7faafba0a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:KDWff4pBXrMmsv0cA/Fq/6FANGs=, ofs0, ns] 2024-09-12T00:19:49.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.540+0000 7fa9cbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758595 cookie 94775179712112 notifier 5535 bl.length()=203 2024-09-12T00:19:49.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.540+0000 7fa9cbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KDWff4pBXrMmsv0cA/Fq/6FANGs= info.flags=0x7 2024-09-12T00:19:49.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.540+0000 7fa9cbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KDWff4pBXrMmsv0cA/Fq/6FANGs= to cache LRU end 2024-09-12T00:19:49.540 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:19:49.540 INFO:tasks.workunit.client.0.smithi102.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:19:49.540 INFO:tasks.workunit.client.0.smithi102.stdout: "display_name": "librgw test user", 2024-09-12T00:19:49.540 INFO:tasks.workunit.client.0.smithi102.stdout: "email": "librgw@example.com", 2024-09-12T00:19:49.540 INFO:tasks.workunit.client.0.smithi102.stdout: "suspended": 0, 2024-09-12T00:19:49.540 INFO:tasks.workunit.client.0.smithi102.stdout: "max_buckets": 1000, 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: "subusers": [], 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: "keys": [ 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: { 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: "access_key": "KDWff4pBXrMmsv0cA/Fq/6FANGs=", 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: "secret_key": "GEMZZQ43Fnxdnv9m7FIj8g41xkGGJIIl/sOgUWwRLFPuJJitOSzgVg==", 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: "active": true, 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: "create_date": "2024-09-12T00:19:49.527338Z" 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: ], 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: "swift_keys": [], 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: "caps": [], 2024-09-12T00:19:49.541 INFO:tasks.workunit.client.0.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "default_placement": "", 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "default_storage_class": "", 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "placement_tags": [], 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_quota": { 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "enabled": false, 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size": -1, 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "max_objects": -1 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "user_quota": { 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "enabled": false, 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:19:49.542 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size": -1, 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: "max_objects": -1 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: "temp_url_keys": [], 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: "type": "rgw", 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: "mfa_ids": [], 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: "account_id": "", 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: "path": "/", 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: "create_date": "2024-09-12T00:19:49.527281Z", 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: "tags": [], 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: "group_ids": [] 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:19:49.543 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:19:49.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.544+0000 7fa9af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:49.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.552+0000 7faafba0a9c0 20 remove_watcher() i=0 2024-09-12T00:19:49.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.552+0000 7faafba0a9c0 2 removed watcher, disabling cache 2024-09-12T00:19:49.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.552+0000 7faafba0a9c0 20 remove_watcher() i=1 2024-09-12T00:19:49.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.556+0000 7faafba0a9c0 20 remove_watcher() i=2 2024-09-12T00:19:49.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.560+0000 7faafba0a9c0 20 remove_watcher() i=3 2024-09-12T00:19:49.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.560+0000 7faafba0a9c0 20 remove_watcher() i=4 2024-09-12T00:19:49.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.564+0000 7faafba0a9c0 20 remove_watcher() i=5 2024-09-12T00:19:49.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.564+0000 7faafba0a9c0 20 remove_watcher() i=6 2024-09-12T00:19:49.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:49.568+0000 7faafba0a9c0 20 remove_watcher() i=7 2024-09-12T00:19:49.585 INFO:tasks.workunit.client.0.smithi102.stdout:phase 1.1 2024-09-12T00:19:49.605 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:19:49.606 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:19:49.606 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:19:49.606 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:19:49.618 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:49.618 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:50.464 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (858 ms) 2024-09-12T00:19:50.464 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:19:50.466 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:19:50.466 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:19:50.466 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:19:50.466 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:19:50.486 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:19:50.496 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/f1 2024-09-12T00:19:50.503 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/f2 2024-09-12T00:19:50.511 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:19:50.517 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:19:50.523 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:19:50.530 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:19:50.538 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:19:50.545 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:19:50.552 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:19:50.558 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:19:50.565 INFO:tasks.workunit.client.0.smithi102.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:19:50.572 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SETUP_HIER1 (107 ms) 2024-09-12T00:19:50.573 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:19:50.859 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SETUP_DIRS1 (286 ms) 2024-09-12T00:19:50.859 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:19:50.859 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:19:50.859 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:19:50.908 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (50 ms) 2024-09-12T00:19:50.909 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:19:51.030 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (121 ms) 2024-09-12T00:19:51.030 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:19:51.030 INFO:tasks.workunit.client.0.smithi102.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:19:51.047 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (17 ms) 2024-09-12T00:19:51.047 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:19:51.047 INFO:tasks.workunit.client.0.smithi102.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:19:51.064 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (17 ms) 2024-09-12T00:19:51.064 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:19:51.064 INFO:tasks.workunit.client.0.smithi102.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:19:51.065 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:19:51.066 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:19:51.066 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:19:51.066 INFO:tasks.workunit.client.0.smithi102.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:19:51.066 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:19:51.069 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:19:51.069 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:19:51.073 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:19:51.073 INFO:tasks.workunit.client.0.smithi102.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:19:51.073 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:19:51.078 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:19:51.078 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:19:51.082 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:19:51.082 INFO:tasks.workunit.client.0.smithi102.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:19:51.083 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:19:51.086 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:19:51.086 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:19:51.090 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:19:51.090 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READ_DIRS1 (26 ms) 2024-09-12T00:19:51.090 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:19:51.325 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READF_SETUP1 (235 ms) 2024-09-12T00:19:51.325 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:19:51.326 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:19:51.327 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:19:51.327 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:19:51.327 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:19:51.327 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (1 ms) 2024-09-12T00:19:51.327 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:19:51.345 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:19:51.345 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:19:51.352 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:19:51.356 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:19:51.363 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:19:51.363 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:19:51.364 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:19:51.365 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:19:51.367 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:19:51.368 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:19:51.369 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:19:51.374 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:19:51.374 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:19:51.374 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:19:51.374 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.HIER1 (48 ms) 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:19:51.375 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:19:51.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:51.376+0000 7f4fda94ea80 -1 shutting down 2024-09-12T00:19:51.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:19:51.380+0000 7f4eb46a0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58561, si_uid : 1000, si_addr0x3e80000e4c1, si_status0 2024-09-12T00:20:20.753 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (29379 ms) 2024-09-12T00:20:20.753 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 24 tests from LibRGW (31147 ms total) 2024-09-12T00:20:20.754 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:20:20.754 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:20:20.754 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 24 tests from 1 test suite ran. (31147 ms total) 2024-09-12T00:20:20.754 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 24 tests. 2024-09-12T00:20:20.768 INFO:tasks.workunit.client.0.smithi102.stdout:phase 1.2 2024-09-12T00:20:20.791 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:20:20.791 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:20:20.792 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:20:20.792 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:20:20.802 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:20.802 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:21.579 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (787 ms) 2024-09-12T00:20:21.579 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:20:21.581 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:20:21.582 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:20:21.583 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:20:21.584 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:20:21.585 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:20:21.585 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:20:21.585 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:20:21.585 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:20:21.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:20:21.584+0000 7f2902010a80 -1 shutting down 2024-09-12T00:20:21.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:20:21.588+0000 7f27dbd62640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59209, si_uid : 1000, si_addr0x3e80000e749, si_status0 2024-09-12T00:20:51.696 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (30115 ms) 2024-09-12T00:20:51.696 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 24 tests from LibRGW (30904 ms total) 2024-09-12T00:20:51.696 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:20:51.697 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:20:51.697 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 24 tests from 1 test suite ran. (30904 ms total) 2024-09-12T00:20:51.697 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 24 tests. 2024-09-12T00:20:51.705 INFO:tasks.workunit.client.0.smithi102.stdout:phase 1.3 2024-09-12T00:20:51.726 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:20:51.726 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:20:51.727 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:20:51.727 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:20:51.739 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:51.739 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:52.520 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (794 ms) 2024-09-12T00:20:52.521 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:20:52.522 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:20:52.522 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:20:52.522 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:20:52.522 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:20:52.532 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SETUP_HIER1 (10 ms) 2024-09-12T00:20:52.532 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SETUP_DIRS1 (125 ms) 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:20:52.658 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:20:52.659 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:20:52.659 INFO:tasks.workunit.client.0.smithi102.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:20:52.659 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:52.659 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:20:52.659 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:52.659 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:20:52.659 INFO:tasks.workunit.client.0.smithi102.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:20:52.659 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:52.659 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:20:52.659 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:52.660 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:20:52.660 INFO:tasks.workunit.client.0.smithi102.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:20:52.660 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:52.660 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:20:52.660 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:52.660 INFO:tasks.workunit.client.0.smithi102.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:20:52.660 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:20:52.660 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:20:52.660 INFO:tasks.workunit.client.0.smithi102.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:20:52.660 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:20:52.661 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:20:52.661 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:20:52.662 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:20:52.663 INFO:tasks.workunit.client.0.smithi102.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:20:52.663 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:20:52.665 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:20:52.666 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:20:52.669 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:20:52.669 INFO:tasks.workunit.client.0.smithi102.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:20:52.669 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:20:52.670 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:20:52.670 INFO:tasks.workunit.client.0.smithi102.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:20:52.673 INFO:tasks.workunit.client.0.smithi102.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READ_DIRS1 (16 ms) 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:20:52.674 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:20:52.675 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:20:52.675 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:20:52.675 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:20:52.675 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:20:52.675 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:20:52.675 INFO:tasks.workunit.client.0.smithi102.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:20:52.675 INFO:tasks.workunit.client.0.smithi102.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:20:52.675 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:20:52.675 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:20:52.693 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:20:52.694 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:20:52.702 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:20:52.707 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:20:52.715 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:20:52.716 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:20:52.717 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:20:52.718 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:20:52.719 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:20:52.721 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:20:52.722 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:20:52.727 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:20:52.727 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:20:52.727 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:20:52.727 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:20:52.727 INFO:tasks.workunit.client.0.smithi102.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:20:52.727 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.HIER1 (54 ms) 2024-09-12T00:20:52.727 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:20:52.728 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:20:52.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:20:52.731+0000 7f32b9191a80 -1 shutting down 2024-09-12T00:20:52.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:20:52.735+0000 7f3192ee3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59855, si_uid : 1000, si_addr0x3e80000e9cf, si_status0 2024-09-12T00:21:22.730 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (30002 ms) 2024-09-12T00:21:22.730 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 24 tests from LibRGW (31003 ms total) 2024-09-12T00:21:22.730 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:21:22.730 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:22.730 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 24 tests from 1 test suite ran. (31003 ms total) 2024-09-12T00:21:22.731 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 24 tests. 2024-09-12T00:21:22.744 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2.1 2024-09-12T00:21:22.769 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:21:22.769 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:22.769 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:21:22.769 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:21:22.780 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:22.780 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:23.562 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (793 ms) 2024-09-12T00:21:23.562 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:21:23.564 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:21:23.564 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:21:23.585 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CREATE_BUCKET (21 ms) 2024-09-12T00:21:23.585 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:21:23.585 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:21:23.585 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:21:23.602 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave0 2024-09-12T00:21:23.621 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave1 2024-09-12T00:21:23.642 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave2 2024-09-12T00:21:23.661 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave3 2024-09-12T00:21:23.682 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave4 2024-09-12T00:21:23.707 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave5 2024-09-12T00:21:23.730 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave6 2024-09-12T00:21:23.753 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave7 2024-09-12T00:21:23.775 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave8 2024-09-12T00:21:23.797 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave9 2024-09-12T00:21:23.797 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (212 ms) 2024-09-12T00:21:23.797 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:21:24.525 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (727 ms) 2024-09-12T00:21:24.525 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:21:24.525 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:21:24.525 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:21:24.525 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:21:24.525 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:21:24.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:21:24.527+0000 7f6c61d37a80 -1 shutting down 2024-09-12T00:21:24.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:21:24.531+0000 7f6b3ba89640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60562, si_uid : 1000, si_addr0x3e80000ec92, si_status0 2024-09-12T00:21:53.673 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (29149 ms) 2024-09-12T00:21:53.674 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 9 tests from LibRGW (30904 ms total) 2024-09-12T00:21:53.674 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:21:53.674 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:53.674 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 9 tests from 1 test suite ran. (30904 ms total) 2024-09-12T00:21:53.674 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 9 tests. 2024-09-12T00:21:53.686 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2.2 2024-09-12T00:21:53.712 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:21:53.712 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:53.712 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:21:53.712 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:21:53.723 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:53.723 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:54.022 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (310 ms) 2024-09-12T00:21:54.022 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:21:54.023 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:21:54.023 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:21:54.023 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:21:54.024 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:21:54.082 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_BUCKET (58 ms) 2024-09-12T00:21:54.082 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:21:54.099 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave0 2024-09-12T00:21:54.118 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave1 2024-09-12T00:21:54.137 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave2 2024-09-12T00:21:54.156 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave3 2024-09-12T00:21:54.177 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave4 2024-09-12T00:21:54.196 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave5 2024-09-12T00:21:54.216 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave6 2024-09-12T00:21:54.240 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave7 2024-09-12T00:21:54.259 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave8 2024-09-12T00:21:54.281 INFO:tasks.workunit.client.0.smithi102.stdout:created: sorrydave9 2024-09-12T00:21:54.281 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (200 ms) 2024-09-12T00:21:54.282 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:21:55.047 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (766 ms) 2024-09-12T00:21:55.048 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:21:55.048 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:21:55.048 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:21:55.048 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:21:55.048 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:21:55.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:21:55.051+0000 7fd9f5f0da80 -1 shutting down 2024-09-12T00:21:55.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:21:55.055+0000 7fd8cfc5f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61208, si_uid : 1000, si_addr0x3e80000ef18, si_status0 2024-09-12T00:22:24.416 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (29368 ms) 2024-09-12T00:22:24.416 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 9 tests from LibRGW (30704 ms total) 2024-09-12T00:22:24.416 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:22:24.416 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:22:24.416 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 9 tests from 1 test suite ran. (30704 ms total) 2024-09-12T00:22:24.416 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 9 tests. 2024-09-12T00:22:24.430 INFO:tasks.workunit.client.0.smithi102.stdout:phase 3.1 2024-09-12T00:22:24.765 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:22:24.766 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:22:24.766 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:22:24.766 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:22:24.775 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:24.775 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:25.365 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (600 ms) 2024-09-12T00:22:25.366 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:22:25.367 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:22:25.367 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:22:25.388 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CREATE_BUCKET (21 ms) 2024-09-12T00:22:25.388 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:22:25.396 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T00:22:25.396 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:22:25.400 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T00:22:25.400 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:22:25.464 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LARGE1 (64 ms) 2024-09-12T00:22:25.464 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:22:25.529 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LARGE2 (65 ms) 2024-09-12T00:22:25.529 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:22:25.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:22:25.534+0000 7f5b3157fa80 -1 shutting down 2024-09-12T00:22:25.532 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:22:25.534+0000 7f5a0b2d1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61853, si_uid : 1000, si_addr0x3e80000f19d, si_status0 2024-09-12T00:22:55.527 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (29997 ms) 2024-09-12T00:22:55.528 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 13 tests from LibRGW (30761 ms total) 2024-09-12T00:22:55.528 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:22:55.528 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:22:55.528 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 13 tests from 1 test suite ran. (30761 ms total) 2024-09-12T00:22:55.528 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 13 tests. 2024-09-12T00:22:55.542 INFO:tasks.workunit.client.0.smithi102.stdout:phase 3.2 2024-09-12T00:22:55.884 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:22:55.884 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:22:55.884 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:22:55.884 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:22:55.893 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:55.893 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:56.435 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (551 ms) 2024-09-12T00:22:56.435 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:22:56.436 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:22:56.436 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:22:56.436 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:22:56.437 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:22:56.448 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (11 ms) 2024-09-12T00:22:56.448 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:22:56.456 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (8 ms) 2024-09-12T00:22:56.456 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:22:56.523 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LARGE1 (67 ms) 2024-09-12T00:22:56.523 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:22:56.523 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:22:56.523 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:22:56.523 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:22:56.523 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:22:56.533 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-12T00:22:56.533 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:22:56.593 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_BUCKET (60 ms) 2024-09-12T00:22:56.593 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:22:56.593 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:22:56.593 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:22:56.593 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:22:56.593 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:22:56.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:22:56.598+0000 7f8516c74a80 -1 shutting down 2024-09-12T00:22:56.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:22:56.598+0000 7f83f09c6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62499, si_uid : 1000, si_addr0x3e80000f423, si_status0 2024-09-12T00:23:26.703 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (30110 ms) 2024-09-12T00:23:26.704 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 13 tests from LibRGW (30819 ms total) 2024-09-12T00:23:26.704 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:23:26.704 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:23:26.704 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 13 tests from 1 test suite ran. (30819 ms total) 2024-09-12T00:23:26.704 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 13 tests. 2024-09-12T00:23:26.717 INFO:tasks.workunit.client.0.smithi102.stdout:phase 4.1 2024-09-12T00:23:26.741 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:23:26.741 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:23:26.741 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:23:26.741 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:23:26.741 INFO:tasks.workunit.client.0.smithi102.stdout:read i1: 64001 2024-09-12T00:23:26.741 INFO:tasks.workunit.client.0.smithi102.stdout:read s1: blunderbuss 2024-09-12T00:23:26.741 INFO:tasks.workunit.client.0.smithi102.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:23:26.741 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:23:26.754 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:26.754 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (533 ms) 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:23:27.275 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:23:27.307 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (31 ms) 2024-09-12T00:23:27.307 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:23:28.745 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_0 2024-09-12T00:23:28.746 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_1 2024-09-12T00:23:28.746 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_2 2024-09-12T00:23:28.746 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_3 2024-09-12T00:23:28.746 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_4 2024-09-12T00:23:28.746 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_5 2024-09-12T00:23:28.746 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_6 2024-09-12T00:23:28.746 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_7 2024-09-12T00:23:28.746 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_8 2024-09-12T00:23:28.747 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_9 2024-09-12T00:23:28.747 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_10 2024-09-12T00:23:28.747 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_11 2024-09-12T00:23:28.747 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_12 2024-09-12T00:23:28.747 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_13 2024-09-12T00:23:28.747 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_14 2024-09-12T00:23:28.747 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_15 2024-09-12T00:23:28.747 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_16 2024-09-12T00:23:28.747 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_17 2024-09-12T00:23:28.747 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_18 2024-09-12T00:23:28.748 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_19 2024-09-12T00:23:28.748 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_20 2024-09-12T00:23:28.748 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_21 2024-09-12T00:23:28.748 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_22 2024-09-12T00:23:28.748 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_23 2024-09-12T00:23:28.748 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_24 2024-09-12T00:23:28.748 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_25 2024-09-12T00:23:28.748 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_26 2024-09-12T00:23:28.748 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_27 2024-09-12T00:23:28.748 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_28 2024-09-12T00:23:28.749 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_29 2024-09-12T00:23:28.749 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_30 2024-09-12T00:23:28.749 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_31 2024-09-12T00:23:28.749 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_32 2024-09-12T00:23:28.749 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_33 2024-09-12T00:23:28.749 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_34 2024-09-12T00:23:28.749 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_35 2024-09-12T00:23:28.749 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_36 2024-09-12T00:23:28.749 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_37 2024-09-12T00:23:28.749 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_38 2024-09-12T00:23:28.750 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_39 2024-09-12T00:23:28.750 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_40 2024-09-12T00:23:28.750 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_41 2024-09-12T00:23:28.750 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_42 2024-09-12T00:23:28.750 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_43 2024-09-12T00:23:28.750 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_44 2024-09-12T00:23:28.750 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_45 2024-09-12T00:23:28.750 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_46 2024-09-12T00:23:28.750 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_47 2024-09-12T00:23:28.751 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_48 2024-09-12T00:23:28.751 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_49 2024-09-12T00:23:28.751 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_50 2024-09-12T00:23:28.751 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_51 2024-09-12T00:23:28.751 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_52 2024-09-12T00:23:28.751 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_53 2024-09-12T00:23:28.751 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_54 2024-09-12T00:23:28.751 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_55 2024-09-12T00:23:28.751 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_56 2024-09-12T00:23:28.751 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_57 2024-09-12T00:23:28.752 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_58 2024-09-12T00:23:28.752 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_59 2024-09-12T00:23:28.752 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_60 2024-09-12T00:23:28.752 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_61 2024-09-12T00:23:28.752 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_62 2024-09-12T00:23:28.752 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_63 2024-09-12T00:23:28.752 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_64 2024-09-12T00:23:28.752 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_65 2024-09-12T00:23:28.752 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_66 2024-09-12T00:23:28.753 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_67 2024-09-12T00:23:28.753 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_68 2024-09-12T00:23:28.753 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_69 2024-09-12T00:23:28.753 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_70 2024-09-12T00:23:28.753 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_71 2024-09-12T00:23:28.753 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_72 2024-09-12T00:23:28.753 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_73 2024-09-12T00:23:28.753 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_74 2024-09-12T00:23:28.753 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_75 2024-09-12T00:23:28.754 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_76 2024-09-12T00:23:28.754 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_77 2024-09-12T00:23:28.754 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_78 2024-09-12T00:23:28.754 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_79 2024-09-12T00:23:28.754 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_80 2024-09-12T00:23:28.754 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_81 2024-09-12T00:23:28.754 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_82 2024-09-12T00:23:28.754 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_83 2024-09-12T00:23:28.755 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_84 2024-09-12T00:23:28.755 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_85 2024-09-12T00:23:28.755 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_86 2024-09-12T00:23:28.755 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_87 2024-09-12T00:23:28.755 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_88 2024-09-12T00:23:28.755 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_89 2024-09-12T00:23:28.755 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_90 2024-09-12T00:23:28.755 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_91 2024-09-12T00:23:28.755 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_92 2024-09-12T00:23:28.755 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_93 2024-09-12T00:23:28.756 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_94 2024-09-12T00:23:28.756 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_95 2024-09-12T00:23:28.756 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_96 2024-09-12T00:23:28.756 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_97 2024-09-12T00:23:28.756 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_98 2024-09-12T00:23:28.756 INFO:tasks.workunit.client.0.smithi102.stdout:created: dmarker:f_99 2024-09-12T00:23:28.756 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1438 ms) 2024-09-12T00:23:28.757 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:23:28.758 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:23:28.758 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:23:28.758 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:23:28.759 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:23:28.759 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:23:28.759 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:23:28.759 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:23:28.759 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:23:28.759 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:23:28.759 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:23:28.760 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:23:28.760 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:23:28.760 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:23:28.760 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:23:28.760 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:23:28.760 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:23:28.760 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:23:28.760 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:23:28.761 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:23:28.761 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:23:28.761 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:23:28.761 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:23:28.761 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:23:28.761 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:23:28.761 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:23:28.761 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:23:28.761 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:23:28.762 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:23:28.762 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:23:28.762 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:23:28.762 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:23:28.762 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:23:28.762 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:23:28.762 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:23:28.762 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:23:28.762 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:23:28.763 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:23:28.763 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:23:28.763 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:23:28.763 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:23:28.763 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:23:28.763 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:23:28.763 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:23:28.763 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:23:28.764 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:23:28.764 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:23:28.764 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:23:28.764 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:23:28.764 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:23:28.764 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:23:28.764 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:23:28.764 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:23:28.764 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:23:28.765 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:23:28.765 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:23:28.765 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:23:28.765 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:23:28.765 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:23:28.765 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:23:28.765 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:23:28.765 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:23:28.765 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:23:28.766 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:23:28.766 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:23:28.766 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:23:28.766 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:23:28.766 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:23:28.766 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:23:28.766 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:23:28.766 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:23:28.767 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:23:28.767 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:23:28.767 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:23:28.767 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:23:28.767 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:23:28.767 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:23:28.767 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:23:28.767 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:23:28.767 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:23:28.768 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:23:28.768 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:23:28.768 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:23:28.768 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:23:28.768 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:23:28.769 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:23:28.769 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:23:28.769 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:23:28.769 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:23:28.769 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:23:28.770 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:23:28.770 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:23:28.770 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:23:28.770 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:23:28.770 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:23:28.770 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:23:28.770 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:23:28.770 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:23:28.771 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:23:28.771 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:23:28.771 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:23:28.771 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:23:28.771 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:23:28.771 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_READDIR (6 ms) 2024-09-12T00:23:28.771 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:23:28.771 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:23:28.771 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:23:28.771 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:23:28.772 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:23:28.772 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:23:28.772 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:23:28.772 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:23:28.772 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:23:28.772 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:23:28.772 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:23:28.772 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:23:28.773 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:23:28.773 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:23:28.773 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:23:28.773 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:23:28.773 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:23:28.773 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:23:28.773 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:23:28.774 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:23:28.774 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:23:28.774 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:23:28.774 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:23:28.774 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:23:28.774 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:23:28.774 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:23:28.774 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:23:28.774 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:23:28.774 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:23:28.775 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:23:28.775 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:23:28.775 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:23:28.775 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:23:28.775 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:23:28.775 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:23:28.775 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:23:28.775 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:23:28.776 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:23:28.776 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:23:28.776 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:23:28.776 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:23:28.776 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:23:28.776 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:23:28.776 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:23:28.777 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:23:28.777 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:23:28.777 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:23:28.777 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:23:28.777 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:23:28.777 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:23:28.777 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:23:28.777 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:23:28.778 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:23:28.778 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:23:28.778 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:23:28.778 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:23:28.778 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:23:28.778 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:23:28.778 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:23:28.779 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:23:28.779 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:23:28.779 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:23:28.779 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:23:28.779 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:23:28.779 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:23:28.779 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:23:28.779 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:23:28.779 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:23:28.780 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:23:28.780 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:23:28.780 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:23:28.780 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:23:28.780 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:23:28.780 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:23:28.780 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:23:28.780 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:23:28.781 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:23:28.781 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:23:28.781 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:23:28.781 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:23:28.781 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:23:28.781 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:23:28.781 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:23:28.781 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:23:28.781 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:23:28.782 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:23:28.782 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:23:28.782 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:23:28.782 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:23:28.782 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:23:28.782 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:23:28.782 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:23:28.783 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:23:28.784 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:23:28.784 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:23:28.784 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:23:28.784 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:23:28.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:23:28.765+0000 7fb61eadca80 -1 shutting down 2024-09-12T00:23:28.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:23:28.765+0000 7fb4f882e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63144, si_uid : 1000, si_addr0x3e80000f6a8, si_status0 2024-09-12T00:23:57.412 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (28654 ms) 2024-09-12T00:23:57.412 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 11 tests from LibRGW (30671 ms total) 2024-09-12T00:23:57.412 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:23:57.412 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:23:57.413 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 11 tests from 1 test suite ran. (30671 ms total) 2024-09-12T00:23:57.413 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 11 tests. 2024-09-12T00:23:57.425 INFO:tasks.workunit.client.0.smithi102.stdout:phase 4.2 2024-09-12T00:23:57.447 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:23:57.447 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:23:57.447 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:23:57.447 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:23:57.447 INFO:tasks.workunit.client.0.smithi102.stdout:read i1: 64001 2024-09-12T00:23:57.448 INFO:tasks.workunit.client.0.smithi102.stdout:read s1: blunderbuss 2024-09-12T00:23:57.448 INFO:tasks.workunit.client.0.smithi102.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:23:57.448 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:23:57.457 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:57.457 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:58.184 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (737 ms) 2024-09-12T00:23:58.184 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:23:58.185 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:23:58.185 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:23:58.201 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-09-12T00:23:58.201 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:23:58.201 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:23:58.201 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:23:58.201 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:23:58.201 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:23:58.206 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:23:58.206 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:23:58.206 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:23:58.206 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:23:58.206 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:23:58.206 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:23:58.206 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:23:58.206 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:23:58.206 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:23:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:23:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:23:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:23:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:23:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:23:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:23:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:23:58.214 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:23:58.214 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:23:58.214 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:23:58.214 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:23:58.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:23:58.213+0000 7f530bdc5a80 -1 shutting down 2024-09-12T00:23:58.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:23:58.217+0000 7f51e5b17640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63789, si_uid : 1000, si_addr0x3e80000f92d, si_status0 2024-09-12T00:24:28.233 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (30026 ms) 2024-09-12T00:24:28.233 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 11 tests from LibRGW (30785 ms total) 2024-09-12T00:24:28.233 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:24:28.233 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:28.233 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 11 tests from 1 test suite ran. (30785 ms total) 2024-09-12T00:24:28.233 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 11 tests. 2024-09-12T00:24:28.246 INFO:tasks.workunit.client.0.smithi102.stdout:phase 5.1 2024-09-12T00:24:28.280 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:24:28.280 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:28.280 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:24:28.280 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:24:28.291 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:28.292 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:29.059 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (779 ms) 2024-09-12T00:24:29.059 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:24:29.060 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:24:29.060 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:24:29.079 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CREATE_BUCKET (18 ms) 2024-09-12T00:24:29.079 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:24:29.086 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-12T00:24:29.086 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:24:29.086 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:24:29.086 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:24:29.089 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T00:24:29.089 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:24:29.089 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:24:29.089 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:24:29.097 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.PUT_OBJECT (8 ms) 2024-09-12T00:24:29.097 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:24:29.100 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-12T00:24:29.100 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:24:29.100 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:24:29.100 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:24:29.100 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:24:29.101 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:24:29.102 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:24:29.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:24:29.104+0000 7ff556e93a80 -1 shutting down 2024-09-12T00:24:29.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:24:29.108+0000 7ff430be5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64434, si_uid : 1000, si_addr0x3e80000fbb2, si_status0 2024-09-12T00:24:59.422 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (30322 ms) 2024-09-12T00:24:59.423 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 19 tests from LibRGW (31142 ms total) 2024-09-12T00:24:59.423 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:24:59.423 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:59.423 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 19 tests from 1 test suite ran. (31142 ms total) 2024-09-12T00:24:59.423 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 19 tests. 2024-09-12T00:24:59.435 INFO:tasks.workunit.client.0.smithi102.stdout:phase 5.2 2024-09-12T00:24:59.470 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:24:59.471 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:59.471 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:24:59.471 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:24:59.479 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:59.479 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:00.040 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (569 ms) 2024-09-12T00:25:00.040 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:25:00.051 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-12T00:25:00.051 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:25:00.061 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_OBJECT (9 ms) 2024-09-12T00:25:00.061 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:25:00.114 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.DELETE_BUCKET (53 ms) 2024-09-12T00:25:00.114 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:25:00.114 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:25:00.114 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:25:00.114 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:25:00.114 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:25:00.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:25:00.120+0000 7f3a6a2c1a80 -1 shutting down 2024-09-12T00:25:00.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:25:00.124+0000 7f3944013640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65081, si_uid : 1000, si_addr0x3e80000fe39, si_status0 2024-09-12T00:25:30.319 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (30204 ms) 2024-09-12T00:25:30.319 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 19 tests from LibRGW (30847 ms total) 2024-09-12T00:25:30.319 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:25:30.319 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:25:30.319 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 19 tests from 1 test suite ran. (30847 ms total) 2024-09-12T00:25:30.320 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 19 tests. 2024-09-12T00:25:30.331 INFO:tasks.workunit.client.0.smithi102.stdout:phase 6.1 2024-09-12T00:25:30.353 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:25:30.354 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment set-up. 2024-09-12T00:25:30.354 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:25:30.354 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:25:30.362 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:30.363 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:30.959 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.INIT (605 ms) 2024-09-12T00:25:30.959 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:25:30.960 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:25:30.960 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:25:31.002 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CREATE_BUCKETS (42 ms) 2024-09-12T00:25:31.002 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:25:31.016 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (13 ms) 2024-09-12T00:25:31.016 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:25:31.056 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.TOPDIR_RENAME (41 ms) 2024-09-12T00:25:31.056 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:25:31.111 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SUBDIR_RENAME (54 ms) 2024-09-12T00:25:31.111 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:25:31.168 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (56 ms) 2024-09-12T00:25:31.168 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:25:31.168 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:25:31.168 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:25:31.168 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:25:31.168 INFO:tasks.workunit.client.0.smithi102.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:25:31.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:25:31.171+0000 7f0ad12aaa80 -1 shutting down 2024-09-12T00:25:31.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:25:31.175+0000 7f09aaffc640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65729, si_uid : 1000, si_addr0x3e8000100c1, si_status0 2024-09-12T00:26:00.987 INFO:tasks.workunit.client.0.smithi102.stdout:[ OK ] LibRGW.SHUTDOWN (29819 ms) 2024-09-12T00:26:00.987 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] 10 tests from LibRGW (30633 ms total) 2024-09-12T00:26:00.987 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:26:00.987 INFO:tasks.workunit.client.0.smithi102.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:00.987 INFO:tasks.workunit.client.0.smithi102.stdout:[==========] 10 tests from 1 test suite ran. (30633 ms total) 2024-09-12T00:26:00.988 INFO:tasks.workunit.client.0.smithi102.stdout:[ PASSED ] 10 tests. 2024-09-12T00:26:01.000 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:26:01.001 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:26:01.015 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:26:01.016 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:26:01.017 DEBUG:teuthology.orchestra.run.smithi102:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:26:01.069 INFO:tasks.workunit.client.0.smithi102.stderr:+ [ -z ] 2024-09-12T00:26:01.069 INFO:tasks.workunit.client.0.smithi102.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:26:01.069 INFO:tasks.workunit.client.0.smithi102.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:26:01.069 INFO:tasks.workunit.client.0.smithi102.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T00:26:01.110 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:01.110 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:01.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.159+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.163+0000 7fece06979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:01.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.163+0000 7fece06979c0 20 realm 2024-09-12T00:26:01.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.163+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.163+0000 7fece06979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:01.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.163+0000 7fece06979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:01.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.163+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.163+0000 7fece06979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:01.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.163+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.163+0000 7fece06979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:01.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.163+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.160 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.167+0000 7fece06979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:01.160 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.167+0000 7fece06979c0 20 searching for the correct realm 2024-09-12T00:26:01.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.171+0000 7fecde99e640 0 -- 172.21.15.102:0/3726395216 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fecc8089280 msgr2=0x7fecc809f0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:01.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.175+0000 7fecd7fff640 0 -- 172.21.15.102:0/3726395216 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fecd805c720 msgr2=0x7fecd805e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:01.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.391+0000 7fece06979c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:26:01.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.391+0000 7fece06979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:01.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.391+0000 7fece06979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:01.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.391+0000 7fece06979c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:26:01.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.391+0000 7fece06979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:01.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.391+0000 7fece06979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:01.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.391+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.391+0000 7fece06979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:01.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.391+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:01.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:01.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 zone default found 2024-09-12T00:26:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 4 Realm: () 2024-09-12T00:26:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:26:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:26:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 zonegroup default 2024-09-12T00:26:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:01.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:01.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:01.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 started sync module instance, tier type = 2024-09-12T00:26:01.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.395+0000 7fece06979c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:26:01.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.423+0000 7fece06979c0 20 add_watcher() i=0 2024-09-12T00:26:01.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.423+0000 7fece06979c0 20 add_watcher() i=1 2024-09-12T00:26:01.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.423+0000 7fece06979c0 20 add_watcher() i=2 2024-09-12T00:26:01.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.423+0000 7fece06979c0 20 add_watcher() i=3 2024-09-12T00:26:01.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.423+0000 7fece06979c0 20 add_watcher() i=4 2024-09-12T00:26:01.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.423+0000 7fece06979c0 20 add_watcher() i=5 2024-09-12T00:26:01.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.423+0000 7fece06979c0 20 add_watcher() i=6 2024-09-12T00:26:01.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.423+0000 7fece06979c0 20 add_watcher() i=7 2024-09-12T00:26:01.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.423+0000 7fece06979c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:01.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.427+0000 7feb94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:01.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.427+0000 7fece06979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:01.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.427+0000 7fece06979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:01.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.427+0000 7fece06979c0 5 note: GC not initialized 2024-09-12T00:26:01.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7feb0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:01.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 20 init_complete bucket index max shards: 11 2024-09-12T00:26:01.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 20 Filter name: none 2024-09-12T00:26:01.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7feb0d7fa640 20 reqs_thread_entry: start 2024-09-12T00:26:01.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:26:01.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:01.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:26:01.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:26:01.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:26:01.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:01.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:26:01.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:26:01.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:26:01.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:01.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:01.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:26:01.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:26:01.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:26:01.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.431+0000 7fece06979c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:26:01.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.435+0000 7fece06979c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:26:01.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.435+0000 7fece06979c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:26:01.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.435+0000 7fece06979c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:26:01.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.435+0000 7febc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758643 cookie 93993544198432 notifier 5474 bl.length()=677 2024-09-12T00:26:01.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.435+0000 7febc1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:26:01.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.435+0000 7febc1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:26:01.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.439+0000 7fece06979c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:26:01.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.439+0000 7fece06979c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:26:01.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.439+0000 7fece06979c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:26:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.439+0000 7febc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758601 cookie 93993544187440 notifier 5474 bl.length()=187 2024-09-12T00:26:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.439+0000 7febc1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:26:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.439+0000 7febc1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:26:01.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.443+0000 7fece06979c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:26:01.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.443+0000 7fece06979c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:26:01.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.443+0000 7fece06979c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:26:01.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.447+0000 7febc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758602 cookie 93993544187440 notifier 5474 bl.length()=197 2024-09-12T00:26:01.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.447+0000 7febc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:26:01.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.447+0000 7febc17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:26:01.443 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:26:01.443 INFO:tasks.workunit.client.0.smithi102.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:26:01.443 INFO:tasks.workunit.client.0.smithi102.stdout: "display_name": "maven test user", 2024-09-12T00:26:01.445 INFO:tasks.workunit.client.0.smithi102.stdout: "email": "sigv4@example.com", 2024-09-12T00:26:01.445 INFO:tasks.workunit.client.0.smithi102.stdout: "suspended": 0, 2024-09-12T00:26:01.445 INFO:tasks.workunit.client.0.smithi102.stdout: "max_buckets": 1000, 2024-09-12T00:26:01.445 INFO:tasks.workunit.client.0.smithi102.stdout: "subusers": [], 2024-09-12T00:26:01.445 INFO:tasks.workunit.client.0.smithi102.stdout: "keys": [ 2024-09-12T00:26:01.445 INFO:tasks.workunit.client.0.smithi102.stdout: { 2024-09-12T00:26:01.445 INFO:tasks.workunit.client.0.smithi102.stdout: "user": "ceph-test-maven", 2024-09-12T00:26:01.445 INFO:tasks.workunit.client.0.smithi102.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:26:01.445 INFO:tasks.workunit.client.0.smithi102.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "active": true, 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "create_date": "2024-09-12T00:26:01.436519Z" 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: ], 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "swift_keys": [], 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "caps": [], 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "default_placement": "", 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "default_storage_class": "", 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "placement_tags": [], 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_quota": { 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "enabled": false, 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:26:01.446 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size": -1, 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "max_objects": -1 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "user_quota": { 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "enabled": false, 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size": -1, 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "max_objects": -1 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "temp_url_keys": [], 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "type": "rgw", 2024-09-12T00:26:01.447 INFO:tasks.workunit.client.0.smithi102.stdout: "mfa_ids": [], 2024-09-12T00:26:01.448 INFO:tasks.workunit.client.0.smithi102.stdout: "account_id": "", 2024-09-12T00:26:01.448 INFO:tasks.workunit.client.0.smithi102.stdout: "path": "/", 2024-09-12T00:26:01.448 INFO:tasks.workunit.client.0.smithi102.stdout: "create_date": "2024-09-12T00:26:01.436489Z", 2024-09-12T00:26:01.448 INFO:tasks.workunit.client.0.smithi102.stdout: "tags": [], 2024-09-12T00:26:01.448 INFO:tasks.workunit.client.0.smithi102.stdout: "group_ids": [] 2024-09-12T00:26:01.448 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:26:01.448 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:26:01.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.451+0000 7feb94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:01.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.455+0000 7fece06979c0 20 remove_watcher() i=0 2024-09-12T00:26:01.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.455+0000 7fece06979c0 2 removed watcher, disabling cache 2024-09-12T00:26:01.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.455+0000 7fece06979c0 20 remove_watcher() i=1 2024-09-12T00:26:01.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.459+0000 7fece06979c0 20 remove_watcher() i=2 2024-09-12T00:26:01.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.463+0000 7fece06979c0 20 remove_watcher() i=3 2024-09-12T00:26:01.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.463+0000 7fece06979c0 20 remove_watcher() i=4 2024-09-12T00:26:01.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.467+0000 7fece06979c0 20 remove_watcher() i=5 2024-09-12T00:26:01.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.467+0000 7fece06979c0 20 remove_watcher() i=6 2024-09-12T00:26:01.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:26:01.471+0000 7fece06979c0 20 remove_watcher() i=7 2024-09-12T00:26:01.480 INFO:tasks.workunit.client.0.smithi102.stderr:+ [ -z ] 2024-09-12T00:26:01.481 INFO:tasks.workunit.client.0.smithi102.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T00:26:01.481 INFO:tasks.workunit.client.0.smithi102.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:26:01.481 INFO:tasks.workunit.client.0.smithi102.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi102.front.sepia.ceph.com:443 2024-09-12T00:26:01.481 INFO:tasks.workunit.client.0.smithi102.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T00:26:01.482 INFO:tasks.workunit.client.0.smithi102.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:26:01.482 INFO:tasks.workunit.client.0.smithi102.stderr:+ ./mvnw clean package 2024-09-12T00:26:01.488 INFO:tasks.workunit.client.0.smithi102.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:26:04.394 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Scanning for projects... 2024-09-12T00:26:04.536 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:26:04.646 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 49 kB/s) 2024-09-12T00:26:04.665 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:26:04.700 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.3 MB/s) 2024-09-12T00:26:04.719 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:26:04.740 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-12T00:26:04.772 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:04.772 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:26:04.772 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:26:04.772 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] from pom.xml 2024-09-12T00:26:04.772 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:26:04.776 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:26:04.829 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 98 kB/s) 2024-09-12T00:26:04.837 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:26:04.853 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 582 kB/s) 2024-09-12T00:26:04.858 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:26:04.874 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T00:26:04.882 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:26:04.900 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-12T00:26:04.914 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:26:04.931 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.0 MB/s) 2024-09-12T00:26:04.941 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:26:04.958 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 453 kB/s) 2024-09-12T00:26:04.961 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:26:04.977 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-12T00:26:04.980 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:26:04.998 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.7 MB/s) 2024-09-12T00:26:05.004 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:26:05.021 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.2 MB/s) 2024-09-12T00:26:05.030 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:26:05.050 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.5 MB/s) 2024-09-12T00:26:05.058 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:26:05.076 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 545 kB/s) 2024-09-12T00:26:05.086 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:26:05.110 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 2.6 MB/s) 2024-09-12T00:26:05.120 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:26:05.138 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 296 kB/s) 2024-09-12T00:26:05.142 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:26:05.160 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-09-12T00:26:05.166 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:26:05.186 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/50 kB Progress (1): 31/50 kB Progress (1): 48/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.5 MB/s) 2024-09-12T00:26:05.193 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:26:05.210 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.4 MB/s) 2024-09-12T00:26:05.220 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:26:05.236 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-09-12T00:26:05.243 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:26:05.262 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.3 MB/s) 2024-09-12T00:26:05.272 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:26:05.292 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 338 kB/s) 2024-09-12T00:26:05.297 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:26:05.319 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 431 kB/s) 2024-09-12T00:26:05.322 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:26:05.341 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.4 MB/s) 2024-09-12T00:26:05.346 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:26:05.364 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.2 MB/s) 2024-09-12T00:26:05.372 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:26:05.393 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.4 MB/s) 2024-09-12T00:26:05.418 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:26:05.435 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 358 kB/s) 2024-09-12T00:26:05.439 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:26:05.457 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.2 MB/s) 2024-09-12T00:26:05.466 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:26:05.485 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.0 MB/s) 2024-09-12T00:26:05.502 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:26:05.520 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-09-12T00:26:05.523 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:26:05.541 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 86 kB/s) 2024-09-12T00:26:05.546 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:26:05.562 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 124 kB/s) 2024-09-12T00:26:05.574 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:26:05.590 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 214 kB/s) 2024-09-12T00:26:05.599 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:26:05.616 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 190 kB/s) 2024-09-12T00:26:05.625 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:26:05.643 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 577 kB/s) 2024-09-12T00:26:05.653 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:26:05.670 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 99 kB/s) 2024-09-12T00:26:05.677 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:26:05.695 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 212 kB/s) 2024-09-12T00:26:05.704 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:26:05.721 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-09-12T00:26:05.728 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:26:05.744 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 68 kB/s) 2024-09-12T00:26:05.749 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:26:05.767 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 202 kB/s) 2024-09-12T00:26:05.770 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:26:05.788 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 767 kB/s) 2024-09-12T00:26:05.794 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:26:05.813 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 193 kB/s) 2024-09-12T00:26:05.823 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:26:05.841 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 136 kB/s) 2024-09-12T00:26:05.851 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:26:05.873 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 139 kB/s) 2024-09-12T00:26:05.882 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:26:05.907 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 309 kB/s) 2024-09-12T00:26:05.920 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:26:05.935 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 303 kB/s) 2024-09-12T00:26:05.943 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:26:05.960 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 205 kB/s) 2024-09-12T00:26:05.969 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:26:05.986 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 258 kB/s) 2024-09-12T00:26:05.990 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:26:06.006 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 150 kB/s) 2024-09-12T00:26:06.013 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:26:06.030 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 379 kB/s) 2024-09-12T00:26:06.038 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:26:06.059 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 289 kB/s) 2024-09-12T00:26:06.067 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:26:06.083 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-09-12T00:26:06.090 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:26:06.108 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-09-12T00:26:06.116 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:26:06.132 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-09-12T00:26:06.136 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:26:06.153 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-12T00:26:06.161 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:26:06.179 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 348 kB/s) 2024-09-12T00:26:06.183 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:26:06.200 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-09-12T00:26:06.204 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:26:06.221 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.0 MB/s) 2024-09-12T00:26:06.228 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:26:06.248 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 815 kB/s) 2024-09-12T00:26:06.255 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:26:06.271 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 310 kB/s) 2024-09-12T00:26:06.274 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:26:06.291 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-09-12T00:26:06.298 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:26:06.320 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 665 kB/s) 2024-09-12T00:26:06.325 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:26:06.346 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.2 MB/s) 2024-09-12T00:26:06.361 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:26:06.378 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 870 kB/s) 2024-09-12T00:26:06.387 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:26:06.405 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 858 kB/s) 2024-09-12T00:26:06.410 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:26:06.430 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-09-12T00:26:06.440 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:26:06.458 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.0 MB/s) 2024-09-12T00:26:06.467 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:26:06.486 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 998 kB/s) 2024-09-12T00:26:06.492 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:26:06.513 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 63/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.7 MB/s) 2024-09-12T00:26:06.527 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:26:06.549 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 174 kB/s) 2024-09-12T00:26:06.553 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:26:06.571 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 767 kB/s) 2024-09-12T00:26:06.578 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:26:06.596 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-09-12T00:26:06.601 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:26:06.618 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 187 kB/s) 2024-09-12T00:26:06.623 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:26:06.641 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 113 kB/s) 2024-09-12T00:26:06.645 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:26:06.663 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 157 kB/s) 2024-09-12T00:26:06.668 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:26:06.685 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-09-12T00:26:06.691 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:26:06.708 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-09-12T00:26:06.714 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:26:06.732 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-09-12T00:26:06.737 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:26:06.757 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 153 kB/s) 2024-09-12T00:26:06.764 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:26:06.782 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 54 kB/s) 2024-09-12T00:26:06.791 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:26:06.807 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 57 kB/s) 2024-09-12T00:26:06.814 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:26:06.832 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 170 kB/s) 2024-09-12T00:26:06.837 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:26:06.855 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 168 kB/s) 2024-09-12T00:26:06.860 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:26:06.878 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:26:06.883 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:26:06.901 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:26:06.906 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:26:06.928 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 138 kB/s) 2024-09-12T00:26:06.975 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:26:07.098 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 27 MB/s) 2024-09-12T00:26:07.101 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:26:07.101 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:26:07.101 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:26:07.102 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:26:07.102 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:26:07.128 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 2.5 MB/s) 2024-09-12T00:26:07.129 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:26:07.145 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 382 kB/s) 2024-09-12T00:26:07.145 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:26:07.154 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (1): 8.3/16 kB Progress (1): 9.7/16 kB Progress (1): 11/16 kB Progress (1): 12/16 kB Progress (1): 14/16 kB Progress (1): 15/16 kB Progress (1): 16 kB Progress (2): 16 kB | 1.4/35 kB Progress (2): 16 kB | 2.8/35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 310 kB/s) 2024-09-12T00:26:07.154 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.1/35 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:26:07.158 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.5/35 kB Progress (1): 6.9/35 kB Progress (1): 8.3/35 kB Progress (1): 9.7/35 kB Progress (1): 11/35 kB Progress (1): 12/35 kB Progress (1): 14/35 kB Progress (1): 15/35 kB Progress (1): 16/35 kB Progress (1): 17/35 kB Progress (2): 17/35 kB | 1.4/49 kB Progress (2): 19/35 kB | 1.4/49 kB Progress (2): 19/35 kB | 2.8/49 kB Progress (2): 20/35 kB | 2.8/49 kB Progress (2): 20/35 kB | 4.1/49 kB Progress (2): 21/35 kB | 4.1/49 kB Progress (2): 21/35 kB | 5.5/49 kB Progress (2): 23/35 kB | 5.5/49 kB Progress (2): 23/35 kB | 6.9/49 kB Progress (2): 23/35 kB | 8.3/49 kB Progress (2): 23/35 kB | 9.7/49 kB Progress (2): 23/35 kB | 11/49 kB Progress (2): 23/35 kB | 12/49 kB Progress (2): 23/35 kB | 14/49 kB Progress (2): 23/35 kB | 15/49 kB Progress (2): 24/35 kB | 15/49 kB Progress (2): 24/35 kB | 17/49 kB Progress (2): 24/35 kB | 18/49 kB Progress (2): 25/35 kB | 18/49 kB Progress (2): 25/35 kB | 19/49 kB Progress (2): 27/35 kB | 19/49 kB Progress (2): 28/35 kB | 19/49 kB Progress (2): 28/35 kB | 21/49 kB Progress (2): 30/35 kB | 21/49 kB Progress (2): 30/35 kB | 22/49 kB Progress (2): 31/35 kB | 22/49 kB Progress (2): 31/35 kB | 23/49 kB Progress (2): 32/35 kB | 23/49 kB Progress (2): 32/35 kB | 25/49 kB Progress (2): 34/35 kB | 25/49 kB Progress (2): 34/35 kB | 26/49 kB Progress (2): 35/35 kB | 26/49 kB Progress (2): 35/35 kB | 28/49 kB Progress (2): 35 kB | 28/49 kB Progress (2): 35 kB | 29/49 kB Progress (2): 35 kB | 30/49 kB Progress (2): 35 kB | 32/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 606 kB/s) 2024-09-12T00:26:07.158 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:26:07.167 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 33/49 kB Progress (1): 34/49 kB Progress (1): 36/49 kB Progress (1): 37/49 kB Progress (1): 39/49 kB Progress (2): 39/49 kB | 16/782 kB Progress (2): 39/49 kB | 33/782 kB Progress (2): 39/49 kB | 49/782 kB Progress (2): 39/49 kB | 66/782 kB Progress (2): 39/49 kB | 82/782 kB Progress (2): 39/49 kB | 98/782 kB Progress (2): 39/49 kB | 115/782 kB Progress (2): 39/49 kB | 131/782 kB Progress (2): 39/49 kB | 147/782 kB Progress (2): 39/49 kB | 164/782 kB Progress (2): 39/49 kB | 180/782 kB Progress (2): 39/49 kB | 197/782 kB Progress (2): 39/49 kB | 213/782 kB Progress (2): 39/49 kB | 229/782 kB Progress (2): 39/49 kB | 246/782 kB Progress (2): 39/49 kB | 262/782 kB Progress (2): 39/49 kB | 278/782 kB Progress (2): 39/49 kB | 295/782 kB Progress (2): 39/49 kB | 299/782 kB Progress (2): 40/49 kB | 299/782 kB Progress (2): 40/49 kB | 315/782 kB Progress (2): 41/49 kB | 315/782 kB Progress (2): 43/49 kB | 315/782 kB Progress (2): 44/49 kB | 315/782 kB Progress (2): 44/49 kB | 328/782 kB Progress (2): 46/49 kB | 328/782 kB Progress (2): 47/49 kB | 328/782 kB Progress (2): 48/49 kB | 328/782 kB Progress (2): 48/49 kB | 344/782 kB Progress (2): 49 kB | 344/782 kB Progress (2): 49 kB | 360/782 kB Progress (2): 49 kB | 377/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 746 kB/s) 2024-09-12T00:26:07.167 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:26:07.171 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 393/782 kB Progress (1): 410/782 kB Progress (1): 426/782 kB Progress (1): 442/782 kB Progress (1): 459/782 kB Progress (1): 475/782 kB Progress (1): 491/782 kB Progress (1): 508/782 kB Progress (1): 524/782 kB Progress (1): 541/782 kB Progress (2): 541/782 kB | 1.4/11 kB Progress (2): 541/782 kB | 2.8/11 kB Progress (2): 557/782 kB | 2.8/11 kB Progress (2): 557/782 kB | 4.1/11 kB Progress (2): 557/782 kB | 5.5/11 kB Progress (2): 573/782 kB | 5.5/11 kB Progress (2): 573/782 kB | 6.9/11 kB Progress (2): 573/782 kB | 8.3/11 kB Progress (2): 590/782 kB | 8.3/11 kB Progress (2): 590/782 kB | 9.7/11 kB Progress (2): 590/782 kB | 11/11 kB Progress (2): 590/782 kB | 11 kB Progress (2): 606/782 kB | 11 kB Progress (2): 623/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 165 kB/s) 2024-09-12T00:26:07.171 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:26:07.174 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 639/782 kB Progress (1): 655/782 kB Progress (1): 672/782 kB Progress (1): 688/782 kB Progress (1): 704/782 kB Progress (1): 721/782 kB Progress (1): 737/782 kB Progress (1): 754/782 kB Progress (2): 754/782 kB | 1.4/205 kB Progress (2): 770/782 kB | 1.4/205 kB Progress (2): 770/782 kB | 2.8/205 kB Progress (2): 770/782 kB | 4.1/205 kB Progress (2): 782 kB | 4.1/205 kB Progress (2): 782 kB | 5.5/205 kB Progress (2): 782 kB | 6.9/205 kB Progress (2): 782 kB | 8.3/205 kB Progress (2): 782 kB | 9.7/205 kB Progress (2): 782 kB | 11/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-09-12T00:26:07.174 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 12/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:26:07.185 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 14/205 kB Progress (1): 15/205 kB Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (2): 49/205 kB | 1.4/30 kB Progress (2): 49/205 kB | 2.8/30 kB Progress (2): 49/205 kB | 4.1/30 kB Progress (2): 49/205 kB | 5.5/30 kB Progress (2): 49/205 kB | 6.9/30 kB Progress (2): 49/205 kB | 8.3/30 kB Progress (2): 49/205 kB | 9.7/30 kB Progress (2): 49/205 kB | 11/30 kB Progress (2): 49/205 kB | 12/30 kB Progress (2): 49/205 kB | 14/30 kB Progress (2): 49/205 kB | 15/30 kB Progress (2): 49/205 kB | 30 kB Progress (2): 64/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 364 kB/s) 2024-09-12T00:26:07.185 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:26:07.197 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 80/205 kB Progress (1): 97/205 kB Progress (1): 113/205 kB Progress (1): 129/205 kB Progress (1): 146/205 kB Progress (1): 162/205 kB Progress (1): 179/205 kB Progress (2): 179/205 kB | 1.4/81 kB Progress (2): 179/205 kB | 2.8/81 kB Progress (2): 179/205 kB | 4.1/81 kB Progress (2): 179/205 kB | 5.5/81 kB Progress (2): 179/205 kB | 6.9/81 kB Progress (2): 179/205 kB | 8.3/81 kB Progress (2): 179/205 kB | 9.7/81 kB Progress (2): 195/205 kB | 9.7/81 kB Progress (2): 205 kB | 9.7/81 kB Progress (2): 205 kB | 11/81 kB Progress (2): 205 kB | 12/81 kB Progress (2): 205 kB | 14/81 kB Progress (2): 205 kB | 15/81 kB Progress (2): 205 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.2 MB/s) 2024-09-12T00:26:07.197 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:26:07.204 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 33/81 kB Progress (2): 33/81 kB | 13 kB Progress (3): 33/81 kB | 13 kB | 16/798 kB Progress (3): 33/81 kB | 13 kB | 33/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 131 kB/s) 2024-09-12T00:26:07.204 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:26:07.213 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 33/81 kB | 49/798 kB Progress (2): 33/81 kB | 66/798 kB Progress (2): 33/81 kB | 82/798 kB Progress (2): 33/81 kB | 98/798 kB Progress (2): 33/81 kB | 115/798 kB Progress (2): 33/81 kB | 131/798 kB Progress (2): 33/81 kB | 147/798 kB Progress (2): 33/81 kB | 164/798 kB Progress (2): 49/81 kB | 164/798 kB Progress (2): 49/81 kB | 180/798 kB Progress (2): 49/81 kB | 197/798 kB Progress (2): 49/81 kB | 213/798 kB Progress (2): 49/81 kB | 229/798 kB Progress (2): 66/81 kB | 229/798 kB Progress (2): 66/81 kB | 246/798 kB Progress (2): 66/81 kB | 262/798 kB Progress (2): 66/81 kB | 279/798 kB Progress (2): 66/81 kB | 295/798 kB Progress (2): 66/81 kB | 311/798 kB Progress (2): 80/81 kB | 311/798 kB Progress (2): 81 kB | 311/798 kB Progress (2): 81 kB | 328/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 752 kB/s) 2024-09-12T00:26:07.213 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:26:07.220 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 328/798 kB | 1.4/98 kB Progress (2): 328/798 kB | 2.8/98 kB Progress (2): 328/798 kB | 4.1/98 kB Progress (2): 328/798 kB | 5.5/98 kB Progress (2): 328/798 kB | 6.9/98 kB Progress (2): 328/798 kB | 8.3/98 kB Progress (2): 328/798 kB | 9.7/98 kB Progress (2): 328/798 kB | 11/98 kB Progress (2): 328/798 kB | 12/98 kB Progress (2): 328/798 kB | 14/98 kB Progress (2): 328/798 kB | 15/98 kB Progress (2): 328/798 kB | 16/98 kB Progress (3): 328/798 kB | 16/98 kB | 16/182 kB Progress (3): 328/798 kB | 16/98 kB | 33/182 kB Progress (3): 328/798 kB | 16/98 kB | 49/182 kB Progress (3): 328/798 kB | 16/98 kB | 62/182 kB Progress (3): 328/798 kB | 32/98 kB | 62/182 kB Progress (3): 328/798 kB | 32/98 kB | 78/182 kB Progress (3): 328/798 kB | 32/98 kB | 94/182 kB Progress (3): 328/798 kB | 32/98 kB | 111/182 kB Progress (3): 328/798 kB | 32/98 kB | 127/182 kB Progress (3): 328/798 kB | 32/98 kB | 143/182 kB Progress (3): 328/798 kB | 32/98 kB | 160/182 kB Progress (3): 328/798 kB | 32/98 kB | 176/182 kB Progress (3): 328/798 kB | 32/98 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-12T00:26:07.220 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:26:07.228 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (3): 328/798 kB | 32/98 kB | 16/151 kB Progress (3): 344/798 kB | 32/98 kB | 16/151 kB Progress (3): 344/798 kB | 32/98 kB | 33/151 kB Progress (3): 360/798 kB | 32/98 kB | 33/151 kB Progress (3): 377/798 kB | 32/98 kB | 33/151 kB Progress (3): 393/798 kB | 32/98 kB | 33/151 kB Progress (3): 393/798 kB | 32/98 kB | 49/151 kB Progress (3): 393/798 kB | 32/98 kB | 62/151 kB Progress (3): 410/798 kB | 32/98 kB | 62/151 kB Progress (3): 410/798 kB | 32/98 kB | 79/151 kB Progress (3): 410/798 kB | 49/98 kB | 79/151 kB Progress (3): 426/798 kB | 49/98 kB | 79/151 kB Progress (3): 442/798 kB | 49/98 kB | 79/151 kB Progress (3): 459/798 kB | 49/98 kB | 79/151 kB Progress (3): 475/798 kB | 49/98 kB | 79/151 kB Progress (3): 492/798 kB | 49/98 kB | 79/151 kB Progress (3): 492/798 kB | 65/98 kB | 79/151 kB Progress (3): 508/798 kB | 65/98 kB | 79/151 kB Progress (3): 524/798 kB | 65/98 kB | 79/151 kB Progress (4): 524/798 kB | 65/98 kB | 79/151 kB | 16/27 kB Progress (4): 524/798 kB | 65/98 kB | 79/151 kB | 27 kB Progress (4): 524/798 kB | 81/98 kB | 79/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 220 kB/s) 2024-09-12T00:26:07.228 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:26:07.231 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (3): 524/798 kB | 98/98 kB | 79/151 kB Progress (3): 524/798 kB | 98 kB | 79/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 738 kB/s) 2024-09-12T00:26:07.231 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:26:07.235 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 524/798 kB | 95/151 kB Progress (2): 541/798 kB | 95/151 kB Progress (2): 557/798 kB | 95/151 kB Progress (2): 557/798 kB | 111/151 kB Progress (2): 573/798 kB | 111/151 kB Progress (2): 573/798 kB | 128/151 kB Progress (2): 590/798 kB | 128/151 kB Progress (2): 590/798 kB | 144/151 kB Progress (2): 590/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T00:26:07.235 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:26:07.238 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 606/798 kB Progress (1): 623/798 kB Progress (1): 639/798 kB Progress (1): 655/798 kB Progress (2): 655/798 kB | 15/30 kB Progress (2): 672/798 kB | 15/30 kB Progress (2): 688/798 kB | 15/30 kB Progress (2): 688/798 kB | 30 kB Progress (2): 705/798 kB | 30 kB Progress (2): 721/798 kB | 30 kB Progress (2): 737/798 kB | 30 kB Progress (2): 754/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 224 kB/s) 2024-09-12T00:26:07.238 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:26:07.245 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 770/798 kB Progress (1): 786/798 kB Progress (1): 798 kB Progress (2): 798 kB | 16/385 kB Progress (2): 798 kB | 32/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.6 MB/s) 2024-09-12T00:26:07.245 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:26:07.252 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 49/385 kB Progress (1): 65/385 kB Progress (1): 81/385 kB Progress (1): 98/385 kB Progress (1): 114/385 kB Progress (2): 114/385 kB | 16/75 kB Progress (2): 114/385 kB | 33/75 kB Progress (3): 114/385 kB | 33/75 kB | 13 kB Progress (3): 114/385 kB | 49/75 kB | 13 kB Progress (3): 114/385 kB | 61/75 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 89 kB/s) 2024-09-12T00:26:07.252 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 114/385 kB | 75 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:26:07.253 INFO:tasks.workunit.client.0.smithi102.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 504 kB/s) 2024-09-12T00:26:07.253 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:26:07.268 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 130/385 kB Progress (1): 147/385 kB Progress (1): 163/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (1): 212/385 kB Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (1): 262/385 kB Progress (1): 278/385 kB Progress (1): 294/385 kB Progress (1): 311/385 kB Progress (1): 327/385 kB Progress (1): 343/385 kB Progress (1): 360/385 kB Progress (1): 376/385 kB Progress (1): 385 kB Progress (2): 385 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.3 MB/s) 2024-09-12T00:26:07.268 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 32/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:26:07.276 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 49/501 kB Progress (1): 65/501 kB Progress (1): 79/501 kB Progress (1): 96/501 kB Progress (1): 112/501 kB Progress (2): 112/501 kB | 16/329 kB Progress (2): 112/501 kB | 32/329 kB Progress (2): 128/501 kB | 32/329 kB Progress (2): 128/501 kB | 49/329 kB Progress (2): 145/501 kB | 49/329 kB Progress (2): 145/501 kB | 65/329 kB Progress (2): 145/501 kB | 81/329 kB Progress (2): 161/501 kB | 81/329 kB Progress (2): 161/501 kB | 98/329 kB Progress (2): 177/501 kB | 98/329 kB Progress (2): 177/501 kB | 114/329 kB Progress (2): 177/501 kB | 130/329 kB Progress (2): 194/501 kB | 130/329 kB Progress (2): 194/501 kB | 147/329 kB Progress (2): 210/501 kB | 147/329 kB Progress (2): 210/501 kB | 163/329 kB Progress (2): 227/501 kB | 163/329 kB Progress (2): 227/501 kB | 180/329 kB Progress (2): 227/501 kB | 196/329 kB Progress (2): 243/501 kB | 196/329 kB Progress (2): 243/501 kB | 208/329 kB Progress (2): 243/501 kB | 224/329 kB Progress (2): 243/501 kB | 240/329 kB Progress (2): 243/501 kB | 257/329 kB Progress (2): 243/501 kB | 273/329 kB Progress (2): 243/501 kB | 277/329 kB Progress (2): 243/501 kB | 294/329 kB Progress (2): 243/501 kB | 310/329 kB Progress (2): 243/501 kB | 326/329 kB Progress (2): 243/501 kB | 329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.9 MB/s) 2024-09-12T00:26:07.276 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:26:07.285 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 259/501 kB Progress (1): 276/501 kB Progress (1): 292/501 kB Progress (1): 309/501 kB Progress (1): 325/501 kB Progress (1): 341/501 kB Progress (1): 358/501 kB Progress (1): 374/501 kB Progress (1): 390/501 kB Progress (1): 407/501 kB Progress (1): 423/501 kB Progress (1): 440/501 kB Progress (1): 456/501 kB Progress (1): 472/501 kB Progress (1): 489/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-09-12T00:26:07.285 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:26:07.288 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/41 kB Progress (1): 33/41 kB Progress (1): 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 223 kB/s) 2024-09-12T00:26:07.288 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:26:07.298 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/780 kB Progress (1): 31/780 kB Progress (1): 48/780 kB Progress (1): 64/780 kB Progress (1): 81/780 kB Progress (1): 97/780 kB Progress (1): 113/780 kB Progress (1): 130/780 kB Progress (1): 144/780 kB Progress (1): 160/780 kB Progress (1): 176/780 kB Progress (1): 193/780 kB Progress (1): 209/780 kB Progress (1): 225/780 kB Progress (1): 242/780 kB Progress (1): 258/780 kB Progress (1): 275/780 kB Progress (1): 291/780 kB Progress (1): 307/780 kB Progress (1): 324/780 kB Progress (2): 324/780 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 33 kB/s) 2024-09-12T00:26:07.298 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:26:07.310 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 340/780 kB Progress (1): 356/780 kB Progress (2): 356/780 kB | 16/586 kB Progress (2): 373/780 kB | 16/586 kB Progress (2): 373/780 kB | 33/586 kB Progress (2): 389/780 kB | 33/586 kB Progress (2): 406/780 kB | 33/586 kB Progress (2): 406/780 kB | 49/586 kB Progress (2): 422/780 kB | 49/586 kB Progress (2): 422/780 kB | 62/586 kB Progress (2): 438/780 kB | 62/586 kB Progress (2): 438/780 kB | 78/586 kB Progress (2): 455/780 kB | 78/586 kB Progress (3): 455/780 kB | 78/586 kB | 16/211 kB Progress (3): 471/780 kB | 78/586 kB | 16/211 kB Progress (3): 471/780 kB | 78/586 kB | 32/211 kB Progress (3): 471/780 kB | 95/586 kB | 32/211 kB Progress (3): 471/780 kB | 95/586 kB | 49/211 kB Progress (3): 488/780 kB | 95/586 kB | 49/211 kB Progress (3): 488/780 kB | 111/586 kB | 49/211 kB Progress (3): 488/780 kB | 111/586 kB | 65/211 kB Progress (3): 504/780 kB | 111/586 kB | 65/211 kB Progress (3): 504/780 kB | 111/586 kB | 81/211 kB Progress (3): 504/780 kB | 127/586 kB | 81/211 kB Progress (3): 520/780 kB | 127/586 kB | 81/211 kB Progress (3): 520/780 kB | 127/586 kB | 98/211 kB Progress (3): 520/780 kB | 144/586 kB | 98/211 kB Progress (3): 520/780 kB | 144/586 kB | 114/211 kB Progress (3): 537/780 kB | 144/586 kB | 114/211 kB Progress (3): 537/780 kB | 144/586 kB | 130/211 kB Progress (3): 537/780 kB | 160/586 kB | 130/211 kB Progress (3): 553/780 kB | 160/586 kB | 130/211 kB Progress (3): 553/780 kB | 160/586 kB | 147/211 kB Progress (3): 553/780 kB | 176/586 kB | 147/211 kB Progress (3): 553/780 kB | 176/586 kB | 163/211 kB Progress (3): 569/780 kB | 176/586 kB | 163/211 kB Progress (3): 569/780 kB | 176/586 kB | 180/211 kB Progress (3): 569/780 kB | 193/586 kB | 180/211 kB Progress (3): 586/780 kB | 193/586 kB | 180/211 kB Progress (3): 586/780 kB | 193/586 kB | 196/211 kB Progress (3): 586/780 kB | 209/586 kB | 196/211 kB Progress (4): 586/780 kB | 209/586 kB | 196/211 kB | 16/354 kB Progress (4): 602/780 kB | 209/586 kB | 196/211 kB | 16/354 kB Progress (4): 602/780 kB | 209/586 kB | 211 kB | 16/354 kB Progress (4): 602/780 kB | 226/586 kB | 211 kB | 16/354 kB Progress (4): 619/780 kB | 226/586 kB | 211 kB | 16/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.0 MB/s) 2024-09-12T00:26:07.310 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (3): 619/780 kB | 242/586 kB | 16/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:26:07.311 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (3): 635/780 kB | 242/586 kB | 16/354 kB Progress (4): 635/780 kB | 242/586 kB | 16/354 kB | 14 kB Progress (4): 635/780 kB | 258/586 kB | 16/354 kB | 14 kB Progress (4): 651/780 kB | 258/586 kB | 16/354 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 69 kB/s) 2024-09-12T00:26:07.311 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (3): 651/780 kB | 275/586 kB | 16/354 kB Progress (3): 668/780 kB | 275/586 kB | 16/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:26:07.338 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (3): 668/780 kB | 291/586 kB | 16/354 kB Progress (3): 684/780 kB | 291/586 kB | 16/354 kB Progress (3): 684/780 kB | 291/586 kB | 32/354 kB Progress (3): 701/780 kB | 291/586 kB | 32/354 kB Progress (3): 701/780 kB | 308/586 kB | 32/354 kB Progress (4): 701/780 kB | 308/586 kB | 32/354 kB | 15/106 kB Progress (4): 701/780 kB | 308/586 kB | 49/354 kB | 15/106 kB Progress (4): 701/780 kB | 324/586 kB | 49/354 kB | 15/106 kB Progress (4): 717/780 kB | 324/586 kB | 49/354 kB | 15/106 kB Progress (4): 717/780 kB | 324/586 kB | 49/354 kB | 31/106 kB Progress (4): 717/780 kB | 324/586 kB | 65/354 kB | 31/106 kB Progress (4): 717/780 kB | 340/586 kB | 65/354 kB | 31/106 kB Progress (4): 733/780 kB | 340/586 kB | 65/354 kB | 31/106 kB Progress (4): 733/780 kB | 340/586 kB | 65/354 kB | 48/106 kB Progress (4): 733/780 kB | 340/586 kB | 81/354 kB | 48/106 kB Progress (4): 733/780 kB | 357/586 kB | 81/354 kB | 48/106 kB Progress (4): 733/780 kB | 357/586 kB | 81/354 kB | 64/106 kB Progress (4): 750/780 kB | 357/586 kB | 81/354 kB | 64/106 kB Progress (4): 750/780 kB | 357/586 kB | 98/354 kB | 64/106 kB Progress (4): 750/780 kB | 373/586 kB | 98/354 kB | 64/106 kB Progress (4): 750/780 kB | 373/586 kB | 98/354 kB | 81/106 kB Progress (4): 766/780 kB | 373/586 kB | 98/354 kB | 81/106 kB Progress (4): 766/780 kB | 373/586 kB | 114/354 kB | 81/106 kB Progress (4): 766/780 kB | 389/586 kB | 114/354 kB | 81/106 kB Progress (4): 766/780 kB | 389/586 kB | 114/354 kB | 94/106 kB Progress (4): 780 kB | 389/586 kB | 114/354 kB | 94/106 kB Progress (4): 780 kB | 389/586 kB | 130/354 kB | 94/106 kB Progress (4): 780 kB | 406/586 kB | 130/354 kB | 94/106 kB Progress (4): 780 kB | 406/586 kB | 130/354 kB | 106 kB Progress (4): 780 kB | 406/586 kB | 147/354 kB | 106 kB Progress (4): 780 kB | 422/586 kB | 147/354 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 3.3 MB/s) 2024-09-12T00:26:07.338 INFO:tasks.workunit.client.0.smithi102.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 458 kB/s) 2024-09-12T00:26:07.338 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 439/586 kB | 147/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:26:07.338 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:26:07.342 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 455/586 kB | 147/354 kB Progress (2): 471/586 kB | 147/354 kB Progress (2): 488/586 kB | 147/354 kB Progress (2): 504/586 kB | 147/354 kB Progress (2): 521/586 kB | 147/354 kB Progress (2): 537/586 kB | 147/354 kB Progress (2): 553/586 kB | 147/354 kB Progress (2): 570/586 kB | 147/354 kB Progress (2): 586 kB | 147/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.5 MB/s) 2024-09-12T00:26:07.342 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:26:07.349 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 147/354 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 28 kB/s) 2024-09-12T00:26:07.349 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:26:07.363 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 147/354 kB | 15/245 kB Progress (2): 163/354 kB | 15/245 kB Progress (2): 163/354 kB | 31/245 kB Progress (2): 180/354 kB | 31/245 kB Progress (2): 180/354 kB | 48/245 kB Progress (2): 196/354 kB | 48/245 kB Progress (2): 196/354 kB | 64/245 kB Progress (2): 212/354 kB | 64/245 kB Progress (2): 212/354 kB | 81/245 kB Progress (2): 212/354 kB | 95/245 kB Progress (2): 212/354 kB | 112/245 kB Progress (2): 212/354 kB | 128/245 kB Progress (3): 212/354 kB | 128/245 kB | 15/205 kB Progress (3): 212/354 kB | 145/245 kB | 15/205 kB Progress (3): 212/354 kB | 145/245 kB | 31/205 kB Progress (3): 229/354 kB | 145/245 kB | 31/205 kB Progress (3): 229/354 kB | 145/245 kB | 48/205 kB Progress (3): 229/354 kB | 161/245 kB | 48/205 kB Progress (3): 245/354 kB | 161/245 kB | 48/205 kB Progress (3): 245/354 kB | 161/245 kB | 64/205 kB Progress (3): 245/354 kB | 177/245 kB | 64/205 kB Progress (3): 245/354 kB | 177/245 kB | 81/205 kB Progress (4): 245/354 kB | 177/245 kB | 81/205 kB | 15 kB Progress (4): 262/354 kB | 177/245 kB | 81/205 kB | 15 kB Progress (4): 262/354 kB | 194/245 kB | 81/205 kB | 15 kB Progress (4): 262/354 kB | 194/245 kB | 97/205 kB | 15 kB Progress (4): 278/354 kB | 194/245 kB | 97/205 kB | 15 kB Progress (4): 278/354 kB | 194/245 kB | 113/205 kB | 15 kB Progress (4): 278/354 kB | 210/245 kB | 113/205 kB | 15 kB Progress (4): 294/354 kB | 210/245 kB | 113/205 kB | 15 kB Progress (4): 294/354 kB | 210/245 kB | 130/205 kB | 15 kB Progress (4): 294/354 kB | 226/245 kB | 130/205 kB | 15 kB Progress (4): 311/354 kB | 226/245 kB | 130/205 kB | 15 kB Progress (4): 311/354 kB | 226/245 kB | 146/205 kB | 15 kB Progress (4): 311/354 kB | 243/245 kB | 146/205 kB | 15 kB Progress (4): 327/354 kB | 243/245 kB | 146/205 kB | 15 kB Progress (4): 327/354 kB | 245 kB | 146/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 60 kB/s) 2024-09-12T00:26:07.363 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (3): 327/354 kB | 245 kB | 162/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:26:07.363 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (3): 343/354 kB | 245 kB | 162/205 kB Progress (3): 343/354 kB | 245 kB | 179/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 960 kB/s) 2024-09-12T00:26:07.363 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:26:07.363 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 343/354 kB | 195/205 kB Progress (2): 343/354 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 800 kB/s) 2024-09-12T00:26:07.364 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:26:07.369 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 343/354 kB | 16/16 kB Progress (2): 343/354 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 63 kB/s) 2024-09-12T00:26:07.369 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:26:07.373 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.3 MB/s) 2024-09-12T00:26:07.373 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:26:07.375 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 24 kB/s) 2024-09-12T00:26:07.378 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/24 kB Progress (2): 16/24 kB | 16/23 kB Progress (2): 24 kB | 16/23 kB Progress (2): 24 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 88 kB/s) 2024-09-12T00:26:07.378 INFO:tasks.workunit.client.0.smithi102.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 83 kB/s) 2024-09-12T00:26:07.381 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 63 kB/s) 2024-09-12T00:26:07.446 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/184 kB Progress (1): 32/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 539 kB/s) 2024-09-12T00:26:07.490 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:07.490 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:26:07.501 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:26:07.525 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 243 kB/s) 2024-09-12T00:26:07.527 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:26:07.565 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 134 kB/s) 2024-09-12T00:26:07.567 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:26:07.598 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 1.4 MB/s) 2024-09-12T00:26:07.607 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:26:07.627 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 679 kB/s) 2024-09-12T00:26:07.638 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:26:07.661 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/153 kB Progress (1): 31/153 kB Progress (1): 48/153 kB Progress (1): 64/153 kB Progress (1): 80/153 kB Progress (1): 96/153 kB Progress (1): 112/153 kB Progress (1): 129/153 kB Progress (1): 145/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 6.7 MB/s) 2024-09-12T00:26:07.661 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:26:07.686 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/215 kB Progress (1): 31/215 kB Progress (1): 48/215 kB Progress (1): 64/215 kB Progress (1): 81/215 kB Progress (1): 97/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 8.6 MB/s) 2024-09-12T00:26:07.791 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:07.791 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:26:07.798 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:26:07.819 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 126 kB/s) 2024-09-12T00:26:07.822 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:26:07.840 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-09-12T00:26:07.846 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:26:07.870 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 351 kB/s) 2024-09-12T00:26:07.874 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:26:07.897 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.1 MB/s) 2024-09-12T00:26:07.902 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:26:07.953 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 121 kB/s) 2024-09-12T00:26:07.956 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:26:07.983 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 119 kB/s) 2024-09-12T00:26:07.990 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:26:08.011 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 28 kB/s) 2024-09-12T00:26:08.015 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:26:08.031 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 171 kB/s) 2024-09-12T00:26:08.034 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:26:08.054 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 705 kB/s) 2024-09-12T00:26:08.060 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:26:08.083 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 139 kB/s) 2024-09-12T00:26:08.086 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:26:08.111 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 334 kB/s) 2024-09-12T00:26:08.114 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:26:08.131 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 492 kB/s) 2024-09-12T00:26:08.136 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:26:08.157 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 382 kB/s) 2024-09-12T00:26:08.163 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:26:08.181 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.1 MB/s) 2024-09-12T00:26:08.191 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:26:08.207 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 300 kB/s) 2024-09-12T00:26:08.211 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:26:08.235 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.3 MB/s) 2024-09-12T00:26:08.249 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:26:08.271 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 232 kB/s) 2024-09-12T00:26:08.285 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:26:08.311 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/85 kB Progress (1): 31/85 kB Progress (1): 48/85 kB Progress (1): 64/85 kB Progress (1): 79/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 3.2 MB/s) 2024-09-12T00:26:08.312 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:26:08.312 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:26:08.312 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:26:08.313 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:26:08.313 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:26:08.329 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/41 kB Progress (1): 32/41 kB Progress (1): 41 kB Progress (2): 41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-09-12T00:26:08.329 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:26:08.330 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 8.5 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 499 kB/s) 2024-09-12T00:26:08.330 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:26:08.331 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 33/55 kB Progress (1): 49/55 kB Progress (1): 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.9 MB/s) 2024-09-12T00:26:08.332 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/269 kB Progress (2): 16/269 kB | 2.5 kB Progress (2): 32/269 kB | 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 125 kB/s) 2024-09-12T00:26:08.341 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 49/269 kB Progress (1): 65/269 kB Progress (1): 81/269 kB Progress (1): 98/269 kB Progress (1): 114/269 kB Progress (1): 130/269 kB Progress (1): 147/269 kB Progress (1): 163/269 kB Progress (1): 180/269 kB Progress (1): 196/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 9.0 MB/s) 2024-09-12T00:26:08.355 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/327 kB Progress (1): 32/327 kB Progress (1): 49/327 kB Progress (1): 65/327 kB Progress (1): 81/327 kB Progress (2): 81/327 kB | 16/587 kB Progress (2): 98/327 kB | 16/587 kB Progress (2): 98/327 kB | 32/587 kB Progress (2): 114/327 kB | 32/587 kB Progress (2): 114/327 kB | 49/587 kB Progress (2): 130/327 kB | 49/587 kB Progress (2): 130/327 kB | 65/587 kB Progress (2): 147/327 kB | 65/587 kB Progress (2): 147/327 kB | 81/587 kB Progress (2): 163/327 kB | 81/587 kB Progress (2): 163/327 kB | 98/587 kB Progress (2): 180/327 kB | 98/587 kB Progress (2): 180/327 kB | 114/587 kB Progress (2): 196/327 kB | 114/587 kB Progress (2): 196/327 kB | 130/587 kB Progress (2): 212/327 kB | 130/587 kB Progress (2): 212/327 kB | 147/587 kB Progress (2): 229/327 kB | 147/587 kB Progress (2): 229/327 kB | 163/587 kB Progress (2): 245/327 kB | 163/587 kB Progress (2): 245/327 kB | 180/587 kB Progress (2): 262/327 kB | 180/587 kB Progress (2): 262/327 kB | 196/587 kB Progress (2): 278/327 kB | 196/587 kB Progress (2): 278/327 kB | 212/587 kB Progress (2): 294/327 kB | 212/587 kB Progress (2): 294/327 kB | 229/587 kB Progress (2): 311/327 kB | 229/587 kB Progress (2): 311/327 kB | 245/587 kB Progress (2): 327/327 kB | 245/587 kB Progress (2): 327 kB | 245/587 kB Progress (2): 327 kB | 262/587 kB Progress (2): 327 kB | 278/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 7.8 MB/s) 2024-09-12T00:26:08.362 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 294/587 kB Progress (1): 311/587 kB Progress (1): 327/587 kB Progress (1): 343/587 kB Progress (1): 360/587 kB Progress (1): 376/587 kB Progress (1): 393/587 kB Progress (1): 402/587 kB Progress (1): 418/587 kB Progress (1): 435/587 kB Progress (1): 451/587 kB Progress (1): 468/587 kB Progress (1): 484/587 kB Progress (1): 500/587 kB Progress (1): 517/587 kB Progress (1): 533/587 kB Progress (1): 549/587 kB Progress (1): 566/587 kB Progress (1): 582/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 12 MB/s) 2024-09-12T00:26:08.406 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:26:08.407 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:08.407 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:26:08.412 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:26:08.426 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-12T00:26:08.429 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:26:08.453 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 265 kB/s) 2024-09-12T00:26:08.455 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:26:08.470 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-12T00:26:08.473 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:26:08.487 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-12T00:26:08.492 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:26:08.506 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-12T00:26:08.508 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:26:08.524 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-12T00:26:08.525 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:26:08.542 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-09-12T00:26:08.546 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:26:08.561 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-12T00:26:08.564 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:26:08.579 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T00:26:08.585 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:26:08.597 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-12T00:26:08.600 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:26:08.616 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 706 kB/s) 2024-09-12T00:26:08.619 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:26:08.636 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.0 MB/s) 2024-09-12T00:26:08.639 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:26:08.654 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-12T00:26:08.658 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:26:08.676 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 59 kB/s) 2024-09-12T00:26:08.678 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:26:08.694 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 524 kB/s) 2024-09-12T00:26:08.696 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:26:08.714 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 149 kB/s) 2024-09-12T00:26:08.717 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:26:08.733 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-09-12T00:26:08.737 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:26:08.754 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-09-12T00:26:08.757 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:26:08.774 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 45 kB/s) 2024-09-12T00:26:08.777 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:26:08.792 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-12T00:26:08.794 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:26:08.815 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.2 MB/s) 2024-09-12T00:26:08.819 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:26:08.838 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 63 kB/s) 2024-09-12T00:26:08.841 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:26:08.856 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-09-12T00:26:08.864 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:26:08.878 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-12T00:26:08.878 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:26:08.879 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:26:08.879 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:26:08.879 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:26:08.879 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:26:08.900 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/122 kB Progress (1): 32/122 kB Progress (1): 35/122 kB Progress (2): 35/122 kB | 16/334 kB Progress (2): 51/122 kB | 16/334 kB Progress (3): 51/122 kB | 16/334 kB | 16/55 kB Progress (3): 68/122 kB | 16/334 kB | 16/55 kB Progress (3): 68/122 kB | 33/334 kB | 16/55 kB Progress (3): 68/122 kB | 33/334 kB | 32/55 kB Progress (3): 84/122 kB | 33/334 kB | 32/55 kB Progress (3): 84/122 kB | 49/334 kB | 32/55 kB Progress (3): 84/122 kB | 49/334 kB | 49/55 kB Progress (3): 100/122 kB | 49/334 kB | 49/55 kB Progress (3): 100/122 kB | 49/334 kB | 55 kB Progress (3): 100/122 kB | 64/334 kB | 55 kB Progress (3): 117/122 kB | 64/334 kB | 55 kB Progress (3): 122 kB | 64/334 kB | 55 kB Progress (3): 122 kB | 81/334 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.0 MB/s) 2024-09-12T00:26:08.900 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:26:08.900 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 122 kB | 97/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.8 MB/s) 2024-09-12T00:26:08.900 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:26:08.901 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 113/334 kB Progress (1): 130/334 kB Progress (1): 146/334 kB Progress (1): 163/334 kB Progress (1): 179/334 kB Progress (1): 195/334 kB Progress (1): 212/334 kB Progress (1): 228/334 kB Progress (1): 245/334 kB Progress (1): 261/334 kB Progress (1): 277/334 kB Progress (1): 294/334 kB Progress (1): 310/334 kB Progress (1): 326/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-09-12T00:26:08.901 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:26:08.910 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Progress (2): 27 kB | 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 872 kB/s) 2024-09-12T00:26:08.911 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 4.2 kB | 15/267 kB Progress (2): 4.2 kB | 31/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 132 kB/s) 2024-09-12T00:26:08.911 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 48/267 kB Progress (2): 48/267 kB | 4.7 kB Progress (2): 64/267 kB | 4.7 kB Progress (2): 81/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 146 kB/s) 2024-09-12T00:26:08.914 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 97/267 kB Progress (1): 113/267 kB Progress (1): 130/267 kB Progress (1): 146/267 kB Progress (1): 162/267 kB Progress (1): 179/267 kB Progress (1): 195/267 kB Progress (1): 212/267 kB Progress (1): 228/267 kB Progress (1): 244/267 kB Progress (1): 261/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.6 MB/s) 2024-09-12T00:26:08.919 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 570 kB/s) 2024-09-12T00:26:09.159 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:26:09.161 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:26:10.345 INFO:tasks.workunit.client.0.smithi102.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:26:10.345 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:10.345 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:26:10.348 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:26:10.348 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:10.349 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:26:10.353 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:26:10.354 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:26:10.517 INFO:tasks.workunit.client.0.smithi102.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:26:10.517 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:10.518 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:26:10.522 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:26:10.537 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T00:26:10.541 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:26:10.555 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-12T00:26:10.559 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:26:10.574 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-12T00:26:10.578 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:26:10.594 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 254 kB/s) 2024-09-12T00:26:10.598 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:26:10.613 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T00:26:10.616 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:26:10.634 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 248 kB/s) 2024-09-12T00:26:10.637 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:26:10.652 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-09-12T00:26:10.655 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:26:10.671 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 137 kB/s) 2024-09-12T00:26:10.672 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:26:10.691 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.6 MB/s) 2024-09-12T00:26:10.694 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:26:10.708 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T00:26:10.711 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:26:10.725 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-12T00:26:10.729 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:26:10.744 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 147 kB/s) 2024-09-12T00:26:10.745 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:26:10.764 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.2 MB/s) 2024-09-12T00:26:10.768 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:26:10.786 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.1 MB/s) 2024-09-12T00:26:10.790 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:26:10.806 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 952 kB/s) 2024-09-12T00:26:10.811 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:26:10.827 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 541 kB/s) 2024-09-12T00:26:10.830 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:26:10.847 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-12T00:26:10.852 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:26:10.870 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 448 kB/s) 2024-09-12T00:26:10.876 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:26:10.892 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 136 kB/s) 2024-09-12T00:26:10.898 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:26:10.914 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 162 kB/s) 2024-09-12T00:26:10.919 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:26:10.934 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 103 kB/s) 2024-09-12T00:26:10.937 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:26:10.953 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 192 kB/s) 2024-09-12T00:26:10.955 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:26:10.971 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.3 MB/s) 2024-09-12T00:26:10.974 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:26:10.992 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 376 kB/s) 2024-09-12T00:26:10.995 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:26:11.016 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 646 kB/s) 2024-09-12T00:26:11.022 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:26:11.039 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 174 kB/s) 2024-09-12T00:26:11.044 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:26:11.060 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-09-12T00:26:11.063 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:26:11.080 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 494 kB/s) 2024-09-12T00:26:11.085 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:26:11.102 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 115 kB/s) 2024-09-12T00:26:11.107 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:26:11.126 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 124 kB/s) 2024-09-12T00:26:11.134 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:26:11.153 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 159 kB/s) 2024-09-12T00:26:11.160 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:26:11.180 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 788 kB/s) 2024-09-12T00:26:11.184 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:26:11.201 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 806 kB/s) 2024-09-12T00:26:11.208 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:26:11.226 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 746 kB/s) 2024-09-12T00:26:11.230 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:26:11.249 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 282 kB/s) 2024-09-12T00:26:11.251 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:26:11.268 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 369 kB/s) 2024-09-12T00:26:11.273 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:26:11.291 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/32 kB Progress (1): 31/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.8 MB/s) 2024-09-12T00:26:11.298 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:26:11.315 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.0 MB/s) 2024-09-12T00:26:11.319 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:26:11.341 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 673 kB/s) 2024-09-12T00:26:11.348 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:26:11.365 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 44 kB/s) 2024-09-12T00:26:11.368 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:26:11.385 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 267 kB/s) 2024-09-12T00:26:11.390 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:26:11.406 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 494 kB/s) 2024-09-12T00:26:11.412 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:26:11.428 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-09-12T00:26:11.435 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:26:11.456 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 224 kB/s) 2024-09-12T00:26:11.461 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:26:11.481 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 103 kB/s) 2024-09-12T00:26:11.486 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:26:11.503 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 204 kB/s) 2024-09-12T00:26:11.509 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:26:11.530 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 547 kB/s) 2024-09-12T00:26:11.534 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:26:11.552 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 709 kB/s) 2024-09-12T00:26:11.556 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:26:11.574 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.0 MB/s) 2024-09-12T00:26:11.579 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:26:11.597 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 20 kB/s) 2024-09-12T00:26:11.601 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:26:11.618 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 359 kB/s) 2024-09-12T00:26:11.622 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:26:11.640 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 408 kB/s) 2024-09-12T00:26:11.643 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:26:11.661 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 268 kB/s) 2024-09-12T00:26:11.665 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:26:11.683 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-09-12T00:26:11.688 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:26:11.706 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.2 MB/s) 2024-09-12T00:26:11.710 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:26:11.728 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-09-12T00:26:11.736 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:26:11.754 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.3 MB/s) 2024-09-12T00:26:11.761 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:26:11.784 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 235 kB/s) 2024-09-12T00:26:11.788 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:26:11.805 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 251 kB/s) 2024-09-12T00:26:11.809 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:26:11.824 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T00:26:11.827 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:26:11.846 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.5 MB/s) 2024-09-12T00:26:11.852 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:26:11.869 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 139 kB/s) 2024-09-12T00:26:11.881 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:26:11.911 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 9.9 MB/s) 2024-09-12T00:26:11.912 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:26:11.912 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:26:11.912 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:26:11.913 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:26:11.913 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:26:11.932 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 66/171 kB Progress (1): 82/171 kB Progress (1): 98/171 kB Progress (1): 115/171 kB Progress (1): 131/171 kB Progress (2): 131/171 kB | 8.2 kB Progress (2): 147/171 kB | 8.2 kB Progress (2): 164/171 kB | 8.2 kB Progress (2): 171 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 409 kB/s) 2024-09-12T00:26:11.932 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:26:11.932 INFO:tasks.workunit.client.0.smithi102.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.1 MB/s) 2024-09-12T00:26:11.933 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:26:11.934 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/118 kB Progress (2): 26 kB | 16/118 kB Progress (2): 26 kB | 32/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.1 MB/s) 2024-09-12T00:26:11.935 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 49/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:26:11.938 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 65/118 kB Progress (1): 81/118 kB Progress (1): 98/118 kB Progress (1): 114/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 4.5 MB/s) 2024-09-12T00:26:11.938 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:26:11.945 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 400 kB/s) 2024-09-12T00:26:11.945 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:26:11.950 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 62/146 kB Progress (1): 79/146 kB Progress (1): 95/146 kB Progress (1): 112/146 kB Progress (2): 112/146 kB | 16/136 kB Progress (2): 128/146 kB | 16/136 kB Progress (2): 128/146 kB | 32/136 kB Progress (2): 144/146 kB | 32/136 kB Progress (2): 146 kB | 32/136 kB Progress (2): 146 kB | 49/136 kB Progress (2): 146 kB | 65/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.9 MB/s) 2024-09-12T00:26:11.950 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:26:11.952 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 81/136 kB Progress (1): 98/136 kB Progress (1): 114/136 kB Progress (1): 130/136 kB Progress (1): 136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.5 MB/s) 2024-09-12T00:26:11.952 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:26:11.963 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/501 kB Progress (1): 32/501 kB Progress (1): 49/501 kB Progress (1): 65/501 kB Progress (1): 81/501 kB Progress (1): 98/501 kB Progress (2): 98/501 kB | 16/61 kB Progress (2): 114/501 kB | 16/61 kB Progress (2): 130/501 kB | 16/61 kB Progress (2): 147/501 kB | 16/61 kB Progress (2): 163/501 kB | 16/61 kB Progress (2): 180/501 kB | 16/61 kB Progress (2): 196/501 kB | 16/61 kB Progress (2): 204/501 kB | 16/61 kB Progress (2): 220/501 kB | 16/61 kB Progress (2): 237/501 kB | 16/61 kB Progress (2): 253/501 kB | 16/61 kB Progress (2): 269/501 kB | 16/61 kB Progress (2): 286/501 kB | 16/61 kB Progress (2): 302/501 kB | 16/61 kB Progress (2): 319/501 kB | 16/61 kB Progress (2): 335/501 kB | 16/61 kB Progress (2): 351/501 kB | 16/61 kB Progress (3): 351/501 kB | 16/61 kB | 16/58 kB Progress (3): 368/501 kB | 16/61 kB | 16/58 kB Progress (3): 368/501 kB | 16/61 kB | 33/58 kB Progress (3): 384/501 kB | 16/61 kB | 33/58 kB Progress (3): 401/501 kB | 16/61 kB | 33/58 kB Progress (3): 401/501 kB | 16/61 kB | 49/58 kB Progress (3): 401/501 kB | 16/61 kB | 58 kB Progress (3): 417/501 kB | 16/61 kB | 58 kB Progress (3): 433/501 kB | 16/61 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.2 MB/s) 2024-09-12T00:26:11.964 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 450/501 kB | 16/61 kB Progress (2): 450/501 kB | 32/61 kB Progress (2): 466/501 kB | 32/61 kB Progress (2): 466/501 kB | 49/61 kB Progress (2): 482/501 kB | 49/61 kB Progress (2): 482/501 kB | 61 kB Progress (2): 499/501 kB | 61 kB Progress (2): 501 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.2 MB/s) 2024-09-12T00:26:11.964 INFO:tasks.workunit.client.0.smithi102.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 10 MB/s) 2024-09-12T00:26:11.970 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/124 kB Progress (1): 31/124 kB Progress (1): 48/124 kB Progress (1): 64/124 kB Progress (1): 78/124 kB Progress (1): 94/124 kB Progress (1): 110/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.2 MB/s) 2024-09-12T00:26:12.023 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 22 MB/s) 2024-09-12T00:26:12.109 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:12.109 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:26:12.112 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:26:12.127 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-12T00:26:12.129 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:26:12.143 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-12T00:26:12.145 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:26:12.160 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T00:26:12.162 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:26:12.178 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.3 MB/s) 2024-09-12T00:26:12.181 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:26:12.195 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T00:26:12.198 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:26:12.213 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-12T00:26:12.216 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:26:12.233 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 354 kB/s) 2024-09-12T00:26:12.236 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:26:12.254 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 348 kB/s) 2024-09-12T00:26:12.258 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:26:12.273 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-09-12T00:26:12.279 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:26:12.295 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 909 kB/s) 2024-09-12T00:26:12.299 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:26:12.314 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 128 kB/s) 2024-09-12T00:26:12.318 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:26:12.335 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 483 kB/s) 2024-09-12T00:26:12.338 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:26:12.361 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 15/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.1 MB/s) 2024-09-12T00:26:12.369 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:26:12.384 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-12T00:26:12.385 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:26:12.386 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:26:12.386 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:26:12.386 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:26:12.386 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:26:12.407 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/58 kB Progress (2): 26 kB | 16/58 kB Progress (2): 26 kB | 33/58 kB Progress (2): 26 kB | 49/58 kB Progress (2): 26 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-12T00:26:12.407 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 58 kB | 16/79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-12T00:26:12.407 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:26:12.407 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:26:12.408 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 16/79 kB | 15/211 kB Progress (2): 33/79 kB | 15/211 kB Progress (2): 49/79 kB | 15/211 kB Progress (2): 49/79 kB | 31/211 kB Progress (2): 66/79 kB | 31/211 kB Progress (2): 66/79 kB | 48/211 kB Progress (2): 79 kB | 48/211 kB Progress (2): 79 kB | 64/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.2 MB/s) 2024-09-12T00:26:12.410 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 81/211 kB Progress (1): 95/211 kB Progress (1): 112/211 kB Progress (1): 128/211 kB Progress (1): 145/211 kB Progress (1): 161/211 kB Progress (1): 177/211 kB Progress (1): 194/211 kB Progress (1): 210/211 kB Progress (1): 211 kB Progress (2): 211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.6 MB/s) 2024-09-12T00:26:12.418 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 0/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (2): 0.4/1.0 MB | 16/116 kB Progress (2): 0.4/1.0 MB | 16/116 kB Progress (2): 0.4/1.0 MB | 32/116 kB Progress (2): 0.4/1.0 MB | 32/116 kB Progress (2): 0.4/1.0 MB | 49/116 kB Progress (2): 0.4/1.0 MB | 49/116 kB Progress (2): 0.4/1.0 MB | 65/116 kB Progress (2): 0.5/1.0 MB | 65/116 kB Progress (2): 0.5/1.0 MB | 81/116 kB Progress (2): 0.5/1.0 MB | 81/116 kB Progress (2): 0.5/1.0 MB | 98/116 kB Progress (2): 0.5/1.0 MB | 98/116 kB Progress (2): 0.5/1.0 MB | 114/116 kB Progress (2): 0.5/1.0 MB | 116 kB Progress (2): 0.5/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.5 MB/s) 2024-09-12T00:26:12.428 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (2): 0.6/1.0 MB | 16/267 kB Progress (2): 0.6/1.0 MB | 16/267 kB Progress (2): 0.6/1.0 MB | 32/267 kB Progress (2): 0.6/1.0 MB | 32/267 kB Progress (2): 0.6/1.0 MB | 49/267 kB Progress (2): 0.6/1.0 MB | 49/267 kB Progress (2): 0.6/1.0 MB | 65/267 kB Progress (2): 0.7/1.0 MB | 65/267 kB Progress (2): 0.7/1.0 MB | 81/267 kB Progress (2): 0.7/1.0 MB | 98/267 kB Progress (2): 0.7/1.0 MB | 98/267 kB Progress (2): 0.7/1.0 MB | 114/267 kB Progress (2): 0.7/1.0 MB | 114/267 kB Progress (2): 0.7/1.0 MB | 130/267 kB Progress (2): 0.7/1.0 MB | 130/267 kB Progress (2): 0.7/1.0 MB | 147/267 kB Progress (2): 0.7/1.0 MB | 147/267 kB Progress (2): 0.7/1.0 MB | 163/267 kB Progress (2): 0.7/1.0 MB | 163/267 kB Progress (2): 0.7/1.0 MB | 180/267 kB Progress (2): 0.8/1.0 MB | 180/267 kB Progress (2): 0.8/1.0 MB | 196/267 kB Progress (2): 0.8/1.0 MB | 210/267 kB Progress (2): 0.8/1.0 MB | 210/267 kB Progress (2): 0.8/1.0 MB | 227/267 kB Progress (2): 0.8/1.0 MB | 227/267 kB Progress (2): 0.8/1.0 MB | 243/267 kB Progress (2): 0.8/1.0 MB | 243/267 kB Progress (2): 0.8/1.0 MB | 243/267 kB Progress (2): 0.8/1.0 MB | 260/267 kB Progress (2): 0.8/1.0 MB | 267 kB Progress (2): 0.8/1.0 MB | 267 kB Progress (2): 0.8/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.5 MB/s) 2024-09-12T00:26:12.428 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 24 MB/s) 2024-09-12T00:26:12.622 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:26:12.653 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:26:12.653 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:26:12.653 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:26:12.654 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Total time: 8.303 s 2024-09-12T00:26:12.654 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Finished at: 2024-09-12T00:26:12Z 2024-09-12T00:26:12.654 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:26:12.686 INFO:tasks.workunit.client.0.smithi102.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:26:12.692 INFO:tasks.workunit.client.0.smithi102.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:26:13.790 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Scanning for projects... 2024-09-12T00:26:13.871 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:13.872 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:26:13.872 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:26:13.872 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] from pom.xml 2024-09-12T00:26:13.872 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:26:14.135 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:14.135 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:26:14.253 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:26:14.254 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:14.254 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:26:14.361 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:26:14.362 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:14.362 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:26:14.364 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:26:14.364 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:14.364 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:26:14.370 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:26:14.370 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:14.370 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:26:14.634 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:26:14.832 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:26:15.030 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-12T00:26:15.038 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:26:15.059 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 124 kB/s) 2024-09-12T00:26:15.064 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:26:15.082 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 156 kB/s) 2024-09-12T00:26:15.087 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:26:15.103 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-12T00:26:15.105 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:26:15.121 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-12T00:26:15.124 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:26:15.140 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T00:26:15.142 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:26:15.158 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-12T00:26:15.163 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:26:15.192 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 936 kB/s) 2024-09-12T00:26:15.194 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:26:15.195 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:26:15.195 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:26:15.200 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:26:15.201 INFO:tasks.workunit.client.0.smithi102.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:26:15.240 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 3.6 MB/s) 2024-09-12T00:26:15.254 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 1.4/18 kB Progress (1): 2.8/18 kB Progress (2): 2.8/18 kB | 1.4/7.7 kB Progress (2): 4.1/18 kB | 1.4/7.7 kB Progress (2): 4.1/18 kB | 2.8/7.7 kB Progress (2): 5.5/18 kB | 2.8/7.7 kB Progress (2): 5.5/18 kB | 4.1/7.7 kB Progress (2): 6.9/18 kB | 4.1/7.7 kB Progress (2): 6.9/18 kB | 5.5/7.7 kB Progress (2): 8.3/18 kB | 5.5/7.7 kB Progress (2): 8.3/18 kB | 6.9/7.7 kB Progress (2): 9.7/18 kB | 6.9/7.7 kB Progress (2): 9.7/18 kB | 7.7 kB Progress (2): 11/18 kB | 7.7 kB Progress (3): 11/18 kB | 7.7 kB | 1.4/103 kB Progress (3): 12/18 kB | 7.7 kB | 1.4/103 kB Progress (3): 12/18 kB | 7.7 kB | 2.8/103 kB Progress (3): 12/18 kB | 7.7 kB | 4.1/103 kB Progress (3): 12/18 kB | 7.7 kB | 5.5/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 128 kB/s) 2024-09-12T00:26:15.259 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 14/18 kB | 5.5/103 kB Progress (2): 14/18 kB | 6.9/103 kB Progress (3): 14/18 kB | 6.9/103 kB | 1.4/189 kB Progress (3): 14/18 kB | 8.3/103 kB | 1.4/189 kB Progress (3): 15/18 kB | 8.3/103 kB | 1.4/189 kB Progress (3): 15/18 kB | 9.7/103 kB | 1.4/189 kB Progress (3): 15/18 kB | 9.7/103 kB | 2.8/189 kB Progress (3): 15/18 kB | 11/103 kB | 2.8/189 kB Progress (3): 17/18 kB | 11/103 kB | 2.8/189 kB Progress (3): 17/18 kB | 12/103 kB | 2.8/189 kB Progress (3): 17/18 kB | 12/103 kB | 4.1/189 kB Progress (3): 17/18 kB | 14/103 kB | 4.1/189 kB Progress (3): 18 kB | 14/103 kB | 4.1/189 kB Progress (3): 18 kB | 15/103 kB | 4.1/189 kB Progress (3): 18 kB | 15/103 kB | 5.5/189 kB Progress (3): 18 kB | 16/103 kB | 5.5/189 kB Progress (3): 18 kB | 16/103 kB | 6.9/189 kB Progress (3): 18 kB | 18/103 kB | 6.9/189 kB Progress (3): 18 kB | 18/103 kB | 8.3/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 262 kB/s) 2024-09-12T00:26:15.277 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (2): 19/103 kB | 8.3/189 kB Progress (2): 19/103 kB | 9.7/189 kB Progress (2): 21/103 kB | 9.7/189 kB Progress (2): 21/103 kB | 11/189 kB Progress (2): 22/103 kB | 11/189 kB Progress (2): 22/103 kB | 12/189 kB Progress (2): 23/103 kB | 12/189 kB Progress (2): 23/103 kB | 14/189 kB Progress (2): 23/103 kB | 15/189 kB Progress (2): 25/103 kB | 15/189 kB Progress (2): 26/103 kB | 15/189 kB Progress (2): 27/103 kB | 15/189 kB Progress (2): 27/103 kB | 31/189 kB Progress (2): 29/103 kB | 31/189 kB Progress (2): 30/103 kB | 31/189 kB Progress (2): 31/103 kB | 31/189 kB Progress (2): 33/103 kB | 31/189 kB Progress (2): 34/103 kB | 31/189 kB Progress (2): 34/103 kB | 48/189 kB Progress (2): 36/103 kB | 48/189 kB Progress (2): 37/103 kB | 48/189 kB Progress (2): 38/103 kB | 48/189 kB Progress (2): 40/103 kB | 48/189 kB Progress (2): 41/103 kB | 48/189 kB Progress (2): 41/103 kB | 64/189 kB Progress (2): 42/103 kB | 64/189 kB Progress (2): 44/103 kB | 64/189 kB Progress (2): 45/103 kB | 64/189 kB Progress (2): 47/103 kB | 64/189 kB Progress (2): 48/103 kB | 64/189 kB Progress (2): 64/103 kB | 64/189 kB Progress (2): 79/103 kB | 64/189 kB Progress (2): 95/103 kB | 64/189 kB Progress (2): 103 kB | 64/189 kB Progress (2): 103 kB | 79/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T00:26:15.284 INFO:tasks.workunit.client.0.smithi102.stdout:Progress (1): 96/189 kB Progress (1): 112/189 kB Progress (1): 128/189 kB Progress (1): 145/189 kB Progress (1): 161/189 kB Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.1 MB/s) 2024-09-12T00:26:15.302 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:26:15.302 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:26:15.302 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] T E S T S 2024-09-12T00:26:15.302 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:26:15.857 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:26:15.957 INFO:tasks.workunit.client.0.smithi102.stdout:PutObjects.java: starting test run: 2024-09-12T00:26:15.957 INFO:tasks.workunit.client.0.smithi102.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:26:15.957 INFO:tasks.workunit.client.0.smithi102.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:26:15.957 INFO:tasks.workunit.client.0.smithi102.stdout: EndpointUrl=https://smithi102.front.sepia.ceph.com:443 2024-09-12T00:26:15.958 INFO:tasks.workunit.client.0.smithi102.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:26:16.153 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: Environment Variables Read 2024-09-12T00:26:16.454 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:26:16.454 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: Generating File 2024-09-12T00:26:16.454 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: File Generated 2024-09-12T00:26:16.455 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: Generating File 2024-09-12T00:26:16.455 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: File Generated 2024-09-12T00:26:16.455 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: Generating File 2024-09-12T00:26:16.555 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: File Generated 2024-09-12T00:26:16.555 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: Generating File 2024-09-12T00:26:16.555 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: File Generated 2024-09-12T00:26:16.555 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: Generating File 2024-09-12T00:26:16.555 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: File Generated 2024-09-12T00:26:16.555 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: Generating File 2024-09-12T00:26:16.555 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: File Generated 2024-09-12T00:26:16.555 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: Generated Big Files 2024-09-12T00:26:17.156 INFO:tasks.workunit.client.0.smithi102.stdout:HeadBucketResponse() 2024-09-12T00:26:17.156 INFO:tasks.workunit.client.0.smithi102.stdout:sheik is ready 2024-09-12T00:26:17.156 INFO:tasks.workunit.client.0.smithi102.stdout:DEBUG: Test Bucket Created 2024-09-12T00:26:17.256 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:26:17.557 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:26:17.757 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:26:18.158 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:26:18.459 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:26:18.760 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:26:19.261 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:26:19.762 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:26:20.764 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:26:21.767 INFO:tasks.workunit.client.0.smithi102.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:26:28.256 INFO:tasks.workunit.client.0.smithi102.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:26:34.969 INFO:tasks.workunit.client.0.smithi102.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:27:37.435 INFO:tasks.workunit.client.0.smithi102.stdout:arg: file-0b 2024-09-12T00:27:37.436 INFO:tasks.workunit.client.0.smithi102.stdout:arg: file-8b 2024-09-12T00:27:37.436 INFO:tasks.workunit.client.0.smithi102.stdout:arg: file-200b 2024-09-12T00:27:37.437 INFO:tasks.workunit.client.0.smithi102.stdout:arg: file-21983b 2024-09-12T00:27:37.438 INFO:tasks.workunit.client.0.smithi102.stdout:arg: file-5519b 2024-09-12T00:27:37.439 INFO:tasks.workunit.client.0.smithi102.stdout:arg: file-204329b 2024-09-12T00:27:37.441 INFO:tasks.workunit.client.0.smithi102.stdout:arg: file-256k 2024-09-12T00:27:37.442 INFO:tasks.workunit.client.0.smithi102.stdout:arg: file-1m 2024-09-12T00:27:37.443 INFO:tasks.workunit.client.0.smithi102.stdout:arg: file-1038757b 2024-09-12T00:27:37.461 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:27:37.661 INFO:tasks.workunit.client.0.smithi102.stdout:PutObjectResponse 2024-09-12T00:27:37.761 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:27:37.861 INFO:tasks.workunit.client.0.smithi102.stdout:PutObjectResponse 2024-09-12T00:27:37.962 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:27:38.162 INFO:tasks.workunit.client.0.smithi102.stdout:PutObjectResponse 2024-09-12T00:27:38.262 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:27:38.462 INFO:tasks.workunit.client.0.smithi102.stdout:PutObjectResponse 2024-09-12T00:27:38.563 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:27:38.763 INFO:tasks.workunit.client.0.smithi102.stdout:PutObjectResponse 2024-09-12T00:27:38.863 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:27:39.163 INFO:tasks.workunit.client.0.smithi102.stdout:PutObjectResponse 2024-09-12T00:27:39.364 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:27:39.764 INFO:tasks.workunit.client.0.smithi102.stdout:PutObjectResponse 2024-09-12T00:27:39.965 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:27:40.966 INFO:tasks.workunit.client.0.smithi102.stdout:PutObjectResponse 2024-09-12T00:27:41.267 INFO:tasks.workunit.client.0.smithi102.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:27:42.067 INFO:tasks.workunit.client.0.smithi102.stdout:PutObjectResponse 2024-09-12T00:27:42.468 INFO:tasks.workunit.client.0.smithi102.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:27:48.377 INFO:tasks.workunit.client.0.smithi102.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:27:57.487 INFO:tasks.workunit.client.0.smithi102.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:29:28.149 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 192.3 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:29:28.172 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:29:28.172 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Results: 2024-09-12T00:29:28.172 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:29:28.172 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:29:28.173 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] 2024-09-12T00:29:28.174 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:29:28.174 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:29:28.174 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:29:28.175 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Total time: 03:14 min 2024-09-12T00:29:28.175 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] Finished at: 2024-09-12T00:29:28Z 2024-09-12T00:29:28.175 INFO:tasks.workunit.client.0.smithi102.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:29:28.195 INFO:tasks.workunit.client.0.smithi102.stderr:+ exit 2024-09-12T00:29:28.196 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:29:28.196 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:29:28.247 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:29:28.247 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:29:28.628 DEBUG:teuthology.parallel:result is None 2024-09-12T00:29:28.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:29:28.641 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:29:28.641 DEBUG:teuthology.orchestra.run.smithi102:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:29:28.689 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:29:28.689 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:29:28.700 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:29:28.700 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:29:28.700 DEBUG:teuthology.orchestra.run.smithi102:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:29:28.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:29:28.737 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:29:28.737 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:29:28.785 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:29:28.785 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:29:28.833 INFO:tasks.workunit:timeout=3h 2024-09-12T00:29:28.833 INFO:tasks.workunit:cleanup=True 2024-09-12T00:29:28.834 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:29:28.884 INFO:tasks.workunit.client.0.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:30:12.023 INFO:tasks.workunit.client.0.smithi102.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:30:12.024 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:30:12.024 INFO:tasks.workunit.client.0.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:30:12.024 INFO:tasks.workunit.client.0.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:30:12.024 INFO:tasks.workunit.client.0.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:30:12.024 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:30:12.024 INFO:tasks.workunit.client.0.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:30:12.024 INFO:tasks.workunit.client.0.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:30:12.024 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:30:12.024 INFO:tasks.workunit.client.0.smithi102.stderr: git switch -c 2024-09-12T00:30:12.024 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:30:12.025 INFO:tasks.workunit.client.0.smithi102.stderr:Or undo this operation with: 2024-09-12T00:30:12.025 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:30:12.025 INFO:tasks.workunit.client.0.smithi102.stderr: git switch - 2024-09-12T00:30:12.025 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:30:12.025 INFO:tasks.workunit.client.0.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:30:12.025 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:30:12.025 INFO:tasks.workunit.client.0.smithi102.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:30:12.031 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:30:12.077 INFO:tasks.workunit.client.0.smithi102.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:30:12.081 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:30:12.081 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:30:12.132 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:30:12.185 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:30:12.227 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:30:12.228 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:30:12.228 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:30:12.274 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:30:12.277 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:30:12.277 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:30:12.326 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:30:12.327 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:30:12.327 DEBUG:teuthology.orchestra.run.smithi102:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:30:12.380 INFO:tasks.workunit.client.0.smithi102.stdout:INFO: fully qualified domain name: smithi102.front.sepia.ceph.com 2024-09-12T00:30:12.381 INFO:tasks.workunit.client.0.smithi102.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:30:12.381 INFO:tasks.workunit.client.0.smithi102.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T00:30:15.745 INFO:tasks.workunit.client.0.smithi102.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:30:15.955 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting pip 2024-09-12T00:30:15.961 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:30:15.995 INFO:tasks.workunit.client.0.smithi102.stdout:Installing collected packages: pip 2024-09-12T00:30:15.995 INFO:tasks.workunit.client.0.smithi102.stdout: Attempting uninstall: pip 2024-09-12T00:30:15.996 INFO:tasks.workunit.client.0.smithi102.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:30:16.262 INFO:tasks.workunit.client.0.smithi102.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:30:16.268 INFO:tasks.workunit.client.0.smithi102.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:30:17.288 INFO:tasks.workunit.client.0.smithi102.stdout:Successfully installed pip-24.2 2024-09-12T00:30:18.315 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting boto3 2024-09-12T00:30:18.316 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:30:18.871 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:30:18.872 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:30:18.918 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:30:18.919 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:30:18.966 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:30:18.967 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:30:19.021 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:30:19.023 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:30:19.130 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:30:19.132 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:30:19.397 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:30:19.397 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:30:19.401 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:30:19.402 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:30:19.411 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:30:19.413 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:30:19.414 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:30:19.415 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:30:19.416 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:30:19.483 INFO:tasks.workunit.client.0.smithi102.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:30:20.620 INFO:tasks.workunit.client.0.smithi102.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:30:20.988 INFO:tasks.workunit.client.0.smithi102.stdout:INFO: creating user 2024-09-12T00:30:21.355 INFO:tasks.workunit.client.0.smithi102.stdout:{ 2024-09-12T00:30:21.355 INFO:tasks.workunit.client.0.smithi102.stdout: "user_id": "testid", 2024-09-12T00:30:21.355 INFO:tasks.workunit.client.0.smithi102.stdout: "display_name": "M. Tester", 2024-09-12T00:30:21.355 INFO:tasks.workunit.client.0.smithi102.stdout: "email": "tester@ceph.com", 2024-09-12T00:30:21.355 INFO:tasks.workunit.client.0.smithi102.stdout: "suspended": 0, 2024-09-12T00:30:21.355 INFO:tasks.workunit.client.0.smithi102.stdout: "max_buckets": 1000, 2024-09-12T00:30:21.355 INFO:tasks.workunit.client.0.smithi102.stdout: "subusers": [], 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "keys": [ 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: { 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "user": "testid", 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "active": true, 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "create_date": "2024-09-12T00:30:21.347454Z" 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: } 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: ], 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "swift_keys": [], 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "caps": [], 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "default_placement": "", 2024-09-12T00:30:21.356 INFO:tasks.workunit.client.0.smithi102.stdout: "default_storage_class": "", 2024-09-12T00:30:21.357 INFO:tasks.workunit.client.0.smithi102.stdout: "placement_tags": [], 2024-09-12T00:30:21.357 INFO:tasks.workunit.client.0.smithi102.stdout: "bucket_quota": { 2024-09-12T00:30:21.357 INFO:tasks.workunit.client.0.smithi102.stdout: "enabled": false, 2024-09-12T00:30:21.357 INFO:tasks.workunit.client.0.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:30:21.357 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size": -1, 2024-09-12T00:30:21.357 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:30:21.357 INFO:tasks.workunit.client.0.smithi102.stdout: "max_objects": -1 2024-09-12T00:30:21.357 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:30:21.357 INFO:tasks.workunit.client.0.smithi102.stdout: "user_quota": { 2024-09-12T00:30:21.357 INFO:tasks.workunit.client.0.smithi102.stdout: "enabled": false, 2024-09-12T00:30:21.358 INFO:tasks.workunit.client.0.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:30:21.358 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size": -1, 2024-09-12T00:30:21.358 INFO:tasks.workunit.client.0.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:30:21.358 INFO:tasks.workunit.client.0.smithi102.stdout: "max_objects": -1 2024-09-12T00:30:21.358 INFO:tasks.workunit.client.0.smithi102.stdout: }, 2024-09-12T00:30:21.358 INFO:tasks.workunit.client.0.smithi102.stdout: "temp_url_keys": [], 2024-09-12T00:30:21.358 INFO:tasks.workunit.client.0.smithi102.stdout: "type": "rgw", 2024-09-12T00:30:21.358 INFO:tasks.workunit.client.0.smithi102.stdout: "mfa_ids": [], 2024-09-12T00:30:21.358 INFO:tasks.workunit.client.0.smithi102.stdout: "account_id": "", 2024-09-12T00:30:21.359 INFO:tasks.workunit.client.0.smithi102.stdout: "path": "/", 2024-09-12T00:30:21.359 INFO:tasks.workunit.client.0.smithi102.stdout: "create_date": "2024-09-12T00:30:21.347421Z", 2024-09-12T00:30:21.359 INFO:tasks.workunit.client.0.smithi102.stdout: "tags": [], 2024-09-12T00:30:21.359 INFO:tasks.workunit.client.0.smithi102.stdout: "group_ids": [] 2024-09-12T00:30:21.359 INFO:tasks.workunit.client.0.smithi102.stdout:} 2024-09-12T00:30:21.359 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-09-12T00:30:29.633 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:29.634 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:29.804 INFO:tasks.workunit.client.0.smithi102.stderr:5+0 records in 2024-09-12T00:30:29.804 INFO:tasks.workunit.client.0.smithi102.stderr:5+0 records out 2024-09-12T00:30:29.804 INFO:tasks.workunit.client.0.smithi102.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0214255 s, 245 MB/s 2024-09-12T00:30:29.809 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:29.809 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:29.951 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:29.952 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:32.074 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:32.074 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:34.304 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:34.304 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:36.561 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:36.561 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:38.882 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:38.882 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:41.217 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:41.218 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:43.595 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:43.595 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:46.072 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:46.072 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:48.505 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:48.505 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:50.864 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:50.864 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:53.127 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:53.127 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:55.392 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:55.393 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:57.577 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:57.577 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:30:59.764 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:30:59.764 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:31:00.029 INFO:tasks.workunit.client.0.smithi102.stdout:bucket nams is reupload-bkt-117067 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:endpoint is https://smithi102.front.sepia.ceph.com:443 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:start UploadId=2~Veoert8qo8ZuuqXwmeLj2GoTagc95BN 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:phase 1 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:phase 1 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 2} 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.031 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.031 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.031 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.031 INFO:tasks.workunit.client.0.smithi102.stdout:phase 2 uploaded part {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1} 2024-09-12T00:31:00.031 INFO:tasks.workunit.client.0.smithi102.stdout:completing multipart upload, parts=[{'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 1}, {'ETag': '"e5c476f77abfe0ced65bfd1d1f2f62b1"', 'PartNumber': 2}] 2024-09-12T00:31:02.027 INFO:tasks.workunit.client.0.smithi102.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:31:02.028 INFO:tasks.workunit.client.0.smithi102.stdout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4_mpu_test4 2024-09-12T00:31:02.028 INFO:tasks.workunit.client.0.smithi102.stdout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4__multipart_mpu_test4.2~Veoert8qo8ZuuqXwmeLj2GoTagc95BN.2 2024-09-12T00:31:02.028 INFO:tasks.workunit.client.0.smithi102.stdout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4__multipart_mpu_test4.nUr17XOR2b6xe33KgtsY1PNYPJzJeqxy.1 2024-09-12T00:31:02.028 INFO:tasks.workunit.client.0.smithi102.stdout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4__shadow_mpu_test4.2~Veoert8qo8ZuuqXwmeLj2GoTagc95BN.2_1 2024-09-12T00:31:02.029 INFO:tasks.workunit.client.0.smithi102.stdout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4__shadow_mpu_test4.nUr17XOR2b6xe33KgtsY1PNYPJzJeqxy.1_1 2024-09-12T00:31:02.116 INFO:tasks.workunit.client.0.smithi102.stdout:rados ls: 2024-09-12T00:31:02.117 INFO:tasks.workunit.client.0.smithi102.stdout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4_mpu_test4 2024-09-12T00:31:02.117 INFO:tasks.workunit.client.0.smithi102.stdout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4__multipart_mpu_test4.2~Veoert8qo8ZuuqXwmeLj2GoTagc95BN.2 2024-09-12T00:31:02.117 INFO:tasks.workunit.client.0.smithi102.stdout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4__multipart_mpu_test4.nUr17XOR2b6xe33KgtsY1PNYPJzJeqxy.1 2024-09-12T00:31:02.117 INFO:tasks.workunit.client.0.smithi102.stdout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4__shadow_mpu_test4.2~Veoert8qo8ZuuqXwmeLj2GoTagc95BN.2_1 2024-09-12T00:31:02.117 INFO:tasks.workunit.client.0.smithi102.stdout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4__shadow_mpu_test4.nUr17XOR2b6xe33KgtsY1PNYPJzJeqxy.1_1 2024-09-12T00:31:02.171 INFO:tasks.workunit.client.0.smithi102.stdout:== PASSED == 2024-09-12T00:31:02.172 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:31:02.172 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:31:02.229 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:31:02.229 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:31:02.672 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:02.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:02.684 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:02.684 DEBUG:teuthology.orchestra.run.smithi102:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:31:02.729 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:02.729 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:31:02.745 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:31:02.746 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:31:02.746 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:31:02.746 DEBUG:teuthology.orchestra.run.smithi102:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:31:02.781 INFO:teuthology.orchestra.run.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:31:02.978 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:31:02.978 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:31:02.979 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key FZKNVQBAVZWHXAMILFNN --secret lkRVdWjveQb4JPmRfzsNxW4LoS00YhTdbOGu5eJrRvdu+22cci/G4A== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:31:03.069 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:03.069 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:03.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.116+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.116+0000 7f61580d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.116+0000 7f61580d79c0 20 realm 2024-09-12T00:31:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.116+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.116+0000 7f61580d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.116+0000 7f61580d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.116+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.116+0000 7f61580d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.116+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.120+0000 7f61580d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:03.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.120+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.120+0000 7f61580d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:03.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.120+0000 7f61580d79c0 20 searching for the correct realm 2024-09-12T00:31:03.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.124+0000 7f61563de640 0 -- 172.21.15.102:0/3275780620 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f614c036040 msgr2=0x7f614c01f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:03.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.132+0000 7f61553dc640 0 -- 172.21.15.102:0/3275780620 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f614810d040 msgr2=0x7f61480e5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.348+0000 7f61580d79c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:31:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.348+0000 7f61580d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:03.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.348+0000 7f61580d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.348+0000 7f61580d79c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:31:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.348+0000 7f61580d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.348+0000 7f61580d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.348+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.348+0000 7f61580d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.348+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:03.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 zone default found 2024-09-12T00:31:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 4 Realm: () 2024-09-12T00:31:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:31:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:31:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 zonegroup default 2024-09-12T00:31:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 started sync module instance, tier type = 2024-09-12T00:31:03.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.352+0000 7f61580d79c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:31:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.376+0000 7f61580d79c0 20 add_watcher() i=0 2024-09-12T00:31:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.376+0000 7f61580d79c0 20 add_watcher() i=1 2024-09-12T00:31:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.376+0000 7f61580d79c0 20 add_watcher() i=2 2024-09-12T00:31:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.376+0000 7f61580d79c0 20 add_watcher() i=3 2024-09-12T00:31:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.376+0000 7f61580d79c0 20 add_watcher() i=4 2024-09-12T00:31:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.376+0000 7f61580d79c0 20 add_watcher() i=5 2024-09-12T00:31:03.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.376+0000 7f61580d79c0 20 add_watcher() i=6 2024-09-12T00:31:03.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.376+0000 7f61580d79c0 20 add_watcher() i=7 2024-09-12T00:31:03.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.376+0000 7f61580d79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:03.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.380+0000 7f60077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:03.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.380+0000 7f61580d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:03.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.380+0000 7f61580d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:03.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.380+0000 7f61580d79c0 5 note: GC not initialized 2024-09-12T00:31:03.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.380+0000 7f60067fc640 20 reqs_thread_entry: start 2024-09-12T00:31:03.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.380+0000 7f61580d79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:03.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 20 Filter name: none 2024-09-12T00:31:03.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f5f77fff640 20 reqs_thread_entry: start 2024-09-12T00:31:03.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:31:03.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:31:03.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:31:03.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:31:03.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:31:03.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:31:03.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 cache get: name=default.rgw.meta+users.keys+FZKNVQBAVZWHXAMILFNN : miss 2024-09-12T00:31:03.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 cache put: name=default.rgw.meta+users.keys+FZKNVQBAVZWHXAMILFNN info.flags=0x0 2024-09-12T00:31:03.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 adding default.rgw.meta+users.keys+FZKNVQBAVZWHXAMILFNN to cache LRU end 2024-09-12T00:31:03.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 cache get: name=default.rgw.meta+users.keys+FZKNVQBAVZWHXAMILFNN : hit (negative entry) 2024-09-12T00:31:03.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.384+0000 7f61580d79c0 10 cache get: name=default.rgw.meta+users.keys+FZKNVQBAVZWHXAMILFNN : hit (negative entry) 2024-09-12T00:31:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.388+0000 7f61580d79c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:31:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.388+0000 7f61580d79c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:31:03.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.388+0000 7f61580d79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:31:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.388+0000 7f60397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660502 cookie 94082365187376 notifier 5576 bl.length()=675 2024-09-12T00:31:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.388+0000 7f60397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:31:03.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.388+0000 7f60397fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:31:03.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.396+0000 7f61580d79c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:31:03.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.396+0000 7f61580d79c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:31:03.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.396+0000 7f61580d79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:31:03.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.396+0000 7f6038ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660491 cookie 94082365180944 notifier 5576 bl.length()=202 2024-09-12T00:31:03.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.396+0000 7f6038ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:31:03.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.396+0000 7f6038ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:31:03.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.400+0000 7f61580d79c0 10 cache put: name=default.rgw.meta+users.keys+FZKNVQBAVZWHXAMILFNN info.flags=0x7 2024-09-12T00:31:03.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.400+0000 7f61580d79c0 10 moving default.rgw.meta+users.keys+FZKNVQBAVZWHXAMILFNN to cache LRU end 2024-09-12T00:31:03.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.400+0000 7f61580d79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:FZKNVQBAVZWHXAMILFNN, ofs0, ns] 2024-09-12T00:31:03.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.400+0000 7f6038ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660492 cookie 94082365180944 notifier 5576 bl.length()=190 2024-09-12T00:31:03.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.400+0000 7f6038ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FZKNVQBAVZWHXAMILFNN info.flags=0x7 2024-09-12T00:31:03.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.400+0000 7f6038ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FZKNVQBAVZWHXAMILFNN to cache LRU end 2024-09-12T00:31:03.401 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T00:31:03.401 INFO:teuthology.orchestra.run.smithi102.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:31:03.401 INFO:teuthology.orchestra.run.smithi102.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: "suspended": 0, 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: "subusers": [], 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: "keys": [ 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: "user": "ragweed.client.0", 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: "access_key": "FZKNVQBAVZWHXAMILFNN", 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: "secret_key": "lkRVdWjveQb4JPmRfzsNxW4LoS00YhTdbOGu5eJrRvdu+22cci/G4A==", 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: "active": true, 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T00:31:03.389260Z" 2024-09-12T00:31:03.402 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "swift_keys": [], 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": [], 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "default_placement": "", 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "default_storage_class": "", 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "placement_tags": [], 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T00:31:03.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T00:31:03.404 INFO:teuthology.orchestra.run.smithi102.stdout: "user_quota": { 2024-09-12T00:31:03.404 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T00:31:03.404 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:31:03.404 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T00:31:03.404 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:31:03.404 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T00:31:03.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T00:31:03.404 INFO:teuthology.orchestra.run.smithi102.stdout: "temp_url_keys": [], 2024-09-12T00:31:03.404 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "rgw", 2024-09-12T00:31:03.405 INFO:teuthology.orchestra.run.smithi102.stdout: "mfa_ids": [], 2024-09-12T00:31:03.405 INFO:teuthology.orchestra.run.smithi102.stdout: "account_id": "", 2024-09-12T00:31:03.405 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-12T00:31:03.405 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T00:31:03.389219Z", 2024-09-12T00:31:03.405 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-12T00:31:03.405 INFO:teuthology.orchestra.run.smithi102.stdout: "group_ids": [] 2024-09-12T00:31:03.405 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T00:31:03.405 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:31:03.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.408+0000 7f60077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:03.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.412+0000 7f61580d79c0 20 remove_watcher() i=0 2024-09-12T00:31:03.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.412+0000 7f61580d79c0 2 removed watcher, disabling cache 2024-09-12T00:31:03.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.416+0000 7f61580d79c0 20 remove_watcher() i=1 2024-09-12T00:31:03.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.416+0000 7f61580d79c0 20 remove_watcher() i=2 2024-09-12T00:31:03.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.420+0000 7f61580d79c0 20 remove_watcher() i=3 2024-09-12T00:31:03.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.424+0000 7f61580d79c0 20 remove_watcher() i=4 2024-09-12T00:31:03.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.424+0000 7f61580d79c0 20 remove_watcher() i=5 2024-09-12T00:31:03.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.428+0000 7f61580d79c0 20 remove_watcher() i=6 2024-09-12T00:31:03.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.428+0000 7f61580d79c0 20 remove_watcher() i=7 2024-09-12T00:31:03.437 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:31:03.437 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key WOGISMUBWRGSTZEXHGJU --secret 8y7L78v/UkDqaHWjan881AXa6D7EtBWP9osYxd1jYGs5IAxte/rXgQ== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:31:03.481 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:03.481 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:03.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.736+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.740+0000 7fa03d64f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.740+0000 7fa03d64f9c0 20 realm 2024-09-12T00:31:03.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.740+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.740+0000 7fa03d64f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.740+0000 7fa03d64f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:03.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.740+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.740+0000 7fa03d64f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.740+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.740+0000 7fa03d64f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:03.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.740+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.744+0000 7fa03d64f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:03.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.744+0000 7fa03d64f9c0 20 searching for the correct realm 2024-09-12T00:31:03.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.744+0000 7fa03b155640 0 -- 172.21.15.102:0/1886321922 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x558840a619b0 msgr2=0x558840a63e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:03.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.752+0000 7fa03b155640 0 -- 172.21.15.102:0/1886321922 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x558840913400 msgr2=0x7fa02c12c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:03.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:31:03.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:03.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:03.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:31:03.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:03.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:03.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:03.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:03.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 zone default found 2024-09-12T00:31:03.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 4 Realm: () 2024-09-12T00:31:03.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:31:03.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:31:03.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:03.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 zonegroup default 2024-09-12T00:31:03.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.976+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.980+0000 7fa03d64f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.980+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.980+0000 7fa03d64f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.980+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.980+0000 7fa03d64f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.980+0000 7fa03d64f9c0 20 started sync module instance, tier type = 2024-09-12T00:31:03.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:03.980+0000 7fa03d64f9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:31:03.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.000+0000 7fa03d64f9c0 20 add_watcher() i=0 2024-09-12T00:31:03.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.000+0000 7fa03d64f9c0 20 add_watcher() i=1 2024-09-12T00:31:03.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.000+0000 7fa03d64f9c0 20 add_watcher() i=2 2024-09-12T00:31:03.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.000+0000 7fa03d64f9c0 20 add_watcher() i=3 2024-09-12T00:31:03.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.000+0000 7fa03d64f9c0 20 add_watcher() i=4 2024-09-12T00:31:03.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.000+0000 7fa03d64f9c0 20 add_watcher() i=5 2024-09-12T00:31:03.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.000+0000 7fa03d64f9c0 20 add_watcher() i=6 2024-09-12T00:31:03.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.004+0000 7fa03d64f9c0 20 add_watcher() i=7 2024-09-12T00:31:03.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.004+0000 7fa03d64f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.008+0000 7f9ef1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:04.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.008+0000 7fa03d64f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.008+0000 7fa03d64f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.008+0000 7fa03d64f9c0 5 note: GC not initialized 2024-09-12T00:31:04.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.008+0000 7f9ef0fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.008+0000 7fa03d64f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 20 Filter name: none 2024-09-12T00:31:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7f9e6a7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:31:04.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:04.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:04.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:31:04.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:31:04.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:31:04.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:04.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:04.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:31:04.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:31:04.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 cache get: name=default.rgw.meta+users.keys+WOGISMUBWRGSTZEXHGJU : miss 2024-09-12T00:31:04.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:04.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:04.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 cache put: name=default.rgw.meta+users.keys+WOGISMUBWRGSTZEXHGJU info.flags=0x0 2024-09-12T00:31:04.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 adding default.rgw.meta+users.keys+WOGISMUBWRGSTZEXHGJU to cache LRU end 2024-09-12T00:31:04.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 cache get: name=default.rgw.meta+users.keys+WOGISMUBWRGSTZEXHGJU : hit (negative entry) 2024-09-12T00:31:04.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.012+0000 7fa03d64f9c0 10 cache get: name=default.rgw.meta+users.keys+WOGISMUBWRGSTZEXHGJU : hit (negative entry) 2024-09-12T00:31:04.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.016+0000 7fa03d64f9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:31:04.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.016+0000 7fa03d64f9c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:31:04.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.016+0000 7fa03d64f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:31:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.016+0000 7f9f1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660493 cookie 94043688555360 notifier 5916 bl.length()=675 2024-09-12T00:31:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.016+0000 7f9f1effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:31:04.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.016+0000 7f9f1effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:31:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.020+0000 7fa03d64f9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:31:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.020+0000 7fa03d64f9c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:31:04.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.020+0000 7fa03d64f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:31:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.024+0000 7f9f1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660503 cookie 94043688564448 notifier 5916 bl.length()=202 2024-09-12T00:31:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.024+0000 7f9f1e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:31:04.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.024+0000 7f9f1e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:31:04.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.024+0000 7fa03d64f9c0 10 cache put: name=default.rgw.meta+users.keys+WOGISMUBWRGSTZEXHGJU info.flags=0x7 2024-09-12T00:31:04.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.024+0000 7fa03d64f9c0 10 moving default.rgw.meta+users.keys+WOGISMUBWRGSTZEXHGJU to cache LRU end 2024-09-12T00:31:04.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.024+0000 7fa03d64f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:WOGISMUBWRGSTZEXHGJU, ofs0, ns] 2024-09-12T00:31:04.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.028+0000 7f9f1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1095216660531 cookie 94043688545360 notifier 5916 bl.length()=190 2024-09-12T00:31:04.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.028+0000 7f9f1e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WOGISMUBWRGSTZEXHGJU info.flags=0x7 2024-09-12T00:31:04.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.028+0000 7f9f1e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WOGISMUBWRGSTZEXHGJU to cache LRU end 2024-09-12T00:31:04.024 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T00:31:04.024 INFO:teuthology.orchestra.run.smithi102.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:31:04.024 INFO:teuthology.orchestra.run.smithi102.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:31:04.024 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: "suspended": 0, 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: "subusers": [], 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: "keys": [ 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: "user": "sysuser.client.0", 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: "access_key": "WOGISMUBWRGSTZEXHGJU", 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: "secret_key": "8y7L78v/UkDqaHWjan881AXa6D7EtBWP9osYxd1jYGs5IAxte/rXgQ==", 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: "active": true, 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T00:31:04.016647Z" 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T00:31:04.025 INFO:teuthology.orchestra.run.smithi102.stdout: "swift_keys": [], 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": [], 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "system": true, 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "default_placement": "", 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "default_storage_class": "", 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "placement_tags": [], 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T00:31:04.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "user_quota": { 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "temp_url_keys": [], 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "rgw", 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "mfa_ids": [], 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "account_id": "", 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T00:31:04.016601Z", 2024-09-12T00:31:04.027 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-12T00:31:04.028 INFO:teuthology.orchestra.run.smithi102.stdout: "group_ids": [] 2024-09-12T00:31:04.028 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T00:31:04.028 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:31:04.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.032+0000 7f9ef1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:04.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.036+0000 7fa03d64f9c0 20 remove_watcher() i=0 2024-09-12T00:31:04.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.036+0000 7fa03d64f9c0 2 removed watcher, disabling cache 2024-09-12T00:31:04.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.036+0000 7fa03d64f9c0 20 remove_watcher() i=1 2024-09-12T00:31:04.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.040+0000 7fa03d64f9c0 20 remove_watcher() i=2 2024-09-12T00:31:04.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.040+0000 7fa03d64f9c0 20 remove_watcher() i=3 2024-09-12T00:31:04.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.044+0000 7fa03d64f9c0 20 remove_watcher() i=4 2024-09-12T00:31:04.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.044+0000 7fa03d64f9c0 20 remove_watcher() i=5 2024-09-12T00:31:04.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.048+0000 7fa03d64f9c0 20 remove_watcher() i=6 2024-09-12T00:31:04.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:31:04.048+0000 7fa03d64f9c0 20 remove_watcher() i=7 2024-09-12T00:31:04.060 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:31:04.060 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:31:04.060 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:31:04.106 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:31:04.107 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:31:04.107 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:31:04.154 DEBUG:teuthology.orchestra.run.smithi102:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:31:04.343 INFO:teuthology.orchestra.run.smithi102.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:31:04.521 INFO:teuthology.orchestra.run.smithi102.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:31:05.106 INFO:teuthology.orchestra.run.smithi102.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:31:07.779 INFO:teuthology.orchestra.run.smithi102.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:31:12.134 INFO:teuthology.orchestra.run.smithi102.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=a69f2af01c83a08fd9fd758a22cdcbf0a7c26ec3454c68662ac81e2c2a5b2e64,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T00:31:12.135 INFO:teuthology.orchestra.run.smithi102.stdout:py run-test-pre: PYTHONHASHSEED='2576202646' 2024-09-12T00:31:12.135 INFO:teuthology.orchestra.run.smithi102.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:31:12.306 INFO:teuthology.orchestra.run.smithi102.stdout:============================= test session starts ============================== 2024-09-12T00:31:12.307 INFO:teuthology.orchestra.run.smithi102.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:31:12.307 INFO:teuthology.orchestra.run.smithi102.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:31:12.307 INFO:teuthology.orchestra.run.smithi102.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T00:31:12.489 INFO:teuthology.orchestra.run.smithi102.stdout:collecting ... collected 9 items 2024-09-12T00:31:12.489 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:31:23.790 INFO:teuthology.orchestra.run.smithi102.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:31:35.951 INFO:teuthology.orchestra.run.smithi102.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:31:46.376 INFO:teuthology.orchestra.run.smithi102.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:31:58.830 INFO:teuthology.orchestra.run.smithi102.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:32:12.496 INFO:teuthology.orchestra.run.smithi102.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:32:38.004 INFO:teuthology.orchestra.run.smithi102.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:33:01.878 INFO:teuthology.orchestra.run.smithi102.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:33:24.797 INFO:teuthology.orchestra.run.smithi102.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:34:08.956 INFO:teuthology.orchestra.run.smithi102.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:34:08.956 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:34:08.956 INFO:teuthology.orchestra.run.smithi102.stdout:=============================== warnings summary =============================== 2024-09-12T00:34:08.957 INFO:teuthology.orchestra.run.smithi102.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T00:34:08.957 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T00:34:08.957 INFO:teuthology.orchestra.run.smithi102.stdout: import imp 2024-09-12T00:34:08.957 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:34:08.957 INFO:teuthology.orchestra.run.smithi102.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T00:34:08.957 INFO:teuthology.orchestra.run.smithi102.stdout:=================== 9 passed, 1 warning in 176.65s (0:02:56) =================== 2024-09-12T00:34:09.014 INFO:teuthology.orchestra.run.smithi102.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:34:09.014 INFO:teuthology.orchestra.run.smithi102.stdout: py: commands succeeded 2024-09-12T00:34:09.014 INFO:teuthology.orchestra.run.smithi102.stdout: congratulations :) 2024-09-12T00:34:09.052 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:34:09.052 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:34:09.058 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:34:09.135 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:09.135 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:09.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.185+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.189+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:09.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.189+0000 7f590dab69c0 20 realm 2024-09-12T00:34:09.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.189+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.189+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:09.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.189+0000 7f590dab69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:09.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.189+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.189+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:09.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.189+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.189+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:09.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.189+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.193+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:09.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.193+0000 7f590dab69c0 20 searching for the correct realm 2024-09-12T00:34:09.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.193+0000 7f590bdbd640 0 -- 172.21.15.102:0/2956022912 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f58f40cf040 msgr2=0x7f58f4001ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:09.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.409+0000 7f590adbb640 0 -- 172.21.15.102:0/2956022912 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f590406b210 msgr2=0x7f59040898f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:09.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.625+0000 7f590dab69c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:34:09.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.625+0000 7f590dab69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:09.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.625+0000 7f590dab69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:09.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.625+0000 7f590dab69c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:34:09.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.625+0000 7f590dab69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:09.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.625+0000 7f590dab69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:09.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.625+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.625+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:09.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.625+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:09.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:09.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 zone default found 2024-09-12T00:34:09.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 4 Realm: () 2024-09-12T00:34:09.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:34:09.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:34:09.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:09.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 zonegroup default 2024-09-12T00:34:09.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:09.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:09.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:09.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 started sync module instance, tier type = 2024-09-12T00:34:09.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.629+0000 7f590dab69c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:34:09.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.653+0000 7f590dab69c0 20 add_watcher() i=0 2024-09-12T00:34:09.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.653+0000 7f590dab69c0 20 add_watcher() i=1 2024-09-12T00:34:09.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.653+0000 7f590dab69c0 20 add_watcher() i=2 2024-09-12T00:34:09.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.653+0000 7f590dab69c0 20 add_watcher() i=3 2024-09-12T00:34:09.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.653+0000 7f590dab69c0 20 add_watcher() i=4 2024-09-12T00:34:09.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.653+0000 7f590dab69c0 20 add_watcher() i=5 2024-09-12T00:34:09.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.653+0000 7f590dab69c0 20 add_watcher() i=6 2024-09-12T00:34:09.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.657+0000 7f590dab69c0 20 add_watcher() i=7 2024-09-12T00:34:09.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.657+0000 7f590dab69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:09.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.661+0000 7f57c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:09.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.661+0000 7f590dab69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:09.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.661+0000 7f590dab69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:09.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.753+0000 7f57c17e2640 20 reqs_thread_entry: start 2024-09-12T00:34:09.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.753+0000 7f590dab69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:09.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.753+0000 7f590dab69c0 20 Filter name: none 2024-09-12T00:34:09.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.753+0000 7f57ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:09.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.753+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:34:09.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.753+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:34:09.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:34:09.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:34:09.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:09.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5 : miss 2024-09-12T00:34:09.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:34:09.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5 info.flags=0x17 2024-09-12T00:34:09.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5 to cache LRU end 2024-09-12T00:34:09.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:09.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:09.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.757+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5 2024-09-12T00:34:09.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.761+0000 7f590dab69c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:34:09.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.761+0000 7f590dab69c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:34:09.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.761+0000 7f590dab69c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:34:09.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.761+0000 7f590dab69c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:34:09.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.761+0000 7f590dab69c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:34:09.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.761+0000 7f590dab69c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:34:09.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.761+0000 7f590dab69c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:34:09.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.765+0000 7f590dab69c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:34:09.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.765+0000 7f590dab69c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:34:09.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.765+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.769+0000 7f590dab69c0 10 manifest: total_size = 7822 2024-09-12T00:34:09.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.769+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11671590268409154190 2024-09-12T00:34:09.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.769+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.769+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652ffe558 2024-09-12T00:34:09.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.769+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5.1 2024-09-12T00:34:09.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.773+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:09.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.773+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=7822 stripe_ofs=7822 part_ofs=0 rule->part_size=0 2024-09-12T00:34:09.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.773+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11671590268409154190 2024-09-12T00:34:09.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.773+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.773+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.lRtw9nhTM47NKPJ95WgfbV1qd9CSOkK_0 2024-09-12T00:34:09.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.773+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:09.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.773+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.773+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11671590268409154190 2024-09-12T00:34:09.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.777+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:34:09.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.777+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.777+0000 7f590dab69c0 10 manifest: total_size = 7409 2024-09-12T00:34:09.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.777+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8611142453384407858 2024-09-12T00:34:09.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.777+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.777+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652ffe558 2024-09-12T00:34:09.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.777+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5.2 2024-09-12T00:34:09.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.785+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:09.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.785+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=7409 stripe_ofs=7409 part_ofs=0 rule->part_size=0 2024-09-12T00:34:09.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.785+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8611142453384407858 2024-09-12T00:34:09.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.785+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.785+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.VA2Ueg3-oKFbN7mXGjsuoNX7uUtTKVU_0 2024-09-12T00:34:09.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.785+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:34:09.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.785+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.785+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8611142453384407858 2024-09-12T00:34:09.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.785+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:34:09.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.789+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.789+0000 7f590dab69c0 10 manifest: total_size = 5043 2024-09-12T00:34:09.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.789+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11949667394087077435 2024-09-12T00:34:09.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.789+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.789+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652ffe558 2024-09-12T00:34:09.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.789+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5.2 2024-09-12T00:34:09.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.793+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:09.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.793+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5043 stripe_ofs=5043 part_ofs=0 rule->part_size=0 2024-09-12T00:34:09.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11949667394087077435 2024-09-12T00:34:09.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.Psz0S1bKVT9sdpn9efJu7XS75xieRVG_0 2024-09-12T00:34:09.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:09.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11949667394087077435 2024-09-12T00:34:09.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.797+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:34:09.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.797+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.797+0000 7f590dab69c0 10 manifest: total_size = 7558 2024-09-12T00:34:09.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.797+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16515131115276443157 2024-09-12T00:34:09.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.797+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.797+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652ffe558 2024-09-12T00:34:09.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.797+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5.3 2024-09-12T00:34:09.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.801+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:09.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.801+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=7558 stripe_ofs=7558 part_ofs=0 rule->part_size=0 2024-09-12T00:34:09.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.801+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16515131115276443157 2024-09-12T00:34:09.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.801+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.801+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.aP1HB-1la_mXZrDtgcC0Dnd9NNgRVEO_0 2024-09-12T00:34:09.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.801+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:09.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.801+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.801+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16515131115276443157 2024-09-12T00:34:09.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.805+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:34:09.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.805+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.809+0000 7f590dab69c0 10 manifest: total_size = 7678 2024-09-12T00:34:09.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.809+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13634469972292428969 2024-09-12T00:34:09.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.809+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.809+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652ffe558 2024-09-12T00:34:09.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.809+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5.4 2024-09-12T00:34:09.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.813+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:09.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.813+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=7678 stripe_ofs=7678 part_ofs=0 rule->part_size=0 2024-09-12T00:34:09.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.813+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13634469972292428969 2024-09-12T00:34:09.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.813+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.813+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.ZyTNT8ahW-Dr1v5ubzL_5a-eLGfgxME_0 2024-09-12T00:34:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.813+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.813+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.813+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13634469972292428969 2024-09-12T00:34:09.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.817+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:34:09.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.817+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.817+0000 7f590dab69c0 10 manifest: total_size = 13593 2024-09-12T00:34:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.817+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17690005587684849383 2024-09-12T00:34:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.817+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.817+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652ffe558 2024-09-12T00:34:09.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.817+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5.4 2024-09-12T00:34:09.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.825+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:09.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.825+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=13593 stripe_ofs=13593 part_ofs=0 rule->part_size=0 2024-09-12T00:34:09.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.825+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17690005587684849383 2024-09-12T00:34:09.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.825+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.825+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.sq9pZDMDl4RefBfzRZVquEVjTMG56LP_0 2024-09-12T00:34:09.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.825+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:09.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.825+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.825+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17690005587684849383 2024-09-12T00:34:09.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.825+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:34:09.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.825+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.829+0000 7f590dab69c0 10 manifest: total_size = 7426 2024-09-12T00:34:09.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.829+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14231876287855177345 2024-09-12T00:34:09.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.829+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.829+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652ffe558 2024-09-12T00:34:09.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.829+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5.5 2024-09-12T00:34:09.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.833+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:09.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.833+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=7426 stripe_ofs=7426 part_ofs=0 rule->part_size=0 2024-09-12T00:34:09.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.833+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14231876287855177345 2024-09-12T00:34:09.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.833+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.833+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.QXjfaPWP0TpKcCTxEYNvSvLKJiEx4fx_0 2024-09-12T00:34:09.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.833+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:09.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.833+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.833+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14231876287855177345 2024-09-12T00:34:09.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.837+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:34:09.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.837+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.837+0000 7f590dab69c0 10 manifest: total_size = 14229 2024-09-12T00:34:09.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.837+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7220778308589289833 2024-09-12T00:34:09.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.837+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904095040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.837+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652ffe558 2024-09-12T00:34:09.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.837+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5.7 2024-09-12T00:34:09.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.845+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:09.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.845+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=14229 stripe_ofs=14229 part_ofs=0 rule->part_size=0 2024-09-12T00:34:09.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.845+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7220778308589289833 2024-09-12T00:34:09.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.845+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.845+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.-GQOhEVzbpW6zv7ViG1JNSStuxzkrlm_0 2024-09-12T00:34:09.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.845+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:34:09.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.845+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.845+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7220778308589289833 2024-09-12T00:34:09.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.845+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:34:09.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.845+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc081520 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.849+0000 7f590dab69c0 10 manifest: total_size = 5420 2024-09-12T00:34:09.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.849+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14491418996404770659 2024-09-12T00:34:09.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.849+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc081520 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.849+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652ffe558 2024-09-12T00:34:09.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.849+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5.8 2024-09-12T00:34:09.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.853+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:09.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.853+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5420 stripe_ofs=5420 part_ofs=0 rule->part_size=0 2024-09-12T00:34:09.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.853+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14491418996404770659 2024-09-12T00:34:09.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.853+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.853+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.QZb3zz9QPaH4xdt0K-9XOBoDVs6OKof_0 2024-09-12T00:34:09.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.853+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:09.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.853+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.853+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14491418996404770659 2024-09-12T00:34:09.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.857+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:34:09.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.857+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:09.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.857+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:09.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.857+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:09.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.857+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:09.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.857+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:09.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.857+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:09.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.857+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:09.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.861+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:34:09.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.861+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.865+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:34:09.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.865+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:34:09.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.865+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:34:09.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.865+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:34:09.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.865+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:34:09.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.865+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398875 cookie 94585161579408 notifier 5615 bl.length()=162 2024-09-12T00:34:09.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.873+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5 from cache 2024-09-12T00:34:09.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.873+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5, ofs0, ns] 2024-09-12T00:34:09.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.873+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398871 cookie 94585161599104 notifier 5615 bl.length()=219 2024-09-12T00:34:09.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.881+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5 : miss 2024-09-12T00:34:09.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.881+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.881+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:09.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.881+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5 info.flags=0x0 2024-09-12T00:34:09.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.881+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5 to cache LRU end 2024-09-12T00:34:09.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.885+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12 : miss 2024-09-12T00:34:09.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.885+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.885+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:34:09.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.885+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12 info.flags=0x17 2024-09-12T00:34:09.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.885+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12 to cache LRU end 2024-09-12T00:34:09.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.885+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:09.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.885+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:09.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.885+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12 2024-09-12T00:34:09.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.897+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:34:09.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.897+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f89410 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.897+0000 7f590dab69c0 10 manifest: total_size = 886297 2024-09-12T00:34:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.897+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1577802116135324901 2024-09-12T00:34:09.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.897+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f89410 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x560652ffe558 s->prefetch_data=0 2024-09-12T00:34:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.897+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652ffe558 2024-09-12T00:34:09.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.897+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12.10 2024-09-12T00:34:09.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:09.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-12T00:34:09.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:34:09.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:09.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-12T00:34:09.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:34:09.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:09.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2024-09-12T00:34:09.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:34:09.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:34:09.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1577802116135324901 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12__multipart_foo.2~b10p9vcnypOkW1PsNntLd1bQWfVC14U.1 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12__multipart_foo.2~b10p9vcnypOkW1PsNntLd1bQWfVC14U.2 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12__multipart_foo.2~b10p9vcnypOkW1PsNntLd1bQWfVC14U.3 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12__multipart_foo.2~b10p9vcnypOkW1PsNntLd1bQWfVC14U.4 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:34:09.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.905+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1577802116135324901 2024-09-12T00:34:09.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.909+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:34:09.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.909+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:09.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.909+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:09.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.909+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:09.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.909+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:09.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.909+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:09.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.909+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:09.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.909+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:09.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.913+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:34:09.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.913+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.917+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:34:09.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.917+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:34:09.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.917+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:34:09.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.921+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:34:09.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.921+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:34:09.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.921+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398909 cookie 94585161577200 notifier 5615 bl.length()=191 2024-09-12T00:34:09.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.925+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12 from cache 2024-09-12T00:34:09.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.925+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12, ofs0, ns] 2024-09-12T00:34:09.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.929+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398876 cookie 94585161589264 notifier 5615 bl.length()=249 2024-09-12T00:34:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.937+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12 : miss 2024-09-12T00:34:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.937+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.937+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:09.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.937+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12 info.flags=0x0 2024-09-12T00:34:09.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.937+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12 to cache LRU end 2024-09-12T00:34:09.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.941+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13 : miss 2024-09-12T00:34:09.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.941+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.945+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:34:09.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.945+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13 info.flags=0x17 2024-09-12T00:34:09.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.945+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13 to cache LRU end 2024-09-12T00:34:09.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.945+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:09.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.945+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:09.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.945+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13 2024-09-12T00:34:09.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.957+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:34:09.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.957+0000 7f590dab69c0 20 get_obj_state: octx=0x560652ffdcb0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:09.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.957+0000 7f590dab69c0 10 manifest: total_size = 26078 2024-09-12T00:34:09.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.957+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10115152549794325198 2024-09-12T00:34:09.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.957+0000 7f590dab69c0 20 get_obj_state: octx=0x560652ffdcb0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:09.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.957+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:09.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.957+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13.10 2024-09-12T00:34:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=7669 rules.size()=3 2024-09-12T00:34:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7669 2024-09-12T00:34:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=7669 stripe_ofs=7669 part_ofs=7669 rule->part_size=7671 2024-09-12T00:34:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T00:34:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4197877 part_ofs=7669 rule->part_size=7671 2024-09-12T00:34:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=15340 stripe_ofs=15340 part_ofs=15340 rule->part_size=7671 2024-09-12T00:34:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T00:34:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4205548 part_ofs=15340 rule->part_size=7671 2024-09-12T00:34:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=23011 stripe_ofs=23011 part_ofs=23011 rule->part_size=3067 2024-09-12T00:34:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-12T00:34:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4213219 part_ofs=23011 rule->part_size=3067 2024-09-12T00:34:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=26078 stripe_ofs=26078 part_ofs=26078 rule->part_size=3067 2024-09-12T00:34:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10115152549794325198 2024-09-12T00:34:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13__multipart_foo.2~UK8-FJQIYzfCMy6eXUaGq6ugxjWanIk.1 2024-09-12T00:34:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:34:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13__multipart_foo.2~UK8-FJQIYzfCMy6eXUaGq6ugxjWanIk.2 2024-09-12T00:34:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:34:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13__multipart_foo.2~UK8-FJQIYzfCMy6eXUaGq6ugxjWanIk.3 2024-09-12T00:34:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:34:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13__multipart_foo.2~UK8-FJQIYzfCMy6eXUaGq6ugxjWanIk.4 2024-09-12T00:34:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:34:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.965+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10115152549794325198 2024-09-12T00:34:09.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.969+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:34:09.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.969+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:09.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.969+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:09.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.969+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:09.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.969+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:09.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.969+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:09.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.969+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:09.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.969+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:09.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.977+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:34:09.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.977+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.977+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:34:09.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.977+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:34:09.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.977+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:34:09.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.981+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:34:09.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.981+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:34:09.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.981+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398868 cookie 94585161587136 notifier 5615 bl.length()=198 2024-09-12T00:34:09.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.989+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13 from cache 2024-09-12T00:34:09.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.989+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13, ofs0, ns] 2024-09-12T00:34:09.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.989+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398910 cookie 94585161577200 notifier 5615 bl.length()=256 2024-09-12T00:34:09.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.997+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13 : miss 2024-09-12T00:34:09.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.997+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.997+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:09.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.997+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13 info.flags=0x0 2024-09-12T00:34:09.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:09.997+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13 to cache LRU end 2024-09-12T00:34:09.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.005+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11 : miss 2024-09-12T00:34:09.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.005+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:09.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.005+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:34:09.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.005+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11 info.flags=0x17 2024-09-12T00:34:09.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.005+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11 to cache LRU end 2024-09-12T00:34:09.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.005+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:09.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.005+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:09.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.005+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11 2024-09-12T00:34:10.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.013+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo[C9xe.0qaZFN5TgzQa-RHHJCRsbbBI.t] 2024-09-12T00:34:10.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.013+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11.10 2024-09-12T00:34:10.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.017+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff520 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.017+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 39s6pu85qnbwts1c0zdidnhy4b02acw0 2024-09-12T00:34:10.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.017+0000 7f590dab69c0 20 get_obj_state_impl: setting s->olh_tag to p7n5qa3z64dv43756e2b4juc7cckgodf 2024-09-12T00:34:10.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.017+0000 7f590dab69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p7n5qa3z64dv43756e2b4juc7cckgodf 2024-09-12T00:34:10.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.021+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11.10 2024-09-12T00:34:10.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.025+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11.10 2024-09-12T00:34:10.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.025+0000 7f590dab69c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:34:10.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.025+0000 7f590dab69c0 20 olh_log_entry: epoch=3 op=3 key=foo[C9xe.0qaZFN5TgzQa-RHHJCRsbbBI.t] 2024-09-12T00:34:10.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.025+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff520 obj=test-client.0-r-test-multipart-index-versioning.1:_:C9xe.0qaZFN5TgzQa-RHHJCRsbbBI.t_foo state=0x560652f839b8 s->prefetch_data=0 2024-09-12T00:34:10.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.025+0000 7f590dab69c0 10 manifest: total_size = 886297 2024-09-12T00:34:10.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.025+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7671286631638423017 2024-09-12T00:34:10.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.025+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff520 obj=test-client.0-r-test-multipart-index-versioning.1:_:C9xe.0qaZFN5TgzQa-RHHJCRsbbBI.t_foo state=0x560652f839b8 s->prefetch_data=0 2024-09-12T00:34:10.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.025+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f839b8 2024-09-12T00:34:10.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.025+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11.10 2024-09-12T00:34:10.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.029+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:10.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.029+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7671286631638423017 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11__multipart_foo.2~DjqKVlkyAwprX9SlTywqTbL8wxPllcu.1 2024-09-12T00:34:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:34:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11__multipart_foo.2~DjqKVlkyAwprX9SlTywqTbL8wxPllcu.2 2024-09-12T00:34:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:34:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11__multipart_foo.2~DjqKVlkyAwprX9SlTywqTbL8wxPllcu.3 2024-09-12T00:34:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:34:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11__multipart_foo.2~DjqKVlkyAwprX9SlTywqTbL8wxPllcu.4 2024-09-12T00:34:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:34:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7671286631638423017 2024-09-12T00:34:10.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.033+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo[C9xe.0qaZFN5TgzQa-RHHJCRsbbBI.t] 2024-09-12T00:34:10.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.037+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff520 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.041+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11.10 2024-09-12T00:34:10.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.045+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11.10 2024-09-12T00:34:10.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.045+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:10.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.045+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:10.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.045+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:10.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.045+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:10.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.045+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:10.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.045+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:10.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.045+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:10.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.049+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:34:10.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.049+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.049+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:34:10.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.049+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:34:10.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.049+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:34:10.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.053+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:34:10.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.053+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:34:10.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.053+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398869 cookie 94585161587136 notifier 5615 bl.length()=193 2024-09-12T00:34:10.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.057+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11 from cache 2024-09-12T00:34:10.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.057+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11, ofs0, ns] 2024-09-12T00:34:10.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.061+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398904 cookie 94585161597904 notifier 5615 bl.length()=251 2024-09-12T00:34:10.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.065+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11 : miss 2024-09-12T00:34:10.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.065+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.069+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:10.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.069+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11 info.flags=0x0 2024-09-12T00:34:10.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.069+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11 to cache LRU end 2024-09-12T00:34:10.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.073+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10 : miss 2024-09-12T00:34:10.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.073+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.073+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T00:34:10.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.073+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10 info.flags=0x17 2024-09-12T00:34:10.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.073+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10 to cache LRU end 2024-09-12T00:34:10.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.073+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:10.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.073+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:10.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.073+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10 2024-09-12T00:34:10.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.081+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:34:10.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.081+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f9a5c0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.085+0000 7f590dab69c0 10 manifest: total_size = 74198 2024-09-12T00:34:10.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.085+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2358758810885434439 2024-09-12T00:34:10.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.085+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f9a5c0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.085+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.085+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10.10 2024-09-12T00:34:10.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:34:10.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2024-09-12T00:34:10.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=20613 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4252047 part_ofs=61839 rule->part_size=12359 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2358758810885434439 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10__multipart_foo.2~05y2U0w054H8nNKylVnDu9YY95Be4cb.1 2024-09-12T00:34:10.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:34:10.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10__multipart_foo.2~05y2U0w054H8nNKylVnDu9YY95Be4cb.2 2024-09-12T00:34:10.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:34:10.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10__multipart_foo.2~05y2U0w054H8nNKylVnDu9YY95Be4cb.3 2024-09-12T00:34:10.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:34:10.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10__multipart_foo.2~05y2U0w054H8nNKylVnDu9YY95Be4cb.4 2024-09-12T00:34:10.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:34:10.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.089+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2358758810885434439 2024-09-12T00:34:10.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.093+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:34:10.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.093+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:10.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.093+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:10.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.097+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:10.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.097+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:10.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.097+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:10.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.097+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:10.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.097+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:10.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.097+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:34:10.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.097+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.101+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T00:34:10.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.101+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:34:10.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.101+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:34:10.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.101+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:34:10.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.101+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:34:10.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.105+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398877 cookie 94585161589264 notifier 5615 bl.length()=183 2024-09-12T00:34:10.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.109+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10 from cache 2024-09-12T00:34:10.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.109+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10, ofs0, ns] 2024-09-12T00:34:10.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.109+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398872 cookie 94585161595328 notifier 5615 bl.length()=241 2024-09-12T00:34:10.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.117+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10 : miss 2024-09-12T00:34:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.117+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.121+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.121+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10 info.flags=0x0 2024-09-12T00:34:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.121+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10 to cache LRU end 2024-09-12T00:34:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.125+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16 : miss 2024-09-12T00:34:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.125+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.125+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:34:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.125+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16 info.flags=0x17 2024-09-12T00:34:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.125+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16 to cache LRU end 2024-09-12T00:34:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.125+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.125+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.125+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16 2024-09-12T00:34:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.125+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:34:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.129+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:34:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.129+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:34:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.129+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:34:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.129+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:34:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.129+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:34:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.133+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:34:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.133+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:34:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.133+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:34:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.133+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:34:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.133+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:34:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.133+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:34:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.133+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f817d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.137+0000 7f590dab69c0 10 manifest: total_size = 22651 2024-09-12T00:34:10.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.137+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _vGJJbJhVhThrWpzWjbuG6vVGT2a8iAJ 2024-09-12T00:34:10.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.137+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f817d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.137+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.137+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.0 2024-09-12T00:34:10.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.141+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.141+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.141+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _vGJJbJhVhThrWpzWjbuG6vVGT2a8iAJ 2024-09-12T00:34:10.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.141+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.141+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.DHqTXpzhIkdbgxtT9Kehh9ciBJzYmP9_0 2024-09-12T00:34:10.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.141+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:34:10.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.141+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.141+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _vGJJbJhVhThrWpzWjbuG6vVGT2a8iAJ 2024-09-12T00:34:10.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.145+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:34:10.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.145+0000 7f590dab69c0 20 get_obj_state: octx=0x560652ffdc10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.145+0000 7f590dab69c0 10 manifest: total_size = 5242880 2024-09-12T00:34:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.145+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _2uEks0qrkkOWBt8aPZ0qbr-ARKzPqMT 2024-09-12T00:34:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.145+0000 7f590dab69c0 20 get_obj_state: octx=0x560652ffdc10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.145+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.145+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.2 2024-09-12T00:34:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _2uEks0qrkkOWBt8aPZ0qbr-ARKzPqMT 2024-09-12T00:34:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.WnFB3raBzI3BG8QXfR86sj0tQs7sp-O_0 2024-09-12T00:34:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:34:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.WnFB3raBzI3BG8QXfR86sj0tQs7sp-O_1 2024-09-12T00:34:10.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:34:10.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _2uEks0qrkkOWBt8aPZ0qbr-ARKzPqMT 2024-09-12T00:34:10.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.153+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:34:10.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.157+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904064080 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.157+0000 7f590dab69c0 10 manifest: total_size = 5242880 2024-09-12T00:34:10.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.157+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1827983661902159064 2024-09-12T00:34:10.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.157+0000 7f590dab69c0 20 get_obj_state: octx=0x7f5904064080 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.157+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.157+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.3 2024-09-12T00:34:10.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1827983661902159064 2024-09-12T00:34:10.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.rpRqJwZ-BbxkDLwhWBOfasSC6xAzk3m_0 2024-09-12T00:34:10.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:34:10.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.rpRqJwZ-BbxkDLwhWBOfasSC6xAzk3m_1 2024-09-12T00:34:10.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:34:10.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.161+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1827983661902159064 2024-09-12T00:34:10.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.165+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:34:10.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.165+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f412e480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.165+0000 7f590dab69c0 10 manifest: total_size = 5242880 2024-09-12T00:34:10.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.165+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _5vwNy4MIl_8JUZdS-FOZPdDmqlrG4Af 2024-09-12T00:34:10.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.165+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f412e480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.165+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.165+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.5 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _5vwNy4MIl_8JUZdS-FOZPdDmqlrG4Af 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.ianXGxFJwM3pdJOodBGB-eHZmrcUOpa_0 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.ianXGxFJwM3pdJOodBGB-eHZmrcUOpa_1 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:34:10.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _5vwNy4MIl_8JUZdS-FOZPdDmqlrG4Af 2024-09-12T00:34:10.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc05bcd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:34:10.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 10 manifest: total_size = 5242880 2024-09-12T00:34:10.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _D8Vg2CU2RxKXR_8KNYC5b5XnU5IwCnL 2024-09-12T00:34:10.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc05bcd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.173+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.5 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _D8Vg2CU2RxKXR_8KNYC5b5XnU5IwCnL 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.PhHFjwzUMLKqqrRUE0CTKhnTIh8VDrb_0 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.PhHFjwzUMLKqqrRUE0CTKhnTIh8VDrb_1 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:34:10.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.181+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _D8Vg2CU2RxKXR_8KNYC5b5XnU5IwCnL 2024-09-12T00:34:10.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.185+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:34:10.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.185+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc002f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.185+0000 7f590dab69c0 10 manifest: total_size = 22651 2024-09-12T00:34:10.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.185+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12907920396944960048 2024-09-12T00:34:10.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.185+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc002f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.185+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.185+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.5 2024-09-12T00:34:10.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.193+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.193+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.193+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12907920396944960048 2024-09-12T00:34:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.193+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.193+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.UZPWG0gzTqv6bp1ahMDgckqb317an0e_0 2024-09-12T00:34:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.193+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:34:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.193+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.193+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12907920396944960048 2024-09-12T00:34:10.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.193+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:34:10.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.193+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f412e480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.197+0000 7f590dab69c0 10 manifest: total_size = 5242880 2024-09-12T00:34:10.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.197+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _6KxwbkZqXAzjNOghv52OW3PRXXnyzcX 2024-09-12T00:34:10.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.197+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f412e480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.197+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.197+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.7 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _6KxwbkZqXAzjNOghv52OW3PRXXnyzcX 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.WqDC_sDN3FywObJ9ZUgYonNO7MWZJdA_0 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.WqDC_sDN3FywObJ9ZUgYonNO7MWZJdA_1 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _6KxwbkZqXAzjNOghv52OW3PRXXnyzcX 2024-09-12T00:34:10.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:34:10.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc002f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 10 manifest: total_size = 5242880 2024-09-12T00:34:10.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7939470501903829136 2024-09-12T00:34:10.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.201+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc002f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.205+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.205+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.7 2024-09-12T00:34:10.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7939470501903829136 2024-09-12T00:34:10.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.JZKSSeWujvWi-C2NXrnN19zathen9DW_0 2024-09-12T00:34:10.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:34:10.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.JZKSSeWujvWi-C2NXrnN19zathen9DW_1 2024-09-12T00:34:10.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:34:10.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7939470501903829136 2024-09-12T00:34:10.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.209+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:34:10.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.213+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc002f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.213+0000 7f590dab69c0 10 manifest: total_size = 22651 2024-09-12T00:34:10.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.213+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2300748505700008841 2024-09-12T00:34:10.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.213+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc002f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.213+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.213+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.7 2024-09-12T00:34:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.217+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.217+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.217+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2300748505700008841 2024-09-12T00:34:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.217+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.217+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.UZPWG0gzTqv6bp1ahMDgckqb317an0e_0 2024-09-12T00:34:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.217+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:34:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.217+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.217+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2300748505700008841 2024-09-12T00:34:10.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.221+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:34:10.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.221+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc05bcd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.221+0000 7f590dab69c0 10 manifest: total_size = 5242880 2024-09-12T00:34:10.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.221+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9858672795371025214 2024-09-12T00:34:10.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.221+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc05bcd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.221+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.221+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.8 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9858672795371025214 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.JZKSSeWujvWi-C2NXrnN19zathen9DW_0 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.JZKSSeWujvWi-C2NXrnN19zathen9DW_1 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:34:10.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9858672795371025214 2024-09-12T00:34:10.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f4007440 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:34:10.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 10 manifest: total_size = 22651 2024-09-12T00:34:10.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _d4DW6mvUm7wcpsS2qzp6VVIbqtnw4uz 2024-09-12T00:34:10.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f4007440 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.229+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.8 2024-09-12T00:34:10.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.237+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.237+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.237+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _d4DW6mvUm7wcpsS2qzp6VVIbqtnw4uz 2024-09-12T00:34:10.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.237+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.237+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.BGVJdbLeESRKdXjH2n-ypVk3hXJ8qwx_0 2024-09-12T00:34:10.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.237+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:34:10.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.237+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.237+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _d4DW6mvUm7wcpsS2qzp6VVIbqtnw4uz 2024-09-12T00:34:10.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.241+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc002f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.241+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:34:10.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.241+0000 7f590dab69c0 10 manifest: total_size = 5242880 2024-09-12T00:34:10.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.241+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15993588399308755495 2024-09-12T00:34:10.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.241+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc002f60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x560652f98e08 s->prefetch_data=0 2024-09-12T00:34:10.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.241+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f98e08 2024-09-12T00:34:10.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.241+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16.9 2024-09-12T00:34:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15993588399308755495 2024-09-12T00:34:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.rpRqJwZ-BbxkDLwhWBOfasSC6xAzk3m_0 2024-09-12T00:34:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:34:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.rpRqJwZ-BbxkDLwhWBOfasSC6xAzk3m_1 2024-09-12T00:34:10.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:34:10.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15993588399308755495 2024-09-12T00:34:10.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:34:10.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:10.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.249+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.253+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.253+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.253+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.253+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:10.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.253+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:10.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.257+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:34:10.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.257+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.257+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:34:10.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.257+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:34:10.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.257+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:34:10.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.261+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:34:10.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.261+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:34:10.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.261+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398870 cookie 94585161587136 notifier 5615 bl.length()=189 2024-09-12T00:34:10.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.269+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16 from cache 2024-09-12T00:34:10.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.269+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16, ofs0, ns] 2024-09-12T00:34:10.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.269+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398905 cookie 94585161597904 notifier 5615 bl.length()=247 2024-09-12T00:34:10.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.277+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16 : miss 2024-09-12T00:34:10.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.277+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.277+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:10.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.277+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16 info.flags=0x0 2024-09-12T00:34:10.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.277+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16 to cache LRU end 2024-09-12T00:34:10.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.281+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17 : miss 2024-09-12T00:34:10.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.281+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.285+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:34:10.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.285+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17 info.flags=0x17 2024-09-12T00:34:10.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.285+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17 to cache LRU end 2024-09-12T00:34:10.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.285+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:10.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.285+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:10.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.285+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17 2024-09-12T00:34:10.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.285+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:34:10.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.285+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:34:10.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.289+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:34:10.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.289+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:34:10.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.289+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:34:10.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.289+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:34:10.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:34:10.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:34:10.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:34:10.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:34:10.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:34:10.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:34:10.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f98710 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 10 manifest: total_size = 541681 2024-09-12T00:34:10.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _Nr5HWU4fHMmgoONQaSq83TryPwxRnwb 2024-09-12T00:34:10.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f98710 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.293+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.0 2024-09-12T00:34:10.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.301+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.301+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.301+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Nr5HWU4fHMmgoONQaSq83TryPwxRnwb 2024-09-12T00:34:10.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.301+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.301+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.-LpWt4zCZX7NWX-TP7NzP6fYAU_mZfT_0 2024-09-12T00:34:10.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.301+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:34:10.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.301+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.301+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _Nr5HWU4fHMmgoONQaSq83TryPwxRnwb 2024-09-12T00:34:10.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.301+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:34:10.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.305+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f4a690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.305+0000 7f590dab69c0 10 manifest: total_size = 11534336 2024-09-12T00:34:10.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.305+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _J41v_5Xy4r0QG7FXOz5m3CbugGJAotd 2024-09-12T00:34:10.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.305+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f4a690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.305+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.305+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.2 2024-09-12T00:34:10.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _J41v_5Xy4r0QG7FXOz5m3CbugGJAotd 2024-09-12T00:34:10.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.dXu6J5kSJnuG7arjiAzFrte0ml3yFvz_0 2024-09-12T00:34:10.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:34:10.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.dXu6J5kSJnuG7arjiAzFrte0ml3yFvz_1 2024-09-12T00:34:10.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:34:10.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.dXu6J5kSJnuG7arjiAzFrte0ml3yFvz_2 2024-09-12T00:34:10.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T00:34:10.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _J41v_5Xy4r0QG7FXOz5m3CbugGJAotd 2024-09-12T00:34:10.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.309+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:34:10.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.313+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f4a690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.313+0000 7f590dab69c0 10 manifest: total_size = 11534336 2024-09-12T00:34:10.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.313+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14408056009544830399 2024-09-12T00:34:10.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.313+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f4a690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.313+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.313+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.3 2024-09-12T00:34:10.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14408056009544830399 2024-09-12T00:34:10.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.1 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.1_1 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.2 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.2_1 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.3 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14408056009544830399 2024-09-12T00:34:10.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.321+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:34:10.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.325+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f40dff80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.325+0000 7f590dab69c0 10 manifest: total_size = 11534336 2024-09-12T00:34:10.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.325+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _M07buE4WU1Ha57_RxitDd0c3A8T6dLQ 2024-09-12T00:34:10.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.325+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f40dff80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.325+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.325+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.5 2024-09-12T00:34:10.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _M07buE4WU1Ha57_RxitDd0c3A8T6dLQ 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.mDmw9DQC8ZU28B23eM1bODkfJktgb68_0 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.mDmw9DQC8ZU28B23eM1bODkfJktgb68_1 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.mDmw9DQC8ZU28B23eM1bODkfJktgb68_2 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.329+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _M07buE4WU1Ha57_RxitDd0c3A8T6dLQ 2024-09-12T00:34:10.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.333+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:34:10.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.333+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f40ad140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.333+0000 7f590dab69c0 10 manifest: total_size = 11534336 2024-09-12T00:34:10.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.333+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _x12j2X52TU6XxqDfmZ52v89gyrjWGsi 2024-09-12T00:34:10.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.333+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f40ad140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.333+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.333+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.5 2024-09-12T00:34:10.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _x12j2X52TU6XxqDfmZ52v89gyrjWGsi 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.0vg4kXqwWVMrqlk8RSJBAU2AvJb4XzY_0 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.0vg4kXqwWVMrqlk8RSJBAU2AvJb4XzY_1 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.0vg4kXqwWVMrqlk8RSJBAU2AvJb4XzY_2 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.341+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _x12j2X52TU6XxqDfmZ52v89gyrjWGsi 2024-09-12T00:34:10.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.345+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:34:10.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.345+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f7f040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.345+0000 7f590dab69c0 10 manifest: total_size = 541681 2024-09-12T00:34:10.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.345+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2519118478709484508 2024-09-12T00:34:10.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.345+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f7f040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.345+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.345+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.5 2024-09-12T00:34:10.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:10.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-12T00:34:10.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:34:10.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=49187 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2519118478709484508 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.1 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.2 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.3 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:34:10.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.349+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2519118478709484508 2024-09-12T00:34:10.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.353+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:34:10.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.353+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f40ad140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.353+0000 7f590dab69c0 10 manifest: total_size = 11534336 2024-09-12T00:34:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.353+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _vFc5908twqob9iIend3LaPVLcgo7ytX 2024-09-12T00:34:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.353+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f40ad140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.353+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.353+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.7 2024-09-12T00:34:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _vFc5908twqob9iIend3LaPVLcgo7ytX 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.2xXYcTM8sQuJ_As-s1wqgJ_Ek8YEp8K_0 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.2xXYcTM8sQuJ_As-s1wqgJ_Ek8YEp8K_1 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.2xXYcTM8sQuJ_As-s1wqgJ_Ek8YEp8K_2 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _vFc5908twqob9iIend3LaPVLcgo7ytX 2024-09-12T00:34:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f7f040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.361+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:34:10.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.365+0000 7f590dab69c0 10 manifest: total_size = 11534336 2024-09-12T00:34:10.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.365+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15309283241685018400 2024-09-12T00:34:10.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.365+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f7f040 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.365+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.365+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.7 2024-09-12T00:34:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15309283241685018400 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.1 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.1_1 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:34:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.2 2024-09-12T00:34:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:34:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.2_1 2024-09-12T00:34:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T00:34:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.3 2024-09-12T00:34:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T00:34:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.369+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15309283241685018400 2024-09-12T00:34:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.373+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:34:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.373+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f86cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.373+0000 7f590dab69c0 10 manifest: total_size = 541681 2024-09-12T00:34:10.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.373+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14536320832121734036 2024-09-12T00:34:10.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.373+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f86cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.373+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.373+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.7 2024-09-12T00:34:10.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:10.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-12T00:34:10.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:34:10.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:10.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=49187 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14536320832121734036 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.1 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.2 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.3 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14536320832121734036 2024-09-12T00:34:10.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.381+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f8cca0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.385+0000 7f590dab69c0 10 manifest: total_size = 11534336 2024-09-12T00:34:10.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.385+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6788646005182573753 2024-09-12T00:34:10.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.385+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f8cca0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.385+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.385+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.8 2024-09-12T00:34:10.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.385+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:34:10.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6788646005182573753 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.1 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.1_1 2024-09-12T00:34:10.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T00:34:10.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.2 2024-09-12T00:34:10.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T00:34:10.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.2_1 2024-09-12T00:34:10.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T00:34:10.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.3 2024-09-12T00:34:10.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T00:34:10.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6788646005182573753 2024-09-12T00:34:10.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.389+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:34:10.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.393+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f40ad140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.393+0000 7f590dab69c0 10 manifest: total_size = 541681 2024-09-12T00:34:10.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.393+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to _v8hT2cSZHbx-RAfe_wPay4FJhy1K9c2 2024-09-12T00:34:10.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.393+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58f40ad140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.393+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.393+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.8 2024-09-12T00:34:10.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.397+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.397+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.397+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: _v8hT2cSZHbx-RAfe_wPay4FJhy1K9c2 2024-09-12T00:34:10.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.397+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.397+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.ukS0AZM-yqHAjJaEzOi4-gJMR1eh09f_0 2024-09-12T00:34:10.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.397+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:34:10.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.397+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.397+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _v8hT2cSZHbx-RAfe_wPay4FJhy1K9c2 2024-09-12T00:34:10.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.401+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:34:10.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.401+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc002f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.401+0000 7f590dab69c0 10 manifest: total_size = 11534336 2024-09-12T00:34:10.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.401+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3870916058006906045 2024-09-12T00:34:10.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.401+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc002f60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x560652f8e978 s->prefetch_data=0 2024-09-12T00:34:10.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.401+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8e978 2024-09-12T00:34:10.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.401+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17.9 2024-09-12T00:34:10.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3870916058006906045 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.1 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.1_1 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.2 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.2_1 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.3 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.409+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3870916058006906045 2024-09-12T00:34:10.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.413+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:10.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.413+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:10.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.413+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:34:10.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.413+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:10.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.413+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:10.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.413+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:10.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.413+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:10.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.413+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:10.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.417+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:34:10.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.417+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.421+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:34:10.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.421+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:34:10.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.421+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:34:10.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.421+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:34:10.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.421+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:34:10.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.421+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398859 cookie 94585161585936 notifier 5615 bl.length()=199 2024-09-12T00:34:10.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.429+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17 from cache 2024-09-12T00:34:10.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.429+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17, ofs0, ns] 2024-09-12T00:34:10.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.429+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398871 cookie 94585161587136 notifier 5615 bl.length()=257 2024-09-12T00:34:10.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.437+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17 : miss 2024-09-12T00:34:10.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.437+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.437+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:10.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.437+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17 info.flags=0x0 2024-09-12T00:34:10.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.437+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17 to cache LRU end 2024-09-12T00:34:10.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.441+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15 : miss 2024-09-12T00:34:10.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.441+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.445+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:34:10.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.445+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15 info.flags=0x17 2024-09-12T00:34:10.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.445+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15 to cache LRU end 2024-09-12T00:34:10.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.445+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:10.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.445+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:10.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.445+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15 2024-09-12T00:34:10.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.449+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:34:10.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.449+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:34:10.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.453+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:34:10.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.453+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f81a50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x560652f9c358 s->prefetch_data=0 2024-09-12T00:34:10.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.453+0000 7f590dab69c0 10 manifest: total_size = 11534336 2024-09-12T00:34:10.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.453+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4405199013687830053 2024-09-12T00:34:10.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.453+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f81a50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x560652f9c358 s->prefetch_data=0 2024-09-12T00:34:10.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.453+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f9c358 2024-09-12T00:34:10.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.453+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15.3 2024-09-12T00:34:10.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4405199013687830053 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-FROZEN.2~bFQAEIx1UCoLMaC_kEMrTNtFYjssFiN.1 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__shadow_foo-FROZEN.2~bFQAEIx1UCoLMaC_kEMrTNtFYjssFiN.1_1 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:34:10.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-FROZEN.2~bFQAEIx1UCoLMaC_kEMrTNtFYjssFiN.2 2024-09-12T00:34:10.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:34:10.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__shadow_foo-FROZEN.2~bFQAEIx1UCoLMaC_kEMrTNtFYjssFiN.2_1 2024-09-12T00:34:10.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:34:10.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-FROZEN.2~bFQAEIx1UCoLMaC_kEMrTNtFYjssFiN.3 2024-09-12T00:34:10.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:34:10.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4405199013687830053 2024-09-12T00:34:10.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.461+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:34:10.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.465+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc081520 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x560652f9be38 s->prefetch_data=0 2024-09-12T00:34:10.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.465+0000 7f590dab69c0 10 manifest: total_size = 541681 2024-09-12T00:34:10.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.465+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10755812464411218660 2024-09-12T00:34:10.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.465+0000 7f590dab69c0 20 get_obj_state: octx=0x7f58fc081520 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x560652f9be38 s->prefetch_data=0 2024-09-12T00:34:10.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.465+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f9be38 2024-09-12T00:34:10.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.465+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15.5 2024-09-12T00:34:10.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:10.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-12T00:34:10.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:34:10.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:34:10.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-12T00:34:10.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-12T00:34:10.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-12T00:34:10.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=49187 2024-09-12T00:34:10.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-12T00:34:10.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10755812464411218660 2024-09-12T00:34:10.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-STANDARD.2~9URnfvinAH3gIlZU78aZkJNqPP5N9-o.1 2024-09-12T00:34:10.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:34:10.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-STANDARD.2~9URnfvinAH3gIlZU78aZkJNqPP5N9-o.2 2024-09-12T00:34:10.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:34:10.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-STANDARD.2~9URnfvinAH3gIlZU78aZkJNqPP5N9-o.3 2024-09-12T00:34:10.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:34:10.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.469+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10755812464411218660 2024-09-12T00:34:10.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.473+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:34:10.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.473+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f8cc40 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x560652f9be38 s->prefetch_data=0 2024-09-12T00:34:10.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.477+0000 7f590dab69c0 10 manifest: total_size = 11534336 2024-09-12T00:34:10.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.477+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6614455906155235140 2024-09-12T00:34:10.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.477+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f8cc40 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x560652f9be38 s->prefetch_data=0 2024-09-12T00:34:10.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.477+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f9be38 2024-09-12T00:34:10.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.477+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15.7 2024-09-12T00:34:10.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:34:10.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6614455906155235140 2024-09-12T00:34:10.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-LUKEWARM.2~tk-_39-Iok9YPAB32JboWfBmlG0eIl7.1 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__shadow_foo-LUKEWARM.2~tk-_39-Iok9YPAB32JboWfBmlG0eIl7.1_1 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-LUKEWARM.2~tk-_39-Iok9YPAB32JboWfBmlG0eIl7.2 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__shadow_foo-LUKEWARM.2~tk-_39-Iok9YPAB32JboWfBmlG0eIl7.2_1 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-LUKEWARM.2~tk-_39-Iok9YPAB32JboWfBmlG0eIl7.3 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.481+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6614455906155235140 2024-09-12T00:34:10.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.485+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:10.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.485+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:34:10.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.485+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:10.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.485+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:10.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.485+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:10.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.485+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:10.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.485+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:10.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.485+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:10.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.489+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:34:10.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.489+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.493+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:34:10.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.493+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:34:10.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.493+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:34:10.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.493+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:34:10.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.493+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:34:10.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.493+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 94585161595328 notifier 5615 bl.length()=194 2024-09-12T00:34:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.501+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15 from cache 2024-09-12T00:34:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.501+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15, ofs0, ns] 2024-09-12T00:34:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.501+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398872 cookie 94585161587136 notifier 5615 bl.length()=252 2024-09-12T00:34:10.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.509+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15 : miss 2024-09-12T00:34:10.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.509+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.509+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:10.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.509+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15 info.flags=0x0 2024-09-12T00:34:10.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.509+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15 to cache LRU end 2024-09-12T00:34:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.513+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14 : miss 2024-09-12T00:34:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.513+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.517+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:34:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.517+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14 info.flags=0x17 2024-09-12T00:34:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.517+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14 to cache LRU end 2024-09-12T00:34:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.517+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.517+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.517+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14 2024-09-12T00:34:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.521+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:34:10.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.521+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:34:10.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.525+0000 7f590dab69c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:34:10.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.525+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fffc70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x560652f8ee38 s->prefetch_data=0 2024-09-12T00:34:10.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.525+0000 7f590dab69c0 10 manifest: total_size = 10485760 2024-09-12T00:34:10.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.525+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13144894286639926085 2024-09-12T00:34:10.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.525+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fffc70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x560652f8ee38 s->prefetch_data=0 2024-09-12T00:34:10.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.525+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8ee38 2024-09-12T00:34:10.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.525+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14.3 2024-09-12T00:34:10.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13144894286639926085 2024-09-12T00:34:10.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.3dlgU4536Wwt-z60m1AKtdflOwBMUvX_0 2024-09-12T00:34:10.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:34:10.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.3dlgU4536Wwt-z60m1AKtdflOwBMUvX_1 2024-09-12T00:34:10.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:34:10.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.3dlgU4536Wwt-z60m1AKtdflOwBMUvX_2 2024-09-12T00:34:10.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-12T00:34:10.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.533+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13144894286639926085 2024-09-12T00:34:10.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.537+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:34:10.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.537+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f8b1d0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x560652f8ee38 s->prefetch_data=0 2024-09-12T00:34:10.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.537+0000 7f590dab69c0 10 manifest: total_size = 10485760 2024-09-12T00:34:10.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.537+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12457598927910242394 2024-09-12T00:34:10.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.537+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f8b1d0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x560652f8ee38 s->prefetch_data=0 2024-09-12T00:34:10.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.537+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8ee38 2024-09-12T00:34:10.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.537+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14.5 2024-09-12T00:34:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12457598927910242394 2024-09-12T00:34:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.rQtUDKW9wGKa7Od7jgxzBkD8ynX4BJ9_0 2024-09-12T00:34:10.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:34:10.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.rQtUDKW9wGKa7Od7jgxzBkD8ynX4BJ9_1 2024-09-12T00:34:10.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 561 2024-09-12T00:34:10.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.rQtUDKW9wGKa7Od7jgxzBkD8ynX4BJ9_2 2024-09-12T00:34:10.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 791 2024-09-12T00:34:10.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12457598927910242394 2024-09-12T00:34:10.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.545+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:34:10.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.549+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fac650 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x560652f8ee38 s->prefetch_data=0 2024-09-12T00:34:10.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.549+0000 7f590dab69c0 10 manifest: total_size = 10485760 2024-09-12T00:34:10.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.549+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9656881585989730591 2024-09-12T00:34:10.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.549+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fac650 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x560652f8ee38 s->prefetch_data=0 2024-09-12T00:34:10.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.549+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8ee38 2024-09-12T00:34:10.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.549+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14.7 2024-09-12T00:34:10.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9656881585989730591 2024-09-12T00:34:10.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.KP53dOLro91u4jD8IEIZSex_8_adCFT_0 2024-09-12T00:34:10.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:34:10.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.KP53dOLro91u4jD8IEIZSex_8_adCFT_1 2024-09-12T00:34:10.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:34:10.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.KP53dOLro91u4jD8IEIZSex_8_adCFT_2 2024-09-12T00:34:10.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-12T00:34:10.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.553+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9656881585989730591 2024-09-12T00:34:10.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.557+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:34:10.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.557+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:10.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.557+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:10.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.561+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:10.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.561+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:10.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.561+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:10.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.561+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:10.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.561+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:10.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.565+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:34:10.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.565+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.565+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:34:10.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.565+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:34:10.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.565+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:34:10.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.569+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:34:10.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.569+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:34:10.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.569+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 94585161587136 notifier 5615 bl.length()=184 2024-09-12T00:34:10.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.577+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14 from cache 2024-09-12T00:34:10.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.577+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14, ofs0, ns] 2024-09-12T00:34:10.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.577+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398911 cookie 94585161577200 notifier 5615 bl.length()=242 2024-09-12T00:34:10.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.585+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14 : miss 2024-09-12T00:34:10.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.585+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.585+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:10.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.585+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14 info.flags=0x0 2024-09-12T00:34:10.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.585+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14 to cache LRU end 2024-09-12T00:34:10.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.593+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7 : miss 2024-09-12T00:34:10.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.593+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.593+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:34:10.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.593+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7 info.flags=0x17 2024-09-12T00:34:10.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.593+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7 to cache LRU end 2024-09-12T00:34:10.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.593+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:10.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.593+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:10.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.593+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7 2024-09-12T00:34:10.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.597+0000 7f590dab69c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:34:10.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.597+0000 7f590dab69c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:34:10.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.601+0000 7f590dab69c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:34:10.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.601+0000 7f590dab69c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:34:10.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.605+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f601c0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x560652f9be38 s->prefetch_data=0 2024-09-12T00:34:10.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.605+0000 7f590dab69c0 10 manifest: total_size = 0 2024-09-12T00:34:10.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.605+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7838395614211613346 2024-09-12T00:34:10.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.605+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f601c0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x560652f9be38 s->prefetch_data=0 2024-09-12T00:34:10.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.605+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f9be38 2024-09-12T00:34:10.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.605+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7.2 2024-09-12T00:34:10.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.613+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f601c0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x560652fabd98 s->prefetch_data=0 2024-09-12T00:34:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.613+0000 7f590dab69c0 10 manifest: total_size = 0 2024-09-12T00:34:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.613+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3616622010217299832 2024-09-12T00:34:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.613+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f601c0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x560652fabd98 s->prefetch_data=0 2024-09-12T00:34:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.613+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652fabd98 2024-09-12T00:34:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.613+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7.3 2024-09-12T00:34:10.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.617+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:34:10.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.621+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f601c0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x560652fabd98 s->prefetch_data=0 2024-09-12T00:34:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.621+0000 7f590dab69c0 10 manifest: total_size = 0 2024-09-12T00:34:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.621+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9630490093921019015 2024-09-12T00:34:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.621+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f601c0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x560652fabd98 s->prefetch_data=0 2024-09-12T00:34:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.621+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652fabd98 2024-09-12T00:34:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.621+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7.6 2024-09-12T00:34:10.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.625+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:34:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.629+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f601c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x560652f96478 s->prefetch_data=0 2024-09-12T00:34:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.629+0000 7f590dab69c0 10 manifest: total_size = 0 2024-09-12T00:34:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.629+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5789304358607328873 2024-09-12T00:34:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.629+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f601c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x560652f96478 s->prefetch_data=0 2024-09-12T00:34:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.629+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f96478 2024-09-12T00:34:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.629+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7.8 2024-09-12T00:34:10.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.633+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:34:10.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.637+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:10.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.637+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:10.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.641+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:34:10.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.641+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:10.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.641+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:10.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.641+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:10.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.641+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:10.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.641+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.645+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:34:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.645+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.645+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:34:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.645+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:34:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.645+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:34:10.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.649+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:34:10.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.649+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:34:10.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.649+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398912 cookie 94585161577200 notifier 5615 bl.length()=181 2024-09-12T00:34:10.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.657+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7 from cache 2024-09-12T00:34:10.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.657+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7, ofs0, ns] 2024-09-12T00:34:10.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.657+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398913 cookie 94585161577200 notifier 5615 bl.length()=238 2024-09-12T00:34:10.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.669+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7 : miss 2024-09-12T00:34:10.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.669+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.669+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:10.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.669+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7 info.flags=0x0 2024-09-12T00:34:10.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.669+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7 to cache LRU end 2024-09-12T00:34:10.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.673+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8 : miss 2024-09-12T00:34:10.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.673+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.677+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:34:10.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.677+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8 info.flags=0x17 2024-09-12T00:34:10.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.677+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8 to cache LRU end 2024-09-12T00:34:10.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.677+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:10.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.677+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:10.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.677+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8 2024-09-12T00:34:10.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.677+0000 7f590dab69c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:34:10.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.677+0000 7f590dab69c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:34:10.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.681+0000 7f590dab69c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:34:10.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.685+0000 7f590dab69c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:34:10.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.685+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f9b140 obj=test-client.0-r-test-small-obj-data.2:___ state=0x560652fa8cd8 s->prefetch_data=0 2024-09-12T00:34:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.685+0000 7f590dab69c0 10 manifest: total_size = 38 2024-09-12T00:34:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.685+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9029002458042109761 2024-09-12T00:34:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.685+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f9b140 obj=test-client.0-r-test-small-obj-data.2:___ state=0x560652fa8cd8 s->prefetch_data=0 2024-09-12T00:34:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.685+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652fa8cd8 2024-09-12T00:34:10.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.685+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8.2 2024-09-12T00:34:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.693+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.693+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.693+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9029002458042109761 2024-09-12T00:34:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.693+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.693+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8__shadow_.xhVDTP6qIzCuP78s0l2V1KYcQH7Bdax_0 2024-09-12T00:34:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.693+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:34:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.693+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.693+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9029002458042109761 2024-09-12T00:34:10.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.697+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:34:10.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.697+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f9b140 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x560652fa8cd8 s->prefetch_data=0 2024-09-12T00:34:10.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.697+0000 7f590dab69c0 10 manifest: total_size = 24595 2024-09-12T00:34:10.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.697+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13975625676025230173 2024-09-12T00:34:10.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.697+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f9b140 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x560652fa8cd8 s->prefetch_data=0 2024-09-12T00:34:10.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.697+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652fa8cd8 2024-09-12T00:34:10.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.697+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8.3 2024-09-12T00:34:10.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.705+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.705+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.705+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13975625676025230173 2024-09-12T00:34:10.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.705+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.705+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8__shadow_.8MMdnXpFDxi84s7rw5JZhk8fkpBUrQt_0 2024-09-12T00:34:10.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.705+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:10.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.705+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.705+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13975625676025230173 2024-09-12T00:34:10.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.709+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:34:10.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.709+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f9b140 obj=test-client.0-r-test-small-obj-data.2:__ state=0x560652fa8cd8 s->prefetch_data=0 2024-09-12T00:34:10.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.709+0000 7f590dab69c0 10 manifest: total_size = 2078 2024-09-12T00:34:10.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.709+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13756711011000805167 2024-09-12T00:34:10.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.709+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f9b140 obj=test-client.0-r-test-small-obj-data.2:__ state=0x560652fa8cd8 s->prefetch_data=0 2024-09-12T00:34:10.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.709+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652fa8cd8 2024-09-12T00:34:10.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.709+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8.6 2024-09-12T00:34:10.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.717+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.717+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.717+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13756711011000805167 2024-09-12T00:34:10.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.717+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.717+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8__shadow_.mA1ynOo3Mn-jsiKRHah89fVkFoh2tjv_0 2024-09-12T00:34:10.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.717+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:10.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.717+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.717+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13756711011000805167 2024-09-12T00:34:10.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.721+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:34:10.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.721+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f9b140 obj=test-client.0-r-test-small-obj-data.2:obj state=0x560652fa8cd8 s->prefetch_data=0 2024-09-12T00:34:10.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.721+0000 7f590dab69c0 10 manifest: total_size = 524288 2024-09-12T00:34:10.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.721+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5016697132734001603 2024-09-12T00:34:10.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.721+0000 7f590dab69c0 20 get_obj_state: octx=0x560652f9b140 obj=test-client.0-r-test-small-obj-data.2:obj state=0x560652fa8cd8 s->prefetch_data=0 2024-09-12T00:34:10.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.721+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652fa8cd8 2024-09-12T00:34:10.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.721+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8.8 2024-09-12T00:34:10.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.729+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.729+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.729+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5016697132734001603 2024-09-12T00:34:10.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.729+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.729+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8__shadow_.O_ML5icwa3qiiPpTN4ZCjaht7x2Z_J4_0 2024-09-12T00:34:10.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.729+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:34:10.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.729+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.729+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5016697132734001603 2024-09-12T00:34:10.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.733+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:10.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.733+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:10.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.733+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:34:10.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.733+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:10.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.733+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:10.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.733+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:10.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.733+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:10.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.733+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.741+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:34:10.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.741+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.741+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:34:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.741+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:34:10.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.741+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:34:10.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.745+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:34:10.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.745+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:34:10.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.745+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398914 cookie 94585161577200 notifier 5615 bl.length()=181 2024-09-12T00:34:10.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.749+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8 from cache 2024-09-12T00:34:10.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.749+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8, ofs0, ns] 2024-09-12T00:34:10.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.753+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398915 cookie 94585161577200 notifier 5615 bl.length()=238 2024-09-12T00:34:10.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.761+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8 : miss 2024-09-12T00:34:10.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.761+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.761+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:10.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.761+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8 info.flags=0x0 2024-09-12T00:34:10.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.761+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8 to cache LRU end 2024-09-12T00:34:10.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.765+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9 : miss 2024-09-12T00:34:10.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.765+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.765+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:34:10.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.765+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9 info.flags=0x17 2024-09-12T00:34:10.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.765+0000 7f590dab69c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9 to cache LRU end 2024-09-12T00:34:10.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.765+0000 7f590dab69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:10.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.765+0000 7f590dab69c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:34:10.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.765+0000 7f590dab69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9 2024-09-12T00:34:10.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.769+0000 7f590dab69c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:34:10.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.769+0000 7f590dab69c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:34:10.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.773+0000 7f590dab69c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:34:10.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.773+0000 7f590dab69c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:34:10.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.777+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff960 obj=test-client.0-r-test-small-obj-data.3:___ state=0x560652f8ebc8 s->prefetch_data=0 2024-09-12T00:34:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.777+0000 7f590dab69c0 10 manifest: total_size = 1048576 2024-09-12T00:34:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.777+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10489917118806195046 2024-09-12T00:34:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.777+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff960 obj=test-client.0-r-test-small-obj-data.3:___ state=0x560652f8ebc8 s->prefetch_data=0 2024-09-12T00:34:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.777+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8ebc8 2024-09-12T00:34:10.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.777+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9.2 2024-09-12T00:34:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.781+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.781+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.781+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10489917118806195046 2024-09-12T00:34:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.781+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.781+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9__shadow_.NGtH7yJorKlWgaf2ED44TT_eB9w3ZgX_0 2024-09-12T00:34:10.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.781+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.781+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.781+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10489917118806195046 2024-09-12T00:34:10.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.785+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:34:10.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.785+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff960 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x560652f8ebc8 s->prefetch_data=0 2024-09-12T00:34:10.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.785+0000 7f590dab69c0 10 manifest: total_size = 55 2024-09-12T00:34:10.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.785+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14885762382882863317 2024-09-12T00:34:10.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.785+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff960 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x560652f8ebc8 s->prefetch_data=0 2024-09-12T00:34:10.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.785+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8ebc8 2024-09-12T00:34:10.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.785+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9.3 2024-09-12T00:34:10.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.793+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.793+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14885762382882863317 2024-09-12T00:34:10.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9__shadow_.EpcXhaX0dNH-LRZYHoa8KBCbFmR4dmd_0 2024-09-12T00:34:10.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:10.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.793+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14885762382882863317 2024-09-12T00:34:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.797+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:34:10.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.797+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff960 obj=test-client.0-r-test-small-obj-data.3:__ state=0x560652f8ebc8 s->prefetch_data=0 2024-09-12T00:34:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.797+0000 7f590dab69c0 10 manifest: total_size = 4134 2024-09-12T00:34:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.797+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5024602794872115567 2024-09-12T00:34:10.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.797+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff960 obj=test-client.0-r-test-small-obj-data.3:__ state=0x560652f8ebc8 s->prefetch_data=0 2024-09-12T00:34:10.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.797+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8ebc8 2024-09-12T00:34:10.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.797+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9.6 2024-09-12T00:34:10.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.805+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.805+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.805+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5024602794872115567 2024-09-12T00:34:10.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.805+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.805+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9__shadow_.PQ0LVi26LtF1Fgh7G2Sc0XDSehfRP-B_0 2024-09-12T00:34:10.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.805+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:34:10.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.805+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.805+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5024602794872115567 2024-09-12T00:34:10.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.809+0000 7f57eeffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:34:10.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.809+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff960 obj=test-client.0-r-test-small-obj-data.3:obj state=0x560652f8ebc8 s->prefetch_data=0 2024-09-12T00:34:10.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.809+0000 7f590dab69c0 10 manifest: total_size = 1048576 2024-09-12T00:34:10.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.809+0000 7f590dab69c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10643655452170635002 2024-09-12T00:34:10.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.809+0000 7f590dab69c0 20 get_obj_state: octx=0x560652fff960 obj=test-client.0-r-test-small-obj-data.3:obj state=0x560652f8ebc8 s->prefetch_data=0 2024-09-12T00:34:10.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.809+0000 7f590dab69c0 20 prepare_atomic_modification: state is not atomic. state=0x560652f8ebc8 2024-09-12T00:34:10.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.809+0000 7f590dab69c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9.8 2024-09-12T00:34:10.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.817+0000 7f590dab69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:34:10.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.817+0000 7f590dab69c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:34:10.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.817+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10643655452170635002 2024-09-12T00:34:10.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.817+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:34:10.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.817+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9__shadow_.JNxSjSR-q58lqfzK1RWI7QENo9ThhG7_0 2024-09-12T00:34:10.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.817+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:34:10.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.817+0000 7f590dab69c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:34:10.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.817+0000 7f590dab69c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10643655452170635002 2024-09-12T00:34:10.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.821+0000 7f590dab69c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:34:10.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.821+0000 7f590dab69c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:34:10.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.821+0000 7f57ee7fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:34:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.821+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:34:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.821+0000 7f590dab69c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:34:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.821+0000 7f590dab69c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:34:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.821+0000 7f590dab69c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:34:10.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.821+0000 7f590dab69c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:34:10.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.825+0000 7f590dab69c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:34:10.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.825+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.829+0000 7f590dab69c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:34:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.829+0000 7f590dab69c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:34:10.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.829+0000 7f590dab69c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:34:10.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.829+0000 7f590dab69c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:34:10.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.829+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:34:10.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.833+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398916 cookie 94585161577200 notifier 5615 bl.length()=181 2024-09-12T00:34:10.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.837+0000 7f590dab69c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9 from cache 2024-09-12T00:34:10.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.837+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9, ofs0, ns] 2024-09-12T00:34:10.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.837+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398917 cookie 94585161577200 notifier 5615 bl.length()=238 2024-09-12T00:34:10.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.849+0000 7f590dab69c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9 : miss 2024-09-12T00:34:10.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.849+0000 7f590dab69c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:10.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.849+0000 7f590dab69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:10.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.849+0000 7f590dab69c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9 info.flags=0x0 2024-09-12T00:34:10.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.849+0000 7f590dab69c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9 to cache LRU end 2024-09-12T00:34:10.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.853+0000 7f590dab69c0 10 removing key index: FZKNVQBAVZWHXAMILFNN 2024-09-12T00:34:10.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.857+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:FZKNVQBAVZWHXAMILFNN, ofs0, ns] 2024-09-12T00:34:10.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.857+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398874 cookie 94585161587136 notifier 5615 bl.length()=170 2024-09-12T00:34:10.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.861+0000 7f590dab69c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:34:10.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.861+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:34:10.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.861+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398875 cookie 94585161587136 notifier 5615 bl.length()=182 2024-09-12T00:34:10.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.865+0000 7f590dab69c0 10 removing user buckets index 2024-09-12T00:34:10.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.869+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:34:10.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.869+0000 7f57ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398874 cookie 94585161595328 notifier 5615 bl.length()=173 2024-09-12T00:34:10.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.873+0000 7f590dab69c0 10 removing user index: ragweed.client.0 2024-09-12T00:34:10.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.877+0000 7f590dab69c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:34:10.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.877+0000 7f590dab69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:34:10.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.877+0000 7f57eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 94585161589264 notifier 5615 bl.length()=165 2024-09-12T00:34:10.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.885+0000 7f57c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:10.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.893+0000 7f590dab69c0 20 remove_watcher() i=0 2024-09-12T00:34:10.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.893+0000 7f590dab69c0 2 removed watcher, disabling cache 2024-09-12T00:34:10.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.893+0000 7f590dab69c0 20 remove_watcher() i=1 2024-09-12T00:34:10.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.897+0000 7f590dab69c0 20 remove_watcher() i=2 2024-09-12T00:34:10.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.901+0000 7f590dab69c0 20 remove_watcher() i=3 2024-09-12T00:34:10.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.901+0000 7f590dab69c0 20 remove_watcher() i=4 2024-09-12T00:34:10.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.905+0000 7f590dab69c0 20 remove_watcher() i=5 2024-09-12T00:34:10.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.905+0000 7f590dab69c0 20 remove_watcher() i=6 2024-09-12T00:34:10.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:10.909+0000 7f590dab69c0 20 remove_watcher() i=7 2024-09-12T00:34:10.920 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:34:11.002 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:11.002 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:11.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.049+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.053+0000 7fce236519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:11.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.053+0000 7fce236519c0 20 realm 2024-09-12T00:34:11.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.053+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.053+0000 7fce236519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:11.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.053+0000 7fce236519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:11.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.053+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.053+0000 7fce236519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:11.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.053+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.053+0000 7fce236519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:11.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.053+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.057+0000 7fce236519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.057+0000 7fce236519c0 20 searching for the correct realm 2024-09-12T00:34:11.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.061+0000 7fce21958640 0 -- 172.21.15.102:0/2790991631 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fce1804d060 msgr2=0x7fce1808a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:11.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.277+0000 7fce20956640 0 -- 172.21.15.102:0/2790991631 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fce1c069440 msgr2=0x7fce1c064920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:11.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.493+0000 7fce236519c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:34:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.493+0000 7fce236519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.493+0000 7fce236519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.493+0000 7fce236519c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:34:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.493+0000 7fce236519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.493+0000 7fce236519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.493+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.493+0000 7fce236519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:11.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.493+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:11.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:11.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 zone default found 2024-09-12T00:34:11.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 4 Realm: () 2024-09-12T00:34:11.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:34:11.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:34:11.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:11.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 zonegroup default 2024-09-12T00:34:11.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:11.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:11.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:11.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 started sync module instance, tier type = 2024-09-12T00:34:11.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.497+0000 7fce236519c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:34:11.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.521+0000 7fce236519c0 20 add_watcher() i=0 2024-09-12T00:34:11.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.521+0000 7fce236519c0 20 add_watcher() i=1 2024-09-12T00:34:11.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.521+0000 7fce236519c0 20 add_watcher() i=2 2024-09-12T00:34:11.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.521+0000 7fce236519c0 20 add_watcher() i=3 2024-09-12T00:34:11.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.521+0000 7fce236519c0 20 add_watcher() i=4 2024-09-12T00:34:11.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.521+0000 7fce236519c0 20 add_watcher() i=5 2024-09-12T00:34:11.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.521+0000 7fce236519c0 20 add_watcher() i=6 2024-09-12T00:34:11.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.525+0000 7fce236519c0 20 add_watcher() i=7 2024-09-12T00:34:11.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.525+0000 7fce236519c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:11.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.529+0000 7fccd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:11.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.529+0000 7fce236519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:11.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.529+0000 7fce236519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:11.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.621+0000 7fccd67e4640 20 reqs_thread_entry: start 2024-09-12T00:34:11.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.621+0000 7fce236519c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:11.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.621+0000 7fce236519c0 20 Filter name: none 2024-09-12T00:34:11.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.621+0000 7fcc47fff640 20 reqs_thread_entry: start 2024-09-12T00:34:11.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.621+0000 7fce236519c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:34:11.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.621+0000 7fce236519c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:11.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.625+0000 7fce236519c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:34:11.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.625+0000 7fce236519c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:34:11.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.625+0000 7fce236519c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:34:11.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.625+0000 7fce236519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:11.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.625+0000 7fce236519c0 10 removing key index: WOGISMUBWRGSTZEXHGJU 2024-09-12T00:34:11.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.625+0000 7fce236519c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:WOGISMUBWRGSTZEXHGJU, ofs0, ns] 2024-09-12T00:34:11.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.629+0000 7fcd04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398918 cookie 94402773833344 notifier 5633 bl.length()=170 2024-09-12T00:34:11.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.629+0000 7fce236519c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:34:11.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.633+0000 7fce236519c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:34:11.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.633+0000 7fccf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94402773827840 notifier 5633 bl.length()=182 2024-09-12T00:34:11.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.637+0000 7fce236519c0 10 removing user buckets index 2024-09-12T00:34:11.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.637+0000 7fce236519c0 10 removing user index: sysuser.client.0 2024-09-12T00:34:11.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.641+0000 7fce236519c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:34:11.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.641+0000 7fce236519c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:34:11.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.641+0000 7fccf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398876 cookie 94402773836320 notifier 5633 bl.length()=165 2024-09-12T00:34:11.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.645+0000 7fccd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:11.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.649+0000 7fce236519c0 20 remove_watcher() i=0 2024-09-12T00:34:11.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.649+0000 7fce236519c0 2 removed watcher, disabling cache 2024-09-12T00:34:11.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.653+0000 7fce236519c0 20 remove_watcher() i=1 2024-09-12T00:34:11.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.657+0000 7fce236519c0 20 remove_watcher() i=2 2024-09-12T00:34:11.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.657+0000 7fce236519c0 20 remove_watcher() i=3 2024-09-12T00:34:11.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.661+0000 7fce236519c0 20 remove_watcher() i=4 2024-09-12T00:34:11.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.661+0000 7fce236519c0 20 remove_watcher() i=5 2024-09-12T00:34:11.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.661+0000 7fce236519c0 20 remove_watcher() i=6 2024-09-12T00:34:11.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:34:11.665+0000 7fce236519c0 20 remove_watcher() i=7 2024-09-12T00:34:11.674 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:34:11.674 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:34:11.767 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:34:11.778 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:34:11.779 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:34:11.779 DEBUG:teuthology.orchestra.run.smithi102:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:34:11.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:34:11.784 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:34:11.785 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:34:11.832 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:34:11.832 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:34:11.881 INFO:tasks.workunit:timeout=3h 2024-09-12T00:34:11.881 INFO:tasks.workunit:cleanup=True 2024-09-12T00:34:11.881 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:34:11.931 INFO:tasks.workunit.client.0.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:34:54.993 INFO:tasks.workunit.client.0.smithi102.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:34:54.993 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:34:54.993 INFO:tasks.workunit.client.0.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:34:54.993 INFO:tasks.workunit.client.0.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr: git switch -c 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr:Or undo this operation with: 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr: git switch - 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:34:54.994 INFO:tasks.workunit.client.0.smithi102.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:34:55.000 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:34:55.049 INFO:tasks.workunit.client.0.smithi102.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:34:55.053 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:34:55.053 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:34:55.109 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:34:55.165 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:34:55.205 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:34:55.206 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:34:55.206 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:34:55.246 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:34:55.249 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:34:55.249 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:34:55.301 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:34:55.302 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:34:55.302 DEBUG:teuthology.orchestra.run.smithi102:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:34:55.353 INFO:tasks.workunit.client.0.smithi102.stderr:+ ulimit -c 0 2024-09-12T00:34:55.353 INFO:tasks.workunit.client.0.smithi102.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:34:55.353 INFO:tasks.workunit.client.0.smithi102.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:34:55.353 INFO:tasks.workunit.client.0.smithi102.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:34:58.195 INFO:tasks.workunit.client.0.smithi102.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:34:58.195 INFO:tasks.workunit.client.0.smithi102.stderr:++ deactivate nondestructive 2024-09-12T00:34:58.195 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:34:58.195 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:34:58.195 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:34:58.195 INFO:tasks.workunit.client.0.smithi102.stderr:++ hash -r 2024-09-12T00:34:58.195 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ export VIRTUAL_ENV 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ export PATH 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -z '' ']' 2024-09-12T00:34:58.196 INFO:tasks.workunit.client.0.smithi102.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:34:58.197 INFO:tasks.workunit.client.0.smithi102.stderr:++ PS1='(rgw) ' 2024-09-12T00:34:58.197 INFO:tasks.workunit.client.0.smithi102.stderr:++ export PS1 2024-09-12T00:34:58.197 INFO:tasks.workunit.client.0.smithi102.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:34:58.197 INFO:tasks.workunit.client.0.smithi102.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:34:58.197 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:34:58.197 INFO:tasks.workunit.client.0.smithi102.stderr:++ hash -r 2024-09-12T00:34:58.197 INFO:tasks.workunit.client.0.smithi102.stderr:+ pip install pip --upgrade 2024-09-12T00:34:58.587 INFO:tasks.workunit.client.0.smithi102.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:34:58.795 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting pip 2024-09-12T00:34:58.800 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:34:58.837 INFO:tasks.workunit.client.0.smithi102.stdout:Installing collected packages: pip 2024-09-12T00:34:58.837 INFO:tasks.workunit.client.0.smithi102.stdout: Attempting uninstall: pip 2024-09-12T00:34:58.838 INFO:tasks.workunit.client.0.smithi102.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:34:59.093 INFO:tasks.workunit.client.0.smithi102.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:34:59.099 INFO:tasks.workunit.client.0.smithi102.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:34:59.839 INFO:tasks.workunit.client.0.smithi102.stdout:Successfully installed pip-24.2 2024-09-12T00:34:59.897 INFO:tasks.workunit.client.0.smithi102.stderr:+ pip install boto3 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting boto3 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:35:01.410 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:35:01.411 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:35:01.465 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:35:01.466 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:35:01.513 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:35:01.514 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:35:01.570 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:35:01.572 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:35:01.683 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:35:01.683 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:35:01.885 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:35:01.886 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:35:01.889 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:35:01.891 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:35:01.900 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:35:01.901 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:35:01.903 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:35:01.904 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:35:01.905 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:35:01.972 INFO:tasks.workunit.client.0.smithi102.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:35:02.976 INFO:tasks.workunit.client.0.smithi102.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:35:03.153 INFO:tasks.workunit.client.0.smithi102.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:35:03.292 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:35:03.333 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:03.333 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:03.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.380+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 realm 2024-09-12T00:35:03.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:03.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:03.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:03.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.384+0000 7fdd296179c0 20 searching for the correct realm 2024-09-12T00:35:03.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.392+0000 7fdd2711d640 0 -- 172.21.15.102:0/1482088054 >> [v2:172.21.15.102:6824/1865676346,v1:172.21.15.102:6825/1865676346] conn(0x55f091a93a90 msgr2=0x55f091a95f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:03.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.396+0000 7fdd2791e640 0 -- 172.21.15.102:0/1482088054 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fdd1c043060 msgr2=0x7fdd1c093a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:03.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:03.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:03.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:03.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:03.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:03.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:03.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:03.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:03.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 zone default found 2024-09-12T00:35:03.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 4 Realm: () 2024-09-12T00:35:03.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:03.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:03.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:03.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 zonegroup default 2024-09-12T00:35:03.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 started sync module instance, tier type = 2024-09-12T00:35:03.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.404+0000 7fdd296179c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:03.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.420+0000 7fdd296179c0 20 add_watcher() i=0 2024-09-12T00:35:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.420+0000 7fdd296179c0 20 add_watcher() i=1 2024-09-12T00:35:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.420+0000 7fdd296179c0 20 add_watcher() i=2 2024-09-12T00:35:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.420+0000 7fdd296179c0 20 add_watcher() i=3 2024-09-12T00:35:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.420+0000 7fdd296179c0 20 add_watcher() i=4 2024-09-12T00:35:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.420+0000 7fdd296179c0 20 add_watcher() i=5 2024-09-12T00:35:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.420+0000 7fdd296179c0 20 add_watcher() i=6 2024-09-12T00:35:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.420+0000 7fdd296179c0 20 add_watcher() i=7 2024-09-12T00:35:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.420+0000 7fdd296179c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:03.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdbddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:03.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:03.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:03.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 5 note: GC not initialized 2024-09-12T00:35:03.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdbdcfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:03.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:03.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 20 Filter name: none 2024-09-12T00:35:03.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdb567fc640 20 reqs_thread_entry: start 2024-09-12T00:35:03.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:35:03.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:35:03.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:35:03.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:35:03.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T00:35:03.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T00:35:03.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:35:03.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T00:35:03.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.424+0000 7fdd296179c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.428+0000 7fdd296179c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T00:35:03.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.428+0000 7fdd296179c0 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T00:35:03.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.428+0000 7fdd296179c0 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T00:35:03.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.428+0000 7fdd296179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:03.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.428+0000 7fdd296179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T00:35:03.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.428+0000 7fdd296179c0 20 get_user_info_from_index found 0 xattrs 2024-09-12T00:35:03.422 INFO:tasks.workunit.client.0.smithi102.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T00:35:03.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.428+0000 7fdbddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:03.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.432+0000 7fdd296179c0 20 remove_watcher() i=0 2024-09-12T00:35:03.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.432+0000 7fdd296179c0 2 removed watcher, disabling cache 2024-09-12T00:35:03.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.436+0000 7fdd296179c0 20 remove_watcher() i=1 2024-09-12T00:35:03.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.436+0000 7fdd296179c0 20 remove_watcher() i=2 2024-09-12T00:35:03.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.440+0000 7fdd296179c0 20 remove_watcher() i=3 2024-09-12T00:35:03.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.440+0000 7fdd296179c0 20 remove_watcher() i=4 2024-09-12T00:35:03.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.444+0000 7fdd296179c0 20 remove_watcher() i=5 2024-09-12T00:35:03.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.444+0000 7fdd296179c0 20 remove_watcher() i=6 2024-09-12T00:35:03.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:03.444+0000 7fdd296179c0 20 remove_watcher() i=7 2024-09-12T00:35:14.405 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.406 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:14.480 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.480 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:14.607 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.608 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:14.748 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.749 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:14.832 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.832 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:14.932 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.933 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:15.017 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard add 2024-09-12T00:35:15.017 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:15.018 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:35:15.052 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:15.052 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:15.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.103+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.103+0000 7f7f1271f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.103+0000 7f7f1271f9c0 20 realm 2024-09-12T00:35:15.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.103+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.103+0000 7f7f1271f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.103+0000 7f7f1271f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:15.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.103+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.103+0000 7f7f1271f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.103+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.107+0000 7f7f1271f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.107+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.107+0000 7f7f1271f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:15.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.107+0000 7f7f1271f9c0 20 searching for the correct realm 2024-09-12T00:35:15.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.111+0000 7f7f10a26640 0 -- 172.21.15.102:0/1262314322 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f7f040c2040 msgr2=0x7f7f04131250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:15.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.327+0000 7f7f0fa24640 0 -- 172.21.15.102:0/1262314322 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f7f0806c990 msgr2=0x7f7f0809e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:15.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.543+0000 7f7f1271f9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:15.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.543+0000 7f7f1271f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:15.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.543+0000 7f7f1271f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:15.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.543+0000 7f7f1271f9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:15.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.543+0000 7f7f1271f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:15.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.543+0000 7f7f1271f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:15.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.543+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:15.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 zone default found 2024-09-12T00:35:15.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 4 Realm: () 2024-09-12T00:35:15.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:15.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:15.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:15.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 zonegroup default 2024-09-12T00:35:15.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.547+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.551+0000 7f7f1271f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.551+0000 7f7f1271f9c0 20 started sync module instance, tier type = 2024-09-12T00:35:15.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.551+0000 7f7f1271f9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:15.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.575+0000 7f7f1271f9c0 20 add_watcher() i=0 2024-09-12T00:35:15.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.575+0000 7f7f1271f9c0 20 add_watcher() i=1 2024-09-12T00:35:15.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.575+0000 7f7f1271f9c0 20 add_watcher() i=2 2024-09-12T00:35:15.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.575+0000 7f7f1271f9c0 20 add_watcher() i=3 2024-09-12T00:35:15.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.575+0000 7f7f1271f9c0 20 add_watcher() i=4 2024-09-12T00:35:15.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.575+0000 7f7f1271f9c0 20 add_watcher() i=5 2024-09-12T00:35:15.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.575+0000 7f7f1271f9c0 20 add_watcher() i=6 2024-09-12T00:35:15.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.575+0000 7f7f1271f9c0 20 add_watcher() i=7 2024-09-12T00:35:15.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.575+0000 7f7f1271f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:15.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.579+0000 7f7dc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:15.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.583+0000 7f7f1271f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:15.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.583+0000 7f7f1271f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:15.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.583+0000 7f7f1271f9c0 5 note: GC not initialized 2024-09-12T00:35:15.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.583+0000 7f7dc5fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:15.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.583+0000 7f7f1271f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:15.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.583+0000 7f7f1271f9c0 20 Filter name: none 2024-09-12T00:35:15.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.583+0000 7f7d377fe640 20 reqs_thread_entry: start 2024-09-12T00:35:15.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.583+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.583+0000 7f7f1271f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:15.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.583+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.587+0000 7f7f1271f9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:15.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.587+0000 7f7f1271f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:15.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.587+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.587+0000 7f7f1271f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:15.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.587+0000 7f7f1271f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.587+0000 7f7f1271f9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:15.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.587+0000 7f7f1271f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:15.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.591+0000 7f7dc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:15.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.595+0000 7f7f1271f9c0 20 remove_watcher() i=0 2024-09-12T00:35:15.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.595+0000 7f7f1271f9c0 2 removed watcher, disabling cache 2024-09-12T00:35:15.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.599+0000 7f7f1271f9c0 20 remove_watcher() i=1 2024-09-12T00:35:15.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.599+0000 7f7f1271f9c0 20 remove_watcher() i=2 2024-09-12T00:35:15.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.603+0000 7f7f1271f9c0 20 remove_watcher() i=3 2024-09-12T00:35:15.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.607+0000 7f7f1271f9c0 20 remove_watcher() i=4 2024-09-12T00:35:15.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.607+0000 7f7f1271f9c0 20 remove_watcher() i=5 2024-09-12T00:35:15.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.607+0000 7f7f1271f9c0 20 remove_watcher() i=6 2024-09-12T00:35:15.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.611+0000 7f7f1271f9c0 20 remove_watcher() i=7 2024-09-12T00:35:15.626 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:15.626 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:15.626 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: a-bucket id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:35:15.626 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:15.626 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T00:35:15.657 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:15.657 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:15.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.707+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.711+0000 7f555b0999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.711+0000 7f555b0999c0 20 realm 2024-09-12T00:35:15.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.711+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.711+0000 7f555b0999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.711+0000 7f555b0999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:15.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.711+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.711+0000 7f555b0999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.711+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.711+0000 7f555b0999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.711+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.715+0000 7f555b0999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:15.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.715+0000 7f555b0999c0 20 searching for the correct realm 2024-09-12T00:35:15.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.715+0000 7f55593a0640 0 -- 172.21.15.102:0/3578934576 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f554c0eb040 msgr2=0x7f554c109a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:15.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:15.931+0000 7f555839e640 0 -- 172.21.15.102:0/3578934576 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f5550096be0 msgr2=0x7f555000a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:16.142 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:16.142 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:16.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:16.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:16.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:16.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:16.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:16.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.147+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:16.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 zone default found 2024-09-12T00:35:16.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 4 Realm: () 2024-09-12T00:35:16.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:16.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:16.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:16.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 zonegroup default 2024-09-12T00:35:16.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 started sync module instance, tier type = 2024-09-12T00:35:16.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.151+0000 7f555b0999c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:16.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.175+0000 7f555b0999c0 20 add_watcher() i=0 2024-09-12T00:35:16.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.175+0000 7f555b0999c0 20 add_watcher() i=1 2024-09-12T00:35:16.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.175+0000 7f555b0999c0 20 add_watcher() i=2 2024-09-12T00:35:16.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.175+0000 7f555b0999c0 20 add_watcher() i=3 2024-09-12T00:35:16.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.175+0000 7f555b0999c0 20 add_watcher() i=4 2024-09-12T00:35:16.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.175+0000 7f555b0999c0 20 add_watcher() i=5 2024-09-12T00:35:16.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.175+0000 7f555b0999c0 20 add_watcher() i=6 2024-09-12T00:35:16.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.175+0000 7f555b0999c0 20 add_watcher() i=7 2024-09-12T00:35:16.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.175+0000 7f555b0999c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:16.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.179+0000 7f540efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:16.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:16.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:16.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 5 note: GC not initialized 2024-09-12T00:35:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f540dfe3640 20 reqs_thread_entry: start 2024-09-12T00:35:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 20 Filter name: none 2024-09-12T00:35:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f537f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:16.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:35:16.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:16.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:35:16.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:16.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:16.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:16.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:16.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:16.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.183+0000 7f555b0999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:35:16.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.187+0000 7f540efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:16.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.195+0000 7f555b0999c0 20 remove_watcher() i=0 2024-09-12T00:35:16.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.195+0000 7f555b0999c0 2 removed watcher, disabling cache 2024-09-12T00:35:16.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.195+0000 7f555b0999c0 20 remove_watcher() i=1 2024-09-12T00:35:16.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.199+0000 7f555b0999c0 20 remove_watcher() i=2 2024-09-12T00:35:16.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.199+0000 7f555b0999c0 20 remove_watcher() i=3 2024-09-12T00:35:16.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.203+0000 7f555b0999c0 20 remove_watcher() i=4 2024-09-12T00:35:16.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.203+0000 7f555b0999c0 20 remove_watcher() i=5 2024-09-12T00:35:16.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.207+0000 7f555b0999c0 20 remove_watcher() i=6 2024-09-12T00:35:16.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.207+0000 7f555b0999c0 20 remove_watcher() i=7 2024-09-12T00:35:16.218 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshard list 2024-09-12T00:35:16.243 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:16.243 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:16.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.291+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.295+0000 7fa98607a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.295+0000 7fa98607a9c0 20 realm 2024-09-12T00:35:16.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.295+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.295+0000 7fa98607a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.295+0000 7fa98607a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:16.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.295+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.295+0000 7fa98607a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.295+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.295+0000 7fa98607a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:16.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.295+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.299+0000 7fa98607a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:16.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.299+0000 7fa98607a9c0 20 searching for the correct realm 2024-09-12T00:35:16.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.303+0000 7fa984381640 0 -- 172.21.15.102:0/4157294815 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fa96c09bc20 msgr2=0x7fa96c0673a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:16.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.519+0000 7fa98337f640 0 -- 172.21.15.102:0/4157294815 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fa9740433b0 msgr2=0x7fa9740437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:16.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.735+0000 7fa98607a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:16.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.735+0000 7fa98607a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:16.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.735+0000 7fa98607a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:16.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.735+0000 7fa98607a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:16.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.735+0000 7fa98607a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:16.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.735+0000 7fa98607a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:16.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.735+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.735+0000 7fa98607a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.735+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:16.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:16.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 zone default found 2024-09-12T00:35:16.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 4 Realm: () 2024-09-12T00:35:16.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:16.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:16.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:16.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 zonegroup default 2024-09-12T00:35:16.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 started sync module instance, tier type = 2024-09-12T00:35:16.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.739+0000 7fa98607a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:16.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.763+0000 7fa98607a9c0 20 add_watcher() i=0 2024-09-12T00:35:16.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.763+0000 7fa98607a9c0 20 add_watcher() i=1 2024-09-12T00:35:16.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.763+0000 7fa98607a9c0 20 add_watcher() i=2 2024-09-12T00:35:16.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.763+0000 7fa98607a9c0 20 add_watcher() i=3 2024-09-12T00:35:16.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.763+0000 7fa98607a9c0 20 add_watcher() i=4 2024-09-12T00:35:16.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.763+0000 7fa98607a9c0 20 add_watcher() i=5 2024-09-12T00:35:16.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.763+0000 7fa98607a9c0 20 add_watcher() i=6 2024-09-12T00:35:16.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.767+0000 7fa98607a9c0 20 add_watcher() i=7 2024-09-12T00:35:16.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.767+0000 7fa98607a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:16.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.771+0000 7fa839fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:16.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.771+0000 7fa98607a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:16.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.771+0000 7fa98607a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:16.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.771+0000 7fa98607a9c0 5 note: GC not initialized 2024-09-12T00:35:16.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.771+0000 7fa838fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:16.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.771+0000 7fa98607a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:16.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.771+0000 7fa98607a9c0 20 Filter name: none 2024-09-12T00:35:16.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.771+0000 7fa7b27fc640 20 reqs_thread_entry: start 2024-09-12T00:35:16.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.783+0000 7fa839fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:16.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.791+0000 7fa98607a9c0 20 remove_watcher() i=0 2024-09-12T00:35:16.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.791+0000 7fa98607a9c0 2 removed watcher, disabling cache 2024-09-12T00:35:16.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.791+0000 7fa98607a9c0 20 remove_watcher() i=1 2024-09-12T00:35:16.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.795+0000 7fa98607a9c0 20 remove_watcher() i=2 2024-09-12T00:35:16.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.795+0000 7fa98607a9c0 20 remove_watcher() i=3 2024-09-12T00:35:16.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.799+0000 7fa98607a9c0 20 remove_watcher() i=4 2024-09-12T00:35:16.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.799+0000 7fa98607a9c0 20 remove_watcher() i=5 2024-09-12T00:35:16.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.803+0000 7fa98607a9c0 20 remove_watcher() i=6 2024-09-12T00:35:16.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.803+0000 7fa98607a9c0 20 remove_watcher() i=7 2024-09-12T00:35:16.814 INFO:tasks.workunit.client.0.smithi102.stderr:bucket name a-bucket 2024-09-12T00:35:16.814 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard process 2024-09-12T00:35:16.814 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:16.814 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshard process 2024-09-12T00:35:16.843 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:16.843 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:16.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.891+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.895+0000 7fa5796759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.895+0000 7fa5796759c0 20 realm 2024-09-12T00:35:16.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.895+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.895+0000 7fa5796759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.895+0000 7fa5796759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:16.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.895+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.895+0000 7fa5796759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.895+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.895+0000 7fa5796759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:16.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.895+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.899+0000 7fa5796759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:16.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.899+0000 7fa5796759c0 20 searching for the correct realm 2024-09-12T00:35:16.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.903+0000 7fa57717b640 0 -- 172.21.15.102:0/1514395490 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x5608892239e0 msgr2=0x560889225ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:16.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.907+0000 7fa57697a640 0 -- 172.21.15.102:0/1514395490 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fa57012c260 msgr2=0x7fa570009250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:16.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:16.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:16.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:16.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:16.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:16.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:16.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.915+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 zone default found 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 4 Realm: () 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 zonegroup default 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 started sync module instance, tier type = 2024-09-12T00:35:16.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.919+0000 7fa5796759c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:16.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.935+0000 7fa5796759c0 20 add_watcher() i=0 2024-09-12T00:35:16.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.935+0000 7fa5796759c0 20 add_watcher() i=1 2024-09-12T00:35:16.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.935+0000 7fa5796759c0 20 add_watcher() i=2 2024-09-12T00:35:16.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.935+0000 7fa5796759c0 20 add_watcher() i=3 2024-09-12T00:35:16.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.935+0000 7fa5796759c0 20 add_watcher() i=4 2024-09-12T00:35:16.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.935+0000 7fa5796759c0 20 add_watcher() i=5 2024-09-12T00:35:16.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.935+0000 7fa5796759c0 20 add_watcher() i=6 2024-09-12T00:35:16.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.935+0000 7fa5796759c0 20 add_watcher() i=7 2024-09-12T00:35:16.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.935+0000 7fa5796759c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:16.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.939+0000 7fa42dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:16.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.939+0000 7fa5796759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:16.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.939+0000 7fa5796759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:16.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.939+0000 7fa5796759c0 5 note: GC not initialized 2024-09-12T00:35:16.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.939+0000 7fa42cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:16.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.939+0000 7fa5796759c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:16.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.939+0000 7fa5796759c0 20 Filter name: none 2024-09-12T00:35:16.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.939+0000 7fa3a67fc640 20 reqs_thread_entry: start 2024-09-12T00:35:16.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.939+0000 7fa5796759c0 20 processing logshard = reshard.0000000000 2024-09-12T00:35:16.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.943+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:35:16.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.943+0000 7fa5796759c0 20 processing logshard = reshard.0000000001 2024-09-12T00:35:16.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.947+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:35:16.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.947+0000 7fa5796759c0 20 processing logshard = reshard.0000000002 2024-09-12T00:35:16.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.951+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:35:16.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.951+0000 7fa5796759c0 20 processing logshard = reshard.0000000003 2024-09-12T00:35:16.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.955+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:35:16.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.955+0000 7fa5796759c0 20 processing logshard = reshard.0000000004 2024-09-12T00:35:16.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.963+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:35:16.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.963+0000 7fa5796759c0 20 processing logshard = reshard.0000000005 2024-09-12T00:35:16.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.967+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:35:16.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.967+0000 7fa5796759c0 20 processing logshard = reshard.0000000006 2024-09-12T00:35:16.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 20 process_entry resharding a-bucket 2024-09-12T00:35:16.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:16.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:16.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:35:16.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:16.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:35:16.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:16.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:16.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:16.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:16.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:16.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.971+0000 7fa5796759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:35:16.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa5796759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:16.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa5796759c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:16.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa5796759c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:16.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa5796759c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:35:16.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa45affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398882 cookie 94594660471392 notifier 6057 bl.length()=911 2024-09-12T00:35:16.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa45affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:16.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa45affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:16.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa45affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:16.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:35:16.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:35:16.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:35:16.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.987+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:35:16.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.0 2024-09-12T00:35:16.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.0 2024-09-12T00:35:16.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.1 2024-09-12T00:35:16.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.1 2024-09-12T00:35:16.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.2 2024-09-12T00:35:16.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.2 2024-09-12T00:35:16.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.3 2024-09-12T00:35:16.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.3 2024-09-12T00:35:16.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.4 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.4 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.5 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.5 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.6 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.6 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.7 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.7 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.8 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.8 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.9 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.9 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.10 2024-09-12T00:35:16.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.10 2024-09-12T00:35:16.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.11 2024-09-12T00:35:16.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.11 2024-09-12T00:35:16.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.0 2024-09-12T00:35:16.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:16.999+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1 2024-09-12T00:35:16.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.003+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2 2024-09-12T00:35:16.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.003+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3 2024-09-12T00:35:16.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.003+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.4 2024-09-12T00:35:16.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.003+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.5 2024-09-12T00:35:17.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.003+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.6 2024-09-12T00:35:17.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.007+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.7 2024-09-12T00:35:17.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.007+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.8 2024-09-12T00:35:17.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.007+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.9 2024-09-12T00:35:17.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.007+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.10 2024-09-12T00:35:17.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.011+0000 7fa5796759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:17.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.011+0000 7fa5796759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:35:17.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.011+0000 7fa5796759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:17.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.011+0000 7fa5796759c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:17.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.011+0000 7fa5796759c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:17.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.011+0000 7fa5796759c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:35:17.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.015+0000 7fa45affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398883 cookie 94594660471392 notifier 6057 bl.length()=911 2024-09-12T00:35:17.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.015+0000 7fa45affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:17.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.015+0000 7fa45affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:17.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.015+0000 7fa45affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:17.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.015+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:35:17.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.015+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:35:17.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.015+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:35:17.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.015+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:35:17.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.023+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.0 2024-09-12T00:35:17.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.023+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1 2024-09-12T00:35:17.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.023+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2 2024-09-12T00:35:17.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.023+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3 2024-09-12T00:35:17.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.023+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.4 2024-09-12T00:35:17.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.023+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.5 2024-09-12T00:35:17.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.027+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.6 2024-09-12T00:35:17.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.027+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.7 2024-09-12T00:35:17.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.027+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.8 2024-09-12T00:35:17.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.027+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.9 2024-09-12T00:35:17.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.027+0000 7fa5796759c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.10 2024-09-12T00:35:17.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.031+0000 7fa5796759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:17.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.031+0000 7fa5796759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:35:17.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.031+0000 7fa5796759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:17.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.031+0000 7fa5796759c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:17.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.031+0000 7fa5796759c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:17.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.031+0000 7fa5796759c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:35:17.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.031+0000 7fa45affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398884 cookie 94594660471392 notifier 6057 bl.length()=879 2024-09-12T00:35:17.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.031+0000 7fa45affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:17.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.031+0000 7fa45affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:17.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.031+0000 7fa45affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:17.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.035+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:35:17.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.035+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:35:17.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.035+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:35:17.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.035+0000 7fa5796759c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:35:17.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.039+0000 7fa5796759c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T00:35:17.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.043+0000 7fa5796759c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:35:17.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.051+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:35:17.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.051+0000 7fa5796759c0 20 processing logshard = reshard.0000000007 2024-09-12T00:35:17.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.055+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:35:17.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.055+0000 7fa5796759c0 20 processing logshard = reshard.0000000008 2024-09-12T00:35:17.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.059+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:35:17.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.059+0000 7fa5796759c0 20 processing logshard = reshard.0000000009 2024-09-12T00:35:17.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.067+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:35:17.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.067+0000 7fa5796759c0 20 processing logshard = reshard.0000000010 2024-09-12T00:35:17.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.067+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:35:17.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.067+0000 7fa5796759c0 20 processing logshard = reshard.0000000011 2024-09-12T00:35:17.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.075+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:35:17.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.075+0000 7fa5796759c0 20 processing logshard = reshard.0000000012 2024-09-12T00:35:17.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.079+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:35:17.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.079+0000 7fa5796759c0 20 processing logshard = reshard.0000000013 2024-09-12T00:35:17.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.083+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:35:17.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.083+0000 7fa5796759c0 20 processing logshard = reshard.0000000014 2024-09-12T00:35:17.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.087+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:35:17.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.087+0000 7fa5796759c0 20 processing logshard = reshard.0000000015 2024-09-12T00:35:17.091 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.095+0000 7fa5796759c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:35:17.091 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.095+0000 7fa42dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:17.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.103+0000 7fa5796759c0 20 remove_watcher() i=0 2024-09-12T00:35:17.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.103+0000 7fa5796759c0 2 removed watcher, disabling cache 2024-09-12T00:35:17.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.103+0000 7fa5796759c0 20 remove_watcher() i=1 2024-09-12T00:35:17.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.107+0000 7fa5796759c0 20 remove_watcher() i=2 2024-09-12T00:35:17.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.107+0000 7fa5796759c0 20 remove_watcher() i=3 2024-09-12T00:35:17.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.111+0000 7fa5796759c0 20 remove_watcher() i=4 2024-09-12T00:35:17.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.111+0000 7fa5796759c0 20 remove_watcher() i=5 2024-09-12T00:35:17.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.111+0000 7fa5796759c0 20 remove_watcher() i=6 2024-09-12T00:35:17.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:17.115+0000 7fa5796759c0 20 remove_watcher() i=7 2024-09-12T00:35:22.130 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:35:22.164 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:22.164 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:22.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.215+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.215+0000 7f19b62529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:22.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.215+0000 7f19b62529c0 20 realm 2024-09-12T00:35:22.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.215+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.215+0000 7f19b62529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:22.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.215+0000 7f19b62529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:22.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.215+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.215+0000 7f19b62529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:22.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.215+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.219+0000 7f19b62529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:22.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.219+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.219+0000 7f19b62529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:22.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.219+0000 7f19b62529c0 20 searching for the correct realm 2024-09-12T00:35:22.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.223+0000 7f19b4559640 0 -- 172.21.15.102:0/3555230546 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f19a80c4ba0 msgr2=0x7f19a80de050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:22.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.231+0000 7f19b3557640 0 -- 172.21.15.102:0/3555230546 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f19ac04dc20 msgr2=0x7f19ac076040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:22.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.447+0000 7f19b62529c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:22.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.447+0000 7f19b62529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:22.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.447+0000 7f19b62529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:22.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.447+0000 7f19b62529c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:22.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.447+0000 7f19b62529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:22.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.447+0000 7f19b62529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:22.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.447+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.447+0000 7f19b62529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:22.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.447+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:22.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:22.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 zone default found 2024-09-12T00:35:22.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 4 Realm: () 2024-09-12T00:35:22.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:22.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:22.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:22.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 zonegroup default 2024-09-12T00:35:22.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:22.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:22.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:22.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 started sync module instance, tier type = 2024-09-12T00:35:22.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.451+0000 7f19b62529c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:22.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.475+0000 7f19b62529c0 20 add_watcher() i=0 2024-09-12T00:35:22.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.475+0000 7f19b62529c0 20 add_watcher() i=1 2024-09-12T00:35:22.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.475+0000 7f19b62529c0 20 add_watcher() i=2 2024-09-12T00:35:22.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.475+0000 7f19b62529c0 20 add_watcher() i=3 2024-09-12T00:35:22.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.475+0000 7f19b62529c0 20 add_watcher() i=4 2024-09-12T00:35:22.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.475+0000 7f19b62529c0 20 add_watcher() i=5 2024-09-12T00:35:22.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.475+0000 7f19b62529c0 20 add_watcher() i=6 2024-09-12T00:35:22.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.479+0000 7f19b62529c0 20 add_watcher() i=7 2024-09-12T00:35:22.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.479+0000 7f19b62529c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:22.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.483+0000 7f1869fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:22.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.483+0000 7f19b62529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:22.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.483+0000 7f19b62529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:22.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.483+0000 7f19b62529c0 5 note: GC not initialized 2024-09-12T00:35:22.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.487+0000 7f1868fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:22.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.487+0000 7f19b62529c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:22.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.487+0000 7f19b62529c0 20 Filter name: none 2024-09-12T00:35:22.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.487+0000 7f17e27fc640 20 reqs_thread_entry: start 2024-09-12T00:35:22.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.487+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.487+0000 7f19b62529c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:22.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.487+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.487+0000 7f19b62529c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:22.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.487+0000 7f19b62529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:22.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.487+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.491+0000 7f19b62529c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:22.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.491+0000 7f19b62529c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:22.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.491+0000 7f19b62529c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:22.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.491+0000 7f19b62529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:22.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.495+0000 7f1869fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:22.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.499+0000 7f19b62529c0 20 remove_watcher() i=0 2024-09-12T00:35:22.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.499+0000 7f19b62529c0 2 removed watcher, disabling cache 2024-09-12T00:35:22.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.499+0000 7f19b62529c0 20 remove_watcher() i=1 2024-09-12T00:35:22.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.503+0000 7f19b62529c0 20 remove_watcher() i=2 2024-09-12T00:35:22.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.507+0000 7f19b62529c0 20 remove_watcher() i=3 2024-09-12T00:35:22.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.507+0000 7f19b62529c0 20 remove_watcher() i=4 2024-09-12T00:35:22.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.507+0000 7f19b62529c0 20 remove_watcher() i=5 2024-09-12T00:35:22.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.511+0000 7f19b62529c0 20 remove_watcher() i=6 2024-09-12T00:35:22.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:22.511+0000 7f19b62529c0 20 remove_watcher() i=7 2024-09-12T00:35:22.522 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:22.522 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:22.522 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: a-bucket id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:35:22.522 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:22.522 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard add non empty bucket 2024-09-12T00:35:22.522 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:22.525 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:22.525 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:22.602 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:22.602 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:22.706 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:22.706 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:22.812 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:22.812 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:22.900 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:22.900 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:22.988 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:22.989 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:23.087 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:23.093 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:23.182 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:23.273 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:35:23.307 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:23.307 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:23.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.359+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.363+0000 7fca2c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.363+0000 7fca2c7419c0 20 realm 2024-09-12T00:35:23.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.363+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.363+0000 7fca2c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.363+0000 7fca2c7419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:23.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.363+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.363+0000 7fca2c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.363+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.367+0000 7fca2c7419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:23.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.367+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.367+0000 7fca2c7419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:23.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.367+0000 7fca2c7419c0 20 searching for the correct realm 2024-09-12T00:35:23.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.367+0000 7fca29a46640 0 -- 172.21.15.102:0/635011221 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7fca240f57e0 msgr2=0x7fca2411b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:23.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.579+0000 7fca2aa48640 0 -- 172.21.15.102:0/635011221 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x555a8ac0b5a0 msgr2=0x555a8ac0d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:23.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.595+0000 7fca2c7419c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:23.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:23.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:23.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:23.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:23.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:23.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:23.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:23.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 zone default found 2024-09-12T00:35:23.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 4 Realm: () 2024-09-12T00:35:23.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:23.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:23.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:23.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 zonegroup default 2024-09-12T00:35:23.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.599+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.603+0000 7fca2c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.603+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.603+0000 7fca2c7419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.603+0000 7fca2c7419c0 20 started sync module instance, tier type = 2024-09-12T00:35:23.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.603+0000 7fca2c7419c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:23.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.627+0000 7fca2c7419c0 20 add_watcher() i=0 2024-09-12T00:35:23.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.627+0000 7fca2c7419c0 20 add_watcher() i=1 2024-09-12T00:35:23.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.627+0000 7fca2c7419c0 20 add_watcher() i=2 2024-09-12T00:35:23.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.627+0000 7fca2c7419c0 20 add_watcher() i=3 2024-09-12T00:35:23.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.627+0000 7fca2c7419c0 20 add_watcher() i=4 2024-09-12T00:35:23.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.627+0000 7fca2c7419c0 20 add_watcher() i=5 2024-09-12T00:35:23.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.627+0000 7fca2c7419c0 20 add_watcher() i=6 2024-09-12T00:35:23.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.627+0000 7fca2c7419c0 20 add_watcher() i=7 2024-09-12T00:35:23.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.627+0000 7fca2c7419c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:23.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.631+0000 7fc8e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:23.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:23.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:23.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 5 note: GC not initialized 2024-09-12T00:35:23.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fc85b7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:23.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:23.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 20 Filter name: none 2024-09-12T00:35:23.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fc8597fa640 20 reqs_thread_entry: start 2024-09-12T00:35:23.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:23.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:23.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:23.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.635+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.639+0000 7fca2c7419c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:23.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.639+0000 7fca2c7419c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.639+0000 7fca2c7419c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:23.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.639+0000 7fca2c7419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:23.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.643+0000 7fc8e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:23.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.647+0000 7fca2c7419c0 20 remove_watcher() i=0 2024-09-12T00:35:23.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.647+0000 7fca2c7419c0 2 removed watcher, disabling cache 2024-09-12T00:35:23.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.651+0000 7fca2c7419c0 20 remove_watcher() i=1 2024-09-12T00:35:23.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.651+0000 7fca2c7419c0 20 remove_watcher() i=2 2024-09-12T00:35:23.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.655+0000 7fca2c7419c0 20 remove_watcher() i=3 2024-09-12T00:35:23.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.655+0000 7fca2c7419c0 20 remove_watcher() i=4 2024-09-12T00:35:23.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.659+0000 7fca2c7419c0 20 remove_watcher() i=5 2024-09-12T00:35:23.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.659+0000 7fca2c7419c0 20 remove_watcher() i=6 2024-09-12T00:35:23.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.659+0000 7fca2c7419c0 20 remove_watcher() i=7 2024-09-12T00:35:23.673 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:23.673 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:23.673 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: a-bucket id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T00:35:23.673 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:23.673 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T00:35:23.707 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:23.707 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:23.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.755+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.759+0000 7f1aecb6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.759+0000 7f1aecb6b9c0 20 realm 2024-09-12T00:35:23.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.759+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.759+0000 7f1aecb6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.759+0000 7f1aecb6b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:23.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.759+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.759+0000 7f1aecb6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.759+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.759+0000 7f1aecb6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:23.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.759+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.763+0000 7f1aecb6b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:23.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.763+0000 7f1aecb6b9c0 20 searching for the correct realm 2024-09-12T00:35:23.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.763+0000 7f1aeae72640 0 -- 172.21.15.102:0/603263166 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55e655aa0770 msgr2=0x55e655aa2b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:23.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.767+0000 7f1aea671640 0 -- 172.21.15.102:0/603263166 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x7f1adc089bd0 msgr2=0x7f1adc064930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:23.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:23.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:23.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:23.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:23.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:23.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:23.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:23.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.991+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:23.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 zone default found 2024-09-12T00:35:23.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 4 Realm: () 2024-09-12T00:35:23.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:23.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:23.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:23.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 zonegroup default 2024-09-12T00:35:23.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:23.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:23.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 started sync module instance, tier type = 2024-09-12T00:35:23.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:23.995+0000 7f1aecb6b9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:24.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.019+0000 7f1aecb6b9c0 20 add_watcher() i=0 2024-09-12T00:35:24.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.019+0000 7f1aecb6b9c0 20 add_watcher() i=1 2024-09-12T00:35:24.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.019+0000 7f1aecb6b9c0 20 add_watcher() i=2 2024-09-12T00:35:24.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.019+0000 7f1aecb6b9c0 20 add_watcher() i=3 2024-09-12T00:35:24.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.019+0000 7f1aecb6b9c0 20 add_watcher() i=4 2024-09-12T00:35:24.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.019+0000 7f1aecb6b9c0 20 add_watcher() i=5 2024-09-12T00:35:24.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.019+0000 7f1aecb6b9c0 20 add_watcher() i=6 2024-09-12T00:35:24.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.023+0000 7f1aecb6b9c0 20 add_watcher() i=7 2024-09-12T00:35:24.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.023+0000 7f1aecb6b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:24.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f19a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:24.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:24.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:24.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 5 note: GC not initialized 2024-09-12T00:35:24.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f199b7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:24.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:24.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 20 Filter name: none 2024-09-12T00:35:24.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f19997fa640 20 reqs_thread_entry: start 2024-09-12T00:35:24.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:24.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:24.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:35:24.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:24.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:35:24.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.027+0000 7f1aecb6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.031+0000 7f1aecb6b9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:24.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.031+0000 7f1aecb6b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:24.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.031+0000 7f1aecb6b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:24.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.031+0000 7f1aecb6b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:24.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.031+0000 7f1aecb6b9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:24.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.031+0000 7f1aecb6b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:35:24.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.035+0000 7f19a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:24.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.039+0000 7f1aecb6b9c0 20 remove_watcher() i=0 2024-09-12T00:35:24.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.039+0000 7f1aecb6b9c0 2 removed watcher, disabling cache 2024-09-12T00:35:24.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.039+0000 7f1aecb6b9c0 20 remove_watcher() i=1 2024-09-12T00:35:24.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.043+0000 7f1aecb6b9c0 20 remove_watcher() i=2 2024-09-12T00:35:24.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.047+0000 7f1aecb6b9c0 20 remove_watcher() i=3 2024-09-12T00:35:24.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.047+0000 7f1aecb6b9c0 20 remove_watcher() i=4 2024-09-12T00:35:24.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.051+0000 7f1aecb6b9c0 20 remove_watcher() i=5 2024-09-12T00:35:24.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.051+0000 7f1aecb6b9c0 20 remove_watcher() i=6 2024-09-12T00:35:24.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.051+0000 7f1aecb6b9c0 20 remove_watcher() i=7 2024-09-12T00:35:24.064 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshard list 2024-09-12T00:35:24.093 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:24.093 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:24.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.143+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.143+0000 7fc2ad3e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.143+0000 7fc2ad3e19c0 20 realm 2024-09-12T00:35:24.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.143+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.143+0000 7fc2ad3e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.143+0000 7fc2ad3e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:24.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.143+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.143+0000 7fc2ad3e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.143+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.147+0000 7fc2ad3e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:24.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.147+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.147+0000 7fc2ad3e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:24.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.147+0000 7fc2ad3e19c0 20 searching for the correct realm 2024-09-12T00:35:24.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.151+0000 7fc2ab6e8640 0 -- 172.21.15.102:0/3260168059 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fc2a0131ac0 msgr2=0x7fc2a00fd130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:24.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.159+0000 7fc2aa6e6640 0 -- 172.21.15.102:0/3260168059 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fc2a4062040 msgr2=0x7fc2a4062930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:24.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.375+0000 7fc2ad3e19c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:24.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.375+0000 7fc2ad3e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:24.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.375+0000 7fc2ad3e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:24.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.375+0000 7fc2ad3e19c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:24.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.375+0000 7fc2ad3e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:24.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.375+0000 7fc2ad3e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:24.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.375+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:24.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:24.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 zone default found 2024-09-12T00:35:24.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 4 Realm: () 2024-09-12T00:35:24.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:24.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:24.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:24.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 zonegroup default 2024-09-12T00:35:24.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 started sync module instance, tier type = 2024-09-12T00:35:24.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.379+0000 7fc2ad3e19c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:24.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.399+0000 7fc2ad3e19c0 20 add_watcher() i=0 2024-09-12T00:35:24.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.399+0000 7fc2ad3e19c0 20 add_watcher() i=1 2024-09-12T00:35:24.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.399+0000 7fc2ad3e19c0 20 add_watcher() i=2 2024-09-12T00:35:24.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.399+0000 7fc2ad3e19c0 20 add_watcher() i=3 2024-09-12T00:35:24.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.399+0000 7fc2ad3e19c0 20 add_watcher() i=4 2024-09-12T00:35:24.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.399+0000 7fc2ad3e19c0 20 add_watcher() i=5 2024-09-12T00:35:24.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.399+0000 7fc2ad3e19c0 20 add_watcher() i=6 2024-09-12T00:35:24.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.403+0000 7fc2ad3e19c0 20 add_watcher() i=7 2024-09-12T00:35:24.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.403+0000 7fc2ad3e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:24.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.407+0000 7fc1617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:24.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.407+0000 7fc2ad3e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:24.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.407+0000 7fc2ad3e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:24.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.407+0000 7fc2ad3e19c0 5 note: GC not initialized 2024-09-12T00:35:24.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.407+0000 7fc0dbfff640 20 reqs_thread_entry: start 2024-09-12T00:35:24.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.407+0000 7fc2ad3e19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:24.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.407+0000 7fc2ad3e19c0 20 Filter name: none 2024-09-12T00:35:24.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.407+0000 7fc0d9ffb640 20 reqs_thread_entry: start 2024-09-12T00:35:24.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.423+0000 7fc1617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:24.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.427+0000 7fc2ad3e19c0 20 remove_watcher() i=0 2024-09-12T00:35:24.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.427+0000 7fc2ad3e19c0 2 removed watcher, disabling cache 2024-09-12T00:35:24.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.427+0000 7fc2ad3e19c0 20 remove_watcher() i=1 2024-09-12T00:35:24.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.431+0000 7fc2ad3e19c0 20 remove_watcher() i=2 2024-09-12T00:35:24.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.435+0000 7fc2ad3e19c0 20 remove_watcher() i=3 2024-09-12T00:35:24.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.435+0000 7fc2ad3e19c0 20 remove_watcher() i=4 2024-09-12T00:35:24.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.439+0000 7fc2ad3e19c0 20 remove_watcher() i=5 2024-09-12T00:35:24.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.439+0000 7fc2ad3e19c0 20 remove_watcher() i=6 2024-09-12T00:35:24.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.443+0000 7fc2ad3e19c0 20 remove_watcher() i=7 2024-09-12T00:35:24.451 INFO:tasks.workunit.client.0.smithi102.stderr:bucket name a-bucket 2024-09-12T00:35:24.451 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard process non empty bucket 2024-09-12T00:35:24.451 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:24.452 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshard process 2024-09-12T00:35:24.476 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:24.477 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:24.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.527+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.527+0000 7fa6d717d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.527+0000 7fa6d717d9c0 20 realm 2024-09-12T00:35:24.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.527+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.527+0000 7fa6d717d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.527+0000 7fa6d717d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:24.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.527+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.527+0000 7fa6d717d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.527+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.531+0000 7fa6d717d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:24.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.531+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.531+0000 7fa6d717d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:24.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.531+0000 7fa6d717d9c0 20 searching for the correct realm 2024-09-12T00:35:24.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.535+0000 7fa6d4c83640 0 -- 172.21.15.102:0/2438327248 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x55af831cbf90 msgr2=0x55af831ce450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:24.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.543+0000 7fa6d4482640 0 -- 172.21.15.102:0/2438327248 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fa6c4135420 msgr2=0x7fa6c40e4910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:24.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:24.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:24.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:24.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:24.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:24.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:24.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 zone default found 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 4 Realm: () 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 zonegroup default 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 started sync module instance, tier type = 2024-09-12T00:35:24.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.551+0000 7fa6d717d9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:24.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.567+0000 7fa6d717d9c0 20 add_watcher() i=0 2024-09-12T00:35:24.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.567+0000 7fa6d717d9c0 20 add_watcher() i=1 2024-09-12T00:35:24.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.567+0000 7fa6d717d9c0 20 add_watcher() i=2 2024-09-12T00:35:24.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.567+0000 7fa6d717d9c0 20 add_watcher() i=3 2024-09-12T00:35:24.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.567+0000 7fa6d717d9c0 20 add_watcher() i=4 2024-09-12T00:35:24.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.567+0000 7fa6d717d9c0 20 add_watcher() i=5 2024-09-12T00:35:24.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.567+0000 7fa6d717d9c0 20 add_watcher() i=6 2024-09-12T00:35:24.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa6d717d9c0 20 add_watcher() i=7 2024-09-12T00:35:24.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa6d717d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:24.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa58b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa6d717d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa6d717d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa6d717d9c0 5 note: GC not initialized 2024-09-12T00:35:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa58a7e4640 20 reqs_thread_entry: start 2024-09-12T00:35:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa6d717d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa6d717d9c0 20 Filter name: none 2024-09-12T00:35:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa5837fe640 20 reqs_thread_entry: start 2024-09-12T00:35:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.571+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000000 2024-09-12T00:35:24.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.579+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:35:24.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.579+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000001 2024-09-12T00:35:24.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.583+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:35:24.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.583+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000002 2024-09-12T00:35:24.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.587+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:35:24.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.587+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000003 2024-09-12T00:35:24.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.591+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:35:24.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.591+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000004 2024-09-12T00:35:24.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.599+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:35:24.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.599+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000005 2024-09-12T00:35:24.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.603+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:35:24.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.603+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000006 2024-09-12T00:35:24.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.603+0000 7fa6d717d9c0 20 process_entry resharding a-bucket 2024-09-12T00:35:24.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.603+0000 7fa6d717d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:24.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.603+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.603+0000 7fa6d717d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:24.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.603+0000 7fa6d717d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:35:24.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.603+0000 7fa6d717d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:24.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.603+0000 7fa6d717d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:35:24.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.603+0000 7fa6d717d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.607+0000 7fa6d717d9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:24.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.607+0000 7fa6d717d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:24.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.607+0000 7fa6d717d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:24.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.607+0000 7fa6d717d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:24.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.607+0000 7fa6d717d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:24.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.607+0000 7fa6d717d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:35:24.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.619+0000 7fa6d717d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:24.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.619+0000 7fa6d717d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:24.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.619+0000 7fa6d717d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:24.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.619+0000 7fa6d717d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:35:24.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.619+0000 7fa5abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398885 cookie 94212307341872 notifier 6150 bl.length()=911 2024-09-12T00:35:24.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.619+0000 7fa5abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:24.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.619+0000 7fa5abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:24.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.619+0000 7fa5abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:24.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.623+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:35:24.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.623+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:35:24.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.623+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:35:24.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.623+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:35:24.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:35:24.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:35:24.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:35:24.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:35:24.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:35:24.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:35:24.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:35:24.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:35:24.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:35:24.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:35:24.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:35:24.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:35:24.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:35:24.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.0 2024-09-12T00:35:24.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.631+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.0 2024-09-12T00:35:24.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.635+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.1 2024-09-12T00:35:24.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.635+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.1 2024-09-12T00:35:24.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.635+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.2 2024-09-12T00:35:24.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.635+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.2 2024-09-12T00:35:24.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.635+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.3 2024-09-12T00:35:24.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.635+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.3 2024-09-12T00:35:24.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.635+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.4 2024-09-12T00:35:24.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.635+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.4 2024-09-12T00:35:24.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.639+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.5 2024-09-12T00:35:24.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.639+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.5 2024-09-12T00:35:24.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.639+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.6 2024-09-12T00:35:24.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.639+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.6 2024-09-12T00:35:24.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.639+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.7 2024-09-12T00:35:24.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.639+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.7 2024-09-12T00:35:24.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.639+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.8 2024-09-12T00:35:24.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.639+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.8 2024-09-12T00:35:24.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.639+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.9 2024-09-12T00:35:24.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.639+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.9 2024-09-12T00:35:24.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.643+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.10 2024-09-12T00:35:24.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.643+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.10 2024-09-12T00:35:24.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.643+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.11 2024-09-12T00:35:24.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.643+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.11 2024-09-12T00:35:24.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.647+0000 7fa6d717d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:24.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.647+0000 7fa6d717d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:35:24.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.651+0000 7fa6d717d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:24.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.651+0000 7fa6d717d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:24.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.651+0000 7fa6d717d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:24.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.651+0000 7fa6d717d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:35:24.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.651+0000 7fa5ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398886 cookie 94212307341872 notifier 6150 bl.length()=911 2024-09-12T00:35:24.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.651+0000 7fa5ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:24.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.651+0000 7fa5ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:24.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.651+0000 7fa5ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:24.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.655+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:35:24.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.655+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:35:24.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.655+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:35:24.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.655+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:35:24.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.659+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.0 2024-09-12T00:35:24.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.659+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.0 2024-09-12T00:35:24.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.659+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.1 2024-09-12T00:35:24.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.659+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.1 2024-09-12T00:35:24.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.2 2024-09-12T00:35:24.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.2 2024-09-12T00:35:24.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.3 2024-09-12T00:35:24.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.3 2024-09-12T00:35:24.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.4 2024-09-12T00:35:24.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.4 2024-09-12T00:35:24.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.5 2024-09-12T00:35:24.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.5 2024-09-12T00:35:24.659 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.6 2024-09-12T00:35:24.659 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.6 2024-09-12T00:35:24.659 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.7 2024-09-12T00:35:24.659 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.663+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.7 2024-09-12T00:35:24.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.667+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.8 2024-09-12T00:35:24.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.667+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.8 2024-09-12T00:35:24.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.667+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.9 2024-09-12T00:35:24.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.667+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.9 2024-09-12T00:35:24.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.667+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.10 2024-09-12T00:35:24.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.667+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.10 2024-09-12T00:35:24.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.667+0000 7fa6d717d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.11 2024-09-12T00:35:24.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.667+0000 7fa6d717d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.1.11 2024-09-12T00:35:24.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.667+0000 7fa6d717d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:24.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.667+0000 7fa6d717d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:35:24.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.671+0000 7fa6d717d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:24.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.671+0000 7fa6d717d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:24.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.671+0000 7fa6d717d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:24.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.671+0000 7fa6d717d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:35:24.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.671+0000 7fa5ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398887 cookie 94212307341872 notifier 6150 bl.length()=879 2024-09-12T00:35:24.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.671+0000 7fa5ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:35:24.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.671+0000 7fa5ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:35:24.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.671+0000 7fa5ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:35:24.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.675+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:35:24.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.675+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:35:24.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.675+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:35:24.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.675+0000 7fa6d717d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:35:24.674 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.679+0000 7fa6d717d9c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T00:35:24.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.683+0000 7fa6d717d9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:35:24.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.687+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:35:24.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.687+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000007 2024-09-12T00:35:24.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.691+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:35:24.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.691+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000008 2024-09-12T00:35:24.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.695+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:35:24.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.695+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000009 2024-09-12T00:35:24.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.703+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:35:24.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.703+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000010 2024-09-12T00:35:24.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.707+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:35:24.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.707+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000011 2024-09-12T00:35:24.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.711+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:35:24.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.711+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000012 2024-09-12T00:35:24.715 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.719+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:35:24.715 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.719+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000013 2024-09-12T00:35:24.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.727+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:35:24.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.727+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000014 2024-09-12T00:35:24.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.731+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:35:24.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.731+0000 7fa6d717d9c0 20 processing logshard = reshard.0000000015 2024-09-12T00:35:24.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.739+0000 7fa6d717d9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:35:24.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.739+0000 7fa58b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:24.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.743+0000 7fa6d717d9c0 20 remove_watcher() i=0 2024-09-12T00:35:24.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.743+0000 7fa6d717d9c0 2 removed watcher, disabling cache 2024-09-12T00:35:24.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.747+0000 7fa6d717d9c0 20 remove_watcher() i=1 2024-09-12T00:35:24.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.747+0000 7fa6d717d9c0 20 remove_watcher() i=2 2024-09-12T00:35:24.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.751+0000 7fa6d717d9c0 20 remove_watcher() i=3 2024-09-12T00:35:24.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.755+0000 7fa6d717d9c0 20 remove_watcher() i=4 2024-09-12T00:35:24.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.755+0000 7fa6d717d9c0 20 remove_watcher() i=5 2024-09-12T00:35:24.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.759+0000 7fa6d717d9c0 20 remove_watcher() i=6 2024-09-12T00:35:24.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.759+0000 7fa6d717d9c0 20 remove_watcher() i=7 2024-09-12T00:35:24.770 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:35:24.801 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:24.801 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:24.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.851+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 realm 2024-09-12T00:35:24.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:24.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:24.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:24.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:24.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:24.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.855+0000 7f0fa2bf89c0 20 searching for the correct realm 2024-09-12T00:35:24.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:24.859+0000 7f0fa0eff640 0 -- 172.21.15.102:0/3671423771 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f0f88041040 msgr2=0x7f0f88041420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:25.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.075+0000 7f0f9fefd640 0 -- 172.21.15.102:0/3671423771 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f0f9008e760 msgr2=0x7f0f900606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.291+0000 7f0fa2bf89c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.291+0000 7f0fa2bf89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.291+0000 7f0fa2bf89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.291+0000 7f0fa2bf89c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.291+0000 7f0fa2bf89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.291+0000 7f0fa2bf89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.291+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 zone default found 2024-09-12T00:35:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 4 Realm: () 2024-09-12T00:35:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:25.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 zonegroup default 2024-09-12T00:35:25.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:25.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:25.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:25.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:25.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:25.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:25.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 started sync module instance, tier type = 2024-09-12T00:35:25.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.295+0000 7f0fa2bf89c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:25.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.319+0000 7f0fa2bf89c0 20 add_watcher() i=0 2024-09-12T00:35:25.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.319+0000 7f0fa2bf89c0 20 add_watcher() i=1 2024-09-12T00:35:25.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.319+0000 7f0fa2bf89c0 20 add_watcher() i=2 2024-09-12T00:35:25.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.319+0000 7f0fa2bf89c0 20 add_watcher() i=3 2024-09-12T00:35:25.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.319+0000 7f0fa2bf89c0 20 add_watcher() i=4 2024-09-12T00:35:25.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.319+0000 7f0fa2bf89c0 20 add_watcher() i=5 2024-09-12T00:35:25.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.319+0000 7f0fa2bf89c0 20 add_watcher() i=6 2024-09-12T00:35:25.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.323+0000 7f0fa2bf89c0 20 add_watcher() i=7 2024-09-12T00:35:25.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.323+0000 7f0fa2bf89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:25.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0e56fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:25.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0fa2bf89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:25.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0fa2bf89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:25.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0fa2bf89c0 5 note: GC not initialized 2024-09-12T00:35:25.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0e55fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:25.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0fa2bf89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:25.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0fa2bf89c0 20 Filter name: none 2024-09-12T00:35:25.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0dc77fe640 20 reqs_thread_entry: start 2024-09-12T00:35:25.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:25.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0fa2bf89c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:25.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.327+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:25.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.331+0000 7f0fa2bf89c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:25.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.331+0000 7f0fa2bf89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:25.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.331+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:25.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.331+0000 7f0fa2bf89c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:35:25.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.331+0000 7f0fa2bf89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:25.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.331+0000 7f0fa2bf89c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:35:25.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.331+0000 7f0fa2bf89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:25.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.335+0000 7f0e56fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.339+0000 7f0fa2bf89c0 20 remove_watcher() i=0 2024-09-12T00:35:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.339+0000 7f0fa2bf89c0 2 removed watcher, disabling cache 2024-09-12T00:35:25.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.343+0000 7f0fa2bf89c0 20 remove_watcher() i=1 2024-09-12T00:35:25.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.343+0000 7f0fa2bf89c0 20 remove_watcher() i=2 2024-09-12T00:35:25.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.347+0000 7f0fa2bf89c0 20 remove_watcher() i=3 2024-09-12T00:35:25.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.347+0000 7f0fa2bf89c0 20 remove_watcher() i=4 2024-09-12T00:35:25.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.351+0000 7f0fa2bf89c0 20 remove_watcher() i=5 2024-09-12T00:35:25.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.351+0000 7f0fa2bf89c0 20 remove_watcher() i=6 2024-09-12T00:35:25.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:25.355+0000 7f0fa2bf89c0 20 remove_watcher() i=7 2024-09-12T00:35:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:25.368 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:25.368 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: a-bucket id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:35:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:25.368 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:35:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:25.369 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:25.459 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:25.459 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:25.537 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:25.537 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:25.616 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:25.616 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:25.710 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:25.710 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:25.812 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:25.812 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:25.905 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:25.906 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.002 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.002 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.073 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.073 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.174 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.174 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.273 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.273 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.374 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.375 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.471 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.471 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.583 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.583 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.685 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.685 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.787 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.788 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.888 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.888 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:26.985 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:26.985 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:27.082 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:27.082 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:27.186 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:27.186 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:27.284 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:27.285 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:27.391 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:27.391 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:27.485 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:35:27.517 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:27.518 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:27.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.567+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.571+0000 7febe6cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:27.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.571+0000 7febe6cd89c0 20 realm 2024-09-12T00:35:27.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.571+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.571+0000 7febe6cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:27.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.571+0000 7febe6cd89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:27.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.571+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.571+0000 7febe6cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:27.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.571+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.571+0000 7febe6cd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:27.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.571+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.575+0000 7febe6cd89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:27.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.575+0000 7febe6cd89c0 20 searching for the correct realm 2024-09-12T00:35:27.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.579+0000 7febe4fdf640 0 -- 172.21.15.102:0/3112619303 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7febd80e2920 msgr2=0x7febd80aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:27.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.587+0000 7febe3fdd640 0 -- 172.21.15.102:0/3112619303 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7febdc0991a0 msgr2=0x7febdc076130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:27.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.803+0000 7febe6cd89c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:27.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.803+0000 7febe6cd89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:27.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.803+0000 7febe6cd89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:27.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.803+0000 7febe6cd89c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:27.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.803+0000 7febe6cd89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:27.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.803+0000 7febe6cd89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:27.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.803+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.803+0000 7febe6cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:27.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.803+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:27.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:27.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 zone default found 2024-09-12T00:35:27.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 4 Realm: () 2024-09-12T00:35:27.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:27.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:27.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:27.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 zonegroup default 2024-09-12T00:35:27.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:27.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:27.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:27.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 started sync module instance, tier type = 2024-09-12T00:35:27.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.807+0000 7febe6cd89c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:27.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.831+0000 7febe6cd89c0 20 add_watcher() i=0 2024-09-12T00:35:27.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.831+0000 7febe6cd89c0 20 add_watcher() i=1 2024-09-12T00:35:27.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.831+0000 7febe6cd89c0 20 add_watcher() i=2 2024-09-12T00:35:27.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.831+0000 7febe6cd89c0 20 add_watcher() i=3 2024-09-12T00:35:27.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.831+0000 7febe6cd89c0 20 add_watcher() i=4 2024-09-12T00:35:27.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.831+0000 7febe6cd89c0 20 add_watcher() i=5 2024-09-12T00:35:27.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.831+0000 7febe6cd89c0 20 add_watcher() i=6 2024-09-12T00:35:27.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.835+0000 7febe6cd89c0 20 add_watcher() i=7 2024-09-12T00:35:27.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.835+0000 7febe6cd89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:27.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.839+0000 7fea9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.839+0000 7febe6cd89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.839+0000 7febe6cd89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.839+0000 7febe6cd89c0 5 note: GC not initialized 2024-09-12T00:35:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.839+0000 7fea99fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.839+0000 7febe6cd89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.839+0000 7febe6cd89c0 20 Filter name: none 2024-09-12T00:35:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.839+0000 7fea0b7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.839+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.843+0000 7febe6cd89c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:27.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.843+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.843+0000 7febe6cd89c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:27.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.843+0000 7febe6cd89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:27.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.843+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.843+0000 7febe6cd89c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:27.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.843+0000 7febe6cd89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.847+0000 7febe6cd89c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.847+0000 7febe6cd89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:27.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.847+0000 7fea9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:27.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.855+0000 7febe6cd89c0 20 remove_watcher() i=0 2024-09-12T00:35:27.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.855+0000 7febe6cd89c0 2 removed watcher, disabling cache 2024-09-12T00:35:27.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.855+0000 7febe6cd89c0 20 remove_watcher() i=1 2024-09-12T00:35:27.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.859+0000 7febe6cd89c0 20 remove_watcher() i=2 2024-09-12T00:35:27.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.859+0000 7febe6cd89c0 20 remove_watcher() i=3 2024-09-12T00:35:27.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.863+0000 7febe6cd89c0 20 remove_watcher() i=4 2024-09-12T00:35:27.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.863+0000 7febe6cd89c0 20 remove_watcher() i=5 2024-09-12T00:35:27.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.863+0000 7febe6cd89c0 20 remove_watcher() i=6 2024-09-12T00:35:27.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.867+0000 7febe6cd89c0 20 remove_watcher() i=7 2024-09-12T00:35:27.876 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-init-index id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:27.876 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:35:27.912 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:27.913 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:27.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.959+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.963+0000 7f190d7d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:27.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.963+0000 7f190d7d59c0 20 realm 2024-09-12T00:35:27.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.963+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.963+0000 7f190d7d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:27.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.963+0000 7f190d7d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:27.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.963+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.963+0000 7f190d7d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:27.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.963+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.963+0000 7f190d7d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:27.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.963+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:27.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.967+0000 7f190d7d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:27.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.967+0000 7f190d7d59c0 20 searching for the correct realm 2024-09-12T00:35:27.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:27.967+0000 7f190badc640 0 -- 172.21.15.102:0/2404103858 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f1900026040 msgr2=0x7f1900044420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:28.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.183+0000 7f190aada640 0 -- 172.21.15.102:0/2404103858 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f1904114750 msgr2=0x7f19040fc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:28.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:28.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:28.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:28.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:28.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:28.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:28.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:28.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:28.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 zone default found 2024-09-12T00:35:28.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 4 Realm: () 2024-09-12T00:35:28.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:28.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:28.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:28.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 zonegroup default 2024-09-12T00:35:28.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.403+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.407+0000 7f190d7d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.407+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.407+0000 7f190d7d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.407+0000 7f190d7d59c0 20 started sync module instance, tier type = 2024-09-12T00:35:28.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.407+0000 7f190d7d59c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:28.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.431+0000 7f190d7d59c0 20 add_watcher() i=0 2024-09-12T00:35:28.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.431+0000 7f190d7d59c0 20 add_watcher() i=1 2024-09-12T00:35:28.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.431+0000 7f190d7d59c0 20 add_watcher() i=2 2024-09-12T00:35:28.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.431+0000 7f190d7d59c0 20 add_watcher() i=3 2024-09-12T00:35:28.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.431+0000 7f190d7d59c0 20 add_watcher() i=4 2024-09-12T00:35:28.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.431+0000 7f190d7d59c0 20 add_watcher() i=5 2024-09-12T00:35:28.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.431+0000 7f190d7d59c0 20 add_watcher() i=6 2024-09-12T00:35:28.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.431+0000 7f190d7d59c0 20 add_watcher() i=7 2024-09-12T00:35:28.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.431+0000 7f190d7d59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:28.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.435+0000 7f17c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:28.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:28.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:28.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 5 note: GC not initialized 2024-09-12T00:35:28.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f17c17e2640 20 reqs_thread_entry: start 2024-09-12T00:35:28.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:28.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 20 Filter name: none 2024-09-12T00:35:28.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f17ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:28.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:35:28.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:28.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:35:28.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:35:28.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 : miss 2024-09-12T00:35:28.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.439+0000 7f190d7d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.443+0000 7f190d7d59c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:28.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.443+0000 7f190d7d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 info.flags=0x17 2024-09-12T00:35:28.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.443+0000 7f190d7d59c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 to cache LRU end 2024-09-12T00:35:28.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.443+0000 7f190d7d59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:28.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.443+0000 7f190d7d59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:28.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.443+0000 7f190d7d59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 2024-09-12T00:35:28.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.443+0000 7f190d7d59c0 -1 Injecting error=-5 at location=init_index 2024-09-12T00:35:28.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.443+0000 7f190d7d59c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:35:28.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.447+0000 7f17c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:28.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.451+0000 7f190d7d59c0 20 remove_watcher() i=0 2024-09-12T00:35:28.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.451+0000 7f190d7d59c0 2 removed watcher, disabling cache 2024-09-12T00:35:28.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.455+0000 7f190d7d59c0 20 remove_watcher() i=1 2024-09-12T00:35:28.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.459+0000 7f190d7d59c0 20 remove_watcher() i=2 2024-09-12T00:35:28.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.459+0000 7f190d7d59c0 20 remove_watcher() i=3 2024-09-12T00:35:28.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.463+0000 7f190d7d59c0 20 remove_watcher() i=4 2024-09-12T00:35:28.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.463+0000 7f190d7d59c0 20 remove_watcher() i=5 2024-09-12T00:35:28.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.463+0000 7f190d7d59c0 20 remove_watcher() i=6 2024-09-12T00:35:28.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.467+0000 7f190d7d59c0 20 remove_watcher() i=7 2024-09-12T00:35:28.485 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:35:28.516 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:28.516 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:28.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 20 realm 2024-09-12T00:35:28.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:28.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:28.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.567+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.571+0000 7ff4867f49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:28.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.571+0000 7ff4867f49c0 20 searching for the correct realm 2024-09-12T00:35:28.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.575+0000 7ff484afb640 0 -- 172.21.15.102:0/1369136578 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55d661fcc980 msgr2=0x55d661fced70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:28.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.579+0000 7ff47bfff640 0 -- 172.21.15.102:0/1369136578 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7ff47c0706b0 msgr2=0x7ff47c09a220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:28.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:28.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:28.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:28.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:28.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:28.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:28.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:28.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.795+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:28.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 zone default found 2024-09-12T00:35:28.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 4 Realm: () 2024-09-12T00:35:28.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:28.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:28.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:28.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 zonegroup default 2024-09-12T00:35:28.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:28.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 started sync module instance, tier type = 2024-09-12T00:35:28.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.799+0000 7ff4867f49c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:28.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.827+0000 7ff4867f49c0 20 add_watcher() i=0 2024-09-12T00:35:28.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.827+0000 7ff4867f49c0 20 add_watcher() i=1 2024-09-12T00:35:28.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.827+0000 7ff4867f49c0 20 add_watcher() i=2 2024-09-12T00:35:28.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.827+0000 7ff4867f49c0 20 add_watcher() i=3 2024-09-12T00:35:28.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.827+0000 7ff4867f49c0 20 add_watcher() i=4 2024-09-12T00:35:28.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.827+0000 7ff4867f49c0 20 add_watcher() i=5 2024-09-12T00:35:28.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.827+0000 7ff4867f49c0 20 add_watcher() i=6 2024-09-12T00:35:28.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.827+0000 7ff4867f49c0 20 add_watcher() i=7 2024-09-12T00:35:28.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.827+0000 7ff4867f49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:28.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.831+0000 7ff33afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:28.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.831+0000 7ff4867f49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:28.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.831+0000 7ff4867f49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:28.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.831+0000 7ff4867f49c0 5 note: GC not initialized 2024-09-12T00:35:28.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.835+0000 7ff339fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:28.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.835+0000 7ff4867f49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:28.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.835+0000 7ff4867f49c0 20 Filter name: none 2024-09-12T00:35:28.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.835+0000 7ff2ab7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:28.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.835+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.835+0000 7ff4867f49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:28.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.835+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.835+0000 7ff4867f49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:28.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.835+0000 7ff4867f49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:28.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.835+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.839+0000 7ff4867f49c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:28.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.839+0000 7ff4867f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:28.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.839+0000 7ff4867f49c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:28.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.839+0000 7ff4867f49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:28.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.843+0000 7ff33afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:28.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.847+0000 7ff4867f49c0 20 remove_watcher() i=0 2024-09-12T00:35:28.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.847+0000 7ff4867f49c0 2 removed watcher, disabling cache 2024-09-12T00:35:28.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.847+0000 7ff4867f49c0 20 remove_watcher() i=1 2024-09-12T00:35:28.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.851+0000 7ff4867f49c0 20 remove_watcher() i=2 2024-09-12T00:35:28.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.855+0000 7ff4867f49c0 20 remove_watcher() i=3 2024-09-12T00:35:28.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.855+0000 7ff4867f49c0 20 remove_watcher() i=4 2024-09-12T00:35:28.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.855+0000 7ff4867f49c0 20 remove_watcher() i=5 2024-09-12T00:35:28.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.863+0000 7ff4867f49c0 20 remove_watcher() i=6 2024-09-12T00:35:28.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:28.867+0000 7ff4867f49c0 20 remove_watcher() i=7 2024-09-12T00:35:28.876 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:28.876 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:28.876 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-init-index id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:28.876 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:28.878 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:28.878 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:28.924 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:28.924 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:28.990 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:29.026 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:29.026 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:29.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.075+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.075+0000 7fe931e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:29.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.075+0000 7fe931e6c9c0 20 realm 2024-09-12T00:35:29.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.075+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.075+0000 7fe931e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:29.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.075+0000 7fe931e6c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:29.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.075+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.079+0000 7fe931e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:29.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.079+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.079+0000 7fe931e6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:29.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.079+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.079+0000 7fe931e6c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:29.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.079+0000 7fe931e6c9c0 20 searching for the correct realm 2024-09-12T00:35:29.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.083+0000 7fe930173640 0 -- 172.21.15.102:0/1754305360 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fe92002f060 msgr2=0x7fe9200611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:29.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.299+0000 7fe92f171640 0 -- 172.21.15.102:0/1754305360 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fe928008040 msgr2=0x7fe928060290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:29.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:29.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:29.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:29.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:29.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:29.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:29.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:29.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:29.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:29.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 zone default found 2024-09-12T00:35:29.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 4 Realm: () 2024-09-12T00:35:29.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:29.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:29.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:29.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 zonegroup default 2024-09-12T00:35:29.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:29.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.519+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.523+0000 7fe931e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:29.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.523+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.523+0000 7fe931e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:29.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.523+0000 7fe931e6c9c0 20 started sync module instance, tier type = 2024-09-12T00:35:29.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.523+0000 7fe931e6c9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:29.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.543+0000 7fe931e6c9c0 20 add_watcher() i=0 2024-09-12T00:35:29.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.543+0000 7fe931e6c9c0 20 add_watcher() i=1 2024-09-12T00:35:29.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.543+0000 7fe931e6c9c0 20 add_watcher() i=2 2024-09-12T00:35:29.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.543+0000 7fe931e6c9c0 20 add_watcher() i=3 2024-09-12T00:35:29.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.543+0000 7fe931e6c9c0 20 add_watcher() i=4 2024-09-12T00:35:29.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.543+0000 7fe931e6c9c0 20 add_watcher() i=5 2024-09-12T00:35:29.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.543+0000 7fe931e6c9c0 20 add_watcher() i=6 2024-09-12T00:35:29.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.547+0000 7fe931e6c9c0 20 add_watcher() i=7 2024-09-12T00:35:29.542 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.547+0000 7fe931e6c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:29.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe7e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:29.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:29.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:29.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 5 note: GC not initialized 2024-09-12T00:35:29.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe7e4fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:29.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:29.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 20 Filter name: none 2024-09-12T00:35:29.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe75e7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:29.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:35:29.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:29.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:35:29.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:35:29.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 : miss 2024-09-12T00:35:29.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.551+0000 7fe931e6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.555+0000 7fe931e6c9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:29.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.555+0000 7fe931e6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 info.flags=0x17 2024-09-12T00:35:29.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.555+0000 7fe931e6c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 to cache LRU end 2024-09-12T00:35:29.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.555+0000 7fe931e6c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:29.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.555+0000 7fe931e6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:29.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.555+0000 7fe931e6c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 2024-09-12T00:35:29.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.563+0000 7fe931e6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 info.flags=0x17 2024-09-12T00:35:29.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.563+0000 7fe931e6c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 to cache LRU end 2024-09-12T00:35:29.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.563+0000 7fe931e6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:29.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.563+0000 7fe931e6c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20, ofs0, ns] 2024-09-12T00:35:29.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.563+0000 7fe80effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 94554940341984 notifier 6243 bl.length()=995 2024-09-12T00:35:29.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.563+0000 7fe80effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 info.flags=0x17 2024-09-12T00:35:29.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.563+0000 7fe80effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 to cache LRU end 2024-09-12T00:35:29.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.563+0000 7fe80effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:29.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.567+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): orig_sources= new_sources= 2024-09-12T00:35:29.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.567+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): potential sources added=[] removed=[] 2024-09-12T00:35:29.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.567+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): orig_dests= new_dests= 2024-09-12T00:35:29.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.567+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): potential dests added=[] removed=[] 2024-09-12T00:35:29.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.0 2024-09-12T00:35:29.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.0 2024-09-12T00:35:29.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.1 2024-09-12T00:35:29.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.1 2024-09-12T00:35:29.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.2 2024-09-12T00:35:29.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.2 2024-09-12T00:35:29.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.3 2024-09-12T00:35:29.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.3 2024-09-12T00:35:29.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.4 2024-09-12T00:35:29.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.4 2024-09-12T00:35:29.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.5 2024-09-12T00:35:29.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.5 2024-09-12T00:35:29.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.6 2024-09-12T00:35:29.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.6 2024-09-12T00:35:29.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.7 2024-09-12T00:35:29.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.7 2024-09-12T00:35:29.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.8 2024-09-12T00:35:29.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.8 2024-09-12T00:35:29.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.9 2024-09-12T00:35:29.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.9 2024-09-12T00:35:29.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.10 2024-09-12T00:35:29.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.10 2024-09-12T00:35:29.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.11 2024-09-12T00:35:29.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1.11 2024-09-12T00:35:29.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.0 2024-09-12T00:35:29.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.579+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1 2024-09-12T00:35:29.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.583+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.2 2024-09-12T00:35:29.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.583+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.3 2024-09-12T00:35:29.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.583+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.4 2024-09-12T00:35:29.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.583+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.5 2024-09-12T00:35:29.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.587+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.6 2024-09-12T00:35:29.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.587+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.7 2024-09-12T00:35:29.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.587+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.8 2024-09-12T00:35:29.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.591+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.9 2024-09-12T00:35:29.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.591+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.10 2024-09-12T00:35:29.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.595+0000 7fe931e6c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:29.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.595+0000 7fe931e6c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 2024-09-12T00:35:29.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.599+0000 7fe931e6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 info.flags=0x17 2024-09-12T00:35:29.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.599+0000 7fe931e6c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 to cache LRU end 2024-09-12T00:35:29.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.599+0000 7fe931e6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:29.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.599+0000 7fe931e6c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20, ofs0, ns] 2024-09-12T00:35:29.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.599+0000 7fe80effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94554940341984 notifier 6243 bl.length()=995 2024-09-12T00:35:29.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.599+0000 7fe80effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 info.flags=0x17 2024-09-12T00:35:29.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.599+0000 7fe80effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 to cache LRU end 2024-09-12T00:35:29.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.599+0000 7fe80effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:29.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.603+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): orig_sources= new_sources= 2024-09-12T00:35:29.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.603+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): potential sources added=[] removed=[] 2024-09-12T00:35:29.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.603+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): orig_dests= new_dests= 2024-09-12T00:35:29.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.603+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): potential dests added=[] removed=[] 2024-09-12T00:35:29.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.607+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.0 2024-09-12T00:35:29.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.607+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.1 2024-09-12T00:35:29.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.611+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.2 2024-09-12T00:35:29.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.611+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.3 2024-09-12T00:35:29.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.611+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.4 2024-09-12T00:35:29.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.611+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.5 2024-09-12T00:35:29.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.611+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.6 2024-09-12T00:35:29.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.615+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.7 2024-09-12T00:35:29.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.615+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.8 2024-09-12T00:35:29.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.615+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.9 2024-09-12T00:35:29.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.615+0000 7fe931e6c9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20.10 2024-09-12T00:35:29.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.615+0000 7fe931e6c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:29.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.615+0000 7fe931e6c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 2024-09-12T00:35:29.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.619+0000 7fe931e6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 info.flags=0x17 2024-09-12T00:35:29.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.619+0000 7fe931e6c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 to cache LRU end 2024-09-12T00:35:29.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.619+0000 7fe931e6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:29.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.619+0000 7fe931e6c9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20, ofs0, ns] 2024-09-12T00:35:29.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.619+0000 7fe80effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398880 cookie 94554940341984 notifier 6243 bl.length()=963 2024-09-12T00:35:29.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.619+0000 7fe80effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 info.flags=0x17 2024-09-12T00:35:29.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.619+0000 7fe80effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 to cache LRU end 2024-09-12T00:35:29.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.619+0000 7fe80effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:29.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.623+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): orig_sources= new_sources= 2024-09-12T00:35:29.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.623+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): potential sources added=[] removed=[] 2024-09-12T00:35:29.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.623+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): orig_dests= new_dests= 2024-09-12T00:35:29.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.623+0000 7fe931e6c9c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20]): potential dests added=[] removed=[] 2024-09-12T00:35:29.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.627+0000 7fe931e6c9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:35:29.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.631+0000 7fe7e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:29.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.639+0000 7fe931e6c9c0 20 remove_watcher() i=0 2024-09-12T00:35:29.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.639+0000 7fe931e6c9c0 2 removed watcher, disabling cache 2024-09-12T00:35:29.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.639+0000 7fe931e6c9c0 20 remove_watcher() i=1 2024-09-12T00:35:29.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.643+0000 7fe931e6c9c0 20 remove_watcher() i=2 2024-09-12T00:35:29.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.643+0000 7fe931e6c9c0 20 remove_watcher() i=3 2024-09-12T00:35:29.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.647+0000 7fe931e6c9c0 20 remove_watcher() i=4 2024-09-12T00:35:29.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.647+0000 7fe931e6c9c0 20 remove_watcher() i=5 2024-09-12T00:35:29.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.651+0000 7fe931e6c9c0 20 remove_watcher() i=6 2024-09-12T00:35:29.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.651+0000 7fe931e6c9c0 20 remove_watcher() i=7 2024-09-12T00:35:29.664 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:35:29.694 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:29.694 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:29.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.743+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.747+0000 7f8c6e4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:29.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.747+0000 7f8c6e4479c0 20 realm 2024-09-12T00:35:29.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.747+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.747+0000 7f8c6e4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:29.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.747+0000 7f8c6e4479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:29.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.747+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.747+0000 7f8c6e4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:29.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.747+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.747+0000 7f8c6e4479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:29.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.747+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:29.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.751+0000 7f8c6e4479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:29.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.751+0000 7f8c6e4479c0 20 searching for the correct realm 2024-09-12T00:35:29.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.751+0000 7f8c6c74e640 0 -- 172.21.15.102:0/3517861691 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f8c60086060 msgr2=0x7f8c60070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:29.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:29.967+0000 7f8c6b74c640 0 -- 172.21.15.102:0/3517861691 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f8c640c4eb0 msgr2=0x7f8c640d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:30.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.183+0000 7f8c6e4479c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:30.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.183+0000 7f8c6e4479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:30.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.183+0000 7f8c6e4479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:30.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.183+0000 7f8c6e4479c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:30.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.183+0000 7f8c6e4479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:30.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.183+0000 7f8c6e4479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:30.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.183+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:30.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.183+0000 7f8c6e4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:30.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.183+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:30.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:30.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:30.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:30.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 zone default found 2024-09-12T00:35:30.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 4 Realm: () 2024-09-12T00:35:30.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:30.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:30.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:30.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 zonegroup default 2024-09-12T00:35:30.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:30.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:30.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:30.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:30.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:30.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:30.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 started sync module instance, tier type = 2024-09-12T00:35:30.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.187+0000 7f8c6e4479c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:30.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.219+0000 7f8c6e4479c0 20 add_watcher() i=0 2024-09-12T00:35:30.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.219+0000 7f8c6e4479c0 20 add_watcher() i=1 2024-09-12T00:35:30.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.219+0000 7f8c6e4479c0 20 add_watcher() i=2 2024-09-12T00:35:30.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.219+0000 7f8c6e4479c0 20 add_watcher() i=3 2024-09-12T00:35:30.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.219+0000 7f8c6e4479c0 20 add_watcher() i=4 2024-09-12T00:35:30.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.219+0000 7f8c6e4479c0 20 add_watcher() i=5 2024-09-12T00:35:30.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.219+0000 7f8c6e4479c0 20 add_watcher() i=6 2024-09-12T00:35:30.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.219+0000 7f8c6e4479c0 20 add_watcher() i=7 2024-09-12T00:35:30.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.219+0000 7f8c6e4479c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:30.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8b21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:30.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8c6e4479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:30.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8c6e4479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:30.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8c6e4479c0 5 note: GC not initialized 2024-09-12T00:35:30.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8b20fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:30.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8c6e4479c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:30.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8c6e4479c0 20 Filter name: none 2024-09-12T00:35:30.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8a9a7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:30.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:30.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8c6e4479c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:30.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.227+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:30.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.231+0000 7f8c6e4479c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:30.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.231+0000 7f8c6e4479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:30.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.231+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:30.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.231+0000 7f8c6e4479c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:30.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.231+0000 7f8c6e4479c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:30.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.231+0000 7f8c6e4479c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:30.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.231+0000 7f8c6e4479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:30.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.235+0000 7f8b21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:30.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.243+0000 7f8c6e4479c0 20 remove_watcher() i=0 2024-09-12T00:35:30.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.243+0000 7f8c6e4479c0 2 removed watcher, disabling cache 2024-09-12T00:35:30.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.247+0000 7f8c6e4479c0 20 remove_watcher() i=1 2024-09-12T00:35:30.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.247+0000 7f8c6e4479c0 20 remove_watcher() i=2 2024-09-12T00:35:30.244 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.251+0000 7f8c6e4479c0 20 remove_watcher() i=3 2024-09-12T00:35:30.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.255+0000 7f8c6e4479c0 20 remove_watcher() i=4 2024-09-12T00:35:30.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.255+0000 7f8c6e4479c0 20 remove_watcher() i=5 2024-09-12T00:35:30.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.259+0000 7f8c6e4479c0 20 remove_watcher() i=6 2024-09-12T00:35:30.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:30.259+0000 7f8c6e4479c0 20 remove_watcher() i=7 2024-09-12T00:35:30.271 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:30.271 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:30.271 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-init-index id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:35:30.271 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:30.272 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:30.273 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:30.294 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:30.294 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:30.750 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:30.750 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:31.096 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:35:31.096 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:31.098 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:31.098 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:31.225 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:31.225 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:31.312 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:31.312 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:31.399 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:31.399 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:31.502 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:31.502 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:31.594 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:31.594 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:31.691 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:31.691 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:31.793 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:31.793 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:31.891 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:31.891 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:31.991 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:31.992 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:32.085 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:32.085 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:32.187 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:32.187 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:32.472 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:32.472 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:32.566 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:32.566 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:32.667 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:32.668 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:32.775 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:32.775 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:32.873 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:32.873 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:32.973 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:33.077 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:33.077 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:33.179 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:33.180 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:33.280 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:35:33.314 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:33.314 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:33.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.367+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.367+0000 7f96211a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.367+0000 7f96211a99c0 20 realm 2024-09-12T00:35:33.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.367+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.367+0000 7f96211a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.367+0000 7f96211a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:33.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.367+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.367+0000 7f96211a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.367+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.371+0000 7f96211a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:33.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.371+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.371+0000 7f96211a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:33.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.371+0000 7f96211a99c0 20 searching for the correct realm 2024-09-12T00:35:33.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.375+0000 7f961f4b0640 0 -- 172.21.15.102:0/2506975138 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f9614018040 msgr2=0x7f961404a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:33.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.591+0000 7f961e4ae640 0 -- 172.21.15.102:0/2506975138 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f96181069d0 msgr2=0x7f9618106040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:33.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.807+0000 7f96211a99c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:33.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.807+0000 7f96211a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:33.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.807+0000 7f96211a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:33.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.807+0000 7f96211a99c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:33.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.807+0000 7f96211a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:33.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.807+0000 7f96211a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:33.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.807+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:33.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:33.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 20 zone default found 2024-09-12T00:35:33.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 4 Realm: () 2024-09-12T00:35:33.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:33.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:33.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:33.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 20 zonegroup default 2024-09-12T00:35:33.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.811+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.815+0000 7f96211a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.815+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.815+0000 7f96211a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.815+0000 7f96211a99c0 20 started sync module instance, tier type = 2024-09-12T00:35:33.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.815+0000 7f96211a99c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:33.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.839+0000 7f96211a99c0 20 add_watcher() i=0 2024-09-12T00:35:33.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.839+0000 7f96211a99c0 20 add_watcher() i=1 2024-09-12T00:35:33.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.839+0000 7f96211a99c0 20 add_watcher() i=2 2024-09-12T00:35:33.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.839+0000 7f96211a99c0 20 add_watcher() i=3 2024-09-12T00:35:33.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.839+0000 7f96211a99c0 20 add_watcher() i=4 2024-09-12T00:35:33.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.839+0000 7f96211a99c0 20 add_watcher() i=5 2024-09-12T00:35:33.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.843+0000 7f96211a99c0 20 add_watcher() i=6 2024-09-12T00:35:33.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.843+0000 7f96211a99c0 20 add_watcher() i=7 2024-09-12T00:35:33.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.843+0000 7f96211a99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:33.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.847+0000 7f94d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:33.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.847+0000 7f96211a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:33.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.847+0000 7f96211a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:33.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.847+0000 7f96211a99c0 5 note: GC not initialized 2024-09-12T00:35:33.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.851+0000 7f944ffff640 20 reqs_thread_entry: start 2024-09-12T00:35:33.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.851+0000 7f96211a99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:33.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.851+0000 7f96211a99c0 20 Filter name: none 2024-09-12T00:35:33.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.851+0000 7f944dffb640 20 reqs_thread_entry: start 2024-09-12T00:35:33.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.851+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.851+0000 7f96211a99c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:33.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.851+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.851+0000 7f96211a99c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:33.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.851+0000 7f96211a99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:33.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.851+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.855+0000 7f96211a99c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:33.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.855+0000 7f96211a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.855+0000 7f96211a99c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:33.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.855+0000 7f96211a99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:33.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.859+0000 7f94d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:33.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.863+0000 7f96211a99c0 20 remove_watcher() i=0 2024-09-12T00:35:33.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.863+0000 7f96211a99c0 2 removed watcher, disabling cache 2024-09-12T00:35:33.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.863+0000 7f96211a99c0 20 remove_watcher() i=1 2024-09-12T00:35:33.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.867+0000 7f96211a99c0 20 remove_watcher() i=2 2024-09-12T00:35:33.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.867+0000 7f96211a99c0 20 remove_watcher() i=3 2024-09-12T00:35:33.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.871+0000 7f96211a99c0 20 remove_watcher() i=4 2024-09-12T00:35:33.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.871+0000 7f96211a99c0 20 remove_watcher() i=5 2024-09-12T00:35:33.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.875+0000 7f96211a99c0 20 remove_watcher() i=6 2024-09-12T00:35:33.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.875+0000 7f96211a99c0 20 remove_watcher() i=7 2024-09-12T00:35:33.885 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:33.885 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:33.885 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-init-index id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:33.886 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:33.886 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:35:33.921 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:33.921 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:33.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.971+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.971+0000 7f9485d789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.971+0000 7f9485d789c0 20 realm 2024-09-12T00:35:33.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.971+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.971+0000 7f9485d789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.971+0000 7f9485d789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:33.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.971+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.971+0000 7f9485d789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.971+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.975+0000 7f9485d789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:33.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.975+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.975+0000 7f9485d789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:33.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.975+0000 7f9485d789c0 20 searching for the correct realm 2024-09-12T00:35:33.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.983+0000 7f948387e640 0 -- 172.21.15.102:0/3444978111 >> [v2:172.21.15.102:6824/1865676346,v1:172.21.15.102:6825/1865676346] conn(0x55fe9c7d7680 msgr2=0x55fe9c7d9b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:33.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.987+0000 7f948407f640 0 -- 172.21.15.102:0/3444978111 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f94780db070 msgr2=0x7f94780b8440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:33.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:33.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:33.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:33.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:33.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:33.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:33.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:33.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:33.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 zone default found 2024-09-12T00:35:33.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 4 Realm: () 2024-09-12T00:35:33.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:33.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:33.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:33.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 zonegroup default 2024-09-12T00:35:33.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.995+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:33.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.999+0000 7f9485d789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:33.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.999+0000 7f9485d789c0 20 started sync module instance, tier type = 2024-09-12T00:35:33.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:33.999+0000 7f9485d789c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:34.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.011+0000 7f9485d789c0 20 add_watcher() i=0 2024-09-12T00:35:34.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.011+0000 7f9485d789c0 20 add_watcher() i=1 2024-09-12T00:35:34.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.011+0000 7f9485d789c0 20 add_watcher() i=2 2024-09-12T00:35:34.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.011+0000 7f9485d789c0 20 add_watcher() i=3 2024-09-12T00:35:34.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.011+0000 7f9485d789c0 20 add_watcher() i=4 2024-09-12T00:35:34.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.011+0000 7f9485d789c0 20 add_watcher() i=5 2024-09-12T00:35:34.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.011+0000 7f9485d789c0 20 add_watcher() i=6 2024-09-12T00:35:34.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9485d789c0 20 add_watcher() i=7 2024-09-12T00:35:34.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9485d789c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:34.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:34.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9485d789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:34.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9485d789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:34.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9485d789c0 5 note: GC not initialized 2024-09-12T00:35:34.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9338fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:34.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9485d789c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:34.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9485d789c0 20 Filter name: none 2024-09-12T00:35:34.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f92b27fc640 20 reqs_thread_entry: start 2024-09-12T00:35:34.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9485d789c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:35:34.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.015+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:34.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:35:34.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:35:34.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 : miss 2024-09-12T00:35:34.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:34.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 info.flags=0x17 2024-09-12T00:35:34.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 to cache LRU end 2024-09-12T00:35:34.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:34.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:34.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 2024-09-12T00:35:34.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 -1 Injecting error=-95 at location=init_index 2024-09-12T00:35:34.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.019+0000 7f9485d789c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:35:34.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f9485d789c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 info.flags=0x17 2024-09-12T00:35:34.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f9485d789c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 to cache LRU end 2024-09-12T00:35:34.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f9485d789c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:34.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f9485d789c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21, ofs0, ns] 2024-09-12T00:35:34.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f93627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398883 cookie 94552035597232 notifier 6297 bl.length()=995 2024-09-12T00:35:34.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f93627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 info.flags=0x17 2024-09-12T00:35:34.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f93627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 to cache LRU end 2024-09-12T00:35:34.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f93627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:34.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f9485d789c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21]): orig_sources= new_sources= 2024-09-12T00:35:34.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f9485d789c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21]): potential sources added=[] removed=[] 2024-09-12T00:35:34.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f9485d789c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21]): orig_dests= new_dests= 2024-09-12T00:35:34.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.027+0000 7f9485d789c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21]): potential dests added=[] removed=[] 2024-09-12T00:35:34.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.0 2024-09-12T00:35:34.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.0 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.1 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.1 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.2 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.2 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.3 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.3 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.4 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.4 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.5 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.5 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.6 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.6 2024-09-12T00:35:34.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.7 2024-09-12T00:35:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.7 2024-09-12T00:35:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.8 2024-09-12T00:35:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.8 2024-09-12T00:35:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.9 2024-09-12T00:35:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.9 2024-09-12T00:35:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.10 2024-09-12T00:35:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.10 2024-09-12T00:35:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.11 2024-09-12T00:35:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1.11 2024-09-12T00:35:34.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.0 2024-09-12T00:35:34.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.1 2024-09-12T00:35:34.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.035+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.2 2024-09-12T00:35:34.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.039+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.3 2024-09-12T00:35:34.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.039+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.4 2024-09-12T00:35:34.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.039+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.5 2024-09-12T00:35:34.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.039+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.6 2024-09-12T00:35:34.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.039+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.7 2024-09-12T00:35:34.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.043+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.8 2024-09-12T00:35:34.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.043+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.9 2024-09-12T00:35:34.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.043+0000 7f9485d789c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21.10 2024-09-12T00:35:34.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.047+0000 7f9485d789c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:34.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.047+0000 7f9485d789c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 2024-09-12T00:35:34.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f9485d789c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 info.flags=0x17 2024-09-12T00:35:34.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f9485d789c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 to cache LRU end 2024-09-12T00:35:34.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f9485d789c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:34.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f9485d789c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21, ofs0, ns] 2024-09-12T00:35:34.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f93627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398884 cookie 94552035597232 notifier 6297 bl.length()=963 2024-09-12T00:35:34.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f93627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 info.flags=0x17 2024-09-12T00:35:34.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f93627fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 to cache LRU end 2024-09-12T00:35:34.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f93627fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:34.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f9485d789c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21]): orig_sources= new_sources= 2024-09-12T00:35:34.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f9485d789c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21]): potential sources added=[] removed=[] 2024-09-12T00:35:34.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f9485d789c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21]): orig_dests= new_dests= 2024-09-12T00:35:34.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.051+0000 7f9485d789c0 20 handle_bi_update(): bucket=:error-at-init-index[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21]): potential dests added=[] removed=[] 2024-09-12T00:35:34.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.059+0000 7f9485d789c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:35:34.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.059+0000 7f9339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:34.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.063+0000 7f9485d789c0 20 remove_watcher() i=0 2024-09-12T00:35:34.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.063+0000 7f9485d789c0 2 removed watcher, disabling cache 2024-09-12T00:35:34.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.067+0000 7f9485d789c0 20 remove_watcher() i=1 2024-09-12T00:35:34.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.067+0000 7f9485d789c0 20 remove_watcher() i=2 2024-09-12T00:35:34.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.071+0000 7f9485d789c0 20 remove_watcher() i=3 2024-09-12T00:35:34.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.071+0000 7f9485d789c0 20 remove_watcher() i=4 2024-09-12T00:35:34.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.075+0000 7f9485d789c0 20 remove_watcher() i=5 2024-09-12T00:35:34.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.075+0000 7f9485d789c0 20 remove_watcher() i=6 2024-09-12T00:35:34.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.075+0000 7f9485d789c0 20 remove_watcher() i=7 2024-09-12T00:35:34.085 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:35:34.112 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:34.112 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:34.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.159+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.163+0000 7f1276a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:34.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.163+0000 7f1276a539c0 20 realm 2024-09-12T00:35:34.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.163+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.163+0000 7f1276a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:34.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.163+0000 7f1276a539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:34.159 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.163+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.159 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.163+0000 7f1276a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:34.159 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.163+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.159 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.163+0000 7f1276a539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:34.159 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.163+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.167+0000 7f1276a539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:34.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.167+0000 7f1276a539c0 20 searching for the correct realm 2024-09-12T00:35:34.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.167+0000 7f1274d5a640 0 -- 172.21.15.102:0/2888053699 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f125c04b040 msgr2=0x7f125c023920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:34.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.175+0000 7f1273d58640 0 -- 172.21.15.102:0/2888053699 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f126c04cf90 msgr2=0x7f126c06f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:34.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.391+0000 7f1276a539c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:34.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.391+0000 7f1276a539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:34.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.391+0000 7f1276a539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:34.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.391+0000 7f1276a539c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:34.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.391+0000 7f1276a539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:34.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.391+0000 7f1276a539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:34.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.391+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.391+0000 7f1276a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:34.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.391+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:34.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:34.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 zone default found 2024-09-12T00:35:34.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 4 Realm: () 2024-09-12T00:35:34.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:34.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:34.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:34.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 zonegroup default 2024-09-12T00:35:34.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:34.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:34.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:34.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 started sync module instance, tier type = 2024-09-12T00:35:34.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.395+0000 7f1276a539c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:34.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.419+0000 7f1276a539c0 20 add_watcher() i=0 2024-09-12T00:35:34.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.419+0000 7f1276a539c0 20 add_watcher() i=1 2024-09-12T00:35:34.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.419+0000 7f1276a539c0 20 add_watcher() i=2 2024-09-12T00:35:34.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.419+0000 7f1276a539c0 20 add_watcher() i=3 2024-09-12T00:35:34.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.419+0000 7f1276a539c0 20 add_watcher() i=4 2024-09-12T00:35:34.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.419+0000 7f1276a539c0 20 add_watcher() i=5 2024-09-12T00:35:34.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.419+0000 7f1276a539c0 20 add_watcher() i=6 2024-09-12T00:35:34.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.423+0000 7f1276a539c0 20 add_watcher() i=7 2024-09-12T00:35:34.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.423+0000 7f1276a539c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:34.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.423+0000 7f112a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:34.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.423+0000 7f1276a539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:34.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.423+0000 7f1276a539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:34.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.423+0000 7f1276a539c0 5 note: GC not initialized 2024-09-12T00:35:34.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.423+0000 7f11297e2640 20 reqs_thread_entry: start 2024-09-12T00:35:34.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.423+0000 7f1276a539c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:34.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 Filter name: none 2024-09-12T00:35:34.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f109affd640 20 reqs_thread_entry: start 2024-09-12T00:35:34.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:34.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:34.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:34.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:34.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:34.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:34.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.427+0000 7f1276a539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:34.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.431+0000 7f112a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:34.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.435+0000 7f1276a539c0 20 remove_watcher() i=0 2024-09-12T00:35:34.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.435+0000 7f1276a539c0 2 removed watcher, disabling cache 2024-09-12T00:35:34.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.439+0000 7f1276a539c0 20 remove_watcher() i=1 2024-09-12T00:35:34.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.439+0000 7f1276a539c0 20 remove_watcher() i=2 2024-09-12T00:35:34.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.443+0000 7f1276a539c0 20 remove_watcher() i=3 2024-09-12T00:35:34.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.443+0000 7f1276a539c0 20 remove_watcher() i=4 2024-09-12T00:35:34.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.447+0000 7f1276a539c0 20 remove_watcher() i=5 2024-09-12T00:35:34.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.447+0000 7f1276a539c0 20 remove_watcher() i=6 2024-09-12T00:35:34.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:34.451+0000 7f1276a539c0 20 remove_watcher() i=7 2024-09-12T00:35:34.459 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:34.459 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:34.459 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-init-index id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:35:34.459 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:34.461 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:34.461 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:34.481 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:34.481 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:35.106 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:35.106 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:35.472 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:35:35.473 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:35.475 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:35.476 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:35.615 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:35.615 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:35.701 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:35.701 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:35.808 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:35.808 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:35.907 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:35.908 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.002 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.002 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.097 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.097 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.195 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.195 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.297 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.298 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.400 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.401 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.498 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.598 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.598 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.697 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.697 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.796 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.796 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.887 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.887 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:36.989 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:36.989 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:37.086 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:37.086 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:37.183 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:37.183 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:37.282 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:37.282 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:37.380 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:37.380 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:37.482 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:37.482 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:37.585 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:37.585 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:37.676 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:35:37.710 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:37.710 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:37.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.758+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 realm 2024-09-12T00:35:37.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:37.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:37.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:37.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.762+0000 7fe7469809c0 20 searching for the correct realm 2024-09-12T00:35:37.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.770+0000 7fe744c87640 0 -- 172.21.15.102:0/305260859 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55dfa4f1e690 msgr2=0x55dfa4f20a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:37.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.774+0000 7fe743c85640 0 -- 172.21.15.102:0/305260859 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fe73402d400 msgr2=0x7fe73402d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:37.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:37.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:37.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:37.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:37.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:37.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:37.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:37.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:37.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 zone default found 2024-09-12T00:35:37.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 4 Realm: () 2024-09-12T00:35:37.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:37.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:37.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:37.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 zonegroup default 2024-09-12T00:35:37.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.994+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.998+0000 7fe7469809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.998+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.998+0000 7fe7469809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.998+0000 7fe7469809c0 20 started sync module instance, tier type = 2024-09-12T00:35:37.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:37.998+0000 7fe7469809c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:38.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.022+0000 7fe7469809c0 20 add_watcher() i=0 2024-09-12T00:35:38.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.022+0000 7fe7469809c0 20 add_watcher() i=1 2024-09-12T00:35:38.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.022+0000 7fe7469809c0 20 add_watcher() i=2 2024-09-12T00:35:38.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.022+0000 7fe7469809c0 20 add_watcher() i=3 2024-09-12T00:35:38.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.022+0000 7fe7469809c0 20 add_watcher() i=4 2024-09-12T00:35:38.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.022+0000 7fe7469809c0 20 add_watcher() i=5 2024-09-12T00:35:38.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.022+0000 7fe7469809c0 20 add_watcher() i=6 2024-09-12T00:35:38.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.022+0000 7fe7469809c0 20 add_watcher() i=7 2024-09-12T00:35:38.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.022+0000 7fe7469809c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:38.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe5fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:38.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:38.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:38.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 5 note: GC not initialized 2024-09-12T00:35:38.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe5f9fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:38.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:38.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 20 Filter name: none 2024-09-12T00:35:38.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe56b7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:38.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:35:38.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:35:38.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:38.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.030+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.034+0000 7fe7469809c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:35:38.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.034+0000 7fe7469809c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.034+0000 7fe7469809c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:35:38.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.034+0000 7fe7469809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:38.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.034+0000 7fe5fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:38.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.042+0000 7fe7469809c0 20 remove_watcher() i=0 2024-09-12T00:35:38.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.042+0000 7fe7469809c0 2 removed watcher, disabling cache 2024-09-12T00:35:38.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.042+0000 7fe7469809c0 20 remove_watcher() i=1 2024-09-12T00:35:38.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.046+0000 7fe7469809c0 20 remove_watcher() i=2 2024-09-12T00:35:38.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.046+0000 7fe7469809c0 20 remove_watcher() i=3 2024-09-12T00:35:38.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.050+0000 7fe7469809c0 20 remove_watcher() i=4 2024-09-12T00:35:38.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.050+0000 7fe7469809c0 20 remove_watcher() i=5 2024-09-12T00:35:38.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.054+0000 7fe7469809c0 20 remove_watcher() i=6 2024-09-12T00:35:38.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.054+0000 7fe7469809c0 20 remove_watcher() i=7 2024-09-12T00:35:38.065 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.065 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:38.065 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-init-indext id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:38.065 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.065 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:35:38.100 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:38.100 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:38.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 realm 2024-09-12T00:35:38.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.150+0000 7fd6a33b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:38.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.148 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:38.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:38.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 searching for the correct realm 2024-09-12T00:35:38.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.158+0000 7fd6a16ba640 0 -- 172.21.15.102:0/1333075636 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fd694080040 msgr2=0x7fd69401c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:38.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.166+0000 7fd6a06b8640 0 -- 172.21.15.102:0/1333075636 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd698082130 msgr2=0x7fd6980901e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:38.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:38.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:38.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:38.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:38.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:38.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:38.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:38.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:38.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 zone default found 2024-09-12T00:35:38.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 4 Realm: () 2024-09-12T00:35:38.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:38.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:38.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:38.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 zonegroup default 2024-09-12T00:35:38.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 started sync module instance, tier type = 2024-09-12T00:35:38.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:38.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=0 2024-09-12T00:35:38.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=1 2024-09-12T00:35:38.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=2 2024-09-12T00:35:38.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=3 2024-09-12T00:35:38.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=4 2024-09-12T00:35:38.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=5 2024-09-12T00:35:38.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=6 2024-09-12T00:35:38.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=7 2024-09-12T00:35:38.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.414+0000 7fd6a33b39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:38.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.418+0000 7fd5577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:38.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.418+0000 7fd6a33b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:38.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.418+0000 7fd6a33b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:38.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 note: GC not initialized 2024-09-12T00:35:38.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.418+0000 7fd5567e4640 20 reqs_thread_entry: start 2024-09-12T00:35:38.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:38.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 Filter name: none 2024-09-12T00:35:38.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd54f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:38.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:35:38.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:35:38.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:35:38.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:35:38.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 : miss 2024-09-12T00:35:38.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:35:38.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:35:38.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:35:38.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:38.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:38.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 2024-09-12T00:35:38.420 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd6a33b39c0 time 2024-09-12T00:35:38.429949+0000 2024-09-12T00:35:38.420 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:38.423 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:38.423 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd6a6c8d2eb] 2024-09-12T00:35:38.423 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6a6c8d49f] 2024-09-12T00:35:38.423 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561444711cc1] 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1421f32) [0x56144516ef32] 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561444726ced] 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd6a5af3d90] 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.426+0000 7fd6a33b39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd6a33b39c0 time 2024-09-12T00:35:38.429949+0000 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd6a6c8d2eb] 2024-09-12T00:35:38.424 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6a6c8d49f] 2024-09-12T00:35:38.425 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561444711cc1] 2024-09-12T00:35:38.425 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1421f32) [0x56144516ef32] 2024-09-12T00:35:38.425 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561444726ced] 2024-09-12T00:35:38.425 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:35:38.425 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd6a5af3d90] 2024-09-12T00:35:38.425 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:35:38.425 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:35:38.425 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.425 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:35:38.425 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd6a33b39c0 thread_name:radosgw-admin 2024-09-12T00:35:38.426 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:38.426 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd6a5b0c520] 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd6a6c8d345] 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6a6c8d49f] 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561444711cc1] 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1421f32) [0x56144516ef32] 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561444726ced] 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd6a5af3d90] 2024-09-12T00:35:38.427 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.430+0000 7fd6a33b39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd6a33b39c0 thread_name:radosgw-admin 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd6a5b0c520] 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd6a6c8d345] 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6a6c8d49f] 2024-09-12T00:35:38.428 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561444711cc1] 2024-09-12T00:35:38.429 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1421f32) [0x56144516ef32] 2024-09-12T00:35:38.429 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561444726ced] 2024-09-12T00:35:38.429 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:35:38.429 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd6a5af3d90] 2024-09-12T00:35:38.429 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:35:38.429 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:35:38.429 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:38.429 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.429 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:35:38.436 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.436 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:35:38.126+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:35:38.126+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:35:38.126+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:35:38.126+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request con 0x561445ff82b0 auth_method 0 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:35:38.126+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:35:38.126+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:35:38.126+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_done global_id 5984 payload 274 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient: _finish_hunting 0 2024-09-12T00:35:38.437 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 1 monclient: found mon.noname-c 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: dump: 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.438 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: _finish_auth 0 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: _check_auth_tickets 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 monclient: authenticate success, global_id 5984 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 4 set_mon_vals no callback set 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: dump: 2024-09-12T00:35:38.439 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 10 monclient: shutdown 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) unregister_commands rotate-key 2024-09-12T00:35:38.440 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 10 monclient: build_initial_monmap 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 10 monclient: monmap: 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.441 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding auth protocol: cephx 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding auth protocol: cephx 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding auth protocol: cephx 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.442 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 1 librados: starting msgr at 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 1 librados: starting objecter 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command objecter_requests hook 0x561445f6f2b0 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 1 librados: setting wanted keys 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 1 librados: calling monclient init 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 10 monclient: init 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding auth protocol: cephx 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding auth protocol: cephx 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding auth protocol: cephx 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.443 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.444 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.444 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.444 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.444 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.444 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.444 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.444 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.444 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.444 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.444 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command rotate-key hook 0x561446147668 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-b con 0x561445ff82b0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-a con 0x561446003ba0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-c con 0x561446090090 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.445 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): authenticate will time out at 2526.632480s 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request con 0x561446090090 auth_method 0 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request con 0x561446003ba0 auth_method 0 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.446 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_done global_id 5987 payload 824 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient: _finish_hunting 0 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 1 monclient: found mon.noname-c 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:35:38.130+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x561445ff82b0 auth_method 0 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: dump: 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.447 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: _finish_auth 0 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: _check_auth_tickets 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 5 monclient: authenticate success, global_id 5987 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:35:38.448 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: dump: 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.449 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:35:38.130+0000 7fd58ee0d640 4 set_mon_vals no callback set 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 1 librados: init done 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:35:38.130+0000 7fd58d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:35:38.130+0000 7fd58d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:35:38.130+0000 7fd58d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:35:38.130+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x7fd588070b10 auth_method 0 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x56144616f050 auth_method 0 2024-09-12T00:35:38.450 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:35:38.134+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x561446193300 auth_method 0 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:35:38.134+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x5614461974f0 auth_method 0 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:35:38.138+0000 7fd6a16ba640 10 monclient: get_auth_request con 0x56144619b1d0 auth_method 0 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient: build_initial_monmap 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient: monmap: 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.451 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding auth protocol: cephx 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding auth protocol: cephx 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding auth protocol: cephx 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.452 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5614461a2d10 EEXIST 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient: init 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding auth protocol: cephx 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding auth protocol: cephx 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding auth protocol: cephx 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.453 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.454 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command rotate-key cmddesc rotate-key hook 0x56144619e320 EEXIST 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-c con 0x5614461c6ec0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-b con 0x5614461c67f0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-a con 0x5614461c51d0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): authenticate will time out at 2526.643030s 2024-09-12T00:35:38.455 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request con 0x5614461c51d0 auth_method 0 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request con 0x5614461c6ec0 auth_method 0 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.456 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:35:38.138+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request con 0x5614461c67f0 auth_method 0 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:35:38.138+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:35:38.138+0000 7fd6a16ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:35:38.138+0000 7fd6a16ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_done global_id 6348 payload 824 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient: _finish_hunting 0 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 1 monclient: found mon.noname-a 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:38.457 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: dump: 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: _finish_auth 0 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: _check_auth_tickets 2024-09-12T00:35:38.458 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: dump: 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.459 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 monclient: authenticate success, global_id 6348 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:35:38.138+0000 7fd6a1ebb640 4 set_mon_vals no callback set 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:35:38.142+0000 7fd5867fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:35:38.142+0000 7fd5867fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:35:38.142+0000 7fd5867fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: get_monmap_and_config 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: build_initial_monmap 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: monmap: 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:35:38.460 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding auth protocol: cephx 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding auth protocol: cephx 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding auth protocol: cephx 2024-09-12T00:35:38.461 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x7fd578070a20 auth_method 0 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.462 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: init 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding auth protocol: cephx 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding auth protocol: cephx 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding auth protocol: cephx 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.463 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffefd327ca8 EEXIST 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-c con 0x561446214f50 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-b con 0x56144620b8a0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-a con 0x561446216090 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.464 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): authenticate will time out at 2526.647321s 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request con 0x561446214f50 auth_method 0 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request con 0x561446216090 auth_method 0 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_done global_id 5993 payload 274 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient: _finish_hunting 0 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 1 monclient: found mon.noname-c 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: dump: 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: _finish_auth 0 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: _check_auth_tickets 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 monclient: authenticate success, global_id 5993 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: dump: 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 4 set_mon_vals no callback set 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: shutdown 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: build_initial_monmap 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: monmap: 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.469 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding auth protocol: cephx 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding auth protocol: cephx 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding auth protocol: cephx 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.470 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 librados: starting msgr at 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 librados: starting objecter 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5614461c4e40 EEXIST 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 librados: setting wanted keys 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 librados: calling monclient init 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: init 2024-09-12T00:35:38.471 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding auth protocol: cephx 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding auth protocol: cephx 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding auth protocol: cephx 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.472 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command rotate-key cmddesc rotate-key hook 0x5614461c8e28 EEXIST 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-a con 0x56144620b8a0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-b con 0x561446214f50 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-c con 0x561446216090 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:38.473 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): authenticate will time out at 2526.650015s 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request con 0x56144620b8a0 auth_method 0 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request con 0x561446216090 auth_method 0 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.474 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:35:38.146+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request con 0x561446214f50 auth_method 0 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:35:38.146+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:35:38.146+0000 7fd6a16ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:35:38.146+0000 7fd6a16ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_done global_id 6354 payload 824 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient: _finish_hunting 0 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 1 monclient: found mon.noname-a 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: dump: 2024-09-12T00:35:38.475 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: _finish_auth 0 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: _check_auth_tickets 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: dump: 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:35:38.146+0000 7fd577fff640 4 set_mon_vals no callback set 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 monclient: authenticate success, global_id 6354 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 librados: init done 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command cr dump hook 0x561446212a58 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:35:38.150+0000 7fd5767fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:35:38.150+0000 7fd5767fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.478 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:35:38.150+0000 7fd5767fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:35:38.150+0000 7fd6a16ba640 10 monclient: get_auth_request con 0x7fd56c070ae0 auth_method 0 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:35:38.150+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x561446234590 auth_method 0 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 realm 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:35:38.150+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x5614462387d0 auth_method 0 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:35:38.154+0000 7fd6a16ba640 10 monclient: get_auth_request con 0x56144623c030 auth_method 0 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 searching for the correct realm 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:35:38.154+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x561446240e00 auth_method 0 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:35:38.154+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x7fd6980665e0 auth_method 0 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:35:38.158+0000 7fd6a16ba640 10 monclient: get_auth_request con 0x7fd694080040 auth_method 0 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:35:38.158+0000 7fd6a16ba640 0 -- 172.21.15.102:0/1333075636 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fd694080040 msgr2=0x7fd69401c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:35:38.158+0000 7fd5767fc640 1 client.6354.objecter ms_handle_reset 0x7fd694080040 session 0x7fd694054100 osd.4 2024-09-12T00:35:38.480 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:35:38.158+0000 7fd5767fc640 10 monclient: _renew_subs 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:35:38.158+0000 7fd5767fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:35:38.158+0000 7fd6a16ba640 10 monclient: get_auth_request con 0x7fd56c081180 auth_method 0 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:35:38.162+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x7fd69807ea30 auth_method 0 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:35:38.166+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x7fd698082130 auth_method 0 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:35:38.166+0000 7fd6a06b8640 0 -- 172.21.15.102:0/1333075636 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd698082130 msgr2=0x7fd6980901e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:35:38.370+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x7fd698082130 auth_method 0 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 zone default found 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 4 Realm: () 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 zonegroup default 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 started sync module instance, tier type = 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=0 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=1 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=2 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=3 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=4 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=5 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=6 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=7 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding auth protocol: cephx 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding auth protocol: cephx 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding auth protocol: cephx 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.484 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:35:38.418+0000 7fd5577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command cache list hook 0x5614461e9610 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command cache inspect hook 0x5614461e9610 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command cache erase hook 0x5614461e9610 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command cache zap hook 0x5614461e9610 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 note: GC not initialized 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:35:38.418+0000 7fd5567e4640 20 reqs_thread_entry: start 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command sync trace show hook 0x7fd69402a050 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command sync trace history hook 0x7fd69402a050 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command sync trace active hook 0x7fd69402a050 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command sync trace active_short hook 0x7fd69402a050 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 Filter name: none 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:35:38.422+0000 7fd54f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 : miss 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:35:38.426+0000 7fd6a33b39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd6a33b39c0 time 2024-09-12T00:35:38.429949+0000 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd6a6c8d2eb] 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6a6c8d49f] 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561444711cc1] 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1421f32) [0x56144516ef32] 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561444726ced] 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd6a5af3d90] 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:35:38.430+0000 7fd6a33b39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd6a33b39c0 thread_name:radosgw-admin 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd6a5b0c520] 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd6a6c8d345] 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6a6c8d49f] 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561444711cc1] 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1421f32) [0x56144516ef32] 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561444726ced] 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd6a5af3d90] 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:35:38.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:35:38.493 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:35:38.493 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:35:38.493 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:35:38.506 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:35:38.506 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:38.506 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:35:38.506 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:35:38.506 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:38.506 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:38.506 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:35:38.506 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:38.506 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:35:38.507 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:35:38.508 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:35:38.509 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd54f7fe640 / http_manager 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd5567e4640 / http_manager 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd5577e6640 / rgw_dt_lg_renew 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd5767fc640 / ms_dispatch 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd577fff640 / io_context_pool 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd5867fc640 / ms_dispatch 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd58d60a640 / ms_dispatch 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd58ee0d640 / io_context_pool 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6a06b8640 / msgr-worker-2 2024-09-12T00:35:38.510 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6a0eb9640 / msgr-worker-1 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6a16ba640 / msgr-worker-0 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6a1ebb640 / io_context_pool 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6a33b39c0 / radosgw-admin 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.84651.log 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:35:38.126+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:35:38.126+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:35:38.126+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.511 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:35:38.126+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request con 0x561445ff82b0 auth_method 0 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:35:38.126+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:35:38.126+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:35:38.126+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_done global_id 5984 payload 274 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient: _finish_hunting 0 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 1 monclient: found mon.noname-c 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:35:38.126+0000 7fd6a06b8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: dump: 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.512 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: _finish_auth 0 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: _check_auth_tickets 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 monclient: authenticate success, global_id 5984 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 4 set_mon_vals no callback set 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:38.513 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:35:38.126+0000 7fd58ee0d640 10 monclient: dump: 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 10 monclient: shutdown 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) unregister_commands rotate-key 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 10 monclient: build_initial_monmap 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:38.514 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 10 monclient: monmap: 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding auth protocol: cephx 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding auth protocol: cephx 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding auth protocol: cephx 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.515 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: crc 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x56144614c8f0) adding con mode: secure 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 1 librados: starting msgr at 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 1 librados: starting objecter 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command objecter_requests hook 0x561445f6f2b0 2024-09-12T00:35:38.516 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 1 librados: setting wanted keys 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 1 librados: calling monclient init 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 10 monclient: init 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding auth protocol: cephx 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding auth protocol: cephx 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding auth protocol: cephx 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.517 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: crc 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:35:38.126+0000 7fd6a33b39c0 5 AuthRegistry(0x561446147520) adding con mode: secure 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command rotate-key hook 0x561446147668 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-b con 0x561445ff82b0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-a con 0x561446003ba0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-c con 0x561446090090 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.518 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient(hunting): authenticate will time out at 2526.632480s 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request con 0x561446090090 auth_method 0 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request con 0x561446003ba0 auth_method 0 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.519 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient(hunting): handle_auth_done global_id 5987 payload 824 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient: _finish_hunting 0 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 1 monclient: found mon.noname-c 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:35:38.130+0000 7fd6a16ba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:35:38.130+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x561445ff82b0 auth_method 0 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:38.520 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: dump: 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: _finish_auth 0 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: _check_auth_tickets 2024-09-12T00:35:38.521 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 5 monclient: authenticate success, global_id 5987 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:35:38.130+0000 7fd58d60a640 10 monclient: dump: 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.522 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:35:38.130+0000 7fd58ee0d640 4 set_mon_vals no callback set 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:35:38.130+0000 7fd6a33b39c0 1 librados: init done 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:35:38.130+0000 7fd58d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:35:38.130+0000 7fd58d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:35:38.130+0000 7fd58d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:35:38.130+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x7fd588070b10 auth_method 0 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:35:38.130+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x56144616f050 auth_method 0 2024-09-12T00:35:38.523 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:35:38.134+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x561446193300 auth_method 0 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:35:38.134+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x5614461974f0 auth_method 0 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:35:38.138+0000 7fd6a16ba640 10 monclient: get_auth_request con 0x56144619b1d0 auth_method 0 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient: build_initial_monmap 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient: monmap: 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.524 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding auth protocol: cephx 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding auth protocol: cephx 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding auth protocol: cephx 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.525 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: crc 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619f2e0) adding con mode: secure 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5614461a2d10 EEXIST 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient: init 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding auth protocol: cephx 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding auth protocol: cephx 2024-09-12T00:35:38.526 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding auth protocol: cephx 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: crc 2024-09-12T00:35:38.527 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 AuthRegistry(0x56144619e1d8) adding con mode: secure 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command rotate-key cmddesc rotate-key hook 0x56144619e320 EEXIST 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-c con 0x5614461c6ec0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-b con 0x5614461c67f0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-a con 0x5614461c51d0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.528 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 10 monclient(hunting): authenticate will time out at 2526.643030s 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request con 0x5614461c51d0 auth_method 0 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request con 0x5614461c6ec0 auth_method 0 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.529 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:35:38.138+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:35:38.138+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request con 0x5614461c67f0 auth_method 0 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:35:38.138+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:35:38.138+0000 7fd6a16ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:35:38.138+0000 7fd6a16ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_done global_id 6348 payload 824 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient: _finish_hunting 0 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 1 monclient: found mon.noname-a 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:35:38.138+0000 7fd6a0eb9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.530 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: dump: 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: _finish_auth 0 2024-09-12T00:35:38.531 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: _check_auth_tickets 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:35:38.138+0000 7fd5867fc640 10 monclient: dump: 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.532 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:35:38.138+0000 7fd6a33b39c0 5 monclient: authenticate success, global_id 6348 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:35:38.138+0000 7fd6a1ebb640 4 set_mon_vals no callback set 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:35:38.142+0000 7fd5867fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:35:38.142+0000 7fd5867fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:35:38.142+0000 7fd5867fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: get_monmap_and_config 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: build_initial_monmap 2024-09-12T00:35:38.533 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: monmap: 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding auth protocol: cephx 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding auth protocol: cephx 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding auth protocol: cephx 2024-09-12T00:35:38.534 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: crc 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461e6760) adding con mode: secure 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x7fd578070a20 auth_method 0 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.535 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: init 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding auth protocol: cephx 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding auth protocol: cephx 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding auth protocol: cephx 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.536 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: crc 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd327b60) adding con mode: secure 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffefd327ca8 EEXIST 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-c con 0x561446214f50 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-b con 0x56144620b8a0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-a con 0x561446216090 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.537 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:35:38.142+0000 7fd6a33b39c0 10 monclient(hunting): authenticate will time out at 2526.647321s 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request con 0x561446214f50 auth_method 0 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request con 0x561446216090 auth_method 0 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.538 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:35:38.142+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_done global_id 5993 payload 274 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient: _finish_hunting 0 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 1 monclient: found mon.noname-c 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:35:38.142+0000 7fd6a06b8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: dump: 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.539 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: _finish_auth 0 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: _check_auth_tickets 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 monclient: authenticate success, global_id 5993 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:35:38.146+0000 7fd577fff640 10 monclient: dump: 2024-09-12T00:35:38.540 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 4 set_mon_vals no callback set 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: shutdown 2024-09-12T00:35:38.541 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: build_initial_monmap 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: monmap: 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.542 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding auth protocol: cephx 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding auth protocol: cephx 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding auth protocol: cephx 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: crc 2024-09-12T00:35:38.543 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x56144620c9d0) adding con mode: secure 2024-09-12T00:35:38.544 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.544 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 librados: starting msgr at 2024-09-12T00:35:38.544 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 librados: starting objecter 2024-09-12T00:35:38.544 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5614461c4e40 EEXIST 2024-09-12T00:35:38.544 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 librados: setting wanted keys 2024-09-12T00:35:38.544 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 librados: calling monclient init 2024-09-12T00:35:38.544 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: init 2024-09-12T00:35:38.544 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding auth protocol: cephx 2024-09-12T00:35:38.544 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding auth protocol: cephx 2024-09-12T00:35:38.544 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding auth protocol: cephx 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.545 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: crc 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 AuthRegistry(0x5614461c8ce0) adding con mode: secure 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command rotate-key cmddesc rotate-key hook 0x5614461c8e28 EEXIST 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-a con 0x56144620b8a0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-b con 0x561446214f50 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): picked mon.noname-c con 0x561446216090 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.546 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient(hunting): authenticate will time out at 2526.650015s 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request con 0x56144620b8a0 auth_method 0 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request con 0x561446216090 auth_method 0 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.547 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:35:38.146+0000 7fd6a0eb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:35:38.146+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request con 0x561446214f50 auth_method 0 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:35:38.146+0000 7fd6a16ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:35:38.146+0000 7fd6a16ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:35:38.146+0000 7fd6a16ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient(hunting): handle_auth_done global_id 6354 payload 824 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient: _finish_hunting 0 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 1 monclient: found mon.noname-a 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:35:38.146+0000 7fd6a06b8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.548 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: dump: 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.549 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: _finish_auth 0 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: _check_auth_tickets 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:35:38.146+0000 7fd5767fc640 10 monclient: dump: 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:38.550 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:35:38.146+0000 7fd577fff640 4 set_mon_vals no callback set 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 monclient: authenticate success, global_id 6354 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _renew_subs 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 1 librados: init done 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:35:38.146+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command cr dump hook 0x561446212a58 2024-09-12T00:35:38.551 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:35:38.150+0000 7fd5767fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:35:38.150+0000 7fd5767fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:35:38.150+0000 7fd5767fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:35:38.150+0000 7fd6a16ba640 10 monclient: get_auth_request con 0x7fd56c070ae0 auth_method 0 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:35:38.150+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x561446234590 auth_method 0 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 realm 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:35:38.150+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.552 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:35:38.150+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x5614462387d0 auth_method 0 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:35:38.154+0000 7fd6a16ba640 10 monclient: get_auth_request con 0x56144623c030 auth_method 0 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:35:38.154+0000 7fd6a33b39c0 20 searching for the correct realm 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:35:38.154+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x561446240e00 auth_method 0 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:35:38.154+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x7fd6980665e0 auth_method 0 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:35:38.158+0000 7fd6a16ba640 10 monclient: get_auth_request con 0x7fd694080040 auth_method 0 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:35:38.158+0000 7fd6a16ba640 0 -- 172.21.15.102:0/1333075636 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fd694080040 msgr2=0x7fd69401c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:35:38.158+0000 7fd5767fc640 1 client.6354.objecter ms_handle_reset 0x7fd694080040 session 0x7fd694054100 osd.4 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:35:38.158+0000 7fd5767fc640 10 monclient: _renew_subs 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:35:38.158+0000 7fd5767fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:35:38.553 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:35:38.158+0000 7fd6a16ba640 10 monclient: get_auth_request con 0x7fd56c081180 auth_method 0 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:35:38.162+0000 7fd6a0eb9640 10 monclient: get_auth_request con 0x7fd69807ea30 auth_method 0 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:35:38.166+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x7fd698082130 auth_method 0 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:35:38.166+0000 7fd6a06b8640 0 -- 172.21.15.102:0/1333075636 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd698082130 msgr2=0x7fd6980901e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:35:38.370+0000 7fd6a06b8640 10 monclient: get_auth_request con 0x7fd698082130 auth_method 0 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:35:38.382+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.554 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 zone default found 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 4 Realm: () 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 zonegroup default 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:35:38.386+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.555 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 started sync module instance, tier type = 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:35:38.390+0000 7fd6a33b39c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=0 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=1 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=2 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=3 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=4 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=5 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=6 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 20 add_watcher() i=7 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:35:38.414+0000 7fd6a33b39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding auth protocol: cephx 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding auth protocol: cephx 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding auth protocol: cephx 2024-09-12T00:35:38.556 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:35:38.418+0000 7fd5577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: crc 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 AuthRegistry(0x7ffefd328040) adding con mode: secure 2024-09-12T00:35:38.557 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command cache list hook 0x5614461e9610 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command cache inspect hook 0x5614461e9610 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command cache erase hook 0x5614461e9610 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command cache zap hook 0x5614461e9610 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:35:38.418+0000 7fd6a33b39c0 5 note: GC not initialized 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:35:38.418+0000 7fd5567e4640 20 reqs_thread_entry: start 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command sync trace show hook 0x7fd69402a050 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command sync trace history hook 0x7fd69402a050 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command sync trace active hook 0x7fd69402a050 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 5 asok(0x561445f3d2b0) register_command sync trace active_short hook 0x7fd69402a050 2024-09-12T00:35:38.558 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 Filter name: none 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:35:38.422+0000 7fd54f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 : miss 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:35:38.559 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:35:38.422+0000 7fd6a33b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:35:38.426+0000 7fd6a33b39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd6a33b39c0 time 2024-09-12T00:35:38.429949+0000 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd6a6c8d2eb] 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6a6c8d49f] 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561444711cc1] 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1421f32) [0x56144516ef32] 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561444726ced] 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:35:38.560 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd6a5af3d90] 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:35:38.430+0000 7fd6a33b39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd6a33b39c0 thread_name:radosgw-admin 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd6a5b0c520] 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:35:38.561 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd6a6c8d345] 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6a6c8d49f] 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561444711cc1] 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1421f32) [0x56144516ef32] 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561444726ced] 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd6a5af3d90] 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:35:38.562 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:35:38.563 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:35:38.564 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:38.565 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:35:38.566 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:35:38.567 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:35:38.568 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd54f7fe640 / http_manager 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd5567e4640 / http_manager 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd5577e6640 / rgw_dt_lg_renew 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd5767fc640 / ms_dispatch 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd577fff640 / io_context_pool 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd5867fc640 / ms_dispatch 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd58d60a640 / ms_dispatch 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd58ee0d640 / io_context_pool 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6a06b8640 / msgr-worker-2 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6a0eb9640 / msgr-worker-1 2024-09-12T00:35:38.569 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6a16ba640 / msgr-worker-0 2024-09-12T00:35:38.570 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6a1ebb640 / io_context_pool 2024-09-12T00:35:38.570 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6a33b39c0 / radosgw-admin 2024-09-12T00:35:38.570 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:35:38.570 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:35:38.570 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:35:38.435949Z_ef917266-bec9-4d28-a127-6448ba858ba8/log 2024-09-12T00:35:38.570 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:35:38.570 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:35:38.570 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:35:38.570 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:38.570 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:38.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.522+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.526+0000 7f6cb33cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.526+0000 7f6cb33cb9c0 20 realm 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.526+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.526+0000 7f6cb33cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.526+0000 7f6cb33cb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.526+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.526+0000 7f6cb33cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.526+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.526+0000 7f6cb33cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.526+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.530+0000 7f6cb33cb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.530+0000 7f6cb33cb9c0 20 searching for the correct realm 2024-09-12T00:35:38.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.534+0000 7f6cb16d2640 0 -- 172.21.15.102:0/455830682 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f6ca4088a10 msgr2=0x7f6ca404b730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:38.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.542+0000 7f6cb06d0640 0 -- 172.21.15.102:0/455830682 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6ca80e2920 msgr2=0x7f6ca80bf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:38.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.758+0000 7f6cb33cb9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:38.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.758+0000 7f6cb33cb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:38.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.758+0000 7f6cb33cb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:38.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.758+0000 7f6cb33cb9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:38.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.758+0000 7f6cb33cb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:38.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.758+0000 7f6cb33cb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:38.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.758+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.758+0000 7f6cb33cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.758+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:38.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:38.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 zone default found 2024-09-12T00:35:38.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 4 Realm: () 2024-09-12T00:35:38.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:38.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:38.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:38.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 zonegroup default 2024-09-12T00:35:38.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 started sync module instance, tier type = 2024-09-12T00:35:38.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.762+0000 7f6cb33cb9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:38.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.786+0000 7f6cb33cb9c0 20 add_watcher() i=0 2024-09-12T00:35:38.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.786+0000 7f6cb33cb9c0 20 add_watcher() i=1 2024-09-12T00:35:38.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.786+0000 7f6cb33cb9c0 20 add_watcher() i=2 2024-09-12T00:35:38.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.786+0000 7f6cb33cb9c0 20 add_watcher() i=3 2024-09-12T00:35:38.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.786+0000 7f6cb33cb9c0 20 add_watcher() i=4 2024-09-12T00:35:38.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.786+0000 7f6cb33cb9c0 20 add_watcher() i=5 2024-09-12T00:35:38.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.786+0000 7f6cb33cb9c0 20 add_watcher() i=6 2024-09-12T00:35:38.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.790+0000 7f6cb33cb9c0 20 add_watcher() i=7 2024-09-12T00:35:38.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.790+0000 7f6cb33cb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:38.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6b66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:38.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6cb33cb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:38.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6cb33cb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:38.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6cb33cb9c0 5 note: GC not initialized 2024-09-12T00:35:38.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6b65fe3640 20 reqs_thread_entry: start 2024-09-12T00:35:38.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6cb33cb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:38.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6cb33cb9c0 20 Filter name: none 2024-09-12T00:35:38.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6ad77fe640 20 reqs_thread_entry: start 2024-09-12T00:35:38.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6cb33cb9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:35:38.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.794+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.798+0000 7f6cb33cb9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:35:38.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.798+0000 7f6cb33cb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:38.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.798+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.798+0000 7f6cb33cb9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:35:38.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.798+0000 7f6cb33cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.798+0000 7f6cb33cb9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:35:38.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.798+0000 7f6cb33cb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:38.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.802+0000 7f6b66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:38.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.806+0000 7f6cb33cb9c0 20 remove_watcher() i=0 2024-09-12T00:35:38.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.806+0000 7f6cb33cb9c0 2 removed watcher, disabling cache 2024-09-12T00:35:38.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.810+0000 7f6cb33cb9c0 20 remove_watcher() i=1 2024-09-12T00:35:38.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.810+0000 7f6cb33cb9c0 20 remove_watcher() i=2 2024-09-12T00:35:38.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.814+0000 7f6cb33cb9c0 20 remove_watcher() i=3 2024-09-12T00:35:38.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.814+0000 7f6cb33cb9c0 20 remove_watcher() i=4 2024-09-12T00:35:38.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.818+0000 7f6cb33cb9c0 20 remove_watcher() i=5 2024-09-12T00:35:38.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.818+0000 7f6cb33cb9c0 20 remove_watcher() i=6 2024-09-12T00:35:38.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:38.822+0000 7f6cb33cb9c0 20 remove_watcher() i=7 2024-09-12T00:35:38.834 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.834 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:35:38.834 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-init-indext id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:38.834 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:35:38.835 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:38.835 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:38.891 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:38.891 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:35:38.974 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:39.012 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:39.012 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:39.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.062+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.062+0000 7f7fc0d979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.062+0000 7f7fc0d979c0 20 realm 2024-09-12T00:35:39.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.062+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.062+0000 7f7fc0d979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.062+0000 7f7fc0d979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:39.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.062+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.062+0000 7f7fc0d979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.062+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.066+0000 7f7fc0d979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:39.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.066+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.066+0000 7f7fc0d979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:39.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.066+0000 7f7fc0d979c0 20 searching for the correct realm 2024-09-12T00:35:39.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.070+0000 7f7fbf09e640 0 -- 172.21.15.102:0/1619465559 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f7fa802c070 msgr2=0x7f7fa805d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:39.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.078+0000 7f7fbe09c640 0 -- 172.21.15.102:0/1619465559 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f7fb805f920 msgr2=0x7f7fb801c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:39.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.294+0000 7f7fc0d979c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:35:39.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.294+0000 7f7fc0d979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:39.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.294+0000 7f7fc0d979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:39.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.294+0000 7f7fc0d979c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:35:39.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.294+0000 7f7fc0d979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:39.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.294+0000 7f7fc0d979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:39.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.294+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:39.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:39.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 zone default found 2024-09-12T00:35:39.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 4 Realm: () 2024-09-12T00:35:39.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:35:39.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:35:39.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:39.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 zonegroup default 2024-09-12T00:35:39.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.298+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.302+0000 7f7fc0d979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.302+0000 7f7fc0d979c0 20 started sync module instance, tier type = 2024-09-12T00:35:39.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.302+0000 7f7fc0d979c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:35:39.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.322+0000 7f7fc0d979c0 20 add_watcher() i=0 2024-09-12T00:35:39.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.322+0000 7f7fc0d979c0 20 add_watcher() i=1 2024-09-12T00:35:39.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.322+0000 7f7fc0d979c0 20 add_watcher() i=2 2024-09-12T00:35:39.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.322+0000 7f7fc0d979c0 20 add_watcher() i=3 2024-09-12T00:35:39.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.322+0000 7f7fc0d979c0 20 add_watcher() i=4 2024-09-12T00:35:39.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.322+0000 7f7fc0d979c0 20 add_watcher() i=5 2024-09-12T00:35:39.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.322+0000 7f7fc0d979c0 20 add_watcher() i=6 2024-09-12T00:35:39.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.322+0000 7f7fc0d979c0 20 add_watcher() i=7 2024-09-12T00:35:39.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.322+0000 7f7fc0d979c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:39.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.326+0000 7f7e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:39.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.326+0000 7f7fc0d979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:39.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.326+0000 7f7fc0d979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:39.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.326+0000 7f7fc0d979c0 5 note: GC not initialized 2024-09-12T00:35:39.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.326+0000 7f7deffff640 20 reqs_thread_entry: start 2024-09-12T00:35:39.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.326+0000 7f7fc0d979c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:39.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.326+0000 7f7fc0d979c0 20 Filter name: none 2024-09-12T00:35:39.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.326+0000 7f7dedffb640 20 reqs_thread_entry: start 2024-09-12T00:35:39.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.326+0000 7f7fc0d979c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:35:39.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.326+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:35:39.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:35:39.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:35:39.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 : miss 2024-09-12T00:35:39.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:35:39.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:35:39.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:35:39.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:39.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:39.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 2024-09-12T00:35:39.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7fc0d979c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to be held by another RGW process; skipping for now 2024-09-12T00:35:39.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.330+0000 7f7e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:39.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.338+0000 7f7fc0d979c0 20 remove_watcher() i=0 2024-09-12T00:35:39.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.338+0000 7f7fc0d979c0 2 removed watcher, disabling cache 2024-09-12T00:35:39.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.338+0000 7f7fc0d979c0 20 remove_watcher() i=1 2024-09-12T00:35:39.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.342+0000 7f7fc0d979c0 20 remove_watcher() i=2 2024-09-12T00:35:39.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.342+0000 7f7fc0d979c0 20 remove_watcher() i=3 2024-09-12T00:35:39.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.346+0000 7f7fc0d979c0 20 remove_watcher() i=4 2024-09-12T00:35:39.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.346+0000 7f7fc0d979c0 20 remove_watcher() i=5 2024-09-12T00:35:39.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.350+0000 7f7fc0d979c0 20 remove_watcher() i=6 2024-09-12T00:35:39.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:35:39.350+0000 7f7fc0d979c0 20 remove_watcher() i=7 2024-09-12T00:35:39.361 INFO:tasks.workunit.client.0.smithi102.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:36:09.393 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:09.429 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:09.429 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:09.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.481+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.485+0000 7ffbe73089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:09.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.485+0000 7ffbe73089c0 20 realm 2024-09-12T00:36:09.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.485+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.485+0000 7ffbe73089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:09.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.485+0000 7ffbe73089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:09.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.485+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.485+0000 7ffbe73089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:09.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.485+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.485+0000 7ffbe73089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:09.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.485+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.489+0000 7ffbe73089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:09.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.489+0000 7ffbe73089c0 20 searching for the correct realm 2024-09-12T00:36:09.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.489+0000 7ffbe560f640 0 -- 172.21.15.102:0/946506042 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7ffbcc009250 msgr2=0x7ffbcc0199e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:09.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.705+0000 7ffbe460d640 0 -- 172.21.15.102:0/946506042 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7ffbdc0e6410 msgr2=0x7ffbdc0e6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:09.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.921+0000 7ffbe73089c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:09.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.921+0000 7ffbe73089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:09.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.921+0000 7ffbe73089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:09.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.921+0000 7ffbe73089c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:09.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.921+0000 7ffbe73089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:09.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.921+0000 7ffbe73089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:09.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.921+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:09.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:09.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:09.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 20 zone default found 2024-09-12T00:36:09.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 4 Realm: () 2024-09-12T00:36:09.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:09.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:09.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:09.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 20 zonegroup default 2024-09-12T00:36:09.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:09.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.925+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.929+0000 7ffbe73089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:09.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.929+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.929+0000 7ffbe73089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:09.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.929+0000 7ffbe73089c0 20 started sync module instance, tier type = 2024-09-12T00:36:09.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.929+0000 7ffbe73089c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:09.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.953+0000 7ffbe73089c0 20 add_watcher() i=0 2024-09-12T00:36:09.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.953+0000 7ffbe73089c0 20 add_watcher() i=1 2024-09-12T00:36:09.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.953+0000 7ffbe73089c0 20 add_watcher() i=2 2024-09-12T00:36:09.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.953+0000 7ffbe73089c0 20 add_watcher() i=3 2024-09-12T00:36:09.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.953+0000 7ffbe73089c0 20 add_watcher() i=4 2024-09-12T00:36:09.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.953+0000 7ffbe73089c0 20 add_watcher() i=5 2024-09-12T00:36:09.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.953+0000 7ffbe73089c0 20 add_watcher() i=6 2024-09-12T00:36:09.947 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.953+0000 7ffbe73089c0 20 add_watcher() i=7 2024-09-12T00:36:09.947 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.953+0000 7ffbe73089c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:09.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.957+0000 7ffa9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:09.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.957+0000 7ffbe73089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:09.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.957+0000 7ffbe73089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:09.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.957+0000 7ffbe73089c0 5 note: GC not initialized 2024-09-12T00:36:09.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.957+0000 7ffa99fe3640 20 reqs_thread_entry: start 2024-09-12T00:36:09.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.957+0000 7ffbe73089c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:09.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.957+0000 7ffbe73089c0 20 Filter name: none 2024-09-12T00:36:09.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.957+0000 7ffa0b7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:09.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.957+0000 7ffbe73089c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:36:09.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.957+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:36:09.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:36:09.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:36:09.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 : miss 2024-09-12T00:36:09.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:09.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:36:09.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:36:09.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:36:09.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:09.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:09.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.961+0000 7ffbe73089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 2024-09-12T00:36:09.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.969+0000 7ffbe73089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:36:09.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.969+0000 7ffbe73089c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:36:09.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.969+0000 7ffbe73089c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:09.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.969+0000 7ffbe73089c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22, ofs0, ns] 2024-09-12T00:36:09.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.969+0000 7ffabbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398887 cookie 94504661327248 notifier 6411 bl.length()=997 2024-09-12T00:36:09.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.969+0000 7ffabbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:36:09.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.969+0000 7ffabbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:36:09.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.969+0000 7ffabbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:09.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.973+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): orig_sources= new_sources= 2024-09-12T00:36:09.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.973+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): potential sources added=[] removed=[] 2024-09-12T00:36:09.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.973+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): orig_dests= new_dests= 2024-09-12T00:36:09.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.973+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): potential dests added=[] removed=[] 2024-09-12T00:36:09.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.0 2024-09-12T00:36:09.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.0 2024-09-12T00:36:09.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.1 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.1 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.2 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.2 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.3 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.3 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.4 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.4 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.5 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.5 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.6 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.6 2024-09-12T00:36:09.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.7 2024-09-12T00:36:09.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.7 2024-09-12T00:36:09.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.8 2024-09-12T00:36:09.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.8 2024-09-12T00:36:09.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.9 2024-09-12T00:36:09.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.9 2024-09-12T00:36:09.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.10 2024-09-12T00:36:09.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.10 2024-09-12T00:36:09.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.11 2024-09-12T00:36:09.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1.11 2024-09-12T00:36:09.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.0 2024-09-12T00:36:09.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.981+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1 2024-09-12T00:36:09.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.985+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.2 2024-09-12T00:36:09.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.985+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.3 2024-09-12T00:36:09.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.985+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.4 2024-09-12T00:36:09.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.985+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.5 2024-09-12T00:36:09.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.989+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.6 2024-09-12T00:36:09.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.989+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.7 2024-09-12T00:36:09.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.989+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.8 2024-09-12T00:36:09.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.993+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.9 2024-09-12T00:36:09.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.993+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.10 2024-09-12T00:36:09.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.997+0000 7ffbe73089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:09.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:09.997+0000 7ffbe73089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 2024-09-12T00:36:09.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.001+0000 7ffbe73089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:36:09.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.001+0000 7ffbe73089c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:36:09.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.001+0000 7ffbe73089c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:09.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.001+0000 7ffbe73089c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22, ofs0, ns] 2024-09-12T00:36:09.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.001+0000 7ffabb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398888 cookie 94504661327248 notifier 6411 bl.length()=997 2024-09-12T00:36:09.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.001+0000 7ffabb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:36:09.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.001+0000 7ffabb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:36:09.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.001+0000 7ffabb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:09.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.005+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): orig_sources= new_sources= 2024-09-12T00:36:09.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.005+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): potential sources added=[] removed=[] 2024-09-12T00:36:09.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.005+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): orig_dests= new_dests= 2024-09-12T00:36:09.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.005+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): potential dests added=[] removed=[] 2024-09-12T00:36:10.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.009+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.0 2024-09-12T00:36:10.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.009+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.1 2024-09-12T00:36:10.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.009+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.2 2024-09-12T00:36:10.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.009+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.3 2024-09-12T00:36:10.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.009+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.4 2024-09-12T00:36:10.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.009+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.5 2024-09-12T00:36:10.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.013+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.6 2024-09-12T00:36:10.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.013+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.7 2024-09-12T00:36:10.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.013+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.8 2024-09-12T00:36:10.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.013+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.9 2024-09-12T00:36:10.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.013+0000 7ffbe73089c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22.10 2024-09-12T00:36:10.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.013+0000 7ffbe73089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:10.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.013+0000 7ffbe73089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 2024-09-12T00:36:10.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.017+0000 7ffbe73089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:36:10.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.017+0000 7ffbe73089c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:36:10.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.017+0000 7ffbe73089c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:10.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.017+0000 7ffbe73089c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22, ofs0, ns] 2024-09-12T00:36:10.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.017+0000 7ffabb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398889 cookie 94504661327248 notifier 6411 bl.length()=965 2024-09-12T00:36:10.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.017+0000 7ffabb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 info.flags=0x17 2024-09-12T00:36:10.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.017+0000 7ffabb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 to cache LRU end 2024-09-12T00:36:10.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.017+0000 7ffabb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:10.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.021+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): orig_sources= new_sources= 2024-09-12T00:36:10.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.021+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): potential sources added=[] removed=[] 2024-09-12T00:36:10.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.021+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): orig_dests= new_dests= 2024-09-12T00:36:10.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.021+0000 7ffbe73089c0 20 handle_bi_update(): bucket=:abort-at-init-indext[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22]): potential dests added=[] removed=[] 2024-09-12T00:36:10.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.021+0000 7ffbe73089c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:10.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.025+0000 7ffa9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:10.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.029+0000 7ffbe73089c0 20 remove_watcher() i=0 2024-09-12T00:36:10.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.029+0000 7ffbe73089c0 2 removed watcher, disabling cache 2024-09-12T00:36:10.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.033+0000 7ffbe73089c0 20 remove_watcher() i=1 2024-09-12T00:36:10.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.033+0000 7ffbe73089c0 20 remove_watcher() i=2 2024-09-12T00:36:10.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.033+0000 7ffbe73089c0 20 remove_watcher() i=3 2024-09-12T00:36:10.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.037+0000 7ffbe73089c0 20 remove_watcher() i=4 2024-09-12T00:36:10.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.037+0000 7ffbe73089c0 20 remove_watcher() i=5 2024-09-12T00:36:10.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.041+0000 7ffbe73089c0 20 remove_watcher() i=6 2024-09-12T00:36:10.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.041+0000 7ffbe73089c0 20 remove_watcher() i=7 2024-09-12T00:36:10.048 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:36:10.075 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:10.075 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:10.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.125+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.129+0000 7ff00d68f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:10.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.129+0000 7ff00d68f9c0 20 realm 2024-09-12T00:36:10.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.129+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.129+0000 7ff00d68f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:10.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.129+0000 7ff00d68f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:10.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.129+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.129+0000 7ff00d68f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:10.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.129+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.129+0000 7ff00d68f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:10.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.129+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.133+0000 7ff00d68f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:10.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.133+0000 7ff00d68f9c0 20 searching for the correct realm 2024-09-12T00:36:10.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.133+0000 7ff00b996640 0 -- 172.21.15.102:0/3920353338 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7feff40f0040 msgr2=0x7feff40f0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:10.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.349+0000 7ff00a994640 0 -- 172.21.15.102:0/3920353338 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7ff004053410 msgr2=0x7ff004053890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:10.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:10.561 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:10.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:10.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:10.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:10.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:10.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:10.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:10.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:10.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 zone default found 2024-09-12T00:36:10.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 4 Realm: () 2024-09-12T00:36:10.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:10.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:10.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:10.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 zonegroup default 2024-09-12T00:36:10.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:10.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.569+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.573+0000 7ff00d68f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:10.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.573+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.573+0000 7ff00d68f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:10.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.573+0000 7ff00d68f9c0 20 started sync module instance, tier type = 2024-09-12T00:36:10.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.573+0000 7ff00d68f9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:10.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.597+0000 7ff00d68f9c0 20 add_watcher() i=0 2024-09-12T00:36:10.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.597+0000 7ff00d68f9c0 20 add_watcher() i=1 2024-09-12T00:36:10.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.597+0000 7ff00d68f9c0 20 add_watcher() i=2 2024-09-12T00:36:10.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.597+0000 7ff00d68f9c0 20 add_watcher() i=3 2024-09-12T00:36:10.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.597+0000 7ff00d68f9c0 20 add_watcher() i=4 2024-09-12T00:36:10.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.597+0000 7ff00d68f9c0 20 add_watcher() i=5 2024-09-12T00:36:10.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.597+0000 7ff00d68f9c0 20 add_watcher() i=6 2024-09-12T00:36:10.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.597+0000 7ff00d68f9c0 20 add_watcher() i=7 2024-09-12T00:36:10.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.597+0000 7ff00d68f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:10.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.601+0000 7feec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:10.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.601+0000 7ff00d68f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:10.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.601+0000 7ff00d68f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:10.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.601+0000 7ff00d68f9c0 5 note: GC not initialized 2024-09-12T00:36:10.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.601+0000 7feec0fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:10.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.601+0000 7ff00d68f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:10.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 Filter name: none 2024-09-12T00:36:10.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7fee3a7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:10.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:36:10.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:36:10.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:10.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:36:10.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:10.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:36:10.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.605+0000 7ff00d68f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:10.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.609+0000 7feec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:10.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.613+0000 7ff00d68f9c0 20 remove_watcher() i=0 2024-09-12T00:36:10.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.613+0000 7ff00d68f9c0 2 removed watcher, disabling cache 2024-09-12T00:36:10.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.617+0000 7ff00d68f9c0 20 remove_watcher() i=1 2024-09-12T00:36:10.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.617+0000 7ff00d68f9c0 20 remove_watcher() i=2 2024-09-12T00:36:10.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.621+0000 7ff00d68f9c0 20 remove_watcher() i=3 2024-09-12T00:36:10.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.621+0000 7ff00d68f9c0 20 remove_watcher() i=4 2024-09-12T00:36:10.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.625+0000 7ff00d68f9c0 20 remove_watcher() i=5 2024-09-12T00:36:10.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.625+0000 7ff00d68f9c0 20 remove_watcher() i=6 2024-09-12T00:36:10.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:10.625+0000 7ff00d68f9c0 20 remove_watcher() i=7 2024-09-12T00:36:10.635 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:10.635 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:36:10.635 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-init-indext id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:36:10.635 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:10.636 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:10.637 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:10.661 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:10.661 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:11.263 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:11.263 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:11.646 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:36:11.646 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:11.651 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:11.651 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:11.788 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:11.788 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:11.873 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:11.873 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:11.974 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:11.974 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:12.073 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:12.073 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:12.174 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:12.175 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:12.264 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:12.264 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:12.349 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:12.349 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:12.443 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:12.443 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:12.538 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:12.538 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:12.636 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:12.636 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:12.736 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:12.736 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:12.837 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:12.837 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:12.940 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:12.941 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:13.039 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:13.139 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:13.139 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:13.235 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:13.235 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:13.338 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:13.338 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:13.434 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:13.434 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:13.534 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:13.534 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:13.636 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:13.636 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:13.737 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:13.737 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:13.833 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:36:13.867 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:13.867 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:13.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.921+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.921+0000 7faa44e5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.921+0000 7faa44e5c9c0 20 realm 2024-09-12T00:36:13.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.921+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.921+0000 7faa44e5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.921+0000 7faa44e5c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:13.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.921+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.921+0000 7faa44e5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:13.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.921+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.925+0000 7faa44e5c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:13.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.925+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:13.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.925+0000 7faa44e5c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:13.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.925+0000 7faa44e5c9c0 20 searching for the correct realm 2024-09-12T00:36:13.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:13.929+0000 7faa43163640 0 -- 172.21.15.102:0/2796274850 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7faa38028c90 msgr2=0x7faa38049930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:14.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.145+0000 7faa42161640 0 -- 172.21.15.102:0/2796274850 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7faa3c0e4800 msgr2=0x7faa3c0e4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:14.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.361+0000 7faa44e5c9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:14.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.361+0000 7faa44e5c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:14.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.361+0000 7faa44e5c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:14.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.361+0000 7faa44e5c9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:14.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.361+0000 7faa44e5c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:14.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.361+0000 7faa44e5c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:14.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.361+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.361+0000 7faa44e5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.361+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:14.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:14.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 20 zone default found 2024-09-12T00:36:14.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 4 Realm: () 2024-09-12T00:36:14.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:14.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:14.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:14.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 20 zonegroup default 2024-09-12T00:36:14.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.365+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.369+0000 7faa44e5c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.369+0000 7faa44e5c9c0 20 started sync module instance, tier type = 2024-09-12T00:36:14.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.369+0000 7faa44e5c9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:14.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.389+0000 7faa44e5c9c0 20 add_watcher() i=0 2024-09-12T00:36:14.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.389+0000 7faa44e5c9c0 20 add_watcher() i=1 2024-09-12T00:36:14.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.389+0000 7faa44e5c9c0 20 add_watcher() i=2 2024-09-12T00:36:14.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.389+0000 7faa44e5c9c0 20 add_watcher() i=3 2024-09-12T00:36:14.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.389+0000 7faa44e5c9c0 20 add_watcher() i=4 2024-09-12T00:36:14.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.389+0000 7faa44e5c9c0 20 add_watcher() i=5 2024-09-12T00:36:14.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.389+0000 7faa44e5c9c0 20 add_watcher() i=6 2024-09-12T00:36:14.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.393+0000 7faa44e5c9c0 20 add_watcher() i=7 2024-09-12T00:36:14.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.393+0000 7faa44e5c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:14.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.397+0000 7fa8f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:14.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.397+0000 7faa44e5c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:14.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.397+0000 7faa44e5c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:14.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7faa44e5c9c0 5 note: GC not initialized 2024-09-12T00:36:14.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7fa873fff640 20 reqs_thread_entry: start 2024-09-12T00:36:14.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7faa44e5c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:14.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7faa44e5c9c0 20 Filter name: none 2024-09-12T00:36:14.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7fa871ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:14.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7faa44e5c9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:14.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7faa44e5c9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:14.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7faa44e5c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:14.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.401+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.405+0000 7faa44e5c9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:14.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.405+0000 7faa44e5c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.405+0000 7faa44e5c9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:14.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.405+0000 7faa44e5c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:14.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.409+0000 7fa8f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:14.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.413+0000 7faa44e5c9c0 20 remove_watcher() i=0 2024-09-12T00:36:14.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.413+0000 7faa44e5c9c0 2 removed watcher, disabling cache 2024-09-12T00:36:14.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.413+0000 7faa44e5c9c0 20 remove_watcher() i=1 2024-09-12T00:36:14.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.417+0000 7faa44e5c9c0 20 remove_watcher() i=2 2024-09-12T00:36:14.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.421+0000 7faa44e5c9c0 20 remove_watcher() i=3 2024-09-12T00:36:14.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.421+0000 7faa44e5c9c0 20 remove_watcher() i=4 2024-09-12T00:36:14.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.421+0000 7faa44e5c9c0 20 remove_watcher() i=5 2024-09-12T00:36:14.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.425+0000 7faa44e5c9c0 20 remove_watcher() i=6 2024-09-12T00:36:14.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.425+0000 7faa44e5c9c0 20 remove_watcher() i=7 2024-09-12T00:36:14.439 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:14.439 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:36:14.439 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-set-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:14.439 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:14.440 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:36:14.474 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:14.474 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:14.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.525+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.525+0000 7f4e341c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.525+0000 7f4e341c49c0 20 realm 2024-09-12T00:36:14.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.525+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.529+0000 7f4e341c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.529+0000 7f4e341c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:14.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.529+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.529+0000 7f4e341c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.529+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.529+0000 7f4e341c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:14.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.529+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.529+0000 7f4e341c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:14.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.529+0000 7f4e341c49c0 20 searching for the correct realm 2024-09-12T00:36:14.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.533+0000 7f4e324cb640 0 -- 172.21.15.102:0/194724193 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f4e1c076030 msgr2=0x7f4e1c07b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:14.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.541+0000 7f4e2bfff640 0 -- 172.21.15.102:0/194724193 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f4e2c071090 msgr2=0x7f4e2c094710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:14.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:14.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:14.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:14.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:14.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:14.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:14.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:14.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:14.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 zone default found 2024-09-12T00:36:14.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 4 Realm: () 2024-09-12T00:36:14.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:14.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:14.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:14.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 zonegroup default 2024-09-12T00:36:14.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.761+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.765+0000 7f4e341c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.765+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.765+0000 7f4e341c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.765+0000 7f4e341c49c0 20 started sync module instance, tier type = 2024-09-12T00:36:14.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.765+0000 7f4e341c49c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:14.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.789+0000 7f4e341c49c0 20 add_watcher() i=0 2024-09-12T00:36:14.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.789+0000 7f4e341c49c0 20 add_watcher() i=1 2024-09-12T00:36:14.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.789+0000 7f4e341c49c0 20 add_watcher() i=2 2024-09-12T00:36:14.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.789+0000 7f4e341c49c0 20 add_watcher() i=3 2024-09-12T00:36:14.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.789+0000 7f4e341c49c0 20 add_watcher() i=4 2024-09-12T00:36:14.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.789+0000 7f4e341c49c0 20 add_watcher() i=5 2024-09-12T00:36:14.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.789+0000 7f4e341c49c0 20 add_watcher() i=6 2024-09-12T00:36:14.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.789+0000 7f4e341c49c0 20 add_watcher() i=7 2024-09-12T00:36:14.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.789+0000 7f4e341c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:14.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.797+0000 7f4ce3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:14.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.797+0000 7f4e341c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:14.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.797+0000 7f4e341c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:14.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.797+0000 7f4e341c49c0 5 note: GC not initialized 2024-09-12T00:36:14.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.797+0000 7f4ce2ffd640 20 reqs_thread_entry: start 2024-09-12T00:36:14.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.797+0000 7f4e341c49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:14.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.797+0000 7f4e341c49c0 20 Filter name: none 2024-09-12T00:36:14.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.797+0000 7f4ce0ff9640 20 reqs_thread_entry: start 2024-09-12T00:36:14.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.797+0000 7f4e341c49c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:36:14.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.797+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:14.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:36:14.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:36:14.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 : miss 2024-09-12T00:36:14.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:14.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 info.flags=0x17 2024-09-12T00:36:14.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 to cache LRU end 2024-09-12T00:36:14.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:14.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:14.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.801+0000 7f4e341c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 2024-09-12T00:36:14.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.809+0000 7f4e341c49c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:36:14.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.809+0000 7f4e341c49c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:36:14.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.817+0000 7f4ce3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:14.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.821+0000 7f4e341c49c0 20 remove_watcher() i=0 2024-09-12T00:36:14.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.821+0000 7f4e341c49c0 2 removed watcher, disabling cache 2024-09-12T00:36:14.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.825+0000 7f4e341c49c0 20 remove_watcher() i=1 2024-09-12T00:36:14.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.829+0000 7f4e341c49c0 20 remove_watcher() i=2 2024-09-12T00:36:14.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.829+0000 7f4e341c49c0 20 remove_watcher() i=3 2024-09-12T00:36:14.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.833+0000 7f4e341c49c0 20 remove_watcher() i=4 2024-09-12T00:36:14.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.837+0000 7f4e341c49c0 20 remove_watcher() i=5 2024-09-12T00:36:14.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.837+0000 7f4e341c49c0 20 remove_watcher() i=6 2024-09-12T00:36:14.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.837+0000 7f4e341c49c0 20 remove_watcher() i=7 2024-09-12T00:36:14.855 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:36:14.882 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:14.883 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:14.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.933+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.937+0000 7fa9026dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.937+0000 7fa9026dc9c0 20 realm 2024-09-12T00:36:14.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.937+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.937+0000 7fa9026dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.937+0000 7fa9026dc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:14.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.937+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.937+0000 7fa9026dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.937+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.937+0000 7fa9026dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:14.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.937+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.941+0000 7fa9026dc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:14.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.941+0000 7fa9026dc9c0 20 searching for the correct realm 2024-09-12T00:36:14.936 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.941+0000 7fa9009e3640 0 -- 172.21.15.102:0/1136211275 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55a70abcb170 msgr2=0x55a70abcd560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:14.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:14.945+0000 7fa9001e2640 0 -- 172.21.15.102:0/1136211275 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x55a70a9873b0 msgr2=0x7fa8f8047040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:15.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:15.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:15.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:15.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:15.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:15.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:15.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:15.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.169+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:15.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 zone default found 2024-09-12T00:36:15.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 4 Realm: () 2024-09-12T00:36:15.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:15.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:15.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:15.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 zonegroup default 2024-09-12T00:36:15.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 started sync module instance, tier type = 2024-09-12T00:36:15.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.173+0000 7fa9026dc9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:15.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.197+0000 7fa9026dc9c0 20 add_watcher() i=0 2024-09-12T00:36:15.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.197+0000 7fa9026dc9c0 20 add_watcher() i=1 2024-09-12T00:36:15.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.197+0000 7fa9026dc9c0 20 add_watcher() i=2 2024-09-12T00:36:15.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.197+0000 7fa9026dc9c0 20 add_watcher() i=3 2024-09-12T00:36:15.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.197+0000 7fa9026dc9c0 20 add_watcher() i=4 2024-09-12T00:36:15.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.197+0000 7fa9026dc9c0 20 add_watcher() i=5 2024-09-12T00:36:15.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.197+0000 7fa9026dc9c0 20 add_watcher() i=6 2024-09-12T00:36:15.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.201+0000 7fa9026dc9c0 20 add_watcher() i=7 2024-09-12T00:36:15.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.201+0000 7fa9026dc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:15.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.205+0000 7fa7b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:15.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.205+0000 7fa9026dc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:15.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.205+0000 7fa9026dc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:15.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.205+0000 7fa9026dc9c0 5 note: GC not initialized 2024-09-12T00:36:15.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.205+0000 7fa7b5fdb640 20 reqs_thread_entry: start 2024-09-12T00:36:15.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.205+0000 7fa9026dc9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:15.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.209+0000 7fa9026dc9c0 20 Filter name: none 2024-09-12T00:36:15.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.209+0000 7fa7277fe640 20 reqs_thread_entry: start 2024-09-12T00:36:15.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.209+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.209+0000 7fa9026dc9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:15.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.209+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.209+0000 7fa9026dc9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:15.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.209+0000 7fa9026dc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:15.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.209+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.209+0000 7fa9026dc9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:15.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.209+0000 7fa9026dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.213+0000 7fa9026dc9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:15.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.213+0000 7fa9026dc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:15.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.213+0000 7fa7b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:15.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.221+0000 7fa9026dc9c0 20 remove_watcher() i=0 2024-09-12T00:36:15.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.221+0000 7fa9026dc9c0 2 removed watcher, disabling cache 2024-09-12T00:36:15.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.221+0000 7fa9026dc9c0 20 remove_watcher() i=1 2024-09-12T00:36:15.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.225+0000 7fa9026dc9c0 20 remove_watcher() i=2 2024-09-12T00:36:15.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.225+0000 7fa9026dc9c0 20 remove_watcher() i=3 2024-09-12T00:36:15.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.229+0000 7fa9026dc9c0 20 remove_watcher() i=4 2024-09-12T00:36:15.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.229+0000 7fa9026dc9c0 20 remove_watcher() i=5 2024-09-12T00:36:15.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.233+0000 7fa9026dc9c0 20 remove_watcher() i=6 2024-09-12T00:36:15.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.233+0000 7fa9026dc9c0 20 remove_watcher() i=7 2024-09-12T00:36:15.252 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:15.252 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:36:15.252 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-set-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:15.252 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:15.253 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:15.253 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:15.304 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:15.304 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:15.371 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:15.408 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:15.408 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:15.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.461+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.461+0000 7fb91f6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.461+0000 7fb91f6479c0 20 realm 2024-09-12T00:36:15.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.461+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.461+0000 7fb91f6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.461+0000 7fb91f6479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:15.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.461+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.461+0000 7fb91f6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.461+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.458 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.465+0000 7fb91f6479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:15.458 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.465+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.465+0000 7fb91f6479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:15.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.465+0000 7fb91f6479c0 20 searching for the correct realm 2024-09-12T00:36:15.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.469+0000 7fb91d94e640 0 -- 172.21.15.102:0/2506055242 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fb908022bf0 msgr2=0x7fb908063ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:15.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.477+0000 7fb91494c640 0 -- 172.21.15.102:0/2506055242 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fb9180e03c0 msgr2=0x7fb9180e0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:15.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.693+0000 7fb91f6479c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.693+0000 7fb91f6479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.693+0000 7fb91f6479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.693+0000 7fb91f6479c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.693+0000 7fb91f6479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.693+0000 7fb91f6479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:15.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.693+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.693+0000 7fb91f6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.693+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:15.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:15.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 20 zone default found 2024-09-12T00:36:15.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 4 Realm: () 2024-09-12T00:36:15.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:15.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:15.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:15.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 20 zonegroup default 2024-09-12T00:36:15.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.697+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.701+0000 7fb91f6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.701+0000 7fb91f6479c0 20 started sync module instance, tier type = 2024-09-12T00:36:15.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.701+0000 7fb91f6479c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:15.715 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.721+0000 7fb91f6479c0 20 add_watcher() i=0 2024-09-12T00:36:15.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.721+0000 7fb91f6479c0 20 add_watcher() i=1 2024-09-12T00:36:15.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.721+0000 7fb91f6479c0 20 add_watcher() i=2 2024-09-12T00:36:15.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.721+0000 7fb91f6479c0 20 add_watcher() i=3 2024-09-12T00:36:15.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.721+0000 7fb91f6479c0 20 add_watcher() i=4 2024-09-12T00:36:15.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.721+0000 7fb91f6479c0 20 add_watcher() i=5 2024-09-12T00:36:15.716 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.721+0000 7fb91f6479c0 20 add_watcher() i=6 2024-09-12T00:36:15.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.725+0000 7fb91f6479c0 20 add_watcher() i=7 2024-09-12T00:36:15.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.725+0000 7fb91f6479c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:15.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb7d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:15.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:15.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:15.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 5 note: GC not initialized 2024-09-12T00:36:15.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb7d27e4640 20 reqs_thread_entry: start 2024-09-12T00:36:15.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:15.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 20 Filter name: none 2024-09-12T00:36:15.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb743fff640 20 reqs_thread_entry: start 2024-09-12T00:36:15.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:36:15.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:15.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:36:15.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:36:15.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 : miss 2024-09-12T00:36:15.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.729+0000 7fb91f6479c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.733+0000 7fb91f6479c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:15.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.733+0000 7fb91f6479c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 info.flags=0x17 2024-09-12T00:36:15.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.733+0000 7fb91f6479c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 to cache LRU end 2024-09-12T00:36:15.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.733+0000 7fb91f6479c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:15.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.733+0000 7fb91f6479c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.733+0000 7fb91f6479c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 2024-09-12T00:36:15.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.741+0000 7fb91f6479c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 info.flags=0x17 2024-09-12T00:36:15.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.741+0000 7fb91f6479c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 to cache LRU end 2024-09-12T00:36:15.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.741+0000 7fb91f6479c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.741+0000 7fb91f6479c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23, ofs0, ns] 2024-09-12T00:36:15.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.745+0000 7fb7effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398889 cookie 94080330261760 notifier 6131 bl.length()=1009 2024-09-12T00:36:15.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.745+0000 7fb7effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 info.flags=0x17 2024-09-12T00:36:15.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.745+0000 7fb7effff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 to cache LRU end 2024-09-12T00:36:15.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.745+0000 7fb7effff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.745+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): orig_sources= new_sources= 2024-09-12T00:36:15.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.745+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): potential sources added=[] removed=[] 2024-09-12T00:36:15.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.745+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): orig_dests= new_dests= 2024-09-12T00:36:15.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.745+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): potential dests added=[] removed=[] 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.0 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.0 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.1 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.1 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.2 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.2 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.3 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.3 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.4 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.4 2024-09-12T00:36:15.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.5 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.5 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.6 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.6 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.7 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.7 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.8 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.8 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.9 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.9 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.10 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.10 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.11 2024-09-12T00:36:15.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1.11 2024-09-12T00:36:15.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.757+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.0 2024-09-12T00:36:15.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.761+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1 2024-09-12T00:36:15.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.761+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.2 2024-09-12T00:36:15.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.761+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.3 2024-09-12T00:36:15.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.761+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.4 2024-09-12T00:36:15.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.765+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.5 2024-09-12T00:36:15.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.765+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.6 2024-09-12T00:36:15.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.765+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.7 2024-09-12T00:36:15.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.769+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.8 2024-09-12T00:36:15.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.769+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.9 2024-09-12T00:36:15.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.769+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.10 2024-09-12T00:36:15.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.777+0000 7fb91f6479c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:15.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.777+0000 7fb91f6479c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 2024-09-12T00:36:15.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.781+0000 7fb91f6479c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 info.flags=0x17 2024-09-12T00:36:15.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.781+0000 7fb91f6479c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 to cache LRU end 2024-09-12T00:36:15.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.781+0000 7fb91f6479c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.781+0000 7fb91f6479c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23, ofs0, ns] 2024-09-12T00:36:15.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.781+0000 7fb800ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398890 cookie 94080330261760 notifier 6131 bl.length()=1009 2024-09-12T00:36:15.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.781+0000 7fb800ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 info.flags=0x17 2024-09-12T00:36:15.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.781+0000 7fb800ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 to cache LRU end 2024-09-12T00:36:15.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.781+0000 7fb800ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.785+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): orig_sources= new_sources= 2024-09-12T00:36:15.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.785+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): potential sources added=[] removed=[] 2024-09-12T00:36:15.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.785+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): orig_dests= new_dests= 2024-09-12T00:36:15.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.785+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): potential dests added=[] removed=[] 2024-09-12T00:36:15.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.789+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.0 2024-09-12T00:36:15.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.789+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.1 2024-09-12T00:36:15.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.793+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.2 2024-09-12T00:36:15.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.793+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.3 2024-09-12T00:36:15.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.793+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.4 2024-09-12T00:36:15.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.793+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.5 2024-09-12T00:36:15.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.793+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.6 2024-09-12T00:36:15.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.793+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.7 2024-09-12T00:36:15.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.797+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.8 2024-09-12T00:36:15.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.797+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.9 2024-09-12T00:36:15.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.797+0000 7fb91f6479c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23.10 2024-09-12T00:36:15.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.797+0000 7fb91f6479c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:15.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.797+0000 7fb91f6479c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 2024-09-12T00:36:15.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.801+0000 7fb91f6479c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 info.flags=0x17 2024-09-12T00:36:15.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.801+0000 7fb91f6479c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 to cache LRU end 2024-09-12T00:36:15.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.801+0000 7fb91f6479c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.801+0000 7fb91f6479c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23, ofs0, ns] 2024-09-12T00:36:15.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.801+0000 7fb800ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398891 cookie 94080330261760 notifier 6131 bl.length()=977 2024-09-12T00:36:15.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.801+0000 7fb800ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 info.flags=0x17 2024-09-12T00:36:15.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.801+0000 7fb800ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 to cache LRU end 2024-09-12T00:36:15.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.801+0000 7fb800ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.805+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): orig_sources= new_sources= 2024-09-12T00:36:15.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.805+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): potential sources added=[] removed=[] 2024-09-12T00:36:15.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.805+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): orig_dests= new_dests= 2024-09-12T00:36:15.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.805+0000 7fb91f6479c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23]): potential dests added=[] removed=[] 2024-09-12T00:36:15.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.809+0000 7fb91f6479c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:15.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.813+0000 7fb7d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:15.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.817+0000 7fb91f6479c0 20 remove_watcher() i=0 2024-09-12T00:36:15.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.817+0000 7fb91f6479c0 2 removed watcher, disabling cache 2024-09-12T00:36:15.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.821+0000 7fb91f6479c0 20 remove_watcher() i=1 2024-09-12T00:36:15.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.825+0000 7fb91f6479c0 20 remove_watcher() i=2 2024-09-12T00:36:15.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.825+0000 7fb91f6479c0 20 remove_watcher() i=3 2024-09-12T00:36:15.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.829+0000 7fb91f6479c0 20 remove_watcher() i=4 2024-09-12T00:36:15.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.829+0000 7fb91f6479c0 20 remove_watcher() i=5 2024-09-12T00:36:15.824 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.829+0000 7fb91f6479c0 20 remove_watcher() i=6 2024-09-12T00:36:15.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.833+0000 7fb91f6479c0 20 remove_watcher() i=7 2024-09-12T00:36:15.842 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:36:15.870 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:15.870 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:15.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.921+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.925+0000 7f81b39929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.925+0000 7f81b39929c0 20 realm 2024-09-12T00:36:15.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.925+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.925+0000 7f81b39929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.925+0000 7f81b39929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:15.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.925+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.925+0000 7f81b39929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.925+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.925+0000 7f81b39929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:15.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.925+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.929+0000 7f81b39929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:15.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.929+0000 7f81b39929c0 20 searching for the correct realm 2024-09-12T00:36:15.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.929+0000 7f81b1498640 0 -- 172.21.15.102:0/3240821239 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x5650055c6140 msgr2=0x5650055c8600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:15.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:15.933+0000 7f81b1498640 0 -- 172.21.15.102:0/3240821239 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x7f81ac0d0070 msgr2=0x7f81ac106040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:16.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:16.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:16.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:16.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:16.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:16.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:16.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:16.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.157+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:16.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 zone default found 2024-09-12T00:36:16.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 4 Realm: () 2024-09-12T00:36:16.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:16.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:16.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:16.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 zonegroup default 2024-09-12T00:36:16.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 started sync module instance, tier type = 2024-09-12T00:36:16.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.161+0000 7f81b39929c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.185+0000 7f81b39929c0 20 add_watcher() i=0 2024-09-12T00:36:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.185+0000 7f81b39929c0 20 add_watcher() i=1 2024-09-12T00:36:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.185+0000 7f81b39929c0 20 add_watcher() i=2 2024-09-12T00:36:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.185+0000 7f81b39929c0 20 add_watcher() i=3 2024-09-12T00:36:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.185+0000 7f81b39929c0 20 add_watcher() i=4 2024-09-12T00:36:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.185+0000 7f81b39929c0 20 add_watcher() i=5 2024-09-12T00:36:16.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.185+0000 7f81b39929c0 20 add_watcher() i=6 2024-09-12T00:36:16.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.185+0000 7f81b39929c0 20 add_watcher() i=7 2024-09-12T00:36:16.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.185+0000 7f81b39929c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:16.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.189+0000 7f8063fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:16.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:16.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:16.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 5 note: GC not initialized 2024-09-12T00:36:16.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f8062fe5640 20 reqs_thread_entry: start 2024-09-12T00:36:16.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:16.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 20 Filter name: none 2024-09-12T00:36:16.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f8060fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:16.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:16.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:16.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:16.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.193+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.197+0000 7f81b39929c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:16.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.197+0000 7f81b39929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.197+0000 7f81b39929c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:16.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.197+0000 7f81b39929c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:16.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.197+0000 7f8063fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:16.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.205+0000 7f81b39929c0 20 remove_watcher() i=0 2024-09-12T00:36:16.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.205+0000 7f81b39929c0 2 removed watcher, disabling cache 2024-09-12T00:36:16.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.205+0000 7f81b39929c0 20 remove_watcher() i=1 2024-09-12T00:36:16.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.209+0000 7f81b39929c0 20 remove_watcher() i=2 2024-09-12T00:36:16.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.209+0000 7f81b39929c0 20 remove_watcher() i=3 2024-09-12T00:36:16.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.213+0000 7f81b39929c0 20 remove_watcher() i=4 2024-09-12T00:36:16.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.213+0000 7f81b39929c0 20 remove_watcher() i=5 2024-09-12T00:36:16.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.217+0000 7f81b39929c0 20 remove_watcher() i=6 2024-09-12T00:36:16.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:16.217+0000 7f81b39929c0 20 remove_watcher() i=7 2024-09-12T00:36:16.227 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:16.227 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:36:16.227 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-set-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:36:16.227 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:16.228 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:16.228 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:16.254 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:16.254 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:16.794 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:16.794 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:17.172 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:36:17.172 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:17.174 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:17.174 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:17.309 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:17.309 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:17.396 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:17.397 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:17.492 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:17.492 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:17.592 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:17.592 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:17.694 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:17.694 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:17.794 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:17.794 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:17.889 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:17.890 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:17.989 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:17.989 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:18.089 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:18.089 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:18.188 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:18.188 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:18.291 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:18.291 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:18.393 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:18.393 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:18.495 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:18.495 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:18.595 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:18.595 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:18.698 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:18.698 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:18.801 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:18.801 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:18.897 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:18.897 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:19.009 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:19.009 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:19.104 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:19.104 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:19.202 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:19.203 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:19.296 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:19.296 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:19.395 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:36:19.428 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:19.429 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:19.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.481+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.481+0000 7f60759679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:19.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.481+0000 7f60759679c0 20 realm 2024-09-12T00:36:19.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.481+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.481+0000 7f60759679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:19.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.481+0000 7f60759679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:19.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.481+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.481+0000 7f60759679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:19.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.481+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.485+0000 7f60759679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:19.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.485+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.485+0000 7f60759679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:19.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.485+0000 7f60759679c0 20 searching for the correct realm 2024-09-12T00:36:19.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.489+0000 7f6073c6e640 0 -- 172.21.15.102:0/3850858600 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f605c0d1040 msgr2=0x7f605c12e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:19.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.705+0000 7f606ac6c640 0 -- 172.21.15.102:0/3850858600 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f606c05d420 msgr2=0x7f606c0766b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:19.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.921+0000 7f60759679c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:19.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.921+0000 7f60759679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:19.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.921+0000 7f60759679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:19.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.921+0000 7f60759679c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:19.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.921+0000 7f60759679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:19.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.921+0000 7f60759679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:19.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.921+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:19.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:19.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:19.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 zone default found 2024-09-12T00:36:19.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 4 Realm: () 2024-09-12T00:36:19.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:19.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:19.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:19.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 zonegroup default 2024-09-12T00:36:19.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:19.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:19.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.925+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.929+0000 7f60759679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:19.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.929+0000 7f60759679c0 20 started sync module instance, tier type = 2024-09-12T00:36:19.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.929+0000 7f60759679c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:19.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.953+0000 7f60759679c0 20 add_watcher() i=0 2024-09-12T00:36:19.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.953+0000 7f60759679c0 20 add_watcher() i=1 2024-09-12T00:36:19.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.953+0000 7f60759679c0 20 add_watcher() i=2 2024-09-12T00:36:19.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.953+0000 7f60759679c0 20 add_watcher() i=3 2024-09-12T00:36:19.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.953+0000 7f60759679c0 20 add_watcher() i=4 2024-09-12T00:36:19.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.953+0000 7f60759679c0 20 add_watcher() i=5 2024-09-12T00:36:19.947 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.953+0000 7f60759679c0 20 add_watcher() i=6 2024-09-12T00:36:19.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.953+0000 7f60759679c0 20 add_watcher() i=7 2024-09-12T00:36:19.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.953+0000 7f60759679c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:19.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.957+0000 7f5f29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:19.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:19.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:19.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 5 note: GC not initialized 2024-09-12T00:36:19.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f5f28fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:19.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:19.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 20 Filter name: none 2024-09-12T00:36:19.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f5ea27fc640 20 reqs_thread_entry: start 2024-09-12T00:36:19.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:19.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:19.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:19.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.961+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.965+0000 7f60759679c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:19.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.965+0000 7f60759679c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:19.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.965+0000 7f60759679c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:19.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.965+0000 7f60759679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:19.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.969+0000 7f5f29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:19.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.973+0000 7f60759679c0 20 remove_watcher() i=0 2024-09-12T00:36:19.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.973+0000 7f60759679c0 2 removed watcher, disabling cache 2024-09-12T00:36:19.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.973+0000 7f60759679c0 20 remove_watcher() i=1 2024-09-12T00:36:19.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.977+0000 7f60759679c0 20 remove_watcher() i=2 2024-09-12T00:36:19.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.977+0000 7f60759679c0 20 remove_watcher() i=3 2024-09-12T00:36:19.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.981+0000 7f60759679c0 20 remove_watcher() i=4 2024-09-12T00:36:19.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.981+0000 7f60759679c0 20 remove_watcher() i=5 2024-09-12T00:36:19.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.985+0000 7f60759679c0 20 remove_watcher() i=6 2024-09-12T00:36:19.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:19.985+0000 7f60759679c0 20 remove_watcher() i=7 2024-09-12T00:36:19.993 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:19.993 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:36:19.993 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-set-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:19.994 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:19.994 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:36:20.029 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:20.029 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:20.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 20 realm 2024-09-12T00:36:20.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:20.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:20.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.081+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.085+0000 7f7d801a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:20.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.085+0000 7f7d801a59c0 20 searching for the correct realm 2024-09-12T00:36:20.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.089+0000 7f7d7e4ac640 0 -- 172.21.15.102:0/4238859848 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f7d740dd930 msgr2=0x7f7d740ee400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:20.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.305+0000 7f7d7d4aa640 0 -- 172.21.15.102:0/4238859848 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f7d7806eb50 msgr2=0x7f7d7809b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:20.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:20.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:20.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:20.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:20.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:20.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:20.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:20.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:20.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 zone default found 2024-09-12T00:36:20.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 4 Realm: () 2024-09-12T00:36:20.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:20.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:20.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:20.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 zonegroup default 2024-09-12T00:36:20.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.525+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.529+0000 7f7d801a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.529+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.529+0000 7f7d801a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.529+0000 7f7d801a59c0 20 started sync module instance, tier type = 2024-09-12T00:36:20.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.529+0000 7f7d801a59c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:20.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.553+0000 7f7d801a59c0 20 add_watcher() i=0 2024-09-12T00:36:20.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.553+0000 7f7d801a59c0 20 add_watcher() i=1 2024-09-12T00:36:20.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.553+0000 7f7d801a59c0 20 add_watcher() i=2 2024-09-12T00:36:20.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.553+0000 7f7d801a59c0 20 add_watcher() i=3 2024-09-12T00:36:20.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.553+0000 7f7d801a59c0 20 add_watcher() i=4 2024-09-12T00:36:20.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.553+0000 7f7d801a59c0 20 add_watcher() i=5 2024-09-12T00:36:20.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.553+0000 7f7d801a59c0 20 add_watcher() i=6 2024-09-12T00:36:20.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.553+0000 7f7d801a59c0 20 add_watcher() i=7 2024-09-12T00:36:20.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.553+0000 7f7d801a59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:20.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.557+0000 7f7c2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:20.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.557+0000 7f7d801a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:20.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.557+0000 7f7d801a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:20.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.557+0000 7f7d801a59c0 5 note: GC not initialized 2024-09-12T00:36:20.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7c2e7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:20.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:20.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 20 Filter name: none 2024-09-12T00:36:20.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7b9ffff640 20 reqs_thread_entry: start 2024-09-12T00:36:20.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:36:20.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:20.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:36:20.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:36:20.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 : miss 2024-09-12T00:36:20.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:20.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 info.flags=0x17 2024-09-12T00:36:20.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 to cache LRU end 2024-09-12T00:36:20.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:20.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.561+0000 7f7d801a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 2024-09-12T00:36:20.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.569+0000 7f7d801a59c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:36:20.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.573+0000 7f7d801a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 info.flags=0x17 2024-09-12T00:36:20.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.573+0000 7f7d801a59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 to cache LRU end 2024-09-12T00:36:20.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.573+0000 7f7d801a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.573+0000 7f7d801a59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24, ofs0, ns] 2024-09-12T00:36:20.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.573+0000 7f7c60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398894 cookie 94435049672080 notifier 6182 bl.length()=1009 2024-09-12T00:36:20.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.573+0000 7f7c60ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 info.flags=0x17 2024-09-12T00:36:20.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.573+0000 7f7c60ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 to cache LRU end 2024-09-12T00:36:20.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.573+0000 7f7c60ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.577+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): orig_sources= new_sources= 2024-09-12T00:36:20.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.577+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): potential sources added=[] removed=[] 2024-09-12T00:36:20.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.577+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): orig_dests= new_dests= 2024-09-12T00:36:20.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.577+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): potential dests added=[] removed=[] 2024-09-12T00:36:20.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.0 2024-09-12T00:36:20.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.0 2024-09-12T00:36:20.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.1 2024-09-12T00:36:20.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.1 2024-09-12T00:36:20.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.2 2024-09-12T00:36:20.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.2 2024-09-12T00:36:20.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.3 2024-09-12T00:36:20.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.3 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.4 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.4 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.5 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.5 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.6 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.6 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.7 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.7 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.8 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.8 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.9 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.9 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.10 2024-09-12T00:36:20.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.10 2024-09-12T00:36:20.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.11 2024-09-12T00:36:20.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1.11 2024-09-12T00:36:20.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.0 2024-09-12T00:36:20.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1 2024-09-12T00:36:20.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.2 2024-09-12T00:36:20.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.589+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.3 2024-09-12T00:36:20.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.593+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.4 2024-09-12T00:36:20.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.593+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.5 2024-09-12T00:36:20.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.593+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.6 2024-09-12T00:36:20.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.597+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.7 2024-09-12T00:36:20.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.597+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.8 2024-09-12T00:36:20.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.597+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.9 2024-09-12T00:36:20.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.597+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.10 2024-09-12T00:36:20.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.605+0000 7f7d801a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:20.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.605+0000 7f7d801a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 2024-09-12T00:36:20.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.609+0000 7f7d801a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 info.flags=0x17 2024-09-12T00:36:20.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.609+0000 7f7d801a59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 to cache LRU end 2024-09-12T00:36:20.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.609+0000 7f7d801a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.609+0000 7f7d801a59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24, ofs0, ns] 2024-09-12T00:36:20.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.609+0000 7f7c617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398895 cookie 94435049672080 notifier 6182 bl.length()=1009 2024-09-12T00:36:20.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.609+0000 7f7c617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 info.flags=0x17 2024-09-12T00:36:20.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.609+0000 7f7c617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 to cache LRU end 2024-09-12T00:36:20.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.609+0000 7f7c617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.613+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): orig_sources= new_sources= 2024-09-12T00:36:20.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.613+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): potential sources added=[] removed=[] 2024-09-12T00:36:20.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.613+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): orig_dests= new_dests= 2024-09-12T00:36:20.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.613+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): potential dests added=[] removed=[] 2024-09-12T00:36:20.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.617+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.0 2024-09-12T00:36:20.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.617+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.1 2024-09-12T00:36:20.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.617+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.2 2024-09-12T00:36:20.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.621+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.3 2024-09-12T00:36:20.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.621+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.4 2024-09-12T00:36:20.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.621+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.5 2024-09-12T00:36:20.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.621+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.6 2024-09-12T00:36:20.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.621+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.7 2024-09-12T00:36:20.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.625+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.8 2024-09-12T00:36:20.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.625+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.9 2024-09-12T00:36:20.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.625+0000 7f7d801a59c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24.10 2024-09-12T00:36:20.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.625+0000 7f7d801a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:20.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.625+0000 7f7d801a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 2024-09-12T00:36:20.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.629+0000 7f7d801a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 info.flags=0x17 2024-09-12T00:36:20.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.629+0000 7f7d801a59c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 to cache LRU end 2024-09-12T00:36:20.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.629+0000 7f7d801a59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.629+0000 7f7d801a59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24, ofs0, ns] 2024-09-12T00:36:20.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.629+0000 7f7c60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398896 cookie 94435049672080 notifier 6182 bl.length()=977 2024-09-12T00:36:20.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.629+0000 7f7c60ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 info.flags=0x17 2024-09-12T00:36:20.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.629+0000 7f7c60ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 to cache LRU end 2024-09-12T00:36:20.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.629+0000 7f7c60ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.633+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): orig_sources= new_sources= 2024-09-12T00:36:20.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.633+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): potential sources added=[] removed=[] 2024-09-12T00:36:20.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.633+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): orig_dests= new_dests= 2024-09-12T00:36:20.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.633+0000 7f7d801a59c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24]): potential dests added=[] removed=[] 2024-09-12T00:36:20.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.637+0000 7f7d801a59c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:20.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.641+0000 7f7c2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:20.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.645+0000 7f7d801a59c0 20 remove_watcher() i=0 2024-09-12T00:36:20.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.645+0000 7f7d801a59c0 2 removed watcher, disabling cache 2024-09-12T00:36:20.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.649+0000 7f7d801a59c0 20 remove_watcher() i=1 2024-09-12T00:36:20.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.653+0000 7f7d801a59c0 20 remove_watcher() i=2 2024-09-12T00:36:20.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.653+0000 7f7d801a59c0 20 remove_watcher() i=3 2024-09-12T00:36:20.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.657+0000 7f7d801a59c0 20 remove_watcher() i=4 2024-09-12T00:36:20.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.657+0000 7f7d801a59c0 20 remove_watcher() i=5 2024-09-12T00:36:20.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.661+0000 7f7d801a59c0 20 remove_watcher() i=6 2024-09-12T00:36:20.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.661+0000 7f7d801a59c0 20 remove_watcher() i=7 2024-09-12T00:36:20.671 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:36:20.701 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:20.701 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:20.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.753+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.753+0000 7f5fc0a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.753+0000 7f5fc0a419c0 20 realm 2024-09-12T00:36:20.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.753+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.753+0000 7f5fc0a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.753+0000 7f5fc0a419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:20.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.753+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.753+0000 7f5fc0a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.753+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.757+0000 7f5fc0a419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:20.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.757+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.757+0000 7f5fc0a419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:20.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.757+0000 7f5fc0a419c0 20 searching for the correct realm 2024-09-12T00:36:20.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.761+0000 7f5fbed48640 0 -- 172.21.15.102:0/3108348071 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f5fb4127b30 msgr2=0x7f5fb411bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:20.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.769+0000 7f5fbdd46640 0 -- 172.21.15.102:0/3108348071 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f5fb8004050 msgr2=0x7f5fb808c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:20.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:20.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:20.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:20.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:20.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:20.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:20.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:20.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:20.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 zone default found 2024-09-12T00:36:20.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 4 Realm: () 2024-09-12T00:36:20.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:20.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:20.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:20.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 zonegroup default 2024-09-12T00:36:20.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.989+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.993+0000 7f5fc0a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.993+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.993+0000 7f5fc0a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.993+0000 7f5fc0a419c0 20 started sync module instance, tier type = 2024-09-12T00:36:20.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:20.993+0000 7f5fc0a419c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:21.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.017+0000 7f5fc0a419c0 20 add_watcher() i=0 2024-09-12T00:36:21.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.017+0000 7f5fc0a419c0 20 add_watcher() i=1 2024-09-12T00:36:21.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.017+0000 7f5fc0a419c0 20 add_watcher() i=2 2024-09-12T00:36:21.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.017+0000 7f5fc0a419c0 20 add_watcher() i=3 2024-09-12T00:36:21.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.017+0000 7f5fc0a419c0 20 add_watcher() i=4 2024-09-12T00:36:21.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.017+0000 7f5fc0a419c0 20 add_watcher() i=5 2024-09-12T00:36:21.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.017+0000 7f5fc0a419c0 20 add_watcher() i=6 2024-09-12T00:36:21.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.017+0000 7f5fc0a419c0 20 add_watcher() i=7 2024-09-12T00:36:21.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.017+0000 7f5fc0a419c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:21.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.021+0000 7f5e74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:21.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:21.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:21.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 5 note: GC not initialized 2024-09-12T00:36:21.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5def7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:21.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:21.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 20 Filter name: none 2024-09-12T00:36:21.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5ded7fa640 20 reqs_thread_entry: start 2024-09-12T00:36:21.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:21.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:21.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:21.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.025+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.029+0000 7f5fc0a419c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:21.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.029+0000 7f5fc0a419c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.029+0000 7f5fc0a419c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:21.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.029+0000 7f5fc0a419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:21.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.033+0000 7f5e74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:21.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.037+0000 7f5fc0a419c0 20 remove_watcher() i=0 2024-09-12T00:36:21.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.037+0000 7f5fc0a419c0 2 removed watcher, disabling cache 2024-09-12T00:36:21.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.037+0000 7f5fc0a419c0 20 remove_watcher() i=1 2024-09-12T00:36:21.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.041+0000 7f5fc0a419c0 20 remove_watcher() i=2 2024-09-12T00:36:21.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.045+0000 7f5fc0a419c0 20 remove_watcher() i=3 2024-09-12T00:36:21.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.045+0000 7f5fc0a419c0 20 remove_watcher() i=4 2024-09-12T00:36:21.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.049+0000 7f5fc0a419c0 20 remove_watcher() i=5 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.049+0000 7f5fc0a419c0 20 remove_watcher() i=6 2024-09-12T00:36:21.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:21.049+0000 7f5fc0a419c0 20 remove_watcher() i=7 2024-09-12T00:36:21.059 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:21.059 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:36:21.059 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-set-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:36:21.059 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:21.060 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:21.060 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:21.092 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:21.092 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:21.701 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:21.701 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:22.074 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:36:22.074 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:22.077 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.077 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:22.213 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.214 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:22.302 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.302 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:22.408 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.408 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:22.510 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.511 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:22.602 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.602 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:22.683 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.683 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:22.777 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.777 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:22.980 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.980 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:23.068 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.068 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:23.172 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.172 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:23.280 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:23.387 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.387 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:23.480 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.480 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:23.578 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.578 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:23.678 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.679 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:23.776 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.776 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:23.867 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.867 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:23.987 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.988 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:24.090 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.090 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:24.186 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.187 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:24.282 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:36:24.315 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:24.315 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:24.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.369+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.369+0000 7f59b656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.369+0000 7f59b656b9c0 20 realm 2024-09-12T00:36:24.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.369+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.369+0000 7f59b656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.369+0000 7f59b656b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:24.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.369+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.369+0000 7f59b656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.369+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.373+0000 7f59b656b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.373+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.373+0000 7f59b656b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:24.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.373+0000 7f59b656b9c0 20 searching for the correct realm 2024-09-12T00:36:24.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.377+0000 7f59b4872640 0 -- 172.21.15.102:0/4226807386 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f59a8039070 msgr2=0x7f59a8048920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:24.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.593+0000 7f59b3870640 0 -- 172.21.15.102:0/4226807386 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f59ac03b630 msgr2=0x7f59ac079870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.809+0000 7f59b656b9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.809+0000 7f59b656b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.809+0000 7f59b656b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.809+0000 7f59b656b9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.809+0000 7f59b656b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.809+0000 7f59b656b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.809+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.809+0000 7f59b656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.809+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 zone default found 2024-09-12T00:36:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 4 Realm: () 2024-09-12T00:36:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 zonegroup default 2024-09-12T00:36:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 started sync module instance, tier type = 2024-09-12T00:36:24.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.813+0000 7f59b656b9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:24.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.837+0000 7f59b656b9c0 20 add_watcher() i=0 2024-09-12T00:36:24.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.837+0000 7f59b656b9c0 20 add_watcher() i=1 2024-09-12T00:36:24.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.837+0000 7f59b656b9c0 20 add_watcher() i=2 2024-09-12T00:36:24.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.837+0000 7f59b656b9c0 20 add_watcher() i=3 2024-09-12T00:36:24.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.837+0000 7f59b656b9c0 20 add_watcher() i=4 2024-09-12T00:36:24.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.837+0000 7f59b656b9c0 20 add_watcher() i=5 2024-09-12T00:36:24.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.837+0000 7f59b656b9c0 20 add_watcher() i=6 2024-09-12T00:36:24.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.841+0000 7f59b656b9c0 20 add_watcher() i=7 2024-09-12T00:36:24.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.841+0000 7f59b656b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:24.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.845+0000 7f586afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:24.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.845+0000 7f59b656b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:24.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.845+0000 7f59b656b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:24.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.845+0000 7f59b656b9c0 5 note: GC not initialized 2024-09-12T00:36:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.845+0000 7f5869fdb640 20 reqs_thread_entry: start 2024-09-12T00:36:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.845+0000 7f59b656b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.849+0000 7f59b656b9c0 20 Filter name: none 2024-09-12T00:36:24.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.849+0000 7f57db7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:24.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.849+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.849+0000 7f59b656b9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:24.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.849+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.849+0000 7f59b656b9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:24.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.849+0000 7f59b656b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:24.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.849+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.853+0000 7f59b656b9c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:24.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.853+0000 7f59b656b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.853+0000 7f59b656b9c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:24.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.853+0000 7f59b656b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:24.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.857+0000 7f586afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:24.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.861+0000 7f59b656b9c0 20 remove_watcher() i=0 2024-09-12T00:36:24.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.861+0000 7f59b656b9c0 2 removed watcher, disabling cache 2024-09-12T00:36:24.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.865+0000 7f59b656b9c0 20 remove_watcher() i=1 2024-09-12T00:36:24.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.865+0000 7f59b656b9c0 20 remove_watcher() i=2 2024-09-12T00:36:24.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.869+0000 7f59b656b9c0 20 remove_watcher() i=3 2024-09-12T00:36:24.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.869+0000 7f59b656b9c0 20 remove_watcher() i=4 2024-09-12T00:36:24.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.869+0000 7f59b656b9c0 20 remove_watcher() i=5 2024-09-12T00:36:24.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.873+0000 7f59b656b9c0 20 remove_watcher() i=6 2024-09-12T00:36:24.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.873+0000 7f59b656b9c0 20 remove_watcher() i=7 2024-09-12T00:36:24.882 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:24.883 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:36:24.883 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-set-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:24.883 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:24.883 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:36:24.920 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:24.920 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:24.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.969+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 realm 2024-09-12T00:36:24.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.973+0000 7fc66fe929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:24.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.977+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:24.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.977+0000 7fc66fe929c0 20 searching for the correct realm 2024-09-12T00:36:24.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.981+0000 7fc66e199640 0 -- 172.21.15.102:0/3714140184 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fc664036030 msgr2=0x7fc664008930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:24.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:24.989+0000 7fc66d197640 0 -- 172.21.15.102:0/3714140184 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fc66805fb90 msgr2=0x7fc668089a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:25.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:25.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:25.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:25.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:25.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:25.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:25.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 zone default found 2024-09-12T00:36:25.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 4 Realm: () 2024-09-12T00:36:25.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:25.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:25.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:25.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 zonegroup default 2024-09-12T00:36:25.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.213+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.213+0000 7fc66fe929c0 20 started sync module instance, tier type = 2024-09-12T00:36:25.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.213+0000 7fc66fe929c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:25.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=0 2024-09-12T00:36:25.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=1 2024-09-12T00:36:25.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=2 2024-09-12T00:36:25.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=3 2024-09-12T00:36:25.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=4 2024-09-12T00:36:25.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=5 2024-09-12T00:36:25.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=6 2024-09-12T00:36:25.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.237+0000 7fc66fe929c0 20 add_watcher() i=7 2024-09-12T00:36:25.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.237+0000 7fc66fe929c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:25.235 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.241+0000 7fc523fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:25.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:25.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 note: GC not initialized 2024-09-12T00:36:25.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.241+0000 7fc522fe5640 20 reqs_thread_entry: start 2024-09-12T00:36:25.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:25.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 Filter name: none 2024-09-12T00:36:25.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.241+0000 7fc520fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:25.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.241+0000 7fc66fe929c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:36:25.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:25.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:36:25.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:36:25.238 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 : miss 2024-09-12T00:36:25.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:25.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:25.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:25.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:25.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:25.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 2024-09-12T00:36:25.248 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc66fe929c0 time 2024-09-12T00:36:25.257095+0000 2024-09-12T00:36:25.248 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:25.249 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc67376c2eb] 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc67376c49f] 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b85e274cc1] 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422078) [0x55b85ecd2078] 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85e289ced] 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc6725d2d90] 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fc66fe929c0 thread_name:radosgw-admin 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.257+0000 7fc66fe929c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc66fe929c0 time 2024-09-12T00:36:25.257095+0000 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc67376c2eb] 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc67376c49f] 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b85e274cc1] 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422078) [0x55b85ecd2078] 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85e289ced] 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc6725d2d90] 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:36:25.251 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.264 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc6725eb520] 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc67376c345] 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc67376c49f] 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b85e274cc1] 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422078) [0x55b85ecd2078] 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85e289ced] 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:36:25.265 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc6725d2d90] 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.257+0000 7fc66fe929c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fc66fe929c0 thread_name:radosgw-admin 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc6725eb520] 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc67376c345] 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc67376c49f] 2024-09-12T00:36:25.266 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b85e274cc1] 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422078) [0x55b85ecd2078] 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85e289ced] 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc6725d2d90] 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): get_auth_request con 0x55b85ff65a30 auth_method 0 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.267 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_done global_id 6218 payload 274 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient: _finish_hunting 0 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:36:24.949+0000 7fc66d998640 1 monclient: found mon.noname-c 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.268 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: dump: 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: _finish_auth 0 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: _check_auth_tickets 2024-09-12T00:36:25.270 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:25.270 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.270 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:25.270 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: dump: 2024-09-12T00:36:25.270 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.270 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.270 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.270 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.270 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 monclient: authenticate success, global_id 6218 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 4 set_mon_vals no callback set 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: shutdown 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) unregister_commands rotate-key 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: build_initial_monmap 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:25.271 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: monmap: 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding auth protocol: cephx 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding auth protocol: cephx 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding auth protocol: cephx 2024-09-12T00:36:25.272 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.273 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 1 librados: starting msgr at 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 1 librados: starting objecter 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command objecter_requests hook 0x55b8600243f0 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 1 librados: setting wanted keys 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 1 librados: calling monclient init 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: init 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding auth protocol: cephx 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding auth protocol: cephx 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding auth protocol: cephx 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.274 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command rotate-key hook 0x55b86001fb08 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:25.275 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-a con 0x55b85fed02b0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-b con 0x55b85fedbba0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-c con 0x55b85ff65a30 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): authenticate will time out at 2573.451590s 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): get_auth_request con 0x55b85fed02b0 auth_method 0 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.276 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): get_auth_request con 0x55b85ff65a30 auth_method 0 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_done global_id 6221 payload 824 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:36:24.953+0000 7fc66e199640 10 monclient: _finish_hunting 0 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:36:24.953+0000 7fc66e199640 1 monclient: found mon.noname-c 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:36:24.953+0000 7fc66e199640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.277 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: dump: 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: _finish_auth 0 2024-09-12T00:36:25.278 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: _check_auth_tickets 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: dump: 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.279 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:36:24.953+0000 7fc55be07640 4 set_mon_vals no callback set 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 5 monclient: authenticate success, global_id 6221 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 1 librados: init done 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:36:24.953+0000 7fc55a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:36:24.953+0000 7fc55a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:36:24.953+0000 7fc55a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.280 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:36:24.953+0000 7fc66d998640 10 monclient: get_auth_request con 0x7fc554070b10 auth_method 0 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:36:24.953+0000 7fc66d197640 10 monclient: get_auth_request con 0x55b86004d250 auth_method 0 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:36:24.957+0000 7fc66d998640 10 monclient: get_auth_request con 0x55b860069da0 auth_method 0 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:36:24.957+0000 7fc66d197640 10 monclient: get_auth_request con 0x55b86006e190 auth_method 0 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient: get_auth_request con 0x55b86006d620 auth_method 0 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: build_initial_monmap 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: monmap: 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.281 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding auth protocol: cephx 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding auth protocol: cephx 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding auth protocol: cephx 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.282 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b860079d40 EEXIST 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: init 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding auth protocol: cephx 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding auth protocol: cephx 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding auth protocol: cephx 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.283 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command rotate-key cmddesc rotate-key hook 0x55b860075350 EEXIST 2024-09-12T00:36:25.284 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-a con 0x55b8600a37e0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-c con 0x55b86009e240 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-b con 0x55b86009c2c0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): authenticate will time out at 2573.462242s 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): get_auth_request con 0x55b86009e240 auth_method 0 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.285 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): get_auth_request con 0x55b8600a37e0 auth_method 0 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:36:24.961+0000 7fc66d998640 10 monclient(hunting): get_auth_request con 0x55b86009c2c0 auth_method 0 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:36:24.961+0000 7fc66d998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:36:24.961+0000 7fc66d998640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.286 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:36:24.961+0000 7fc66d998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): handle_auth_done global_id 6224 payload 824 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient: _finish_hunting 0 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:36:24.961+0000 7fc66e199640 1 monclient: found mon.noname-c 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: dump: 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.287 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: _finish_auth 0 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: _check_auth_tickets 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: dump: 2024-09-12T00:36:25.288 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:36:24.961+0000 7fc66e99a640 4 set_mon_vals no callback set 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 monclient: authenticate success, global_id 6224 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.289 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:36:24.965+0000 7fc5537fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:36:24.965+0000 7fc5537fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:36:24.965+0000 7fc5537fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: get_monmap_and_config 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: build_initial_monmap 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: monmap: 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient: get_auth_request con 0x7fc5480709f0 auth_method 0 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding auth protocol: cephx 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding auth protocol: cephx 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding auth protocol: cephx 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.291 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: init 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding auth protocol: cephx 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding auth protocol: cephx 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding auth protocol: cephx 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.292 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd4de51908 EEXIST 2024-09-12T00:36:25.293 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-c con 0x55b8600f2dd0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-a con 0x55b8600c2940 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-b con 0x55b8600e3850 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): authenticate will time out at 2573.466906s 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): get_auth_request con 0x55b8600c2940 auth_method 0 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.294 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): get_auth_request con 0x55b8600f2dd0 auth_method 0 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): handle_auth_done global_id 6609 payload 274 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient: _finish_hunting 0 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:36:24.965+0000 7fc66e199640 1 monclient: found mon.noname-a 2024-09-12T00:36:25.295 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: dump: 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.296 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: _finish_auth 0 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: _check_auth_tickets 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: dump: 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.297 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 monclient: authenticate success, global_id 6609 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 4 set_mon_vals no callback set 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: shutdown 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: build_initial_monmap 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: monmap: 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:36:25.298 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding auth protocol: cephx 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding auth protocol: cephx 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding auth protocol: cephx 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.299 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 librados: starting msgr at 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 librados: starting objecter 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b8600e5d00 EEXIST 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 librados: setting wanted keys 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 librados: calling monclient init 2024-09-12T00:36:25.300 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: init 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding auth protocol: cephx 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding auth protocol: cephx 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding auth protocol: cephx 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.301 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command rotate-key cmddesc rotate-key hook 0x55b85feae268 EEXIST 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-c con 0x55b8600c2940 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-a con 0x55b8600e3850 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-b con 0x55b8600f2dd0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.302 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): authenticate will time out at 2573.469448s 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): get_auth_request con 0x55b8600e3850 auth_method 0 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): get_auth_request con 0x55b8600c2940 auth_method 0 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.303 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:36:24.969+0000 7fc66d998640 10 monclient(hunting): get_auth_request con 0x55b8600f2dd0 auth_method 0 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:36:24.969+0000 7fc66d998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:36:24.969+0000 7fc66d998640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:36:24.969+0000 7fc66d998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): handle_auth_done global_id 6612 payload 824 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient: _finish_hunting 0 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:36:24.969+0000 7fc66e199640 1 monclient: found mon.noname-a 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:25.304 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: dump: 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:25.305 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: dump: 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 monclient: authenticate success, global_id 6612 2024-09-12T00:36:25.306 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:36:24.969+0000 7fc5517fa640 4 set_mon_vals no callback set 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 librados: init done 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command cr dump hook 0x55b8600f31c8 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:36:24.973+0000 7fc53f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:36:24.973+0000 7fc53f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:36:24.973+0000 7fc53f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:36:24.973+0000 7fc66d197640 10 monclient: get_auth_request con 0x7fc538070ae0 auth_method 0 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:36:24.973+0000 7fc66d998640 10 monclient: get_auth_request con 0x55b86010bb00 auth_method 0 2024-09-12T00:36:25.307 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 realm 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:36:24.973+0000 7fc66d197640 10 monclient: get_auth_request con 0x55b86010fd30 auth_method 0 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:36:24.977+0000 7fc66e199640 10 monclient: get_auth_request con 0x55b8601135b0 auth_method 0 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:36:24.977+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:36:24.977+0000 7fc66fe929c0 20 searching for the correct realm 2024-09-12T00:36:25.308 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:36:24.977+0000 7fc66d998640 10 monclient: get_auth_request con 0x55b860118370 auth_method 0 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:36:24.977+0000 7fc66d197640 10 monclient: get_auth_request con 0x7fc668011b30 auth_method 0 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:36:24.977+0000 7fc66e199640 10 monclient: get_auth_request con 0x7fc664036030 auth_method 0 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:36:24.981+0000 7fc66e199640 0 -- 172.21.15.102:0/3714140184 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fc664036030 msgr2=0x7fc664008930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:36:24.981+0000 7fc53f7fe640 1 client.6612.objecter ms_handle_reset 0x7fc664036030 session 0x7fc664030040 osd.4 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:36:24.981+0000 7fc53f7fe640 10 monclient: _renew_subs 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:36:24.981+0000 7fc53f7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:36:24.981+0000 7fc66e199640 10 monclient: get_auth_request con 0x7fc538081200 auth_method 0 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:36:24.981+0000 7fc66d998640 10 monclient: get_auth_request con 0x7fc668074000 auth_method 0 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:36:24.989+0000 7fc66d197640 0 -- 172.21.15.102:0/3714140184 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fc66805fb90 msgr2=0x7fc668089a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:36:24.989+0000 7fc66d197640 10 monclient: get_auth_request con 0x7fc66805fb90 auth_method 0 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:36:25.193+0000 7fc66d197640 10 monclient: get_auth_request con 0x7fc66805fb90 auth_method 0 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:25.309 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 zone default found 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 4 Realm: () 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 zonegroup default 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:36:25.213+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:36:25.213+0000 7fc66fe929c0 20 started sync module instance, tier type = 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:36:25.213+0000 7fc66fe929c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=0 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=1 2024-09-12T00:36:25.311 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=2 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=3 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=4 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=5 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=6 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:36:25.237+0000 7fc66fe929c0 20 add_watcher() i=7 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:36:25.237+0000 7fc66fe929c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding auth protocol: cephx 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding auth protocol: cephx 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding auth protocol: cephx 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.312 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:36:25.241+0000 7fc523fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command cache list hook 0x55b8600e2a40 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command cache inspect hook 0x55b8600e2a40 2024-09-12T00:36:25.313 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command cache erase hook 0x55b8600e2a40 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command cache zap hook 0x55b8600e2a40 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 note: GC not initialized 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:36:25.241+0000 7fc522fe5640 20 reqs_thread_entry: start 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command sync trace show hook 0x7fc668076070 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command sync trace history hook 0x7fc668076070 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command sync trace active hook 0x7fc668076070 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command sync trace active_short hook 0x7fc668076070 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 Filter name: none 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:36:25.241+0000 7fc520fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:25.314 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 : miss 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:36:25.257+0000 7fc66fe929c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc66fe929c0 time 2024-09-12T00:36:25.257095+0000 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:25.315 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc67376c2eb] 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc67376c49f] 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b85e274cc1] 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422078) [0x55b85ecd2078] 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85e289ced] 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc6725d2d90] 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:36:25.257+0000 7fc66fe929c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fc66fe929c0 thread_name:radosgw-admin 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.316 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc6725eb520] 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc67376c345] 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc67376c49f] 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b85e274cc1] 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422078) [0x55b85ecd2078] 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85e289ced] 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc6725d2d90] 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:25.317 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:25.318 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:36:25.319 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:25.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:36:25.321 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:25.322 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:25.323 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc520fe1640 / http_manager 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc522fe5640 / http_manager 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc523fe7640 / rgw_dt_lg_renew 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc53f7fe640 / ms_dispatch 2024-09-12T00:36:25.324 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc5517fa640 / io_context_pool 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc5537fe640 / ms_dispatch 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc55a604640 / ms_dispatch 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc55be07640 / io_context_pool 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc66d197640 / msgr-worker-2 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc66d998640 / msgr-worker-1 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc66e199640 / msgr-worker-0 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc66e99a640 / io_context_pool 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc66fe929c0 / radosgw-admin 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.92911.log 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:36:25.325 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): get_auth_request con 0x55b85ff65a30 auth_method 0 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_done global_id 6218 payload 274 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient: _finish_hunting 0 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:36:24.949+0000 7fc66d998640 1 monclient: found mon.noname-c 2024-09-12T00:36:25.326 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: dump: 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.327 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: _finish_auth 0 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: _check_auth_tickets 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:36:24.949+0000 7fc55be07640 10 monclient: dump: 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.328 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 monclient: authenticate success, global_id 6218 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 4 set_mon_vals no callback set 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: shutdown 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) unregister_commands rotate-key 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: build_initial_monmap 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: monmap: 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:36:25.329 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding auth protocol: cephx 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding auth protocol: cephx 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding auth protocol: cephx 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: crc 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b860024d90) adding con mode: secure 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 1 librados: starting msgr at 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 1 librados: starting objecter 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command objecter_requests hook 0x55b8600243f0 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 1 librados: setting wanted keys 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 1 librados: calling monclient init 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: init 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding auth protocol: cephx 2024-09-12T00:36:25.331 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding auth protocol: cephx 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding auth protocol: cephx 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: crc 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 AuthRegistry(0x55b86001f9c0) adding con mode: secure 2024-09-12T00:36:25.332 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command rotate-key hook 0x55b86001fb08 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-a con 0x55b85fed02b0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-b con 0x55b85fedbba0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-c con 0x55b85ff65a30 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:36:24.949+0000 7fc66fe929c0 10 monclient(hunting): authenticate will time out at 2573.451590s 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): get_auth_request con 0x55b85fed02b0 auth_method 0 2024-09-12T00:36:25.333 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): get_auth_request con 0x55b85ff65a30 auth_method 0 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:36:24.949+0000 7fc66d998640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:36:24.949+0000 7fc66e199640 10 monclient(hunting): handle_auth_done global_id 6221 payload 824 2024-09-12T00:36:25.334 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:36:24.953+0000 7fc66e199640 10 monclient: _finish_hunting 0 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:36:24.953+0000 7fc66e199640 1 monclient: found mon.noname-c 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:36:24.953+0000 7fc66e199640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: dump: 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.335 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: _finish_auth 0 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: _check_auth_tickets 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:36:24.953+0000 7fc55a604640 10 monclient: dump: 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.336 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:36:24.953+0000 7fc55be07640 4 set_mon_vals no callback set 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 5 monclient: authenticate success, global_id 6221 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:36:24.953+0000 7fc66fe929c0 1 librados: init done 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:36:24.953+0000 7fc55a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:36:24.953+0000 7fc55a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:36:24.953+0000 7fc55a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.337 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:36:24.953+0000 7fc66d998640 10 monclient: get_auth_request con 0x7fc554070b10 auth_method 0 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:36:24.953+0000 7fc66d197640 10 monclient: get_auth_request con 0x55b86004d250 auth_method 0 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:36:24.957+0000 7fc66d998640 10 monclient: get_auth_request con 0x55b860069da0 auth_method 0 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:36:24.957+0000 7fc66d197640 10 monclient: get_auth_request con 0x55b86006e190 auth_method 0 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient: get_auth_request con 0x55b86006d620 auth_method 0 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: build_initial_monmap 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: monmap: 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:36:25.338 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding auth protocol: cephx 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding auth protocol: cephx 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding auth protocol: cephx 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.339 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: crc 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860076310) adding con mode: secure 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b860079d40 EEXIST 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: init 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding auth protocol: cephx 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding auth protocol: cephx 2024-09-12T00:36:25.340 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding auth protocol: cephx 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: crc 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 AuthRegistry(0x55b860075208) adding con mode: secure 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.341 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command rotate-key cmddesc rotate-key hook 0x55b860075350 EEXIST 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-a con 0x55b8600a37e0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-c con 0x55b86009e240 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-b con 0x55b86009c2c0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient(hunting): authenticate will time out at 2573.462242s 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): get_auth_request con 0x55b86009e240 auth_method 0 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.342 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): get_auth_request con 0x55b8600a37e0 auth_method 0 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:36:24.961+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:36:24.961+0000 7fc66d998640 10 monclient(hunting): get_auth_request con 0x55b86009c2c0 auth_method 0 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:36:24.961+0000 7fc66d998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.343 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:36:24.961+0000 7fc66d998640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:36:24.961+0000 7fc66d998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient(hunting): handle_auth_done global_id 6224 payload 824 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient: _finish_hunting 0 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:36:24.961+0000 7fc66e199640 1 monclient: found mon.noname-c 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:36:24.961+0000 7fc66e199640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: dump: 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.344 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: _finish_auth 0 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: _check_auth_tickets 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:36:24.961+0000 7fc5537fe640 10 monclient: dump: 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.345 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:36:24.961+0000 7fc66e99a640 4 set_mon_vals no callback set 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 5 monclient: authenticate success, global_id 6224 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.346 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:36:24.961+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:36:24.965+0000 7fc5537fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:36:24.965+0000 7fc5537fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:36:24.965+0000 7fc5537fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: get_monmap_and_config 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: build_initial_monmap 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: monmap: 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.347 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient: get_auth_request con 0x7fc5480709f0 auth_method 0 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding auth protocol: cephx 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding auth protocol: cephx 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding auth protocol: cephx 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.348 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: crc 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600be980) adding con mode: secure 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: init 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding auth protocol: cephx 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding auth protocol: cephx 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding auth protocol: cephx 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.349 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: crc 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de517c0) adding con mode: secure 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd4de51908 EEXIST 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-c con 0x55b8600f2dd0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-a con 0x55b8600c2940 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-b con 0x55b8600e3850 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient(hunting): authenticate will time out at 2573.466906s 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): get_auth_request con 0x55b8600c2940 auth_method 0 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.351 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): get_auth_request con 0x55b8600f2dd0 auth_method 0 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:36:24.965+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient(hunting): handle_auth_done global_id 6609 payload 274 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient: _finish_hunting 0 2024-09-12T00:36:25.352 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:36:24.965+0000 7fc66e199640 1 monclient: found mon.noname-a 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:36:24.965+0000 7fc66e199640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: dump: 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.353 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: _finish_auth 0 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: _check_auth_tickets 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:36:24.965+0000 7fc5517fa640 10 monclient: dump: 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.354 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 5 monclient: authenticate success, global_id 6609 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:36:24.965+0000 7fc66fe929c0 4 set_mon_vals no callback set 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: shutdown 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: build_initial_monmap 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: monmap: 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:36:25.355 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding auth protocol: cephx 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding auth protocol: cephx 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding auth protocol: cephx 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.356 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: crc 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b8600e3db0) adding con mode: secure 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 librados: starting msgr at 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 librados: starting objecter 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b8600e5d00 EEXIST 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 librados: setting wanted keys 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 librados: calling monclient init 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: init 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding auth protocol: cephx 2024-09-12T00:36:25.357 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding auth protocol: cephx 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding auth protocol: cephx 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.358 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: crc 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 AuthRegistry(0x55b85feae120) adding con mode: secure 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command rotate-key cmddesc rotate-key hook 0x55b85feae268 EEXIST 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-c con 0x55b8600c2940 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-a con 0x55b8600e3850 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): picked mon.noname-b con 0x55b8600f2dd0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:25.359 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient(hunting): authenticate will time out at 2573.469448s 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): get_auth_request con 0x55b8600e3850 auth_method 0 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): get_auth_request con 0x55b8600c2940 auth_method 0 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.360 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:36:24.969+0000 7fc66d197640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:36:24.969+0000 7fc66d998640 10 monclient(hunting): get_auth_request con 0x55b8600f2dd0 auth_method 0 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:36:24.969+0000 7fc66d998640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:36:24.969+0000 7fc66d998640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:36:24.969+0000 7fc66d998640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient(hunting): handle_auth_done global_id 6612 payload 824 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient: _finish_hunting 0 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:36:24.969+0000 7fc66e199640 1 monclient: found mon.noname-a 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:36:24.969+0000 7fc66e199640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.361 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: dump: 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:25.362 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:36:24.969+0000 7fc53f7fe640 10 monclient: dump: 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 monclient: authenticate success, global_id 6612 2024-09-12T00:36:25.363 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:36:24.969+0000 7fc5517fa640 4 set_mon_vals no callback set 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _renew_subs 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 1 librados: init done 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command cr dump hook 0x55b8600f31c8 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:36:24.969+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:36:24.973+0000 7fc53f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:36:24.973+0000 7fc53f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:36:24.973+0000 7fc53f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:36:24.973+0000 7fc66d197640 10 monclient: get_auth_request con 0x7fc538070ae0 auth_method 0 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:36:24.973+0000 7fc66d998640 10 monclient: get_auth_request con 0x55b86010bb00 auth_method 0 2024-09-12T00:36:25.364 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 realm 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:36:24.973+0000 7fc66d197640 10 monclient: get_auth_request con 0x55b86010fd30 auth_method 0 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:36:24.973+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:36:24.977+0000 7fc66e199640 10 monclient: get_auth_request con 0x55b8601135b0 auth_method 0 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:36:24.977+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:36:24.977+0000 7fc66fe929c0 20 searching for the correct realm 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:36:24.977+0000 7fc66d998640 10 monclient: get_auth_request con 0x55b860118370 auth_method 0 2024-09-12T00:36:25.365 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:36:24.977+0000 7fc66d197640 10 monclient: get_auth_request con 0x7fc668011b30 auth_method 0 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:36:24.977+0000 7fc66e199640 10 monclient: get_auth_request con 0x7fc664036030 auth_method 0 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:36:24.981+0000 7fc66e199640 0 -- 172.21.15.102:0/3714140184 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fc664036030 msgr2=0x7fc664008930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:36:24.981+0000 7fc53f7fe640 1 client.6612.objecter ms_handle_reset 0x7fc664036030 session 0x7fc664030040 osd.4 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:36:24.981+0000 7fc53f7fe640 10 monclient: _renew_subs 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:36:24.981+0000 7fc53f7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:36:24.981+0000 7fc66e199640 10 monclient: get_auth_request con 0x7fc538081200 auth_method 0 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:36:24.981+0000 7fc66d998640 10 monclient: get_auth_request con 0x7fc668074000 auth_method 0 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:36:24.989+0000 7fc66d197640 0 -- 172.21.15.102:0/3714140184 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fc66805fb90 msgr2=0x7fc668089a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:36:24.989+0000 7fc66d197640 10 monclient: get_auth_request con 0x7fc66805fb90 auth_method 0 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:36:25.193+0000 7fc66d197640 10 monclient: get_auth_request con 0x7fc66805fb90 auth_method 0 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:25.366 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:36:25.205+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 zone default found 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 4 Realm: () 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:25.367 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 zonegroup default 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:36:25.209+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:36:25.213+0000 7fc66fe929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:36:25.213+0000 7fc66fe929c0 20 started sync module instance, tier type = 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:36:25.213+0000 7fc66fe929c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=0 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=1 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=2 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=3 2024-09-12T00:36:25.368 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=4 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=5 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:36:25.233+0000 7fc66fe929c0 20 add_watcher() i=6 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:36:25.237+0000 7fc66fe929c0 20 add_watcher() i=7 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:36:25.237+0000 7fc66fe929c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding auth protocol: cephx 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding auth protocol: cephx 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding auth protocol: cephx 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.369 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: crc 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 AuthRegistry(0x7ffd4de51ca0) adding con mode: secure 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:36:25.241+0000 7fc523fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command cache list hook 0x55b8600e2a40 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command cache inspect hook 0x55b8600e2a40 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command cache erase hook 0x55b8600e2a40 2024-09-12T00:36:25.370 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command cache zap hook 0x55b8600e2a40 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 note: GC not initialized 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:36:25.241+0000 7fc522fe5640 20 reqs_thread_entry: start 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command sync trace show hook 0x7fc668076070 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command sync trace history hook 0x7fc668076070 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command sync trace active hook 0x7fc668076070 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 5 asok(0x55b85fe152b0) register_command sync trace active_short hook 0x7fc668076070 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 Filter name: none 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:36:25.241+0000 7fc520fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:36:25.241+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:36:25.371 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 : miss 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:36:25.245+0000 7fc66fe929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:36:25.257+0000 7fc66fe929c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc66fe929c0 time 2024-09-12T00:36:25.257095+0000 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc67376c2eb] 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc67376c49f] 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b85e274cc1] 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422078) [0x55b85ecd2078] 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85e289ced] 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc6725d2d90] 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:36:25.257+0000 7fc66fe929c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fc66fe929c0 thread_name:radosgw-admin 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:25.373 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc6725eb520] 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc67376c345] 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc67376c49f] 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b85e274cc1] 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422078) [0x55b85ecd2078] 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85e289ced] 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc6725d2d90] 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.374 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:36:25.375 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:36:25.376 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:25.377 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:36:25.378 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:25.379 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:36:25.380 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc520fe1640 / http_manager 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc522fe5640 / http_manager 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc523fe7640 / rgw_dt_lg_renew 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc53f7fe640 / ms_dispatch 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc5517fa640 / io_context_pool 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc5537fe640 / ms_dispatch 2024-09-12T00:36:25.381 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc55a604640 / ms_dispatch 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc55be07640 / io_context_pool 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc66d197640 / msgr-worker-2 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc66d998640 / msgr-worker-1 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc66e199640 / msgr-worker-0 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc66e99a640 / io_context_pool 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr: 7fc66fe929c0 / radosgw-admin 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:36:25.259592Z_94942d00-b20c-4a5b-be9b-6cbcf76dda18/log 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:36:25.382 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:36:25.384 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:25.384 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:25.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.341+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.345+0000 7f2c0e9049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.345+0000 7f2c0e9049c0 20 realm 2024-09-12T00:36:25.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.345+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.345+0000 7f2c0e9049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.345+0000 7f2c0e9049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:25.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.345+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.345+0000 7f2c0e9049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.345+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.345+0000 7f2c0e9049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.345+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.349+0000 7f2c0e9049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:25.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.349+0000 7f2c0e9049c0 20 searching for the correct realm 2024-09-12T00:36:25.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.349+0000 7f2c0cc0b640 0 -- 172.21.15.102:0/1578624250 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f2c00114c20 msgr2=0x7f2c000f6da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.357+0000 7f2c0bc09640 0 -- 172.21.15.102:0/1578624250 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f2c0406a120 msgr2=0x7f2c04084900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:25.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:25.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:25.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:25.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:25.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:25.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.573+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:25.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 zone default found 2024-09-12T00:36:25.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 4 Realm: () 2024-09-12T00:36:25.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:25.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:25.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:25.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 zonegroup default 2024-09-12T00:36:25.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 started sync module instance, tier type = 2024-09-12T00:36:25.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.577+0000 7f2c0e9049c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:25.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.601+0000 7f2c0e9049c0 20 add_watcher() i=0 2024-09-12T00:36:25.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.601+0000 7f2c0e9049c0 20 add_watcher() i=1 2024-09-12T00:36:25.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.601+0000 7f2c0e9049c0 20 add_watcher() i=2 2024-09-12T00:36:25.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.601+0000 7f2c0e9049c0 20 add_watcher() i=3 2024-09-12T00:36:25.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.601+0000 7f2c0e9049c0 20 add_watcher() i=4 2024-09-12T00:36:25.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.601+0000 7f2c0e9049c0 20 add_watcher() i=5 2024-09-12T00:36:25.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.601+0000 7f2c0e9049c0 20 add_watcher() i=6 2024-09-12T00:36:25.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.605+0000 7f2c0e9049c0 20 add_watcher() i=7 2024-09-12T00:36:25.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.605+0000 7f2c0e9049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:25.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.609+0000 7f2ac2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.609+0000 7f2c0e9049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:25.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.609+0000 7f2c0e9049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:25.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.609+0000 7f2c0e9049c0 5 note: GC not initialized 2024-09-12T00:36:25.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.609+0000 7f2ac1fdb640 20 reqs_thread_entry: start 2024-09-12T00:36:25.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.613+0000 7f2c0e9049c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:25.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.613+0000 7f2c0e9049c0 20 Filter name: none 2024-09-12T00:36:25.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.613+0000 7f2a337fe640 20 reqs_thread_entry: start 2024-09-12T00:36:25.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.613+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.613+0000 7f2c0e9049c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:25.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.613+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.613+0000 7f2c0e9049c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:25.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.613+0000 7f2c0e9049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:25.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.613+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.617+0000 7f2c0e9049c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:25.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.617+0000 7f2c0e9049c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.617+0000 7f2c0e9049c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:25.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.617+0000 7f2c0e9049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:25.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.621+0000 7f2ac2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.625+0000 7f2c0e9049c0 20 remove_watcher() i=0 2024-09-12T00:36:25.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.625+0000 7f2c0e9049c0 2 removed watcher, disabling cache 2024-09-12T00:36:25.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.625+0000 7f2c0e9049c0 20 remove_watcher() i=1 2024-09-12T00:36:25.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.629+0000 7f2c0e9049c0 20 remove_watcher() i=2 2024-09-12T00:36:25.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.633+0000 7f2c0e9049c0 20 remove_watcher() i=3 2024-09-12T00:36:25.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.633+0000 7f2c0e9049c0 20 remove_watcher() i=4 2024-09-12T00:36:25.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.637+0000 7f2c0e9049c0 20 remove_watcher() i=5 2024-09-12T00:36:25.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.637+0000 7f2c0e9049c0 20 remove_watcher() i=6 2024-09-12T00:36:25.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.637+0000 7f2c0e9049c0 20 remove_watcher() i=7 2024-09-12T00:36:25.654 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.654 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:36:25.654 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-set-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:25.654 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:25.655 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.655 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:25.730 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.730 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:25.815 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:25.851 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:25.851 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:25.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.905+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.905+0000 7f8c7a0209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.905+0000 7f8c7a0209c0 20 realm 2024-09-12T00:36:25.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.905+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.905+0000 7f8c7a0209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.905+0000 7f8c7a0209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:25.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.905+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.905+0000 7f8c7a0209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.905+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.909+0000 7f8c7a0209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.909+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.909+0000 7f8c7a0209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:25.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.909+0000 7f8c7a0209c0 20 searching for the correct realm 2024-09-12T00:36:25.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:25.913+0000 7f8c78327640 0 -- 172.21.15.102:0/3117263388 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f8c64027040 msgr2=0x7f8c64063350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:26.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.129+0000 7f8c77325640 0 -- 172.21.15.102:0/3117263388 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f8c700f0410 msgr2=0x7f8c700f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.345+0000 7f8c7a0209c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.345+0000 7f8c7a0209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.345+0000 7f8c7a0209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.345+0000 7f8c7a0209c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.345+0000 7f8c7a0209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.345+0000 7f8c7a0209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.345+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:26.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:26.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 zone default found 2024-09-12T00:36:26.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 4 Realm: () 2024-09-12T00:36:26.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:26.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:26.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:26.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 zonegroup default 2024-09-12T00:36:26.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 started sync module instance, tier type = 2024-09-12T00:36:26.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.349+0000 7f8c7a0209c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:26.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.373+0000 7f8c7a0209c0 20 add_watcher() i=0 2024-09-12T00:36:26.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.373+0000 7f8c7a0209c0 20 add_watcher() i=1 2024-09-12T00:36:26.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.373+0000 7f8c7a0209c0 20 add_watcher() i=2 2024-09-12T00:36:26.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.373+0000 7f8c7a0209c0 20 add_watcher() i=3 2024-09-12T00:36:26.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.373+0000 7f8c7a0209c0 20 add_watcher() i=4 2024-09-12T00:36:26.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.373+0000 7f8c7a0209c0 20 add_watcher() i=5 2024-09-12T00:36:26.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.373+0000 7f8c7a0209c0 20 add_watcher() i=6 2024-09-12T00:36:26.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.377+0000 7f8c7a0209c0 20 add_watcher() i=7 2024-09-12T00:36:26.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.377+0000 7f8c7a0209c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:26.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8b2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:26.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:26.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:26.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 5 note: GC not initialized 2024-09-12T00:36:26.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8b2cfe1640 20 reqs_thread_entry: start 2024-09-12T00:36:26.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:26.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 20 Filter name: none 2024-09-12T00:36:26.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8aa67fc640 20 reqs_thread_entry: start 2024-09-12T00:36:26.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:36:26.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:26.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:36:26.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:36:26.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 : miss 2024-09-12T00:36:26.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.381+0000 7f8c7a0209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.385+0000 7f8c7a0209c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:26.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.385+0000 7f8c7a0209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:26.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.385+0000 7f8c7a0209c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:26.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.385+0000 7f8c7a0209c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:26.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.385+0000 7f8c7a0209c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:26.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.385+0000 7f8c7a0209c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 2024-09-12T00:36:26.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.385+0000 7f8c7a0209c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to be held by another RGW process; skipping for now 2024-09-12T00:36:26.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.389+0000 7f8b2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:26.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.393+0000 7f8c7a0209c0 20 remove_watcher() i=0 2024-09-12T00:36:26.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.393+0000 7f8c7a0209c0 2 removed watcher, disabling cache 2024-09-12T00:36:26.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.393+0000 7f8c7a0209c0 20 remove_watcher() i=1 2024-09-12T00:36:26.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.397+0000 7f8c7a0209c0 20 remove_watcher() i=2 2024-09-12T00:36:26.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.397+0000 7f8c7a0209c0 20 remove_watcher() i=3 2024-09-12T00:36:26.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.401+0000 7f8c7a0209c0 20 remove_watcher() i=4 2024-09-12T00:36:26.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.401+0000 7f8c7a0209c0 20 remove_watcher() i=5 2024-09-12T00:36:26.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.405+0000 7f8c7a0209c0 20 remove_watcher() i=6 2024-09-12T00:36:26.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:26.405+0000 7f8c7a0209c0 20 remove_watcher() i=7 2024-09-12T00:36:26.413 INFO:tasks.workunit.client.0.smithi102.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:36:56.431 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:56.469 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:56.469 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:56.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.519+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.519+0000 7f61142369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.519+0000 7f61142369c0 20 realm 2024-09-12T00:36:56.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.519+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.519+0000 7f61142369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.519+0000 7f61142369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:56.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.519+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.519+0000 7f61142369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.519+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.523+0000 7f61142369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:56.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.523+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.523+0000 7f61142369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:56.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.523+0000 7f61142369c0 20 searching for the correct realm 2024-09-12T00:36:56.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.527+0000 7f611253d640 0 -- 172.21.15.102:0/2477180798 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f60fc018070 msgr2=0x7f60fc081a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:56.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.743+0000 7f611153b640 0 -- 172.21.15.102:0/2477180798 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f610c0e5900 msgr2=0x7f610c0b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:56.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.959+0000 7f61142369c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:56.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.959+0000 7f61142369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:56.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.959+0000 7f61142369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:56.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.959+0000 7f61142369c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:56.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.959+0000 7f61142369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:56.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.959+0000 7f61142369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:56.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.959+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.959+0000 7f61142369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.959+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:56.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:56.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 zone default found 2024-09-12T00:36:56.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 4 Realm: () 2024-09-12T00:36:56.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:56.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:56.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:56.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 zonegroup default 2024-09-12T00:36:56.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 started sync module instance, tier type = 2024-09-12T00:36:56.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.963+0000 7f61142369c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:56.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.987+0000 7f61142369c0 20 add_watcher() i=0 2024-09-12T00:36:56.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.987+0000 7f61142369c0 20 add_watcher() i=1 2024-09-12T00:36:56.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.987+0000 7f61142369c0 20 add_watcher() i=2 2024-09-12T00:36:56.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.987+0000 7f61142369c0 20 add_watcher() i=3 2024-09-12T00:36:56.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.987+0000 7f61142369c0 20 add_watcher() i=4 2024-09-12T00:36:56.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.987+0000 7f61142369c0 20 add_watcher() i=5 2024-09-12T00:36:56.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.987+0000 7f61142369c0 20 add_watcher() i=6 2024-09-12T00:36:56.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.991+0000 7f61142369c0 20 add_watcher() i=7 2024-09-12T00:36:56.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.991+0000 7f61142369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:56.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.995+0000 7f5fc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:56.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.995+0000 7f61142369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:56.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.995+0000 7f61142369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:56.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.995+0000 7f61142369c0 5 note: GC not initialized 2024-09-12T00:36:56.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.995+0000 7f5fc27fc640 20 reqs_thread_entry: start 2024-09-12T00:36:56.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.995+0000 7f61142369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:56.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.995+0000 7f61142369c0 20 Filter name: none 2024-09-12T00:36:56.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.995+0000 7f5f33fff640 20 reqs_thread_entry: start 2024-09-12T00:36:56.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.995+0000 7f61142369c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:36:56.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.995+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:56.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:36:56.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:36:56.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 : miss 2024-09-12T00:36:56.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:56.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:56.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:56.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:56.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:56.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:56.999+0000 7f61142369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 2024-09-12T00:36:57.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f61142369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:57.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f61142369c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:57.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f61142369c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:57.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f61142369c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25, ofs0, ns] 2024-09-12T00:36:57.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f5ff4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398922 cookie 94442257182640 notifier 6669 bl.length()=1009 2024-09-12T00:36:57.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f5ff4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:57.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f5ff4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:57.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f5ff4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:57.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f5ff57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398923 cookie 94442257182640 notifier 6669 bl.length()=1009 2024-09-12T00:36:57.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f5ff57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:57.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f5ff57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:57.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.011+0000 7f5ff57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:57.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.015+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): orig_sources= new_sources= 2024-09-12T00:36:57.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.015+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): potential sources added=[] removed=[] 2024-09-12T00:36:57.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.015+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): orig_dests= new_dests= 2024-09-12T00:36:57.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.015+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): potential dests added=[] removed=[] 2024-09-12T00:36:57.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.0 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.0 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.1 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.1 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.2 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.2 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.3 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.3 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.4 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.4 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.5 2024-09-12T00:36:57.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.5 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.6 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.6 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.7 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.7 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.8 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.8 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.9 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.9 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.10 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.10 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.11 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1.11 2024-09-12T00:36:57.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.0 2024-09-12T00:36:57.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1 2024-09-12T00:36:57.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.2 2024-09-12T00:36:57.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.027+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.3 2024-09-12T00:36:57.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.031+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.4 2024-09-12T00:36:57.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.031+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.5 2024-09-12T00:36:57.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.031+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.6 2024-09-12T00:36:57.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.031+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.7 2024-09-12T00:36:57.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.031+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.8 2024-09-12T00:36:57.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.031+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.9 2024-09-12T00:36:57.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.035+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.10 2024-09-12T00:36:57.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.043+0000 7f61142369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:57.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.043+0000 7f61142369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 2024-09-12T00:36:57.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.043+0000 7f61142369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:57.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.043+0000 7f61142369c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:57.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.043+0000 7f61142369c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:57.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.043+0000 7f61142369c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25, ofs0, ns] 2024-09-12T00:36:57.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.047+0000 7f5ff4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398924 cookie 94442257182640 notifier 6669 bl.length()=1009 2024-09-12T00:36:57.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.047+0000 7f5ff4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:57.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.047+0000 7f5ff4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:57.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.047+0000 7f5ff4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:57.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.047+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): orig_sources= new_sources= 2024-09-12T00:36:57.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.047+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): potential sources added=[] removed=[] 2024-09-12T00:36:57.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.047+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): orig_dests= new_dests= 2024-09-12T00:36:57.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.047+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): potential dests added=[] removed=[] 2024-09-12T00:36:57.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.055+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.0 2024-09-12T00:36:57.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.055+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.1 2024-09-12T00:36:57.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.055+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.2 2024-09-12T00:36:57.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.055+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.3 2024-09-12T00:36:57.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.055+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.4 2024-09-12T00:36:57.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.059+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.5 2024-09-12T00:36:57.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.059+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.6 2024-09-12T00:36:57.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.059+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.7 2024-09-12T00:36:57.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.059+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.8 2024-09-12T00:36:57.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.059+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.9 2024-09-12T00:36:57.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.059+0000 7f61142369c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25.10 2024-09-12T00:36:57.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.059+0000 7f61142369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:57.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.059+0000 7f61142369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 2024-09-12T00:36:57.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.063+0000 7f61142369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:57.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.063+0000 7f61142369c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:57.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.063+0000 7f61142369c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:57.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.063+0000 7f61142369c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25, ofs0, ns] 2024-09-12T00:36:57.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.063+0000 7f5ff4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398925 cookie 94442257182640 notifier 6669 bl.length()=977 2024-09-12T00:36:57.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.063+0000 7f5ff4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 info.flags=0x17 2024-09-12T00:36:57.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.063+0000 7f5ff4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 to cache LRU end 2024-09-12T00:36:57.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.063+0000 7f5ff4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:57.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.067+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): orig_sources= new_sources= 2024-09-12T00:36:57.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.067+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): potential sources added=[] removed=[] 2024-09-12T00:36:57.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.067+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): orig_dests= new_dests= 2024-09-12T00:36:57.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.067+0000 7f61142369c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25]): potential dests added=[] removed=[] 2024-09-12T00:36:57.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.071+0000 7f61142369c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:57.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.075+0000 7f5fc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:57.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.079+0000 7f61142369c0 20 remove_watcher() i=0 2024-09-12T00:36:57.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.079+0000 7f61142369c0 2 removed watcher, disabling cache 2024-09-12T00:36:57.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.083+0000 7f61142369c0 20 remove_watcher() i=1 2024-09-12T00:36:57.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.083+0000 7f61142369c0 20 remove_watcher() i=2 2024-09-12T00:36:57.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.087+0000 7f61142369c0 20 remove_watcher() i=3 2024-09-12T00:36:57.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.087+0000 7f61142369c0 20 remove_watcher() i=4 2024-09-12T00:36:57.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.091+0000 7f61142369c0 20 remove_watcher() i=5 2024-09-12T00:36:57.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.091+0000 7f61142369c0 20 remove_watcher() i=6 2024-09-12T00:36:57.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.095+0000 7f61142369c0 20 remove_watcher() i=7 2024-09-12T00:36:57.105 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:36:57.135 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:57.136 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:57.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.183+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.187+0000 7f5af8a069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.187+0000 7f5af8a069c0 20 realm 2024-09-12T00:36:57.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.187+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.187+0000 7f5af8a069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.187+0000 7f5af8a069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:57.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.187+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.187+0000 7f5af8a069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.187+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.187+0000 7f5af8a069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:57.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.187+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.191+0000 7f5af8a069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:57.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.191+0000 7f5af8a069c0 20 searching for the correct realm 2024-09-12T00:36:57.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.195+0000 7f5af650c640 0 -- 172.21.15.102:0/2792956987 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x55a8b3048bc0 msgr2=0x55a8b304b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:57.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.199+0000 7f5af5d0b640 0 -- 172.21.15.102:0/2792956987 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f5af007cb30 msgr2=0x7f5af0061390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:57.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.207+0000 7f5af8a069c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:36:57.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.207+0000 7f5af8a069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:57.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.207+0000 7f5af8a069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:57.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.207+0000 7f5af8a069c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:36:57.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.207+0000 7f5af8a069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:57.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.207+0000 7f5af8a069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:57.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.207+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.207+0000 7f5af8a069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.207+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:57.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:57.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 zone default found 2024-09-12T00:36:57.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 4 Realm: () 2024-09-12T00:36:57.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:36:57.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:36:57.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:57.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 zonegroup default 2024-09-12T00:36:57.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 started sync module instance, tier type = 2024-09-12T00:36:57.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.211+0000 7f5af8a069c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:36:57.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.227+0000 7f5af8a069c0 20 add_watcher() i=0 2024-09-12T00:36:57.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.227+0000 7f5af8a069c0 20 add_watcher() i=1 2024-09-12T00:36:57.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.227+0000 7f5af8a069c0 20 add_watcher() i=2 2024-09-12T00:36:57.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.227+0000 7f5af8a069c0 20 add_watcher() i=3 2024-09-12T00:36:57.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.227+0000 7f5af8a069c0 20 add_watcher() i=4 2024-09-12T00:36:57.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.227+0000 7f5af8a069c0 20 add_watcher() i=5 2024-09-12T00:36:57.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.227+0000 7f5af8a069c0 20 add_watcher() i=6 2024-09-12T00:36:57.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.227+0000 7f5af8a069c0 20 add_watcher() i=7 2024-09-12T00:36:57.224 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.227+0000 7f5af8a069c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:57.227 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f59acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:57.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f5af8a069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:57.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f5af8a069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:57.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f5af8a069c0 5 note: GC not initialized 2024-09-12T00:36:57.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f59277fe640 20 reqs_thread_entry: start 2024-09-12T00:36:57.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f5af8a069c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:57.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f5af8a069c0 20 Filter name: none 2024-09-12T00:36:57.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f59257fa640 20 reqs_thread_entry: start 2024-09-12T00:36:57.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f5af8a069c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:57.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.231+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.235+0000 7f5af8a069c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:57.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.235+0000 7f5af8a069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:57.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.235+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.235+0000 7f5af8a069c0 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:36:57.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.235+0000 7f5af8a069c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.235+0000 7f5af8a069c0 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:36:57.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.235+0000 7f5af8a069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:57.235 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.239+0000 7f59acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:57.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.243+0000 7f5af8a069c0 20 remove_watcher() i=0 2024-09-12T00:36:57.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.243+0000 7f5af8a069c0 2 removed watcher, disabling cache 2024-09-12T00:36:57.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.243+0000 7f5af8a069c0 20 remove_watcher() i=1 2024-09-12T00:36:57.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.247+0000 7f5af8a069c0 20 remove_watcher() i=2 2024-09-12T00:36:57.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.247+0000 7f5af8a069c0 20 remove_watcher() i=3 2024-09-12T00:36:57.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.251+0000 7f5af8a069c0 20 remove_watcher() i=4 2024-09-12T00:36:57.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.251+0000 7f5af8a069c0 20 remove_watcher() i=5 2024-09-12T00:36:57.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.255+0000 7f5af8a069c0 20 remove_watcher() i=6 2024-09-12T00:36:57.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:36:57.255+0000 7f5af8a069c0 20 remove_watcher() i=7 2024-09-12T00:36:57.264 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:57.264 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:36:57.264 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-set-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:36:57.264 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:57.265 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:57.266 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:57.286 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:57.286 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:57.807 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:57.808 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:58.182 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:36:58.182 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:36:58.185 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.185 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:58.314 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.315 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:58.402 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.402 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:58.507 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.507 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:58.615 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.615 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:58.720 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.720 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:58.822 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.823 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:58.927 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.927 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:59.038 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.038 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:59.132 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.132 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:59.230 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.231 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:59.318 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.318 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:59.414 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.414 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:59.498 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.499 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:59.607 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.607 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:59.704 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.704 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:59.807 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.807 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:36:59.967 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.967 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:00.045 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:00.045 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:00.141 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:00.141 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:00.206 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:00.206 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:00.308 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:00.308 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:00.408 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:37:00.439 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:00.440 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:00.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.487+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.491+0000 7f77729279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.491+0000 7f77729279c0 20 realm 2024-09-12T00:37:00.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.491+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.491+0000 7f77729279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.491+0000 7f77729279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:00.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.491+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.491+0000 7f77729279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.491+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.491+0000 7f77729279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.491+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.495+0000 7f77729279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:00.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.495+0000 7f77729279c0 20 searching for the correct realm 2024-09-12T00:37:00.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.495+0000 7f7770c2e640 0 -- 172.21.15.102:0/2758757776 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f776412f070 msgr2=0x7f77640c8a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:00.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.711+0000 7f776fc2c640 0 -- 172.21.15.102:0/2758757776 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f776807e610 msgr2=0x7f7768093040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:00.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:00.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:00.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:00.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:00.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:00.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:00.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:00.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 zone default found 2024-09-12T00:37:00.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 4 Realm: () 2024-09-12T00:37:00.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:00.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:00.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:00.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 zonegroup default 2024-09-12T00:37:00.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.931+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.935+0000 7f77729279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.935+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.935+0000 7f77729279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.935+0000 7f77729279c0 20 started sync module instance, tier type = 2024-09-12T00:37:00.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.935+0000 7f77729279c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:00.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.959+0000 7f77729279c0 20 add_watcher() i=0 2024-09-12T00:37:00.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.959+0000 7f77729279c0 20 add_watcher() i=1 2024-09-12T00:37:00.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.959+0000 7f77729279c0 20 add_watcher() i=2 2024-09-12T00:37:00.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.959+0000 7f77729279c0 20 add_watcher() i=3 2024-09-12T00:37:00.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.959+0000 7f77729279c0 20 add_watcher() i=4 2024-09-12T00:37:00.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.959+0000 7f77729279c0 20 add_watcher() i=5 2024-09-12T00:37:00.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.959+0000 7f77729279c0 20 add_watcher() i=6 2024-09-12T00:37:00.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.959+0000 7f77729279c0 20 add_watcher() i=7 2024-09-12T00:37:00.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.959+0000 7f77729279c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:00.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.963+0000 7f7626fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.967+0000 7f77729279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:00.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.967+0000 7f77729279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:00.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.967+0000 7f77729279c0 5 note: GC not initialized 2024-09-12T00:37:00.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.967+0000 7f7625fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:00.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.967+0000 7f77729279c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:00.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.967+0000 7f77729279c0 20 Filter name: none 2024-09-12T00:37:00.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.967+0000 7f75977fe640 20 reqs_thread_entry: start 2024-09-12T00:37:00.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.967+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.967+0000 7f77729279c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:00.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.967+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.971+0000 7f77729279c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:00.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.971+0000 7f77729279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:00.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.971+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.971+0000 7f77729279c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:00.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.971+0000 7f77729279c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.971+0000 7f77729279c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:00.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.971+0000 7f77729279c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:00.972 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.975+0000 7f7626fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.979+0000 7f77729279c0 20 remove_watcher() i=0 2024-09-12T00:37:00.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.979+0000 7f77729279c0 2 removed watcher, disabling cache 2024-09-12T00:37:00.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.983+0000 7f77729279c0 20 remove_watcher() i=1 2024-09-12T00:37:00.982 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.987+0000 7f77729279c0 20 remove_watcher() i=2 2024-09-12T00:37:00.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.987+0000 7f77729279c0 20 remove_watcher() i=3 2024-09-12T00:37:00.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.991+0000 7f77729279c0 20 remove_watcher() i=4 2024-09-12T00:37:00.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.991+0000 7f77729279c0 20 remove_watcher() i=5 2024-09-12T00:37:00.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.991+0000 7f77729279c0 20 remove_watcher() i=6 2024-09-12T00:37:00.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:00.995+0000 7f77729279c0 20 remove_watcher() i=7 2024-09-12T00:37:01.005 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:01.005 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:01.006 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-trim-reshard-log-entries id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:01.006 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:01.006 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:37:01.042 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:01.042 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:01.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 20 realm 2024-09-12T00:37:01.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:01.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.091+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.091 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.095+0000 7f30570a39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:01.091 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.095+0000 7f30570a39c0 20 searching for the correct realm 2024-09-12T00:37:01.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.099+0000 7f30553aa640 0 -- 172.21.15.102:0/3873000097 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f30480df070 msgr2=0x7f30480ef930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:01.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.107+0000 7f30543a8640 0 -- 172.21.15.102:0/3873000097 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f304c058920 msgr2=0x7f304c0273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:01.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.323+0000 7f30570a39c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:01.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:01.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:01.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:01.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:01.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:01.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:01.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 zone default found 2024-09-12T00:37:01.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 4 Realm: () 2024-09-12T00:37:01.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:01.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:01.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:01.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 zonegroup default 2024-09-12T00:37:01.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.327+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.331+0000 7f30570a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.331+0000 7f30570a39c0 20 started sync module instance, tier type = 2024-09-12T00:37:01.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.331+0000 7f30570a39c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.351+0000 7f30570a39c0 20 add_watcher() i=0 2024-09-12T00:37:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.351+0000 7f30570a39c0 20 add_watcher() i=1 2024-09-12T00:37:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.351+0000 7f30570a39c0 20 add_watcher() i=2 2024-09-12T00:37:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.351+0000 7f30570a39c0 20 add_watcher() i=3 2024-09-12T00:37:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.351+0000 7f30570a39c0 20 add_watcher() i=4 2024-09-12T00:37:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.351+0000 7f30570a39c0 20 add_watcher() i=5 2024-09-12T00:37:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.351+0000 7f30570a39c0 20 add_watcher() i=6 2024-09-12T00:37:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.355+0000 7f30570a39c0 20 add_watcher() i=7 2024-09-12T00:37:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.355+0000 7f30570a39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:01.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f2f0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:01.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:01.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 5 note: GC not initialized 2024-09-12T00:37:01.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f2f0a7e4640 20 reqs_thread_entry: start 2024-09-12T00:37:01.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:01.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 20 Filter name: none 2024-09-12T00:37:01.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f2f037fe640 20 reqs_thread_entry: start 2024-09-12T00:37:01.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:37:01.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:01.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:01.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:01.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 : miss 2024-09-12T00:37:01.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.363+0000 7f30570a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.367+0000 7f30570a39c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:01.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.367+0000 7f30570a39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 info.flags=0x17 2024-09-12T00:37:01.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.367+0000 7f30570a39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 to cache LRU end 2024-09-12T00:37:01.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.367+0000 7f30570a39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:01.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.367+0000 7f30570a39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:01.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.367+0000 7f30570a39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 2024-09-12T00:37:01.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.375+0000 7f30570a39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 info.flags=0x17 2024-09-12T00:37:01.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.375+0000 7f30570a39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 to cache LRU end 2024-09-12T00:37:01.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.375+0000 7f30570a39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:01.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.375+0000 7f30570a39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26, ofs0, ns] 2024-09-12T00:37:01.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.375+0000 7f2f2bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398880 cookie 93883498198160 notifier 6323 bl.length()=1023 2024-09-12T00:37:01.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.375+0000 7f2f2bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 info.flags=0x17 2024-09-12T00:37:01.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.375+0000 7f2f2bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 to cache LRU end 2024-09-12T00:37:01.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.375+0000 7f2f2bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.379+0000 7f30570a39c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): orig_sources= new_sources= 2024-09-12T00:37:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.379+0000 7f30570a39c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): potential sources added=[] removed=[] 2024-09-12T00:37:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.379+0000 7f30570a39c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): orig_dests= new_dests= 2024-09-12T00:37:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.379+0000 7f30570a39c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): potential dests added=[] removed=[] 2024-09-12T00:37:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.379+0000 7f30570a39c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:37:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.379+0000 7f30570a39c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:37:01.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.383+0000 7f2f0b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.387+0000 7f30570a39c0 20 remove_watcher() i=0 2024-09-12T00:37:01.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.387+0000 7f30570a39c0 2 removed watcher, disabling cache 2024-09-12T00:37:01.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.391+0000 7f30570a39c0 20 remove_watcher() i=1 2024-09-12T00:37:01.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.391+0000 7f30570a39c0 20 remove_watcher() i=2 2024-09-12T00:37:01.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.395+0000 7f30570a39c0 20 remove_watcher() i=3 2024-09-12T00:37:01.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.395+0000 7f30570a39c0 20 remove_watcher() i=4 2024-09-12T00:37:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.399+0000 7f30570a39c0 20 remove_watcher() i=5 2024-09-12T00:37:01.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.399+0000 7f30570a39c0 20 remove_watcher() i=6 2024-09-12T00:37:01.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.403+0000 7f30570a39c0 20 remove_watcher() i=7 2024-09-12T00:37:01.413 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:37:01.443 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:01.443 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:01.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.491+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.491+0000 7f6c715849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.491+0000 7f6c715849c0 20 realm 2024-09-12T00:37:01.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.491+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.491+0000 7f6c715849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.491+0000 7f6c715849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:01.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.491+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.491+0000 7f6c715849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.491+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.495+0000 7f6c715849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.495+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.495+0000 7f6c715849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:01.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.495+0000 7f6c715849c0 20 searching for the correct realm 2024-09-12T00:37:01.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.499+0000 7f6c6f88b640 0 -- 172.21.15.102:0/82496442 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x563a712d11a0 msgr2=0x563a712d3590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:01.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.507+0000 7f6c6e889640 0 -- 172.21.15.102:0/82496442 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6c680e5910 msgr2=0x7f6c680cd3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:01.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:01.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:01.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:01.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:01.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:01.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:01.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:01.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 zone default found 2024-09-12T00:37:01.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 4 Realm: () 2024-09-12T00:37:01.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:01.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:01.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:01.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 zonegroup default 2024-09-12T00:37:01.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.727+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.731+0000 7f6c715849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.731+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.731+0000 7f6c715849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.731+0000 7f6c715849c0 20 started sync module instance, tier type = 2024-09-12T00:37:01.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.731+0000 7f6c715849c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:01.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.755+0000 7f6c715849c0 20 add_watcher() i=0 2024-09-12T00:37:01.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.755+0000 7f6c715849c0 20 add_watcher() i=1 2024-09-12T00:37:01.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.755+0000 7f6c715849c0 20 add_watcher() i=2 2024-09-12T00:37:01.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.755+0000 7f6c715849c0 20 add_watcher() i=3 2024-09-12T00:37:01.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.755+0000 7f6c715849c0 20 add_watcher() i=4 2024-09-12T00:37:01.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.755+0000 7f6c715849c0 20 add_watcher() i=5 2024-09-12T00:37:01.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.755+0000 7f6c715849c0 20 add_watcher() i=6 2024-09-12T00:37:01.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.755+0000 7f6c715849c0 20 add_watcher() i=7 2024-09-12T00:37:01.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.755+0000 7f6c715849c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:01.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.759+0000 7f6b25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.763+0000 7f6c715849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:01.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.763+0000 7f6c715849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:01.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.763+0000 7f6c715849c0 5 note: GC not initialized 2024-09-12T00:37:01.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.763+0000 7f6b24fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:01.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.763+0000 7f6c715849c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:01.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.763+0000 7f6c715849c0 20 Filter name: none 2024-09-12T00:37:01.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.763+0000 7f6a9e7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:01.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.763+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.763+0000 7f6c715849c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:01.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.763+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.767+0000 7f6c715849c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:37:01.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.767+0000 7f6c715849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:01.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.767+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.767+0000 7f6c715849c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:01.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.767+0000 7f6c715849c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.767+0000 7f6c715849c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:37:01.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.767+0000 7f6c715849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:01.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.771+0000 7f6b25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.775+0000 7f6c715849c0 20 remove_watcher() i=0 2024-09-12T00:37:01.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.775+0000 7f6c715849c0 2 removed watcher, disabling cache 2024-09-12T00:37:01.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.779+0000 7f6c715849c0 20 remove_watcher() i=1 2024-09-12T00:37:01.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.779+0000 7f6c715849c0 20 remove_watcher() i=2 2024-09-12T00:37:01.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.783+0000 7f6c715849c0 20 remove_watcher() i=3 2024-09-12T00:37:01.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.783+0000 7f6c715849c0 20 remove_watcher() i=4 2024-09-12T00:37:01.782 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.787+0000 7f6c715849c0 20 remove_watcher() i=5 2024-09-12T00:37:01.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.787+0000 7f6c715849c0 20 remove_watcher() i=6 2024-09-12T00:37:01.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:01.787+0000 7f6c715849c0 20 remove_watcher() i=7 2024-09-12T00:37:01.799 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:01.799 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-trim-reshard-log-entries id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:01.801 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.801 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:01.856 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.856 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:01.920 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:01.955 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:01.955 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:01.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.003+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.003+0000 7f2b4b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.003+0000 7f2b4b0189c0 20 realm 2024-09-12T00:37:02.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.003+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.003+0000 7f2b4b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.003+0000 7f2b4b0189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:02.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.003+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.003+0000 7f2b4b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.003+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.007+0000 7f2b4b0189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.007+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.007+0000 7f2b4b0189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:02.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.007+0000 7f2b4b0189c0 20 searching for the correct realm 2024-09-12T00:37:02.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.011+0000 7f2b48b1e640 0 -- 172.21.15.102:0/4225910675 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x56502f2a0620 msgr2=0x56502f2a2ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.019+0000 7f2b4831d640 0 -- 172.21.15.102:0/4225910675 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f2b4000a040 msgr2=0x7f2b40053430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:02.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:02.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:02.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:02.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:02.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:02.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:02.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 zone default found 2024-09-12T00:37:02.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 4 Realm: () 2024-09-12T00:37:02.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:02.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:02.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:02.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 zonegroup default 2024-09-12T00:37:02.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.027+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.031+0000 7f2b4b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.031+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.031+0000 7f2b4b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.031+0000 7f2b4b0189c0 20 started sync module instance, tier type = 2024-09-12T00:37:02.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.031+0000 7f2b4b0189c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:02.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.043+0000 7f2b4b0189c0 20 add_watcher() i=0 2024-09-12T00:37:02.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.043+0000 7f2b4b0189c0 20 add_watcher() i=1 2024-09-12T00:37:02.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.043+0000 7f2b4b0189c0 20 add_watcher() i=2 2024-09-12T00:37:02.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.043+0000 7f2b4b0189c0 20 add_watcher() i=3 2024-09-12T00:37:02.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.043+0000 7f2b4b0189c0 20 add_watcher() i=4 2024-09-12T00:37:02.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.043+0000 7f2b4b0189c0 20 add_watcher() i=5 2024-09-12T00:37:02.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.043+0000 7f2b4b0189c0 20 add_watcher() i=6 2024-09-12T00:37:02.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.047+0000 7f2b4b0189c0 20 add_watcher() i=7 2024-09-12T00:37:02.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.047+0000 7f2b4b0189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:02.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.047+0000 7f29fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.047+0000 7f2b4b0189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.047+0000 7f2b4b0189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.047+0000 7f2b4b0189c0 5 note: GC not initialized 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.047+0000 7f29fdfe3640 20 reqs_thread_entry: start 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.047+0000 7f2b4b0189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.047+0000 7f2b4b0189c0 20 Filter name: none 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f296f7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:37:02.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:02.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:02.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:02.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 : miss 2024-09-12T00:37:02.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:37:02.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 info.flags=0x17 2024-09-12T00:37:02.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 to cache LRU end 2024-09-12T00:37:02.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:02.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:02.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.051+0000 7f2b4b0189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 2024-09-12T00:37:02.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.055+0000 7f2b4b0189c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:37:02.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2b4b0189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 info.flags=0x17 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2b4b0189c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 to cache LRU end 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2b4b0189c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2b4b0189c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26, ofs0, ns] 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2a1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398881 cookie 94902388661584 notifier 6359 bl.length()=1023 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2a1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 info.flags=0x17 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2a1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 to cache LRU end 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2a1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): orig_sources= new_sources= 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): potential sources added=[] removed=[] 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): orig_dests= new_dests= 2024-09-12T00:37:02.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.067+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): potential dests added=[] removed=[] 2024-09-12T00:37:02.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.0 2024-09-12T00:37:02.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.0 2024-09-12T00:37:02.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.1 2024-09-12T00:37:02.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.1 2024-09-12T00:37:02.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.2 2024-09-12T00:37:02.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.2 2024-09-12T00:37:02.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.3 2024-09-12T00:37:02.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.3 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.4 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.4 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.5 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.5 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.6 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.6 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.7 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.7 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.8 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.8 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.9 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.9 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.10 2024-09-12T00:37:02.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.10 2024-09-12T00:37:02.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.11 2024-09-12T00:37:02.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2.11 2024-09-12T00:37:02.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.0 2024-09-12T00:37:02.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.1 2024-09-12T00:37:02.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2 2024-09-12T00:37:02.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.079+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.3 2024-09-12T00:37:02.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.083+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.4 2024-09-12T00:37:02.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.083+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.5 2024-09-12T00:37:02.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.083+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.6 2024-09-12T00:37:02.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.083+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.7 2024-09-12T00:37:02.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.087+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.8 2024-09-12T00:37:02.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.087+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.9 2024-09-12T00:37:02.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.087+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.10 2024-09-12T00:37:02.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.095+0000 7f2b4b0189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:02.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.095+0000 7f2b4b0189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 2024-09-12T00:37:02.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.095+0000 7f2b4b0189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 info.flags=0x17 2024-09-12T00:37:02.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.095+0000 7f2b4b0189c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 to cache LRU end 2024-09-12T00:37:02.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.095+0000 7f2b4b0189c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:02.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.095+0000 7f2b4b0189c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26, ofs0, ns] 2024-09-12T00:37:02.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.099+0000 7f2a1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398882 cookie 94902388661584 notifier 6359 bl.length()=1023 2024-09-12T00:37:02.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.099+0000 7f2a1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 info.flags=0x17 2024-09-12T00:37:02.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.099+0000 7f2a1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 to cache LRU end 2024-09-12T00:37:02.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.099+0000 7f2a1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:02.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.099+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): orig_sources= new_sources= 2024-09-12T00:37:02.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.099+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): potential sources added=[] removed=[] 2024-09-12T00:37:02.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.099+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): orig_dests= new_dests= 2024-09-12T00:37:02.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.099+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): potential dests added=[] removed=[] 2024-09-12T00:37:02.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.103+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.0 2024-09-12T00:37:02.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.103+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.1 2024-09-12T00:37:02.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.107+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.2 2024-09-12T00:37:02.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.107+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.3 2024-09-12T00:37:02.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.107+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.4 2024-09-12T00:37:02.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.107+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.5 2024-09-12T00:37:02.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.107+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.6 2024-09-12T00:37:02.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.107+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.7 2024-09-12T00:37:02.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.111+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.8 2024-09-12T00:37:02.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.111+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.9 2024-09-12T00:37:02.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.111+0000 7f2b4b0189c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26.10 2024-09-12T00:37:02.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.111+0000 7f2b4b0189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:02.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.111+0000 7f2b4b0189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 2024-09-12T00:37:02.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.115+0000 7f2b4b0189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 info.flags=0x17 2024-09-12T00:37:02.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.115+0000 7f2b4b0189c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 to cache LRU end 2024-09-12T00:37:02.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.115+0000 7f2b4b0189c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:02.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.115+0000 7f2b4b0189c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26, ofs0, ns] 2024-09-12T00:37:02.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.115+0000 7f2a1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398883 cookie 94902388661584 notifier 6359 bl.length()=991 2024-09-12T00:37:02.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.115+0000 7f2a1f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 info.flags=0x17 2024-09-12T00:37:02.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.115+0000 7f2a1f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 to cache LRU end 2024-09-12T00:37:02.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.115+0000 7f2a1f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:02.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.119+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): orig_sources= new_sources= 2024-09-12T00:37:02.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.119+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): potential sources added=[] removed=[] 2024-09-12T00:37:02.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.119+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): orig_dests= new_dests= 2024-09-12T00:37:02.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.119+0000 7f2b4b0189c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26]): potential dests added=[] removed=[] 2024-09-12T00:37:02.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.123+0000 7f2b4b0189c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:02.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.127+0000 7f29fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.131+0000 7f2b4b0189c0 20 remove_watcher() i=0 2024-09-12T00:37:02.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.131+0000 7f2b4b0189c0 2 removed watcher, disabling cache 2024-09-12T00:37:02.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.131+0000 7f2b4b0189c0 20 remove_watcher() i=1 2024-09-12T00:37:02.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.135+0000 7f2b4b0189c0 20 remove_watcher() i=2 2024-09-12T00:37:02.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.135+0000 7f2b4b0189c0 20 remove_watcher() i=3 2024-09-12T00:37:02.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.139+0000 7f2b4b0189c0 20 remove_watcher() i=4 2024-09-12T00:37:02.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.139+0000 7f2b4b0189c0 20 remove_watcher() i=5 2024-09-12T00:37:02.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.139+0000 7f2b4b0189c0 20 remove_watcher() i=6 2024-09-12T00:37:02.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.143+0000 7f2b4b0189c0 20 remove_watcher() i=7 2024-09-12T00:37:02.154 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:37:02.181 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:02.181 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:02.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.231+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.231+0000 7f8f47a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.231+0000 7f8f47a9c9c0 20 realm 2024-09-12T00:37:02.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.231+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.231+0000 7f8f47a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.231+0000 7f8f47a9c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:02.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.231+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.231+0000 7f8f47a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.231+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.235+0000 7f8f47a9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.235+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.235+0000 7f8f47a9c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:02.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.235+0000 7f8f47a9c9c0 20 searching for the correct realm 2024-09-12T00:37:02.235 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.239+0000 7f8f45da3640 0 -- 172.21.15.102:0/3554449686 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f8f3c004bc0 msgr2=0x7f8f3c063c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:02.242 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.247+0000 7f8f44da1640 0 -- 172.21.15.102:0/3554449686 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f8f40033040 msgr2=0x7f8f40033930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.463+0000 7f8f47a9c9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:02.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.463+0000 7f8f47a9c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:02.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.463+0000 7f8f47a9c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:02.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.463+0000 7f8f47a9c9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:02.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.463+0000 7f8f47a9c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:02.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.463+0000 7f8f47a9c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:02.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.463+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.463+0000 7f8f47a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.463+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:02.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 zone default found 2024-09-12T00:37:02.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 4 Realm: () 2024-09-12T00:37:02.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:02.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:02.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:02.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 zonegroup default 2024-09-12T00:37:02.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 started sync module instance, tier type = 2024-09-12T00:37:02.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.467+0000 7f8f47a9c9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:02.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.491+0000 7f8f47a9c9c0 20 add_watcher() i=0 2024-09-12T00:37:02.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.491+0000 7f8f47a9c9c0 20 add_watcher() i=1 2024-09-12T00:37:02.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.491+0000 7f8f47a9c9c0 20 add_watcher() i=2 2024-09-12T00:37:02.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.491+0000 7f8f47a9c9c0 20 add_watcher() i=3 2024-09-12T00:37:02.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.491+0000 7f8f47a9c9c0 20 add_watcher() i=4 2024-09-12T00:37:02.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.491+0000 7f8f47a9c9c0 20 add_watcher() i=5 2024-09-12T00:37:02.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.491+0000 7f8f47a9c9c0 20 add_watcher() i=6 2024-09-12T00:37:02.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.495+0000 7f8f47a9c9c0 20 add_watcher() i=7 2024-09-12T00:37:02.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.495+0000 7f8f47a9c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:02.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.499+0000 7f8dfb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.499+0000 7f8f47a9c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:02.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.499+0000 7f8f47a9c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:02.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.499+0000 7f8f47a9c9c0 5 note: GC not initialized 2024-09-12T00:37:02.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.499+0000 7f8dfa7e4640 20 reqs_thread_entry: start 2024-09-12T00:37:02.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.499+0000 7f8f47a9c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:02.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.499+0000 7f8f47a9c9c0 20 Filter name: none 2024-09-12T00:37:02.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.503+0000 7f8d6bfff640 20 reqs_thread_entry: start 2024-09-12T00:37:02.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.503+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.503+0000 7f8f47a9c9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:02.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.503+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.503+0000 7f8f47a9c9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:02.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.503+0000 7f8f47a9c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:02.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.503+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.503+0000 7f8f47a9c9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:02.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.503+0000 7f8f47a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.507+0000 7f8f47a9c9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:02.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.507+0000 7f8f47a9c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:02.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.511+0000 7f8dfb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.515+0000 7f8f47a9c9c0 20 remove_watcher() i=0 2024-09-12T00:37:02.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.515+0000 7f8f47a9c9c0 2 removed watcher, disabling cache 2024-09-12T00:37:02.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.515+0000 7f8f47a9c9c0 20 remove_watcher() i=1 2024-09-12T00:37:02.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.519+0000 7f8f47a9c9c0 20 remove_watcher() i=2 2024-09-12T00:37:02.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.519+0000 7f8f47a9c9c0 20 remove_watcher() i=3 2024-09-12T00:37:02.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.523+0000 7f8f47a9c9c0 20 remove_watcher() i=4 2024-09-12T00:37:02.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.523+0000 7f8f47a9c9c0 20 remove_watcher() i=5 2024-09-12T00:37:02.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.523+0000 7f8f47a9c9c0 20 remove_watcher() i=6 2024-09-12T00:37:02.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:02.527+0000 7f8f47a9c9c0 20 remove_watcher() i=7 2024-09-12T00:37:02.537 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:02.537 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:02.538 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-trim-reshard-log-entries id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:37:02.538 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:02.539 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.539 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:02.572 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.572 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:03.064 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.065 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:03.434 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:37:03.434 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:03.436 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.436 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:03.572 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.572 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:03.665 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.665 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:03.763 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.763 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:03.859 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.859 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:03.953 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.953 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:04.053 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:04.054 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:04.155 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:04.155 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:04.253 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:04.253 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:04.352 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:04.353 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:04.457 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:04.457 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:04.555 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:04.556 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:04.658 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:04.658 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:04.755 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:04.755 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:04.853 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:04.854 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:04.954 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:04.954 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:05.048 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:05.049 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:05.148 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:05.148 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:05.245 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:05.245 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:05.348 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:05.348 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:05.449 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:05.449 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:05.549 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:05.549 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:05.645 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:37:05.678 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:05.678 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:05.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.727+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.727+0000 7f6fdd5329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:05.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.727+0000 7f6fdd5329c0 20 realm 2024-09-12T00:37:05.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.727+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.727+0000 7f6fdd5329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:05.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.727+0000 7f6fdd5329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:05.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.727+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.727+0000 7f6fdd5329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:05.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.727+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.731+0000 7f6fdd5329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:05.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.731+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.731+0000 7f6fdd5329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:05.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.731+0000 7f6fdd5329c0 20 searching for the correct realm 2024-09-12T00:37:05.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.735+0000 7f6fdb839640 0 -- 172.21.15.102:0/412604375 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f6fd0008ba0 msgr2=0x7f6fd00523f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:05.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.743+0000 7f6fda837640 0 -- 172.21.15.102:0/412604375 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6fcc0f7bd0 msgr2=0x7f6fcc131930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:05.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:05.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:05.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:05.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:05.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:05.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:05.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:05.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:05.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:05.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 zone default found 2024-09-12T00:37:05.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 4 Realm: () 2024-09-12T00:37:05.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:05.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:05.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:05.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 zonegroup default 2024-09-12T00:37:05.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:05.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.963+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.967+0000 7f6fdd5329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:05.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.967+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.967+0000 7f6fdd5329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:05.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.967+0000 7f6fdd5329c0 20 started sync module instance, tier type = 2024-09-12T00:37:05.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.967+0000 7f6fdd5329c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:05.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.991+0000 7f6fdd5329c0 20 add_watcher() i=0 2024-09-12T00:37:05.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.991+0000 7f6fdd5329c0 20 add_watcher() i=1 2024-09-12T00:37:05.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.991+0000 7f6fdd5329c0 20 add_watcher() i=2 2024-09-12T00:37:05.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.991+0000 7f6fdd5329c0 20 add_watcher() i=3 2024-09-12T00:37:05.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.991+0000 7f6fdd5329c0 20 add_watcher() i=4 2024-09-12T00:37:05.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.991+0000 7f6fdd5329c0 20 add_watcher() i=5 2024-09-12T00:37:05.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.991+0000 7f6fdd5329c0 20 add_watcher() i=6 2024-09-12T00:37:05.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.991+0000 7f6fdd5329c0 20 add_watcher() i=7 2024-09-12T00:37:05.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.991+0000 7f6fdd5329c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:05.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.995+0000 7f6e91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:05.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:05.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:05.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 5 note: GC not initialized 2024-09-12T00:37:05.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6e90fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:05.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:05.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 20 Filter name: none 2024-09-12T00:37:05.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6e0a7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:05.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:05.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:05.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:05.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:05.999+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.003+0000 7f6fdd5329c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:05.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.003+0000 7f6fdd5329c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:05.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.003+0000 7f6fdd5329c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:05.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.003+0000 7f6fdd5329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:06.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.007+0000 7f6e91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:06.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.011+0000 7f6fdd5329c0 20 remove_watcher() i=0 2024-09-12T00:37:06.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.011+0000 7f6fdd5329c0 2 removed watcher, disabling cache 2024-09-12T00:37:06.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.015+0000 7f6fdd5329c0 20 remove_watcher() i=1 2024-09-12T00:37:06.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.015+0000 7f6fdd5329c0 20 remove_watcher() i=2 2024-09-12T00:37:06.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.019+0000 7f6fdd5329c0 20 remove_watcher() i=3 2024-09-12T00:37:06.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.023+0000 7f6fdd5329c0 20 remove_watcher() i=4 2024-09-12T00:37:06.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.023+0000 7f6fdd5329c0 20 remove_watcher() i=5 2024-09-12T00:37:06.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.023+0000 7f6fdd5329c0 20 remove_watcher() i=6 2024-09-12T00:37:06.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.027+0000 7f6fdd5329c0 20 remove_watcher() i=7 2024-09-12T00:37:06.040 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:06.040 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:06.040 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-trim-reshard-log-entries id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:06.040 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:06.040 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:37:06.080 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:06.080 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:06.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.127+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.131+0000 7f37acc499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.131+0000 7f37acc499c0 20 realm 2024-09-12T00:37:06.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.131+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.131+0000 7f37acc499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.131+0000 7f37acc499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:06.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.131+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.131+0000 7f37acc499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.131+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.131+0000 7f37acc499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:06.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.131+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.135+0000 7f37acc499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:06.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.135+0000 7f37acc499c0 20 searching for the correct realm 2024-09-12T00:37:06.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.135+0000 7f37aaf50640 0 -- 172.21.15.102:0/463666478 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f37a00e0000 msgr2=0x7f37a00e0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:06.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.351+0000 7f37a9f4e640 0 -- 172.21.15.102:0/463666478 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f37a401e050 msgr2=0x7f37a4058420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:06.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.567+0000 7f37acc499c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:06.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.567+0000 7f37acc499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:06.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.567+0000 7f37acc499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:06.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.567+0000 7f37acc499c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:06.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.567+0000 7f37acc499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:06.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.567+0000 7f37acc499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:06.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.567+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:06.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:06.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 zone default found 2024-09-12T00:37:06.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 4 Realm: () 2024-09-12T00:37:06.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:06.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:06.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:06.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 zonegroup default 2024-09-12T00:37:06.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.571+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.575+0000 7f37acc499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.575+0000 7f37acc499c0 20 started sync module instance, tier type = 2024-09-12T00:37:06.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.575+0000 7f37acc499c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:06.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.599+0000 7f37acc499c0 20 add_watcher() i=0 2024-09-12T00:37:06.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.599+0000 7f37acc499c0 20 add_watcher() i=1 2024-09-12T00:37:06.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.599+0000 7f37acc499c0 20 add_watcher() i=2 2024-09-12T00:37:06.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.599+0000 7f37acc499c0 20 add_watcher() i=3 2024-09-12T00:37:06.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.599+0000 7f37acc499c0 20 add_watcher() i=4 2024-09-12T00:37:06.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.599+0000 7f37acc499c0 20 add_watcher() i=5 2024-09-12T00:37:06.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.599+0000 7f37acc499c0 20 add_watcher() i=6 2024-09-12T00:37:06.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.599+0000 7f37acc499c0 20 add_watcher() i=7 2024-09-12T00:37:06.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.599+0000 7f37acc499c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:06.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.603+0000 7f3660fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:06.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.603+0000 7f37acc499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:06.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.603+0000 7f37acc499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:06.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.603+0000 7f37acc499c0 5 note: GC not initialized 2024-09-12T00:37:06.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.603+0000 7f35db7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:06.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.603+0000 7f37acc499c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:06.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 20 Filter name: none 2024-09-12T00:37:06.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f35d97fa640 20 reqs_thread_entry: start 2024-09-12T00:37:06.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:37:06.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:06.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:06.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:06.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 : miss 2024-09-12T00:37:06.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:06.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 info.flags=0x17 2024-09-12T00:37:06.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 to cache LRU end 2024-09-12T00:37:06.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:06.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:06.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.607+0000 7f37acc499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 2024-09-12T00:37:06.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.615+0000 7f37acc499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 info.flags=0x17 2024-09-12T00:37:06.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.615+0000 7f37acc499c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 to cache LRU end 2024-09-12T00:37:06.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.615+0000 7f37acc499c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:06.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.615+0000 7f37acc499c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27, ofs0, ns] 2024-09-12T00:37:06.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.619+0000 7f368dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398886 cookie 94439950996656 notifier 6822 bl.length()=1023 2024-09-12T00:37:06.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.619+0000 7f368dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 info.flags=0x17 2024-09-12T00:37:06.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.619+0000 7f368dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 to cache LRU end 2024-09-12T00:37:06.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.619+0000 7f368dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:06.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.619+0000 7f37acc499c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27]): orig_sources= new_sources= 2024-09-12T00:37:06.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.619+0000 7f37acc499c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27]): potential sources added=[] removed=[] 2024-09-12T00:37:06.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.619+0000 7f37acc499c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27]): orig_dests= new_dests= 2024-09-12T00:37:06.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.619+0000 7f37acc499c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27]): potential dests added=[] removed=[] 2024-09-12T00:37:06.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.619+0000 7f37acc499c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:37:06.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.619+0000 7f37acc499c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:37:06.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.0 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.0 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.1 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.1 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.2 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.2 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.3 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.3 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.4 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.4 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.5 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.5 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.6 2024-09-12T00:37:06.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.6 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.7 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.7 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.8 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.8 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.9 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.9 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.10 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.10 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.11 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1.11 2024-09-12T00:37:06.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.0 2024-09-12T00:37:06.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.1 2024-09-12T00:37:06.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.2 2024-09-12T00:37:06.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.627+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.3 2024-09-12T00:37:06.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.631+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.4 2024-09-12T00:37:06.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.631+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.5 2024-09-12T00:37:06.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.631+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.6 2024-09-12T00:37:06.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.631+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.7 2024-09-12T00:37:06.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.631+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.8 2024-09-12T00:37:06.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.635+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.9 2024-09-12T00:37:06.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.635+0000 7f37acc499c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27.10 2024-09-12T00:37:06.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.643+0000 7f37acc499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:06.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.643+0000 7f37acc499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 2024-09-12T00:37:06.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.643+0000 7f37acc499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 info.flags=0x17 2024-09-12T00:37:06.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.643+0000 7f37acc499c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 to cache LRU end 2024-09-12T00:37:06.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.643+0000 7f37acc499c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:06.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.643+0000 7f37acc499c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27, ofs0, ns] 2024-09-12T00:37:06.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.643+0000 7f368dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398887 cookie 94439950996656 notifier 6822 bl.length()=991 2024-09-12T00:37:06.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.643+0000 7f368dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 info.flags=0x17 2024-09-12T00:37:06.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.643+0000 7f368dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 to cache LRU end 2024-09-12T00:37:06.641 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.643+0000 7f368dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:06.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.647+0000 7f37acc499c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27]): orig_sources= new_sources= 2024-09-12T00:37:06.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.647+0000 7f37acc499c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27]): potential sources added=[] removed=[] 2024-09-12T00:37:06.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.647+0000 7f37acc499c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27]): orig_dests= new_dests= 2024-09-12T00:37:06.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.647+0000 7f37acc499c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27]): potential dests added=[] removed=[] 2024-09-12T00:37:06.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.651+0000 7f37acc499c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:06.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.655+0000 7f3660fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:06.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.659+0000 7f37acc499c0 20 remove_watcher() i=0 2024-09-12T00:37:06.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.659+0000 7f37acc499c0 2 removed watcher, disabling cache 2024-09-12T00:37:06.659 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.663+0000 7f37acc499c0 20 remove_watcher() i=1 2024-09-12T00:37:06.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.663+0000 7f37acc499c0 20 remove_watcher() i=2 2024-09-12T00:37:06.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.667+0000 7f37acc499c0 20 remove_watcher() i=3 2024-09-12T00:37:06.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.667+0000 7f37acc499c0 20 remove_watcher() i=4 2024-09-12T00:37:06.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.671+0000 7f37acc499c0 20 remove_watcher() i=5 2024-09-12T00:37:06.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.671+0000 7f37acc499c0 20 remove_watcher() i=6 2024-09-12T00:37:06.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.671+0000 7f37acc499c0 20 remove_watcher() i=7 2024-09-12T00:37:06.686 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:37:06.716 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:06.717 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:06.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.763+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.767+0000 7fabf9c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.767+0000 7fabf9c1e9c0 20 realm 2024-09-12T00:37:06.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.767+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.767+0000 7fabf9c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.767+0000 7fabf9c1e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:06.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.767+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.767+0000 7fabf9c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.767+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.767+0000 7fabf9c1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:06.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.767+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.771+0000 7fabf9c1e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:06.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.771+0000 7fabf9c1e9c0 20 searching for the correct realm 2024-09-12T00:37:06.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.771+0000 7fabf6f23640 0 -- 172.21.15.102:0/3673369407 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7fabf00bb040 msgr2=0x7fabf00d6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:06.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.983+0000 7fabf7f25640 0 -- 172.21.15.102:0/3673369407 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x555ab73c2ec0 msgr2=0x555ab73c52b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:06.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.999+0000 7fabf9c1e9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:06.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.999+0000 7fabf9c1e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:06.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.999+0000 7fabf9c1e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:06.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.999+0000 7fabf9c1e9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:06.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.999+0000 7fabf9c1e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:06.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.999+0000 7fabf9c1e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:06.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.999+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.999+0000 7fabf9c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:06.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:06.999+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:06.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:06.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:06.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 zone default found 2024-09-12T00:37:06.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 4 Realm: () 2024-09-12T00:37:06.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:06.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:06.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:06.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 zonegroup default 2024-09-12T00:37:06.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:07.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:07.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:07.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:07.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:07.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:07.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 started sync module instance, tier type = 2024-09-12T00:37:07.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.003+0000 7fabf9c1e9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:07.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.027+0000 7fabf9c1e9c0 20 add_watcher() i=0 2024-09-12T00:37:07.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.027+0000 7fabf9c1e9c0 20 add_watcher() i=1 2024-09-12T00:37:07.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.027+0000 7fabf9c1e9c0 20 add_watcher() i=2 2024-09-12T00:37:07.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.027+0000 7fabf9c1e9c0 20 add_watcher() i=3 2024-09-12T00:37:07.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.027+0000 7fabf9c1e9c0 20 add_watcher() i=4 2024-09-12T00:37:07.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.027+0000 7fabf9c1e9c0 20 add_watcher() i=5 2024-09-12T00:37:07.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.027+0000 7fabf9c1e9c0 20 add_watcher() i=6 2024-09-12T00:37:07.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.031+0000 7fabf9c1e9c0 20 add_watcher() i=7 2024-09-12T00:37:07.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.031+0000 7fabf9c1e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:07.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.031+0000 7faaadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:07.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:07.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:07.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 5 note: GC not initialized 2024-09-12T00:37:07.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7faaacfe1640 20 reqs_thread_entry: start 2024-09-12T00:37:07.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:07.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 Filter name: none 2024-09-12T00:37:07.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7faa267fc640 20 reqs_thread_entry: start 2024-09-12T00:37:07.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:07.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:07.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:07.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:07.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:07.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:07.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:07.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.035+0000 7fabf9c1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:07.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.039+0000 7fabf9c1e9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:07.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.039+0000 7fabf9c1e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:07.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.039+0000 7faaadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:07.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.047+0000 7fabf9c1e9c0 20 remove_watcher() i=0 2024-09-12T00:37:07.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.047+0000 7fabf9c1e9c0 2 removed watcher, disabling cache 2024-09-12T00:37:07.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.047+0000 7fabf9c1e9c0 20 remove_watcher() i=1 2024-09-12T00:37:07.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.051+0000 7fabf9c1e9c0 20 remove_watcher() i=2 2024-09-12T00:37:07.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.051+0000 7fabf9c1e9c0 20 remove_watcher() i=3 2024-09-12T00:37:07.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.055+0000 7fabf9c1e9c0 20 remove_watcher() i=4 2024-09-12T00:37:07.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.055+0000 7fabf9c1e9c0 20 remove_watcher() i=5 2024-09-12T00:37:07.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.059+0000 7fabf9c1e9c0 20 remove_watcher() i=6 2024-09-12T00:37:07.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:07.059+0000 7fabf9c1e9c0 20 remove_watcher() i=7 2024-09-12T00:37:07.070 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:07.070 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:07.070 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-trim-reshard-log-entries id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:37:07.070 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:07.071 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:07.072 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:07.095 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:07.095 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:07.661 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:07.661 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:08.034 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:37:08.034 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:08.037 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:08.037 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:08.170 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:08.171 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:08.254 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:08.254 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:08.364 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:08.364 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:08.453 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:08.453 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:08.550 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:08.550 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:08.652 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:08.652 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:08.754 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:08.754 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:08.851 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:08.852 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:08.946 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:08.946 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:09.068 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:09.068 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:09.161 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:09.161 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:09.255 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:09.256 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:09.358 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:09.358 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:09.461 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:09.461 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:09.553 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:09.553 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:09.656 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:09.657 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:09.759 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:09.759 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:09.860 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:09.860 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:09.972 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:09.973 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:10.069 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:10.069 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:10.168 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:10.169 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:10.265 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:37:10.297 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:10.297 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:10.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.347+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.347+0000 7f92a23989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:10.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.347+0000 7f92a23989c0 20 realm 2024-09-12T00:37:10.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.347+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.347+0000 7f92a23989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:10.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.347+0000 7f92a23989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:10.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.347+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.347+0000 7f92a23989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:10.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.347+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.351+0000 7f92a23989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:10.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.351+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.351+0000 7f92a23989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:10.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.351+0000 7f92a23989c0 20 searching for the correct realm 2024-09-12T00:37:10.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.355+0000 7f92a069f640 0 -- 172.21.15.102:0/2367864676 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f928812bb70 msgr2=0x7f92880f7130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:10.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.571+0000 7f929f69d640 0 -- 172.21.15.102:0/2367864676 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f9298067120 msgr2=0x7f9298061640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:10.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.787+0000 7f92a23989c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:10.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.787+0000 7f92a23989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:10.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.787+0000 7f92a23989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:10.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.787+0000 7f92a23989c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:10.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.787+0000 7f92a23989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:10.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.787+0000 7f92a23989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:10.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.787+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:10.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:10.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:10.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 zone default found 2024-09-12T00:37:10.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 4 Realm: () 2024-09-12T00:37:10.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:10.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:10.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:10.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 zonegroup default 2024-09-12T00:37:10.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:10.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:10.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.791+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.795+0000 7f92a23989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:10.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.795+0000 7f92a23989c0 20 started sync module instance, tier type = 2024-09-12T00:37:10.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.795+0000 7f92a23989c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:10.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.823+0000 7f92a23989c0 20 add_watcher() i=0 2024-09-12T00:37:10.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.823+0000 7f92a23989c0 20 add_watcher() i=1 2024-09-12T00:37:10.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.823+0000 7f92a23989c0 20 add_watcher() i=2 2024-09-12T00:37:10.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.823+0000 7f92a23989c0 20 add_watcher() i=3 2024-09-12T00:37:10.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.823+0000 7f92a23989c0 20 add_watcher() i=4 2024-09-12T00:37:10.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.823+0000 7f92a23989c0 20 add_watcher() i=5 2024-09-12T00:37:10.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.823+0000 7f92a23989c0 20 add_watcher() i=6 2024-09-12T00:37:10.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.827+0000 7f92a23989c0 20 add_watcher() i=7 2024-09-12T00:37:10.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.827+0000 7f92a23989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:10.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.831+0000 7f9155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:10.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.831+0000 7f92a23989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:10.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.831+0000 7f92a23989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:10.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.831+0000 7f92a23989c0 5 note: GC not initialized 2024-09-12T00:37:10.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.831+0000 7f9154fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:10.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.831+0000 7f92a23989c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:10.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.831+0000 7f92a23989c0 20 Filter name: none 2024-09-12T00:37:10.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.831+0000 7f90ce7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:10.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.831+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.835+0000 7f92a23989c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:10.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.835+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.835+0000 7f92a23989c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:10.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.835+0000 7f92a23989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:10.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.835+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.835+0000 7f92a23989c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:10.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.835+0000 7f92a23989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.835+0000 7f92a23989c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:10.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.835+0000 7f92a23989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:10.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.839+0000 7f9155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:10.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.843+0000 7f92a23989c0 20 remove_watcher() i=0 2024-09-12T00:37:10.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.843+0000 7f92a23989c0 2 removed watcher, disabling cache 2024-09-12T00:37:10.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.847+0000 7f92a23989c0 20 remove_watcher() i=1 2024-09-12T00:37:10.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.847+0000 7f92a23989c0 20 remove_watcher() i=2 2024-09-12T00:37:10.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.851+0000 7f92a23989c0 20 remove_watcher() i=3 2024-09-12T00:37:10.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.855+0000 7f92a23989c0 20 remove_watcher() i=4 2024-09-12T00:37:10.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.855+0000 7f92a23989c0 20 remove_watcher() i=5 2024-09-12T00:37:10.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.855+0000 7f92a23989c0 20 remove_watcher() i=6 2024-09-12T00:37:10.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.859+0000 7f92a23989c0 20 remove_watcher() i=7 2024-09-12T00:37:10.871 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:10.871 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:10.871 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-trim-reshard-log-entries id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:10.871 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:10.871 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:37:10.905 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:10.905 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:10.949 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.951+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:10.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 realm 2024-09-12T00:37:10.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:10.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.955+0000 7f50cd1029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:10.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:10.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:10.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:10.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.959+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:10.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.959+0000 7f50cd1029c0 20 searching for the correct realm 2024-09-12T00:37:10.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:10.959+0000 7f50cb409640 0 -- 172.21.15.102:0/2472865248 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f50b40760c0 msgr2=0x7f50b40767e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:11.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.175+0000 7f50ca407640 0 -- 172.21.15.102:0/2472865248 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f50c407ab30 msgr2=0x7f50c406b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:11.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:11.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:11.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:11.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:11.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:11.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:11.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:11.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:11.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 zone default found 2024-09-12T00:37:11.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 4 Realm: () 2024-09-12T00:37:11.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:11.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:11.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:11.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 zonegroup default 2024-09-12T00:37:11.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 started sync module instance, tier type = 2024-09-12T00:37:11.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:11.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=0 2024-09-12T00:37:11.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=1 2024-09-12T00:37:11.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=2 2024-09-12T00:37:11.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=3 2024-09-12T00:37:11.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=4 2024-09-12T00:37:11.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=5 2024-09-12T00:37:11.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=6 2024-09-12T00:37:11.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.427+0000 7f50cd1029c0 20 add_watcher() i=7 2024-09-12T00:37:11.423 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.427+0000 7f50cd1029c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:11.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.431+0000 7f4f817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:11.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:11.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:11.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 note: GC not initialized 2024-09-12T00:37:11.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.431+0000 7f4efbfff640 20 reqs_thread_entry: start 2024-09-12T00:37:11.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:11.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 Filter name: none 2024-09-12T00:37:11.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.431+0000 7f4ef9ffb640 20 reqs_thread_entry: start 2024-09-12T00:37:11.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.431+0000 7f50cd1029c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:37:11.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:11.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:11.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:11.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 : miss 2024-09-12T00:37:11.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:11.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:11.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:11.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:11.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:11.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 2024-09-12T00:37:11.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:11.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:11.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:11.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28, ofs0, ns] 2024-09-12T00:37:11.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398928 cookie 94254171459520 notifier 6876 bl.length()=1023 2024-09-12T00:37:11.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:11.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:11.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:11.447 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f50cd1029c0 time 2024-09-12T00:37:11.455274+0000 2024-09-12T00:37:11.447 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:11.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_sources= new_sources= 2024-09-12T00:37:11.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential sources added=[] removed=[] 2024-09-12T00:37:11.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_dests= new_dests= 2024-09-12T00:37:11.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential dests added=[] removed=[] 2024-09-12T00:37:11.449 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:11.449 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f50d09dc2eb] 2024-09-12T00:37:11.449 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f50d09dc49f] 2024-09-12T00:37:11.449 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b93f594cc1] 2024-09-12T00:37:11.449 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422a3e) [0x55b93fff2a3e] 2024-09-12T00:37:11.449 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b93f5a9ced] 2024-09-12T00:37:11.449 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:37:11.449 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f50cf842d90] 2024-09-12T00:37:11.449 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:37:11.449 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:37:11.450 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:37:11.450 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f50cd1029c0 thread_name:radosgw-admin 2024-09-12T00:37:11.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.451+0000 7f50cd1029c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f50cd1029c0 time 2024-09-12T00:37:11.455274+0000 2024-09-12T00:37:11.450 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:11.450 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.450 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:11.450 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f50d09dc2eb] 2024-09-12T00:37:11.450 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f50d09dc49f] 2024-09-12T00:37:11.450 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b93f594cc1] 2024-09-12T00:37:11.450 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422a3e) [0x55b93fff2a3e] 2024-09-12T00:37:11.451 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b93f5a9ced] 2024-09-12T00:37:11.451 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:37:11.451 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f50cf842d90] 2024-09-12T00:37:11.451 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:37:11.451 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:37:11.451 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f50cf85b520] 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f50d09dc345] 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f50d09dc49f] 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b93f594cc1] 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422a3e) [0x55b93fff2a3e] 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b93f5a9ced] 2024-09-12T00:37:11.461 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:37:11.462 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f50cf842d90] 2024-09-12T00:37:11.462 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:37:11.462 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:37:11.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.451+0000 7f50cd1029c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:11.462 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f50cd1029c0 thread_name:radosgw-admin 2024-09-12T00:37:11.462 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.462 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:11.462 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f50cf85b520] 2024-09-12T00:37:11.462 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:37:11.462 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f50d09dc345] 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f50d09dc49f] 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b93f594cc1] 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422a3e) [0x55b93fff2a3e] 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b93f5a9ced] 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f50cf842d90] 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:37:11.463 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_done global_id 6449 payload 274 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient: _finish_hunting 0 2024-09-12T00:37:11.464 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:37:10.931+0000 7f50cb409640 1 monclient: found mon.noname-c 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:37:10.931+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b94243b120 auth_method 0 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: dump: 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.465 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.466 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.466 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.466 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.466 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.466 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: _finish_auth 0 2024-09-12T00:37:11.466 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: _check_auth_tickets 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: dump: 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.467 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 monclient: authenticate success, global_id 6449 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 4 set_mon_vals no callback set 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: shutdown 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) unregister_commands rotate-key 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: build_initial_monmap 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: monmap: 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:11.468 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding auth protocol: cephx 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding auth protocol: cephx 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding auth protocol: cephx 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.469 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.470 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.470 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.470 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.470 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.470 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.470 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.470 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.470 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.470 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 1 librados: starting msgr at 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 1 librados: starting objecter 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command objecter_requests hook 0x55b9423a8950 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 1 librados: setting wanted keys 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 1 librados: calling monclient init 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: init 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding auth protocol: cephx 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding auth protocol: cephx 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding auth protocol: cephx 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.471 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.472 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command rotate-key hook 0x55b94258ac28 2024-09-12T00:37:11.473 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:11.473 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:37:11.473 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-b con 0x55b94243b120 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:11.473 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-a con 0x55b942446e70 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:11.473 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-c con 0x55b9425913e0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:11.473 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.473 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): authenticate will time out at 2619.435296s 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): get_auth_request con 0x55b942446e70 auth_method 0 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): get_auth_request con 0x55b9425913e0 auth_method 0 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.474 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_done global_id 6867 payload 824 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient: _finish_hunting 0 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:37:10.931+0000 7f50ca407640 1 monclient: found mon.noname-a 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.475 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:11.476 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: dump: 2024-09-12T00:37:11.476 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.476 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.476 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.476 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.476 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.476 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.476 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.477 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.477 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.477 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.477 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: _finish_auth 0 2024-09-12T00:37:11.477 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: _check_auth_tickets 2024-09-12T00:37:11.477 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:11.477 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.477 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:11.477 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: dump: 2024-09-12T00:37:11.478 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.478 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.478 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.478 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.478 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.478 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.478 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.478 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.478 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 5 monclient: authenticate success, global_id 6867 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:37:10.935+0000 7f4fb8e09640 4 set_mon_vals no callback set 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 1 librados: init done 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:37:10.935+0000 7f4fb7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:37:10.935+0000 7f4fb7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:37:10.935+0000 7f4fb7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.479 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:37:10.935+0000 7f50cac08640 10 monclient: get_auth_request con 0x7f4fb0070b10 auth_method 0 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:37:10.935+0000 7f50cb409640 10 monclient: get_auth_request con 0x55b9425b2b70 auth_method 0 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:37:10.935+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b9425d5ad0 auth_method 0 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:37:10.939+0000 7f50ca407640 10 monclient: get_auth_request con 0x55b9425da170 auth_method 0 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:37:10.939+0000 7f50cb409640 10 monclient: get_auth_request con 0x55b9425de040 auth_method 0 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: build_initial_monmap 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: monmap: 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:11.480 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:11.481 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.481 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:11.481 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:11.481 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:11.481 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.481 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding auth protocol: cephx 2024-09-12T00:37:11.481 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding auth protocol: cephx 2024-09-12T00:37:11.481 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding auth protocol: cephx 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.482 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b9425e5bd0 EEXIST 2024-09-12T00:37:11.483 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: init 2024-09-12T00:37:11.483 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding auth protocol: cephx 2024-09-12T00:37:11.483 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding auth protocol: cephx 2024-09-12T00:37:11.483 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding auth protocol: cephx 2024-09-12T00:37:11.483 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.483 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.483 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.483 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.483 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.484 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.484 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.484 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.484 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.484 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.484 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.484 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.484 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.484 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.484 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command rotate-key cmddesc rotate-key hook 0x55b9425e11c0 EEXIST 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-a con 0x55b942609d80 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-c con 0x55b9426096b0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-b con 0x55b942608090 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): authenticate will time out at 2619.445550s 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): get_auth_request con 0x55b9426096b0 auth_method 0 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.485 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): get_auth_request con 0x55b942609d80 auth_method 0 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): handle_auth_done global_id 6455 payload 824 2024-09-12T00:37:11.486 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient: _finish_hunting 0 2024-09-12T00:37:11.487 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:37:10.943+0000 7f50cb409640 1 monclient: found mon.noname-c 2024-09-12T00:37:11.487 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:37:11.487 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:37:10.943+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b942608090 auth_method 0 2024-09-12T00:37:11.487 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.487 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:11.487 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: dump: 2024-09-12T00:37:11.487 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.487 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.487 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.487 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.488 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.488 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.488 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.488 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.488 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.488 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.488 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: _finish_auth 0 2024-09-12T00:37:11.488 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: _check_auth_tickets 2024-09-12T00:37:11.488 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 monclient: authenticate success, global_id 6455 2024-09-12T00:37:11.488 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: dump: 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.489 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:37:10.943+0000 7f50cbc0a640 4 set_mon_vals no callback set 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:37:10.947+0000 7f4fb4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:37:10.947+0000 7f4fb4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:37:10.947+0000 7f4fb4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: build_initial_monmap 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: monmap: 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:11.490 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:11.491 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:11.491 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:11.491 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.491 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:11.491 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:11.491 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:11.491 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.491 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding auth protocol: cephx 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding auth protocol: cephx 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding auth protocol: cephx 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.492 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.493 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.493 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:37:10.947+0000 7f50ca407640 10 monclient: get_auth_request con 0x7f4fa4070a10 auth_method 0 2024-09-12T00:37:11.493 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.493 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: init 2024-09-12T00:37:11.493 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding auth protocol: cephx 2024-09-12T00:37:11.493 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding auth protocol: cephx 2024-09-12T00:37:11.493 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding auth protocol: cephx 2024-09-12T00:37:11.493 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.494 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.494 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.494 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.494 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.494 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.494 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.494 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.494 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.494 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.494 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdbbeb2638 EEXIST 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-b con 0x55b94262d790 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-a con 0x55b94265de40 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-c con 0x55b942658ff0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.495 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): authenticate will time out at 2619.449785s 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): get_auth_request con 0x55b94265de40 auth_method 0 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): get_auth_request con 0x55b942658ff0 auth_method 0 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.496 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): handle_auth_done global_id 6873 payload 274 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient: _finish_hunting 0 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:37:10.947+0000 7f50cb409640 1 monclient: found mon.noname-a 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:37:10.947+0000 7f50ca407640 10 monclient: get_auth_request con 0x55b94262d790 auth_method 0 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: dump: 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.497 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.498 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.498 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.498 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.498 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.498 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.498 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.498 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: _finish_auth 0 2024-09-12T00:37:11.498 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:37:11.498 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:11.499 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.499 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:11.499 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: dump: 2024-09-12T00:37:11.499 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.499 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.499 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.499 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.499 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.499 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.499 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 monclient: authenticate success, global_id 6873 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 4 set_mon_vals no callback set 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: shutdown 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: build_initial_monmap 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: monmap: 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:11.500 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding auth protocol: cephx 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding auth protocol: cephx 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding auth protocol: cephx 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.501 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.502 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 librados: starting msgr at 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 librados: starting objecter 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b9426084f0 EEXIST 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 librados: setting wanted keys 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 librados: calling monclient init 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: init 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding auth protocol: cephx 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding auth protocol: cephx 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding auth protocol: cephx 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.503 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command rotate-key cmddesc rotate-key hook 0x55b94260bce8 EEXIST 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-c con 0x55b94262d790 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:11.504 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-a con 0x55b942658ff0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:11.505 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-b con 0x55b94265de40 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:11.505 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.505 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.505 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.505 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:11.505 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): authenticate will time out at 2619.452444s 2024-09-12T00:37:11.505 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): get_auth_request con 0x55b942658ff0 auth_method 0 2024-09-12T00:37:11.505 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.505 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.505 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): get_auth_request con 0x55b94262d790 auth_method 0 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): handle_auth_done global_id 6876 payload 824 2024-09-12T00:37:11.506 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient: _finish_hunting 0 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:37:10.951+0000 7f50cb409640 1 monclient: found mon.noname-a 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:37:10.951+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b94265de40 auth_method 0 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: dump: 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.507 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: _finish_auth 0 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: _check_auth_tickets 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: dump: 2024-09-12T00:37:11.508 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.509 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.509 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.509 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.509 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.509 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.509 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.509 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.509 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:37:10.951+0000 7f4fae7fc640 4 set_mon_vals no callback set 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 5 monclient: authenticate success, global_id 6876 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 1 librados: init done 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command cr dump hook 0x55b94264e618 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.510 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:37:10.951+0000 7f4facff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:37:10.951+0000 7f4facff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:37:10.951+0000 7f4facff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:37:10.955+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b942677110 auth_method 0 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:37:10.955+0000 7f50ca407640 10 monclient: get_auth_request con 0x7f4f94070b10 auth_method 0 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 realm 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.511 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:37:10.955+0000 7f50ca407640 10 monclient: get_auth_request con 0x55b94267b450 auth_method 0 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:37:10.955+0000 7f50cb409640 10 monclient: get_auth_request con 0x55b94267eb90 auth_method 0 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:37:10.959+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:37:10.959+0000 7f50cd1029c0 20 searching for the correct realm 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:37:10.959+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b9426838e0 auth_method 0 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:37:10.959+0000 7f50ca407640 10 monclient: get_auth_request con 0x7f50c40a03b0 auth_method 0 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:37:10.959+0000 7f50cb409640 10 monclient: get_auth_request con 0x7f50b40760c0 auth_method 0 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:37:10.959+0000 7f50cb409640 0 -- 172.21.15.102:0/2472865248 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f50b40760c0 msgr2=0x7f50b40767e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:37:11.163+0000 7f50cb409640 10 monclient: get_auth_request con 0x7f50b40760c0 auth_method 0 2024-09-12T00:37:11.512 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:37:11.167+0000 7f50cac08640 10 monclient: get_auth_request con 0x7f50c4062ae0 auth_method 0 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:37:11.175+0000 7f50ca407640 10 monclient: get_auth_request con 0x7f50c407ab30 auth_method 0 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:37:11.175+0000 7f50ca407640 0 -- 172.21.15.102:0/2472865248 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f50c407ab30 msgr2=0x7f50c406b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:37:11.379+0000 7f50ca407640 10 monclient: get_auth_request con 0x7f50c407ab30 auth_method 0 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:11.513 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 zone default found 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 4 Realm: () 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 zonegroup default 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 started sync module instance, tier type = 2024-09-12T00:37:11.514 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=0 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=1 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=2 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=3 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=4 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=5 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=6 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:37:11.427+0000 7f50cd1029c0 20 add_watcher() i=7 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:37:11.427+0000 7f50cd1029c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding auth protocol: cephx 2024-09-12T00:37:11.515 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding auth protocol: cephx 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding auth protocol: cephx 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.516 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:37:11.431+0000 7f4f817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command cache list hook 0x55b942653760 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command cache inspect hook 0x55b942653760 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command cache erase hook 0x55b942653760 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command cache zap hook 0x55b942653760 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 note: GC not initialized 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:37:11.431+0000 7f4efbfff640 20 reqs_thread_entry: start 2024-09-12T00:37:11.517 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command sync trace show hook 0x7f50b4004ab0 2024-09-12T00:37:11.518 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command sync trace history hook 0x7f50b4004ab0 2024-09-12T00:37:11.518 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command sync trace active hook 0x7f50b4004ab0 2024-09-12T00:37:11.518 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command sync trace active_short hook 0x7f50b4004ab0 2024-09-12T00:37:11.518 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:11.518 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 Filter name: none 2024-09-12T00:37:11.518 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:37:11.431+0000 7f4ef9ffb640 20 reqs_thread_entry: start 2024-09-12T00:37:11.518 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:37:11.518 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.518 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:11.518 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 : miss 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:11.519 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28, ofs0, ns] 2024-09-12T00:37:11.520 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398928 cookie 94254171459520 notifier 6876 bl.length()=1023 2024-09-12T00:37:11.520 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:11.520 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:11.520 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:11.520 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_sources= new_sources= 2024-09-12T00:37:11.520 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential sources added=[] removed=[] 2024-09-12T00:37:11.520 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_dests= new_dests= 2024-09-12T00:37:11.520 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential dests added=[] removed=[] 2024-09-12T00:37:11.520 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f50cd1029c0 time 2024-09-12T00:37:11.455274+0000 2024-09-12T00:37:11.521 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:11.521 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.521 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:11.521 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f50d09dc2eb] 2024-09-12T00:37:11.521 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f50d09dc49f] 2024-09-12T00:37:11.521 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b93f594cc1] 2024-09-12T00:37:11.521 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422a3e) [0x55b93fff2a3e] 2024-09-12T00:37:11.521 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b93f5a9ced] 2024-09-12T00:37:11.521 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:37:11.521 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f50cf842d90] 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f50cd1029c0 thread_name:radosgw-admin 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f50cf85b520] 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f50d09dc345] 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f50d09dc49f] 2024-09-12T00:37:11.522 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b93f594cc1] 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422a3e) [0x55b93fff2a3e] 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b93f5a9ced] 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f50cf842d90] 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:37:11.523 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:37:11.524 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:37:11.525 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:37:11.525 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:11.525 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:11.525 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:11.525 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:37:11.525 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:37:11.525 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:11.525 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:37:11.525 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:37:11.526 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:37:11.526 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:37:11.526 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:37:11.526 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:37:11.526 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:37:11.526 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:37:11.526 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:37:11.526 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:37:11.527 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:37:11.527 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:37:11.527 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:37:11.527 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:37:11.527 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:37:11.527 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:11.527 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:37:11.527 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:37:11.528 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:11.528 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:11.528 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:37:11.528 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:11.528 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:11.528 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:11.528 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:37:11.528 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:37:11.528 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:37:11.529 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:37:11.529 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:37:11.529 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:37:11.529 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:37:11.529 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:37:11.529 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:37:11.529 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:37:11.530 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:37:11.530 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:37:11.530 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:37:11.530 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:37:11.530 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:37:11.530 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:37:11.530 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:37:11.530 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:37:11.531 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:11.531 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:11.531 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:11.531 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:37:11.531 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:11.531 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:11.531 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:11.531 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:11.531 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:37:11.532 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:11.532 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:11.532 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:11.532 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:11.532 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:11.532 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:11.532 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:37:11.532 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:11.533 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:37:11.533 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:37:11.533 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:37:11.533 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:11.533 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:37:11.533 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:37:11.533 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:11.534 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:11.534 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:11.534 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:11.534 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4ef9ffb640 / http_manager 2024-09-12T00:37:11.534 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4efbfff640 / http_manager 2024-09-12T00:37:11.534 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4f817e2640 / rgw_dt_lg_renew 2024-09-12T00:37:11.534 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4facff9640 / ms_dispatch 2024-09-12T00:37:11.534 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4fae7fc640 / io_context_pool 2024-09-12T00:37:11.535 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4fb4e01640 / ms_dispatch 2024-09-12T00:37:11.535 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4fb7606640 / ms_dispatch 2024-09-12T00:37:11.535 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4fb8e09640 / io_context_pool 2024-09-12T00:37:11.535 INFO:tasks.workunit.client.0.smithi102.stderr: 7f50ca407640 / msgr-worker-2 2024-09-12T00:37:11.535 INFO:tasks.workunit.client.0.smithi102.stderr: 7f50cac08640 / msgr-worker-1 2024-09-12T00:37:11.535 INFO:tasks.workunit.client.0.smithi102.stderr: 7f50cb409640 / msgr-worker-0 2024-09-12T00:37:11.535 INFO:tasks.workunit.client.0.smithi102.stderr: 7f50cbc0a640 / io_context_pool 2024-09-12T00:37:11.535 INFO:tasks.workunit.client.0.smithi102.stderr: 7f50cd1029c0 / radosgw-admin 2024-09-12T00:37:11.535 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:37:11.536 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:37:11.536 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.101171.log 2024-09-12T00:37:11.536 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:37:11.536 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:37:11.536 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.536 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.536 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.536 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.537 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.537 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.537 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_done global_id 6449 payload 274 2024-09-12T00:37:11.537 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient: _finish_hunting 0 2024-09-12T00:37:11.537 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:37:10.931+0000 7f50cb409640 1 monclient: found mon.noname-c 2024-09-12T00:37:11.537 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:37:11.537 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:37:10.931+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b94243b120 auth_method 0 2024-09-12T00:37:11.537 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.538 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:11.538 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: dump: 2024-09-12T00:37:11.538 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.538 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.538 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.538 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.538 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.538 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.538 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.539 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.539 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.539 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.539 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: _finish_auth 0 2024-09-12T00:37:11.539 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: _check_auth_tickets 2024-09-12T00:37:11.539 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:11.539 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.539 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:11.540 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:37:10.931+0000 7f4fb8e09640 10 monclient: dump: 2024-09-12T00:37:11.540 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.540 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.540 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.540 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.540 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.540 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.540 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.540 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.540 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 monclient: authenticate success, global_id 6449 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 4 set_mon_vals no callback set 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: shutdown 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) unregister_commands rotate-key 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: build_initial_monmap 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: monmap: 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:11.541 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding auth protocol: cephx 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding auth protocol: cephx 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding auth protocol: cephx 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.542 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: crc 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b942590010) adding con mode: secure 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 1 librados: starting msgr at 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 1 librados: starting objecter 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command objecter_requests hook 0x55b9423a8950 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 1 librados: setting wanted keys 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 1 librados: calling monclient init 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: init 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding auth protocol: cephx 2024-09-12T00:37:11.543 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding auth protocol: cephx 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding auth protocol: cephx 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: crc 2024-09-12T00:37:11.544 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 AuthRegistry(0x55b94258aae0) adding con mode: secure 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command rotate-key hook 0x55b94258ac28 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-b con 0x55b94243b120 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-a con 0x55b942446e70 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-c con 0x55b9425913e0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:11.545 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:37:10.931+0000 7f50cd1029c0 10 monclient(hunting): authenticate will time out at 2619.435296s 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): get_auth_request con 0x55b942446e70 auth_method 0 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): get_auth_request con 0x55b9425913e0 auth_method 0 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:37:10.931+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.546 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient(hunting): handle_auth_done global_id 6867 payload 824 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient: _finish_hunting 0 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:37:10.931+0000 7f50ca407640 1 monclient: found mon.noname-a 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:37:10.931+0000 7f50ca407640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: dump: 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.547 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: _finish_auth 0 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: _check_auth_tickets 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:37:10.935+0000 7f4fb7606640 10 monclient: dump: 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.548 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 5 monclient: authenticate success, global_id 6867 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:37:10.935+0000 7f4fb8e09640 4 set_mon_vals no callback set 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:37:10.935+0000 7f50cd1029c0 1 librados: init done 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:37:10.935+0000 7f4fb7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:37:10.935+0000 7f4fb7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:37:10.935+0000 7f4fb7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.549 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:37:10.935+0000 7f50cac08640 10 monclient: get_auth_request con 0x7f4fb0070b10 auth_method 0 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:37:10.935+0000 7f50cb409640 10 monclient: get_auth_request con 0x55b9425b2b70 auth_method 0 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:37:10.935+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b9425d5ad0 auth_method 0 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:37:10.939+0000 7f50ca407640 10 monclient: get_auth_request con 0x55b9425da170 auth_method 0 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:37:10.939+0000 7f50cb409640 10 monclient: get_auth_request con 0x55b9425de040 auth_method 0 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: build_initial_monmap 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: monmap: 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:11.550 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding auth protocol: cephx 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding auth protocol: cephx 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding auth protocol: cephx 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.551 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: crc 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e2270) adding con mode: secure 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b9425e5bd0 EEXIST 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: init 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding auth protocol: cephx 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding auth protocol: cephx 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding auth protocol: cephx 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.552 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: crc 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 AuthRegistry(0x55b9425e1078) adding con mode: secure 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command rotate-key cmddesc rotate-key hook 0x55b9425e11c0 EEXIST 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-a con 0x55b942609d80 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-c con 0x55b9426096b0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:11.553 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-b con 0x55b942608090 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient(hunting): authenticate will time out at 2619.445550s 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): get_auth_request con 0x55b9426096b0 auth_method 0 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): get_auth_request con 0x55b942609d80 auth_method 0 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.554 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:37:10.943+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient(hunting): handle_auth_done global_id 6455 payload 824 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient: _finish_hunting 0 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:37:10.943+0000 7f50cb409640 1 monclient: found mon.noname-c 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:37:10.943+0000 7f50cb409640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:37:10.943+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b942608090 auth_method 0 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: dump: 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.555 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: _finish_auth 0 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: _check_auth_tickets 2024-09-12T00:37:11.556 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 5 monclient: authenticate success, global_id 6455 2024-09-12T00:37:11.557 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.557 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:37:11.557 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:11.557 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.557 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:11.557 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:37:10.943+0000 7f4fb4e01640 10 monclient: dump: 2024-09-12T00:37:11.557 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.557 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.557 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:37:10.943+0000 7f50cbc0a640 4 set_mon_vals no callback set 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:37:10.943+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:37:10.947+0000 7f4fb4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:37:10.947+0000 7f4fb4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:37:10.947+0000 7f4fb4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:11.558 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: build_initial_monmap 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: monmap: 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding auth protocol: cephx 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding auth protocol: cephx 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding auth protocol: cephx 2024-09-12T00:37:11.559 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: crc 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b9426296d0) adding con mode: secure 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:37:10.947+0000 7f50ca407640 10 monclient: get_auth_request con 0x7f4fa4070a10 auth_method 0 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: init 2024-09-12T00:37:11.560 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding auth protocol: cephx 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding auth protocol: cephx 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding auth protocol: cephx 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.561 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: crc 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb24f0) adding con mode: secure 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdbbeb2638 EEXIST 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-b con 0x55b94262d790 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-a con 0x55b94265de40 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-c con 0x55b942658ff0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.562 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient(hunting): authenticate will time out at 2619.449785s 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): get_auth_request con 0x55b94265de40 auth_method 0 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): get_auth_request con 0x55b942658ff0 auth_method 0 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.563 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:37:10.947+0000 7f50cac08640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient(hunting): handle_auth_done global_id 6873 payload 274 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient: _finish_hunting 0 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:37:10.947+0000 7f50cb409640 1 monclient: found mon.noname-a 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:37:10.947+0000 7f50cb409640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:37:10.947+0000 7f50ca407640 10 monclient: get_auth_request con 0x55b94262d790 auth_method 0 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: dump: 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.564 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: _finish_auth 0 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:11.565 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:37:10.947+0000 7f4fae7fc640 10 monclient: dump: 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 monclient: authenticate success, global_id 6873 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 4 set_mon_vals no callback set 2024-09-12T00:37:11.566 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: shutdown 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: build_initial_monmap 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: monmap: 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:11.567 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding auth protocol: cephx 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding auth protocol: cephx 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding auth protocol: cephx 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.568 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: crc 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b942650040) adding con mode: secure 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 librados: starting msgr at 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 librados: starting objecter 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b9426084f0 EEXIST 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 librados: setting wanted keys 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 1 librados: calling monclient init 2024-09-12T00:37:11.569 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 10 monclient: init 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding auth protocol: cephx 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding auth protocol: cephx 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding auth protocol: cephx 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.570 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.571 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.571 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: crc 2024-09-12T00:37:11.571 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:37:10.947+0000 7f50cd1029c0 5 AuthRegistry(0x55b94260bba0) adding con mode: secure 2024-09-12T00:37:11.571 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.571 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.571 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command rotate-key cmddesc rotate-key hook 0x55b94260bce8 EEXIST 2024-09-12T00:37:11.571 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:11.571 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:37:11.571 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-c con 0x55b94262d790 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:11.571 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-a con 0x55b942658ff0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): picked mon.noname-b con 0x55b94265de40 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient(hunting): authenticate will time out at 2619.452444s 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): get_auth_request con 0x55b942658ff0 auth_method 0 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): get_auth_request con 0x55b94262d790 auth_method 0 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:11.572 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:37:10.951+0000 7f50ca407640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient(hunting): handle_auth_done global_id 6876 payload 824 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient: _finish_hunting 0 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:37:10.951+0000 7f50cb409640 1 monclient: found mon.noname-a 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:37:10.951+0000 7f50cb409640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:37:10.951+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b94265de40 auth_method 0 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:11.573 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: dump: 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: _finish_auth 0 2024-09-12T00:37:11.574 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: _check_auth_tickets 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:37:10.951+0000 7f4facff9640 10 monclient: dump: 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:11.575 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:37:10.951+0000 7f4fae7fc640 4 set_mon_vals no callback set 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 5 monclient: authenticate success, global_id 6876 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _renew_subs 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 1 librados: init done 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command cr dump hook 0x55b94264e618 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:37:10.951+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:37:10.951+0000 7f4facff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:11.576 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:37:10.951+0000 7f4facff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:37:10.951+0000 7f4facff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:37:10.955+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b942677110 auth_method 0 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:37:10.955+0000 7f50ca407640 10 monclient: get_auth_request con 0x7f4f94070b10 auth_method 0 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 realm 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:37:10.955+0000 7f50ca407640 10 monclient: get_auth_request con 0x55b94267b450 auth_method 0 2024-09-12T00:37:11.577 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:37:10.955+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:37:10.955+0000 7f50cb409640 10 monclient: get_auth_request con 0x55b94267eb90 auth_method 0 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:37:10.959+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:37:10.959+0000 7f50cd1029c0 20 searching for the correct realm 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:37:10.959+0000 7f50cac08640 10 monclient: get_auth_request con 0x55b9426838e0 auth_method 0 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:37:10.959+0000 7f50ca407640 10 monclient: get_auth_request con 0x7f50c40a03b0 auth_method 0 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:37:10.959+0000 7f50cb409640 10 monclient: get_auth_request con 0x7f50b40760c0 auth_method 0 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:37:10.959+0000 7f50cb409640 0 -- 172.21.15.102:0/2472865248 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f50b40760c0 msgr2=0x7f50b40767e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:37:11.163+0000 7f50cb409640 10 monclient: get_auth_request con 0x7f50b40760c0 auth_method 0 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:37:11.167+0000 7f50cac08640 10 monclient: get_auth_request con 0x7f50c4062ae0 auth_method 0 2024-09-12T00:37:11.578 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:37:11.175+0000 7f50ca407640 10 monclient: get_auth_request con 0x7f50c407ab30 auth_method 0 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:37:11.175+0000 7f50ca407640 0 -- 172.21.15.102:0/2472865248 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f50c407ab30 msgr2=0x7f50c406b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:37:11.379+0000 7f50ca407640 10 monclient: get_auth_request con 0x7f50c407ab30 auth_method 0 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:37:11.391+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.579 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 zone default found 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 4 Realm: () 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 zonegroup default 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 started sync module instance, tier type = 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:37:11.395+0000 7f50cd1029c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:11.580 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=0 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=1 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=2 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=3 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=4 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=5 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:37:11.423+0000 7f50cd1029c0 20 add_watcher() i=6 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:37:11.427+0000 7f50cd1029c0 20 add_watcher() i=7 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:37:11.427+0000 7f50cd1029c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding auth protocol: cephx 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding auth protocol: cephx 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding auth protocol: cephx 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.581 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: crc 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 AuthRegistry(0x7ffdbbeb29d0) adding con mode: secure 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:37:11.431+0000 7f4f817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:11.582 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command cache list hook 0x55b942653760 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command cache inspect hook 0x55b942653760 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command cache erase hook 0x55b942653760 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command cache zap hook 0x55b942653760 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 note: GC not initialized 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:37:11.431+0000 7f4efbfff640 20 reqs_thread_entry: start 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command sync trace show hook 0x7f50b4004ab0 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command sync trace history hook 0x7f50b4004ab0 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command sync trace active hook 0x7f50b4004ab0 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 5 asok(0x55b94237d2b0) register_command sync trace active_short hook 0x7f50b4004ab0 2024-09-12T00:37:11.583 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:11.584 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 Filter name: none 2024-09-12T00:37:11.584 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:37:11.431+0000 7f4ef9ffb640 20 reqs_thread_entry: start 2024-09-12T00:37:11.584 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:37:11.584 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:37:11.431+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.584 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:11.584 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:11.584 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 : miss 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:37:11.435+0000 7f50cd1029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:37:11.447+0000 7f50cd1029c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28, ofs0, ns] 2024-09-12T00:37:11.585 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398928 cookie 94254171459520 notifier 6876 bl.length()=1023 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:37:11.447+0000 7f4fae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_sources= new_sources= 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential sources added=[] removed=[] 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_dests= new_dests= 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential dests added=[] removed=[] 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f50cd1029c0 time 2024-09-12T00:37:11.455274+0000 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:11.586 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f50d09dc2eb] 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f50d09dc49f] 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b93f594cc1] 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422a3e) [0x55b93fff2a3e] 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b93f5a9ced] 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f50cf842d90] 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:37:11.451+0000 7f50cd1029c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f50cd1029c0 thread_name:radosgw-admin 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.587 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f50cf85b520] 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f50d09dc345] 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f50d09dc49f] 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b93f594cc1] 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422a3e) [0x55b93fff2a3e] 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b93f5a9ced] 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f50cf842d90] 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:37:11.588 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:11.589 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:37:11.590 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:11.591 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:37:11.592 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:37:11.593 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:11.594 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:11.595 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:11.595 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:11.595 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:37:11.595 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:11.595 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:37:11.595 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:37:11.595 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:37:11.595 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:11.595 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4ef9ffb640 / http_manager 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4efbfff640 / http_manager 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4f817e2640 / rgw_dt_lg_renew 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4facff9640 / ms_dispatch 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4fae7fc640 / io_context_pool 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4fb4e01640 / ms_dispatch 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4fb7606640 / ms_dispatch 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 7f4fb8e09640 / io_context_pool 2024-09-12T00:37:11.596 INFO:tasks.workunit.client.0.smithi102.stderr: 7f50ca407640 / msgr-worker-2 2024-09-12T00:37:11.597 INFO:tasks.workunit.client.0.smithi102.stderr: 7f50cac08640 / msgr-worker-1 2024-09-12T00:37:11.597 INFO:tasks.workunit.client.0.smithi102.stderr: 7f50cb409640 / msgr-worker-0 2024-09-12T00:37:11.597 INFO:tasks.workunit.client.0.smithi102.stderr: 7f50cbc0a640 / io_context_pool 2024-09-12T00:37:11.597 INFO:tasks.workunit.client.0.smithi102.stderr: 7f50cd1029c0 / radosgw-admin 2024-09-12T00:37:11.597 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:37:11.597 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:37:11.597 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:37:11.457769Z_8e463e41-3c65-467a-8ce6-85b6de398338/log 2024-09-12T00:37:11.597 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:37:11.597 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:37:11.598 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:37:11.598 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:11.598 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:11.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.747+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.747+0000 7f3a6a5129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.747+0000 7f3a6a5129c0 20 realm 2024-09-12T00:37:11.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.747+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.747+0000 7f3a6a5129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.747+0000 7f3a6a5129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:11.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.747+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.747+0000 7f3a6a5129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.747+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.751+0000 7f3a6a5129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:11.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.751+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.751+0000 7f3a6a5129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:11.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.751+0000 7f3a6a5129c0 20 searching for the correct realm 2024-09-12T00:37:11.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.755+0000 7f3a67817640 0 -- 172.21.15.102:0/1955958568 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f3a600d0060 msgr2=0x7f3a6012e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:11.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.967+0000 7f3a68819640 0 -- 172.21.15.102:0/1955958568 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55eecb9c65c0 msgr2=0x55eecb9c89b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:11.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:11.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:11.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:11.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:11.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:11.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:11.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:11.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:11.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 zone default found 2024-09-12T00:37:11.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 4 Realm: () 2024-09-12T00:37:11.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:11.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:11.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:11.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 zonegroup default 2024-09-12T00:37:11.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.987+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.991+0000 7f3a6a5129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.991+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.991+0000 7f3a6a5129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.991+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:11.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.991+0000 7f3a6a5129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:11.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.991+0000 7f3a6a5129c0 20 started sync module instance, tier type = 2024-09-12T00:37:11.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:11.991+0000 7f3a6a5129c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:12.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.019+0000 7f3a6a5129c0 20 add_watcher() i=0 2024-09-12T00:37:12.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.019+0000 7f3a6a5129c0 20 add_watcher() i=1 2024-09-12T00:37:12.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.019+0000 7f3a6a5129c0 20 add_watcher() i=2 2024-09-12T00:37:12.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.019+0000 7f3a6a5129c0 20 add_watcher() i=3 2024-09-12T00:37:12.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.019+0000 7f3a6a5129c0 20 add_watcher() i=4 2024-09-12T00:37:12.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.019+0000 7f3a6a5129c0 20 add_watcher() i=5 2024-09-12T00:37:12.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.019+0000 7f3a6a5129c0 20 add_watcher() i=6 2024-09-12T00:37:12.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.023+0000 7f3a6a5129c0 20 add_watcher() i=7 2024-09-12T00:37:12.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.023+0000 7f3a6a5129c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:12.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.027+0000 7f391efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:12.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.027+0000 7f3a6a5129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:12.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.027+0000 7f3a6a5129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:12.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.027+0000 7f3a6a5129c0 5 note: GC not initialized 2024-09-12T00:37:12.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.027+0000 7f391dfdb640 20 reqs_thread_entry: start 2024-09-12T00:37:12.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.027+0000 7f3a6a5129c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:12.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.027+0000 7f3a6a5129c0 20 Filter name: none 2024-09-12T00:37:12.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.027+0000 7f388f7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:12.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.027+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.031+0000 7f3a6a5129c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:12.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.031+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.031+0000 7f3a6a5129c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:37:12.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.031+0000 7f3a6a5129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:12.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.031+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.031+0000 7f3a6a5129c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:12.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.031+0000 7f3a6a5129c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.031+0000 7f3a6a5129c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:37:12.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.031+0000 7f3a6a5129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:12.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.035+0000 7f391efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:12.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.039+0000 7f3a6a5129c0 20 remove_watcher() i=0 2024-09-12T00:37:12.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.039+0000 7f3a6a5129c0 2 removed watcher, disabling cache 2024-09-12T00:37:12.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.043+0000 7f3a6a5129c0 20 remove_watcher() i=1 2024-09-12T00:37:12.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.043+0000 7f3a6a5129c0 20 remove_watcher() i=2 2024-09-12T00:37:12.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.047+0000 7f3a6a5129c0 20 remove_watcher() i=3 2024-09-12T00:37:12.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.047+0000 7f3a6a5129c0 20 remove_watcher() i=4 2024-09-12T00:37:12.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.051+0000 7f3a6a5129c0 20 remove_watcher() i=5 2024-09-12T00:37:12.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.051+0000 7f3a6a5129c0 20 remove_watcher() i=6 2024-09-12T00:37:12.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.055+0000 7f3a6a5129c0 20 remove_watcher() i=7 2024-09-12T00:37:12.070 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:12.070 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:12.070 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-trim-reshard-log-entries id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:12.070 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:12.071 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:12.071 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:12.130 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:12.130 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:12.216 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:12.252 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:12.252 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:12.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.303+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.303+0000 7f89ac04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:12.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.303+0000 7f89ac04a9c0 20 realm 2024-09-12T00:37:12.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.303+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.303+0000 7f89ac04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:12.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.303+0000 7f89ac04a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:12.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.303+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.303+0000 7f89ac04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:12.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.303+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.307+0000 7f89ac04a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:12.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.307+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.307+0000 7f89ac04a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:12.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.307+0000 7f89ac04a9c0 20 searching for the correct realm 2024-09-12T00:37:12.308 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.311+0000 7f89aa351640 0 -- 172.21.15.102:0/610618276 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f8994051040 msgr2=0x7f8994051930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:12.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.319+0000 7f89a934f640 0 -- 172.21.15.102:0/610618276 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f89a40667b0 msgr2=0x7f89a4064920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:12.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.535+0000 7f89ac04a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:12.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.535+0000 7f89ac04a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:12.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.535+0000 7f89ac04a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:12.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.535+0000 7f89ac04a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:12.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.535+0000 7f89ac04a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:12.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.535+0000 7f89ac04a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:12.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.535+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.535+0000 7f89ac04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:12.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.535+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.535+0000 7f89ac04a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:12.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:12.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 zone default found 2024-09-12T00:37:12.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 4 Realm: () 2024-09-12T00:37:12.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:12.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:12.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:12.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 zonegroup default 2024-09-12T00:37:12.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:12.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:12.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:12.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 started sync module instance, tier type = 2024-09-12T00:37:12.539 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.539+0000 7f89ac04a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:12.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.563+0000 7f89ac04a9c0 20 add_watcher() i=0 2024-09-12T00:37:12.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.563+0000 7f89ac04a9c0 20 add_watcher() i=1 2024-09-12T00:37:12.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.563+0000 7f89ac04a9c0 20 add_watcher() i=2 2024-09-12T00:37:12.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.563+0000 7f89ac04a9c0 20 add_watcher() i=3 2024-09-12T00:37:12.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.563+0000 7f89ac04a9c0 20 add_watcher() i=4 2024-09-12T00:37:12.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.563+0000 7f89ac04a9c0 20 add_watcher() i=5 2024-09-12T00:37:12.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.563+0000 7f89ac04a9c0 20 add_watcher() i=6 2024-09-12T00:37:12.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.567+0000 7f89ac04a9c0 20 add_watcher() i=7 2024-09-12T00:37:12.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.567+0000 7f89ac04a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:12.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.571+0000 7f885b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:12.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.571+0000 7f89ac04a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:12.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.571+0000 7f89ac04a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:12.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.571+0000 7f89ac04a9c0 5 note: GC not initialized 2024-09-12T00:37:12.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.571+0000 7f885a7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:12.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.571+0000 7f89ac04a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:12.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.571+0000 7f89ac04a9c0 20 Filter name: none 2024-09-12T00:37:12.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.571+0000 7f87cbfff640 20 reqs_thread_entry: start 2024-09-12T00:37:12.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:37:12.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:12.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:12.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:12.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 : miss 2024-09-12T00:37:12.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:12.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:37:12.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:12.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:12.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:12.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:12.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.575+0000 7f89ac04a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 2024-09-12T00:37:12.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.579+0000 7f89ac04a9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to be held by another RGW process; skipping for now 2024-09-12T00:37:12.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.579+0000 7f885b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:12.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.583+0000 7f89ac04a9c0 20 remove_watcher() i=0 2024-09-12T00:37:12.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.583+0000 7f89ac04a9c0 2 removed watcher, disabling cache 2024-09-12T00:37:12.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.587+0000 7f89ac04a9c0 20 remove_watcher() i=1 2024-09-12T00:37:12.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.591+0000 7f89ac04a9c0 20 remove_watcher() i=2 2024-09-12T00:37:12.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.591+0000 7f89ac04a9c0 20 remove_watcher() i=3 2024-09-12T00:37:12.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.595+0000 7f89ac04a9c0 20 remove_watcher() i=4 2024-09-12T00:37:12.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.595+0000 7f89ac04a9c0 20 remove_watcher() i=5 2024-09-12T00:37:12.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.595+0000 7f89ac04a9c0 20 remove_watcher() i=6 2024-09-12T00:37:12.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:12.599+0000 7f89ac04a9c0 20 remove_watcher() i=7 2024-09-12T00:37:12.611 INFO:tasks.workunit.client.0.smithi102.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:37:42.641 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:42.674 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:42.675 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:42.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.722+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:42.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:42.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 realm 2024-09-12T00:37:42.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:42.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:42.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:42.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:42.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:42.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:42.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:42.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:42.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:42.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.726+0000 7f8a7a06d9c0 20 searching for the correct realm 2024-09-12T00:37:42.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.730+0000 7f8a78374640 0 -- 172.21.15.102:0/3666669405 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f8a6c029070 msgr2=0x7f8a6c038430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:42.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:42.946+0000 7f8a77372640 0 -- 172.21.15.102:0/3666669405 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f8a6806c0e0 msgr2=0x7f8a68066900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:43.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.162+0000 7f8a7a06d9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:43.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.162+0000 7f8a7a06d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:43.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.162+0000 7f8a7a06d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:43.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.162+0000 7f8a7a06d9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:43.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.162+0000 7f8a7a06d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:43.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.162+0000 7f8a7a06d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:43.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.162+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.162+0000 7f8a7a06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.162+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:43.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:43.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 zone default found 2024-09-12T00:37:43.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 4 Realm: () 2024-09-12T00:37:43.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:43.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:43.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:43.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 zonegroup default 2024-09-12T00:37:43.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 started sync module instance, tier type = 2024-09-12T00:37:43.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.166+0000 7f8a7a06d9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:43.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.190+0000 7f8a7a06d9c0 20 add_watcher() i=0 2024-09-12T00:37:43.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.190+0000 7f8a7a06d9c0 20 add_watcher() i=1 2024-09-12T00:37:43.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.190+0000 7f8a7a06d9c0 20 add_watcher() i=2 2024-09-12T00:37:43.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.190+0000 7f8a7a06d9c0 20 add_watcher() i=3 2024-09-12T00:37:43.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.190+0000 7f8a7a06d9c0 20 add_watcher() i=4 2024-09-12T00:37:43.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.190+0000 7f8a7a06d9c0 20 add_watcher() i=5 2024-09-12T00:37:43.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.190+0000 7f8a7a06d9c0 20 add_watcher() i=6 2024-09-12T00:37:43.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.194+0000 7f8a7a06d9c0 20 add_watcher() i=7 2024-09-12T00:37:43.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.194+0000 7f8a7a06d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:43.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.198+0000 7f892dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:43.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.198+0000 7f8a7a06d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:43.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.198+0000 7f8a7a06d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:43.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.198+0000 7f8a7a06d9c0 5 note: GC not initialized 2024-09-12T00:37:43.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.198+0000 7f892cfe1640 20 reqs_thread_entry: start 2024-09-12T00:37:43.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.198+0000 7f8a7a06d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:43.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 20 Filter name: none 2024-09-12T00:37:43.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f88a67fc640 20 reqs_thread_entry: start 2024-09-12T00:37:43.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:37:43.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:43.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:37:43.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:37:43.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 : miss 2024-09-12T00:37:43.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:37:43.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:43.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:43.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:43.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:43.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.202+0000 7f8a7a06d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 2024-09-12T00:37:43.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.206+0000 7f8a7a06d9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:37:43.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.218+0000 7f8a7a06d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:43.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.218+0000 7f8a7a06d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:43.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.218+0000 7f8a7a06d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:43.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.218+0000 7f8a7a06d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28, ofs0, ns] 2024-09-12T00:37:43.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.218+0000 7f89567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398929 cookie 93957631647760 notifier 6512 bl.length()=1023 2024-09-12T00:37:43.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.218+0000 7f89567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:43.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.218+0000 7f89567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:43.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.218+0000 7f89567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:43.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.222+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_sources= new_sources= 2024-09-12T00:37:43.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.222+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential sources added=[] removed=[] 2024-09-12T00:37:43.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.222+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_dests= new_dests= 2024-09-12T00:37:43.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.222+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential dests added=[] removed=[] 2024-09-12T00:37:43.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.0 2024-09-12T00:37:43.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.0 2024-09-12T00:37:43.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.1 2024-09-12T00:37:43.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.1 2024-09-12T00:37:43.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.2 2024-09-12T00:37:43.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.2 2024-09-12T00:37:43.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.3 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.3 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.4 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.4 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.5 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.5 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.6 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.6 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.7 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.7 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.8 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.8 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.9 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.9 2024-09-12T00:37:43.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.10 2024-09-12T00:37:43.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.10 2024-09-12T00:37:43.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.11 2024-09-12T00:37:43.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2.11 2024-09-12T00:37:43.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.230+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.0 2024-09-12T00:37:43.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.234+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.1 2024-09-12T00:37:43.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.234+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2 2024-09-12T00:37:43.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.234+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.3 2024-09-12T00:37:43.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.234+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.4 2024-09-12T00:37:43.234 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.238+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.5 2024-09-12T00:37:43.235 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.238+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.6 2024-09-12T00:37:43.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.238+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.7 2024-09-12T00:37:43.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.238+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.8 2024-09-12T00:37:43.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.242+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.9 2024-09-12T00:37:43.240 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.242+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.10 2024-09-12T00:37:43.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.246+0000 7f8a7a06d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:43.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.246+0000 7f8a7a06d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 2024-09-12T00:37:43.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.250+0000 7f8a7a06d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:43.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.250+0000 7f8a7a06d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:43.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.250+0000 7f8a7a06d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:43.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.250+0000 7f8a7a06d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28, ofs0, ns] 2024-09-12T00:37:43.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.250+0000 7f8956ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398930 cookie 93957631647760 notifier 6512 bl.length()=1023 2024-09-12T00:37:43.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.250+0000 7f8956ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:43.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.250+0000 7f8956ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:43.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.250+0000 7f8956ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:43.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.254+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_sources= new_sources= 2024-09-12T00:37:43.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.254+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential sources added=[] removed=[] 2024-09-12T00:37:43.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.254+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_dests= new_dests= 2024-09-12T00:37:43.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.254+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential dests added=[] removed=[] 2024-09-12T00:37:43.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.258+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.0 2024-09-12T00:37:43.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.258+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.1 2024-09-12T00:37:43.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.258+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.2 2024-09-12T00:37:43.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.262+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.3 2024-09-12T00:37:43.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.262+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.4 2024-09-12T00:37:43.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.262+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.5 2024-09-12T00:37:43.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.262+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.6 2024-09-12T00:37:43.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.262+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.7 2024-09-12T00:37:43.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.262+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.8 2024-09-12T00:37:43.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.266+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.9 2024-09-12T00:37:43.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.266+0000 7f8a7a06d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28.10 2024-09-12T00:37:43.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.266+0000 7f8a7a06d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:43.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.266+0000 7f8a7a06d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 2024-09-12T00:37:43.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.270+0000 7f8a7a06d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:43.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.270+0000 7f8a7a06d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:43.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.270+0000 7f8a7a06d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:43.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.270+0000 7f8a7a06d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28, ofs0, ns] 2024-09-12T00:37:43.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.270+0000 7f8956ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398931 cookie 93957631647760 notifier 6512 bl.length()=991 2024-09-12T00:37:43.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.270+0000 7f8956ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 info.flags=0x17 2024-09-12T00:37:43.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.270+0000 7f8956ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 to cache LRU end 2024-09-12T00:37:43.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.270+0000 7f8956ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:43.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.274+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_sources= new_sources= 2024-09-12T00:37:43.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.274+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential sources added=[] removed=[] 2024-09-12T00:37:43.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.274+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): orig_dests= new_dests= 2024-09-12T00:37:43.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.274+0000 7f8a7a06d9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28]): potential dests added=[] removed=[] 2024-09-12T00:37:43.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.278+0000 7f8a7a06d9c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:43.279 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.282+0000 7f892dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:43.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.286+0000 7f8a7a06d9c0 20 remove_watcher() i=0 2024-09-12T00:37:43.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.286+0000 7f8a7a06d9c0 2 removed watcher, disabling cache 2024-09-12T00:37:43.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.290+0000 7f8a7a06d9c0 20 remove_watcher() i=1 2024-09-12T00:37:43.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.290+0000 7f8a7a06d9c0 20 remove_watcher() i=2 2024-09-12T00:37:43.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.294+0000 7f8a7a06d9c0 20 remove_watcher() i=3 2024-09-12T00:37:43.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.294+0000 7f8a7a06d9c0 20 remove_watcher() i=4 2024-09-12T00:37:43.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.298+0000 7f8a7a06d9c0 20 remove_watcher() i=5 2024-09-12T00:37:43.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.298+0000 7f8a7a06d9c0 20 remove_watcher() i=6 2024-09-12T00:37:43.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.302+0000 7f8a7a06d9c0 20 remove_watcher() i=7 2024-09-12T00:37:43.315 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:37:43.344 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:43.344 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:43.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.390+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.390+0000 7f2e806ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.390+0000 7f2e806ed9c0 20 realm 2024-09-12T00:37:43.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.390+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.390+0000 7f2e806ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.390+0000 7f2e806ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:43.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.390+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.390+0000 7f2e806ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.390+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.394+0000 7f2e806ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:43.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.394+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.394+0000 7f2e806ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:43.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.394+0000 7f2e806ed9c0 20 searching for the correct realm 2024-09-12T00:37:43.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.398+0000 7f2e7e9f4640 0 -- 172.21.15.102:0/843385460 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f2e74042030 msgr2=0x7f2e74019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:43.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.614+0000 7f2e7d9f2640 0 -- 172.21.15.102:0/843385460 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f2e7812d320 msgr2=0x7f2e780f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:43.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.830+0000 7f2e806ed9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:43.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.830+0000 7f2e806ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:43.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.830+0000 7f2e806ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:43.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.830+0000 7f2e806ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:43.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.830+0000 7f2e806ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:43.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.830+0000 7f2e806ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:43.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.830+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:43.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:43.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 20 zone default found 2024-09-12T00:37:43.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 4 Realm: () 2024-09-12T00:37:43.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:43.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:43.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:43.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 20 zonegroup default 2024-09-12T00:37:43.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.834+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.838+0000 7f2e806ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.838+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.838+0000 7f2e806ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:43.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.838+0000 7f2e806ed9c0 20 started sync module instance, tier type = 2024-09-12T00:37:43.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.838+0000 7f2e806ed9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:43.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.858+0000 7f2e806ed9c0 20 add_watcher() i=0 2024-09-12T00:37:43.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.858+0000 7f2e806ed9c0 20 add_watcher() i=1 2024-09-12T00:37:43.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.858+0000 7f2e806ed9c0 20 add_watcher() i=2 2024-09-12T00:37:43.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.858+0000 7f2e806ed9c0 20 add_watcher() i=3 2024-09-12T00:37:43.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.858+0000 7f2e806ed9c0 20 add_watcher() i=4 2024-09-12T00:37:43.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.858+0000 7f2e806ed9c0 20 add_watcher() i=5 2024-09-12T00:37:43.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.858+0000 7f2e806ed9c0 20 add_watcher() i=6 2024-09-12T00:37:43.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.858+0000 7f2e806ed9c0 20 add_watcher() i=7 2024-09-12T00:37:43.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.858+0000 7f2e806ed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:43.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.862+0000 7f2d34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:43.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:43.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:43.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 5 note: GC not initialized 2024-09-12T00:37:43.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2caf7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:43.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:43.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 20 Filter name: none 2024-09-12T00:37:43.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2cad7fa640 20 reqs_thread_entry: start 2024-09-12T00:37:43.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:43.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:43.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:43.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.866+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.870+0000 7f2e806ed9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:37:43.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.870+0000 7f2e806ed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:43.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.870+0000 7f2e806ed9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:43.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.870+0000 7f2e806ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:43.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.874+0000 7f2d34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:43.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.878+0000 7f2e806ed9c0 20 remove_watcher() i=0 2024-09-12T00:37:43.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.878+0000 7f2e806ed9c0 2 removed watcher, disabling cache 2024-09-12T00:37:43.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.878+0000 7f2e806ed9c0 20 remove_watcher() i=1 2024-09-12T00:37:43.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.882+0000 7f2e806ed9c0 20 remove_watcher() i=2 2024-09-12T00:37:43.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.886+0000 7f2e806ed9c0 20 remove_watcher() i=3 2024-09-12T00:37:43.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.886+0000 7f2e806ed9c0 20 remove_watcher() i=4 2024-09-12T00:37:43.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.886+0000 7f2e806ed9c0 20 remove_watcher() i=5 2024-09-12T00:37:43.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.890+0000 7f2e806ed9c0 20 remove_watcher() i=6 2024-09-12T00:37:43.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:43.890+0000 7f2e806ed9c0 20 remove_watcher() i=7 2024-09-12T00:37:43.909 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:43.909 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:43.909 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-trim-reshard-log-entries id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:37:43.909 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:43.911 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:43.911 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:43.937 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:43.937 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:44.534 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:44.535 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:44.910 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:37:44.910 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:44.913 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:44.913 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:45.056 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.056 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:45.143 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.143 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:45.251 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.251 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:45.360 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.361 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:45.457 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.457 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:45.558 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.558 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:45.652 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.652 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:45.754 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.754 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:45.851 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.851 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:45.953 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:45.953 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:46.046 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.046 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:46.148 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.148 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:46.248 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.248 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:46.347 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.347 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:46.444 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.445 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:46.544 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.544 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:46.630 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.630 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:46.726 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.726 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:46.825 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.825 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:46.922 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:46.922 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:47.022 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:47.022 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:47.117 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:37:47.150 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:47.150 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:47.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.198+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.198+0000 7efebfd729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.198+0000 7efebfd729c0 20 realm 2024-09-12T00:37:47.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.198+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.202+0000 7efebfd729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.202+0000 7efebfd729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:47.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.202+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.202+0000 7efebfd729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.202+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.202+0000 7efebfd729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:47.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.202+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.202+0000 7efebfd729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:47.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.202+0000 7efebfd729c0 20 searching for the correct realm 2024-09-12T00:37:47.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.206+0000 7efebe079640 0 -- 172.21.15.102:0/1224508958 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7efeb4022070 msgr2=0x7efeb400c9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:47.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.214+0000 7efebd077640 0 -- 172.21.15.102:0/1224508958 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7efeb80ce900 msgr2=0x7efeb80b93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:47.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.430+0000 7efebfd729c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:47.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.430+0000 7efebfd729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:47.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.430+0000 7efebfd729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:47.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.430+0000 7efebfd729c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:47.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.430+0000 7efebfd729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:47.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.430+0000 7efebfd729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:47.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.430+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.430+0000 7efebfd729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.430+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:47.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:47.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 zone default found 2024-09-12T00:37:47.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 4 Realm: () 2024-09-12T00:37:47.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:47.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:47.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:47.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 zonegroup default 2024-09-12T00:37:47.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.434+0000 7efebfd729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.438+0000 7efebfd729c0 20 started sync module instance, tier type = 2024-09-12T00:37:47.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.438+0000 7efebfd729c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:47.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.458+0000 7efebfd729c0 20 add_watcher() i=0 2024-09-12T00:37:47.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.458+0000 7efebfd729c0 20 add_watcher() i=1 2024-09-12T00:37:47.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.458+0000 7efebfd729c0 20 add_watcher() i=2 2024-09-12T00:37:47.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.458+0000 7efebfd729c0 20 add_watcher() i=3 2024-09-12T00:37:47.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.458+0000 7efebfd729c0 20 add_watcher() i=4 2024-09-12T00:37:47.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.458+0000 7efebfd729c0 20 add_watcher() i=5 2024-09-12T00:37:47.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.462+0000 7efebfd729c0 20 add_watcher() i=6 2024-09-12T00:37:47.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.462+0000 7efebfd729c0 20 add_watcher() i=7 2024-09-12T00:37:47.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.462+0000 7efebfd729c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:47.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.466+0000 7efd6f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:47.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.466+0000 7efebfd729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:47.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.466+0000 7efebfd729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:47.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.466+0000 7efebfd729c0 5 note: GC not initialized 2024-09-12T00:37:47.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efd6e7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:47.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efebfd729c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:47.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efebfd729c0 20 Filter name: none 2024-09-12T00:37:47.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efcdffff640 20 reqs_thread_entry: start 2024-09-12T00:37:47.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efebfd729c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:47.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efebfd729c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:47.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efebfd729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:47.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efebfd729c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:47.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.470+0000 7efebfd729c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.474+0000 7efebfd729c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:47.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.474+0000 7efebfd729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:47.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.478+0000 7efd6f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:47.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.482+0000 7efebfd729c0 20 remove_watcher() i=0 2024-09-12T00:37:47.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.482+0000 7efebfd729c0 2 removed watcher, disabling cache 2024-09-12T00:37:47.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.482+0000 7efebfd729c0 20 remove_watcher() i=1 2024-09-12T00:37:47.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.486+0000 7efebfd729c0 20 remove_watcher() i=2 2024-09-12T00:37:47.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.486+0000 7efebfd729c0 20 remove_watcher() i=3 2024-09-12T00:37:47.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.490+0000 7efebfd729c0 20 remove_watcher() i=4 2024-09-12T00:37:47.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.490+0000 7efebfd729c0 20 remove_watcher() i=5 2024-09-12T00:37:47.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.494+0000 7efebfd729c0 20 remove_watcher() i=6 2024-09-12T00:37:47.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.494+0000 7efebfd729c0 20 remove_watcher() i=7 2024-09-12T00:37:47.512 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:47.512 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:47.512 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-block-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:47.512 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:47.513 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:37:47.546 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:47.547 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:47.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.594+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.594+0000 7f61c1a7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.594+0000 7f61c1a7a9c0 20 realm 2024-09-12T00:37:47.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.594+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.594+0000 7f61c1a7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.594+0000 7f61c1a7a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:47.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.594+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.594+0000 7f61c1a7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.594+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.598+0000 7f61c1a7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:47.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.598+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.598+0000 7f61c1a7a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:47.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.598+0000 7f61c1a7a9c0 20 searching for the correct realm 2024-09-12T00:37:47.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.602+0000 7f61bfd81640 0 -- 172.21.15.102:0/3281096885 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f61b4068a30 msgr2=0x7f61b40674a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:47.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.610+0000 7f61bed7f640 0 -- 172.21.15.102:0/3281096885 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f61b8017020 msgr2=0x7f61b80679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:47.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.826+0000 7f61c1a7a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:47.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.826+0000 7f61c1a7a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:47.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.826+0000 7f61c1a7a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:47.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.826+0000 7f61c1a7a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:47.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.826+0000 7f61c1a7a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:47.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.826+0000 7f61c1a7a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:47.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.826+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:47.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:47.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 zone default found 2024-09-12T00:37:47.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 4 Realm: () 2024-09-12T00:37:47.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:47.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:47.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:47.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 zonegroup default 2024-09-12T00:37:47.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.830+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.834+0000 7f61c1a7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:47.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.834+0000 7f61c1a7a9c0 20 started sync module instance, tier type = 2024-09-12T00:37:47.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.834+0000 7f61c1a7a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:47.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.854+0000 7f61c1a7a9c0 20 add_watcher() i=0 2024-09-12T00:37:47.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.854+0000 7f61c1a7a9c0 20 add_watcher() i=1 2024-09-12T00:37:47.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.854+0000 7f61c1a7a9c0 20 add_watcher() i=2 2024-09-12T00:37:47.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.854+0000 7f61c1a7a9c0 20 add_watcher() i=3 2024-09-12T00:37:47.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.854+0000 7f61c1a7a9c0 20 add_watcher() i=4 2024-09-12T00:37:47.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.854+0000 7f61c1a7a9c0 20 add_watcher() i=5 2024-09-12T00:37:47.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.854+0000 7f61c1a7a9c0 20 add_watcher() i=6 2024-09-12T00:37:47.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.858+0000 7f61c1a7a9c0 20 add_watcher() i=7 2024-09-12T00:37:47.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.858+0000 7f61c1a7a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:47.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.862+0000 7f6075fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:47.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.862+0000 7f61c1a7a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:47.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.862+0000 7f61c1a7a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:47.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.862+0000 7f61c1a7a9c0 5 note: GC not initialized 2024-09-12T00:37:47.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.862+0000 7f6074fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:47.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.862+0000 7f61c1a7a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:47.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.862+0000 7f61c1a7a9c0 20 Filter name: none 2024-09-12T00:37:47.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f5fee7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:47.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:37:47.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:47.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:37:47.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:37:47.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 : miss 2024-09-12T00:37:47.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:47.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:47.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:47.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:47.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:47.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:47.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.866+0000 7f61c1a7a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 2024-09-12T00:37:47.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.878+0000 7f61c1a7a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:47.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.878+0000 7f61c1a7a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:47.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.878+0000 7f61c1a7a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:47.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.878+0000 7f61c1a7a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29, ofs0, ns] 2024-09-12T00:37:47.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.878+0000 7f60a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398890 cookie 94846310567040 notifier 6987 bl.length()=999 2024-09-12T00:37:47.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.878+0000 7f60a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:47.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.878+0000 7f60a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:47.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.878+0000 7f60a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:47.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.882+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_sources= new_sources= 2024-09-12T00:37:47.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.882+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential sources added=[] removed=[] 2024-09-12T00:37:47.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.882+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_dests= new_dests= 2024-09-12T00:37:47.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.882+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential dests added=[] removed=[] 2024-09-12T00:37:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.0 2024-09-12T00:37:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.0 2024-09-12T00:37:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.1 2024-09-12T00:37:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.1 2024-09-12T00:37:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.2 2024-09-12T00:37:47.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.2 2024-09-12T00:37:47.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.3 2024-09-12T00:37:47.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.3 2024-09-12T00:37:47.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.4 2024-09-12T00:37:47.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.4 2024-09-12T00:37:47.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.5 2024-09-12T00:37:47.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.5 2024-09-12T00:37:47.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.6 2024-09-12T00:37:47.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.6 2024-09-12T00:37:47.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.7 2024-09-12T00:37:47.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.7 2024-09-12T00:37:47.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.8 2024-09-12T00:37:47.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.8 2024-09-12T00:37:47.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.9 2024-09-12T00:37:47.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.9 2024-09-12T00:37:47.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.10 2024-09-12T00:37:47.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.10 2024-09-12T00:37:47.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.11 2024-09-12T00:37:47.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.11 2024-09-12T00:37:47.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.890+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.0 2024-09-12T00:37:47.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.894+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1 2024-09-12T00:37:47.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.894+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.2 2024-09-12T00:37:47.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.894+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.3 2024-09-12T00:37:47.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.894+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.4 2024-09-12T00:37:47.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.898+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.5 2024-09-12T00:37:47.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.898+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.6 2024-09-12T00:37:47.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.898+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.7 2024-09-12T00:37:47.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.902+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.8 2024-09-12T00:37:47.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.902+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.9 2024-09-12T00:37:47.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.902+0000 7f61c1a7a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.10 2024-09-12T00:37:47.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.910+0000 7f61c1a7a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:47.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.910+0000 7f61c1a7a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 2024-09-12T00:37:47.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.910+0000 7f61c1a7a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:47.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.910+0000 7f61c1a7a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:47.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.910+0000 7f61c1a7a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:47.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.910+0000 7f61c1a7a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29, ofs0, ns] 2024-09-12T00:37:47.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.914+0000 7f60a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398891 cookie 94846310567040 notifier 6987 bl.length()=999 2024-09-12T00:37:47.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.914+0000 7f60a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:47.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.914+0000 7f60a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:47.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.914+0000 7f60a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:47.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.918+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_sources= new_sources= 2024-09-12T00:37:47.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.918+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential sources added=[] removed=[] 2024-09-12T00:37:47.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.918+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_dests= new_dests= 2024-09-12T00:37:47.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.918+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential dests added=[] removed=[] 2024-09-12T00:37:47.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.918+0000 7f61c1a7a9c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:37:47.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.918+0000 7f61c1a7a9c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:37:47.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.926+0000 7f61c1a7a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:47.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.926+0000 7f61c1a7a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 2024-09-12T00:37:47.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.930+0000 7f61c1a7a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:47.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.930+0000 7f61c1a7a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:47.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.930+0000 7f61c1a7a9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:47.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.930+0000 7f61c1a7a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29, ofs0, ns] 2024-09-12T00:37:47.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.930+0000 7f60a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398892 cookie 94846310567040 notifier 6987 bl.length()=967 2024-09-12T00:37:47.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.930+0000 7f60a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:47.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.930+0000 7f60a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:47.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.930+0000 7f60a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:47.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.934+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_sources= new_sources= 2024-09-12T00:37:47.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.934+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential sources added=[] removed=[] 2024-09-12T00:37:47.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.934+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_dests= new_dests= 2024-09-12T00:37:47.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.934+0000 7f61c1a7a9c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential dests added=[] removed=[] 2024-09-12T00:37:47.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.938+0000 7f61c1a7a9c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:37:47.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.942+0000 7f6075fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:47.947 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.950+0000 7f61c1a7a9c0 20 remove_watcher() i=0 2024-09-12T00:37:47.947 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.950+0000 7f61c1a7a9c0 2 removed watcher, disabling cache 2024-09-12T00:37:47.949 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.950+0000 7f61c1a7a9c0 20 remove_watcher() i=1 2024-09-12T00:37:47.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.954+0000 7f61c1a7a9c0 20 remove_watcher() i=2 2024-09-12T00:37:47.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.954+0000 7f61c1a7a9c0 20 remove_watcher() i=3 2024-09-12T00:37:47.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.958+0000 7f61c1a7a9c0 20 remove_watcher() i=4 2024-09-12T00:37:47.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.958+0000 7f61c1a7a9c0 20 remove_watcher() i=5 2024-09-12T00:37:47.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.962+0000 7f61c1a7a9c0 20 remove_watcher() i=6 2024-09-12T00:37:47.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:47.962+0000 7f61c1a7a9c0 20 remove_watcher() i=7 2024-09-12T00:37:47.982 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:37:48.013 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:48.013 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:48.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 20 realm 2024-09-12T00:37:48.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:48.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:48.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.062+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.066+0000 7f286cd0f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:48.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.066+0000 7f286cd0f9c0 20 searching for the correct realm 2024-09-12T00:37:48.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.066+0000 7f286a014640 0 -- 172.21.15.102:0/1152213614 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f2864042040 msgr2=0x7f2864036950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:48.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.278+0000 7f286b016640 0 -- 172.21.15.102:0/1152213614 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x557dee93e100 msgr2=0x557dee9404f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:48.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.294+0000 7f286cd0f9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:48.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.294+0000 7f286cd0f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:48.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.294+0000 7f286cd0f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:48.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.294+0000 7f286cd0f9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:48.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.294+0000 7f286cd0f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:48.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.294+0000 7f286cd0f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:48.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.294+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.294+0000 7f286cd0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.294+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:48.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:48.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 zone default found 2024-09-12T00:37:48.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 4 Realm: () 2024-09-12T00:37:48.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:48.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:48.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:48.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 zonegroup default 2024-09-12T00:37:48.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 started sync module instance, tier type = 2024-09-12T00:37:48.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.298+0000 7f286cd0f9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:48.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.322+0000 7f286cd0f9c0 20 add_watcher() i=0 2024-09-12T00:37:48.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.322+0000 7f286cd0f9c0 20 add_watcher() i=1 2024-09-12T00:37:48.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.322+0000 7f286cd0f9c0 20 add_watcher() i=2 2024-09-12T00:37:48.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.322+0000 7f286cd0f9c0 20 add_watcher() i=3 2024-09-12T00:37:48.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.322+0000 7f286cd0f9c0 20 add_watcher() i=4 2024-09-12T00:37:48.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.322+0000 7f286cd0f9c0 20 add_watcher() i=5 2024-09-12T00:37:48.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.322+0000 7f286cd0f9c0 20 add_watcher() i=6 2024-09-12T00:37:48.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.322+0000 7f286cd0f9c0 20 add_watcher() i=7 2024-09-12T00:37:48.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.322+0000 7f286cd0f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:48.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.326+0000 7f27217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:48.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.326+0000 7f286cd0f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:48.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.326+0000 7f286cd0f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:48.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.326+0000 7f286cd0f9c0 5 note: GC not initialized 2024-09-12T00:37:48.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.326+0000 7f269bfff640 20 reqs_thread_entry: start 2024-09-12T00:37:48.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.326+0000 7f286cd0f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:48.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.330+0000 7f286cd0f9c0 20 Filter name: none 2024-09-12T00:37:48.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.330+0000 7f2699ffb640 20 reqs_thread_entry: start 2024-09-12T00:37:48.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.330+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.330+0000 7f286cd0f9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:48.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.330+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.330+0000 7f286cd0f9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:48.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.330+0000 7f286cd0f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:48.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.330+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.330+0000 7f286cd0f9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:48.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.334+0000 7f286cd0f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.334+0000 7f286cd0f9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:48.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.334+0000 7f286cd0f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:48.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.334+0000 7f27217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:48.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.342+0000 7f286cd0f9c0 20 remove_watcher() i=0 2024-09-12T00:37:48.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.342+0000 7f286cd0f9c0 2 removed watcher, disabling cache 2024-09-12T00:37:48.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.342+0000 7f286cd0f9c0 20 remove_watcher() i=1 2024-09-12T00:37:48.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.346+0000 7f286cd0f9c0 20 remove_watcher() i=2 2024-09-12T00:37:48.346 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.346+0000 7f286cd0f9c0 20 remove_watcher() i=3 2024-09-12T00:37:48.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.350+0000 7f286cd0f9c0 20 remove_watcher() i=4 2024-09-12T00:37:48.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.350+0000 7f286cd0f9c0 20 remove_watcher() i=5 2024-09-12T00:37:48.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.354+0000 7f286cd0f9c0 20 remove_watcher() i=6 2024-09-12T00:37:48.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.354+0000 7f286cd0f9c0 20 remove_watcher() i=7 2024-09-12T00:37:48.367 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:48.367 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:48.367 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-block-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:48.367 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:48.368 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:48.368 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:48.429 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:48.429 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:48.488 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:48.523 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:48.523 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:48.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.570+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.570+0000 7fc13c4159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.570+0000 7fc13c4159c0 20 realm 2024-09-12T00:37:48.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.570+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.570+0000 7fc13c4159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.570+0000 7fc13c4159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:48.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.570+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.570+0000 7fc13c4159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.570+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.574+0000 7fc13c4159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:48.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.574+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.574+0000 7fc13c4159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:48.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.574+0000 7fc13c4159c0 20 searching for the correct realm 2024-09-12T00:37:48.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.578+0000 7fc13a71c640 0 -- 172.21.15.102:0/1933165048 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fc1300a4950 msgr2=0x7fc130131250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:48.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.586+0000 7fc13971a640 0 -- 172.21.15.102:0/1933165048 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fc1340333f0 msgr2=0x7fc134033870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:48.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.802+0000 7fc13c4159c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:48.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.802+0000 7fc13c4159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:48.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.802+0000 7fc13c4159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:48.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.802+0000 7fc13c4159c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:48.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.802+0000 7fc13c4159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:48.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.802+0000 7fc13c4159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:48.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.802+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.802+0000 7fc13c4159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.802+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:48.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:48.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 20 zone default found 2024-09-12T00:37:48.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 4 Realm: () 2024-09-12T00:37:48.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:48.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:48.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:48.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 20 zonegroup default 2024-09-12T00:37:48.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.806+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.810+0000 7fc13c4159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.810+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.810+0000 7fc13c4159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:48.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.810+0000 7fc13c4159c0 20 started sync module instance, tier type = 2024-09-12T00:37:48.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.810+0000 7fc13c4159c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:48.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.830+0000 7fc13c4159c0 20 add_watcher() i=0 2024-09-12T00:37:48.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.830+0000 7fc13c4159c0 20 add_watcher() i=1 2024-09-12T00:37:48.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.830+0000 7fc13c4159c0 20 add_watcher() i=2 2024-09-12T00:37:48.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.830+0000 7fc13c4159c0 20 add_watcher() i=3 2024-09-12T00:37:48.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.830+0000 7fc13c4159c0 20 add_watcher() i=4 2024-09-12T00:37:48.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.830+0000 7fc13c4159c0 20 add_watcher() i=5 2024-09-12T00:37:48.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.830+0000 7fc13c4159c0 20 add_watcher() i=6 2024-09-12T00:37:48.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.834+0000 7fc13c4159c0 20 add_watcher() i=7 2024-09-12T00:37:48.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.834+0000 7fc13c4159c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:48.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fbfeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:48.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:48.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:48.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 5 note: GC not initialized 2024-09-12T00:37:48.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fbfea7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:48.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:48.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 20 Filter name: none 2024-09-12T00:37:48.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fbf5bfff640 20 reqs_thread_entry: start 2024-09-12T00:37:48.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:37:48.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:48.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:37:48.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:37:48.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 : miss 2024-09-12T00:37:48.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.838+0000 7fc13c4159c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:48.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.842+0000 7fc13c4159c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:48.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.842+0000 7fc13c4159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:48.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.842+0000 7fc13c4159c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:48.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.842+0000 7fc13c4159c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:48.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.842+0000 7fc13c4159c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:48.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.842+0000 7fc13c4159c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 2024-09-12T00:37:48.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.854+0000 7fc13c4159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:48.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.854+0000 7fc13c4159c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:48.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.854+0000 7fc13c4159c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:48.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.854+0000 7fc13c4159c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29, ofs0, ns] 2024-09-12T00:37:48.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.854+0000 7fc01d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398893 cookie 94766941836112 notifier 6596 bl.length()=999 2024-09-12T00:37:48.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.854+0000 7fc01d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:48.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.854+0000 7fc01d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:48.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.854+0000 7fc01d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:48.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.858+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_sources= new_sources= 2024-09-12T00:37:48.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.858+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential sources added=[] removed=[] 2024-09-12T00:37:48.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.858+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_dests= new_dests= 2024-09-12T00:37:48.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.858+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential dests added=[] removed=[] 2024-09-12T00:37:48.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.0 2024-09-12T00:37:48.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.0 2024-09-12T00:37:48.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.1 2024-09-12T00:37:48.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.1 2024-09-12T00:37:48.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.2 2024-09-12T00:37:48.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.2 2024-09-12T00:37:48.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.3 2024-09-12T00:37:48.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.3 2024-09-12T00:37:48.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.4 2024-09-12T00:37:48.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.4 2024-09-12T00:37:48.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.5 2024-09-12T00:37:48.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.5 2024-09-12T00:37:48.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.6 2024-09-12T00:37:48.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.6 2024-09-12T00:37:48.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.7 2024-09-12T00:37:48.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.7 2024-09-12T00:37:48.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.8 2024-09-12T00:37:48.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.8 2024-09-12T00:37:48.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.9 2024-09-12T00:37:48.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.9 2024-09-12T00:37:48.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.10 2024-09-12T00:37:48.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.10 2024-09-12T00:37:48.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.11 2024-09-12T00:37:48.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1.11 2024-09-12T00:37:48.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.0 2024-09-12T00:37:48.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1 2024-09-12T00:37:48.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.870+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.2 2024-09-12T00:37:48.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.874+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.3 2024-09-12T00:37:48.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.874+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.4 2024-09-12T00:37:48.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.874+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.5 2024-09-12T00:37:48.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.878+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.6 2024-09-12T00:37:48.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.878+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.7 2024-09-12T00:37:48.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.878+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.8 2024-09-12T00:37:48.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.878+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.9 2024-09-12T00:37:48.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.882+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.10 2024-09-12T00:37:48.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.886+0000 7fc13c4159c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:48.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.886+0000 7fc13c4159c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 2024-09-12T00:37:48.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.890+0000 7fc13c4159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:48.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.890+0000 7fc13c4159c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:48.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.890+0000 7fc13c4159c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:48.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.890+0000 7fc13c4159c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29, ofs0, ns] 2024-09-12T00:37:48.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.890+0000 7fc01d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398894 cookie 94766941836112 notifier 6596 bl.length()=999 2024-09-12T00:37:48.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.890+0000 7fc01d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:48.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.890+0000 7fc01d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:48.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.890+0000 7fc01d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:48.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.894+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_sources= new_sources= 2024-09-12T00:37:48.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.894+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential sources added=[] removed=[] 2024-09-12T00:37:48.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.894+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_dests= new_dests= 2024-09-12T00:37:48.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.894+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential dests added=[] removed=[] 2024-09-12T00:37:48.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.898+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.0 2024-09-12T00:37:48.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.898+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.1 2024-09-12T00:37:48.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.898+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.2 2024-09-12T00:37:48.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.898+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.3 2024-09-12T00:37:48.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.902+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.4 2024-09-12T00:37:48.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.902+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.5 2024-09-12T00:37:48.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.902+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.6 2024-09-12T00:37:48.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.902+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.7 2024-09-12T00:37:48.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.902+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.8 2024-09-12T00:37:48.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.902+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.9 2024-09-12T00:37:48.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.906+0000 7fc13c4159c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29.10 2024-09-12T00:37:48.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.906+0000 7fc13c4159c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:48.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.906+0000 7fc13c4159c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 2024-09-12T00:37:48.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc13c4159c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:48.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc13c4159c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:48.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc13c4159c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:48.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc13c4159c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29, ofs0, ns] 2024-09-12T00:37:48.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc01cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398895 cookie 94766941836112 notifier 6596 bl.length()=967 2024-09-12T00:37:48.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc01cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 info.flags=0x17 2024-09-12T00:37:48.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc01cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 to cache LRU end 2024-09-12T00:37:48.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc01cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:48.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_sources= new_sources= 2024-09-12T00:37:48.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential sources added=[] removed=[] 2024-09-12T00:37:48.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): orig_dests= new_dests= 2024-09-12T00:37:48.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.910+0000 7fc13c4159c0 20 handle_bi_update(): bucket=:error-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29]): potential dests added=[] removed=[] 2024-09-12T00:37:48.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.918+0000 7fc13c4159c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:48.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.918+0000 7fbfeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:48.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.926+0000 7fc13c4159c0 20 remove_watcher() i=0 2024-09-12T00:37:48.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.926+0000 7fc13c4159c0 2 removed watcher, disabling cache 2024-09-12T00:37:48.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.926+0000 7fc13c4159c0 20 remove_watcher() i=1 2024-09-12T00:37:48.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.930+0000 7fc13c4159c0 20 remove_watcher() i=2 2024-09-12T00:37:48.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.930+0000 7fc13c4159c0 20 remove_watcher() i=3 2024-09-12T00:37:48.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.934+0000 7fc13c4159c0 20 remove_watcher() i=4 2024-09-12T00:37:48.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.934+0000 7fc13c4159c0 20 remove_watcher() i=5 2024-09-12T00:37:48.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.938+0000 7fc13c4159c0 20 remove_watcher() i=6 2024-09-12T00:37:48.936 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:48.938+0000 7fc13c4159c0 20 remove_watcher() i=7 2024-09-12T00:37:48.952 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:37:48.982 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:48.982 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:49.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.026+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.030+0000 7f6c38f0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.030+0000 7f6c38f0a9c0 20 realm 2024-09-12T00:37:49.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.030+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.030+0000 7f6c38f0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.030+0000 7f6c38f0a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:49.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.030+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.030+0000 7f6c38f0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.030+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.030+0000 7f6c38f0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:49.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.030+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.034+0000 7f6c38f0a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:49.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.034+0000 7f6c38f0a9c0 20 searching for the correct realm 2024-09-12T00:37:49.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.038+0000 7f6c37211640 0 -- 172.21.15.102:0/1389601499 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f6c2c107430 msgr2=0x7f6c2c0fd300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:49.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.046+0000 7f6c3620f640 0 -- 172.21.15.102:0/1389601499 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6c300709c0 msgr2=0x7f6c30003300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:49.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:49.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:49.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:49.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:49.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:49.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:49.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:49.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:49.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 zone default found 2024-09-12T00:37:49.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 4 Realm: () 2024-09-12T00:37:49.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:49.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:49.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:49.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 zonegroup default 2024-09-12T00:37:49.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.266+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.270+0000 7f6c38f0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.266 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.270+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.270+0000 7f6c38f0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:49.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.270+0000 7f6c38f0a9c0 20 started sync module instance, tier type = 2024-09-12T00:37:49.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.270+0000 7f6c38f0a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:49.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.294+0000 7f6c38f0a9c0 20 add_watcher() i=0 2024-09-12T00:37:49.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.294+0000 7f6c38f0a9c0 20 add_watcher() i=1 2024-09-12T00:37:49.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.294+0000 7f6c38f0a9c0 20 add_watcher() i=2 2024-09-12T00:37:49.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.294+0000 7f6c38f0a9c0 20 add_watcher() i=3 2024-09-12T00:37:49.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.294+0000 7f6c38f0a9c0 20 add_watcher() i=4 2024-09-12T00:37:49.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.294+0000 7f6c38f0a9c0 20 add_watcher() i=5 2024-09-12T00:37:49.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.294+0000 7f6c38f0a9c0 20 add_watcher() i=6 2024-09-12T00:37:49.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.294+0000 7f6c38f0a9c0 20 add_watcher() i=7 2024-09-12T00:37:49.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.294+0000 7f6c38f0a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:49.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.298+0000 7f6aed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:49.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.298+0000 7f6c38f0a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:49.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.298+0000 7f6c38f0a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:49.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6c38f0a9c0 5 note: GC not initialized 2024-09-12T00:37:49.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6a67fff640 20 reqs_thread_entry: start 2024-09-12T00:37:49.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6c38f0a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:49.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6c38f0a9c0 20 Filter name: none 2024-09-12T00:37:49.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6a65ffb640 20 reqs_thread_entry: start 2024-09-12T00:37:49.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6c38f0a9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:49.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6c38f0a9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:49.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6c38f0a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:49.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.302+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.306+0000 7f6c38f0a9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:49.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.306+0000 7f6c38f0a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:49.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.306+0000 7f6c38f0a9c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:49.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.306+0000 7f6c38f0a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:49.308 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.310+0000 7f6aed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:49.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.314+0000 7f6c38f0a9c0 20 remove_watcher() i=0 2024-09-12T00:37:49.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.314+0000 7f6c38f0a9c0 2 removed watcher, disabling cache 2024-09-12T00:37:49.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.318+0000 7f6c38f0a9c0 20 remove_watcher() i=1 2024-09-12T00:37:49.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.322+0000 7f6c38f0a9c0 20 remove_watcher() i=2 2024-09-12T00:37:49.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.322+0000 7f6c38f0a9c0 20 remove_watcher() i=3 2024-09-12T00:37:49.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.322+0000 7f6c38f0a9c0 20 remove_watcher() i=4 2024-09-12T00:37:49.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.326+0000 7f6c38f0a9c0 20 remove_watcher() i=5 2024-09-12T00:37:49.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.326+0000 7f6c38f0a9c0 20 remove_watcher() i=6 2024-09-12T00:37:49.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:49.330+0000 7f6c38f0a9c0 20 remove_watcher() i=7 2024-09-12T00:37:49.344 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:49.344 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:49.344 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-block-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:37:49.344 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:49.346 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:49.346 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:49.373 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:49.373 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:49.929 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:49.929 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:50.312 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:37:50.312 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:50.317 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:50.317 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:50.457 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:50.457 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:50.547 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:50.547 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:50.654 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:50.654 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:50.757 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:50.758 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:50.855 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:50.855 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:50.955 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:50.955 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:51.058 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:51.058 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:51.162 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:51.162 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:51.257 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:51.258 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:51.361 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:51.361 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:51.464 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:51.464 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:51.564 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:51.564 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:51.666 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:51.667 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:51.765 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:51.765 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:51.863 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:51.864 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:51.965 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:51.965 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:52.062 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.063 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:52.159 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.159 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:52.255 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.255 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:52.359 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.359 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:52.448 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:52.449 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:52.540 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:37:52.573 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:52.573 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:52.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.622+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.626+0000 7fad5b0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.626+0000 7fad5b0049c0 20 realm 2024-09-12T00:37:52.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.626+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.626+0000 7fad5b0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.626+0000 7fad5b0049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:52.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.626+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.626+0000 7fad5b0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.626+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.626+0000 7fad5b0049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:52.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.626+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.630+0000 7fad5b0049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:52.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.630+0000 7fad5b0049c0 20 searching for the correct realm 2024-09-12T00:37:52.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.634+0000 7fad5930b640 0 -- 172.21.15.102:0/1509928989 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fad4804bc20 msgr2=0x7fad4805f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:52.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.846+0000 7fad5930b640 0 -- 172.21.15.102:0/1509928989 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fac24081230 msgr2=0x7fac24083660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:52.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:52.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:52.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:52.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:52.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:52.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:52.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:52.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:52.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 zone default found 2024-09-12T00:37:52.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 4 Realm: () 2024-09-12T00:37:52.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:52.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:52.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:52.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 zonegroup default 2024-09-12T00:37:52.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.862+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.866+0000 7fad5b0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.866+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.866+0000 7fad5b0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.866+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.866+0000 7fad5b0049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:52.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.866+0000 7fad5b0049c0 20 started sync module instance, tier type = 2024-09-12T00:37:52.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.866+0000 7fad5b0049c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:52.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.890+0000 7fad5b0049c0 20 add_watcher() i=0 2024-09-12T00:37:52.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.890+0000 7fad5b0049c0 20 add_watcher() i=1 2024-09-12T00:37:52.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.890+0000 7fad5b0049c0 20 add_watcher() i=2 2024-09-12T00:37:52.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.890+0000 7fad5b0049c0 20 add_watcher() i=3 2024-09-12T00:37:52.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.890+0000 7fad5b0049c0 20 add_watcher() i=4 2024-09-12T00:37:52.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.890+0000 7fad5b0049c0 20 add_watcher() i=5 2024-09-12T00:37:52.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.890+0000 7fad5b0049c0 20 add_watcher() i=6 2024-09-12T00:37:52.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.890+0000 7fad5b0049c0 20 add_watcher() i=7 2024-09-12T00:37:52.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.890+0000 7fad5b0049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:52.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.894+0000 7fac0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:52.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.894+0000 7fad5b0049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:52.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.894+0000 7fad5b0049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:52.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.894+0000 7fad5b0049c0 5 note: GC not initialized 2024-09-12T00:37:52.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fac0dfe3640 20 reqs_thread_entry: start 2024-09-12T00:37:52.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fad5b0049c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:52.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fad5b0049c0 20 Filter name: none 2024-09-12T00:37:52.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fab7f7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:52.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fad5b0049c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:52.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fad5b0049c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:52.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fad5b0049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:52.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fad5b0049c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:52.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.898+0000 7fad5b0049c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:52.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.902+0000 7fad5b0049c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:52.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.902+0000 7fad5b0049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:52.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.906+0000 7fac0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:52.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.910+0000 7fad5b0049c0 20 remove_watcher() i=0 2024-09-12T00:37:52.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.910+0000 7fad5b0049c0 2 removed watcher, disabling cache 2024-09-12T00:37:52.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.910+0000 7fad5b0049c0 20 remove_watcher() i=1 2024-09-12T00:37:52.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.914+0000 7fad5b0049c0 20 remove_watcher() i=2 2024-09-12T00:37:52.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.914+0000 7fad5b0049c0 20 remove_watcher() i=3 2024-09-12T00:37:52.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.918+0000 7fad5b0049c0 20 remove_watcher() i=4 2024-09-12T00:37:52.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.918+0000 7fad5b0049c0 20 remove_watcher() i=5 2024-09-12T00:37:52.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.922+0000 7fad5b0049c0 20 remove_watcher() i=6 2024-09-12T00:37:52.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:52.922+0000 7fad5b0049c0 20 remove_watcher() i=7 2024-09-12T00:37:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:52.940 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:52.941 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-block-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:52.941 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:37:52.975 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:52.975 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:53.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.026+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.030+0000 7f35025989c0 20 realm 2024-09-12T00:37:53.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.030+0000 7f35025989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:53.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.034+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.034+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:53.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.034+0000 7f35025989c0 20 searching for the correct realm 2024-09-12T00:37:53.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.038+0000 7f350089f640 0 -- 172.21.15.102:0/3259729814 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f34f409dc20 msgr2=0x7f34f406b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.046+0000 7f34ff89d640 0 -- 172.21.15.102:0/3259729814 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f34f80c7a80 msgr2=0x7f34f80bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:53.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:53.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:53.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:53.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:53.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:53.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.262+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.262+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.262+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:53.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 zone default found 2024-09-12T00:37:53.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 4 Realm: () 2024-09-12T00:37:53.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:53.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:53.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:53.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 zonegroup default 2024-09-12T00:37:53.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 started sync module instance, tier type = 2024-09-12T00:37:53.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.266+0000 7f35025989c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:53.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=0 2024-09-12T00:37:53.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=1 2024-09-12T00:37:53.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=2 2024-09-12T00:37:53.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=3 2024-09-12T00:37:53.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=4 2024-09-12T00:37:53.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=5 2024-09-12T00:37:53.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=6 2024-09-12T00:37:53.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.294+0000 7f35025989c0 20 add_watcher() i=7 2024-09-12T00:37:53.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.294+0000 7f35025989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:53.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f33b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:53.292 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:53.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 5 note: GC not initialized 2024-09-12T00:37:53.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f33b57e2640 20 reqs_thread_entry: start 2024-09-12T00:37:53.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:53.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 20 Filter name: none 2024-09-12T00:37:53.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f3326ffd640 20 reqs_thread_entry: start 2024-09-12T00:37:53.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:37:53.294 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:53.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:37:53.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:37:53.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 : miss 2024-09-12T00:37:53.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.298+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.302+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:53.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.302+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.295 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.302+0000 7f35025989c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.302+0000 7f35025989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:53.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.302+0000 7f35025989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.296 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.302+0000 7f35025989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 2024-09-12T00:37:53.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.310+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.310+0000 7f35025989c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.310+0000 7f35025989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.310+0000 7f35025989c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30, ofs0, ns] 2024-09-12T00:37:53.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398934 cookie 94337250538432 notifier 7080 bl.length()=999 2024-09-12T00:37:53.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_sources= new_sources= 2024-09-12T00:37:53.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential sources added=[] removed=[] 2024-09-12T00:37:53.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_dests= new_dests= 2024-09-12T00:37:53.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential dests added=[] removed=[] 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.0 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.0 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.1 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.1 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.2 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.2 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.3 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.3 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.4 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.4 2024-09-12T00:37:53.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.5 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.5 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.6 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.6 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.7 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.7 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.8 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.8 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.9 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.9 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.10 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.10 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.11 2024-09-12T00:37:53.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.11 2024-09-12T00:37:53.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.0 2024-09-12T00:37:53.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1 2024-09-12T00:37:53.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2 2024-09-12T00:37:53.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.3 2024-09-12T00:37:53.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.4 2024-09-12T00:37:53.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.5 2024-09-12T00:37:53.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.6 2024-09-12T00:37:53.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.7 2024-09-12T00:37:53.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.8 2024-09-12T00:37:53.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.334+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.9 2024-09-12T00:37:53.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.334+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.10 2024-09-12T00:37:53.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.338+0000 7f35025989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:53.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.338+0000 7f35025989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 2024-09-12T00:37:53.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.342+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.342+0000 7f35025989c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.342+0000 7f35025989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.342+0000 7f35025989c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30, ofs0, ns] 2024-09-12T00:37:53.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398935 cookie 94337250538432 notifier 7080 bl.length()=999 2024-09-12T00:37:53.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.339 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f35025989c0 time 2024-09-12T00:37:53.346539+0000 2024-09-12T00:37:53.339 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:53.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_sources= new_sources= 2024-09-12T00:37:53.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential sources added=[] removed=[] 2024-09-12T00:37:53.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_dests= new_dests= 2024-09-12T00:37:53.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential dests added=[] removed=[] 2024-09-12T00:37:53.340 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:53.340 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3505e722eb] 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3505e7249f] 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc98de6cc1] 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55cc98dfb086] 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55cc98dfc6a4] 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3504cd8d90] 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f35025989c0 thread_name:radosgw-admin 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.346+0000 7f35025989c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f35025989c0 time 2024-09-12T00:37:53.346539+0000 2024-09-12T00:37:53.341 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3505e722eb] 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3505e7249f] 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc98de6cc1] 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55cc98dfb086] 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55cc98dfc6a4] 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3504cd8d90] 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:37:53.342 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.359 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:53.359 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3504cf1520] 2024-09-12T00:37:53.359 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:37:53.359 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:37:53.359 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:37:53.359 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3505e72345] 2024-09-12T00:37:53.360 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3505e7249f] 2024-09-12T00:37:53.360 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc98de6cc1] 2024-09-12T00:37:53.360 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55cc98dfb086] 2024-09-12T00:37:53.360 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55cc98dfc6a4] 2024-09-12T00:37:53.360 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:37:53.360 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3504cd8d90] 2024-09-12T00:37:53.360 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:37:53.361 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:37:53.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.346+0000 7f35025989c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:53.361 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f35025989c0 thread_name:radosgw-admin 2024-09-12T00:37:53.361 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.361 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:53.361 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3504cf1520] 2024-09-12T00:37:53.361 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:37:53.361 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:37:53.361 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:37:53.362 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3505e72345] 2024-09-12T00:37:53.362 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3505e7249f] 2024-09-12T00:37:53.362 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc98de6cc1] 2024-09-12T00:37:53.362 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55cc98dfb086] 2024-09-12T00:37:53.362 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55cc98dfc6a4] 2024-09-12T00:37:53.362 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:37:53.362 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3504cd8d90] 2024-09-12T00:37:53.362 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:37:53.363 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:37:53.363 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:53.363 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.363 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:37:53.363 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: crc 2024-09-12T00:37:53.363 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: crc 2024-09-12T00:37:53.363 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: secure 2024-09-12T00:37:53.363 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: crc 2024-09-12T00:37:53.364 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: secure 2024-09-12T00:37:53.364 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: crc 2024-09-12T00:37:53.364 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: secure 2024-09-12T00:37:53.364 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:37:53.006+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.364 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:37:53.006+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.364 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command rotate-key hook 0x55cc9a3eca98 2024-09-12T00:37:53.364 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:53.364 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:37:53.365 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-c con 0x55cc9a29d120 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:53.365 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-a con 0x55cc9a2a8e70 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:53.365 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-b con 0x55cc9a3efd30 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:53.365 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.365 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.365 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.365 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:53.365 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): authenticate will time out at 2661.506832s 2024-09-12T00:37:53.366 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): get_auth_request con 0x55cc9a29d120 auth_method 0 2024-09-12T00:37:53.366 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.366 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.366 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.366 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): get_auth_request con 0x55cc9a2a8e70 auth_method 0 2024-09-12T00:37:53.366 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.366 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.366 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.367 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.367 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.367 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.367 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.367 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.367 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.367 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): handle_auth_done global_id 6635 payload 824 2024-09-12T00:37:53.367 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient: _finish_hunting 0 2024-09-12T00:37:53.367 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:37:53.006+0000 7f350009e640 1 monclient: found mon.noname-c 2024-09-12T00:37:53.368 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:37:53.368 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.368 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:53.368 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: dump: 2024-09-12T00:37:53.368 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.368 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.368 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.368 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.369 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.369 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.369 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.369 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.369 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.369 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.369 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: _finish_auth 0 2024-09-12T00:37:53.369 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: _check_auth_tickets 2024-09-12T00:37:53.369 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:53.369 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: dump: 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.370 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 monclient: authenticate success, global_id 6635 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:37:53.006+0000 7f33ee60c640 4 set_mon_vals no callback set 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:37:53.006+0000 7f35025989c0 1 librados: init done 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:37:53.010+0000 7f33ece09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:37:53.010+0000 7f33ece09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:37:53.010+0000 7f33ece09640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:37:53.010+0000 7f34ff89d640 10 monclient: get_auth_request con 0x7f33e8070ae0 auth_method 0 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:37:53.010+0000 7f350089f640 10 monclient: get_auth_request con 0x55cc9a42dd60 auth_method 0 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:37:53.010+0000 7f350009e640 10 monclient: get_auth_request con 0x55cc9a4379e0 auth_method 0 2024-09-12T00:37:53.371 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:37:53.014+0000 7f34ff89d640 10 monclient: get_auth_request con 0x55cc9a43bbd0 auth_method 0 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:37:53.014+0000 7f350089f640 10 monclient: get_auth_request con 0x55cc9a43b2c0 auth_method 0 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: build_initial_monmap 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:37:53.018+0000 7f35025989c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: monmap: 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:53.372 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding auth protocol: cephx 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding auth protocol: cephx 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding auth protocol: cephx 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.373 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:37:53.018+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55cc9a447750 EEXIST 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: init 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding auth protocol: cephx 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding auth protocol: cephx 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding auth protocol: cephx 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.374 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:37:53.018+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:37:53.018+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command rotate-key cmddesc rotate-key hook 0x55cc9a442dc0 EEXIST 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-c con 0x55cc9a46b900 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:53.375 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-b con 0x55cc9a46b230 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-a con 0x55cc9a469c10 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): authenticate will time out at 2661.517789s 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): get_auth_request con 0x55cc9a469c10 auth_method 0 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): get_auth_request con 0x55cc9a46b900 auth_method 0 2024-09-12T00:37:53.376 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:37:53.018+0000 7f350089f640 10 monclient(hunting): get_auth_request con 0x55cc9a46b230 auth_method 0 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:37:53.018+0000 7f350089f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:37:53.018+0000 7f350089f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:37:53.018+0000 7f350089f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.377 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): handle_auth_done global_id 7074 payload 824 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient: _finish_hunting 0 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:37:53.018+0000 7f350009e640 1 monclient: found mon.noname-a 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: dump: 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.378 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 monclient: authenticate success, global_id 7074 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.379 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: dump: 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:37:53.018+0000 7f35010a0640 4 set_mon_vals no callback set 2024-09-12T00:37:53.380 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:37:53.022+0000 7f33e5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:37:53.022+0000 7f33e5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:37:53.022+0000 7f33e5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: build_initial_monmap 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:37:53.022+0000 7f35025989c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient: get_auth_request con 0x7f33d8070a20 auth_method 0 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: monmap: 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:53.381 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding auth protocol: cephx 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding auth protocol: cephx 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding auth protocol: cephx 2024-09-12T00:37:53.382 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:37:53.022+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.383 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: init 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding auth protocol: cephx 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding auth protocol: cephx 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding auth protocol: cephx 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.384 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:37:53.022+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:37:53.022+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffffacbdfa8 EEXIST 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-c con 0x55cc9a4bf290 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-a con 0x55cc9a490390 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-b con 0x55cc9a4b9820 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.385 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): authenticate will time out at 2661.522312s 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): get_auth_request con 0x55cc9a490390 auth_method 0 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): get_auth_request con 0x55cc9a4bf290 auth_method 0 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.386 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): handle_auth_done global_id 7077 payload 274 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient: _finish_hunting 0 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:37:53.022+0000 7f350089f640 1 monclient: found mon.noname-a 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:37:53.022+0000 7f350009e640 10 monclient: get_auth_request con 0x55cc9a4b9820 auth_method 0 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: dump: 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.387 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: _finish_auth 0 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 monclient: authenticate success, global_id 7077 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:37:53.022+0000 7f35025989c0 4 set_mon_vals no callback set 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.388 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: dump: 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: shutdown 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: build_initial_monmap 2024-09-12T00:37:53.389 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:37:53.022+0000 7f35025989c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: monmap: 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding auth protocol: cephx 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding auth protocol: cephx 2024-09-12T00:37:53.390 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding auth protocol: cephx 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.391 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:37:53.026+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:37:53.026+0000 7f35025989c0 1 librados: starting msgr at 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:37:53.026+0000 7f35025989c0 1 librados: starting objecter 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55cc9a470c40 EEXIST 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:37:53.026+0000 7f35025989c0 1 librados: setting wanted keys 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:37:53.026+0000 7f35025989c0 1 librados: calling monclient init 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: init 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding auth protocol: cephx 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding auth protocol: cephx 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding auth protocol: cephx 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.392 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:37:53.026+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:37:53.026+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.393 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command rotate-key cmddesc rotate-key hook 0x55cc9a46d868 EEXIST 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-a con 0x55cc9a490390 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-b con 0x55cc9a4b9820 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-c con 0x55cc9a4bf290 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): authenticate will time out at 2661.525117s 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): get_auth_request con 0x55cc9a490390 auth_method 0 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.394 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): get_auth_request con 0x55cc9a4bf290 auth_method 0 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:37:53.026+0000 7f350089f640 10 monclient(hunting): get_auth_request con 0x55cc9a4b9820 auth_method 0 2024-09-12T00:37:53.395 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:37:53.026+0000 7f350089f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.396 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:37:53.026+0000 7f350089f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:37:53.026+0000 7f350089f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): handle_auth_done global_id 7080 payload 824 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient: _finish_hunting 0 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:37:53.026+0000 7f34ff89d640 1 monclient: found mon.noname-a 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: dump: 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.397 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: dump: 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.398 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 monclient: authenticate success, global_id 7080 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:37:53.026+0000 7f33df7fe640 4 set_mon_vals no callback set 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.399 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:37:53.026+0000 7f35025989c0 1 librados: init done 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command cr dump hook 0x55cc9a4affc8 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:37:53.026+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:37:53.030+0000 7f33ddffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:37:53.030+0000 7f33ddffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:37:53.030+0000 7f33ddffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:37:53.030+0000 7f350089f640 10 monclient: get_auth_request con 0x7f33d0070ae0 auth_method 0 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:37:53.030+0000 7f350009e640 10 monclient: get_auth_request con 0x55cc9a4d90e0 auth_method 0 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 realm 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:37:53.030+0000 7f35025989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.400 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:37:53.030+0000 7f34ff89d640 10 monclient: get_auth_request con 0x55cc9a4dd2d0 auth_method 0 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:37:53.034+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:37:53.034+0000 7f350089f640 10 monclient: get_auth_request con 0x55cc9a4e0b30 auth_method 0 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:37:53.034+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:37:53.034+0000 7f35025989c0 20 searching for the correct realm 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:37:53.034+0000 7f350009e640 10 monclient: get_auth_request con 0x55cc9a4e58f0 auth_method 0 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:37:53.034+0000 7f34ff89d640 10 monclient: get_auth_request con 0x7f34f80e2b60 auth_method 0 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:37:53.038+0000 7f350089f640 10 monclient: get_auth_request con 0x7f34f409dc20 auth_method 0 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:37:53.038+0000 7f350089f640 0 -- 172.21.15.102:0/3259729814 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f34f409dc20 msgr2=0x7f34f406b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:37:53.038+0000 7f33ddffb640 1 client.7080.objecter ms_handle_reset 0x7f34f409dc20 session 0x7f34f409d040 osd.4 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:37:53.038+0000 7f33ddffb640 10 monclient: _renew_subs 2024-09-12T00:37:53.401 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:37:53.038+0000 7f33ddffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:37:53.038+0000 7f350089f640 10 monclient: get_auth_request con 0x7f33d0081200 auth_method 0 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:37:53.042+0000 7f350009e640 10 monclient: get_auth_request con 0x7f34f80f2040 auth_method 0 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:37:53.046+0000 7f34ff89d640 10 monclient: get_auth_request con 0x7f34f80c7a80 auth_method 0 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:37:53.046+0000 7f34ff89d640 0 -- 172.21.15.102:0/3259729814 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f34f80c7a80 msgr2=0x7f34f80bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:37:53.250+0000 7f34ff89d640 10 monclient: get_auth_request con 0x7f34f80c7a80 auth_method 0 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.402 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 zone default found 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:37:53.266+0000 7f35025989c0 4 Realm: () 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:37:53.266+0000 7f35025989c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:37:53.266+0000 7f35025989c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:37:53.266+0000 7f35025989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 zonegroup default 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.403 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.404 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 started sync module instance, tier type = 2024-09-12T00:37:53.404 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:53.404 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=0 2024-09-12T00:37:53.404 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=1 2024-09-12T00:37:53.404 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=2 2024-09-12T00:37:53.404 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=3 2024-09-12T00:37:53.404 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=4 2024-09-12T00:37:53.404 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=5 2024-09-12T00:37:53.404 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=6 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:37:53.294+0000 7f35025989c0 20 add_watcher() i=7 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:37:53.294+0000 7f35025989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding auth protocol: cephx 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding auth protocol: cephx 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding auth protocol: cephx 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.405 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:37:53.298+0000 7f33b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:37:53.298+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command cache list hook 0x55cc9a4baaf0 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command cache inspect hook 0x55cc9a4baaf0 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command cache erase hook 0x55cc9a4baaf0 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command cache zap hook 0x55cc9a4baaf0 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 note: GC not initialized 2024-09-12T00:37:53.406 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:37:53.298+0000 7f33b57e2640 20 reqs_thread_entry: start 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command sync trace show hook 0x7f34f80a8480 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command sync trace history hook 0x7f34f80a8480 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command sync trace active hook 0x7f34f80a8480 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command sync trace active_short hook 0x7f34f80a8480 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 Filter name: none 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:37:53.298+0000 7f3326ffd640 20 reqs_thread_entry: start 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:37:53.298+0000 7f35025989c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:37:53.298+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:37:53.298+0000 7f35025989c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:37:53.298+0000 7f35025989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 : miss 2024-09-12T00:37:53.407 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:37:53.302+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:37:53.302+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:37:53.302+0000 7f35025989c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:37:53.302+0000 7f35025989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:37:53.302+0000 7f35025989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:37:53.302+0000 7f35025989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:37:53.310+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:37:53.310+0000 7f35025989c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:37:53.310+0000 7f35025989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:37:53.310+0000 7f35025989c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30, ofs0, ns] 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398934 cookie 94337250538432 notifier 7080 bl.length()=999 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.408 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_sources= new_sources= 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential sources added=[] removed=[] 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_dests= new_dests= 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential dests added=[] removed=[] 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.0 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.0 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.1 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.1 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.2 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.2 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.3 2024-09-12T00:37:53.409 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.3 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.4 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.4 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.5 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.5 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.6 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.6 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.7 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.7 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.8 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.8 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.9 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.9 2024-09-12T00:37:53.410 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.10 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.10 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.11 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.11 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.0 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.3 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.4 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.5 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.6 2024-09-12T00:37:53.411 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.7 2024-09-12T00:37:53.412 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.8 2024-09-12T00:37:53.412 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:37:53.334+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.9 2024-09-12T00:37:53.412 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:37:53.334+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.10 2024-09-12T00:37:53.412 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:37:53.338+0000 7f35025989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:53.412 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:37:53.338+0000 7f35025989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 2024-09-12T00:37:53.412 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:37:53.342+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.412 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:37:53.342+0000 7f35025989c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.412 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:37:53.342+0000 7f35025989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.412 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:37:53.342+0000 7f35025989c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30, ofs0, ns] 2024-09-12T00:37:53.412 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398935 cookie 94337250538432 notifier 7080 bl.length()=999 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_sources= new_sources= 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential sources added=[] removed=[] 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_dests= new_dests= 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential dests added=[] removed=[] 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:37:53.346+0000 7f35025989c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f35025989c0 time 2024-09-12T00:37:53.346539+0000 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3505e722eb] 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3505e7249f] 2024-09-12T00:37:53.413 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc98de6cc1] 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55cc98dfb086] 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55cc98dfc6a4] 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3504cd8d90] 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:37:53.346+0000 7f35025989c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f35025989c0 thread_name:radosgw-admin 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3504cf1520] 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:37:53.414 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3505e72345] 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3505e7249f] 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc98de6cc1] 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55cc98dfb086] 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55cc98dfc6a4] 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3504cd8d90] 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:37:53.415 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:37:53.416 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:37:53.417 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:37:53.418 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:37:53.419 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:53.420 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:53.421 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:53.422 INFO:tasks.workunit.client.0.smithi102.stderr: 7f3326ffd640 / http_manager 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33b57e2640 / http_manager 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33b67e4640 / rgw_dt_lg_renew 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33ddffb640 / ms_dispatch 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33deffd640 / io_context_pool 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33df7fe640 / io_context_pool 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33e5ffb640 / ms_dispatch 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33ece09640 / ms_dispatch 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33ee60c640 / io_context_pool 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f34ff89d640 / msgr-worker-2 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f350009e640 / msgr-worker-1 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f350089f640 / msgr-worker-0 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f35010a0640 / io_context_pool 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: 7f35025989c0 / radosgw-admin 2024-09-12T00:37:53.423 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.107661.log 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: crc 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: crc 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: secure 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: crc 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: secure 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: crc 2024-09-12T00:37:53.424 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 AuthRegistry(0x55cc9a3ec950) adding con mode: secure 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:37:53.006+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:37:53.006+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command rotate-key hook 0x55cc9a3eca98 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-c con 0x55cc9a29d120 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-a con 0x55cc9a2a8e70 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-b con 0x55cc9a3efd30 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:53.425 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient(hunting): authenticate will time out at 2661.506832s 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): get_auth_request con 0x55cc9a29d120 auth_method 0 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): get_auth_request con 0x55cc9a2a8e70 auth_method 0 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.426 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:37:53.006+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient(hunting): handle_auth_done global_id 6635 payload 824 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient: _finish_hunting 0 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:37:53.006+0000 7f350009e640 1 monclient: found mon.noname-c 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:37:53.006+0000 7f350009e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: dump: 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.427 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: _finish_auth 0 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: _check_auth_tickets 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:37:53.006+0000 7f33ece09640 10 monclient: dump: 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.428 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.429 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.429 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.429 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.429 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.429 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.429 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.429 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.429 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:37:53.006+0000 7f35025989c0 5 monclient: authenticate success, global_id 6635 2024-09-12T00:37:53.429 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.429 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:37:53.006+0000 7f33ee60c640 4 set_mon_vals no callback set 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:37:53.006+0000 7f35025989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:37:53.006+0000 7f35025989c0 1 librados: init done 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:37:53.010+0000 7f33ece09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:37:53.010+0000 7f33ece09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:37:53.010+0000 7f33ece09640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:37:53.010+0000 7f34ff89d640 10 monclient: get_auth_request con 0x7f33e8070ae0 auth_method 0 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:37:53.010+0000 7f350089f640 10 monclient: get_auth_request con 0x55cc9a42dd60 auth_method 0 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:37:53.010+0000 7f350009e640 10 monclient: get_auth_request con 0x55cc9a4379e0 auth_method 0 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:37:53.014+0000 7f34ff89d640 10 monclient: get_auth_request con 0x55cc9a43bbd0 auth_method 0 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:37:53.014+0000 7f350089f640 10 monclient: get_auth_request con 0x55cc9a43b2c0 auth_method 0 2024-09-12T00:37:53.430 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: build_initial_monmap 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:37:53.018+0000 7f35025989c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: monmap: 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding auth protocol: cephx 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding auth protocol: cephx 2024-09-12T00:37:53.431 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding auth protocol: cephx 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: crc 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a443d80) adding con mode: secure 2024-09-12T00:37:53.432 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:37:53.018+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55cc9a447750 EEXIST 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: init 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding auth protocol: cephx 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding auth protocol: cephx 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding auth protocol: cephx 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.433 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: crc 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 AuthRegistry(0x55cc9a442c78) adding con mode: secure 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:37:53.018+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:37:53.018+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command rotate-key cmddesc rotate-key hook 0x55cc9a442dc0 EEXIST 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-c con 0x55cc9a46b900 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-b con 0x55cc9a46b230 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-a con 0x55cc9a469c10 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.434 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient(hunting): authenticate will time out at 2661.517789s 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): get_auth_request con 0x55cc9a469c10 auth_method 0 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): get_auth_request con 0x55cc9a46b900 auth_method 0 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.435 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.436 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.436 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.436 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.436 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.436 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.436 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:37:53.018+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.436 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:37:53.018+0000 7f350089f640 10 monclient(hunting): get_auth_request con 0x55cc9a46b230 auth_method 0 2024-09-12T00:37:53.436 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:37:53.018+0000 7f350089f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.436 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:37:53.018+0000 7f350089f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.437 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:37:53.018+0000 7f350089f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.437 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient(hunting): handle_auth_done global_id 7074 payload 824 2024-09-12T00:37:53.437 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient: _finish_hunting 0 2024-09-12T00:37:53.437 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:37:53.018+0000 7f350009e640 1 monclient: found mon.noname-a 2024-09-12T00:37:53.437 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:37:53.018+0000 7f350009e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.437 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.437 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:53.437 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: dump: 2024-09-12T00:37:53.437 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.437 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:37:53.018+0000 7f35025989c0 5 monclient: authenticate success, global_id 7074 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.438 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:37:53.018+0000 7f33e5ffb640 10 monclient: dump: 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.439 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:37:53.018+0000 7f35010a0640 4 set_mon_vals no callback set 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:37:53.018+0000 7f35025989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:37:53.022+0000 7f33e5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:37:53.022+0000 7f33e5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:37:53.022+0000 7f33e5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: build_initial_monmap 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:37:53.022+0000 7f35025989c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient: get_auth_request con 0x7f33d8070a20 auth_method 0 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: monmap: 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:53.440 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding auth protocol: cephx 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding auth protocol: cephx 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding auth protocol: cephx 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.441 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: crc 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad70) adding con mode: secure 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:37:53.022+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: init 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding auth protocol: cephx 2024-09-12T00:37:53.442 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding auth protocol: cephx 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding auth protocol: cephx 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.443 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: crc 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbde60) adding con mode: secure 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:37:53.022+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:37:53.022+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffffacbdfa8 EEXIST 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-c con 0x55cc9a4bf290 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-a con 0x55cc9a490390 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-b con 0x55cc9a4b9820 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.444 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient(hunting): authenticate will time out at 2661.522312s 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): get_auth_request con 0x55cc9a490390 auth_method 0 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): get_auth_request con 0x55cc9a4bf290 auth_method 0 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.445 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:37:53.022+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient(hunting): handle_auth_done global_id 7077 payload 274 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient: _finish_hunting 0 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:37:53.022+0000 7f350089f640 1 monclient: found mon.noname-a 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:37:53.022+0000 7f350089f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:37:53.022+0000 7f350009e640 10 monclient: get_auth_request con 0x55cc9a4b9820 auth_method 0 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: dump: 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.446 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: _finish_auth 0 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:37:53.022+0000 7f35025989c0 5 monclient: authenticate success, global_id 7077 2024-09-12T00:37:53.447 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:37:53.022+0000 7f35025989c0 4 set_mon_vals no callback set 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:37:53.022+0000 7f33df7fe640 10 monclient: dump: 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.448 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: shutdown 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:37:53.022+0000 7f35025989c0 10 monclient: build_initial_monmap 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:37:53.022+0000 7f35025989c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: monmap: 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:53.449 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding auth protocol: cephx 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding auth protocol: cephx 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding auth protocol: cephx 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.450 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: crc 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a48ad20) adding con mode: secure 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:37:53.026+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:37:53.026+0000 7f35025989c0 1 librados: starting msgr at 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:37:53.026+0000 7f35025989c0 1 librados: starting objecter 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55cc9a470c40 EEXIST 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:37:53.026+0000 7f35025989c0 1 librados: setting wanted keys 2024-09-12T00:37:53.451 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:37:53.026+0000 7f35025989c0 1 librados: calling monclient init 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: init 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding auth protocol: cephx 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding auth protocol: cephx 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding auth protocol: cephx 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.452 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: crc 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 AuthRegistry(0x55cc9a46d720) adding con mode: secure 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:37:53.026+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:37:53.026+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command rotate-key cmddesc rotate-key hook 0x55cc9a46d868 EEXIST 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-a con 0x55cc9a490390 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-b con 0x55cc9a4b9820 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:37:53.453 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): picked mon.noname-c con 0x55cc9a4bf290 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:37:53.454 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.454 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.454 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:53.454 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:53.454 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient(hunting): authenticate will time out at 2661.525117s 2024-09-12T00:37:53.454 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): get_auth_request con 0x55cc9a490390 auth_method 0 2024-09-12T00:37:53.454 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.454 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): get_auth_request con 0x55cc9a4bf290 auth_method 0 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:37:53.026+0000 7f350009e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:37:53.026+0000 7f350089f640 10 monclient(hunting): get_auth_request con 0x55cc9a4b9820 auth_method 0 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:37:53.026+0000 7f350089f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:37:53.026+0000 7f350089f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:53.455 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:37:53.026+0000 7f350089f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient(hunting): handle_auth_done global_id 7080 payload 824 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient: _finish_hunting 0 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:37:53.026+0000 7f34ff89d640 1 monclient: found mon.noname-a 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:37:53.026+0000 7f34ff89d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: dump: 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.456 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:37:53.026+0000 7f33ddffb640 10 monclient: dump: 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:37:53.457 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 monclient: authenticate success, global_id 7080 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:37:53.026+0000 7f33df7fe640 4 set_mon_vals no callback set 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _renew_subs 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:37:53.026+0000 7f35025989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.458 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:37:53.026+0000 7f35025989c0 1 librados: init done 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:37:53.026+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command cr dump hook 0x55cc9a4affc8 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:37:53.026+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:37:53.030+0000 7f33ddffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:37:53.030+0000 7f33ddffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:37:53.030+0000 7f33ddffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:37:53.030+0000 7f350089f640 10 monclient: get_auth_request con 0x7f33d0070ae0 auth_method 0 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:37:53.030+0000 7f350009e640 10 monclient: get_auth_request con 0x55cc9a4d90e0 auth_method 0 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 realm 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:37:53.030+0000 7f35025989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.459 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:37:53.030+0000 7f34ff89d640 10 monclient: get_auth_request con 0x55cc9a4dd2d0 auth_method 0 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:37:53.030+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:37:53.034+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:37:53.034+0000 7f350089f640 10 monclient: get_auth_request con 0x55cc9a4e0b30 auth_method 0 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:37:53.034+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:37:53.034+0000 7f35025989c0 20 searching for the correct realm 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:37:53.034+0000 7f350009e640 10 monclient: get_auth_request con 0x55cc9a4e58f0 auth_method 0 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:37:53.034+0000 7f34ff89d640 10 monclient: get_auth_request con 0x7f34f80e2b60 auth_method 0 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:37:53.038+0000 7f350089f640 10 monclient: get_auth_request con 0x7f34f409dc20 auth_method 0 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:37:53.038+0000 7f350089f640 0 -- 172.21.15.102:0/3259729814 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f34f409dc20 msgr2=0x7f34f406b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:37:53.038+0000 7f33ddffb640 1 client.7080.objecter ms_handle_reset 0x7f34f409dc20 session 0x7f34f409d040 osd.4 2024-09-12T00:37:53.460 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:37:53.038+0000 7f33ddffb640 10 monclient: _renew_subs 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:37:53.038+0000 7f33ddffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:37:53.038+0000 7f350089f640 10 monclient: get_auth_request con 0x7f33d0081200 auth_method 0 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:37:53.042+0000 7f350009e640 10 monclient: get_auth_request con 0x7f34f80f2040 auth_method 0 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:37:53.046+0000 7f34ff89d640 10 monclient: get_auth_request con 0x7f34f80c7a80 auth_method 0 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:37:53.046+0000 7f34ff89d640 0 -- 172.21.15.102:0/3259729814 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f34f80c7a80 msgr2=0x7f34f80bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:37:53.250+0000 7f34ff89d640 10 monclient: get_auth_request con 0x7f34f80c7a80 auth_method 0 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:53.461 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:37:53.262+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 zone default found 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:37:53.266+0000 7f35025989c0 4 Realm: () 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:37:53.266+0000 7f35025989c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:37:53.266+0000 7f35025989c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:37:53.266+0000 7f35025989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 zonegroup default 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.462 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 started sync module instance, tier type = 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:37:53.266+0000 7f35025989c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=0 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=1 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=2 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=3 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=4 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=5 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:37:53.290+0000 7f35025989c0 20 add_watcher() i=6 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:37:53.294+0000 7f35025989c0 20 add_watcher() i=7 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:37:53.294+0000 7f35025989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:53.463 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding auth protocol: cephx 2024-09-12T00:37:53.464 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding auth protocol: cephx 2024-09-12T00:37:53.464 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding auth protocol: cephx 2024-09-12T00:37:53.464 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.464 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.464 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.464 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.464 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.464 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.465 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.465 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.465 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.465 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.465 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: crc 2024-09-12T00:37:53.465 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:37:53.298+0000 7f33b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.466 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 AuthRegistry(0x7ffffacbe340) adding con mode: secure 2024-09-12T00:37:53.466 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:37:53.298+0000 7f35025989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:53.466 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:53.466 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:53.466 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command cache list hook 0x55cc9a4baaf0 2024-09-12T00:37:53.466 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command cache inspect hook 0x55cc9a4baaf0 2024-09-12T00:37:53.466 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command cache erase hook 0x55cc9a4baaf0 2024-09-12T00:37:53.467 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command cache zap hook 0x55cc9a4baaf0 2024-09-12T00:37:53.467 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 note: GC not initialized 2024-09-12T00:37:53.467 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:37:53.298+0000 7f33b57e2640 20 reqs_thread_entry: start 2024-09-12T00:37:53.467 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command sync trace show hook 0x7f34f80a8480 2024-09-12T00:37:53.467 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command sync trace history hook 0x7f34f80a8480 2024-09-12T00:37:53.467 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command sync trace active hook 0x7f34f80a8480 2024-09-12T00:37:53.468 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:37:53.298+0000 7f35025989c0 5 asok(0x55cc9a1df2b0) register_command sync trace active_short hook 0x7f34f80a8480 2024-09-12T00:37:53.468 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:53.468 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 Filter name: none 2024-09-12T00:37:53.468 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:37:53.298+0000 7f3326ffd640 20 reqs_thread_entry: start 2024-09-12T00:37:53.468 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:37:53.298+0000 7f35025989c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:37:53.468 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.469 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:53.469 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:37:53.298+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:37:53.469 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:37:53.298+0000 7f35025989c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:37:53.469 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:37:53.298+0000 7f35025989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 : miss 2024-09-12T00:37:53.469 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:37:53.298+0000 7f35025989c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.469 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:37:53.302+0000 7f35025989c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:37:53.470 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:37:53.302+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.470 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:37:53.302+0000 7f35025989c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.470 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:37:53.302+0000 7f35025989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:53.470 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:37:53.302+0000 7f35025989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.470 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:37:53.302+0000 7f35025989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 2024-09-12T00:37:53.470 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:37:53.310+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.471 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:37:53.310+0000 7f35025989c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.471 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:37:53.310+0000 7f35025989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.471 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:37:53.310+0000 7f35025989c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30, ofs0, ns] 2024-09-12T00:37:53.471 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398934 cookie 94337250538432 notifier 7080 bl.length()=999 2024-09-12T00:37:53.471 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.471 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.472 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:37:53.310+0000 7f33deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.472 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_sources= new_sources= 2024-09-12T00:37:53.472 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential sources added=[] removed=[] 2024-09-12T00:37:53.472 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_dests= new_dests= 2024-09-12T00:37:53.472 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:37:53.314+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential dests added=[] removed=[] 2024-09-12T00:37:53.473 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.0 2024-09-12T00:37:53.473 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.0 2024-09-12T00:37:53.473 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.1 2024-09-12T00:37:53.473 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.1 2024-09-12T00:37:53.473 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.2 2024-09-12T00:37:53.473 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.2 2024-09-12T00:37:53.474 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.3 2024-09-12T00:37:53.474 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.3 2024-09-12T00:37:53.474 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.4 2024-09-12T00:37:53.474 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.4 2024-09-12T00:37:53.474 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.5 2024-09-12T00:37:53.474 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.5 2024-09-12T00:37:53.475 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.6 2024-09-12T00:37:53.475 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.6 2024-09-12T00:37:53.475 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.7 2024-09-12T00:37:53.475 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.7 2024-09-12T00:37:53.475 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.8 2024-09-12T00:37:53.476 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.8 2024-09-12T00:37:53.476 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.9 2024-09-12T00:37:53.476 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.9 2024-09-12T00:37:53.476 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.10 2024-09-12T00:37:53.476 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.10 2024-09-12T00:37:53.476 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:37:53.322+0000 7f35025989c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.11 2024-09-12T00:37:53.477 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1.11 2024-09-12T00:37:53.477 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:37:53.322+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.0 2024-09-12T00:37:53.477 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1 2024-09-12T00:37:53.477 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2 2024-09-12T00:37:53.477 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.3 2024-09-12T00:37:53.478 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:37:53.326+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.4 2024-09-12T00:37:53.478 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.5 2024-09-12T00:37:53.478 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.6 2024-09-12T00:37:53.478 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.7 2024-09-12T00:37:53.478 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:37:53.330+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.8 2024-09-12T00:37:53.478 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:37:53.334+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.9 2024-09-12T00:37:53.479 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:37:53.334+0000 7f35025989c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.10 2024-09-12T00:37:53.479 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:37:53.338+0000 7f35025989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:53.479 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:37:53.338+0000 7f35025989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 2024-09-12T00:37:53.479 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:37:53.342+0000 7f35025989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.479 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:37:53.342+0000 7f35025989c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.479 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:37:53.342+0000 7f35025989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.480 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:37:53.342+0000 7f35025989c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30, ofs0, ns] 2024-09-12T00:37:53.480 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398935 cookie 94337250538432 notifier 7080 bl.length()=999 2024-09-12T00:37:53.480 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:53.480 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:53.480 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:37:53.342+0000 7f33deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:53.480 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_sources= new_sources= 2024-09-12T00:37:53.481 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential sources added=[] removed=[] 2024-09-12T00:37:53.481 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_dests= new_dests= 2024-09-12T00:37:53.481 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:37:53.346+0000 7f35025989c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential dests added=[] removed=[] 2024-09-12T00:37:53.481 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:37:53.346+0000 7f35025989c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f35025989c0 time 2024-09-12T00:37:53.346539+0000 2024-09-12T00:37:53.481 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:53.482 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.482 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:53.482 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3505e722eb] 2024-09-12T00:37:53.482 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3505e7249f] 2024-09-12T00:37:53.482 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc98de6cc1] 2024-09-12T00:37:53.482 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55cc98dfb086] 2024-09-12T00:37:53.483 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55cc98dfc6a4] 2024-09-12T00:37:53.483 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:37:53.483 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3504cd8d90] 2024-09-12T00:37:53.483 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:37:53.483 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:37:53.483 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.484 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:37:53.346+0000 7f35025989c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:53.484 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f35025989c0 thread_name:radosgw-admin 2024-09-12T00:37:53.484 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.484 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:53.484 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3504cf1520] 2024-09-12T00:37:53.485 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:37:53.485 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:37:53.485 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:37:53.485 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3505e72345] 2024-09-12T00:37:53.485 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3505e7249f] 2024-09-12T00:37:53.485 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc98de6cc1] 2024-09-12T00:37:53.486 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55cc98dfb086] 2024-09-12T00:37:53.486 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55cc98dfc6a4] 2024-09-12T00:37:53.486 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:37:53.486 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3504cd8d90] 2024-09-12T00:37:53.488 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:37:53.488 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:37:53.488 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:53.488 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.489 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:37:53.489 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:37:53.489 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:37:53.489 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:37:53.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:37:53.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:37:53.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:53.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:37:53.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:37:53.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:53.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:53.491 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:53.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:37:53.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:37:53.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:37:53.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:37:53.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:37:53.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:37:53.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:37:53.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:53.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:53.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:53.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:37:53.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:37:53.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:53.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:37:53.493 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:37:53.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:37:53.494 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:37:53.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:37:53.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:37:53.494 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:37:53.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:37:53.494 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:37:53.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:37:53.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:53.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:37:53.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7f3326ffd640 / http_manager 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33b57e2640 / http_manager 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33b67e4640 / rgw_dt_lg_renew 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33ddffb640 / ms_dispatch 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33deffd640 / io_context_pool 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33df7fe640 / io_context_pool 2024-09-12T00:37:53.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33e5ffb640 / ms_dispatch 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33ece09640 / ms_dispatch 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr: 7f33ee60c640 / io_context_pool 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr: 7f34ff89d640 / msgr-worker-2 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr: 7f350009e640 / msgr-worker-1 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr: 7f350089f640 / msgr-worker-0 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr: 7f35010a0640 / io_context_pool 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr: 7f35025989c0 / radosgw-admin 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:37:53.349066Z_ff7e8ac9-2aa0-40de-a455-b8db44803c36/log 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:37:53.500 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:37:53.502 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:53.502 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:53.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.433+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.433+0000 7f39163cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.433+0000 7f39163cf9c0 20 realm 2024-09-12T00:37:53.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.433+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.433+0000 7f39163cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.433+0000 7f39163cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.433+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.433+0000 7f39163cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.433+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.437+0000 7f39163cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.437+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.437+0000 7f39163cf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.437+0000 7f39163cf9c0 20 searching for the correct realm 2024-09-12T00:37:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.441+0000 7f39146d6640 0 -- 172.21.15.102:0/1432383454 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f39080c5040 msgr2=0x7f39080ac3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.449+0000 7f39136d4640 0 -- 172.21.15.102:0/1432383454 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f390c057040 msgr2=0x7f390c057930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:53.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.665+0000 7f39163cf9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:53.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.665+0000 7f39163cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:53.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.665+0000 7f39163cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:53.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.665+0000 7f39163cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:53.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.665+0000 7f39163cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:53.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.665+0000 7f39163cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:53.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.665+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.665+0000 7f39163cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.665+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:53.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:53.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 zone default found 2024-09-12T00:37:53.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 4 Realm: () 2024-09-12T00:37:53.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:53.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:53.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:53.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 zonegroup default 2024-09-12T00:37:53.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:53.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 started sync module instance, tier type = 2024-09-12T00:37:53.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.669+0000 7f39163cf9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:53.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.697+0000 7f39163cf9c0 20 add_watcher() i=0 2024-09-12T00:37:53.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.697+0000 7f39163cf9c0 20 add_watcher() i=1 2024-09-12T00:37:53.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.697+0000 7f39163cf9c0 20 add_watcher() i=2 2024-09-12T00:37:53.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.697+0000 7f39163cf9c0 20 add_watcher() i=3 2024-09-12T00:37:53.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.697+0000 7f39163cf9c0 20 add_watcher() i=4 2024-09-12T00:37:53.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.697+0000 7f39163cf9c0 20 add_watcher() i=5 2024-09-12T00:37:53.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.697+0000 7f39163cf9c0 20 add_watcher() i=6 2024-09-12T00:37:53.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.701+0000 7f39163cf9c0 20 add_watcher() i=7 2024-09-12T00:37:53.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.701+0000 7f39163cf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:53.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.705+0000 7f37c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.705+0000 7f39163cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:53.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.705+0000 7f39163cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:53.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.705+0000 7f39163cf9c0 5 note: GC not initialized 2024-09-12T00:37:53.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f37c8fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:53.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:53.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 Filter name: none 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f37427fc640 20 reqs_thread_entry: start 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:53.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:37:53.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:53.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:53.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:53.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:37:53.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.709+0000 7f39163cf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:53.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.713+0000 7f37c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:53.714 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.717+0000 7f39163cf9c0 20 remove_watcher() i=0 2024-09-12T00:37:53.715 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.717+0000 7f39163cf9c0 2 removed watcher, disabling cache 2024-09-12T00:37:53.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.721+0000 7f39163cf9c0 20 remove_watcher() i=1 2024-09-12T00:37:53.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.725+0000 7f39163cf9c0 20 remove_watcher() i=2 2024-09-12T00:37:53.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.725+0000 7f39163cf9c0 20 remove_watcher() i=3 2024-09-12T00:37:53.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.729+0000 7f39163cf9c0 20 remove_watcher() i=4 2024-09-12T00:37:53.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.729+0000 7f39163cf9c0 20 remove_watcher() i=5 2024-09-12T00:37:53.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.729+0000 7f39163cf9c0 20 remove_watcher() i=6 2024-09-12T00:37:53.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:53.733+0000 7f39163cf9c0 20 remove_watcher() i=7 2024-09-12T00:37:53.743 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.743 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:37:53.743 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-block-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:53.743 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:37:53.744 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:53.744 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:53.791 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:53.791 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:37:53.852 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:53.889 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:53.889 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:54.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.145+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.142 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:54.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 realm 2024-09-12T00:37:54.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:54.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:54.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:54.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:54.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:54.146 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.149+0000 7fbbbc8b19c0 20 searching for the correct realm 2024-09-12T00:37:54.148 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.153+0000 7fbbb9bb6640 0 -- 172.21.15.102:0/973619283 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7fbbb4004040 msgr2=0x7fbbb412bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:54.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.365+0000 7fbbbabb8640 0 -- 172.21.15.102:0/973619283 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x562242d254e0 msgr2=0x562242d278d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:54.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:37:54.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:54.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:54.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:37:54.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:54.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:54.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:54.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:54.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:54.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 zone default found 2024-09-12T00:37:54.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 4 Realm: () 2024-09-12T00:37:54.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:37:54.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:37:54.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:54.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 zonegroup default 2024-09-12T00:37:54.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:54.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.385+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.389+0000 7fbbbc8b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:54.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.389+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.389+0000 7fbbbc8b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:54.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.389+0000 7fbbbc8b19c0 20 started sync module instance, tier type = 2024-09-12T00:37:54.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.389+0000 7fbbbc8b19c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:37:54.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.413+0000 7fbbbc8b19c0 20 add_watcher() i=0 2024-09-12T00:37:54.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.413+0000 7fbbbc8b19c0 20 add_watcher() i=1 2024-09-12T00:37:54.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.413+0000 7fbbbc8b19c0 20 add_watcher() i=2 2024-09-12T00:37:54.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.413+0000 7fbbbc8b19c0 20 add_watcher() i=3 2024-09-12T00:37:54.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.413+0000 7fbbbc8b19c0 20 add_watcher() i=4 2024-09-12T00:37:54.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.413+0000 7fbbbc8b19c0 20 add_watcher() i=5 2024-09-12T00:37:54.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.413+0000 7fbbbc8b19c0 20 add_watcher() i=6 2024-09-12T00:37:54.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.413+0000 7fbbbc8b19c0 20 add_watcher() i=7 2024-09-12T00:37:54.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.413+0000 7fbbbc8b19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:54.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.417+0000 7fba70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:54.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.417+0000 7fbbbc8b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:54.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.417+0000 7fbbbc8b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:54.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.417+0000 7fbbbc8b19c0 5 note: GC not initialized 2024-09-12T00:37:54.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.417+0000 7fb9eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:54.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 20 Filter name: none 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fb9e97fa640 20 reqs_thread_entry: start 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 : miss 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:37:54.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:37:54.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:37:54.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:54.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:37:54.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.421+0000 7fbbbc8b19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 2024-09-12T00:37:54.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.425+0000 7fbbbc8b19c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to be held by another RGW process; skipping for now 2024-09-12T00:37:54.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.425+0000 7fba70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.429+0000 7fbbbc8b19c0 20 remove_watcher() i=0 2024-09-12T00:37:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.429+0000 7fbbbc8b19c0 2 removed watcher, disabling cache 2024-09-12T00:37:54.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.433+0000 7fbbbc8b19c0 20 remove_watcher() i=1 2024-09-12T00:37:54.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.433+0000 7fbbbc8b19c0 20 remove_watcher() i=2 2024-09-12T00:37:54.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.437+0000 7fbbbc8b19c0 20 remove_watcher() i=3 2024-09-12T00:37:54.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.441+0000 7fbbbc8b19c0 20 remove_watcher() i=4 2024-09-12T00:37:54.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.441+0000 7fbbbc8b19c0 20 remove_watcher() i=5 2024-09-12T00:37:54.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.441+0000 7fbbbc8b19c0 20 remove_watcher() i=6 2024-09-12T00:37:54.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:37:54.445+0000 7fbbbc8b19c0 20 remove_watcher() i=7 2024-09-12T00:37:54.454 INFO:tasks.workunit.client.0.smithi102.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:38:24.487 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:24.522 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:24.522 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.573+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.573+0000 7f6d1a5b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.573+0000 7f6d1a5b99c0 20 realm 2024-09-12T00:38:24.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.573+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.573+0000 7f6d1a5b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.573+0000 7f6d1a5b99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.573+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.573+0000 7f6d1a5b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.573+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.577+0000 7f6d1a5b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:24.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.577+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.577+0000 7f6d1a5b99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:24.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.577+0000 7f6d1a5b99c0 20 searching for the correct realm 2024-09-12T00:38:24.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.581+0000 7f6d188c0640 0 -- 172.21.15.102:0/299395876 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f6d08004020 msgr2=0x7f6d081113e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:24.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.589+0000 7f6d178be640 0 -- 172.21.15.102:0/299395876 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6d10008040 msgr2=0x7f6d1001fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:24.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.805+0000 7f6d1a5b99c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:24.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.805+0000 7f6d1a5b99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:24.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.805+0000 7f6d1a5b99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:24.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.805+0000 7f6d1a5b99c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:24.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.805+0000 7f6d1a5b99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:24.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.805+0000 7f6d1a5b99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:24.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.805+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:24.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 20 zone default found 2024-09-12T00:38:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 4 Realm: () 2024-09-12T00:38:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:24.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:24.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:24.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 20 zonegroup default 2024-09-12T00:38:24.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.809+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.813+0000 7f6d1a5b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.813+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.813+0000 7f6d1a5b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.813+0000 7f6d1a5b99c0 20 started sync module instance, tier type = 2024-09-12T00:38:24.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.813+0000 7f6d1a5b99c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:24.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.833+0000 7f6d1a5b99c0 20 add_watcher() i=0 2024-09-12T00:38:24.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.833+0000 7f6d1a5b99c0 20 add_watcher() i=1 2024-09-12T00:38:24.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.833+0000 7f6d1a5b99c0 20 add_watcher() i=2 2024-09-12T00:38:24.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.833+0000 7f6d1a5b99c0 20 add_watcher() i=3 2024-09-12T00:38:24.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.833+0000 7f6d1a5b99c0 20 add_watcher() i=4 2024-09-12T00:38:24.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.833+0000 7f6d1a5b99c0 20 add_watcher() i=5 2024-09-12T00:38:24.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.833+0000 7f6d1a5b99c0 20 add_watcher() i=6 2024-09-12T00:38:24.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.837+0000 7f6d1a5b99c0 20 add_watcher() i=7 2024-09-12T00:38:24.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.837+0000 7f6d1a5b99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:24.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.841+0000 7f6bcf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:24.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.841+0000 7f6d1a5b99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:24.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.841+0000 7f6d1a5b99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:24.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.841+0000 7f6d1a5b99c0 5 note: GC not initialized 2024-09-12T00:38:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.841+0000 7f6bce7dc640 20 reqs_thread_entry: start 2024-09-12T00:38:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.841+0000 7f6d1a5b99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 20 Filter name: none 2024-09-12T00:38:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6bc7fff640 20 reqs_thread_entry: start 2024-09-12T00:38:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:38:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:38:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:38:24.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:38:24.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 : miss 2024-09-12T00:38:24.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:38:24.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:38:24.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:38:24.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:24.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:24.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.845+0000 7f6d1a5b99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 2024-09-12T00:38:24.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.849+0000 7f6d1a5b99c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:24.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.861+0000 7f6d1a5b99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:38:24.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.861+0000 7f6d1a5b99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:38:24.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.861+0000 7f6d1a5b99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:24.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.861+0000 7f6d1a5b99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30, ofs0, ns] 2024-09-12T00:38:24.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.861+0000 7f6beeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398936 cookie 93876874672272 notifier 7131 bl.length()=999 2024-09-12T00:38:24.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.861+0000 7f6beeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:38:24.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.861+0000 7f6beeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:38:24.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.861+0000 7f6beeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:24.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.865+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_sources= new_sources= 2024-09-12T00:38:24.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.865+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential sources added=[] removed=[] 2024-09-12T00:38:24.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.865+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_dests= new_dests= 2024-09-12T00:38:24.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.865+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential dests added=[] removed=[] 2024-09-12T00:38:24.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.0 2024-09-12T00:38:24.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.0 2024-09-12T00:38:24.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.1 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.1 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.2 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.2 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.3 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.3 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.4 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.4 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.5 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.5 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.6 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.6 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.7 2024-09-12T00:38:24.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.7 2024-09-12T00:38:24.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.8 2024-09-12T00:38:24.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.8 2024-09-12T00:38:24.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.9 2024-09-12T00:38:24.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.9 2024-09-12T00:38:24.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.10 2024-09-12T00:38:24.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.10 2024-09-12T00:38:24.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.11 2024-09-12T00:38:24.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2.11 2024-09-12T00:38:24.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.0 2024-09-12T00:38:24.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1 2024-09-12T00:38:24.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2 2024-09-12T00:38:24.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.877+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.3 2024-09-12T00:38:24.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.881+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.4 2024-09-12T00:38:24.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.881+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.5 2024-09-12T00:38:24.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.881+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.6 2024-09-12T00:38:24.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.881+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.7 2024-09-12T00:38:24.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.881+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.8 2024-09-12T00:38:24.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.885+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.9 2024-09-12T00:38:24.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.885+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.10 2024-09-12T00:38:24.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.889+0000 7f6d1a5b99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:24.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.889+0000 7f6d1a5b99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 2024-09-12T00:38:24.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.893+0000 7f6d1a5b99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:38:24.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.893+0000 7f6d1a5b99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:38:24.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.893+0000 7f6d1a5b99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:24.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.893+0000 7f6d1a5b99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30, ofs0, ns] 2024-09-12T00:38:24.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.893+0000 7f6bef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398937 cookie 93876874672272 notifier 7131 bl.length()=999 2024-09-12T00:38:24.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.893+0000 7f6bef7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:38:24.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.893+0000 7f6bef7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:38:24.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.893+0000 7f6bef7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:24.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.897+0000 7f6bef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398938 cookie 93876874672272 notifier 7131 bl.length()=999 2024-09-12T00:38:24.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.897+0000 7f6bef7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:38:24.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.897+0000 7f6bef7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:38:24.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.897+0000 7f6bef7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:24.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.901+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_sources= new_sources= 2024-09-12T00:38:24.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.901+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential sources added=[] removed=[] 2024-09-12T00:38:24.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.901+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_dests= new_dests= 2024-09-12T00:38:24.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.901+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential dests added=[] removed=[] 2024-09-12T00:38:24.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.905+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.0 2024-09-12T00:38:24.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.905+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.1 2024-09-12T00:38:24.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.905+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.2 2024-09-12T00:38:24.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.905+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.3 2024-09-12T00:38:24.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.909+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.4 2024-09-12T00:38:24.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.909+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.5 2024-09-12T00:38:24.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.909+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.6 2024-09-12T00:38:24.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.909+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.7 2024-09-12T00:38:24.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.909+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.8 2024-09-12T00:38:24.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.909+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.9 2024-09-12T00:38:24.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.909+0000 7f6d1a5b99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30.10 2024-09-12T00:38:24.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.913+0000 7f6d1a5b99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:24.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.913+0000 7f6d1a5b99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 2024-09-12T00:38:24.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.913+0000 7f6d1a5b99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:38:24.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.913+0000 7f6d1a5b99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:38:24.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.913+0000 7f6d1a5b99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:24.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.913+0000 7f6d1a5b99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30, ofs0, ns] 2024-09-12T00:38:24.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.913+0000 7f6beeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398939 cookie 93876874672272 notifier 7131 bl.length()=967 2024-09-12T00:38:24.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.913+0000 7f6beeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 info.flags=0x17 2024-09-12T00:38:24.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.913+0000 7f6beeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 to cache LRU end 2024-09-12T00:38:24.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.913+0000 7f6beeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:24.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.917+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_sources= new_sources= 2024-09-12T00:38:24.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.917+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential sources added=[] removed=[] 2024-09-12T00:38:24.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.917+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): orig_dests= new_dests= 2024-09-12T00:38:24.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.917+0000 7f6d1a5b99c0 20 handle_bi_update(): bucket=:abort-at-block-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30]): potential dests added=[] removed=[] 2024-09-12T00:38:24.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.921+0000 7f6d1a5b99c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:24.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.925+0000 7f6bcf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:24.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.929+0000 7f6d1a5b99c0 20 remove_watcher() i=0 2024-09-12T00:38:24.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.929+0000 7f6d1a5b99c0 2 removed watcher, disabling cache 2024-09-12T00:38:24.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.933+0000 7f6d1a5b99c0 20 remove_watcher() i=1 2024-09-12T00:38:24.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.937+0000 7f6d1a5b99c0 20 remove_watcher() i=2 2024-09-12T00:38:24.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.937+0000 7f6d1a5b99c0 20 remove_watcher() i=3 2024-09-12T00:38:24.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.941+0000 7f6d1a5b99c0 20 remove_watcher() i=4 2024-09-12T00:38:24.936 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.941+0000 7f6d1a5b99c0 20 remove_watcher() i=5 2024-09-12T00:38:24.938 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.941+0000 7f6d1a5b99c0 20 remove_watcher() i=6 2024-09-12T00:38:24.939 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:24.945+0000 7f6d1a5b99c0 20 remove_watcher() i=7 2024-09-12T00:38:24.957 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:38:24.987 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:24.987 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:25.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.037+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.037+0000 7f7ea78c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.037+0000 7f7ea78c49c0 20 realm 2024-09-12T00:38:25.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.037+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.037+0000 7f7ea78c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.037+0000 7f7ea78c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:25.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.037+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.041+0000 7f7ea78c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.041+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.041+0000 7f7ea78c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:25.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.041+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.041+0000 7f7ea78c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:25.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.041+0000 7f7ea78c49c0 20 searching for the correct realm 2024-09-12T00:38:25.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.045+0000 7f7ea5bcb640 0 -- 172.21.15.102:0/3573464763 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f7e9c01a040 msgr2=0x7f7e9c0636b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:25.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.261+0000 7f7ea4bc9640 0 -- 172.21.15.102:0/3573464763 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f7ea002d040 msgr2=0x7f7ea0045410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:25.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.477+0000 7f7ea78c49c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:25.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.477+0000 7f7ea78c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:25.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.477+0000 7f7ea78c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:25.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.477+0000 7f7ea78c49c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:25.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.477+0000 7f7ea78c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:25.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.477+0000 7f7ea78c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:25.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.477+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.477+0000 7f7ea78c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.477+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:25.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:25.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 20 zone default found 2024-09-12T00:38:25.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 4 Realm: () 2024-09-12T00:38:25.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:25.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:25.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:25.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 20 zonegroup default 2024-09-12T00:38:25.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.481+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.485+0000 7f7ea78c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.485+0000 7f7ea78c49c0 20 started sync module instance, tier type = 2024-09-12T00:38:25.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.485+0000 7f7ea78c49c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:25.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.505+0000 7f7ea78c49c0 20 add_watcher() i=0 2024-09-12T00:38:25.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.505+0000 7f7ea78c49c0 20 add_watcher() i=1 2024-09-12T00:38:25.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.505+0000 7f7ea78c49c0 20 add_watcher() i=2 2024-09-12T00:38:25.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.505+0000 7f7ea78c49c0 20 add_watcher() i=3 2024-09-12T00:38:25.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.505+0000 7f7ea78c49c0 20 add_watcher() i=4 2024-09-12T00:38:25.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.505+0000 7f7ea78c49c0 20 add_watcher() i=5 2024-09-12T00:38:25.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.505+0000 7f7ea78c49c0 20 add_watcher() i=6 2024-09-12T00:38:25.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.509+0000 7f7ea78c49c0 20 add_watcher() i=7 2024-09-12T00:38:25.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.509+0000 7f7ea78c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:25.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.513+0000 7f7d5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:25.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.513+0000 7f7ea78c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:25.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.513+0000 7f7ea78c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:25.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.513+0000 7f7ea78c49c0 5 note: GC not initialized 2024-09-12T00:38:25.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.513+0000 7f7d5a7e4640 20 reqs_thread_entry: start 2024-09-12T00:38:25.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.513+0000 7f7ea78c49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:25.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.513+0000 7f7ea78c49c0 20 Filter name: none 2024-09-12T00:38:25.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.513+0000 7f7ccbfff640 20 reqs_thread_entry: start 2024-09-12T00:38:25.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.513+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.517+0000 7f7ea78c49c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:38:25.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.517+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.517+0000 7f7ea78c49c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:38:25.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.517+0000 7f7ea78c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:25.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.517+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.517+0000 7f7ea78c49c0 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:38:25.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.517+0000 7f7ea78c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.517+0000 7f7ea78c49c0 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:38:25.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.517+0000 7f7ea78c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:25.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.521+0000 7f7d5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:25.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.525+0000 7f7ea78c49c0 20 remove_watcher() i=0 2024-09-12T00:38:25.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.525+0000 7f7ea78c49c0 2 removed watcher, disabling cache 2024-09-12T00:38:25.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.529+0000 7f7ea78c49c0 20 remove_watcher() i=1 2024-09-12T00:38:25.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.529+0000 7f7ea78c49c0 20 remove_watcher() i=2 2024-09-12T00:38:25.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.533+0000 7f7ea78c49c0 20 remove_watcher() i=3 2024-09-12T00:38:25.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.533+0000 7f7ea78c49c0 20 remove_watcher() i=4 2024-09-12T00:38:25.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.537+0000 7f7ea78c49c0 20 remove_watcher() i=5 2024-09-12T00:38:25.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.537+0000 7f7ea78c49c0 20 remove_watcher() i=6 2024-09-12T00:38:25.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:25.537+0000 7f7ea78c49c0 20 remove_watcher() i=7 2024-09-12T00:38:25.549 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:25.550 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:38:25.550 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-block-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:38:25.550 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:25.551 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:25.551 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:25.581 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:25.581 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:26.108 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:26.108 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:26.487 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:38:26.487 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:26.490 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:26.490 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:26.624 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:26.624 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:26.711 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:26.711 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:26.816 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:26.817 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:26.924 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:26.924 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:27.025 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:27.025 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:27.127 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:27.127 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:27.223 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:27.223 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:27.327 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:27.327 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:27.423 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:27.423 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:27.516 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:27.516 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:27.614 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:27.614 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:27.715 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:27.716 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:27.817 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:27.817 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:27.921 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:27.921 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:28.011 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:28.012 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:28.108 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:28.108 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:28.209 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:28.209 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:28.311 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:28.311 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:28.417 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:28.417 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:28.513 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:28.513 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:28.618 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:28.618 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:28.712 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:38:28.746 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:28.746 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:28.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.796+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.796+0000 7fa05ca219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.796+0000 7fa05ca219c0 20 realm 2024-09-12T00:38:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.796+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.796+0000 7fa05ca219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.796+0000 7fa05ca219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.796+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.796+0000 7fa05ca219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:28.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.796+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.800+0000 7fa05ca219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:28.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.800+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.800+0000 7fa05ca219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:28.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.800+0000 7fa05ca219c0 20 searching for the correct realm 2024-09-12T00:38:28.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.804+0000 7fa05ad28640 0 -- 172.21.15.102:0/1366541566 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x5632ffd72c00 msgr2=0x5632ffd74ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:28.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:28.812+0000 7fa059d26640 0 -- 172.21.15.102:0/1366541566 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fa054051370 msgr2=0x7fa0540517f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:29.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.028+0000 7fa05ca219c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:29.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.028+0000 7fa05ca219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:29.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.028+0000 7fa05ca219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:29.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.028+0000 7fa05ca219c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:29.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.028+0000 7fa05ca219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:29.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.028+0000 7fa05ca219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:29.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.028+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.028+0000 7fa05ca219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.028+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:29.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:29.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 zone default found 2024-09-12T00:38:29.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 4 Realm: () 2024-09-12T00:38:29.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:29.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:29.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:29.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 zonegroup default 2024-09-12T00:38:29.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 started sync module instance, tier type = 2024-09-12T00:38:29.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.032+0000 7fa05ca219c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:29.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.056+0000 7fa05ca219c0 20 add_watcher() i=0 2024-09-12T00:38:29.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.056+0000 7fa05ca219c0 20 add_watcher() i=1 2024-09-12T00:38:29.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.056+0000 7fa05ca219c0 20 add_watcher() i=2 2024-09-12T00:38:29.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.056+0000 7fa05ca219c0 20 add_watcher() i=3 2024-09-12T00:38:29.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.056+0000 7fa05ca219c0 20 add_watcher() i=4 2024-09-12T00:38:29.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.056+0000 7fa05ca219c0 20 add_watcher() i=5 2024-09-12T00:38:29.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.056+0000 7fa05ca219c0 20 add_watcher() i=6 2024-09-12T00:38:29.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.056+0000 7fa05ca219c0 20 add_watcher() i=7 2024-09-12T00:38:29.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.056+0000 7fa05ca219c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:29.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.060+0000 7f9f10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:29.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.060+0000 7fa05ca219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:29.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.060+0000 7fa05ca219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:29.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.060+0000 7fa05ca219c0 5 note: GC not initialized 2024-09-12T00:38:29.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.064+0000 7f9e8b7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:29.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.064+0000 7fa05ca219c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:29.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.064+0000 7fa05ca219c0 20 Filter name: none 2024-09-12T00:38:29.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.064+0000 7f9e897fa640 20 reqs_thread_entry: start 2024-09-12T00:38:29.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.064+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.064+0000 7fa05ca219c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:29.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.064+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.064+0000 7fa05ca219c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:29.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.064+0000 7fa05ca219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:29.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.064+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.068+0000 7fa05ca219c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:29.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.068+0000 7fa05ca219c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.068+0000 7fa05ca219c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:29.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.068+0000 7fa05ca219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:29.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.072+0000 7f9f10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:29.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.076+0000 7fa05ca219c0 20 remove_watcher() i=0 2024-09-12T00:38:29.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.076+0000 7fa05ca219c0 2 removed watcher, disabling cache 2024-09-12T00:38:29.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.076+0000 7fa05ca219c0 20 remove_watcher() i=1 2024-09-12T00:38:29.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.080+0000 7fa05ca219c0 20 remove_watcher() i=2 2024-09-12T00:38:29.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.084+0000 7fa05ca219c0 20 remove_watcher() i=3 2024-09-12T00:38:29.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.084+0000 7fa05ca219c0 20 remove_watcher() i=4 2024-09-12T00:38:29.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.088+0000 7fa05ca219c0 20 remove_watcher() i=5 2024-09-12T00:38:29.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.088+0000 7fa05ca219c0 20 remove_watcher() i=6 2024-09-12T00:38:29.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.088+0000 7fa05ca219c0 20 remove_watcher() i=7 2024-09-12T00:38:29.106 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:29.106 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:38:29.106 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-commit-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:29.107 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:29.107 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:38:29.141 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:29.141 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:29.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.192+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.192+0000 7fe9c98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.192+0000 7fe9c98649c0 20 realm 2024-09-12T00:38:29.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.192+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.192+0000 7fe9c98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.192+0000 7fe9c98649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:29.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.192+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.192+0000 7fe9c98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.192+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.196+0000 7fe9c98649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:29.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.196+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.196+0000 7fe9c98649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:29.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.196+0000 7fe9c98649c0 20 searching for the correct realm 2024-09-12T00:38:29.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.200+0000 7fe9c7b6b640 0 -- 172.21.15.102:0/3644806950 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fe9bc038070 msgr2=0x7fe9bc036420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:29.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.416+0000 7fe9c6b69640 0 -- 172.21.15.102:0/3644806950 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fe9c00ff410 msgr2=0x7fe9c00ff890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:29.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.632+0000 7fe9c98649c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:29.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.632+0000 7fe9c98649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:29.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.632+0000 7fe9c98649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:29.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.632+0000 7fe9c98649c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:29.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.632+0000 7fe9c98649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:29.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.632+0000 7fe9c98649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:29.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.632+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.632+0000 7fe9c98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.632+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:29.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:29.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 zone default found 2024-09-12T00:38:29.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 4 Realm: () 2024-09-12T00:38:29.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:29.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:29.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:29.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 zonegroup default 2024-09-12T00:38:29.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.633 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 started sync module instance, tier type = 2024-09-12T00:38:29.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.636+0000 7fe9c98649c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:29.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.664+0000 7fe9c98649c0 20 add_watcher() i=0 2024-09-12T00:38:29.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.664+0000 7fe9c98649c0 20 add_watcher() i=1 2024-09-12T00:38:29.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.664+0000 7fe9c98649c0 20 add_watcher() i=2 2024-09-12T00:38:29.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.664+0000 7fe9c98649c0 20 add_watcher() i=3 2024-09-12T00:38:29.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.664+0000 7fe9c98649c0 20 add_watcher() i=4 2024-09-12T00:38:29.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.664+0000 7fe9c98649c0 20 add_watcher() i=5 2024-09-12T00:38:29.660 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.664+0000 7fe9c98649c0 20 add_watcher() i=6 2024-09-12T00:38:29.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.664+0000 7fe9c98649c0 20 add_watcher() i=7 2024-09-12T00:38:29.662 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.664+0000 7fe9c98649c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:29.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.668+0000 7fe87dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:29.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:29.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:29.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 5 note: GC not initialized 2024-09-12T00:38:29.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe87cfe1640 20 reqs_thread_entry: start 2024-09-12T00:38:29.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:29.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 20 Filter name: none 2024-09-12T00:38:29.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe7f67fc640 20 reqs_thread_entry: start 2024-09-12T00:38:29.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:38:29.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:29.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:29.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:38:29.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 : miss 2024-09-12T00:38:29.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:29.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:29.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:29.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:29.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:29.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.672+0000 7fe9c98649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 2024-09-12T00:38:29.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe9c98649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:29.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe9c98649c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:29.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe9c98649c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:29.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe9c98649c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31, ofs0, ns] 2024-09-12T00:38:29.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe8aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398892 cookie 94343368121152 notifier 6743 bl.length()=1015 2024-09-12T00:38:29.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe8aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:29.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe8aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:29.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe8aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:29.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe9c98649c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): orig_sources= new_sources= 2024-09-12T00:38:29.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe9c98649c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): potential sources added=[] removed=[] 2024-09-12T00:38:29.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe9c98649c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): orig_dests= new_dests= 2024-09-12T00:38:29.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.688+0000 7fe9c98649c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): potential dests added=[] removed=[] 2024-09-12T00:38:29.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.0 2024-09-12T00:38:29.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.0 2024-09-12T00:38:29.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.1 2024-09-12T00:38:29.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.1 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.2 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.2 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.3 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.3 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.4 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.4 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.5 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.5 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.6 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.6 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.7 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.7 2024-09-12T00:38:29.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.8 2024-09-12T00:38:29.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.8 2024-09-12T00:38:29.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.9 2024-09-12T00:38:29.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.9 2024-09-12T00:38:29.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.10 2024-09-12T00:38:29.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.10 2024-09-12T00:38:29.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.11 2024-09-12T00:38:29.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1.11 2024-09-12T00:38:29.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.0 2024-09-12T00:38:29.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.700+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1 2024-09-12T00:38:29.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.704+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2 2024-09-12T00:38:29.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.704+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.3 2024-09-12T00:38:29.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.704+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.4 2024-09-12T00:38:29.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.708+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.5 2024-09-12T00:38:29.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.708+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.6 2024-09-12T00:38:29.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.708+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.7 2024-09-12T00:38:29.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.712+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.8 2024-09-12T00:38:29.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.712+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.9 2024-09-12T00:38:29.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.712+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.10 2024-09-12T00:38:29.715 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.720+0000 7fe9c98649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:29.715 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.720+0000 7fe9c98649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 2024-09-12T00:38:29.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.720+0000 7fe9c98649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:29.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.720+0000 7fe9c98649c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:29.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.720+0000 7fe9c98649c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:29.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.720+0000 7fe9c98649c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31, ofs0, ns] 2024-09-12T00:38:29.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.720+0000 7fe8aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398893 cookie 94343368121152 notifier 6743 bl.length()=1015 2024-09-12T00:38:29.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.720+0000 7fe8aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:29.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.720+0000 7fe8aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:29.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.720+0000 7fe8aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:29.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.724+0000 7fe9c98649c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): orig_sources= new_sources= 2024-09-12T00:38:29.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.724+0000 7fe9c98649c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): potential sources added=[] removed=[] 2024-09-12T00:38:29.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.724+0000 7fe9c98649c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): orig_dests= new_dests= 2024-09-12T00:38:29.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.724+0000 7fe9c98649c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): potential dests added=[] removed=[] 2024-09-12T00:38:29.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.732+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.0 2024-09-12T00:38:29.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.732+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1 2024-09-12T00:38:29.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.732+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2 2024-09-12T00:38:29.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.732+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.3 2024-09-12T00:38:29.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.732+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.4 2024-09-12T00:38:29.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.732+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.5 2024-09-12T00:38:29.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.736+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.6 2024-09-12T00:38:29.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.736+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.7 2024-09-12T00:38:29.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.736+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.8 2024-09-12T00:38:29.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.736+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.9 2024-09-12T00:38:29.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.740+0000 7fe9c98649c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.10 2024-09-12T00:38:29.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.740+0000 7fe9c98649c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:38:29.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.740+0000 7fe9c98649c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:38:29.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.748+0000 7fe87dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:29.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.756+0000 7fe9c98649c0 20 remove_watcher() i=0 2024-09-12T00:38:29.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.756+0000 7fe9c98649c0 2 removed watcher, disabling cache 2024-09-12T00:38:29.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.756+0000 7fe9c98649c0 20 remove_watcher() i=1 2024-09-12T00:38:29.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.760+0000 7fe9c98649c0 20 remove_watcher() i=2 2024-09-12T00:38:29.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.760+0000 7fe9c98649c0 20 remove_watcher() i=3 2024-09-12T00:38:29.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.764+0000 7fe9c98649c0 20 remove_watcher() i=4 2024-09-12T00:38:29.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.764+0000 7fe9c98649c0 20 remove_watcher() i=5 2024-09-12T00:38:29.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.768+0000 7fe9c98649c0 20 remove_watcher() i=6 2024-09-12T00:38:29.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.768+0000 7fe9c98649c0 20 remove_watcher() i=7 2024-09-12T00:38:29.780 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:38:29.812 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:29.812 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:29.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.860+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.860+0000 7fb5baa619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.860+0000 7fb5baa619c0 20 realm 2024-09-12T00:38:29.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.860+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.864+0000 7fb5baa619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.864+0000 7fb5baa619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:29.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.864+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.864+0000 7fb5baa619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:29.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.864+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.864+0000 7fb5baa619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:29.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.864+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:29.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.864+0000 7fb5baa619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:29.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.864+0000 7fb5baa619c0 20 searching for the correct realm 2024-09-12T00:38:29.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:29.868+0000 7fb5b8d68640 0 -- 172.21.15.102:0/747102437 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fb5ac066c20 msgr2=0x7fb5ac071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:30.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.084+0000 7fb5b7d66640 0 -- 172.21.15.102:0/747102437 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fb5b004eb60 msgr2=0x7fb5b008a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:30.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.300+0000 7fb5baa619c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:30.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.300+0000 7fb5baa619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:30.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.300+0000 7fb5baa619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:30.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.300+0000 7fb5baa619c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:30.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.300+0000 7fb5baa619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:30.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.300+0000 7fb5baa619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:30.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.300+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:30.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:30.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 zone default found 2024-09-12T00:38:30.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 4 Realm: () 2024-09-12T00:38:30.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:30.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:30.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:30.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 zonegroup default 2024-09-12T00:38:30.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.304+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.308+0000 7fb5baa619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.308+0000 7fb5baa619c0 20 started sync module instance, tier type = 2024-09-12T00:38:30.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.308+0000 7fb5baa619c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:30.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.328+0000 7fb5baa619c0 20 add_watcher() i=0 2024-09-12T00:38:30.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.328+0000 7fb5baa619c0 20 add_watcher() i=1 2024-09-12T00:38:30.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.328+0000 7fb5baa619c0 20 add_watcher() i=2 2024-09-12T00:38:30.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.328+0000 7fb5baa619c0 20 add_watcher() i=3 2024-09-12T00:38:30.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.328+0000 7fb5baa619c0 20 add_watcher() i=4 2024-09-12T00:38:30.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.328+0000 7fb5baa619c0 20 add_watcher() i=5 2024-09-12T00:38:30.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.328+0000 7fb5baa619c0 20 add_watcher() i=6 2024-09-12T00:38:30.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.332+0000 7fb5baa619c0 20 add_watcher() i=7 2024-09-12T00:38:30.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.332+0000 7fb5baa619c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:30.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.336+0000 7fb46efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:30.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.336+0000 7fb5baa619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:30.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.336+0000 7fb5baa619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:30.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.336+0000 7fb5baa619c0 5 note: GC not initialized 2024-09-12T00:38:30.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.336+0000 7fb46dfdb640 20 reqs_thread_entry: start 2024-09-12T00:38:30.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.336+0000 7fb5baa619c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:30.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.336+0000 7fb5baa619c0 20 Filter name: none 2024-09-12T00:38:30.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.336+0000 7fb3df7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:30.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.336+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.340+0000 7fb5baa619c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:30.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.340+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.340+0000 7fb5baa619c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:38:30.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.340+0000 7fb5baa619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:30.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.340+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.340+0000 7fb5baa619c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:30.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.340+0000 7fb5baa619c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.344+0000 7fb5baa619c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:38:30.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.344+0000 7fb5baa619c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:30.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.348+0000 7fb46efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:30.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.352+0000 7fb5baa619c0 20 remove_watcher() i=0 2024-09-12T00:38:30.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.352+0000 7fb5baa619c0 2 removed watcher, disabling cache 2024-09-12T00:38:30.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.356+0000 7fb5baa619c0 20 remove_watcher() i=1 2024-09-12T00:38:30.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.356+0000 7fb5baa619c0 20 remove_watcher() i=2 2024-09-12T00:38:30.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.360+0000 7fb5baa619c0 20 remove_watcher() i=3 2024-09-12T00:38:30.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.360+0000 7fb5baa619c0 20 remove_watcher() i=4 2024-09-12T00:38:30.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.364+0000 7fb5baa619c0 20 remove_watcher() i=5 2024-09-12T00:38:30.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.364+0000 7fb5baa619c0 20 remove_watcher() i=6 2024-09-12T00:38:30.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.364+0000 7fb5baa619c0 20 remove_watcher() i=7 2024-09-12T00:38:30.378 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:30.378 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:38:30.378 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-commit-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:30.380 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:30.380 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:30.380 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:30.423 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:30.423 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:30.485 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:30.519 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:30.519 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:30.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.564+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.564 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.568+0000 7fe4f13d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.568+0000 7fe4f13d19c0 20 realm 2024-09-12T00:38:30.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.568+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.568+0000 7fe4f13d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.568+0000 7fe4f13d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:30.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.568+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.568+0000 7fe4f13d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.568+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.568+0000 7fe4f13d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:30.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.568+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.572+0000 7fe4f13d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:30.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.572+0000 7fe4f13d19c0 20 searching for the correct realm 2024-09-12T00:38:30.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.576+0000 7fe4ef6d8640 0 -- 172.21.15.102:0/3161285066 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fe4e003e040 msgr2=0x7fe4e003e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:30.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.580+0000 7fe4ee6d6640 0 -- 172.21.15.102:0/3161285066 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fe4e8035410 msgr2=0x7fe4e8035890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:30.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.796+0000 7fe4f13d19c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:30.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.796+0000 7fe4f13d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:30.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.796+0000 7fe4f13d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:30.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.796+0000 7fe4f13d19c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:30.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.796+0000 7fe4f13d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:30.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.796+0000 7fe4f13d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:30.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.796+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.796+0000 7fe4f13d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.796+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:30.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:30.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 zone default found 2024-09-12T00:38:30.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 4 Realm: () 2024-09-12T00:38:30.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:30.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:30.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:30.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 zonegroup default 2024-09-12T00:38:30.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:30.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 started sync module instance, tier type = 2024-09-12T00:38:30.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.800+0000 7fe4f13d19c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:30.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.824+0000 7fe4f13d19c0 20 add_watcher() i=0 2024-09-12T00:38:30.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.824+0000 7fe4f13d19c0 20 add_watcher() i=1 2024-09-12T00:38:30.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.824+0000 7fe4f13d19c0 20 add_watcher() i=2 2024-09-12T00:38:30.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.824+0000 7fe4f13d19c0 20 add_watcher() i=3 2024-09-12T00:38:30.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.824+0000 7fe4f13d19c0 20 add_watcher() i=4 2024-09-12T00:38:30.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.824+0000 7fe4f13d19c0 20 add_watcher() i=5 2024-09-12T00:38:30.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.824+0000 7fe4f13d19c0 20 add_watcher() i=6 2024-09-12T00:38:30.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.828+0000 7fe4f13d19c0 20 add_watcher() i=7 2024-09-12T00:38:30.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.828+0000 7fe4f13d19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:30.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe3a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:30.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe4f13d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:30.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe4f13d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:30.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe4f13d19c0 5 note: GC not initialized 2024-09-12T00:38:30.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe31ffff640 20 reqs_thread_entry: start 2024-09-12T00:38:30.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe4f13d19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:30.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe4f13d19c0 20 Filter name: none 2024-09-12T00:38:30.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe31dffb640 20 reqs_thread_entry: start 2024-09-12T00:38:30.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe4f13d19c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:38:30.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe4f13d19c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:30.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe4f13d19c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:30.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.832+0000 7fe4f13d19c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:38:30.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.836+0000 7fe4f13d19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 : miss 2024-09-12T00:38:30.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.836+0000 7fe4f13d19c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:30.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.836+0000 7fe4f13d19c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:38:30.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.836+0000 7fe4f13d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:30.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.836+0000 7fe4f13d19c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:30.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.836+0000 7fe4f13d19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:30.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.836+0000 7fe4f13d19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:30.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.836+0000 7fe4f13d19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 2024-09-12T00:38:30.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.840+0000 7fe4f13d19c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:30.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.852+0000 7fe4f13d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:30.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.852+0000 7fe4f13d19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:30.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.852+0000 7fe4f13d19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:30.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.852+0000 7fe4f13d19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31, ofs0, ns] 2024-09-12T00:38:30.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.852+0000 7fe3d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398894 cookie 94201948774736 notifier 6779 bl.length()=1015 2024-09-12T00:38:30.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.852+0000 7fe3d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:30.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.852+0000 7fe3d1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:30.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.852+0000 7fe3d1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:30.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.856+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): orig_sources= new_sources= 2024-09-12T00:38:30.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.856+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): potential sources added=[] removed=[] 2024-09-12T00:38:30.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.856+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): orig_dests= new_dests= 2024-09-12T00:38:30.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.856+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): potential dests added=[] removed=[] 2024-09-12T00:38:30.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.0 2024-09-12T00:38:30.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.0 2024-09-12T00:38:30.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.1 2024-09-12T00:38:30.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.1 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.2 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.2 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.3 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.3 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.4 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.4 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.5 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.5 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.6 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.6 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.7 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.7 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.8 2024-09-12T00:38:30.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.8 2024-09-12T00:38:30.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.9 2024-09-12T00:38:30.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.9 2024-09-12T00:38:30.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.10 2024-09-12T00:38:30.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.10 2024-09-12T00:38:30.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.11 2024-09-12T00:38:30.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2.11 2024-09-12T00:38:30.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.0 2024-09-12T00:38:30.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1 2024-09-12T00:38:30.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2 2024-09-12T00:38:30.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.868+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.3 2024-09-12T00:38:30.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.872+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.4 2024-09-12T00:38:30.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.872+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.5 2024-09-12T00:38:30.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.872+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.6 2024-09-12T00:38:30.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.872+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.7 2024-09-12T00:38:30.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.876+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.8 2024-09-12T00:38:30.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.876+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.9 2024-09-12T00:38:30.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.876+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.10 2024-09-12T00:38:30.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.884+0000 7fe4f13d19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:30.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.884+0000 7fe4f13d19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 2024-09-12T00:38:30.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe4f13d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:30.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe4f13d19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:30.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe4f13d19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:30.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe4f13d19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31, ofs0, ns] 2024-09-12T00:38:30.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe3d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398895 cookie 94201948774736 notifier 6779 bl.length()=1015 2024-09-12T00:38:30.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe3d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:30.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe3d27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:30.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe3d27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:30.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): orig_sources= new_sources= 2024-09-12T00:38:30.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): potential sources added=[] removed=[] 2024-09-12T00:38:30.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): orig_dests= new_dests= 2024-09-12T00:38:30.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.888+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): potential dests added=[] removed=[] 2024-09-12T00:38:30.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.896+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.0 2024-09-12T00:38:30.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.896+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.1 2024-09-12T00:38:30.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.896+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.2 2024-09-12T00:38:30.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.896+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.3 2024-09-12T00:38:30.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.900+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.4 2024-09-12T00:38:30.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.900+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.5 2024-09-12T00:38:30.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.900+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.6 2024-09-12T00:38:30.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.900+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.7 2024-09-12T00:38:30.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.900+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.8 2024-09-12T00:38:30.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.904+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.9 2024-09-12T00:38:30.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.904+0000 7fe4f13d19c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31.10 2024-09-12T00:38:30.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.904+0000 7fe4f13d19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:30.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.904+0000 7fe4f13d19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 2024-09-12T00:38:30.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.908+0000 7fe4f13d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:30.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.908+0000 7fe4f13d19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:30.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.908+0000 7fe4f13d19c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:30.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.908+0000 7fe4f13d19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31, ofs0, ns] 2024-09-12T00:38:30.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.908+0000 7fe3d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398896 cookie 94201948774736 notifier 6779 bl.length()=983 2024-09-12T00:38:30.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.908+0000 7fe3d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 info.flags=0x17 2024-09-12T00:38:30.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.908+0000 7fe3d1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 to cache LRU end 2024-09-12T00:38:30.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.908+0000 7fe3d1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:30.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.912+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): orig_sources= new_sources= 2024-09-12T00:38:30.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.912+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): potential sources added=[] removed=[] 2024-09-12T00:38:30.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.912+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): orig_dests= new_dests= 2024-09-12T00:38:30.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.912+0000 7fe4f13d19c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31]): potential dests added=[] removed=[] 2024-09-12T00:38:30.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.916+0000 7fe4f13d19c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:30.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.920+0000 7fe3a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:30.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.924+0000 7fe4f13d19c0 20 remove_watcher() i=0 2024-09-12T00:38:30.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.924+0000 7fe4f13d19c0 2 removed watcher, disabling cache 2024-09-12T00:38:30.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.928+0000 7fe4f13d19c0 20 remove_watcher() i=1 2024-09-12T00:38:30.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.928+0000 7fe4f13d19c0 20 remove_watcher() i=2 2024-09-12T00:38:30.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.932+0000 7fe4f13d19c0 20 remove_watcher() i=3 2024-09-12T00:38:30.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.932+0000 7fe4f13d19c0 20 remove_watcher() i=4 2024-09-12T00:38:30.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.936+0000 7fe4f13d19c0 20 remove_watcher() i=5 2024-09-12T00:38:30.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.936+0000 7fe4f13d19c0 20 remove_watcher() i=6 2024-09-12T00:38:30.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:30.936+0000 7fe4f13d19c0 20 remove_watcher() i=7 2024-09-12T00:38:30.951 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:38:30.981 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:30.981 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:31.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.028+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.032+0000 7ffa3c6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.032+0000 7ffa3c6879c0 20 realm 2024-09-12T00:38:31.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.032+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.032+0000 7ffa3c6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.032+0000 7ffa3c6879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:31.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.032+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.032+0000 7ffa3c6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.032+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.032+0000 7ffa3c6879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:31.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.032+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.036+0000 7ffa3c6879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:31.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.036+0000 7ffa3c6879c0 20 searching for the correct realm 2024-09-12T00:38:31.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.036+0000 7ffa3a98e640 0 -- 172.21.15.102:0/558651868 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7ffa3008ad00 msgr2=0x7ffa30089770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:31.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.252+0000 7ffa3998c640 0 -- 172.21.15.102:0/558651868 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7ffa3412a240 msgr2=0x7ffa341181a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:31.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.468+0000 7ffa3c6879c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:31.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.468+0000 7ffa3c6879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:31.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.468+0000 7ffa3c6879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:31.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.468+0000 7ffa3c6879c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:31.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.468+0000 7ffa3c6879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:31.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.468+0000 7ffa3c6879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:31.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.468+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:31.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:31.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 zone default found 2024-09-12T00:38:31.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 4 Realm: () 2024-09-12T00:38:31.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:31.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:31.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:31.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 zonegroup default 2024-09-12T00:38:31.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.472+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.476+0000 7ffa3c6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.476+0000 7ffa3c6879c0 20 started sync module instance, tier type = 2024-09-12T00:38:31.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.476+0000 7ffa3c6879c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:31.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.496+0000 7ffa3c6879c0 20 add_watcher() i=0 2024-09-12T00:38:31.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.496+0000 7ffa3c6879c0 20 add_watcher() i=1 2024-09-12T00:38:31.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.496+0000 7ffa3c6879c0 20 add_watcher() i=2 2024-09-12T00:38:31.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.496+0000 7ffa3c6879c0 20 add_watcher() i=3 2024-09-12T00:38:31.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.496+0000 7ffa3c6879c0 20 add_watcher() i=4 2024-09-12T00:38:31.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.496+0000 7ffa3c6879c0 20 add_watcher() i=5 2024-09-12T00:38:31.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.496+0000 7ffa3c6879c0 20 add_watcher() i=6 2024-09-12T00:38:31.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.500+0000 7ffa3c6879c0 20 add_watcher() i=7 2024-09-12T00:38:31.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.500+0000 7ffa3c6879c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:31.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.504+0000 7ff8f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:31.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.504+0000 7ffa3c6879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:31.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.504+0000 7ffa3c6879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:31.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.504+0000 7ffa3c6879c0 5 note: GC not initialized 2024-09-12T00:38:31.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.504+0000 7ff86b7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:31.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.504+0000 7ffa3c6879c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:31.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.504+0000 7ffa3c6879c0 20 Filter name: none 2024-09-12T00:38:31.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.504+0000 7ff8697fa640 20 reqs_thread_entry: start 2024-09-12T00:38:31.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.504+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.508+0000 7ffa3c6879c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:31.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.508+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.508+0000 7ffa3c6879c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:31.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.508+0000 7ffa3c6879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:31.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.508+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.508+0000 7ffa3c6879c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:31.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.508+0000 7ffa3c6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.508+0000 7ffa3c6879c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:31.507 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.508+0000 7ffa3c6879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:31.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.512+0000 7ff8f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:31.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.516+0000 7ffa3c6879c0 20 remove_watcher() i=0 2024-09-12T00:38:31.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.516+0000 7ffa3c6879c0 2 removed watcher, disabling cache 2024-09-12T00:38:31.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.520+0000 7ffa3c6879c0 20 remove_watcher() i=1 2024-09-12T00:38:31.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.520+0000 7ffa3c6879c0 20 remove_watcher() i=2 2024-09-12T00:38:31.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.524+0000 7ffa3c6879c0 20 remove_watcher() i=3 2024-09-12T00:38:31.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.524+0000 7ffa3c6879c0 20 remove_watcher() i=4 2024-09-12T00:38:31.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.528+0000 7ffa3c6879c0 20 remove_watcher() i=5 2024-09-12T00:38:31.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.528+0000 7ffa3c6879c0 20 remove_watcher() i=6 2024-09-12T00:38:31.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:31.532+0000 7ffa3c6879c0 20 remove_watcher() i=7 2024-09-12T00:38:31.543 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:31.543 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:38:31.543 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-commit-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:38:31.543 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:31.544 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:31.544 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:31.573 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:31.573 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:32.457 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:38:32.457 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:32.459 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:32.459 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:32.607 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:32.607 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:32.695 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:32.695 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:32.794 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:32.794 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:32.892 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:32.892 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:32.990 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:33.090 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:33.090 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:33.194 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:33.194 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:33.293 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:33.293 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:33.393 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:33.394 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:33.496 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:33.496 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:33.594 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:33.595 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:33.698 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:33.699 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:33.792 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:33.792 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:33.893 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:33.893 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:33.991 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:33.992 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:34.091 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:34.091 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:34.203 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:34.203 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:34.303 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:34.303 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:34.401 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:34.401 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:34.499 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:34.499 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:34.597 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:34.597 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:34.698 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:38:34.730 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:34.730 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:34.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.780+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.780+0000 7f90db6fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:34.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.780+0000 7f90db6fe9c0 20 realm 2024-09-12T00:38:34.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.780+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.784+0000 7f90db6fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:34.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.784+0000 7f90db6fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:34.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.784+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.784+0000 7f90db6fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:34.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.784+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.784+0000 7f90db6fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:34.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.784+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.784+0000 7f90db6fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:34.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.784+0000 7f90db6fe9c0 20 searching for the correct realm 2024-09-12T00:38:34.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:34.788+0000 7f90d8a03640 0 -- 172.21.15.102:0/704486685 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f90d4031040 msgr2=0x7f90d4072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:34.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.000+0000 7f90d9a05640 0 -- 172.21.15.102:0/704486685 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x557bc5a91b00 msgr2=0x557bc5a93ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:35.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.016+0000 7f90db6fe9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:35.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.016+0000 7f90db6fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:35.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.016+0000 7f90db6fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:35.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.016+0000 7f90db6fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:35.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.016+0000 7f90db6fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:35.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.016+0000 7f90db6fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:35.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.016+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.016+0000 7f90db6fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.016+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:35.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:35.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 zone default found 2024-09-12T00:38:35.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 4 Realm: () 2024-09-12T00:38:35.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:35.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:35.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:35.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 zonegroup default 2024-09-12T00:38:35.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 started sync module instance, tier type = 2024-09-12T00:38:35.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.020+0000 7f90db6fe9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:35.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.044+0000 7f90db6fe9c0 20 add_watcher() i=0 2024-09-12T00:38:35.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.044+0000 7f90db6fe9c0 20 add_watcher() i=1 2024-09-12T00:38:35.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.044+0000 7f90db6fe9c0 20 add_watcher() i=2 2024-09-12T00:38:35.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.044+0000 7f90db6fe9c0 20 add_watcher() i=3 2024-09-12T00:38:35.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.044+0000 7f90db6fe9c0 20 add_watcher() i=4 2024-09-12T00:38:35.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.044+0000 7f90db6fe9c0 20 add_watcher() i=5 2024-09-12T00:38:35.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.044+0000 7f90db6fe9c0 20 add_watcher() i=6 2024-09-12T00:38:35.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.048+0000 7f90db6fe9c0 20 add_watcher() i=7 2024-09-12T00:38:35.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.048+0000 7f90db6fe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:35.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.052+0000 7f8f8ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:35.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.052+0000 7f90db6fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:35.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.052+0000 7f90db6fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:35.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f90db6fe9c0 5 note: GC not initialized 2024-09-12T00:38:35.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f8f8efe5640 20 reqs_thread_entry: start 2024-09-12T00:38:35.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f90db6fe9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:35.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f90db6fe9c0 20 Filter name: none 2024-09-12T00:38:35.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f8f8cfe1640 20 reqs_thread_entry: start 2024-09-12T00:38:35.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f90db6fe9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:35.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f90db6fe9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:35.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f90db6fe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:35.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.056+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.060+0000 7f90db6fe9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:35.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.060+0000 7f90db6fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.060+0000 7f90db6fe9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:35.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.060+0000 7f90db6fe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:35.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.064+0000 7f8f8ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:35.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.068+0000 7f90db6fe9c0 20 remove_watcher() i=0 2024-09-12T00:38:35.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.068+0000 7f90db6fe9c0 2 removed watcher, disabling cache 2024-09-12T00:38:35.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.068+0000 7f90db6fe9c0 20 remove_watcher() i=1 2024-09-12T00:38:35.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.072+0000 7f90db6fe9c0 20 remove_watcher() i=2 2024-09-12T00:38:35.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.076+0000 7f90db6fe9c0 20 remove_watcher() i=3 2024-09-12T00:38:35.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.076+0000 7f90db6fe9c0 20 remove_watcher() i=4 2024-09-12T00:38:35.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.080+0000 7f90db6fe9c0 20 remove_watcher() i=5 2024-09-12T00:38:35.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.080+0000 7f90db6fe9c0 20 remove_watcher() i=6 2024-09-12T00:38:35.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.080+0000 7f90db6fe9c0 20 remove_watcher() i=7 2024-09-12T00:38:35.096 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:35.097 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:38:35.097 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-commit-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:35.097 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:35.097 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:38:35.133 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:35.133 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:35.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.180+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.180+0000 7f82656a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.180+0000 7f82656a79c0 20 realm 2024-09-12T00:38:35.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.180+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.180+0000 7f82656a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.180+0000 7f82656a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:35.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.180+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.180+0000 7f82656a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.180+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.184+0000 7f82656a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:35.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.184+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.184+0000 7f82656a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:35.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.184+0000 7f82656a79c0 20 searching for the correct realm 2024-09-12T00:38:35.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.188+0000 7f82639ae640 0 -- 172.21.15.102:0/1486918789 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f824c0d1030 msgr2=0x7f824c0e8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:35.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.404+0000 7f82629ac640 0 -- 172.21.15.102:0/1486918789 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f825406a200 msgr2=0x7f825404a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:35.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.620+0000 7f82656a79c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:35.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.620+0000 7f82656a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:35.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.620+0000 7f82656a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:35.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.620+0000 7f82656a79c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:35.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.620+0000 7f82656a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:35.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.620+0000 7f82656a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:35.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.620+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.620+0000 7f82656a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.620+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:35.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:35.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 20 zone default found 2024-09-12T00:38:35.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 4 Realm: () 2024-09-12T00:38:35.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:35.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:35.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:35.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 20 zonegroup default 2024-09-12T00:38:35.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.624+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.628+0000 7f82656a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.628+0000 7f82656a79c0 20 started sync module instance, tier type = 2024-09-12T00:38:35.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.628+0000 7f82656a79c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:35.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.648+0000 7f82656a79c0 20 add_watcher() i=0 2024-09-12T00:38:35.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.648+0000 7f82656a79c0 20 add_watcher() i=1 2024-09-12T00:38:35.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.648+0000 7f82656a79c0 20 add_watcher() i=2 2024-09-12T00:38:35.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.648+0000 7f82656a79c0 20 add_watcher() i=3 2024-09-12T00:38:35.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.648+0000 7f82656a79c0 20 add_watcher() i=4 2024-09-12T00:38:35.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.648+0000 7f82656a79c0 20 add_watcher() i=5 2024-09-12T00:38:35.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.648+0000 7f82656a79c0 20 add_watcher() i=6 2024-09-12T00:38:35.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.652+0000 7f82656a79c0 20 add_watcher() i=7 2024-09-12T00:38:35.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.652+0000 7f82656a79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:35.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.656+0000 7f8119fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:35.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.656+0000 7f82656a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:35.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.656+0000 7f82656a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:35.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.656+0000 7f82656a79c0 5 note: GC not initialized 2024-09-12T00:38:35.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.656+0000 7f8118fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:35.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.656+0000 7f82656a79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:35.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.656+0000 7f82656a79c0 20 Filter name: none 2024-09-12T00:38:35.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.656+0000 7f80927fc640 20 reqs_thread_entry: start 2024-09-12T00:38:35.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.656+0000 7f82656a79c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:38:35.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.656+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:35.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:35.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:38:35.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 : miss 2024-09-12T00:38:35.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:35.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 info.flags=0x17 2024-09-12T00:38:35.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 to cache LRU end 2024-09-12T00:38:35.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:35.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:35.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.660+0000 7f82656a79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 2024-09-12T00:38:35.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.672+0000 7f82656a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 info.flags=0x17 2024-09-12T00:38:35.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.672+0000 7f82656a79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 to cache LRU end 2024-09-12T00:38:35.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.672+0000 7f82656a79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:35.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.672+0000 7f82656a79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32, ofs0, ns] 2024-09-12T00:38:35.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.672+0000 7f81467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398899 cookie 93999584403168 notifier 7278 bl.length()=1015 2024-09-12T00:38:35.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.672+0000 7f81467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 info.flags=0x17 2024-09-12T00:38:35.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.672+0000 7f81467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 to cache LRU end 2024-09-12T00:38:35.669 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.672+0000 7f81467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:35.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.676+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): orig_sources= new_sources= 2024-09-12T00:38:35.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.676+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): potential sources added=[] removed=[] 2024-09-12T00:38:35.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.676+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): orig_dests= new_dests= 2024-09-12T00:38:35.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.676+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): potential dests added=[] removed=[] 2024-09-12T00:38:35.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.0 2024-09-12T00:38:35.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.0 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.1 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.1 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.2 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.2 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.3 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.3 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.4 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.4 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.5 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.5 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.6 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.6 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.7 2024-09-12T00:38:35.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.7 2024-09-12T00:38:35.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.8 2024-09-12T00:38:35.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.8 2024-09-12T00:38:35.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.9 2024-09-12T00:38:35.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.9 2024-09-12T00:38:35.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.10 2024-09-12T00:38:35.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.10 2024-09-12T00:38:35.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.11 2024-09-12T00:38:35.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1.11 2024-09-12T00:38:35.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.0 2024-09-12T00:38:35.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1 2024-09-12T00:38:35.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.2 2024-09-12T00:38:35.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.684+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.3 2024-09-12T00:38:35.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.688+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.4 2024-09-12T00:38:35.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.688+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.5 2024-09-12T00:38:35.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.688+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.6 2024-09-12T00:38:35.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.688+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.7 2024-09-12T00:38:35.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.688+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.8 2024-09-12T00:38:35.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.692+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.9 2024-09-12T00:38:35.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.692+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.10 2024-09-12T00:38:35.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.700+0000 7f82656a79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:35.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.700+0000 7f82656a79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 2024-09-12T00:38:35.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.700+0000 7f82656a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 info.flags=0x17 2024-09-12T00:38:35.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.700+0000 7f82656a79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 to cache LRU end 2024-09-12T00:38:35.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.700+0000 7f82656a79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:35.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.700+0000 7f82656a79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32, ofs0, ns] 2024-09-12T00:38:35.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.700+0000 7f8146ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398900 cookie 93999584403168 notifier 7278 bl.length()=1015 2024-09-12T00:38:35.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.700+0000 7f8146ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 info.flags=0x17 2024-09-12T00:38:35.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.700+0000 7f8146ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 to cache LRU end 2024-09-12T00:38:35.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.700+0000 7f8146ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:35.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.704+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): orig_sources= new_sources= 2024-09-12T00:38:35.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.704+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): potential sources added=[] removed=[] 2024-09-12T00:38:35.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.704+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): orig_dests= new_dests= 2024-09-12T00:38:35.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.704+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): potential dests added=[] removed=[] 2024-09-12T00:38:35.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.708+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.0 2024-09-12T00:38:35.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.708+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.1 2024-09-12T00:38:35.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.708+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.2 2024-09-12T00:38:35.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.708+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.3 2024-09-12T00:38:35.706 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.708+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.4 2024-09-12T00:38:35.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.712+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.5 2024-09-12T00:38:35.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.712+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.6 2024-09-12T00:38:35.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.712+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.7 2024-09-12T00:38:35.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.712+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.8 2024-09-12T00:38:35.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.712+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.9 2024-09-12T00:38:35.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.712+0000 7f82656a79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32.10 2024-09-12T00:38:35.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f82656a79c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:38:35.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f82656a79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:35.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f82656a79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 2024-09-12T00:38:35.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f82656a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 info.flags=0x17 2024-09-12T00:38:35.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f82656a79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 to cache LRU end 2024-09-12T00:38:35.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f82656a79c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:35.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f82656a79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32, ofs0, ns] 2024-09-12T00:38:35.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f81467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398901 cookie 93999584403168 notifier 7278 bl.length()=983 2024-09-12T00:38:35.713 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f81467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 info.flags=0x17 2024-09-12T00:38:35.714 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f81467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 to cache LRU end 2024-09-12T00:38:35.714 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.716+0000 7f81467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:35.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.720+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): orig_sources= new_sources= 2024-09-12T00:38:35.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.720+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): potential sources added=[] removed=[] 2024-09-12T00:38:35.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.720+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): orig_dests= new_dests= 2024-09-12T00:38:35.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.720+0000 7f82656a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32]): potential dests added=[] removed=[] 2024-09-12T00:38:35.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.728+0000 7f82656a79c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:35.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.728+0000 7f8119fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:35.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.736+0000 7f82656a79c0 20 remove_watcher() i=0 2024-09-12T00:38:35.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.736+0000 7f82656a79c0 2 removed watcher, disabling cache 2024-09-12T00:38:35.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.736+0000 7f82656a79c0 20 remove_watcher() i=1 2024-09-12T00:38:35.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.740+0000 7f82656a79c0 20 remove_watcher() i=2 2024-09-12T00:38:35.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.740+0000 7f82656a79c0 20 remove_watcher() i=3 2024-09-12T00:38:35.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.744+0000 7f82656a79c0 20 remove_watcher() i=4 2024-09-12T00:38:35.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.744+0000 7f82656a79c0 20 remove_watcher() i=5 2024-09-12T00:38:35.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.748+0000 7f82656a79c0 20 remove_watcher() i=6 2024-09-12T00:38:35.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.748+0000 7f82656a79c0 20 remove_watcher() i=7 2024-09-12T00:38:35.770 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:38:35.800 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:35.800 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:35.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.848+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 realm 2024-09-12T00:38:35.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:35.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:35.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:35.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.852+0000 7f030d4b79c0 20 searching for the correct realm 2024-09-12T00:38:35.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.856+0000 7f030b7be640 0 -- 172.21.15.102:0/2704481896 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f030001f040 msgr2=0x7f0300014030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:35.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:35.864+0000 7f030a7bc640 0 -- 172.21.15.102:0/2704481896 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f030401e9c0 msgr2=0x7f03040648e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:36.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.080+0000 7f030d4b79c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:36.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.080+0000 7f030d4b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:36.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.080+0000 7f030d4b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:36.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.080+0000 7f030d4b79c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:36.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.080+0000 7f030d4b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:36.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.080+0000 7f030d4b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:36.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.080+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:36.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.080+0000 7f030d4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:36.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.080+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:36.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:36.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:36.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:36.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 zone default found 2024-09-12T00:38:36.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 4 Realm: () 2024-09-12T00:38:36.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:36.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:36.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:36.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 zonegroup default 2024-09-12T00:38:36.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:36.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:36.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:36.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:36.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:36.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:36.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 started sync module instance, tier type = 2024-09-12T00:38:36.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.084+0000 7f030d4b79c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:36.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.108+0000 7f030d4b79c0 20 add_watcher() i=0 2024-09-12T00:38:36.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.108+0000 7f030d4b79c0 20 add_watcher() i=1 2024-09-12T00:38:36.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.108+0000 7f030d4b79c0 20 add_watcher() i=2 2024-09-12T00:38:36.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.108+0000 7f030d4b79c0 20 add_watcher() i=3 2024-09-12T00:38:36.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.108+0000 7f030d4b79c0 20 add_watcher() i=4 2024-09-12T00:38:36.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.108+0000 7f030d4b79c0 20 add_watcher() i=5 2024-09-12T00:38:36.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.108+0000 7f030d4b79c0 20 add_watcher() i=6 2024-09-12T00:38:36.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.112+0000 7f030d4b79c0 20 add_watcher() i=7 2024-09-12T00:38:36.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.112+0000 7f030d4b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:36.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.116+0000 7f01c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:36.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.116+0000 7f030d4b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:36.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.116+0000 7f030d4b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:36.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.116+0000 7f030d4b79c0 5 note: GC not initialized 2024-09-12T00:38:36.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.116+0000 7f013bfff640 20 reqs_thread_entry: start 2024-09-12T00:38:36.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.116+0000 7f030d4b79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:36.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.116+0000 7f030d4b79c0 20 Filter name: none 2024-09-12T00:38:36.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.116+0000 7f0139ffb640 20 reqs_thread_entry: start 2024-09-12T00:38:36.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.120+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:36.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.120+0000 7f030d4b79c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:36.116 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.120+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:36.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.120+0000 7f030d4b79c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:36.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.120+0000 7f030d4b79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:36.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.120+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:36.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.120+0000 7f030d4b79c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:36.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.120+0000 7f030d4b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:36.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.120+0000 7f030d4b79c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:36.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.124+0000 7f030d4b79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:36.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.124+0000 7f01c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:36.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.132+0000 7f030d4b79c0 20 remove_watcher() i=0 2024-09-12T00:38:36.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.132+0000 7f030d4b79c0 2 removed watcher, disabling cache 2024-09-12T00:38:36.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.132+0000 7f030d4b79c0 20 remove_watcher() i=1 2024-09-12T00:38:36.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.136+0000 7f030d4b79c0 20 remove_watcher() i=2 2024-09-12T00:38:36.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.136+0000 7f030d4b79c0 20 remove_watcher() i=3 2024-09-12T00:38:36.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.140+0000 7f030d4b79c0 20 remove_watcher() i=4 2024-09-12T00:38:36.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.140+0000 7f030d4b79c0 20 remove_watcher() i=5 2024-09-12T00:38:36.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.144+0000 7f030d4b79c0 20 remove_watcher() i=6 2024-09-12T00:38:36.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:36.144+0000 7f030d4b79c0 20 remove_watcher() i=7 2024-09-12T00:38:36.155 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:36.155 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:38:36.155 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-commit-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:38:36.155 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:36.156 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:36.157 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:36.177 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:36.177 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:36.731 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:36.731 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:37.121 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:38:37.121 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:37.126 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:37.126 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:37.262 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:37.262 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:37.351 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:37.351 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:37.454 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:37.454 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:37.552 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:37.552 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:37.648 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:37.648 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:37.741 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:37.741 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:37.844 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:37.844 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:37.943 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:37.943 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:38.041 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:38.042 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:38.138 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:38.138 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:38.236 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:38.236 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:38.336 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:38.336 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:38.438 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:38.438 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:38.534 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:38.534 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:38.631 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:38.632 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:38.726 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:38.726 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:38.825 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:38.825 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:38.924 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:38.925 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:39.025 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:39.026 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:39.133 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:39.134 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:39.245 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:39.245 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:38:39.346 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:38:39.376 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:39.376 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:39.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.424+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.428+0000 7f40e41319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:39.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.428+0000 7f40e41319c0 20 realm 2024-09-12T00:38:39.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.428+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.428+0000 7f40e41319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:39.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.428+0000 7f40e41319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:39.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.428+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.428+0000 7f40e41319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:39.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.428+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.428+0000 7f40e41319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:39.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.428+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.432+0000 7f40e41319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:39.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.432+0000 7f40e41319c0 20 searching for the correct realm 2024-09-12T00:38:39.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.436+0000 7f40e2438640 0 -- 172.21.15.102:0/3610284332 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f40d8008070 msgr2=0x7f40d8062320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:39.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.652+0000 7f40e1436640 0 -- 172.21.15.102:0/3610284332 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f40dc10a090 msgr2=0x7f40dc0e8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:39.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:39.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:39.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:39.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:39.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:39.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:39.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:39.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:39.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.868+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:39.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 zone default found 2024-09-12T00:38:39.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 4 Realm: () 2024-09-12T00:38:39.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:39.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:39.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:39.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 zonegroup default 2024-09-12T00:38:39.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:39.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:39.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:39.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 started sync module instance, tier type = 2024-09-12T00:38:39.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.872+0000 7f40e41319c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:39.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.892+0000 7f40e41319c0 20 add_watcher() i=0 2024-09-12T00:38:39.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.892+0000 7f40e41319c0 20 add_watcher() i=1 2024-09-12T00:38:39.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.892+0000 7f40e41319c0 20 add_watcher() i=2 2024-09-12T00:38:39.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.892+0000 7f40e41319c0 20 add_watcher() i=3 2024-09-12T00:38:39.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.892+0000 7f40e41319c0 20 add_watcher() i=4 2024-09-12T00:38:39.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.892+0000 7f40e41319c0 20 add_watcher() i=5 2024-09-12T00:38:39.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.892+0000 7f40e41319c0 20 add_watcher() i=6 2024-09-12T00:38:39.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.896+0000 7f40e41319c0 20 add_watcher() i=7 2024-09-12T00:38:39.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.896+0000 7f40e41319c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:39.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.900+0000 7f3f937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:39.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.900+0000 7f40e41319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:39.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.900+0000 7f40e41319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:39.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.900+0000 7f40e41319c0 5 note: GC not initialized 2024-09-12T00:38:39.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.900+0000 7f3f927fc640 20 reqs_thread_entry: start 2024-09-12T00:38:39.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.900+0000 7f40e41319c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:39.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.900+0000 7f40e41319c0 20 Filter name: none 2024-09-12T00:38:39.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.900+0000 7f3f03fff640 20 reqs_thread_entry: start 2024-09-12T00:38:39.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.900+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.904+0000 7f40e41319c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:39.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.904+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.904+0000 7f40e41319c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:39.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.904+0000 7f40e41319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:39.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.904+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.904+0000 7f40e41319c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:39.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.904+0000 7f40e41319c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:39.902 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.904+0000 7f40e41319c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:39.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.904+0000 7f40e41319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:39.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.908+0000 7f3f937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:39.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.912+0000 7f40e41319c0 20 remove_watcher() i=0 2024-09-12T00:38:39.910 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.912+0000 7f40e41319c0 2 removed watcher, disabling cache 2024-09-12T00:38:39.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.916+0000 7f40e41319c0 20 remove_watcher() i=1 2024-09-12T00:38:39.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.916+0000 7f40e41319c0 20 remove_watcher() i=2 2024-09-12T00:38:39.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.920+0000 7f40e41319c0 20 remove_watcher() i=3 2024-09-12T00:38:39.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.920+0000 7f40e41319c0 20 remove_watcher() i=4 2024-09-12T00:38:39.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.924+0000 7f40e41319c0 20 remove_watcher() i=5 2024-09-12T00:38:39.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.924+0000 7f40e41319c0 20 remove_watcher() i=6 2024-09-12T00:38:39.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:39.924+0000 7f40e41319c0 20 remove_watcher() i=7 2024-09-12T00:38:39.937 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:39.937 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:38:39.937 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-commit-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:39.937 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:39.937 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:38:39.973 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:39.973 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:40.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.020+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.024+0000 7fd914a729c0 20 realm 2024-09-12T00:38:40.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.024+0000 7fd914a729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:40.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:40.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.028+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:40.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.028+0000 7fd914a729c0 20 searching for the correct realm 2024-09-12T00:38:40.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.032+0000 7fd912d79640 0 -- 172.21.15.102:0/3308351554 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x5635684f1bb0 msgr2=0x5635684f3fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:40.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.036+0000 7fd911d77640 0 -- 172.21.15.102:0/3308351554 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd90c04c040 msgr2=0x7fd90c0820b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:40.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:40.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:40.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:40.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:40.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:40.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:40.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.252+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:40.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:40.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 20 zone default found 2024-09-12T00:38:40.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 4 Realm: () 2024-09-12T00:38:40.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:40.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:40.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:40.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 20 zonegroup default 2024-09-12T00:38:40.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.260+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.260+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.260+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.260+0000 7fd914a729c0 20 started sync module instance, tier type = 2024-09-12T00:38:40.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.260+0000 7fd914a729c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:40.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=0 2024-09-12T00:38:40.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=1 2024-09-12T00:38:40.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=2 2024-09-12T00:38:40.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=3 2024-09-12T00:38:40.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=4 2024-09-12T00:38:40.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=5 2024-09-12T00:38:40.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=6 2024-09-12T00:38:40.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=7 2024-09-12T00:38:40.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.284+0000 7fd914a729c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:40.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.288+0000 7fd7c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:40.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:40.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:40.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 5 note: GC not initialized 2024-09-12T00:38:40.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd7c37fe640 20 reqs_thread_entry: start 2024-09-12T00:38:40.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:40.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 20 Filter name: none 2024-09-12T00:38:40.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd7c17fa640 20 reqs_thread_entry: start 2024-09-12T00:38:40.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:38:40.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:40.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:40.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:38:40.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 : miss 2024-09-12T00:38:40.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:40.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:40.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.292+0000 7fd914a729c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.296+0000 7fd914a729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 2024-09-12T00:38:40.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.304+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.304+0000 7fd914a729c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.304+0000 7fd914a729c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.304+0000 7fd914a729c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33, ofs0, ns] 2024-09-12T00:38:40.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398907 cookie 94787383310592 notifier 6878 bl.length()=1015 2024-09-12T00:38:40.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_sources= new_sources= 2024-09-12T00:38:40.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential sources added=[] removed=[] 2024-09-12T00:38:40.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_dests= new_dests= 2024-09-12T00:38:40.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential dests added=[] removed=[] 2024-09-12T00:38:40.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.0 2024-09-12T00:38:40.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.0 2024-09-12T00:38:40.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.1 2024-09-12T00:38:40.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.1 2024-09-12T00:38:40.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.2 2024-09-12T00:38:40.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.2 2024-09-12T00:38:40.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.3 2024-09-12T00:38:40.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.3 2024-09-12T00:38:40.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.4 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.4 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.5 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.5 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.6 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.6 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.7 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.7 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.8 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.8 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.9 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.9 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.10 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.10 2024-09-12T00:38:40.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.11 2024-09-12T00:38:40.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.11 2024-09-12T00:38:40.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.0 2024-09-12T00:38:40.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1 2024-09-12T00:38:40.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.2 2024-09-12T00:38:40.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.3 2024-09-12T00:38:40.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.4 2024-09-12T00:38:40.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.5 2024-09-12T00:38:40.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.6 2024-09-12T00:38:40.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.7 2024-09-12T00:38:40.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.8 2024-09-12T00:38:40.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.9 2024-09-12T00:38:40.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.10 2024-09-12T00:38:40.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.336+0000 7fd914a729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:40.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.336+0000 7fd914a729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 2024-09-12T00:38:40.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.340+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.340+0000 7fd914a729c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.340+0000 7fd914a729c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.340+0000 7fd914a729c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33, ofs0, ns] 2024-09-12T00:38:40.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398908 cookie 94787383310592 notifier 6878 bl.length()=1015 2024-09-12T00:38:40.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_sources= new_sources= 2024-09-12T00:38:40.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential sources added=[] removed=[] 2024-09-12T00:38:40.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_dests= new_dests= 2024-09-12T00:38:40.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential dests added=[] removed=[] 2024-09-12T00:38:40.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.0 2024-09-12T00:38:40.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1 2024-09-12T00:38:40.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.2 2024-09-12T00:38:40.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.3 2024-09-12T00:38:40.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.4 2024-09-12T00:38:40.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.5 2024-09-12T00:38:40.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.6 2024-09-12T00:38:40.352 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.7 2024-09-12T00:38:40.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.8 2024-09-12T00:38:40.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.9 2024-09-12T00:38:40.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.10 2024-09-12T00:38:40.355 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd914a729c0 time 2024-09-12T00:38:40.362336+0000 2024-09-12T00:38:40.355 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd91834c2eb] 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd91834c49f] 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635654f3cc1] 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563565508fc7] 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9171b2d90] 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.360+0000 7fd914a729c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd914a729c0 time 2024-09-12T00:38:40.362336+0000 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:40.357 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd91834c2eb] 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd91834c49f] 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635654f3cc1] 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563565508fc7] 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9171b2d90] 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:38:40.358 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd914a729c0 thread_name:radosgw-admin 2024-09-12T00:38:40.383 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:40.383 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9171cb520] 2024-09-12T00:38:40.383 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:38:40.383 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd91834c345] 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd91834c49f] 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635654f3cc1] 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563565508fc7] 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9171b2d90] 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.360+0000 7fd914a729c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd914a729c0 thread_name:radosgw-admin 2024-09-12T00:38:40.384 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9171cb520] 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd91834c345] 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd91834c49f] 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635654f3cc1] 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563565508fc7] 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9171b2d90] 2024-09-12T00:38:40.385 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:38:40.000+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:38:40.000+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:38:40.000+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command rotate-key hook 0x5635683fdb68 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-b con 0x5635682b4ee0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-a con 0x5635682b6ba0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-c con 0x563568343a70 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.386 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): authenticate will time out at 2708.502471s 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): get_auth_request con 0x563568343a70 auth_method 0 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): get_auth_request con 0x5635682b6ba0 auth_method 0 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.387 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): handle_auth_done global_id 6869 payload 824 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient: _finish_hunting 0 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:38:40.000+0000 7fd912d79640 1 monclient: found mon.noname-c 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:38:40.000+0000 7fd912578640 10 monclient: get_auth_request con 0x5635682b4ee0 auth_method 0 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: dump: 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.388 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: _finish_auth 0 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: _check_auth_tickets 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: dump: 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.389 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:38:40.000+0000 7fd914a729c0 5 monclient: authenticate success, global_id 6869 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:38:40.000+0000 7fd800608640 4 set_mon_vals no callback set 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.390 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:38:40.000+0000 7fd914a729c0 1 librados: init done 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:38:40.004+0000 7fd7fee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:38:40.004+0000 7fd7fee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:38:40.004+0000 7fd7fee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:38:40.004+0000 7fd912578640 10 monclient: get_auth_request con 0x7fd7f8070ae0 auth_method 0 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:38:40.004+0000 7fd911d77640 10 monclient: get_auth_request con 0x563568430920 auth_method 0 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:38:40.004+0000 7fd912578640 10 monclient: get_auth_request con 0x563568448030 auth_method 0 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:38:40.008+0000 7fd911d77640 10 monclient: get_auth_request con 0x56356844c420 auth_method 0 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:38:40.008+0000 7fd912d79640 10 monclient: get_auth_request con 0x56356844b8e0 auth_method 0 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:38:40.008+0000 7fd914a729c0 10 monclient: build_initial_monmap 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:38:40.008+0000 7fd914a729c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:40.391 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:38:40.008+0000 7fd914a729c0 10 monclient: monmap: 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.392 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding auth protocol: cephx 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding auth protocol: cephx 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding auth protocol: cephx 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.393 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:38:40.012+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command objecter_requests cmddesc objecter_requests hook 0x563568458030 EEXIST 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: init 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding auth protocol: cephx 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding auth protocol: cephx 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding auth protocol: cephx 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.394 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:38:40.012+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:38:40.012+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command rotate-key cmddesc rotate-key hook 0x563568453650 EEXIST 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-a con 0x56356847c1e0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-c con 0x56356847bb10 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:38:40.395 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-b con 0x56356847a4f0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): authenticate will time out at 2708.513139s 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): get_auth_request con 0x56356847c1e0 auth_method 0 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): get_auth_request con 0x56356847bb10 auth_method 0 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.396 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.397 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.397 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.397 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.397 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.397 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.397 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.397 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.397 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:38:40.012+0000 7fd912578640 10 monclient(hunting): get_auth_request con 0x56356847a4f0 auth_method 0 2024-09-12T00:38:40.397 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:38:40.012+0000 7fd912578640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.397 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:38:40.012+0000 7fd912578640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:38:40.012+0000 7fd912578640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): handle_auth_done global_id 7323 payload 824 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient: _finish_hunting 0 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:38:40.012+0000 7fd911d77640 1 monclient: found mon.noname-a 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: dump: 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.398 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: _finish_auth 0 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: dump: 2024-09-12T00:38:40.399 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 monclient: authenticate success, global_id 7323 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:38:40.012+0000 7fd91357a640 4 set_mon_vals no callback set 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.400 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:38:40.016+0000 7fd7f7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:38:40.016+0000 7fd7f7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:38:40.016+0000 7fd7f7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: get_monmap_and_config 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: build_initial_monmap 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: monmap: 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:38:40.401 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding auth protocol: cephx 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding auth protocol: cephx 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding auth protocol: cephx 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.402 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient: get_auth_request con 0x7fd7ec070a20 auth_method 0 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: init 2024-09-12T00:38:40.403 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding auth protocol: cephx 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding auth protocol: cephx 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding auth protocol: cephx 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.404 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command rotate-key cmddesc rotate-key hook 0x7fff0ecfaa18 EEXIST 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-c con 0x5635684cfe50 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-a con 0x5635684d0230 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-b con 0x5635684a0e10 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): authenticate will time out at 2708.517543s 2024-09-12T00:38:40.405 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): get_auth_request con 0x5635684cfe50 auth_method 0 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): get_auth_request con 0x5635684d0230 auth_method 0 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.406 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): handle_auth_done global_id 7326 payload 274 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient: _finish_hunting 0 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:38:40.016+0000 7fd912d79640 1 monclient: found mon.noname-a 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: dump: 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.407 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 monclient: authenticate success, global_id 7326 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: get_monmap_and_config success 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:38:40.016+0000 7fd914a729c0 4 set_mon_vals no callback set 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: dump: 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.408 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: shutdown 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: build_initial_monmap 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: monmap: 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:38:40.409 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding auth protocol: cephx 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding auth protocol: cephx 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding auth protocol: cephx 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.410 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 librados: starting msgr at 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 librados: starting objecter 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command objecter_requests cmddesc objecter_requests hook 0x5635684c9f20 EEXIST 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 librados: setting wanted keys 2024-09-12T00:38:40.411 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 librados: calling monclient init 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: init 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding auth protocol: cephx 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding auth protocol: cephx 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding auth protocol: cephx 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.412 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command rotate-key cmddesc rotate-key hook 0x56356847e148 EEXIST 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-b con 0x5635684a0e10 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-c con 0x5635684cfe50 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-a con 0x5635684cdbc0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:38:40.413 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): authenticate will time out at 2708.520042s 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): get_auth_request con 0x5635684cfe50 auth_method 0 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): get_auth_request con 0x5635684cdbc0 auth_method 0 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.414 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): handle_auth_done global_id 6878 payload 824 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient: _finish_hunting 0 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:38:40.020+0000 7fd912d79640 1 monclient: found mon.noname-c 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: dump: 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.415 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: _finish_auth 0 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:40.416 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: dump: 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:38:40.020+0000 7fd914a729c0 5 monclient: authenticate success, global_id 6878 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:38:40.020+0000 7fd7f5ffb640 4 set_mon_vals no callback set 2024-09-12T00:38:40.417 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:38:40.020+0000 7fd914a729c0 1 librados: init done 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:38:40.020+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command cr dump hook 0x5635684c3998 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:38:40.020+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:38:40.020+0000 7fd911d77640 10 monclient: get_auth_request con 0x7fd7dc070b10 auth_method 0 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient: get_auth_request con 0x5635684ea1a0 auth_method 0 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 realm 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.418 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:38:40.024+0000 7fd914a729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:38:40.024+0000 7fd911d77640 10 monclient: get_auth_request con 0x5635684ee370 auth_method 0 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:38:40.024+0000 7fd912d79640 10 monclient: get_auth_request con 0x5635684f1bb0 auth_method 0 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:38:40.028+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:38:40.028+0000 7fd914a729c0 20 searching for the correct realm 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:38:40.028+0000 7fd912578640 10 monclient: get_auth_request con 0x5635684f68f0 auth_method 0 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:38:40.028+0000 7fd911d77640 10 monclient: get_auth_request con 0x7fd90c0638b0 auth_method 0 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:38:40.028+0000 7fd912d79640 10 monclient: get_auth_request con 0x7fd908033060 auth_method 0 2024-09-12T00:38:40.419 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:38:40.032+0000 7fd912d79640 0 -- 172.21.15.102:0/3308351554 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x5635684f1bb0 msgr2=0x5635684f3fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:38:40.032+0000 7fd7e3fff640 1 client.6878.objecter ms_handle_reset 0x5635684f1bb0 session 0x5635684ed6c0 osd.7 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:38:40.032+0000 7fd7e3fff640 10 monclient: _renew_subs 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:38:40.032+0000 7fd7e3fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:38:40.032+0000 7fd912d79640 10 monclient: get_auth_request con 0x7fd7dc081230 auth_method 0 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:38:40.032+0000 7fd912578640 10 monclient: get_auth_request con 0x7fd90c083610 auth_method 0 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:38:40.036+0000 7fd911d77640 10 monclient: get_auth_request con 0x7fd90c04c040 auth_method 0 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:38:40.036+0000 7fd911d77640 0 -- 172.21.15.102:0/3308351554 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd90c04c040 msgr2=0x7fd90c0820b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:38:40.240+0000 7fd911d77640 10 monclient: get_auth_request con 0x7fd90c04c040 auth_method 0 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:40.420 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 zone default found 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:38:40.256+0000 7fd914a729c0 4 Realm: () 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:38:40.256+0000 7fd914a729c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:38:40.256+0000 7fd914a729c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:38:40.256+0000 7fd914a729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:40.421 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 zonegroup default 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:38:40.260+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:38:40.260+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:38:40.260+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:38:40.260+0000 7fd914a729c0 20 started sync module instance, tier type = 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:38:40.260+0000 7fd914a729c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=0 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=1 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=2 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=3 2024-09-12T00:38:40.422 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=4 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=5 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=6 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=7 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:38:40.284+0000 7fd914a729c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding auth protocol: cephx 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding auth protocol: cephx 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding auth protocol: cephx 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:38:40.288+0000 7fd7c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.423 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:38:40.292+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command cache list hook 0x5635684cdfe0 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command cache inspect hook 0x5635684cdfe0 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command cache erase hook 0x5635684cdfe0 2024-09-12T00:38:40.424 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command cache zap hook 0x5635684cdfe0 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 note: GC not initialized 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:38:40.292+0000 7fd7c37fe640 20 reqs_thread_entry: start 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command sync trace show hook 0x7fd90c048040 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command sync trace history hook 0x7fd90c048040 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command sync trace active hook 0x7fd90c048040 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command sync trace active_short hook 0x7fd90c048040 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 Filter name: none 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:38:40.292+0000 7fd7c17fa640 20 reqs_thread_entry: start 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:40.425 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 : miss 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:38:40.296+0000 7fd914a729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:38:40.304+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:38:40.304+0000 7fd914a729c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:38:40.304+0000 7fd914a729c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.426 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:38:40.304+0000 7fd914a729c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33, ofs0, ns] 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398907 cookie 94787383310592 notifier 6878 bl.length()=1015 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_sources= new_sources= 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential sources added=[] removed=[] 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_dests= new_dests= 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential dests added=[] removed=[] 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.0 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.0 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.1 2024-09-12T00:38:40.427 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.1 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.2 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.2 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.3 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.3 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.4 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.4 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.5 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.5 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.6 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.6 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.7 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.7 2024-09-12T00:38:40.428 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.8 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.8 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.9 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.9 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.10 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.10 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.11 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.11 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.0 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.2 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.3 2024-09-12T00:38:40.429 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.4 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.5 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.6 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.7 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.8 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.9 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.10 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:38:40.336+0000 7fd914a729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:38:40.336+0000 7fd914a729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:38:40.340+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:38:40.340+0000 7fd914a729c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:38:40.340+0000 7fd914a729c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:38:40.340+0000 7fd914a729c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33, ofs0, ns] 2024-09-12T00:38:40.430 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398908 cookie 94787383310592 notifier 6878 bl.length()=1015 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_sources= new_sources= 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential sources added=[] removed=[] 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_dests= new_dests= 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential dests added=[] removed=[] 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.0 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.2 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.3 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.4 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.5 2024-09-12T00:38:40.431 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.6 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.7 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.8 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.9 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.10 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:38:40.360+0000 7fd914a729c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd914a729c0 time 2024-09-12T00:38:40.362336+0000 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd91834c2eb] 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd91834c49f] 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635654f3cc1] 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563565508fc7] 2024-09-12T00:38:40.432 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9171b2d90] 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:38:40.360+0000 7fd914a729c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd914a729c0 thread_name:radosgw-admin 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9171cb520] 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd91834c345] 2024-09-12T00:38:40.433 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd91834c49f] 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635654f3cc1] 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563565508fc7] 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9171b2d90] 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:38:40.434 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:38:40.435 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:38:40.436 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:38:40.437 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:38:40.438 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:40.439 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:40.440 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7c17fa640 / http_manager 2024-09-12T00:38:40.441 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7c37fe640 / http_manager 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7c97e2640 / rgw_dt_lg_renew 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7e3fff640 / ms_dispatch 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7f57fa640 / io_context_pool 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7f5ffb640 / io_context_pool 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7f7fff640 / ms_dispatch 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7fee05640 / ms_dispatch 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd800608640 / io_context_pool 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd911d77640 / msgr-worker-2 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd912578640 / msgr-worker-1 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd912d79640 / msgr-worker-0 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd91357a640 / io_context_pool 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd914a729c0 / radosgw-admin 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:38:40.442 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.115921.log 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:38:40.000+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:38:40.000+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:38:40.000+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command rotate-key hook 0x5635683fdb68 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-b con 0x5635682b4ee0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-a con 0x5635682b6ba0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-c con 0x563568343a70 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.443 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient(hunting): authenticate will time out at 2708.502471s 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): get_auth_request con 0x563568343a70 auth_method 0 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): get_auth_request con 0x5635682b6ba0 auth_method 0 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.444 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:38:40.000+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient(hunting): handle_auth_done global_id 6869 payload 824 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient: _finish_hunting 0 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:38:40.000+0000 7fd912d79640 1 monclient: found mon.noname-c 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:38:40.000+0000 7fd912d79640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:38:40.000+0000 7fd912578640 10 monclient: get_auth_request con 0x5635682b4ee0 auth_method 0 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: dump: 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.445 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: _finish_auth 0 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: _check_auth_tickets 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.446 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:38:40.000+0000 7fd7fee05640 10 monclient: dump: 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:38:40.000+0000 7fd914a729c0 5 monclient: authenticate success, global_id 6869 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:38:40.000+0000 7fd800608640 4 set_mon_vals no callback set 2024-09-12T00:38:40.447 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:38:40.000+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:38:40.000+0000 7fd914a729c0 1 librados: init done 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:38:40.004+0000 7fd7fee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:38:40.004+0000 7fd7fee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:38:40.004+0000 7fd7fee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:38:40.004+0000 7fd912578640 10 monclient: get_auth_request con 0x7fd7f8070ae0 auth_method 0 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:38:40.004+0000 7fd911d77640 10 monclient: get_auth_request con 0x563568430920 auth_method 0 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:38:40.004+0000 7fd912578640 10 monclient: get_auth_request con 0x563568448030 auth_method 0 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:38:40.008+0000 7fd911d77640 10 monclient: get_auth_request con 0x56356844c420 auth_method 0 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:38:40.008+0000 7fd912d79640 10 monclient: get_auth_request con 0x56356844b8e0 auth_method 0 2024-09-12T00:38:40.448 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:38:40.008+0000 7fd914a729c0 10 monclient: build_initial_monmap 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:38:40.008+0000 7fd914a729c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:38:40.008+0000 7fd914a729c0 10 monclient: monmap: 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:38:40.449 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding auth protocol: cephx 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding auth protocol: cephx 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding auth protocol: cephx 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.450 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: crc 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x5635684546b0) adding con mode: secure 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:38:40.012+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command objecter_requests cmddesc objecter_requests hook 0x563568458030 EEXIST 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: init 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding auth protocol: cephx 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding auth protocol: cephx 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding auth protocol: cephx 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.451 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: crc 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 AuthRegistry(0x563568453508) adding con mode: secure 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:38:40.012+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:38:40.012+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command rotate-key cmddesc rotate-key hook 0x563568453650 EEXIST 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:40.452 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-a con 0x56356847c1e0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-c con 0x56356847bb10 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-b con 0x56356847a4f0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient(hunting): authenticate will time out at 2708.513139s 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): get_auth_request con 0x56356847c1e0 auth_method 0 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): get_auth_request con 0x56356847bb10 auth_method 0 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.453 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:38:40.012+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:38:40.012+0000 7fd912578640 10 monclient(hunting): get_auth_request con 0x56356847a4f0 auth_method 0 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:38:40.012+0000 7fd912578640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:38:40.012+0000 7fd912578640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:38:40.012+0000 7fd912578640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient(hunting): handle_auth_done global_id 7323 payload 824 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient: _finish_hunting 0 2024-09-12T00:38:40.454 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:38:40.012+0000 7fd911d77640 1 monclient: found mon.noname-a 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:38:40.012+0000 7fd911d77640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: dump: 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: _finish_auth 0 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:38:40.012+0000 7fd7f7fff640 10 monclient: dump: 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.456 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:38:40.012+0000 7fd914a729c0 5 monclient: authenticate success, global_id 7323 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:38:40.012+0000 7fd91357a640 4 set_mon_vals no callback set 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:38:40.012+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:38:40.016+0000 7fd7f7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:38:40.016+0000 7fd7f7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.457 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:38:40.016+0000 7fd7f7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: get_monmap_and_config 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: build_initial_monmap 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: monmap: 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.458 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding auth protocol: cephx 2024-09-12T00:38:40.459 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding auth protocol: cephx 2024-09-12T00:38:40.459 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding auth protocol: cephx 2024-09-12T00:38:40.459 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.459 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.459 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.459 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.459 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.459 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.459 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: crc 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356849bbb0) adding con mode: secure 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient: get_auth_request con 0x7fd7ec070a20 auth_method 0 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: init 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding auth protocol: cephx 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding auth protocol: cephx 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding auth protocol: cephx 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.460 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: crc 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfa8d0) adding con mode: secure 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.461 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command rotate-key cmddesc rotate-key hook 0x7fff0ecfaa18 EEXIST 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-c con 0x5635684cfe50 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-a con 0x5635684d0230 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-b con 0x5635684a0e10 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient(hunting): authenticate will time out at 2708.517543s 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): get_auth_request con 0x5635684cfe50 auth_method 0 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.462 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): get_auth_request con 0x5635684d0230 auth_method 0 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:38:40.016+0000 7fd911d77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient(hunting): handle_auth_done global_id 7326 payload 274 2024-09-12T00:38:40.463 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient: _finish_hunting 0 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:38:40.016+0000 7fd912d79640 1 monclient: found mon.noname-a 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:38:40.016+0000 7fd912d79640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: dump: 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.464 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 monclient: authenticate success, global_id 7326 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: get_monmap_and_config success 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:38:40.016+0000 7fd914a729c0 4 set_mon_vals no callback set 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:38:40.016+0000 7fd7f5ffb640 10 monclient: dump: 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.465 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: shutdown 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: build_initial_monmap 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: monmap: 2024-09-12T00:38:40.466 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding auth protocol: cephx 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding auth protocol: cephx 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding auth protocol: cephx 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.467 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: crc 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x5635684d52e0) adding con mode: secure 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 librados: starting msgr at 2024-09-12T00:38:40.468 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 librados: starting objecter 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command objecter_requests cmddesc objecter_requests hook 0x5635684c9f20 EEXIST 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 librados: setting wanted keys 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:38:40.016+0000 7fd914a729c0 1 librados: calling monclient init 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: init 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding auth protocol: cephx 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding auth protocol: cephx 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding auth protocol: cephx 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.469 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: crc 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 AuthRegistry(0x56356847e000) adding con mode: secure 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:38:40.016+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:38:40.016+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command rotate-key cmddesc rotate-key hook 0x56356847e148 EEXIST 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:38:40.016+0000 7fd914a729c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:40.470 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-b con 0x5635684a0e10 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-c con 0x5635684cfe50 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): picked mon.noname-a con 0x5635684cdbc0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient(hunting): authenticate will time out at 2708.520042s 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): get_auth_request con 0x5635684cfe50 auth_method 0 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): get_auth_request con 0x5635684cdbc0 auth_method 0 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:40.471 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient(hunting): handle_auth_done global_id 6878 payload 824 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient: _finish_hunting 0 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:38:40.020+0000 7fd912d79640 1 monclient: found mon.noname-c 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:38:40.020+0000 7fd912d79640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.472 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: dump: 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: _finish_auth 0 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:38:40.473 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 10 monclient: dump: 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.474 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:38:40.020+0000 7fd914a729c0 5 monclient: authenticate success, global_id 6878 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:38:40.020+0000 7fd7f5ffb640 4 set_mon_vals no callback set 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient: _renew_subs 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:38:40.020+0000 7fd914a729c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:38:40.020+0000 7fd914a729c0 1 librados: init done 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:38:40.020+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command cr dump hook 0x5635684c3998 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:38:40.020+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:38:40.020+0000 7fd7e3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:38:40.475 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:38:40.020+0000 7fd911d77640 10 monclient: get_auth_request con 0x7fd7dc070b10 auth_method 0 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:38:40.020+0000 7fd912578640 10 monclient: get_auth_request con 0x5635684ea1a0 auth_method 0 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 realm 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:38:40.024+0000 7fd914a729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:38:40.024+0000 7fd911d77640 10 monclient: get_auth_request con 0x5635684ee370 auth_method 0 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:38:40.024+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.476 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:38:40.024+0000 7fd912d79640 10 monclient: get_auth_request con 0x5635684f1bb0 auth_method 0 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:38:40.028+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:38:40.028+0000 7fd914a729c0 20 searching for the correct realm 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:38:40.028+0000 7fd912578640 10 monclient: get_auth_request con 0x5635684f68f0 auth_method 0 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:38:40.028+0000 7fd911d77640 10 monclient: get_auth_request con 0x7fd90c0638b0 auth_method 0 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:38:40.028+0000 7fd912d79640 10 monclient: get_auth_request con 0x7fd908033060 auth_method 0 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:38:40.032+0000 7fd912d79640 0 -- 172.21.15.102:0/3308351554 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x5635684f1bb0 msgr2=0x5635684f3fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:38:40.032+0000 7fd7e3fff640 1 client.6878.objecter ms_handle_reset 0x5635684f1bb0 session 0x5635684ed6c0 osd.7 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:38:40.032+0000 7fd7e3fff640 10 monclient: _renew_subs 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:38:40.032+0000 7fd7e3fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:38:40.032+0000 7fd912d79640 10 monclient: get_auth_request con 0x7fd7dc081230 auth_method 0 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:38:40.032+0000 7fd912578640 10 monclient: get_auth_request con 0x7fd90c083610 auth_method 0 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:38:40.036+0000 7fd911d77640 10 monclient: get_auth_request con 0x7fd90c04c040 auth_method 0 2024-09-12T00:38:40.477 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:38:40.036+0000 7fd911d77640 0 -- 172.21.15.102:0/3308351554 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd90c04c040 msgr2=0x7fd90c0820b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:38:40.240+0000 7fd911d77640 10 monclient: get_auth_request con 0x7fd90c04c040 auth_method 0 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:38:40.252+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:40.478 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 zone default found 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:38:40.256+0000 7fd914a729c0 4 Realm: () 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:38:40.256+0000 7fd914a729c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:38:40.256+0000 7fd914a729c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:38:40.256+0000 7fd914a729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 zonegroup default 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:38:40.256+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:38:40.260+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:38:40.260+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:38:40.260+0000 7fd914a729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:38:40.260+0000 7fd914a729c0 20 started sync module instance, tier type = 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:38:40.260+0000 7fd914a729c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:40.479 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=0 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=1 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=2 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=3 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=4 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=5 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=6 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:38:40.284+0000 7fd914a729c0 20 add_watcher() i=7 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:38:40.284+0000 7fd914a729c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding auth protocol: cephx 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding auth protocol: cephx 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding auth protocol: cephx 2024-09-12T00:38:40.480 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:38:40.288+0000 7fd7c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: crc 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:38:40.288+0000 7fd914a729c0 5 AuthRegistry(0x7fff0ecfadb0) adding con mode: secure 2024-09-12T00:38:40.481 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:38:40.292+0000 7fd914a729c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command cache list hook 0x5635684cdfe0 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command cache inspect hook 0x5635684cdfe0 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command cache erase hook 0x5635684cdfe0 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command cache zap hook 0x5635684cdfe0 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 note: GC not initialized 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:38:40.292+0000 7fd7c37fe640 20 reqs_thread_entry: start 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command sync trace show hook 0x7fd90c048040 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command sync trace history hook 0x7fd90c048040 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command sync trace active hook 0x7fd90c048040 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:38:40.292+0000 7fd914a729c0 5 asok(0x5635681f02b0) register_command sync trace active_short hook 0x7fd90c048040 2024-09-12T00:38:40.482 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 Filter name: none 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:38:40.292+0000 7fd7c17fa640 20 reqs_thread_entry: start 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 : miss 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:38:40.292+0000 7fd914a729c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.483 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:38:40.292+0000 7fd914a729c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:38:40.296+0000 7fd914a729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:38:40.304+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:38:40.304+0000 7fd914a729c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:38:40.304+0000 7fd914a729c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:38:40.304+0000 7fd914a729c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33, ofs0, ns] 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398907 cookie 94787383310592 notifier 6878 bl.length()=1015 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:38:40.308+0000 7fd7f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_sources= new_sources= 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential sources added=[] removed=[] 2024-09-12T00:38:40.484 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_dests= new_dests= 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:38:40.308+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential dests added=[] removed=[] 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.0 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.0 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.1 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.1 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.2 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.2 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.3 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.3 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.4 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.4 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.5 2024-09-12T00:38:40.485 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.5 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.6 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.6 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.7 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.7 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.8 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.8 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.9 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.9 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.10 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.10 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:38:40.320+0000 7fd914a729c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.11 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.11 2024-09-12T00:38:40.486 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.0 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:38:40.320+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.2 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.3 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.4 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.5 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:38:40.324+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.6 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.7 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.8 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.9 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:38:40.328+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.10 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:38:40.336+0000 7fd914a729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:38:40.336+0000 7fd914a729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 2024-09-12T00:38:40.487 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:38:40.340+0000 7fd914a729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:38:40.340+0000 7fd914a729c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:38:40.340+0000 7fd914a729c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:38:40.340+0000 7fd914a729c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33, ofs0, ns] 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398908 cookie 94787383310592 notifier 6878 bl.length()=1015 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:38:40.340+0000 7fd7f57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_sources= new_sources= 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential sources added=[] removed=[] 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_dests= new_dests= 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:38:40.344+0000 7fd914a729c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential dests added=[] removed=[] 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.0 2024-09-12T00:38:40.488 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.2 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.3 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.4 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:38:40.352+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.5 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.6 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.7 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.8 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.9 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:38:40.356+0000 7fd914a729c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.10 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:38:40.360+0000 7fd914a729c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd914a729c0 time 2024-09-12T00:38:40.362336+0000 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.489 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd91834c2eb] 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd91834c49f] 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635654f3cc1] 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563565508fc7] 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9171b2d90] 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:38:40.360+0000 7fd914a729c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd914a729c0 thread_name:radosgw-admin 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.490 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd9171cb520] 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd91834c345] 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd91834c49f] 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5635654f3cc1] 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x563565508fc7] 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd9171b2d90] 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:40.491 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:40.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:38:40.493 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:38:40.494 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:38:40.495 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:40.496 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:38:40.497 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7c17fa640 / http_manager 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7c37fe640 / http_manager 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7c97e2640 / rgw_dt_lg_renew 2024-09-12T00:38:40.498 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7e3fff640 / ms_dispatch 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7f57fa640 / io_context_pool 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7f5ffb640 / io_context_pool 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7f7fff640 / ms_dispatch 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7fee05640 / ms_dispatch 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd800608640 / io_context_pool 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd911d77640 / msgr-worker-2 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd912578640 / msgr-worker-1 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd912d79640 / msgr-worker-0 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd91357a640 / io_context_pool 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd914a729c0 / radosgw-admin 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:38:40.499 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:38:40.365780Z_6ff72347-019a-4aa2-90a0-3b9366cd7136/log 2024-09-12T00:38:40.500 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:38:40.500 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:38:40.500 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:38:40.501 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.452+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.452+0000 7f4770fa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.452+0000 7f4770fa69c0 20 realm 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.452+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.452+0000 7f4770fa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.452+0000 7f4770fa69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.452+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.452+0000 7f4770fa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.452+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.456+0000 7f4770fa69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.456+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.456+0000 7f4770fa69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:40.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.456+0000 7f4770fa69c0 20 searching for the correct realm 2024-09-12T00:38:40.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.456+0000 7f476eaac640 0 -- 172.21.15.102:0/1275434985 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x55a905cba9d0 msgr2=0x55a905cbce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:40.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.668+0000 7f476eaac640 0 -- 172.21.15.102:0/1275434985 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x55a905a73df0 msgr2=0x7f4768098850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:40.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:38:40.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:40.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:40.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:38:40.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:40.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:40.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:40.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:40.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 zone default found 2024-09-12T00:38:40.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 4 Realm: () 2024-09-12T00:38:40.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:38:40.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:38:40.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:40.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 zonegroup default 2024-09-12T00:38:40.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.892+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.896+0000 7f4770fa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.896+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.896+0000 7f4770fa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.892 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.896+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.896+0000 7f4770fa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:40.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.896+0000 7f4770fa69c0 20 started sync module instance, tier type = 2024-09-12T00:38:40.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.896+0000 7f4770fa69c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:38:40.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.920+0000 7f4770fa69c0 20 add_watcher() i=0 2024-09-12T00:38:40.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.920+0000 7f4770fa69c0 20 add_watcher() i=1 2024-09-12T00:38:40.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.920+0000 7f4770fa69c0 20 add_watcher() i=2 2024-09-12T00:38:40.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.920+0000 7f4770fa69c0 20 add_watcher() i=3 2024-09-12T00:38:40.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.920+0000 7f4770fa69c0 20 add_watcher() i=4 2024-09-12T00:38:40.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.920+0000 7f4770fa69c0 20 add_watcher() i=5 2024-09-12T00:38:40.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.920+0000 7f4770fa69c0 20 add_watcher() i=6 2024-09-12T00:38:40.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.924+0000 7f4770fa69c0 20 add_watcher() i=7 2024-09-12T00:38:40.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.924+0000 7f4770fa69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:40.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f46257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:40.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f4770fa69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:40.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f4770fa69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:40.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f4770fa69c0 5 note: GC not initialized 2024-09-12T00:38:40.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f459ffff640 20 reqs_thread_entry: start 2024-09-12T00:38:40.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f4770fa69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:40.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f4770fa69c0 20 Filter name: none 2024-09-12T00:38:40.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f459dffb640 20 reqs_thread_entry: start 2024-09-12T00:38:40.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f4770fa69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:40.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.928+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.932+0000 7f4770fa69c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:38:40.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.932+0000 7f4770fa69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:40.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.932+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.932+0000 7f4770fa69c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:38:40.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.932+0000 7f4770fa69c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:40.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.932+0000 7f4770fa69c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:38:40.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.932+0000 7f4770fa69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:40.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.936+0000 7f46257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:40.937 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.940+0000 7f4770fa69c0 20 remove_watcher() i=0 2024-09-12T00:38:40.937 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.940+0000 7f4770fa69c0 2 removed watcher, disabling cache 2024-09-12T00:38:40.939 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.940+0000 7f4770fa69c0 20 remove_watcher() i=1 2024-09-12T00:38:40.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.944+0000 7f4770fa69c0 20 remove_watcher() i=2 2024-09-12T00:38:40.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.948+0000 7f4770fa69c0 20 remove_watcher() i=3 2024-09-12T00:38:40.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.948+0000 7f4770fa69c0 20 remove_watcher() i=4 2024-09-12T00:38:40.947 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.952+0000 7f4770fa69c0 20 remove_watcher() i=5 2024-09-12T00:38:40.949 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.952+0000 7f4770fa69c0 20 remove_watcher() i=6 2024-09-12T00:38:40.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:38:40.952+0000 7f4770fa69c0 20 remove_watcher() i=7 2024-09-12T00:38:40.964 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:38:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-commit-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:40.964 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:38:40.965 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:40.965 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:11.317 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:11.317 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:11.409 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:11.445 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:11.445 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:11.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.491+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:11.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 realm 2024-09-12T00:39:11.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:11.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:11.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:11.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:11.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:11.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.495+0000 7f6bda5019c0 20 searching for the correct realm 2024-09-12T00:39:11.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.499+0000 7f6bd8808640 0 -- 172.21.15.102:0/1246914796 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f6bc80e0040 msgr2=0x7f6bc80b8950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:11.712 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.715+0000 7f6bd7806640 0 -- 172.21.15.102:0/1246914796 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6bd0043ba0 msgr2=0x7f6bd0072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:11.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.931+0000 7f6bda5019c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:11.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.931+0000 7f6bda5019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:11.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.931+0000 7f6bda5019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:11.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.931+0000 7f6bda5019c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:11.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.931+0000 7f6bda5019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:11.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.931+0000 7f6bda5019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:11.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.931+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:11.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:11.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:11.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 zone default found 2024-09-12T00:39:11.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 4 Realm: () 2024-09-12T00:39:11.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:11.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:11.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:11.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 zonegroup default 2024-09-12T00:39:11.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:11.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:11.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.935+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.939+0000 7f6bda5019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:11.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.939+0000 7f6bda5019c0 20 started sync module instance, tier type = 2024-09-12T00:39:11.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.939+0000 7f6bda5019c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:11.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.959+0000 7f6bda5019c0 20 add_watcher() i=0 2024-09-12T00:39:11.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.959+0000 7f6bda5019c0 20 add_watcher() i=1 2024-09-12T00:39:11.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.959+0000 7f6bda5019c0 20 add_watcher() i=2 2024-09-12T00:39:11.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.959+0000 7f6bda5019c0 20 add_watcher() i=3 2024-09-12T00:39:11.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.959+0000 7f6bda5019c0 20 add_watcher() i=4 2024-09-12T00:39:11.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.959+0000 7f6bda5019c0 20 add_watcher() i=5 2024-09-12T00:39:11.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.959+0000 7f6bda5019c0 20 add_watcher() i=6 2024-09-12T00:39:11.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.963+0000 7f6bda5019c0 20 add_watcher() i=7 2024-09-12T00:39:11.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.963+0000 7f6bda5019c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:11.963 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.963+0000 7f6a8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:11.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:11.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:11.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 5 note: GC not initialized 2024-09-12T00:39:11.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6a8dfdb640 20 reqs_thread_entry: start 2024-09-12T00:39:11.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:11.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 20 Filter name: none 2024-09-12T00:39:11.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f69ff7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:11.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:39:11.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:39:11.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:39:11.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:39:11.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 : miss 2024-09-12T00:39:11.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.967+0000 7f6bda5019c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:11.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.971+0000 7f6bda5019c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:39:11.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.971+0000 7f6bda5019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:39:11.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.971+0000 7f6bda5019c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:39:11.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.971+0000 7f6bda5019c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:11.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.971+0000 7f6bda5019c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:11.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.971+0000 7f6bda5019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 2024-09-12T00:39:11.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.983+0000 7f6bda5019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:39:11.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.983+0000 7f6bda5019c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:39:11.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.983+0000 7f6bda5019c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:11.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.983+0000 7f6bda5019c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33, ofs0, ns] 2024-09-12T00:39:11.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.983+0000 7f6aaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398910 cookie 94743049135424 notifier 6911 bl.length()=1015 2024-09-12T00:39:11.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.983+0000 7f6aaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:39:11.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.983+0000 7f6aaf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:39:11.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.983+0000 7f6aaf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:11.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.987+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_sources= new_sources= 2024-09-12T00:39:11.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.987+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential sources added=[] removed=[] 2024-09-12T00:39:11.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.987+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_dests= new_dests= 2024-09-12T00:39:11.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.987+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential dests added=[] removed=[] 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.0 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.0 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.1 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.1 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.2 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.2 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.3 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.3 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.4 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.4 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.5 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.5 2024-09-12T00:39:11.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.6 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.6 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.7 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.7 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.8 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.8 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.9 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.9 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.10 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.10 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.11 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1.11 2024-09-12T00:39:11.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.0 2024-09-12T00:39:11.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1 2024-09-12T00:39:11.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:11.999+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.2 2024-09-12T00:39:12.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.003+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.3 2024-09-12T00:39:12.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.003+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.4 2024-09-12T00:39:12.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.003+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.5 2024-09-12T00:39:12.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.003+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.6 2024-09-12T00:39:12.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.007+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.7 2024-09-12T00:39:12.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.007+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.8 2024-09-12T00:39:12.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.007+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.9 2024-09-12T00:39:12.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.007+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.10 2024-09-12T00:39:12.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.015+0000 7f6bda5019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:12.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.015+0000 7f6bda5019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 2024-09-12T00:39:12.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.019+0000 7f6bda5019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:39:12.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.019+0000 7f6bda5019c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:39:12.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.019+0000 7f6bda5019c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:12.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.019+0000 7f6bda5019c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33, ofs0, ns] 2024-09-12T00:39:12.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.019+0000 7f6aaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398911 cookie 94743049135424 notifier 6911 bl.length()=1015 2024-09-12T00:39:12.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.019+0000 7f6aaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:39:12.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.019+0000 7f6aaf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:39:12.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.019+0000 7f6aaf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:12.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.023+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_sources= new_sources= 2024-09-12T00:39:12.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.023+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential sources added=[] removed=[] 2024-09-12T00:39:12.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.023+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_dests= new_dests= 2024-09-12T00:39:12.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.023+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential dests added=[] removed=[] 2024-09-12T00:39:12.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.027+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.0 2024-09-12T00:39:12.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.027+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.1 2024-09-12T00:39:12.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.027+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.2 2024-09-12T00:39:12.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.031+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.3 2024-09-12T00:39:12.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.031+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.4 2024-09-12T00:39:12.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.031+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.5 2024-09-12T00:39:12.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.031+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.6 2024-09-12T00:39:12.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.031+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.7 2024-09-12T00:39:12.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.035+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.8 2024-09-12T00:39:12.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.035+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.9 2024-09-12T00:39:12.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.035+0000 7f6bda5019c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33.10 2024-09-12T00:39:12.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.035+0000 7f6bda5019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:12.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.035+0000 7f6bda5019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 2024-09-12T00:39:12.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.039+0000 7f6bda5019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:39:12.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.039+0000 7f6bda5019c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:39:12.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.039+0000 7f6bda5019c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:12.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.039+0000 7f6bda5019c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33, ofs0, ns] 2024-09-12T00:39:12.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.039+0000 7f6aaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398912 cookie 94743049135424 notifier 6911 bl.length()=983 2024-09-12T00:39:12.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.039+0000 7f6aaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 info.flags=0x17 2024-09-12T00:39:12.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.039+0000 7f6aaf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 to cache LRU end 2024-09-12T00:39:12.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.039+0000 7f6aaf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:12.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.043+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_sources= new_sources= 2024-09-12T00:39:12.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.043+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential sources added=[] removed=[] 2024-09-12T00:39:12.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.043+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): orig_dests= new_dests= 2024-09-12T00:39:12.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.043+0000 7f6bda5019c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33]): potential dests added=[] removed=[] 2024-09-12T00:39:12.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.047+0000 7f6bda5019c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:39:12.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.055+0000 7f6a8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:12.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.059+0000 7f6bda5019c0 20 remove_watcher() i=0 2024-09-12T00:39:12.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.059+0000 7f6bda5019c0 2 removed watcher, disabling cache 2024-09-12T00:39:12.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.059+0000 7f6bda5019c0 20 remove_watcher() i=1 2024-09-12T00:39:12.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.063+0000 7f6bda5019c0 20 remove_watcher() i=2 2024-09-12T00:39:12.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.067+0000 7f6bda5019c0 20 remove_watcher() i=3 2024-09-12T00:39:12.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.067+0000 7f6bda5019c0 20 remove_watcher() i=4 2024-09-12T00:39:12.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.071+0000 7f6bda5019c0 20 remove_watcher() i=5 2024-09-12T00:39:12.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.071+0000 7f6bda5019c0 20 remove_watcher() i=6 2024-09-12T00:39:12.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.071+0000 7f6bda5019c0 20 remove_watcher() i=7 2024-09-12T00:39:12.087 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:39:12.118 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:12.119 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:12.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.167+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.167+0000 7f93ed6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:12.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.167+0000 7f93ed6ef9c0 20 realm 2024-09-12T00:39:12.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.167+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.167+0000 7f93ed6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:12.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.167+0000 7f93ed6ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:12.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.167+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.167+0000 7f93ed6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:12.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.167+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.171+0000 7f93ed6ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:12.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.171+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.171+0000 7f93ed6ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:12.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.171+0000 7f93ed6ef9c0 20 searching for the correct realm 2024-09-12T00:39:12.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.175+0000 7f93eb9f6640 0 -- 172.21.15.102:0/3384456759 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f93e0087020 msgr2=0x7f93e008e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:12.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.391+0000 7f93ea9f4640 0 -- 172.21.15.102:0/3384456759 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f93e4084750 msgr2=0x7f93e408a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:12.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.607+0000 7f93ed6ef9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:12.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.607+0000 7f93ed6ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:12.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.607+0000 7f93ed6ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:12.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.607+0000 7f93ed6ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:12.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.607+0000 7f93ed6ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:12.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.607+0000 7f93ed6ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:12.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.607+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.607+0000 7f93ed6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:12.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.607+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:12.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:12.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 zone default found 2024-09-12T00:39:12.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 4 Realm: () 2024-09-12T00:39:12.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:12.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:12.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:12.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 zonegroup default 2024-09-12T00:39:12.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:12.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:12.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:12.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 started sync module instance, tier type = 2024-09-12T00:39:12.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.611+0000 7f93ed6ef9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:12.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.639+0000 7f93ed6ef9c0 20 add_watcher() i=0 2024-09-12T00:39:12.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.639+0000 7f93ed6ef9c0 20 add_watcher() i=1 2024-09-12T00:39:12.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.639+0000 7f93ed6ef9c0 20 add_watcher() i=2 2024-09-12T00:39:12.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.639+0000 7f93ed6ef9c0 20 add_watcher() i=3 2024-09-12T00:39:12.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.639+0000 7f93ed6ef9c0 20 add_watcher() i=4 2024-09-12T00:39:12.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.639+0000 7f93ed6ef9c0 20 add_watcher() i=5 2024-09-12T00:39:12.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.639+0000 7f93ed6ef9c0 20 add_watcher() i=6 2024-09-12T00:39:12.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.639+0000 7f93ed6ef9c0 20 add_watcher() i=7 2024-09-12T00:39:12.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.639+0000 7f93ed6ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:12.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.643+0000 7f92a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:12.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.643+0000 7f93ed6ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:12.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.643+0000 7f93ed6ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:12.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.643+0000 7f93ed6ef9c0 5 note: GC not initialized 2024-09-12T00:39:12.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f92a0fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:12.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f93ed6ef9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:12.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f93ed6ef9c0 20 Filter name: none 2024-09-12T00:39:12.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f921a7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:12.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f93ed6ef9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:39:12.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f93ed6ef9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:39:12.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f93ed6ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:12.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f93ed6ef9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:39:12.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.647+0000 7f93ed6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:12.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.651+0000 7f93ed6ef9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:39:12.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.651+0000 7f93ed6ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:12.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.655+0000 7f92a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:12.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.659+0000 7f93ed6ef9c0 20 remove_watcher() i=0 2024-09-12T00:39:12.657 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.659+0000 7f93ed6ef9c0 2 removed watcher, disabling cache 2024-09-12T00:39:12.659 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.659+0000 7f93ed6ef9c0 20 remove_watcher() i=1 2024-09-12T00:39:12.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.663+0000 7f93ed6ef9c0 20 remove_watcher() i=2 2024-09-12T00:39:12.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.667+0000 7f93ed6ef9c0 20 remove_watcher() i=3 2024-09-12T00:39:12.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.667+0000 7f93ed6ef9c0 20 remove_watcher() i=4 2024-09-12T00:39:12.667 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.667+0000 7f93ed6ef9c0 20 remove_watcher() i=5 2024-09-12T00:39:12.668 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.671+0000 7f93ed6ef9c0 20 remove_watcher() i=6 2024-09-12T00:39:12.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:12.671+0000 7f93ed6ef9c0 20 remove_watcher() i=7 2024-09-12T00:39:12.689 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:12.689 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:39:12.689 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-commit-target-layout id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:39:12.689 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:12.691 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:12.691 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:12.712 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:12.712 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:13.330 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:13.330 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:13.710 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:39:13.711 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:13.714 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:13.714 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:13.847 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:13.847 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:13.935 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:13.936 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:14.041 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:14.041 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:14.140 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:14.140 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:14.247 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:14.248 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:14.343 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:14.344 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:14.445 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:14.445 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:14.543 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:14.544 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:14.642 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:14.642 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:14.804 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:14.804 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:14.902 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:14.902 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.002 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:15.002 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.101 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:15.101 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.207 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:15.207 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.305 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:15.305 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.406 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:15.406 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.505 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:15.505 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.585 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:15.585 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.684 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:15.684 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.777 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:15.777 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.875 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:15.876 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:15.959 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:39:15.993 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:15.993 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:16.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.043+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.043+0000 7f61598ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.043+0000 7f61598ae9c0 20 realm 2024-09-12T00:39:16.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.043+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.043+0000 7f61598ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.043+0000 7f61598ae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:16.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.043+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.047+0000 7f61598ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.047+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.047+0000 7f61598ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:16.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.047+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.047+0000 7f61598ae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:16.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.047+0000 7f61598ae9c0 20 searching for the correct realm 2024-09-12T00:39:16.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.051+0000 7f6157bb5640 0 -- 172.21.15.102:0/3165609317 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f614c0d0020 msgr2=0x7f614c12a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:16.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.059+0000 7f6156bb3640 0 -- 172.21.15.102:0/3165609317 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6150015070 msgr2=0x7f61500820d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:16.273 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:16.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:16.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:16.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:16.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:16.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:16.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:16.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.275+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:16.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 zone default found 2024-09-12T00:39:16.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 4 Realm: () 2024-09-12T00:39:16.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:16.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:16.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:16.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 zonegroup default 2024-09-12T00:39:16.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.278 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 started sync module instance, tier type = 2024-09-12T00:39:16.279 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.279+0000 7f61598ae9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:16.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.303+0000 7f61598ae9c0 20 add_watcher() i=0 2024-09-12T00:39:16.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.303+0000 7f61598ae9c0 20 add_watcher() i=1 2024-09-12T00:39:16.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.303+0000 7f61598ae9c0 20 add_watcher() i=2 2024-09-12T00:39:16.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.303+0000 7f61598ae9c0 20 add_watcher() i=3 2024-09-12T00:39:16.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.303+0000 7f61598ae9c0 20 add_watcher() i=4 2024-09-12T00:39:16.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.303+0000 7f61598ae9c0 20 add_watcher() i=5 2024-09-12T00:39:16.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.303+0000 7f61598ae9c0 20 add_watcher() i=6 2024-09-12T00:39:16.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.307+0000 7f61598ae9c0 20 add_watcher() i=7 2024-09-12T00:39:16.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.307+0000 7f61598ae9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:16.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.311+0000 7f600dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:16.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.311+0000 7f61598ae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:16.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.311+0000 7f61598ae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:16.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.311+0000 7f61598ae9c0 5 note: GC not initialized 2024-09-12T00:39:16.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.311+0000 7f600cfe1640 20 reqs_thread_entry: start 2024-09-12T00:39:16.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.311+0000 7f61598ae9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:16.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.311+0000 7f61598ae9c0 20 Filter name: none 2024-09-12T00:39:16.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.311+0000 7f5f867fc640 20 reqs_thread_entry: start 2024-09-12T00:39:16.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.311+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.315+0000 7f61598ae9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:16.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.315+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.315+0000 7f61598ae9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:16.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.315+0000 7f61598ae9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:16.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.315+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.315+0000 7f61598ae9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:16.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.315+0000 7f61598ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.315+0000 7f61598ae9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:16.314 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.315+0000 7f61598ae9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:16.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.319+0000 7f600dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:16.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.323+0000 7f61598ae9c0 20 remove_watcher() i=0 2024-09-12T00:39:16.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.323+0000 7f61598ae9c0 2 removed watcher, disabling cache 2024-09-12T00:39:16.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.327+0000 7f61598ae9c0 20 remove_watcher() i=1 2024-09-12T00:39:16.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.327+0000 7f61598ae9c0 20 remove_watcher() i=2 2024-09-12T00:39:16.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.331+0000 7f61598ae9c0 20 remove_watcher() i=3 2024-09-12T00:39:16.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.331+0000 7f61598ae9c0 20 remove_watcher() i=4 2024-09-12T00:39:16.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.335+0000 7f61598ae9c0 20 remove_watcher() i=5 2024-09-12T00:39:16.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.335+0000 7f61598ae9c0 20 remove_watcher() i=6 2024-09-12T00:39:16.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.339+0000 7f61598ae9c0 20 remove_watcher() i=7 2024-09-12T00:39:16.353 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:16.353 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:39:16.353 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-do-reshard id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:16.353 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:16.354 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:39:16.390 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:16.391 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:16.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.439+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.439+0000 7f98fe3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.439+0000 7f98fe3a39c0 20 realm 2024-09-12T00:39:16.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.439+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.443+0000 7f98fe3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.443+0000 7f98fe3a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:16.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.443+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.443+0000 7f98fe3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.443+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.443+0000 7f98fe3a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:16.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.443+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.447+0000 7f98fe3a39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:16.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.447+0000 7f98fe3a39c0 20 searching for the correct realm 2024-09-12T00:39:16.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.447+0000 7f98fc6aa640 0 -- 172.21.15.102:0/2210619624 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f98f0017070 msgr2=0x7f98f0066a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:16.661 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.663+0000 7f98fb6a8640 0 -- 172.21.15.102:0/2210619624 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f98f4115520 msgr2=0x7f98f412ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:16.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.879+0000 7f98fe3a39c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:16.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.879+0000 7f98fe3a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:16.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.879+0000 7f98fe3a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:16.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.879+0000 7f98fe3a39c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:16.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.879+0000 7f98fe3a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:16.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.879+0000 7f98fe3a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:16.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.879+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.879+0000 7f98fe3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.879+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:16.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:16.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 zone default found 2024-09-12T00:39:16.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 4 Realm: () 2024-09-12T00:39:16.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:16.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:16.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:16.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 zonegroup default 2024-09-12T00:39:16.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 started sync module instance, tier type = 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.883+0000 7f98fe3a39c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:16.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.907+0000 7f98fe3a39c0 20 add_watcher() i=0 2024-09-12T00:39:16.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.907+0000 7f98fe3a39c0 20 add_watcher() i=1 2024-09-12T00:39:16.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.907+0000 7f98fe3a39c0 20 add_watcher() i=2 2024-09-12T00:39:16.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.907+0000 7f98fe3a39c0 20 add_watcher() i=3 2024-09-12T00:39:16.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.907+0000 7f98fe3a39c0 20 add_watcher() i=4 2024-09-12T00:39:16.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.907+0000 7f98fe3a39c0 20 add_watcher() i=5 2024-09-12T00:39:16.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.907+0000 7f98fe3a39c0 20 add_watcher() i=6 2024-09-12T00:39:16.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.911+0000 7f98fe3a39c0 20 add_watcher() i=7 2024-09-12T00:39:16.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.911+0000 7f98fe3a39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.915+0000 7f97b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:16.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.915+0000 7f98fe3a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:16.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.915+0000 7f98fe3a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:16.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.915+0000 7f98fe3a39c0 5 note: GC not initialized 2024-09-12T00:39:16.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.915+0000 7f97b0fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:16.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.915+0000 7f98fe3a39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:16.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.915+0000 7f98fe3a39c0 20 Filter name: none 2024-09-12T00:39:16.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.915+0000 7f972a7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:16.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.915+0000 7f98fe3a39c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:39:16.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.915+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:16.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:39:16.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:39:16.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 : miss 2024-09-12T00:39:16.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:16.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:16.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:16.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:16.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:16.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.919+0000 7f98fe3a39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 2024-09-12T00:39:16.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.927+0000 7f98fe3a39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:16.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.927+0000 7f98fe3a39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:16.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.927+0000 7f98fe3a39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:16.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.927+0000 7f98fe3a39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34, ofs0, ns] 2024-09-12T00:39:16.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.927+0000 7f97da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398944 cookie 94112892938560 notifier 6965 bl.length()=995 2024-09-12T00:39:16.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.927+0000 7f97da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:16.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.927+0000 7f97da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:16.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.927+0000 7f97da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:16.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.931+0000 7f98fe3a39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): orig_sources= new_sources= 2024-09-12T00:39:16.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.931+0000 7f98fe3a39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): potential sources added=[] removed=[] 2024-09-12T00:39:16.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.931+0000 7f98fe3a39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): orig_dests= new_dests= 2024-09-12T00:39:16.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.931+0000 7f98fe3a39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): potential dests added=[] removed=[] 2024-09-12T00:39:16.939 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.943+0000 7f98fe3a39c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:39:16.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.955+0000 7f98fe3a39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:16.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.955+0000 7f98fe3a39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 2024-09-12T00:39:16.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.959+0000 7f98fe3a39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:16.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.959+0000 7f98fe3a39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:16.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.959+0000 7f98fe3a39c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:16.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.959+0000 7f98fe3a39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34, ofs0, ns] 2024-09-12T00:39:16.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.959+0000 7f97da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398945 cookie 94112892938560 notifier 6965 bl.length()=963 2024-09-12T00:39:16.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.959+0000 7f97da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:16.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.959+0000 7f97da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:16.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.959+0000 7f97da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:16.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.963+0000 7f98fe3a39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): orig_sources= new_sources= 2024-09-12T00:39:16.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.963+0000 7f98fe3a39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): potential sources added=[] removed=[] 2024-09-12T00:39:16.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.963+0000 7f98fe3a39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): orig_dests= new_dests= 2024-09-12T00:39:16.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.963+0000 7f98fe3a39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): potential dests added=[] removed=[] 2024-09-12T00:39:16.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.963+0000 7f98fe3a39c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:39:16.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.967+0000 7f97b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:16.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.971+0000 7f98fe3a39c0 20 remove_watcher() i=0 2024-09-12T00:39:16.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.971+0000 7f98fe3a39c0 2 removed watcher, disabling cache 2024-09-12T00:39:16.972 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.975+0000 7f98fe3a39c0 20 remove_watcher() i=1 2024-09-12T00:39:16.974 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.975+0000 7f98fe3a39c0 20 remove_watcher() i=2 2024-09-12T00:39:16.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.979+0000 7f98fe3a39c0 20 remove_watcher() i=3 2024-09-12T00:39:16.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.979+0000 7f98fe3a39c0 20 remove_watcher() i=4 2024-09-12T00:39:16.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.983+0000 7f98fe3a39c0 20 remove_watcher() i=5 2024-09-12T00:39:16.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.983+0000 7f98fe3a39c0 20 remove_watcher() i=6 2024-09-12T00:39:16.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:16.983+0000 7f98fe3a39c0 20 remove_watcher() i=7 2024-09-12T00:39:16.999 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:39:17.025 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:17.025 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:17.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.071+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.071+0000 7f922d6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.071+0000 7f922d6ef9c0 20 realm 2024-09-12T00:39:17.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.071+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.071+0000 7f922d6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.071+0000 7f922d6ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:17.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.071+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.071+0000 7f922d6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.071+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.075+0000 7f922d6ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:17.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.075+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.075+0000 7f922d6ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:17.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.075+0000 7f922d6ef9c0 20 searching for the correct realm 2024-09-12T00:39:17.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.079+0000 7f922b9f6640 0 -- 172.21.15.102:0/3983370902 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f9220003cd0 msgr2=0x7f922008c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:17.293 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.295+0000 7f922a9f4640 0 -- 172.21.15.102:0/3983370902 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f92240fd920 msgr2=0x7f92240e63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:17.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:17.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:17.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:17.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:17.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:17.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:17.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:17.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.511+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:17.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 zone default found 2024-09-12T00:39:17.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 4 Realm: () 2024-09-12T00:39:17.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:17.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:17.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:17.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 zonegroup default 2024-09-12T00:39:17.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 started sync module instance, tier type = 2024-09-12T00:39:17.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.515+0000 7f922d6ef9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.539+0000 7f922d6ef9c0 20 add_watcher() i=0 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.539+0000 7f922d6ef9c0 20 add_watcher() i=1 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.539+0000 7f922d6ef9c0 20 add_watcher() i=2 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.539+0000 7f922d6ef9c0 20 add_watcher() i=3 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.539+0000 7f922d6ef9c0 20 add_watcher() i=4 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.539+0000 7f922d6ef9c0 20 add_watcher() i=5 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.539+0000 7f922d6ef9c0 20 add_watcher() i=6 2024-09-12T00:39:17.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.543+0000 7f922d6ef9c0 20 add_watcher() i=7 2024-09-12T00:39:17.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.543+0000 7f922d6ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:17.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f90e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:17.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f922d6ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:17.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f922d6ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:17.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f922d6ef9c0 5 note: GC not initialized 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f90e0fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f922d6ef9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f922d6ef9c0 20 Filter name: none 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f905a7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f922d6ef9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.547+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.551+0000 7f922d6ef9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:17.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.551+0000 7f922d6ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:17.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.551+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.551+0000 7f922d6ef9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:17.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.551+0000 7f922d6ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.551+0000 7f922d6ef9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:17.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.551+0000 7f922d6ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:17.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.555+0000 7f90e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:17.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.559+0000 7f922d6ef9c0 20 remove_watcher() i=0 2024-09-12T00:39:17.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.559+0000 7f922d6ef9c0 2 removed watcher, disabling cache 2024-09-12T00:39:17.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.559+0000 7f922d6ef9c0 20 remove_watcher() i=1 2024-09-12T00:39:17.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.563+0000 7f922d6ef9c0 20 remove_watcher() i=2 2024-09-12T00:39:17.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.563+0000 7f922d6ef9c0 20 remove_watcher() i=3 2024-09-12T00:39:17.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.567+0000 7f922d6ef9c0 20 remove_watcher() i=4 2024-09-12T00:39:17.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.583+0000 7f922d6ef9c0 20 remove_watcher() i=5 2024-09-12T00:39:17.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.587+0000 7f922d6ef9c0 20 remove_watcher() i=6 2024-09-12T00:39:17.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.587+0000 7f922d6ef9c0 20 remove_watcher() i=7 2024-09-12T00:39:17.604 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:17.604 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:39:17.604 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-do-reshard id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:17.604 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:17.606 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:17.606 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:17.668 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:17.668 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:17.761 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:17.797 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:17.798 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:17.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.843+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.847+0000 7fef221259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.847+0000 7fef221259c0 20 realm 2024-09-12T00:39:17.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.847+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.847+0000 7fef221259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.847+0000 7fef221259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:17.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.847+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.847+0000 7fef221259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.847+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.847+0000 7fef221259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:17.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.847+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.851+0000 7fef221259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:17.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.851+0000 7fef221259c0 20 searching for the correct realm 2024-09-12T00:39:17.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:17.855+0000 7fef2042c640 0 -- 172.21.15.102:0/2194564565 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fef14040020 msgr2=0x7fef1406fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:18.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.071+0000 7fef1f42a640 0 -- 172.21.15.102:0/2194564565 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fef1001a410 msgr2=0x7fef1001a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:18.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.287+0000 7fef221259c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:18.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.287+0000 7fef221259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:18.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.287+0000 7fef221259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:18.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.287+0000 7fef221259c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:18.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.287+0000 7fef221259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:18.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.287+0000 7fef221259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:18.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.287+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.287+0000 7fef221259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.287+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:18.288 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:18.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 zone default found 2024-09-12T00:39:18.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 4 Realm: () 2024-09-12T00:39:18.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:18.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:18.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:18.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 zonegroup default 2024-09-12T00:39:18.289 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.290 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 started sync module instance, tier type = 2024-09-12T00:39:18.291 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.291+0000 7fef221259c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:18.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.319+0000 7fef221259c0 20 add_watcher() i=0 2024-09-12T00:39:18.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.319+0000 7fef221259c0 20 add_watcher() i=1 2024-09-12T00:39:18.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.319+0000 7fef221259c0 20 add_watcher() i=2 2024-09-12T00:39:18.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.319+0000 7fef221259c0 20 add_watcher() i=3 2024-09-12T00:39:18.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.319+0000 7fef221259c0 20 add_watcher() i=4 2024-09-12T00:39:18.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.319+0000 7fef221259c0 20 add_watcher() i=5 2024-09-12T00:39:18.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.323+0000 7fef221259c0 20 add_watcher() i=6 2024-09-12T00:39:18.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.323+0000 7fef221259c0 20 add_watcher() i=7 2024-09-12T00:39:18.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.323+0000 7fef221259c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:18.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.327+0000 7fedd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:18.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.327+0000 7fef221259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:18.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.327+0000 7fef221259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:18.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.327+0000 7fef221259c0 5 note: GC not initialized 2024-09-12T00:39:18.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.327+0000 7fedd4fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:18.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.327+0000 7fef221259c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:18.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.327+0000 7fef221259c0 20 Filter name: none 2024-09-12T00:39:18.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.327+0000 7fed4e7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:18.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.327+0000 7fef221259c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:39:18.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.327+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:18.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:39:18.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:39:18.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 : miss 2024-09-12T00:39:18.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:18.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:18.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:18.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:18.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:18.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.331+0000 7fef221259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 2024-09-12T00:39:18.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.339+0000 7fef221259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:18.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.339+0000 7fef221259c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:18.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.339+0000 7fef221259c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:18.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.339+0000 7fef221259c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34, ofs0, ns] 2024-09-12T00:39:18.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.343+0000 7fedfeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398946 cookie 94610184899296 notifier 7452 bl.length()=995 2024-09-12T00:39:18.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.343+0000 7fedfeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:18.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.343+0000 7fedfeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:18.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.343+0000 7fedfeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:18.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.343+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): orig_sources= new_sources= 2024-09-12T00:39:18.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.343+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): potential sources added=[] removed=[] 2024-09-12T00:39:18.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.343+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): orig_dests= new_dests= 2024-09-12T00:39:18.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.343+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): potential dests added=[] removed=[] 2024-09-12T00:39:18.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.0 2024-09-12T00:39:18.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.0 2024-09-12T00:39:18.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.1 2024-09-12T00:39:18.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.1 2024-09-12T00:39:18.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.2 2024-09-12T00:39:18.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.2 2024-09-12T00:39:18.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.3 2024-09-12T00:39:18.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.3 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.4 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.4 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.5 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.5 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.6 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.6 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.7 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.7 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.8 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.8 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.9 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.9 2024-09-12T00:39:18.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.10 2024-09-12T00:39:18.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.10 2024-09-12T00:39:18.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.11 2024-09-12T00:39:18.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1.11 2024-09-12T00:39:18.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.0 2024-09-12T00:39:18.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1 2024-09-12T00:39:18.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.2 2024-09-12T00:39:18.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.355+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.3 2024-09-12T00:39:18.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.359+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.4 2024-09-12T00:39:18.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.359+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.5 2024-09-12T00:39:18.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.363+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.6 2024-09-12T00:39:18.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.363+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.7 2024-09-12T00:39:18.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.363+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.8 2024-09-12T00:39:18.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.363+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.9 2024-09-12T00:39:18.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.363+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.10 2024-09-12T00:39:18.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.371+0000 7fef221259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:18.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.371+0000 7fef221259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 2024-09-12T00:39:18.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.371+0000 7fef221259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:18.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.371+0000 7fef221259c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:18.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.371+0000 7fef221259c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:18.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.371+0000 7fef221259c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34, ofs0, ns] 2024-09-12T00:39:18.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.375+0000 7fedfeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398947 cookie 94610184899296 notifier 7452 bl.length()=995 2024-09-12T00:39:18.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.375+0000 7fedfeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:18.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.375+0000 7fedfeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:18.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.375+0000 7fedfeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:18.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.375+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): orig_sources= new_sources= 2024-09-12T00:39:18.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.375+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): potential sources added=[] removed=[] 2024-09-12T00:39:18.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.375+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): orig_dests= new_dests= 2024-09-12T00:39:18.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.375+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): potential dests added=[] removed=[] 2024-09-12T00:39:18.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.379+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.0 2024-09-12T00:39:18.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.383+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.1 2024-09-12T00:39:18.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.383+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.2 2024-09-12T00:39:18.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.383+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.3 2024-09-12T00:39:18.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.383+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.4 2024-09-12T00:39:18.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.383+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.5 2024-09-12T00:39:18.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.383+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.6 2024-09-12T00:39:18.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.387+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.7 2024-09-12T00:39:18.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.387+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.8 2024-09-12T00:39:18.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.387+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.9 2024-09-12T00:39:18.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.387+0000 7fef221259c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34.10 2024-09-12T00:39:18.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.387+0000 7fef221259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:18.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.387+0000 7fef221259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 2024-09-12T00:39:18.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.391+0000 7fef221259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:18.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.391+0000 7fef221259c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:18.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.391+0000 7fef221259c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:18.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.391+0000 7fef221259c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34, ofs0, ns] 2024-09-12T00:39:18.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.391+0000 7fedfeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398948 cookie 94610184899296 notifier 7452 bl.length()=963 2024-09-12T00:39:18.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.391+0000 7fedfeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 info.flags=0x17 2024-09-12T00:39:18.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.391+0000 7fedfeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 to cache LRU end 2024-09-12T00:39:18.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.391+0000 7fedfeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:18.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.395+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): orig_sources= new_sources= 2024-09-12T00:39:18.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.395+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): potential sources added=[] removed=[] 2024-09-12T00:39:18.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.395+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): orig_dests= new_dests= 2024-09-12T00:39:18.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.395+0000 7fef221259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34]): potential dests added=[] removed=[] 2024-09-12T00:39:18.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.399+0000 7fef221259c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:39:18.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.403+0000 7fedd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:18.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.407+0000 7fef221259c0 20 remove_watcher() i=0 2024-09-12T00:39:18.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.407+0000 7fef221259c0 2 removed watcher, disabling cache 2024-09-12T00:39:18.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.407+0000 7fef221259c0 20 remove_watcher() i=1 2024-09-12T00:39:18.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.411+0000 7fef221259c0 20 remove_watcher() i=2 2024-09-12T00:39:18.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.415+0000 7fef221259c0 20 remove_watcher() i=3 2024-09-12T00:39:18.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.419+0000 7fef221259c0 20 remove_watcher() i=4 2024-09-12T00:39:18.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.419+0000 7fef221259c0 20 remove_watcher() i=5 2024-09-12T00:39:18.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.419+0000 7fef221259c0 20 remove_watcher() i=6 2024-09-12T00:39:18.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.423+0000 7fef221259c0 20 remove_watcher() i=7 2024-09-12T00:39:18.435 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:39:18.465 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:18.465 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:18.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.511+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.717 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.719+0000 7f08057699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.719+0000 7f08057699c0 20 realm 2024-09-12T00:39:18.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.719+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.719+0000 7f08057699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.719+0000 7f08057699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:18.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.719+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.719+0000 7f08057699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.719+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.723+0000 7f08057699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:18.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.723+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.723+0000 7f08057699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:18.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.723+0000 7f08057699c0 20 searching for the correct realm 2024-09-12T00:39:18.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.731+0000 7f0803a70640 0 -- 172.21.15.102:0/35333120 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x56228bb69360 msgr2=0x56228bb6b750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:18.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.739+0000 7f0802a6e640 0 -- 172.21.15.102:0/35333120 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f07fc017020 msgr2=0x7f07fc018920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:18.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.955+0000 7f08057699c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:18.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.955+0000 7f08057699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:18.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.955+0000 7f08057699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:18.955 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.955+0000 7f08057699c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:18.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.955+0000 7f08057699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:18.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.955+0000 7f08057699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:18.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.955+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:18.956 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:18.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 zone default found 2024-09-12T00:39:18.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 4 Realm: () 2024-09-12T00:39:18.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:18.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:18.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:18.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 zonegroup default 2024-09-12T00:39:18.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.959+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.963+0000 7f08057699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.963+0000 7f08057699c0 20 started sync module instance, tier type = 2024-09-12T00:39:18.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.963+0000 7f08057699c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:18.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.987+0000 7f08057699c0 20 add_watcher() i=0 2024-09-12T00:39:18.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.987+0000 7f08057699c0 20 add_watcher() i=1 2024-09-12T00:39:18.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.987+0000 7f08057699c0 20 add_watcher() i=2 2024-09-12T00:39:18.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.987+0000 7f08057699c0 20 add_watcher() i=3 2024-09-12T00:39:18.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.987+0000 7f08057699c0 20 add_watcher() i=4 2024-09-12T00:39:18.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.987+0000 7f08057699c0 20 add_watcher() i=5 2024-09-12T00:39:18.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.987+0000 7f08057699c0 20 add_watcher() i=6 2024-09-12T00:39:18.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.987+0000 7f08057699c0 20 add_watcher() i=7 2024-09-12T00:39:18.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.987+0000 7f08057699c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:18.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.991+0000 7f06b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:18.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.991+0000 7f08057699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:18.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.991+0000 7f08057699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:18.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.991+0000 7f08057699c0 5 note: GC not initialized 2024-09-12T00:39:18.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f06b8fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:18.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f08057699c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:18.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f08057699c0 20 Filter name: none 2024-09-12T00:39:18.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f06327fc640 20 reqs_thread_entry: start 2024-09-12T00:39:18.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f08057699c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:18.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f08057699c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:18.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f08057699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:18.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f08057699c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:18.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.995+0000 7f08057699c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.999+0000 7f08057699c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:18.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.999+0000 7f08057699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:18.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:18.999+0000 7f06b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:19.003+0000 7f08057699c0 20 remove_watcher() i=0 2024-09-12T00:39:19.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:19.003+0000 7f08057699c0 2 removed watcher, disabling cache 2024-09-12T00:39:19.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:19.011+0000 7f08057699c0 20 remove_watcher() i=1 2024-09-12T00:39:19.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:19.011+0000 7f08057699c0 20 remove_watcher() i=2 2024-09-12T00:39:19.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:19.019+0000 7f08057699c0 20 remove_watcher() i=3 2024-09-12T00:39:19.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:19.019+0000 7f08057699c0 20 remove_watcher() i=4 2024-09-12T00:39:19.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:19.019+0000 7f08057699c0 20 remove_watcher() i=5 2024-09-12T00:39:19.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:19.023+0000 7f08057699c0 20 remove_watcher() i=6 2024-09-12T00:39:19.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:19.023+0000 7f08057699c0 20 remove_watcher() i=7 2024-09-12T00:39:19.037 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:19.037 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:39:19.037 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-do-reshard id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:39:19.037 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:19.038 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.038 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:19.061 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.062 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:19.608 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.608 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:19.974 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:39:19.974 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:19.977 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.977 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:20.089 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:20.089 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:20.175 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:20.176 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:20.279 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:20.280 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:20.380 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:20.380 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:20.480 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:20.480 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:20.581 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:20.581 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:20.682 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:20.682 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:20.779 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:20.779 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:20.881 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:20.881 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:20.981 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:20.981 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:21.281 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.281 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:21.387 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.388 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:21.491 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.491 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:21.591 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.592 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:21.687 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.687 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:21.791 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.791 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:21.888 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.888 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:21.984 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.984 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:22.085 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:22.085 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:22.174 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:39:22.206 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:22.206 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:22.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.255+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.255+0000 7f921e4ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.255+0000 7f921e4ad9c0 20 realm 2024-09-12T00:39:22.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.255+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.255+0000 7f921e4ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.255+0000 7f921e4ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:22.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.255+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.255+0000 7f921e4ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.255+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.259+0000 7f921e4ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:22.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.259+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.259+0000 7f921e4ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:22.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.259+0000 7f921e4ad9c0 20 searching for the correct realm 2024-09-12T00:39:22.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.263+0000 7f921c7b4640 0 -- 172.21.15.102:0/1380855880 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f921005b390 msgr2=0x7f9210088a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:22.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.479+0000 7f921b7b2640 0 -- 172.21.15.102:0/1380855880 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f9214107590 msgr2=0x7f921411f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:22.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.695+0000 7f921e4ad9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:22.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.695+0000 7f921e4ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:22.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.695+0000 7f921e4ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:22.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.695+0000 7f921e4ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:22.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.695+0000 7f921e4ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:22.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.695+0000 7f921e4ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:22.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.695+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.695+0000 7f921e4ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.695+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:22.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:22.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 zone default found 2024-09-12T00:39:22.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 4 Realm: () 2024-09-12T00:39:22.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:22.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:22.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:22.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 zonegroup default 2024-09-12T00:39:22.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 started sync module instance, tier type = 2024-09-12T00:39:22.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.699+0000 7f921e4ad9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:22.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.727+0000 7f921e4ad9c0 20 add_watcher() i=0 2024-09-12T00:39:22.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.727+0000 7f921e4ad9c0 20 add_watcher() i=1 2024-09-12T00:39:22.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.727+0000 7f921e4ad9c0 20 add_watcher() i=2 2024-09-12T00:39:22.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.727+0000 7f921e4ad9c0 20 add_watcher() i=3 2024-09-12T00:39:22.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.727+0000 7f921e4ad9c0 20 add_watcher() i=4 2024-09-12T00:39:22.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.727+0000 7f921e4ad9c0 20 add_watcher() i=5 2024-09-12T00:39:22.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.727+0000 7f921e4ad9c0 20 add_watcher() i=6 2024-09-12T00:39:22.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.727+0000 7f921e4ad9c0 20 add_watcher() i=7 2024-09-12T00:39:22.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.727+0000 7f921e4ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:22.732 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.735+0000 7f90d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:22.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.735+0000 7f921e4ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:22.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.735+0000 7f921e4ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:22.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.735+0000 7f921e4ad9c0 5 note: GC not initialized 2024-09-12T00:39:22.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.735+0000 7f90d0fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:22.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.735+0000 7f921e4ad9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:22.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.735+0000 7f921e4ad9c0 20 Filter name: none 2024-09-12T00:39:22.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.735+0000 7f904a7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:22.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.735+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.739+0000 7f921e4ad9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:22.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.739+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.739+0000 7f921e4ad9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:22.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.739+0000 7f921e4ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:22.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.739+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.739+0000 7f921e4ad9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:22.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.739+0000 7f921e4ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.739+0000 7f921e4ad9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:22.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.739+0000 7f921e4ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:22.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.743+0000 7f90d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:22.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.747+0000 7f921e4ad9c0 20 remove_watcher() i=0 2024-09-12T00:39:22.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.747+0000 7f921e4ad9c0 2 removed watcher, disabling cache 2024-09-12T00:39:22.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.751+0000 7f921e4ad9c0 20 remove_watcher() i=1 2024-09-12T00:39:22.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.751+0000 7f921e4ad9c0 20 remove_watcher() i=2 2024-09-12T00:39:22.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.755+0000 7f921e4ad9c0 20 remove_watcher() i=3 2024-09-12T00:39:22.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.755+0000 7f921e4ad9c0 20 remove_watcher() i=4 2024-09-12T00:39:22.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.759+0000 7f921e4ad9c0 20 remove_watcher() i=5 2024-09-12T00:39:22.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.759+0000 7f921e4ad9c0 20 remove_watcher() i=6 2024-09-12T00:39:22.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.759+0000 7f921e4ad9c0 20 remove_watcher() i=7 2024-09-12T00:39:22.773 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:22.773 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:39:22.773 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-do-reshard id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:22.773 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:22.774 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:39:22.806 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:22.806 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:22.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 realm 2024-09-12T00:39:22.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.851+0000 7fb8836d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:22.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:22.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:22.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 searching for the correct realm 2024-09-12T00:39:22.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.859+0000 7fb8819dc640 0 -- 172.21.15.102:0/768836982 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fb878019070 msgr2=0x7fb878087540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:22.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:22.867+0000 7fb8809da640 0 -- 172.21.15.102:0/768836982 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fb87c100dd0 msgr2=0x7fb87c108620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:23.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:23.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:23.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:23.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:23.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:23.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:23.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:23.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 zone default found 2024-09-12T00:39:23.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 4 Realm: () 2024-09-12T00:39:23.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:23.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:23.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:23.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 zonegroup default 2024-09-12T00:39:23.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 started sync module instance, tier type = 2024-09-12T00:39:23.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:23.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=0 2024-09-12T00:39:23.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=1 2024-09-12T00:39:23.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=2 2024-09-12T00:39:23.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=3 2024-09-12T00:39:23.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=4 2024-09-12T00:39:23.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=5 2024-09-12T00:39:23.112 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.115+0000 7fb8836d59c0 20 add_watcher() i=6 2024-09-12T00:39:23.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.115+0000 7fb8836d59c0 20 add_watcher() i=7 2024-09-12T00:39:23.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.115+0000 7fb8836d59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:23.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.119+0000 7fb737fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.119+0000 7fb8836d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:23.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.119+0000 7fb8836d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:23.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 note: GC not initialized 2024-09-12T00:39:23.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb736fe5640 20 reqs_thread_entry: start 2024-09-12T00:39:23.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:23.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 Filter name: none 2024-09-12T00:39:23.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb734fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:23.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:39:23.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:23.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:39:23.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:39:23.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 : miss 2024-09-12T00:39:23.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:23.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:23.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:23.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:23.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:23.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 2024-09-12T00:39:23.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:23.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:23.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:23.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35, ofs0, ns] 2024-09-12T00:39:23.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398917 cookie 94694530346784 notifier 7049 bl.length()=995 2024-09-12T00:39:23.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:23.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:23.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:23.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_sources= new_sources= 2024-09-12T00:39:23.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential sources added=[] removed=[] 2024-09-12T00:39:23.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_dests= new_dests= 2024-09-12T00:39:23.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential dests added=[] removed=[] 2024-09-12T00:39:23.146 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb8836d59c0 time 2024-09-12T00:39:23.152650+0000 2024-09-12T00:39:23.146 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:23.147 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:23.147 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb886faf2eb] 2024-09-12T00:39:23.147 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb886faf49f] 2024-09-12T00:39:23.147 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561fc7c40cc1] 2024-09-12T00:39:23.147 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561fc7c55d5a] 2024-09-12T00:39:23.147 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:39:23.147 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb885e15d90] 2024-09-12T00:39:23.147 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:39:23.147 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.147+0000 7fb8836d59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb8836d59c0 time 2024-09-12T00:39:23.152650+0000 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb886faf2eb] 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb886faf49f] 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561fc7c40cc1] 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561fc7c55d5a] 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb885e15d90] 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.148 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:39:23.149 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fb8836d59c0 thread_name:radosgw-admin 2024-09-12T00:39:23.157 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:23.157 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb885e2e520] 2024-09-12T00:39:23.157 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:39:23.157 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb886faf345] 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb886faf49f] 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561fc7c40cc1] 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561fc7c55d5a] 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb885e15d90] 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.151+0000 7fb8836d59c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fb8836d59c0 thread_name:radosgw-admin 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.158 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb885e2e520] 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb886faf345] 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb886faf49f] 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561fc7c40cc1] 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561fc7c55d5a] 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb885e15d90] 2024-09-12T00:39:23.159 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:39:23.160 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:39:23.160 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:23.160 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.160 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:39:23.160 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:39:22.827+0000 7fb8809da640 10 monclient: _finish_hunting 0 2024-09-12T00:39:23.160 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:39:22.827+0000 7fb8809da640 1 monclient: found mon.noname-a 2024-09-12T00:39:23.160 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:39:22.827+0000 7fb8809da640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.160 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.160 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:23.160 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: dump: 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: _finish_auth 0 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: _check_auth_tickets 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:23.161 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:39:22.827+0000 7fb8836d59c0 5 monclient: authenticate success, global_id 7491 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:39:22.827+0000 7fb8836d59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:39:22.827+0000 7fb8836d59c0 4 set_mon_vals no callback set 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: dump: 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.162 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: shutdown 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) unregister_commands rotate-key 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: build_initial_monmap 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: monmap: 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:39:23.163 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding auth protocol: cephx 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding auth protocol: cephx 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding auth protocol: cephx 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.164 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 librados: starting msgr at 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 librados: starting objecter 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command objecter_requests hook 0x561fc9aad950 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 librados: setting wanted keys 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 librados: calling monclient init 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: init 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding auth protocol: cephx 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding auth protocol: cephx 2024-09-12T00:39:23.165 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding auth protocol: cephx 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.166 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command rotate-key hook 0x561fc9c8d738 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-b con 0x561fc9b3d2b0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-a con 0x561fc9b48ba0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-c con 0x561fc9bd5090 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): authenticate will time out at 2751.333704s 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): get_auth_request con 0x561fc9b48ba0 auth_method 0 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.167 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): get_auth_request con 0x561fc9bd5090 auth_method 0 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): handle_auth_done global_id 7494 payload 824 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient: _finish_hunting 0 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:39:22.831+0000 7fb8809da640 1 monclient: found mon.noname-a 2024-09-12T00:39:23.168 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: dump: 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.169 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: _finish_auth 0 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: _check_auth_tickets 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: dump: 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.170 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:39:22.831+0000 7fb76f606640 4 set_mon_vals no callback set 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 monclient: authenticate success, global_id 7494 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 librados: init done 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:39:22.835+0000 7fb76de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:39:22.835+0000 7fb76de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:39:22.835+0000 7fb76de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:39:22.835+0000 7fb8811db640 10 monclient: get_auth_request con 0x7fb768070ae0 auth_method 0 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:39:22.835+0000 7fb8819dc640 10 monclient: get_auth_request con 0x561fc9ccb420 auth_method 0 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:39:22.835+0000 7fb8811db640 10 monclient: get_auth_request con 0x561fc9cd7e40 auth_method 0 2024-09-12T00:39:23.171 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:39:22.835+0000 7fb8809da640 10 monclient: get_auth_request con 0x561fc9cdc1e0 auth_method 0 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:39:22.839+0000 7fb8819dc640 10 monclient: get_auth_request con 0x561fc9ce06e0 auth_method 0 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient: build_initial_monmap 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient: monmap: 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:39:23.172 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding auth protocol: cephx 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding auth protocol: cephx 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding auth protocol: cephx 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.173 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command objecter_requests cmddesc objecter_requests hook 0x561fc9ce7e60 EEXIST 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient: init 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding auth protocol: cephx 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding auth protocol: cephx 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding auth protocol: cephx 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.174 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command rotate-key cmddesc rotate-key hook 0x561fc9ce3570 EEXIST 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:39:23.175 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-a con 0x561fc9d0c010 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-b con 0x561fc9d0b940 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-c con 0x561fc9d0a320 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): authenticate will time out at 2751.343561s 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): get_auth_request con 0x561fc9d0c010 auth_method 0 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): get_auth_request con 0x561fc9d0a320 auth_method 0 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.176 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:39:22.839+0000 7fb8819dc640 10 monclient(hunting): get_auth_request con 0x561fc9d0b940 auth_method 0 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:39:22.839+0000 7fb8819dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:39:22.839+0000 7fb8819dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:39:22.839+0000 7fb8819dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): handle_auth_done global_id 7497 payload 824 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient: _finish_hunting 0 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:39:22.843+0000 7fb8809da640 1 monclient: found mon.noname-a 2024-09-12T00:39:23.177 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: dump: 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.178 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: _finish_auth 0 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 monclient: authenticate success, global_id 7497 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: dump: 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.179 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:39:22.843+0000 7fb8821dd640 4 set_mon_vals no callback set 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:39:22.843+0000 7fb766ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:39:22.843+0000 7fb766ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:39:22.843+0000 7fb766ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: build_initial_monmap 2024-09-12T00:39:23.180 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: monmap: 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding auth protocol: cephx 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding auth protocol: cephx 2024-09-12T00:39:23.181 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding auth protocol: cephx 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient: get_auth_request con 0x7fb75c070a20 auth_method 0 2024-09-12T00:39:23.182 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: init 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding auth protocol: cephx 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding auth protocol: cephx 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding auth protocol: cephx 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.183 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command rotate-key cmddesc rotate-key hook 0x7ffff1a78568 EEXIST 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-c con 0x561fc9d2f580 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-a con 0x561fc9d59dc0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-b con 0x561fc9d5adf0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:23.184 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): authenticate will time out at 2751.347587s 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): get_auth_request con 0x561fc9d2f580 auth_method 0 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): get_auth_request con 0x561fc9d59dc0 auth_method 0 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.185 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): handle_auth_done global_id 7046 payload 274 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient: _finish_hunting 0 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:39:22.843+0000 7fb8809da640 1 monclient: found mon.noname-c 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:39:22.843+0000 7fb8811db640 10 monclient: get_auth_request con 0x561fc9d5adf0 auth_method 0 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: dump: 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.186 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: _finish_auth 0 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: dump: 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.187 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 monclient: authenticate success, global_id 7046 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 4 set_mon_vals no callback set 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: shutdown 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: build_initial_monmap 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: monmap: 2024-09-12T00:39:23.188 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:39:23.189 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:23.189 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:39:23.189 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:39:23.189 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:23.189 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.189 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding auth protocol: cephx 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding auth protocol: cephx 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding auth protocol: cephx 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.190 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 librados: starting msgr at 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 librados: starting objecter 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command objecter_requests cmddesc objecter_requests hook 0x561fc9d2e840 EEXIST 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 librados: setting wanted keys 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 librados: calling monclient init 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: init 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding auth protocol: cephx 2024-09-12T00:39:23.191 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding auth protocol: cephx 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding auth protocol: cephx 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.192 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command rotate-key cmddesc rotate-key hook 0x561fc9d0df78 EEXIST 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-b con 0x561fc9d2f580 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-c con 0x561fc9d59dc0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-a con 0x561fc9d5adf0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:23.193 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): authenticate will time out at 2751.350082s 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): get_auth_request con 0x561fc9d59dc0 auth_method 0 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): get_auth_request con 0x561fc9d5adf0 auth_method 0 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.194 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): handle_auth_done global_id 7049 payload 824 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient: _finish_hunting 0 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:39:22.847+0000 7fb8819dc640 1 monclient: found mon.noname-c 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:39:22.847+0000 7fb8809da640 10 monclient: get_auth_request con 0x561fc9d2f580 auth_method 0 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: dump: 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.195 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: _finish_auth 0 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: dump: 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.196 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:39:22.847+0000 7fb764ff9640 4 set_mon_vals no callback set 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 monclient: authenticate success, global_id 7049 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:39:23.197 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 librados: init done 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command cr dump hook 0x561fc9d4fa08 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:39:22.851+0000 7fb752ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:39:22.851+0000 7fb752ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:39:22.851+0000 7fb752ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:39:22.851+0000 7fb8809da640 10 monclient: get_auth_request con 0x7fb74c070b10 auth_method 0 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:39:22.851+0000 7fb8811db640 10 monclient: get_auth_request con 0x561fc9d795a0 auth_method 0 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 realm 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:23.198 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:39:22.851+0000 7fb8809da640 10 monclient: get_auth_request con 0x561fc9d7d980 auth_method 0 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:39:22.855+0000 7fb8819dc640 10 monclient: get_auth_request con 0x561fc9d810a0 auth_method 0 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 searching for the correct realm 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:39:22.855+0000 7fb8811db640 10 monclient: get_auth_request con 0x561fc9d85e20 auth_method 0 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:39:22.855+0000 7fb8809da640 10 monclient: get_auth_request con 0x7fb87c0e3060 auth_method 0 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:39:22.859+0000 7fb8819dc640 10 monclient: get_auth_request con 0x7fb878019070 auth_method 0 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:39:22.859+0000 7fb8819dc640 0 -- 172.21.15.102:0/768836982 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fb878019070 msgr2=0x7fb878087540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:39:22.859+0000 7fb752ffd640 1 client.7049.objecter ms_handle_reset 0x7fb878019070 session 0x7fb87801e070 osd.4 2024-09-12T00:39:23.199 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:39:22.859+0000 7fb752ffd640 10 monclient: _renew_subs 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:39:22.859+0000 7fb752ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:39:22.859+0000 7fb8819dc640 10 monclient: get_auth_request con 0x7fb74c0811b0 auth_method 0 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:39:22.863+0000 7fb8811db640 10 monclient: get_auth_request con 0x7fb87c136330 auth_method 0 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:39:22.867+0000 7fb8809da640 10 monclient: get_auth_request con 0x7fb87c100dd0 auth_method 0 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:39:22.867+0000 7fb8809da640 0 -- 172.21.15.102:0/768836982 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fb87c100dd0 msgr2=0x7fb87c108620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:39:23.071+0000 7fb8809da640 10 monclient: get_auth_request con 0x7fb87c100dd0 auth_method 0 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:39:23.079+0000 7fb752ffd640 1 client.7049.objecter ms_handle_reset 0x561fc9d7d980 session 0x561fc9d7c820 osd.5 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:39:23.079+0000 7fb8809da640 10 monclient: get_auth_request con 0x7fb878019070 auth_method 0 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:23.200 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 zone default found 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 4 Realm: () 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:23.201 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 zonegroup default 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 started sync module instance, tier type = 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=0 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=1 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=2 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=3 2024-09-12T00:39:23.202 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=4 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=5 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:39:23.115+0000 7fb8836d59c0 20 add_watcher() i=6 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:39:23.115+0000 7fb8836d59c0 20 add_watcher() i=7 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:39:23.115+0000 7fb8836d59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding auth protocol: cephx 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding auth protocol: cephx 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding auth protocol: cephx 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.203 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:39:23.119+0000 7fb737fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command cache list hook 0x561fc9d540b0 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command cache inspect hook 0x561fc9d540b0 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command cache erase hook 0x561fc9d540b0 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command cache zap hook 0x561fc9d540b0 2024-09-12T00:39:23.204 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 note: GC not initialized 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:39:23.123+0000 7fb736fe5640 20 reqs_thread_entry: start 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command sync trace show hook 0x7fb87c0aa540 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command sync trace history hook 0x7fb87c0aa540 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command sync trace active hook 0x7fb87c0aa540 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command sync trace active_short hook 0x7fb87c0aa540 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 Filter name: none 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:39:23.123+0000 7fb734fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:39:23.205 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 : miss 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35, ofs0, ns] 2024-09-12T00:39:23.206 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398917 cookie 94694530346784 notifier 7049 bl.length()=995 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_sources= new_sources= 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential sources added=[] removed=[] 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_dests= new_dests= 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential dests added=[] removed=[] 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:39:23.147+0000 7fb8836d59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb8836d59c0 time 2024-09-12T00:39:23.152650+0000 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb886faf2eb] 2024-09-12T00:39:23.207 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb886faf49f] 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561fc7c40cc1] 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561fc7c55d5a] 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb885e15d90] 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:39:23.151+0000 7fb8836d59c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fb8836d59c0 thread_name:radosgw-admin 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb885e2e520] 2024-09-12T00:39:23.208 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb886faf345] 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb886faf49f] 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561fc7c40cc1] 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561fc7c55d5a] 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb885e15d90] 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.209 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:39:23.210 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:39:23.211 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:39:23.212 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:39:23.213 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:23.214 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:39:23.215 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb734fe1640 / http_manager 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb736fe5640 / http_manager 2024-09-12T00:39:23.216 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb737fe7640 / rgw_dt_lg_renew 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb752ffd640 / ms_dispatch 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb753fff640 / io_context_pool 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb764ff9640 / io_context_pool 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb766ffd640 / ms_dispatch 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb76de03640 / ms_dispatch 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb76f606640 / io_context_pool 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb8809da640 / msgr-worker-2 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb8811db640 / msgr-worker-1 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb8819dc640 / msgr-worker-0 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb8821dd640 / io_context_pool 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb8836d59c0 / radosgw-admin 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:39:23.217 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.121821.log 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:39:22.827+0000 7fb8809da640 10 monclient: _finish_hunting 0 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:39:22.827+0000 7fb8809da640 1 monclient: found mon.noname-a 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:39:22.827+0000 7fb8809da640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: dump: 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.218 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: _finish_auth 0 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: _check_auth_tickets 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:39:22.827+0000 7fb8836d59c0 5 monclient: authenticate success, global_id 7491 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:39:22.827+0000 7fb8836d59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:39:22.827+0000 7fb8836d59c0 4 set_mon_vals no callback set 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:39:22.827+0000 7fb76f606640 10 monclient: dump: 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.219 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: shutdown 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) unregister_commands rotate-key 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: build_initial_monmap 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: monmap: 2024-09-12T00:39:23.220 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding auth protocol: cephx 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding auth protocol: cephx 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding auth protocol: cephx 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.221 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.222 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.222 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.222 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.222 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.222 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.222 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.222 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.222 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.223 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: crc 2024-09-12T00:39:23.223 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c928f0) adding con mode: secure 2024-09-12T00:39:23.223 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.223 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 librados: starting msgr at 2024-09-12T00:39:23.223 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 librados: starting objecter 2024-09-12T00:39:23.223 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command objecter_requests hook 0x561fc9aad950 2024-09-12T00:39:23.223 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 librados: setting wanted keys 2024-09-12T00:39:23.223 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 librados: calling monclient init 2024-09-12T00:39:23.223 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: init 2024-09-12T00:39:23.223 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding auth protocol: cephx 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding auth protocol: cephx 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding auth protocol: cephx 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: crc 2024-09-12T00:39:23.224 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9c8d5f0) adding con mode: secure 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command rotate-key hook 0x561fc9c8d738 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-b con 0x561fc9b3d2b0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-a con 0x561fc9b48ba0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-c con 0x561fc9bd5090 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:23.225 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient(hunting): authenticate will time out at 2751.333704s 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): get_auth_request con 0x561fc9b48ba0 auth_method 0 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): get_auth_request con 0x561fc9bd5090 auth_method 0 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.226 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.227 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.227 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.227 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:39:22.831+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.227 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient(hunting): handle_auth_done global_id 7494 payload 824 2024-09-12T00:39:23.227 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient: _finish_hunting 0 2024-09-12T00:39:23.227 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:39:22.831+0000 7fb8809da640 1 monclient: found mon.noname-a 2024-09-12T00:39:23.227 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:39:22.831+0000 7fb8809da640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.227 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.227 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:23.227 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: dump: 2024-09-12T00:39:23.228 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.228 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.228 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.228 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.228 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.228 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.228 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.228 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.228 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: _finish_auth 0 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: _check_auth_tickets 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:39:22.831+0000 7fb76de03640 10 monclient: dump: 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.229 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.230 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.230 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.230 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.230 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.230 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:39:22.831+0000 7fb76f606640 4 set_mon_vals no callback set 2024-09-12T00:39:23.230 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 5 monclient: authenticate success, global_id 7494 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:39:22.831+0000 7fb8836d59c0 1 librados: init done 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:39:22.835+0000 7fb76de03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:39:22.835+0000 7fb76de03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:39:22.835+0000 7fb76de03640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:39:22.835+0000 7fb8811db640 10 monclient: get_auth_request con 0x7fb768070ae0 auth_method 0 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:39:22.835+0000 7fb8819dc640 10 monclient: get_auth_request con 0x561fc9ccb420 auth_method 0 2024-09-12T00:39:23.231 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:39:22.835+0000 7fb8811db640 10 monclient: get_auth_request con 0x561fc9cd7e40 auth_method 0 2024-09-12T00:39:23.232 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:39:22.835+0000 7fb8809da640 10 monclient: get_auth_request con 0x561fc9cdc1e0 auth_method 0 2024-09-12T00:39:23.232 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:39:22.839+0000 7fb8819dc640 10 monclient: get_auth_request con 0x561fc9ce06e0 auth_method 0 2024-09-12T00:39:23.232 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient: build_initial_monmap 2024-09-12T00:39:23.232 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:23.232 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient: monmap: 2024-09-12T00:39:23.232 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding auth protocol: cephx 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding auth protocol: cephx 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding auth protocol: cephx 2024-09-12T00:39:23.233 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.234 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.234 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.234 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.234 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.234 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.234 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.234 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.234 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.234 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.234 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: crc 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce4530) adding con mode: secure 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command objecter_requests cmddesc objecter_requests hook 0x561fc9ce7e60 EEXIST 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient: init 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding auth protocol: cephx 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding auth protocol: cephx 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding auth protocol: cephx 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.235 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: crc 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9ce3428) adding con mode: secure 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command rotate-key cmddesc rotate-key hook 0x561fc9ce3570 EEXIST 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-a con 0x561fc9d0c010 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:39:23.236 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-b con 0x561fc9d0b940 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-c con 0x561fc9d0a320 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:39:22.839+0000 7fb8836d59c0 10 monclient(hunting): authenticate will time out at 2751.343561s 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): get_auth_request con 0x561fc9d0c010 auth_method 0 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): get_auth_request con 0x561fc9d0a320 auth_method 0 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.237 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:39:22.839+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:39:22.839+0000 7fb8819dc640 10 monclient(hunting): get_auth_request con 0x561fc9d0b940 auth_method 0 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:39:22.839+0000 7fb8819dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:39:22.839+0000 7fb8819dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:39:22.839+0000 7fb8819dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:39:22.839+0000 7fb8809da640 10 monclient(hunting): handle_auth_done global_id 7497 payload 824 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient: _finish_hunting 0 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:39:22.843+0000 7fb8809da640 1 monclient: found mon.noname-a 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.238 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.239 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:23.239 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: dump: 2024-09-12T00:39:23.239 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.239 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.239 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.239 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.239 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.239 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.239 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.239 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: _finish_auth 0 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 monclient: authenticate success, global_id 7497 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:39:22.843+0000 7fb766ffd640 10 monclient: dump: 2024-09-12T00:39:23.240 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:39:22.843+0000 7fb8821dd640 4 set_mon_vals no callback set 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:39:22.843+0000 7fb766ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:23.241 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:39:22.843+0000 7fb766ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:39:22.843+0000 7fb766ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: build_initial_monmap 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: monmap: 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:39:23.242 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:39:23.243 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.243 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding auth protocol: cephx 2024-09-12T00:39:23.243 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding auth protocol: cephx 2024-09-12T00:39:23.243 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding auth protocol: cephx 2024-09-12T00:39:23.243 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.243 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.243 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.243 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.243 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.243 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.244 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.244 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.244 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.244 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.244 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: crc 2024-09-12T00:39:23.244 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d2b4d0) adding con mode: secure 2024-09-12T00:39:23.245 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient: get_auth_request con 0x7fb75c070a20 auth_method 0 2024-09-12T00:39:23.245 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.245 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: init 2024-09-12T00:39:23.245 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding auth protocol: cephx 2024-09-12T00:39:23.245 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding auth protocol: cephx 2024-09-12T00:39:23.245 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding auth protocol: cephx 2024-09-12T00:39:23.245 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.245 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.245 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.246 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.246 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.246 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.246 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.246 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.246 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.246 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.246 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: crc 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78420) adding con mode: secure 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command rotate-key cmddesc rotate-key hook 0x7ffff1a78568 EEXIST 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-c con 0x561fc9d2f580 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-a con 0x561fc9d59dc0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-b con 0x561fc9d5adf0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:23.247 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:39:22.843+0000 7fb8836d59c0 10 monclient(hunting): authenticate will time out at 2751.347587s 2024-09-12T00:39:23.248 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): get_auth_request con 0x561fc9d2f580 auth_method 0 2024-09-12T00:39:23.248 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.248 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.248 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.248 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): get_auth_request con 0x561fc9d59dc0 auth_method 0 2024-09-12T00:39:23.248 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.248 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.248 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.248 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:39:22.843+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient(hunting): handle_auth_done global_id 7046 payload 274 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient: _finish_hunting 0 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:39:22.843+0000 7fb8809da640 1 monclient: found mon.noname-c 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:39:22.843+0000 7fb8809da640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:39:22.843+0000 7fb8811db640 10 monclient: get_auth_request con 0x561fc9d5adf0 auth_method 0 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:23.249 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: dump: 2024-09-12T00:39:23.250 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.250 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.250 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.250 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.250 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.250 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.250 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.250 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.250 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: _finish_auth 0 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:39:22.847+0000 7fb764ff9640 10 monclient: dump: 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.251 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 monclient: authenticate success, global_id 7046 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 4 set_mon_vals no callback set 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: shutdown 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: build_initial_monmap 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: monmap: 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:23.252 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding auth protocol: cephx 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding auth protocol: cephx 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding auth protocol: cephx 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.253 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.254 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.254 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.256 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.256 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.256 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.256 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.256 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.257 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.257 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: crc 2024-09-12T00:39:23.258 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d304d0) adding con mode: secure 2024-09-12T00:39:23.258 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.258 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 librados: starting msgr at 2024-09-12T00:39:23.258 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 librados: starting objecter 2024-09-12T00:39:23.258 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command objecter_requests cmddesc objecter_requests hook 0x561fc9d2e840 EEXIST 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 librados: setting wanted keys 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 librados: calling monclient init 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: init 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding auth protocol: cephx 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding auth protocol: cephx 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding auth protocol: cephx 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.259 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: crc 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 AuthRegistry(0x561fc9d0de30) adding con mode: secure 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command rotate-key cmddesc rotate-key hook 0x561fc9d0df78 EEXIST 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:39:23.260 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-b con 0x561fc9d2f580 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-c con 0x561fc9d59dc0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): picked mon.noname-a con 0x561fc9d5adf0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient(hunting): authenticate will time out at 2751.350082s 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): get_auth_request con 0x561fc9d59dc0 auth_method 0 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): get_auth_request con 0x561fc9d5adf0 auth_method 0 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:23.261 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:23.262 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:23.262 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.262 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.262 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.262 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:39:22.847+0000 7fb8811db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient(hunting): handle_auth_done global_id 7049 payload 824 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient: _finish_hunting 0 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:39:22.847+0000 7fb8819dc640 1 monclient: found mon.noname-c 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:39:22.847+0000 7fb8819dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:39:22.847+0000 7fb8809da640 10 monclient: get_auth_request con 0x561fc9d2f580 auth_method 0 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: dump: 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.263 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.264 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.264 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.264 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.264 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.264 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.265 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.265 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: _finish_auth 0 2024-09-12T00:39:23.265 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:39:23.265 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:23.265 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:23.265 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:23.265 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:39:22.847+0000 7fb752ffd640 10 monclient: dump: 2024-09-12T00:39:23.265 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:39:23.265 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:39:22.847+0000 7fb764ff9640 4 set_mon_vals no callback set 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 monclient: authenticate success, global_id 7049 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:39:23.266 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _renew_subs 2024-09-12T00:39:23.267 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:39:23.267 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 1 librados: init done 2024-09-12T00:39:23.267 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:39:22.847+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command cr dump hook 0x561fc9d4fa08 2024-09-12T00:39:23.267 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.267 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:39:22.851+0000 7fb752ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:23.267 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:39:22.851+0000 7fb752ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.267 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:39:22.851+0000 7fb752ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:39:23.267 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:39:22.851+0000 7fb8809da640 10 monclient: get_auth_request con 0x7fb74c070b10 auth_method 0 2024-09-12T00:39:23.267 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:39:22.851+0000 7fb8811db640 10 monclient: get_auth_request con 0x561fc9d795a0 auth_method 0 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 realm 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:39:22.851+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:39:22.851+0000 7fb8809da640 10 monclient: get_auth_request con 0x561fc9d7d980 auth_method 0 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.268 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:39:22.855+0000 7fb8819dc640 10 monclient: get_auth_request con 0x561fc9d810a0 auth_method 0 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:39:22.855+0000 7fb8836d59c0 20 searching for the correct realm 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:39:22.855+0000 7fb8811db640 10 monclient: get_auth_request con 0x561fc9d85e20 auth_method 0 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:39:22.855+0000 7fb8809da640 10 monclient: get_auth_request con 0x7fb87c0e3060 auth_method 0 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:39:22.859+0000 7fb8819dc640 10 monclient: get_auth_request con 0x7fb878019070 auth_method 0 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:39:22.859+0000 7fb8819dc640 0 -- 172.21.15.102:0/768836982 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fb878019070 msgr2=0x7fb878087540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:39:22.859+0000 7fb752ffd640 1 client.7049.objecter ms_handle_reset 0x7fb878019070 session 0x7fb87801e070 osd.4 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:39:22.859+0000 7fb752ffd640 10 monclient: _renew_subs 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:39:22.859+0000 7fb752ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:39:22.859+0000 7fb8819dc640 10 monclient: get_auth_request con 0x7fb74c0811b0 auth_method 0 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:39:22.863+0000 7fb8811db640 10 monclient: get_auth_request con 0x7fb87c136330 auth_method 0 2024-09-12T00:39:23.269 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:39:22.867+0000 7fb8809da640 10 monclient: get_auth_request con 0x7fb87c100dd0 auth_method 0 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:39:22.867+0000 7fb8809da640 0 -- 172.21.15.102:0/768836982 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fb87c100dd0 msgr2=0x7fb87c108620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:39:23.071+0000 7fb8809da640 10 monclient: get_auth_request con 0x7fb87c100dd0 auth_method 0 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:39:23.079+0000 7fb752ffd640 1 client.7049.objecter ms_handle_reset 0x561fc9d7d980 session 0x561fc9d7c820 osd.5 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:39:23.079+0000 7fb8809da640 10 monclient: get_auth_request con 0x7fb878019070 auth_method 0 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:39:23.083+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.270 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.271 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:23.271 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 zone default found 2024-09-12T00:39:23.271 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 4 Realm: () 2024-09-12T00:39:23.271 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:23.271 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:23.271 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:23.271 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 zonegroup default 2024-09-12T00:39:23.271 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.271 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:39:23.087+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 started sync module instance, tier type = 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:39:23.091+0000 7fb8836d59c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=0 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=1 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=2 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=3 2024-09-12T00:39:23.272 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=4 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:39:23.111+0000 7fb8836d59c0 20 add_watcher() i=5 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:39:23.115+0000 7fb8836d59c0 20 add_watcher() i=6 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:39:23.115+0000 7fb8836d59c0 20 add_watcher() i=7 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:39:23.115+0000 7fb8836d59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding auth protocol: cephx 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding auth protocol: cephx 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding auth protocol: cephx 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.273 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:39:23.119+0000 7fb737fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: crc 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 AuthRegistry(0x7ffff1a78900) adding con mode: secure 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command cache list hook 0x561fc9d540b0 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command cache inspect hook 0x561fc9d540b0 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command cache erase hook 0x561fc9d540b0 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command cache zap hook 0x561fc9d540b0 2024-09-12T00:39:23.274 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:39:23.119+0000 7fb8836d59c0 5 note: GC not initialized 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:39:23.123+0000 7fb736fe5640 20 reqs_thread_entry: start 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command sync trace show hook 0x7fb87c0aa540 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command sync trace history hook 0x7fb87c0aa540 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command sync trace active hook 0x7fb87c0aa540 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 5 asok(0x561fc9a822b0) register_command sync trace active_short hook 0x7fb87c0aa540 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 Filter name: none 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:39:23.123+0000 7fb734fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:39:23.275 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 : miss 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:39:23.123+0000 7fb8836d59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:39:23.135+0000 7fb8836d59c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35, ofs0, ns] 2024-09-12T00:39:23.276 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398917 cookie 94694530346784 notifier 7049 bl.length()=995 2024-09-12T00:39:23.277 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:23.277 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:23.277 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:39:23.135+0000 7fb753fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:23.277 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_sources= new_sources= 2024-09-12T00:39:23.277 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential sources added=[] removed=[] 2024-09-12T00:39:23.277 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_dests= new_dests= 2024-09-12T00:39:23.277 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:39:23.139+0000 7fb8836d59c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential dests added=[] removed=[] 2024-09-12T00:39:23.277 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:39:23.147+0000 7fb8836d59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb8836d59c0 time 2024-09-12T00:39:23.152650+0000 2024-09-12T00:39:23.277 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb886faf2eb] 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb886faf49f] 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561fc7c40cc1] 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561fc7c55d5a] 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb885e15d90] 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:39:23.278 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:39:23.151+0000 7fb8836d59c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fb8836d59c0 thread_name:radosgw-admin 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb885e2e520] 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb886faf345] 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb886faf49f] 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561fc7c40cc1] 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561fc7c55d5a] 2024-09-12T00:39:23.279 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb885e15d90] 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:39:23.280 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:23.281 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:39:23.282 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:23.283 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:39:23.284 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:23.285 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:23.286 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:23.286 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:23.286 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:23.286 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:23.286 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:39:23.286 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:23.286 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:39:23.287 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:39:23.287 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:39:23.287 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:23.287 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:39:23.287 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:39:23.287 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:23.288 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:23.288 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:23.288 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:23.288 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb734fe1640 / http_manager 2024-09-12T00:39:23.288 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb736fe5640 / http_manager 2024-09-12T00:39:23.288 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb737fe7640 / rgw_dt_lg_renew 2024-09-12T00:39:23.289 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb752ffd640 / ms_dispatch 2024-09-12T00:39:23.289 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb753fff640 / io_context_pool 2024-09-12T00:39:23.289 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb764ff9640 / io_context_pool 2024-09-12T00:39:23.289 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb766ffd640 / ms_dispatch 2024-09-12T00:39:23.289 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb76de03640 / ms_dispatch 2024-09-12T00:39:23.290 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb76f606640 / io_context_pool 2024-09-12T00:39:23.290 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb8809da640 / msgr-worker-2 2024-09-12T00:39:23.290 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb8811db640 / msgr-worker-1 2024-09-12T00:39:23.290 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb8819dc640 / msgr-worker-0 2024-09-12T00:39:23.290 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb8821dd640 / io_context_pool 2024-09-12T00:39:23.290 INFO:tasks.workunit.client.0.smithi102.stderr: 7fb8836d59c0 / radosgw-admin 2024-09-12T00:39:23.291 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:39:23.291 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:39:23.291 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:39:23.154701Z_9e83e14c-6283-4ecf-ae78-aa10b1912951/log 2024-09-12T00:39:23.291 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:39:23.296 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:39:23.296 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:39:23.296 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:23.296 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:23.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.231+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.235+0000 7f30ad3589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.235+0000 7f30ad3589c0 20 realm 2024-09-12T00:39:23.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.235+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.235+0000 7f30ad3589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.297 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.235+0000 7f30ad3589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.235+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.235+0000 7f30ad3589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.235+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.235+0000 7f30ad3589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.235+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.239+0000 7f30ad3589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.239+0000 7f30ad3589c0 20 searching for the correct realm 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.243+0000 7f30aae5e640 0 -- 172.21.15.102:0/783643044 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x55fab2a39610 msgr2=0x55fab2a3bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.247+0000 7f30aa65d640 0 -- 172.21.15.102:0/783643044 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f30a4111bf0 msgr2=0x7f30a40b6750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:23.298 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 zone default found 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 4 Realm: () 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:23.299 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 zonegroup default 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.255+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.259+0000 7f30ad3589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.259+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.259+0000 7f30ad3589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.259+0000 7f30ad3589c0 20 started sync module instance, tier type = 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.259+0000 7f30ad3589c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.271+0000 7f30ad3589c0 20 add_watcher() i=0 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.271+0000 7f30ad3589c0 20 add_watcher() i=1 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.271+0000 7f30ad3589c0 20 add_watcher() i=2 2024-09-12T00:39:23.300 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.271+0000 7f30ad3589c0 20 add_watcher() i=3 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.271+0000 7f30ad3589c0 20 add_watcher() i=4 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.271+0000 7f30ad3589c0 20 add_watcher() i=5 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.271+0000 7f30ad3589c0 20 add_watcher() i=6 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f30ad3589c0 20 add_watcher() i=7 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f30ad3589c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f2f617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f30ad3589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f30ad3589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f30ad3589c0 5 note: GC not initialized 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f2edbfff640 20 reqs_thread_entry: start 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f30ad3589c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f30ad3589c0 20 Filter name: none 2024-09-12T00:39:23.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f2ed9ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:23.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.275+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.279+0000 7f30ad3589c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:23.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.279+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.279+0000 7f30ad3589c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:39:23.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.279+0000 7f30ad3589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:23.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.279+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.279+0000 7f30ad3589c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.279+0000 7f30ad3589c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.279+0000 7f30ad3589c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.279+0000 7f30ad3589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.283+0000 7f2f617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.287+0000 7f30ad3589c0 20 remove_watcher() i=0 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.287+0000 7f30ad3589c0 2 removed watcher, disabling cache 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.291+0000 7f30ad3589c0 20 remove_watcher() i=1 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.291+0000 7f30ad3589c0 20 remove_watcher() i=2 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.291+0000 7f30ad3589c0 20 remove_watcher() i=3 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.295+0000 7f30ad3589c0 20 remove_watcher() i=4 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.295+0000 7f30ad3589c0 20 remove_watcher() i=5 2024-09-12T00:39:23.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.299+0000 7f30ad3589c0 20 remove_watcher() i=6 2024-09-12T00:39:23.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.299+0000 7f30ad3589c0 20 remove_watcher() i=7 2024-09-12T00:39:23.310 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.310 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:39:23.310 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-do-reshard id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:23.310 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:23.311 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:23.311 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:23.351 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:23.351 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:23.409 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:23.445 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:23.445 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:23.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.491+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.491+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.491+0000 7f4b1b1bb9c0 20 realm 2024-09-12T00:39:23.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.491+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.495+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.495+0000 7f4b1b1bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:23.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.495+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.495+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.495+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.495+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.495+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.495+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:23.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.495+0000 7f4b1b1bb9c0 20 searching for the correct realm 2024-09-12T00:39:23.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.499+0000 7f4b184c0640 0 -- 172.21.15.102:0/3514959366 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f4b10018070 msgr2=0x7f4b1005cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:23.711 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.711+0000 7f4b194c2640 0 -- 172.21.15.102:0/3514959366 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x564df8d45390 msgr2=0x564df8d47780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:23.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.727+0000 7f4b1b1bb9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:23.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.727+0000 7f4b1b1bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:23.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.727+0000 7f4b1b1bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:23.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.727+0000 7f4b1b1bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:23.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.727+0000 7f4b1b1bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:23.741 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.727+0000 7f4b1b1bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:23.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.727+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.727+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.727+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 zone default found 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 4 Realm: () 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:23.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 zonegroup default 2024-09-12T00:39:23.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 started sync module instance, tier type = 2024-09-12T00:39:23.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.731+0000 7f4b1b1bb9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:23.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.755+0000 7f4b1b1bb9c0 20 add_watcher() i=0 2024-09-12T00:39:23.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.755+0000 7f4b1b1bb9c0 20 add_watcher() i=1 2024-09-12T00:39:23.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.755+0000 7f4b1b1bb9c0 20 add_watcher() i=2 2024-09-12T00:39:23.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.755+0000 7f4b1b1bb9c0 20 add_watcher() i=3 2024-09-12T00:39:23.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.755+0000 7f4b1b1bb9c0 20 add_watcher() i=4 2024-09-12T00:39:23.753 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.755+0000 7f4b1b1bb9c0 20 add_watcher() i=5 2024-09-12T00:39:23.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.755+0000 7f4b1b1bb9c0 20 add_watcher() i=6 2024-09-12T00:39:23.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.759+0000 7f4b1b1bb9c0 20 add_watcher() i=7 2024-09-12T00:39:23.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.759+0000 7f4b1b1bb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:23.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.763+0000 7f49cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.763+0000 7f4b1b1bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:23.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.763+0000 7f4b1b1bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:23.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.763+0000 7f4b1b1bb9c0 5 note: GC not initialized 2024-09-12T00:39:23.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.763+0000 7f49cdfe3640 20 reqs_thread_entry: start 2024-09-12T00:39:23.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.763+0000 7f4b1b1bb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:23.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.763+0000 7f4b1b1bb9c0 20 Filter name: none 2024-09-12T00:39:23.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.763+0000 7f493f7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:23.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.763+0000 7f4b1b1bb9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:39:23.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.763+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:23.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:39:23.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:39:23.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 : miss 2024-09-12T00:39:23.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:39:23.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:23.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:23.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:23.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:23.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 2024-09-12T00:39:23.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.767+0000 7f4b1b1bb9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to be held by another RGW process; skipping for now 2024-09-12T00:39:23.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.771+0000 7f49cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.775+0000 7f4b1b1bb9c0 20 remove_watcher() i=0 2024-09-12T00:39:23.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.775+0000 7f4b1b1bb9c0 2 removed watcher, disabling cache 2024-09-12T00:39:23.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.775+0000 7f4b1b1bb9c0 20 remove_watcher() i=1 2024-09-12T00:39:23.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.779+0000 7f4b1b1bb9c0 20 remove_watcher() i=2 2024-09-12T00:39:23.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.783+0000 7f4b1b1bb9c0 20 remove_watcher() i=3 2024-09-12T00:39:23.782 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.783+0000 7f4b1b1bb9c0 20 remove_watcher() i=4 2024-09-12T00:39:23.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.783+0000 7f4b1b1bb9c0 20 remove_watcher() i=5 2024-09-12T00:39:23.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.787+0000 7f4b1b1bb9c0 20 remove_watcher() i=6 2024-09-12T00:39:23.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:23.787+0000 7f4b1b1bb9c0 20 remove_watcher() i=7 2024-09-12T00:39:23.803 INFO:tasks.workunit.client.0.smithi102.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:39:53.833 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:39:53.869 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:53.869 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:53.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.914+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:53.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.918+0000 7f67444679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:53.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.918+0000 7f67444679c0 20 realm 2024-09-12T00:39:53.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.918+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:53.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.918+0000 7f67444679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:53.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.918+0000 7f67444679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:53.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.918+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:53.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.918+0000 7f67444679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:53.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.918+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:53.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.918+0000 7f67444679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:53.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.918+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:53.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.922+0000 7f67444679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:53.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.922+0000 7f67444679c0 20 searching for the correct realm 2024-09-12T00:39:53.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:53.922+0000 7f674276e640 0 -- 172.21.15.102:0/3733302141 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f67380a9070 msgr2=0x7f67380e3910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:54.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.138+0000 7f674176c640 0 -- 172.21.15.102:0/3733302141 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f673c09f0d0 msgr2=0x7f673c0808b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:54.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.354+0000 7f67444679c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:54.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.354+0000 7f67444679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:54.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.354+0000 7f67444679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:54.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.354+0000 7f67444679c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:54.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.354+0000 7f67444679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:54.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.354+0000 7f67444679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:54.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.354+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.354+0000 7f67444679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:54.355 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.354+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:54.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:54.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 zone default found 2024-09-12T00:39:54.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 4 Realm: () 2024-09-12T00:39:54.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:54.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:54.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:54.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 zonegroup default 2024-09-12T00:39:54.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:54.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:54.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:54.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 started sync module instance, tier type = 2024-09-12T00:39:54.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.358+0000 7f67444679c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:54.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.382+0000 7f67444679c0 20 add_watcher() i=0 2024-09-12T00:39:54.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.382+0000 7f67444679c0 20 add_watcher() i=1 2024-09-12T00:39:54.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.382+0000 7f67444679c0 20 add_watcher() i=2 2024-09-12T00:39:54.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.382+0000 7f67444679c0 20 add_watcher() i=3 2024-09-12T00:39:54.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.382+0000 7f67444679c0 20 add_watcher() i=4 2024-09-12T00:39:54.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.382+0000 7f67444679c0 20 add_watcher() i=5 2024-09-12T00:39:54.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.382+0000 7f67444679c0 20 add_watcher() i=6 2024-09-12T00:39:54.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.386+0000 7f67444679c0 20 add_watcher() i=7 2024-09-12T00:39:54.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.386+0000 7f67444679c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:54.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.390+0000 7f65f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:54.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.390+0000 7f67444679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:54.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.390+0000 7f67444679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:54.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.390+0000 7f67444679c0 5 note: GC not initialized 2024-09-12T00:39:54.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.390+0000 7f65f27fc640 20 reqs_thread_entry: start 2024-09-12T00:39:54.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.390+0000 7f67444679c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:54.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 20 Filter name: none 2024-09-12T00:39:54.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f6563fff640 20 reqs_thread_entry: start 2024-09-12T00:39:54.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:39:54.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:54.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:39:54.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:39:54.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 : miss 2024-09-12T00:39:54.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:39:54.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:54.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:54.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:54.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:54.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.394+0000 7f67444679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 2024-09-12T00:39:54.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.398+0000 7f67444679c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:39:54.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.410+0000 7f67444679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:54.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.410+0000 7f67444679c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:54.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.410+0000 7f67444679c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:54.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.410+0000 7f67444679c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35, ofs0, ns] 2024-09-12T00:39:54.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.414+0000 7f66257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398918 cookie 94885179051984 notifier 7560 bl.length()=995 2024-09-12T00:39:54.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.414+0000 7f66257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:54.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.414+0000 7f66257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:54.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.414+0000 7f66257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:54.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.414+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_sources= new_sources= 2024-09-12T00:39:54.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.414+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential sources added=[] removed=[] 2024-09-12T00:39:54.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.414+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_dests= new_dests= 2024-09-12T00:39:54.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.414+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential dests added=[] removed=[] 2024-09-12T00:39:54.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.0 2024-09-12T00:39:54.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.0 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.1 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.1 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.2 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.2 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.3 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.3 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.4 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.4 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.5 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.5 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.6 2024-09-12T00:39:54.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.6 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.7 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.7 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.8 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.8 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.9 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.9 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.10 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.10 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.11 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2.11 2024-09-12T00:39:54.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.0 2024-09-12T00:39:54.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.1 2024-09-12T00:39:54.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.426+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2 2024-09-12T00:39:54.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.430+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.3 2024-09-12T00:39:54.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.430+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.4 2024-09-12T00:39:54.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.430+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.5 2024-09-12T00:39:54.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.430+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.6 2024-09-12T00:39:54.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.434+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.7 2024-09-12T00:39:54.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.434+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.8 2024-09-12T00:39:54.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.434+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.9 2024-09-12T00:39:54.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.434+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.10 2024-09-12T00:39:54.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.442+0000 7f67444679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:54.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.442+0000 7f67444679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 2024-09-12T00:39:54.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.442+0000 7f67444679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:54.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.442+0000 7f67444679c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:54.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.442+0000 7f67444679c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:54.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.442+0000 7f67444679c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35, ofs0, ns] 2024-09-12T00:39:54.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.442+0000 7f6624ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398919 cookie 94885179051984 notifier 7560 bl.length()=995 2024-09-12T00:39:54.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.442+0000 7f6624ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:54.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.442+0000 7f6624ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:54.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.442+0000 7f6624ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:54.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.446+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_sources= new_sources= 2024-09-12T00:39:54.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.446+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential sources added=[] removed=[] 2024-09-12T00:39:54.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.446+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_dests= new_dests= 2024-09-12T00:39:54.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.446+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential dests added=[] removed=[] 2024-09-12T00:39:54.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.450+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.0 2024-09-12T00:39:54.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.450+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.1 2024-09-12T00:39:54.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.454+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.2 2024-09-12T00:39:54.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.454+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.3 2024-09-12T00:39:54.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.454+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.4 2024-09-12T00:39:54.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.454+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.5 2024-09-12T00:39:54.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.454+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.6 2024-09-12T00:39:54.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.454+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.7 2024-09-12T00:39:54.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.458+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.8 2024-09-12T00:39:54.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.458+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.9 2024-09-12T00:39:54.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.458+0000 7f67444679c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35.10 2024-09-12T00:39:54.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.458+0000 7f67444679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:54.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.458+0000 7f67444679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 2024-09-12T00:39:54.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f67444679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:54.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f67444679c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:54.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f67444679c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:54.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f67444679c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35, ofs0, ns] 2024-09-12T00:39:54.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f6624ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398920 cookie 94885179051984 notifier 7560 bl.length()=963 2024-09-12T00:39:54.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f6624ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 info.flags=0x17 2024-09-12T00:39:54.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f6624ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 to cache LRU end 2024-09-12T00:39:54.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f6624ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:54.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_sources= new_sources= 2024-09-12T00:39:54.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential sources added=[] removed=[] 2024-09-12T00:39:54.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): orig_dests= new_dests= 2024-09-12T00:39:54.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.462+0000 7f67444679c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35]): potential dests added=[] removed=[] 2024-09-12T00:39:54.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.470+0000 7f67444679c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:39:54.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.474+0000 7f65f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:54.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.478+0000 7f67444679c0 20 remove_watcher() i=0 2024-09-12T00:39:54.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.478+0000 7f67444679c0 2 removed watcher, disabling cache 2024-09-12T00:39:54.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.482+0000 7f67444679c0 20 remove_watcher() i=1 2024-09-12T00:39:54.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.482+0000 7f67444679c0 20 remove_watcher() i=2 2024-09-12T00:39:54.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.486+0000 7f67444679c0 20 remove_watcher() i=3 2024-09-12T00:39:54.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.490+0000 7f67444679c0 20 remove_watcher() i=4 2024-09-12T00:39:54.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.490+0000 7f67444679c0 20 remove_watcher() i=5 2024-09-12T00:39:54.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.490+0000 7f67444679c0 20 remove_watcher() i=6 2024-09-12T00:39:54.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.494+0000 7f67444679c0 20 remove_watcher() i=7 2024-09-12T00:39:54.509 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:39:54.539 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:54.539 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:54.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.586+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.586+0000 7f6e7735a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:54.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.586+0000 7f6e7735a9c0 20 realm 2024-09-12T00:39:54.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.586+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.586+0000 7f6e7735a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:54.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.586+0000 7f6e7735a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:54.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.586+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.586+0000 7f6e7735a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:54.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.586+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.590+0000 7f6e7735a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:54.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.590+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:54.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.590+0000 7f6e7735a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:54.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.590+0000 7f6e7735a9c0 20 searching for the correct realm 2024-09-12T00:39:54.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.594+0000 7f6e75661640 0 -- 172.21.15.102:0/4066874295 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f6e5c01b040 msgr2=0x7f6e5c06e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:54.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:54.810+0000 7f6e7465f640 0 -- 172.21.15.102:0/4066874295 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6e6c051840 msgr2=0x7f6e6c0467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:55.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.026+0000 7f6e7735a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:55.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.026+0000 7f6e7735a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:55.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.026+0000 7f6e7735a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:55.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.026+0000 7f6e7735a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:55.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.026+0000 7f6e7735a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:55.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.026+0000 7f6e7735a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:55.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.026+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.026+0000 7f6e7735a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.026+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:55.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:55.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 zone default found 2024-09-12T00:39:55.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 4 Realm: () 2024-09-12T00:39:55.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:55.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:55.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:55.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 zonegroup default 2024-09-12T00:39:55.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:55.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 started sync module instance, tier type = 2024-09-12T00:39:55.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.030+0000 7f6e7735a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:55.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.054+0000 7f6e7735a9c0 20 add_watcher() i=0 2024-09-12T00:39:55.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.054+0000 7f6e7735a9c0 20 add_watcher() i=1 2024-09-12T00:39:55.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.054+0000 7f6e7735a9c0 20 add_watcher() i=2 2024-09-12T00:39:55.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.054+0000 7f6e7735a9c0 20 add_watcher() i=3 2024-09-12T00:39:55.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.054+0000 7f6e7735a9c0 20 add_watcher() i=4 2024-09-12T00:39:55.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.054+0000 7f6e7735a9c0 20 add_watcher() i=5 2024-09-12T00:39:55.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.054+0000 7f6e7735a9c0 20 add_watcher() i=6 2024-09-12T00:39:55.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.054+0000 7f6e7735a9c0 20 add_watcher() i=7 2024-09-12T00:39:55.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.054+0000 7f6e7735a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:55.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.058+0000 7f6d2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:55.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.058+0000 7f6e7735a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:55.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.058+0000 7f6e7735a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:55.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.058+0000 7f6e7735a9c0 5 note: GC not initialized 2024-09-12T00:39:55.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.062+0000 7f6d29fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:55.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.062+0000 7f6e7735a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:55.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.062+0000 7f6e7735a9c0 20 Filter name: none 2024-09-12T00:39:55.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.062+0000 7f6c9b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:55.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.062+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.062+0000 7f6e7735a9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:55.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.062+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.062+0000 7f6e7735a9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:55.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.062+0000 7f6e7735a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:55.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.062+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.066+0000 7f6e7735a9c0 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:39:55.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.066+0000 7f6e7735a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:55.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.066+0000 7f6e7735a9c0 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:39:55.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.066+0000 7f6e7735a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:55.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.070+0000 7f6d2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:55.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.074+0000 7f6e7735a9c0 20 remove_watcher() i=0 2024-09-12T00:39:55.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.074+0000 7f6e7735a9c0 2 removed watcher, disabling cache 2024-09-12T00:39:55.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.074+0000 7f6e7735a9c0 20 remove_watcher() i=1 2024-09-12T00:39:55.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.078+0000 7f6e7735a9c0 20 remove_watcher() i=2 2024-09-12T00:39:55.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.078+0000 7f6e7735a9c0 20 remove_watcher() i=3 2024-09-12T00:39:55.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.082+0000 7f6e7735a9c0 20 remove_watcher() i=4 2024-09-12T00:39:55.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.082+0000 7f6e7735a9c0 20 remove_watcher() i=5 2024-09-12T00:39:55.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.086+0000 7f6e7735a9c0 20 remove_watcher() i=6 2024-09-12T00:39:55.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:55.086+0000 7f6e7735a9c0 20 remove_watcher() i=7 2024-09-12T00:39:55.100 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:55.100 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:39:55.100 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-do-reshard id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:39:55.101 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:55.101 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.102 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:55.125 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.125 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:55.723 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:55.723 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:56.109 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:39:56.109 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:56.112 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.112 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:56.245 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.245 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:56.332 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.332 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:56.442 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.442 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:56.548 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.548 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:56.641 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.641 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:56.740 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.740 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:56.841 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.841 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:56.943 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:56.943 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:57.052 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.052 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:57.153 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.153 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:57.260 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.261 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:57.358 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.358 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:57.460 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.460 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:57.557 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.558 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:57.661 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.661 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:57.753 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.754 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:57.832 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.832 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:57.907 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:57.907 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:58.010 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.010 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:58.114 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.115 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:58.213 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:58.213 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:39:58.307 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:39:58.341 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:58.341 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:58.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.386+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.390+0000 7fdcd448e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.390+0000 7fdcd448e9c0 20 realm 2024-09-12T00:39:58.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.390+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.390+0000 7fdcd448e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.390+0000 7fdcd448e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:58.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.390+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.390+0000 7fdcd448e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.390+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.390+0000 7fdcd448e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:58.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.390+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.394+0000 7fdcd448e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:58.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.394+0000 7fdcd448e9c0 20 searching for the correct realm 2024-09-12T00:39:58.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.394+0000 7fdcd2795640 0 -- 172.21.15.102:0/3111523372 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fdcc803e030 msgr2=0x7fdcc8066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:58.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.610+0000 7fdcd1793640 0 -- 172.21.15.102:0/3111523372 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fdccc0d0910 msgr2=0x7fdccc0c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:58.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.826+0000 7fdcd448e9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:58.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.826+0000 7fdcd448e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:58.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.826+0000 7fdcd448e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:58.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.826+0000 7fdcd448e9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:58.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.826+0000 7fdcd448e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:58.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.826+0000 7fdcd448e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:58.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.826+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:58.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 zone default found 2024-09-12T00:39:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 4 Realm: () 2024-09-12T00:39:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 zonegroup default 2024-09-12T00:39:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.830+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.834+0000 7fdcd448e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.834+0000 7fdcd448e9c0 20 started sync module instance, tier type = 2024-09-12T00:39:58.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.834+0000 7fdcd448e9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:58.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.854+0000 7fdcd448e9c0 20 add_watcher() i=0 2024-09-12T00:39:58.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.854+0000 7fdcd448e9c0 20 add_watcher() i=1 2024-09-12T00:39:58.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.854+0000 7fdcd448e9c0 20 add_watcher() i=2 2024-09-12T00:39:58.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.854+0000 7fdcd448e9c0 20 add_watcher() i=3 2024-09-12T00:39:58.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.854+0000 7fdcd448e9c0 20 add_watcher() i=4 2024-09-12T00:39:58.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.854+0000 7fdcd448e9c0 20 add_watcher() i=5 2024-09-12T00:39:58.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.854+0000 7fdcd448e9c0 20 add_watcher() i=6 2024-09-12T00:39:58.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.858+0000 7fdcd448e9c0 20 add_watcher() i=7 2024-09-12T00:39:58.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.858+0000 7fdcd448e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:58.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.862+0000 7fdb837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:58.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.862+0000 7fdcd448e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:58.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.862+0000 7fdcd448e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:58.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.862+0000 7fdcd448e9c0 5 note: GC not initialized 2024-09-12T00:39:58.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.862+0000 7fdb827fc640 20 reqs_thread_entry: start 2024-09-12T00:39:58.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.862+0000 7fdcd448e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:58.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.866+0000 7fdcd448e9c0 20 Filter name: none 2024-09-12T00:39:58.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.866+0000 7fdaf3fff640 20 reqs_thread_entry: start 2024-09-12T00:39:58.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.866+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.866+0000 7fdcd448e9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:39:58.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.866+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.866+0000 7fdcd448e9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:39:58.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.866+0000 7fdcd448e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:58.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.866+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.870+0000 7fdcd448e9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:39:58.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.870+0000 7fdcd448e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.870+0000 7fdcd448e9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:39:58.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.870+0000 7fdcd448e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:58.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.874+0000 7fdb837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:58.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.878+0000 7fdcd448e9c0 20 remove_watcher() i=0 2024-09-12T00:39:58.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.878+0000 7fdcd448e9c0 2 removed watcher, disabling cache 2024-09-12T00:39:58.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.878+0000 7fdcd448e9c0 20 remove_watcher() i=1 2024-09-12T00:39:58.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.882+0000 7fdcd448e9c0 20 remove_watcher() i=2 2024-09-12T00:39:58.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.882+0000 7fdcd448e9c0 20 remove_watcher() i=3 2024-09-12T00:39:58.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.886+0000 7fdcd448e9c0 20 remove_watcher() i=4 2024-09-12T00:39:58.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.886+0000 7fdcd448e9c0 20 remove_watcher() i=5 2024-09-12T00:39:58.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.890+0000 7fdcd448e9c0 20 remove_watcher() i=6 2024-09-12T00:39:58.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.890+0000 7fdcd448e9c0 20 remove_watcher() i=7 2024-09-12T00:39:58.906 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:58.906 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:39:58.906 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-logrecord-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:39:58.906 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:39:58.907 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:39:58.940 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:58.940 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:58.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.986+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.986+0000 7f6442a829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.986+0000 7f6442a829c0 20 realm 2024-09-12T00:39:58.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.986+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.990+0000 7f6442a829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.990+0000 7f6442a829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:58.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.990+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.990+0000 7f6442a829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:58.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.990+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.990+0000 7f6442a829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:58.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.990+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:58.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.990+0000 7f6442a829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:58.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.990+0000 7f6442a829c0 20 searching for the correct realm 2024-09-12T00:39:58.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:58.994+0000 7f6440d89640 0 -- 172.21.15.102:0/203375586 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f64300da030 msgr2=0x7f64300cd920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:59.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.210+0000 7f643fd87640 0 -- 172.21.15.102:0/203375586 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6438047200 msgr2=0x7f6438087050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:59.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:39:59.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:59.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:59.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:39:59.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:59.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:59.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:59.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.426+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:59.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 zone default found 2024-09-12T00:39:59.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 4 Realm: () 2024-09-12T00:39:59.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:39:59.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:39:59.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:59.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 zonegroup default 2024-09-12T00:39:59.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 started sync module instance, tier type = 2024-09-12T00:39:59.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.430+0000 7f6442a829c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:39:59.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.454+0000 7f6442a829c0 20 add_watcher() i=0 2024-09-12T00:39:59.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.454+0000 7f6442a829c0 20 add_watcher() i=1 2024-09-12T00:39:59.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.454+0000 7f6442a829c0 20 add_watcher() i=2 2024-09-12T00:39:59.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.454+0000 7f6442a829c0 20 add_watcher() i=3 2024-09-12T00:39:59.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.454+0000 7f6442a829c0 20 add_watcher() i=4 2024-09-12T00:39:59.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.454+0000 7f6442a829c0 20 add_watcher() i=5 2024-09-12T00:39:59.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.454+0000 7f6442a829c0 20 add_watcher() i=6 2024-09-12T00:39:59.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.454+0000 7f6442a829c0 20 add_watcher() i=7 2024-09-12T00:39:59.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.454+0000 7f6442a829c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:59.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.458+0000 7f62f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:59.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:59.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:59.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 5 note: GC not initialized 2024-09-12T00:39:59.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f62f5fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:59.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:59.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 20 Filter name: none 2024-09-12T00:39:59.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f62677fe640 20 reqs_thread_entry: start 2024-09-12T00:39:59.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:39:59.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:39:59.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:39:59.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:39:59.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 : miss 2024-09-12T00:39:59.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.462+0000 7f6442a829c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:39:59.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.466+0000 7f6442a829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:39:59.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.466+0000 7f6442a829c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:39:59.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.466+0000 7f6442a829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:59.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.466+0000 7f6442a829c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:59.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.466+0000 7f6442a829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 2024-09-12T00:39:59.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.474+0000 7f6442a829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:39:59.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.474+0000 7f6442a829c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:39:59.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.474+0000 7f6442a829c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:59.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.474+0000 7f6442a829c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36, ofs0, ns] 2024-09-12T00:39:59.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.478+0000 7f63177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398923 cookie 94603473442720 notifier 7617 bl.length()=1007 2024-09-12T00:39:59.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.478+0000 7f63177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:39:59.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.478+0000 7f63177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:39:59.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.478+0000 7f63177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:59.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.478+0000 7f6442a829c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): orig_sources= new_sources= 2024-09-12T00:39:59.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.478+0000 7f6442a829c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): potential sources added=[] removed=[] 2024-09-12T00:39:59.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.478+0000 7f6442a829c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): orig_dests= new_dests= 2024-09-12T00:39:59.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.478+0000 7f6442a829c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): potential dests added=[] removed=[] 2024-09-12T00:39:59.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.482+0000 7f6442a829c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:39:59.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.482+0000 7f6442a829c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:39:59.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.494+0000 7f6442a829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:59.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.494+0000 7f6442a829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 2024-09-12T00:39:59.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.498+0000 7f6442a829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:39:59.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.498+0000 7f6442a829c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:39:59.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.498+0000 7f6442a829c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:59.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.498+0000 7f6442a829c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36, ofs0, ns] 2024-09-12T00:39:59.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.498+0000 7f63177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398924 cookie 94603473442720 notifier 7617 bl.length()=975 2024-09-12T00:39:59.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.498+0000 7f63177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:39:59.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.498+0000 7f63177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:39:59.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.498+0000 7f63177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:39:59.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.502+0000 7f6442a829c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): orig_sources= new_sources= 2024-09-12T00:39:59.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.502+0000 7f6442a829c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): potential sources added=[] removed=[] 2024-09-12T00:39:59.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.502+0000 7f6442a829c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): orig_dests= new_dests= 2024-09-12T00:39:59.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.502+0000 7f6442a829c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): potential dests added=[] removed=[] 2024-09-12T00:39:59.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.502+0000 7f62f6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:59.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.510+0000 7f6442a829c0 20 remove_watcher() i=0 2024-09-12T00:39:59.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.510+0000 7f6442a829c0 2 removed watcher, disabling cache 2024-09-12T00:39:59.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.510+0000 7f6442a829c0 20 remove_watcher() i=1 2024-09-12T00:39:59.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.514+0000 7f6442a829c0 20 remove_watcher() i=2 2024-09-12T00:39:59.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.514+0000 7f6442a829c0 20 remove_watcher() i=3 2024-09-12T00:39:59.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.518+0000 7f6442a829c0 20 remove_watcher() i=4 2024-09-12T00:39:59.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.518+0000 7f6442a829c0 20 remove_watcher() i=5 2024-09-12T00:39:59.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.522+0000 7f6442a829c0 20 remove_watcher() i=6 2024-09-12T00:39:59.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.522+0000 7f6442a829c0 20 remove_watcher() i=7 2024-09-12T00:39:59.535 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:59.566 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:59.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.610+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.610+0000 7f4ac833f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.610+0000 7f4ac833f9c0 20 realm 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.610+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.610+0000 7f4ac833f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.610+0000 7f4ac833f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.610+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.614+0000 7f4ac833f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:59.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.614+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.614+0000 7f4ac833f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:59.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.614+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:59.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.614+0000 7f4ac833f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:59.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.614+0000 7f4ac833f9c0 20 searching for the correct realm 2024-09-12T00:39:59.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.618+0000 7f4ac6646640 0 -- 172.21.15.102:0/2853594168 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f4abc017020 msgr2=0x7f4abc04a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:59.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:39:59.834+0000 7f4ac5644640 0 -- 172.21.15.102:0/2853594168 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f4ac0060fe0 msgr2=0x7f4ac006a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:00.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.050+0000 7f4ac833f9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:00.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.050+0000 7f4ac833f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:00.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.050+0000 7f4ac833f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:00.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.050+0000 7f4ac833f9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:00.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.050+0000 7f4ac833f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:00.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.050+0000 7f4ac833f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:00.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.050+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.050+0000 7f4ac833f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.050+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:00.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:00.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 20 zone default found 2024-09-12T00:40:00.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 4 Realm: () 2024-09-12T00:40:00.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:00.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:00.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:00.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 20 zonegroup default 2024-09-12T00:40:00.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.054+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.058+0000 7f4ac833f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.058+0000 7f4ac833f9c0 20 started sync module instance, tier type = 2024-09-12T00:40:00.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.058+0000 7f4ac833f9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.078+0000 7f4ac833f9c0 20 add_watcher() i=0 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.078+0000 7f4ac833f9c0 20 add_watcher() i=1 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.078+0000 7f4ac833f9c0 20 add_watcher() i=2 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.078+0000 7f4ac833f9c0 20 add_watcher() i=3 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.078+0000 7f4ac833f9c0 20 add_watcher() i=4 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.078+0000 7f4ac833f9c0 20 add_watcher() i=5 2024-09-12T00:40:00.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.078+0000 7f4ac833f9c0 20 add_watcher() i=6 2024-09-12T00:40:00.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.082+0000 7f4ac833f9c0 20 add_watcher() i=7 2024-09-12T00:40:00.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.082+0000 7f4ac833f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:00.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f49777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:00.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f4ac833f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:00.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f4ac833f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:00.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f4ac833f9c0 5 note: GC not initialized 2024-09-12T00:40:00.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f49767fc640 20 reqs_thread_entry: start 2024-09-12T00:40:00.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f4ac833f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:00.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f4ac833f9c0 20 Filter name: none 2024-09-12T00:40:00.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f48e7fff640 20 reqs_thread_entry: start 2024-09-12T00:40:00.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f4ac833f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:00.086 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.086+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.090+0000 7f4ac833f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:00.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.090+0000 7f4ac833f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:00.088 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.090+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.090+0000 7f4ac833f9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:00.089 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.090+0000 7f4ac833f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.090+0000 7f4ac833f9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:00.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.090+0000 7f4ac833f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:00.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.094+0000 7f49777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:00.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.098+0000 7f4ac833f9c0 20 remove_watcher() i=0 2024-09-12T00:40:00.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.098+0000 7f4ac833f9c0 2 removed watcher, disabling cache 2024-09-12T00:40:00.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.102+0000 7f4ac833f9c0 20 remove_watcher() i=1 2024-09-12T00:40:00.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.102+0000 7f4ac833f9c0 20 remove_watcher() i=2 2024-09-12T00:40:00.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.106+0000 7f4ac833f9c0 20 remove_watcher() i=3 2024-09-12T00:40:00.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.106+0000 7f4ac833f9c0 20 remove_watcher() i=4 2024-09-12T00:40:00.108 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.110+0000 7f4ac833f9c0 20 remove_watcher() i=5 2024-09-12T00:40:00.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.110+0000 7f4ac833f9c0 20 remove_watcher() i=6 2024-09-12T00:40:00.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.110+0000 7f4ac833f9c0 20 remove_watcher() i=7 2024-09-12T00:40:00.126 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:00.127 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:00.127 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-logrecord-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:00.127 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:00.127 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:00.127 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:00.169 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:00.169 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:00.233 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:00.270 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:00.270 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:00.313 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.314+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.314+0000 7f954fac99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.314+0000 7f954fac99c0 20 realm 2024-09-12T00:40:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.314+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.314+0000 7f954fac99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.314+0000 7f954fac99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.314+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.314+0000 7f954fac99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.314+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.318+0000 7f954fac99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.318+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.318+0000 7f954fac99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:00.319 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.318+0000 7f954fac99c0 20 searching for the correct realm 2024-09-12T00:40:00.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.322+0000 7f954ddd0640 0 -- 172.21.15.102:0/769241122 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f95440e24c0 msgr2=0x7f954410da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:00.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.330+0000 7f954cdce640 0 -- 172.21.15.102:0/769241122 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f9548008040 msgr2=0x7f95480203f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:00.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.546+0000 7f954fac99c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:00.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.546+0000 7f954fac99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:00.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.546+0000 7f954fac99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:00.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.546+0000 7f954fac99c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:00.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.546+0000 7f954fac99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:00.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.546+0000 7f954fac99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:00.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.546+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:00.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:00.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 zone default found 2024-09-12T00:40:00.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 4 Realm: () 2024-09-12T00:40:00.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:00.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:00.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:00.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 zonegroup default 2024-09-12T00:40:00.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.550+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.554+0000 7f954fac99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.554+0000 7f954fac99c0 20 started sync module instance, tier type = 2024-09-12T00:40:00.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.554+0000 7f954fac99c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:00.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.578+0000 7f954fac99c0 20 add_watcher() i=0 2024-09-12T00:40:00.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.578+0000 7f954fac99c0 20 add_watcher() i=1 2024-09-12T00:40:00.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.578+0000 7f954fac99c0 20 add_watcher() i=2 2024-09-12T00:40:00.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.578+0000 7f954fac99c0 20 add_watcher() i=3 2024-09-12T00:40:00.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.578+0000 7f954fac99c0 20 add_watcher() i=4 2024-09-12T00:40:00.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.578+0000 7f954fac99c0 20 add_watcher() i=5 2024-09-12T00:40:00.576 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.578+0000 7f954fac99c0 20 add_watcher() i=6 2024-09-12T00:40:00.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.578+0000 7f954fac99c0 20 add_watcher() i=7 2024-09-12T00:40:00.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.578+0000 7f954fac99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:00.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.582+0000 7f9403fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:00.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.582+0000 7f954fac99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:00.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.582+0000 7f954fac99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:00.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 5 note: GC not initialized 2024-09-12T00:40:00.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f9402fe5640 20 reqs_thread_entry: start 2024-09-12T00:40:00.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:00.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 20 Filter name: none 2024-09-12T00:40:00.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f9400fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:00.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:40:00.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:00.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:40:00.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:40:00.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 : miss 2024-09-12T00:40:00.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:00.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:40:00.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:40:00.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:00.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:00.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.586+0000 7f954fac99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 2024-09-12T00:40:00.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.598+0000 7f954fac99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:40:00.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.598+0000 7f954fac99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:40:00.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.598+0000 7f954fac99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:00.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.598+0000 7f954fac99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36, ofs0, ns] 2024-09-12T00:40:00.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.598+0000 7f941ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398925 cookie 94508754880960 notifier 7184 bl.length()=1007 2024-09-12T00:40:00.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.598+0000 7f941ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:40:00.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.602+0000 7f941ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:40:00.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.602+0000 7f941ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:00.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.602+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): orig_sources= new_sources= 2024-09-12T00:40:00.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.602+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): potential sources added=[] removed=[] 2024-09-12T00:40:00.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.602+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): orig_dests= new_dests= 2024-09-12T00:40:00.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.602+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): potential dests added=[] removed=[] 2024-09-12T00:40:00.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.0 2024-09-12T00:40:00.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.0 2024-09-12T00:40:00.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.1 2024-09-12T00:40:00.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.1 2024-09-12T00:40:00.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.2 2024-09-12T00:40:00.612 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.2 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.3 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.3 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.4 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.4 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.5 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.5 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.6 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.6 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.7 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.7 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.8 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.8 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.9 2024-09-12T00:40:00.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.9 2024-09-12T00:40:00.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.10 2024-09-12T00:40:00.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.10 2024-09-12T00:40:00.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.11 2024-09-12T00:40:00.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1.11 2024-09-12T00:40:00.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.0 2024-09-12T00:40:00.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1 2024-09-12T00:40:00.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.2 2024-09-12T00:40:00.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.3 2024-09-12T00:40:00.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.614+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.4 2024-09-12T00:40:00.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.618+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.5 2024-09-12T00:40:00.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.618+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.6 2024-09-12T00:40:00.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.618+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.7 2024-09-12T00:40:00.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.622+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.8 2024-09-12T00:40:00.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.622+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.9 2024-09-12T00:40:00.623 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.622+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.10 2024-09-12T00:40:00.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.630+0000 7f954fac99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:00.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.630+0000 7f954fac99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 2024-09-12T00:40:00.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.634+0000 7f954fac99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:40:00.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.634+0000 7f954fac99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:40:00.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.634+0000 7f954fac99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:00.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.634+0000 7f954fac99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36, ofs0, ns] 2024-09-12T00:40:00.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.634+0000 7f9430ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398926 cookie 94508754880960 notifier 7184 bl.length()=1007 2024-09-12T00:40:00.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.634+0000 7f9430ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:40:00.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.634+0000 7f9430ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:40:00.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.634+0000 7f9430ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:00.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.638+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): orig_sources= new_sources= 2024-09-12T00:40:00.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.638+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): potential sources added=[] removed=[] 2024-09-12T00:40:00.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.638+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): orig_dests= new_dests= 2024-09-12T00:40:00.638 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.638+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): potential dests added=[] removed=[] 2024-09-12T00:40:00.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.642+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.0 2024-09-12T00:40:00.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.646+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.1 2024-09-12T00:40:00.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.646+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.2 2024-09-12T00:40:00.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.646+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.3 2024-09-12T00:40:00.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.646+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.4 2024-09-12T00:40:00.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.646+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.5 2024-09-12T00:40:00.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.650+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.6 2024-09-12T00:40:00.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.650+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.7 2024-09-12T00:40:00.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.650+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.8 2024-09-12T00:40:00.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.650+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.9 2024-09-12T00:40:00.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.650+0000 7f954fac99c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36.10 2024-09-12T00:40:00.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.654+0000 7f954fac99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:00.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.654+0000 7f954fac99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 2024-09-12T00:40:00.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.654+0000 7f954fac99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:40:00.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.654+0000 7f954fac99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:40:00.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.654+0000 7f954fac99c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:00.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.654+0000 7f954fac99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36, ofs0, ns] 2024-09-12T00:40:00.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.654+0000 7f941ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398927 cookie 94508754880960 notifier 7184 bl.length()=975 2024-09-12T00:40:00.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.654+0000 7f941ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 info.flags=0x17 2024-09-12T00:40:00.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.654+0000 7f941ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 to cache LRU end 2024-09-12T00:40:00.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.654+0000 7f941ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:00.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.658+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): orig_sources= new_sources= 2024-09-12T00:40:00.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.658+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): potential sources added=[] removed=[] 2024-09-12T00:40:00.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.658+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): orig_dests= new_dests= 2024-09-12T00:40:00.658 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.658+0000 7f954fac99c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36]): potential dests added=[] removed=[] 2024-09-12T00:40:00.663 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.662+0000 7f954fac99c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:40:00.666 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.666+0000 7f9403fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:00.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.670+0000 7f954fac99c0 20 remove_watcher() i=0 2024-09-12T00:40:00.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.670+0000 7f954fac99c0 2 removed watcher, disabling cache 2024-09-12T00:40:00.673 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.674+0000 7f954fac99c0 20 remove_watcher() i=1 2024-09-12T00:40:00.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.678+0000 7f954fac99c0 20 remove_watcher() i=2 2024-09-12T00:40:00.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.678+0000 7f954fac99c0 20 remove_watcher() i=3 2024-09-12T00:40:00.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.682+0000 7f954fac99c0 20 remove_watcher() i=4 2024-09-12T00:40:00.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.682+0000 7f954fac99c0 20 remove_watcher() i=5 2024-09-12T00:40:00.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.686+0000 7f954fac99c0 20 remove_watcher() i=6 2024-09-12T00:40:00.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.686+0000 7f954fac99c0 20 remove_watcher() i=7 2024-09-12T00:40:00.705 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:40:00.739 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:00.740 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:00.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.786+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.786+0000 7f76101669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.786+0000 7f76101669c0 20 realm 2024-09-12T00:40:00.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.786+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.786+0000 7f76101669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.786+0000 7f76101669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:00.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.786+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.786+0000 7f76101669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:00.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.786+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.790+0000 7f76101669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:00.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.790+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:00.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.790+0000 7f76101669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:00.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.790+0000 7f76101669c0 20 searching for the correct realm 2024-09-12T00:40:00.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.794+0000 7f760e46d640 0 -- 172.21.15.102:0/3053454866 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f760002a040 msgr2=0x7f760008e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:00.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:00.802+0000 7f760d46b640 0 -- 172.21.15.102:0/3053454866 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f7608123c40 msgr2=0x7f7608135110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:01.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.018+0000 7f76101669c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:01.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.018+0000 7f76101669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:01.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.018+0000 7f76101669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:01.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.018+0000 7f76101669c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:01.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.018+0000 7f76101669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:01.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.018+0000 7f76101669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:01.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.018+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:01.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.018+0000 7f76101669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:01.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.018+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:01.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:01.020 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:01.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:01.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 20 zone default found 2024-09-12T00:40:01.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 4 Realm: () 2024-09-12T00:40:01.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:01.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:01.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:01.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 20 zonegroup default 2024-09-12T00:40:01.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:01.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:01.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:01.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:01.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.022+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:01.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.026+0000 7f76101669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:01.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.026+0000 7f76101669c0 20 started sync module instance, tier type = 2024-09-12T00:40:01.024 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.026+0000 7f76101669c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:01.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.050+0000 7f76101669c0 20 add_watcher() i=0 2024-09-12T00:40:01.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.050+0000 7f76101669c0 20 add_watcher() i=1 2024-09-12T00:40:01.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.050+0000 7f76101669c0 20 add_watcher() i=2 2024-09-12T00:40:01.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.050+0000 7f76101669c0 20 add_watcher() i=3 2024-09-12T00:40:01.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.050+0000 7f76101669c0 20 add_watcher() i=4 2024-09-12T00:40:01.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.050+0000 7f76101669c0 20 add_watcher() i=5 2024-09-12T00:40:01.049 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.050+0000 7f76101669c0 20 add_watcher() i=6 2024-09-12T00:40:01.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.050+0000 7f76101669c0 20 add_watcher() i=7 2024-09-12T00:40:01.050 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.050+0000 7f76101669c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:01.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.054+0000 7f74bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:01.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.054+0000 7f76101669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:01.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.054+0000 7f76101669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:01.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.054+0000 7f76101669c0 5 note: GC not initialized 2024-09-12T00:40:01.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.058+0000 7f74be7fc640 20 reqs_thread_entry: start 2024-09-12T00:40:01.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.058+0000 7f76101669c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:01.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.058+0000 7f76101669c0 20 Filter name: none 2024-09-12T00:40:01.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.058+0000 7f742ffff640 20 reqs_thread_entry: start 2024-09-12T00:40:01.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.058+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:01.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.058+0000 7f76101669c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:01.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.058+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:01.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.058+0000 7f76101669c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:01.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.058+0000 7f76101669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:01.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.058+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:01.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.062+0000 7f76101669c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:01.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.062+0000 7f76101669c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:01.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.062+0000 7f76101669c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:01.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.062+0000 7f76101669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:01.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.066+0000 7f74bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:01.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.070+0000 7f76101669c0 20 remove_watcher() i=0 2024-09-12T00:40:01.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.070+0000 7f76101669c0 2 removed watcher, disabling cache 2024-09-12T00:40:01.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.074+0000 7f76101669c0 20 remove_watcher() i=1 2024-09-12T00:40:01.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.074+0000 7f76101669c0 20 remove_watcher() i=2 2024-09-12T00:40:01.076 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.078+0000 7f76101669c0 20 remove_watcher() i=3 2024-09-12T00:40:01.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.078+0000 7f76101669c0 20 remove_watcher() i=4 2024-09-12T00:40:01.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.082+0000 7f76101669c0 20 remove_watcher() i=5 2024-09-12T00:40:01.081 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.082+0000 7f76101669c0 20 remove_watcher() i=6 2024-09-12T00:40:01.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:01.082+0000 7f76101669c0 20 remove_watcher() i=7 2024-09-12T00:40:01.097 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:01.097 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:01.097 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-logrecord-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:40:01.097 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:01.098 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:01.098 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:01.117 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:01.118 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:01.578 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:01.578 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:01.947 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:40:01.947 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:01.950 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:01.950 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:02.084 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:02.084 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:02.172 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:02.172 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:02.277 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:02.277 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:02.378 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:02.378 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:02.477 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:02.477 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:02.577 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:02.577 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:02.684 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:02.684 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:02.788 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:02.788 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:02.886 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:02.887 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:02.985 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:02.985 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:03.088 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:03.088 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:03.190 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:03.191 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:03.289 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:03.289 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:03.384 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:03.385 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:03.485 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:03.485 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:03.589 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:03.589 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:03.691 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:03.691 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:03.793 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:03.793 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:03.891 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:03.891 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:03.992 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:03.993 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:04.094 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:04.094 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:04.186 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:40:04.219 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:04.219 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:04.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.266+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.266+0000 7f27cb16e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:04.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.266+0000 7f27cb16e9c0 20 realm 2024-09-12T00:40:04.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.266+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.266+0000 7f27cb16e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:04.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.266+0000 7f27cb16e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:04.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.266+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.266+0000 7f27cb16e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:04.267 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.266+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.268 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.270+0000 7f27cb16e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:04.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.270+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.270+0000 7f27cb16e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:04.270 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.270+0000 7f27cb16e9c0 20 searching for the correct realm 2024-09-12T00:40:04.273 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.274+0000 7f27c9475640 0 -- 172.21.15.102:0/1442080026 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f27bc008040 msgr2=0x7f27bc050420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:04.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.490+0000 7f27c8473640 0 -- 172.21.15.102:0/1442080026 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f27c00ac030 msgr2=0x7f27c0009b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:04.708 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:04.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:04.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:04.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:04.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:04.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:04.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:04.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 zone default found 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 4 Realm: () 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 zonegroup default 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.710+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.714+0000 7f27cb16e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:04.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.714+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.714+0000 7f27cb16e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.714+0000 7f27cb16e9c0 20 started sync module instance, tier type = 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.714+0000 7f27cb16e9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.738+0000 7f27cb16e9c0 20 add_watcher() i=0 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.738+0000 7f27cb16e9c0 20 add_watcher() i=1 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.738+0000 7f27cb16e9c0 20 add_watcher() i=2 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.738+0000 7f27cb16e9c0 20 add_watcher() i=3 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.738+0000 7f27cb16e9c0 20 add_watcher() i=4 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.738+0000 7f27cb16e9c0 20 add_watcher() i=5 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.738+0000 7f27cb16e9c0 20 add_watcher() i=6 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.738+0000 7f27cb16e9c0 20 add_watcher() i=7 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.738+0000 7f27cb16e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.742+0000 7f267efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:04.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.742+0000 7f27cb16e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.742+0000 7f27cb16e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f27cb16e9c0 5 note: GC not initialized 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f267dfe3640 20 reqs_thread_entry: start 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f27cb16e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f27cb16e9c0 20 Filter name: none 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f25ef7fe640 20 reqs_thread_entry: start 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f27cb16e9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f27cb16e9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f27cb16e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:04.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.746+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.750+0000 7f27cb16e9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:04.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.750+0000 7f27cb16e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.750+0000 7f27cb16e9c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:04.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.750+0000 7f27cb16e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:04.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.750+0000 7f267efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:04.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.758+0000 7f27cb16e9c0 20 remove_watcher() i=0 2024-09-12T00:40:04.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.758+0000 7f27cb16e9c0 2 removed watcher, disabling cache 2024-09-12T00:40:04.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.758+0000 7f27cb16e9c0 20 remove_watcher() i=1 2024-09-12T00:40:04.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.762+0000 7f27cb16e9c0 20 remove_watcher() i=2 2024-09-12T00:40:04.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.762+0000 7f27cb16e9c0 20 remove_watcher() i=3 2024-09-12T00:40:04.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.766+0000 7f27cb16e9c0 20 remove_watcher() i=4 2024-09-12T00:40:04.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.766+0000 7f27cb16e9c0 20 remove_watcher() i=5 2024-09-12T00:40:04.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.766+0000 7f27cb16e9c0 20 remove_watcher() i=6 2024-09-12T00:40:04.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.770+0000 7f27cb16e9c0 20 remove_watcher() i=7 2024-09-12T00:40:04.782 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:04.782 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:04.782 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-logrecord-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:04.782 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:04.783 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:40:04.820 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:04.820 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:04.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:04.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 20 realm 2024-09-12T00:40:04.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:04.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:04.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:04.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:04.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:04.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.870+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:04.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.870+0000 7fde981989c0 20 searching for the correct realm 2024-09-12T00:40:04.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.874+0000 7fde9649f640 0 -- 172.21.15.102:0/2523375249 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55c1ac323d30 msgr2=0x55c1ac326120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:04.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:04.878+0000 7fde9549d640 0 -- 172.21.15.102:0/2523375249 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fde9007dbf0 msgr2=0x7fde9006c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:05.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:05.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:05.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:05.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:05.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:05.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:05.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:05.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:05.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 zone default found 2024-09-12T00:40:05.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 4 Realm: () 2024-09-12T00:40:05.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:05.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:05.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:05.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 zonegroup default 2024-09-12T00:40:05.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.102+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.102+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.102+0000 7fde981989c0 20 started sync module instance, tier type = 2024-09-12T00:40:05.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.102+0000 7fde981989c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:05.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=0 2024-09-12T00:40:05.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=1 2024-09-12T00:40:05.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=2 2024-09-12T00:40:05.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=3 2024-09-12T00:40:05.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=4 2024-09-12T00:40:05.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=5 2024-09-12T00:40:05.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=6 2024-09-12T00:40:05.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.126+0000 7fde981989c0 20 add_watcher() i=7 2024-09-12T00:40:05.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.126+0000 7fde981989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:05.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.130+0000 7fdd477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:05.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.130+0000 7fde981989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:05.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.130+0000 7fde981989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:05.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.130+0000 7fde981989c0 5 note: GC not initialized 2024-09-12T00:40:05.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fdd467fc640 20 reqs_thread_entry: start 2024-09-12T00:40:05.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:05.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 20 Filter name: none 2024-09-12T00:40:05.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fdcbbfff640 20 reqs_thread_entry: start 2024-09-12T00:40:05.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:40:05.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:05.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:40:05.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:40:05.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 : miss 2024-09-12T00:40:05.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:05.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:05.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:05.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:05.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:05.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.134+0000 7fde981989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 2024-09-12T00:40:05.144 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fde981989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:05.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fde981989c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:05.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fde981989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:05.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fde981989c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37, ofs0, ns] 2024-09-12T00:40:05.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398872 cookie 94290306062416 notifier 7710 bl.length()=1007 2024-09-12T00:40:05.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:05.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:05.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:05.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_sources= new_sources= 2024-09-12T00:40:05.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential sources added=[] removed=[] 2024-09-12T00:40:05.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_dests= new_dests= 2024-09-12T00:40:05.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential dests added=[] removed=[] 2024-09-12T00:40:05.152 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde981989c0 time 2024-09-12T00:40:05.158735+0000 2024-09-12T00:40:05.152 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:05.153 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:05.153 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fde9ba722eb] 2024-09-12T00:40:05.153 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde9ba7249f] 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c1a93efcc1] 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422aac) [0x55c1a9e4daac] 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c1a9404ced] 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde9a8d8d90] 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fde981989c0 thread_name:radosgw-admin 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.154+0000 7fde981989c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde981989c0 time 2024-09-12T00:40:05.158735+0000 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.154 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:05.155 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fde9ba722eb] 2024-09-12T00:40:05.155 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde9ba7249f] 2024-09-12T00:40:05.155 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c1a93efcc1] 2024-09-12T00:40:05.155 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422aac) [0x55c1a9e4daac] 2024-09-12T00:40:05.155 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c1a9404ced] 2024-09-12T00:40:05.155 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:40:05.155 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde9a8d8d90] 2024-09-12T00:40:05.155 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:40:05.155 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:40:05.155 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.161 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:05.161 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fde9a8f1520] 2024-09-12T00:40:05.161 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:40:05.161 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:40:05.161 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fde9ba72345] 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde9ba7249f] 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c1a93efcc1] 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422aac) [0x55c1a9e4daac] 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c1a9404ced] 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde9a8d8d90] 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.154+0000 7fde981989c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:05.162 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fde981989c0 thread_name:radosgw-admin 2024-09-12T00:40:05.163 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.163 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:05.163 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fde9a8f1520] 2024-09-12T00:40:05.163 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:40:05.163 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:40:05.163 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:40:05.163 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fde9ba72345] 2024-09-12T00:40:05.163 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde9ba7249f] 2024-09-12T00:40:05.163 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c1a93efcc1] 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422aac) [0x55c1a9e4daac] 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c1a9404ced] 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde9a8d8d90] 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:40:04.842+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.164 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient(hunting): handle_auth_done global_id 7223 payload 274 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient: _finish_hunting 0 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:40:04.842+0000 7fde9549d640 1 monclient: found mon.noname-c 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:40:04.842+0000 7fde9649f640 10 monclient: get_auth_request con 0x55c1ac235d00 auth_method 0 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: dump: 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.165 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.166 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.166 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.166 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.166 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.166 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.166 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: _finish_auth 0 2024-09-12T00:40:05.166 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: _check_auth_tickets 2024-09-12T00:40:05.166 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 monclient: authenticate success, global_id 7223 2024-09-12T00:40:05.166 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: dump: 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.167 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:40:04.842+0000 7fde981989c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:40:04.842+0000 7fde981989c0 4 set_mon_vals no callback set 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:40:04.842+0000 7fde981989c0 10 monclient: shutdown 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 asok(0x55c1ac0222b0) unregister_commands rotate-key 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:40:04.842+0000 7fde981989c0 10 monclient: build_initial_monmap 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:40:04.842+0000 7fde981989c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:40:04.842+0000 7fde981989c0 10 monclient: monmap: 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:05.168 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding auth protocol: cephx 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding auth protocol: cephx 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding auth protocol: cephx 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.169 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:40:04.842+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:40:04.842+0000 7fde981989c0 1 librados: starting msgr at 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:40:04.842+0000 7fde981989c0 1 librados: starting objecter 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command objecter_requests hook 0x55c1ac2340b0 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:40:04.842+0000 7fde981989c0 1 librados: setting wanted keys 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:40:04.842+0000 7fde981989c0 1 librados: calling monclient init 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:40:04.842+0000 7fde981989c0 10 monclient: init 2024-09-12T00:40:05.170 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding auth protocol: cephx 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding auth protocol: cephx 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding auth protocol: cephx 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.171 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:40:04.842+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:40:04.846+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:40:04.846+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command rotate-key hook 0x55c1ac22fc68 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-c con 0x55c1ac0e0120 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-a con 0x55c1ac0ebe70 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-b con 0x55c1ac235d00 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.172 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): authenticate will time out at 2793.348215s 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): get_auth_request con 0x55c1ac0ebe70 auth_method 0 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): get_auth_request con 0x55c1ac0e0120 auth_method 0 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.173 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): handle_auth_done global_id 7701 payload 824 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient: _finish_hunting 0 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:40:04.846+0000 7fde9549d640 1 monclient: found mon.noname-a 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: dump: 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.174 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: _finish_auth 0 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: _check_auth_tickets 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:40:04.846+0000 7fde981989c0 5 monclient: authenticate success, global_id 7701 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:05.175 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: dump: 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:40:04.846+0000 7fdd83e07640 4 set_mon_vals no callback set 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.176 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:40:04.846+0000 7fde981989c0 1 librados: init done 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:40:04.846+0000 7fdd82604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:40:04.846+0000 7fdd82604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:40:04.846+0000 7fdd82604640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient: get_auth_request con 0x7fdd7c070ae0 auth_method 0 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:40:04.846+0000 7fde9649f640 10 monclient: get_auth_request con 0x55c1ac277c50 auth_method 0 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:40:04.850+0000 7fde95c9e640 10 monclient: get_auth_request con 0x55c1ac27aa90 auth_method 0 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:40:04.850+0000 7fde9549d640 10 monclient: get_auth_request con 0x55c1ac27ec80 auth_method 0 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient: get_auth_request con 0x55c1ac282960 auth_method 0 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient: build_initial_monmap 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:40:04.854+0000 7fde981989c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient: monmap: 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:05.177 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding auth protocol: cephx 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding auth protocol: cephx 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding auth protocol: cephx 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.178 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:40:04.854+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c1ac28a3a0 EEXIST 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient: init 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding auth protocol: cephx 2024-09-12T00:40:05.179 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding auth protocol: cephx 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding auth protocol: cephx 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.180 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:40:04.854+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:40:04.854+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command rotate-key cmddesc rotate-key hook 0x55c1ac285a50 EEXIST 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-b con 0x55c1ac2ae550 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-a con 0x55c1ac2ade80 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-c con 0x55c1ac2ac860 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): authenticate will time out at 2793.358655s 2024-09-12T00:40:05.181 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): get_auth_request con 0x55c1ac2ade80 auth_method 0 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): get_auth_request con 0x55c1ac2ac860 auth_method 0 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.182 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): handle_auth_done global_id 7704 payload 824 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient: _finish_hunting 0 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:40:04.854+0000 7fde9649f640 1 monclient: found mon.noname-a 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:40:04.854+0000 7fde9549d640 10 monclient: get_auth_request con 0x55c1ac2ae550 auth_method 0 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: dump: 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.183 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.184 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.184 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.184 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.184 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.185 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.185 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:40:05.185 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:40:05.185 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:05.185 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.186 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:05.186 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: dump: 2024-09-12T00:40:05.186 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.186 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.186 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.186 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.186 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.186 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:40:04.854+0000 7fde96ca0640 4 set_mon_vals no callback set 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 monclient: authenticate success, global_id 7704 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:40:04.858+0000 7fdd7b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:40:04.858+0000 7fdd7b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.187 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:40:04.858+0000 7fdd7b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: build_initial_monmap 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:40:04.858+0000 7fde981989c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: monmap: 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.188 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding auth protocol: cephx 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding auth protocol: cephx 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding auth protocol: cephx 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.189 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:40:04.858+0000 7fde9549d640 10 monclient: get_auth_request con 0x7fdd70070a20 auth_method 0 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:40:04.858+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: init 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding auth protocol: cephx 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding auth protocol: cephx 2024-09-12T00:40:05.190 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding auth protocol: cephx 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:40:04.858+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.191 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:40:04.858+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcd41b9658 EEXIST 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-b con 0x55c1ac3024b0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-a con 0x55c1ac2fd8a0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-c con 0x55c1ac2f3fa0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:05.192 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): authenticate will time out at 2793.363358s 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): get_auth_request con 0x55c1ac2fd8a0 auth_method 0 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): get_auth_request con 0x55c1ac2f3fa0 auth_method 0 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.193 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): handle_auth_done global_id 7707 payload 274 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient: _finish_hunting 0 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:40:04.858+0000 7fde9649f640 1 monclient: found mon.noname-a 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: dump: 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.194 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: _finish_auth 0 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: _check_auth_tickets 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 monclient: authenticate success, global_id 7707 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:05.195 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:40:04.862+0000 7fde981989c0 4 set_mon_vals no callback set 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: dump: 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.196 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: shutdown 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: build_initial_monmap 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: monmap: 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:05.197 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding auth protocol: cephx 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding auth protocol: cephx 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding auth protocol: cephx 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.198 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:40:04.862+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 librados: starting msgr at 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 librados: starting objecter 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c1ac2d2770 EEXIST 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 librados: setting wanted keys 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 librados: calling monclient init 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: init 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding auth protocol: cephx 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding auth protocol: cephx 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding auth protocol: cephx 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.199 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.200 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.200 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.200 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.200 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.200 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.200 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.200 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.200 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.200 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:40:04.862+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:40:04.862+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command rotate-key cmddesc rotate-key hook 0x55c1ac2b04b8 EEXIST 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-a con 0x55c1ac2f3fa0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-b con 0x55c1ac2fd8a0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-c con 0x55c1ac3024b0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.201 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): authenticate will time out at 2793.365934s 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): get_auth_request con 0x55c1ac2f3fa0 auth_method 0 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): get_auth_request con 0x55c1ac3024b0 auth_method 0 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.202 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): handle_auth_done global_id 7710 payload 824 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient: _finish_hunting 0 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:40:04.862+0000 7fde9549d640 1 monclient: found mon.noname-a 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:40:04.862+0000 7fde9649f640 10 monclient: get_auth_request con 0x55c1ac2fd8a0 auth_method 0 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: dump: 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.203 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: _finish_auth 0 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: _check_auth_tickets 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:05.204 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: dump: 2024-09-12T00:40:05.205 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.205 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.205 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.205 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.205 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.205 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.205 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.205 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.205 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.205 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.206 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 monclient: authenticate success, global_id 7710 2024-09-12T00:40:05.206 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.206 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:40:04.862+0000 7fdd797fa640 4 set_mon_vals no callback set 2024-09-12T00:40:05.206 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.206 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 librados: init done 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command cr dump hook 0x55c1ac2f3b08 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:40:04.866+0000 7fdd677fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:40:04.866+0000 7fdd677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:40:04.866+0000 7fdd677fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:40:04.866+0000 7fde95c9e640 10 monclient: get_auth_request con 0x55c1ac31c2b0 auth_method 0 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:40:04.866+0000 7fde9649f640 10 monclient: get_auth_request con 0x7fdd60070c80 auth_method 0 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 realm 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.207 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:40:04.866+0000 7fde981989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:40:04.866+0000 7fde9549d640 10 monclient: get_auth_request con 0x55c1ac3205f0 auth_method 0 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:40:04.870+0000 7fde9649f640 10 monclient: get_auth_request con 0x55c1ac323d30 auth_method 0 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:40:04.870+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:40:04.870+0000 7fde981989c0 20 searching for the correct realm 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:40:04.870+0000 7fde95c9e640 10 monclient: get_auth_request con 0x55c1ac328ad0 auth_method 0 2024-09-12T00:40:05.208 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:40:04.870+0000 7fde9549d640 10 monclient: get_auth_request con 0x7fde9002c070 auth_method 0 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:40:04.870+0000 7fde9649f640 10 monclient: get_auth_request con 0x7fde8c1392e0 auth_method 0 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:40:04.874+0000 7fde9649f640 0 -- 172.21.15.102:0/2523375249 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55c1ac323d30 msgr2=0x55c1ac326120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:40:04.874+0000 7fdd677fe640 1 client.7710.objecter ms_handle_reset 0x55c1ac323d30 session 0x55c1ac31fe50 osd.7 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:40:04.874+0000 7fdd677fe640 10 monclient: _renew_subs 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:40:04.874+0000 7fdd677fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:40:04.874+0000 7fde9649f640 10 monclient: get_auth_request con 0x7fdd600813a0 auth_method 0 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:40:04.874+0000 7fde95c9e640 10 monclient: get_auth_request con 0x7fde9007d7f0 auth_method 0 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:40:04.878+0000 7fde9549d640 10 monclient: get_auth_request con 0x7fde9007dbf0 auth_method 0 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:40:04.878+0000 7fde9549d640 0 -- 172.21.15.102:0/2523375249 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fde9007dbf0 msgr2=0x7fde9006c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:40:05.082+0000 7fde9549d640 10 monclient: get_auth_request con 0x7fde9007dbf0 auth_method 0 2024-09-12T00:40:05.209 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 zone default found 2024-09-12T00:40:05.210 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:40:05.098+0000 7fde981989c0 4 Realm: () 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:40:05.098+0000 7fde981989c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:40:05.098+0000 7fde981989c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:40:05.098+0000 7fde981989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 zonegroup default 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:40:05.102+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:40:05.102+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.211 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:40:05.102+0000 7fde981989c0 20 started sync module instance, tier type = 2024-09-12T00:40:05.212 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:40:05.102+0000 7fde981989c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:05.212 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=0 2024-09-12T00:40:05.212 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=1 2024-09-12T00:40:05.212 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=2 2024-09-12T00:40:05.212 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=3 2024-09-12T00:40:05.212 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=4 2024-09-12T00:40:05.212 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=5 2024-09-12T00:40:05.212 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=6 2024-09-12T00:40:05.212 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:40:05.126+0000 7fde981989c0 20 add_watcher() i=7 2024-09-12T00:40:05.212 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:40:05.126+0000 7fde981989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding auth protocol: cephx 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding auth protocol: cephx 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding auth protocol: cephx 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:40:05.130+0000 7fdd477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.213 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:40:05.130+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:40:05.130+0000 7fde981989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:40:05.130+0000 7fde981989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command cache list hook 0x55c1ac2f57c0 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command cache inspect hook 0x55c1ac2f57c0 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command cache erase hook 0x55c1ac2f57c0 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command cache zap hook 0x55c1ac2f57c0 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 note: GC not initialized 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:40:05.134+0000 7fdd467fc640 20 reqs_thread_entry: start 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:40:05.134+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command sync trace show hook 0x7fde88002220 2024-09-12T00:40:05.214 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:40:05.134+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command sync trace history hook 0x7fde88002220 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:40:05.134+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command sync trace active hook 0x7fde88002220 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:40:05.134+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command sync trace active_short hook 0x7fde88002220 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 Filter name: none 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:40:05.134+0000 7fdcbbfff640 20 reqs_thread_entry: start 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 : miss 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.215 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:05.216 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:05.216 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:05.216 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:05.216 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:05.216 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 2024-09-12T00:40:05.216 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:40:05.146+0000 7fde981989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:05.216 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:40:05.146+0000 7fde981989c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:05.216 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:40:05.146+0000 7fde981989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:05.216 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:40:05.146+0000 7fde981989c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37, ofs0, ns] 2024-09-12T00:40:05.217 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398872 cookie 94290306062416 notifier 7710 bl.length()=1007 2024-09-12T00:40:05.217 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:05.217 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:05.217 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:05.217 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_sources= new_sources= 2024-09-12T00:40:05.217 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential sources added=[] removed=[] 2024-09-12T00:40:05.218 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_dests= new_dests= 2024-09-12T00:40:05.218 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential dests added=[] removed=[] 2024-09-12T00:40:05.218 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:40:05.154+0000 7fde981989c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde981989c0 time 2024-09-12T00:40:05.158735+0000 2024-09-12T00:40:05.218 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:05.218 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.218 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:05.219 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fde9ba722eb] 2024-09-12T00:40:05.219 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde9ba7249f] 2024-09-12T00:40:05.219 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c1a93efcc1] 2024-09-12T00:40:05.219 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422aac) [0x55c1a9e4daac] 2024-09-12T00:40:05.219 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c1a9404ced] 2024-09-12T00:40:05.219 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:40:05.220 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde9a8d8d90] 2024-09-12T00:40:05.220 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:40:05.220 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:40:05.220 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.220 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:40:05.154+0000 7fde981989c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:05.220 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fde981989c0 thread_name:radosgw-admin 2024-09-12T00:40:05.221 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.221 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:05.221 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fde9a8f1520] 2024-09-12T00:40:05.221 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:40:05.221 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:40:05.221 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:40:05.222 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fde9ba72345] 2024-09-12T00:40:05.222 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde9ba7249f] 2024-09-12T00:40:05.222 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c1a93efcc1] 2024-09-12T00:40:05.222 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422aac) [0x55c1a9e4daac] 2024-09-12T00:40:05.222 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c1a9404ced] 2024-09-12T00:40:05.222 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:40:05.223 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde9a8d8d90] 2024-09-12T00:40:05.223 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:40:05.223 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:40:05.223 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:05.223 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.223 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:40:05.224 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:40:05.224 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:40:05.224 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:40:05.224 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:40:05.224 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:40:05.225 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:05.225 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:40:05.225 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:40:05.225 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:05.225 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:05.225 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:05.225 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:40:05.226 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:40:05.226 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:40:05.226 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:40:05.226 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:40:05.226 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:40:05.226 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:40:05.226 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:05.226 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:05.226 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:05.226 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:40:05.227 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:40:05.227 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:05.227 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:40:05.227 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:40:05.227 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:40:05.227 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:40:05.227 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:40:05.227 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:40:05.227 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:40:05.227 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:40:05.228 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:40:05.228 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:40:05.228 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:40:05.228 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:40:05.228 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:40:05.229 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:40:05.229 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:40:05.229 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:05.229 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:40:05.229 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:40:05.229 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:05.230 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:05.230 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:40:05.230 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:05.230 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:05.230 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:05.230 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:40:05.231 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:40:05.231 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:40:05.231 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:40:05.231 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:40:05.231 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:40:05.231 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:40:05.232 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:40:05.232 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:40:05.232 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:40:05.232 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:40:05.232 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:40:05.233 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:40:05.233 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:40:05.233 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:40:05.233 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:40:05.233 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:40:05.234 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:40:05.234 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:05.234 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:05.234 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:05.234 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:40:05.234 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:05.235 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:05.235 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:05.235 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:05.235 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:40:05.235 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:05.235 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:05.236 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:05.236 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:05.236 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:05.236 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:05.236 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:40:05.236 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:05.237 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:40:05.237 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:40:05.237 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:40:05.237 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:05.237 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:40:05.237 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:40:05.238 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:05.238 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:05.238 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:05.238 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:05.238 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdcbbfff640 / http_manager 2024-09-12T00:40:05.239 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd467fc640 / http_manager 2024-09-12T00:40:05.239 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd477fe640 / rgw_dt_lg_renew 2024-09-12T00:40:05.239 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd677fe640 / ms_dispatch 2024-09-12T00:40:05.239 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd797fa640 / io_context_pool 2024-09-12T00:40:05.239 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd7b7fe640 / ms_dispatch 2024-09-12T00:40:05.239 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd82604640 / ms_dispatch 2024-09-12T00:40:05.240 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd83e07640 / io_context_pool 2024-09-12T00:40:05.240 INFO:tasks.workunit.client.0.smithi102.stderr: 7fde9549d640 / msgr-worker-2 2024-09-12T00:40:05.240 INFO:tasks.workunit.client.0.smithi102.stderr: 7fde95c9e640 / msgr-worker-1 2024-09-12T00:40:05.240 INFO:tasks.workunit.client.0.smithi102.stderr: 7fde9649f640 / msgr-worker-0 2024-09-12T00:40:05.240 INFO:tasks.workunit.client.0.smithi102.stderr: 7fde96ca0640 / io_context_pool 2024-09-12T00:40:05.240 INFO:tasks.workunit.client.0.smithi102.stderr: 7fde981989c0 / radosgw-admin 2024-09-12T00:40:05.241 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:40:05.241 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:40:05.241 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.128312.log 2024-09-12T00:40:05.241 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:40:05.241 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:40:05.242 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:40:04.842+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.242 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.242 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.242 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.242 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient(hunting): handle_auth_done global_id 7223 payload 274 2024-09-12T00:40:05.242 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient: _finish_hunting 0 2024-09-12T00:40:05.243 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:40:04.842+0000 7fde9549d640 1 monclient: found mon.noname-c 2024-09-12T00:40:05.243 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:40:04.842+0000 7fde9549d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:40:05.243 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:40:04.842+0000 7fde9649f640 10 monclient: get_auth_request con 0x55c1ac235d00 auth_method 0 2024-09-12T00:40:05.243 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.243 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:05.243 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: dump: 2024-09-12T00:40:05.244 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.244 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.244 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.244 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.244 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.245 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.245 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.245 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.245 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.245 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.245 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: _finish_auth 0 2024-09-12T00:40:05.246 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: _check_auth_tickets 2024-09-12T00:40:05.246 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 monclient: authenticate success, global_id 7223 2024-09-12T00:40:05.246 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:05.246 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.246 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:05.247 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:40:04.842+0000 7fdd83e07640 10 monclient: dump: 2024-09-12T00:40:05.247 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.247 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.247 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.247 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.247 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.248 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.248 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.248 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.248 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.248 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.248 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:40:04.842+0000 7fde981989c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:05.249 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:40:04.842+0000 7fde981989c0 4 set_mon_vals no callback set 2024-09-12T00:40:05.249 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:40:04.842+0000 7fde981989c0 10 monclient: shutdown 2024-09-12T00:40:05.249 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 asok(0x55c1ac0222b0) unregister_commands rotate-key 2024-09-12T00:40:05.249 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:40:04.842+0000 7fde981989c0 10 monclient: build_initial_monmap 2024-09-12T00:40:05.249 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:40:04.842+0000 7fde981989c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:05.249 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:40:04.842+0000 7fde981989c0 10 monclient: monmap: 2024-09-12T00:40:05.249 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:05.250 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:05.250 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:05.250 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:05.250 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:05.250 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.250 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:05.251 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:05.251 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:05.251 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.251 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding auth protocol: cephx 2024-09-12T00:40:05.251 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding auth protocol: cephx 2024-09-12T00:40:05.251 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding auth protocol: cephx 2024-09-12T00:40:05.251 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.252 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.252 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.252 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.252 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.252 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.252 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.252 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.252 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: crc 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac234e70) adding con mode: secure 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:40:04.842+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:40:04.842+0000 7fde981989c0 1 librados: starting msgr at 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:40:04.842+0000 7fde981989c0 1 librados: starting objecter 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command objecter_requests hook 0x55c1ac2340b0 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:40:04.842+0000 7fde981989c0 1 librados: setting wanted keys 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:40:04.842+0000 7fde981989c0 1 librados: calling monclient init 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:40:04.842+0000 7fde981989c0 10 monclient: init 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding auth protocol: cephx 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding auth protocol: cephx 2024-09-12T00:40:05.253 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding auth protocol: cephx 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: crc 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:40:04.842+0000 7fde981989c0 5 AuthRegistry(0x55c1ac22fb20) adding con mode: secure 2024-09-12T00:40:05.254 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:40:04.842+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:40:04.846+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:40:04.846+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command rotate-key hook 0x55c1ac22fc68 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-c con 0x55c1ac0e0120 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-a con 0x55c1ac0ebe70 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-b con 0x55c1ac235d00 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.255 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient(hunting): authenticate will time out at 2793.348215s 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): get_auth_request con 0x55c1ac0ebe70 auth_method 0 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): get_auth_request con 0x55c1ac0e0120 auth_method 0 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.256 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient(hunting): handle_auth_done global_id 7701 payload 824 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient: _finish_hunting 0 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:40:04.846+0000 7fde9549d640 1 monclient: found mon.noname-a 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:40:04.846+0000 7fde9549d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: dump: 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.257 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: _finish_auth 0 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: _check_auth_tickets 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:40:04.846+0000 7fde981989c0 5 monclient: authenticate success, global_id 7701 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.258 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:40:04.846+0000 7fdd82604640 10 monclient: dump: 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.259 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:40:04.846+0000 7fdd83e07640 4 set_mon_vals no callback set 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:40:04.846+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:40:04.846+0000 7fde981989c0 1 librados: init done 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:40:04.846+0000 7fdd82604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:40:04.846+0000 7fdd82604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:40:04.846+0000 7fdd82604640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:40:04.846+0000 7fde95c9e640 10 monclient: get_auth_request con 0x7fdd7c070ae0 auth_method 0 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:40:04.846+0000 7fde9649f640 10 monclient: get_auth_request con 0x55c1ac277c50 auth_method 0 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:40:04.850+0000 7fde95c9e640 10 monclient: get_auth_request con 0x55c1ac27aa90 auth_method 0 2024-09-12T00:40:05.260 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:40:04.850+0000 7fde9549d640 10 monclient: get_auth_request con 0x55c1ac27ec80 auth_method 0 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient: get_auth_request con 0x55c1ac282960 auth_method 0 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient: build_initial_monmap 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:40:04.854+0000 7fde981989c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient: monmap: 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:05.261 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding auth protocol: cephx 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding auth protocol: cephx 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding auth protocol: cephx 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.262 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.263 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.263 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.263 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: crc 2024-09-12T00:40:05.263 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2869c0) adding con mode: secure 2024-09-12T00:40:05.263 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:40:04.854+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.263 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c1ac28a3a0 EEXIST 2024-09-12T00:40:05.263 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient: init 2024-09-12T00:40:05.263 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding auth protocol: cephx 2024-09-12T00:40:05.263 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding auth protocol: cephx 2024-09-12T00:40:05.264 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding auth protocol: cephx 2024-09-12T00:40:05.264 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.264 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.264 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.264 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.264 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.264 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.264 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.264 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.264 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: crc 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 AuthRegistry(0x55c1ac285908) adding con mode: secure 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:40:04.854+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:40:04.854+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:40:04.854+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command rotate-key cmddesc rotate-key hook 0x55c1ac285a50 EEXIST 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-b con 0x55c1ac2ae550 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-a con 0x55c1ac2ade80 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-c con 0x55c1ac2ac860 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.265 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.266 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:05.266 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:40:04.854+0000 7fde981989c0 10 monclient(hunting): authenticate will time out at 2793.358655s 2024-09-12T00:40:05.266 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): get_auth_request con 0x55c1ac2ade80 auth_method 0 2024-09-12T00:40:05.266 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.266 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.266 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.266 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): get_auth_request con 0x55c1ac2ac860 auth_method 0 2024-09-12T00:40:05.266 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.266 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.267 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.267 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.267 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.267 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.267 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.267 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.267 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:40:04.854+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.267 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient(hunting): handle_auth_done global_id 7704 payload 824 2024-09-12T00:40:05.267 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient: _finish_hunting 0 2024-09-12T00:40:05.268 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:40:04.854+0000 7fde9649f640 1 monclient: found mon.noname-a 2024-09-12T00:40:05.268 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:40:04.854+0000 7fde9649f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.268 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:40:04.854+0000 7fde9549d640 10 monclient: get_auth_request con 0x55c1ac2ae550 auth_method 0 2024-09-12T00:40:05.268 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.268 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:05.268 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: dump: 2024-09-12T00:40:05.268 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.268 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.268 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.269 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.269 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.269 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.269 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.269 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.269 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.269 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.269 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:40:05.270 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:40:05.270 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:05.270 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.270 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:05.270 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:40:04.854+0000 7fdd7b7fe640 10 monclient: dump: 2024-09-12T00:40:05.270 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.270 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.270 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.271 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.271 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.271 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.271 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.271 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.271 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.271 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.271 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:40:04.854+0000 7fde96ca0640 4 set_mon_vals no callback set 2024-09-12T00:40:05.272 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 monclient: authenticate success, global_id 7704 2024-09-12T00:40:05.272 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.272 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.272 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.272 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.272 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:40:04.858+0000 7fdd7b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:05.272 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:40:04.858+0000 7fdd7b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.272 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:40:04.858+0000 7fdd7b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: build_initial_monmap 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:40:04.858+0000 7fde981989c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: monmap: 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:05.273 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding auth protocol: cephx 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding auth protocol: cephx 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding auth protocol: cephx 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.274 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: crc 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2cdf50) adding con mode: secure 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:40:04.858+0000 7fde9549d640 10 monclient: get_auth_request con 0x7fdd70070a20 auth_method 0 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:40:04.858+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: init 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding auth protocol: cephx 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding auth protocol: cephx 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding auth protocol: cephx 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.275 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: crc 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b9510) adding con mode: secure 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:40:04.858+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:40:04.858+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:40:04.858+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcd41b9658 EEXIST 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:05.276 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-b con 0x55c1ac3024b0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:05.277 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-a con 0x55c1ac2fd8a0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:05.277 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-c con 0x55c1ac2f3fa0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:05.277 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.277 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.277 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.277 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:05.277 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:40:04.858+0000 7fde981989c0 10 monclient(hunting): authenticate will time out at 2793.363358s 2024-09-12T00:40:05.277 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): get_auth_request con 0x55c1ac2fd8a0 auth_method 0 2024-09-12T00:40:05.277 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): get_auth_request con 0x55c1ac2f3fa0 auth_method 0 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:40:04.858+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.278 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient(hunting): handle_auth_done global_id 7707 payload 274 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient: _finish_hunting 0 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:40:04.858+0000 7fde9649f640 1 monclient: found mon.noname-a 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:40:04.858+0000 7fde9649f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: dump: 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.279 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: _finish_auth 0 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: _check_auth_tickets 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 monclient: authenticate success, global_id 7707 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:40:04.862+0000 7fde981989c0 4 set_mon_vals no callback set 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:40:04.862+0000 7fdd797fa640 10 monclient: dump: 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.280 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: shutdown 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: build_initial_monmap 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:05.281 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: monmap: 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding auth protocol: cephx 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding auth protocol: cephx 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding auth protocol: cephx 2024-09-12T00:40:05.282 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: crc 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2fe710) adding con mode: secure 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:40:04.862+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 librados: starting msgr at 2024-09-12T00:40:05.283 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 librados: starting objecter 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c1ac2d2770 EEXIST 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 librados: setting wanted keys 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 librados: calling monclient init 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: init 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding auth protocol: cephx 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding auth protocol: cephx 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding auth protocol: cephx 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.284 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: crc 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 AuthRegistry(0x55c1ac2b0370) adding con mode: secure 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:40:04.862+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:40:04.862+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command rotate-key cmddesc rotate-key hook 0x55c1ac2b04b8 EEXIST 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-a con 0x55c1ac2f3fa0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-b con 0x55c1ac2fd8a0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): picked mon.noname-c con 0x55c1ac3024b0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.285 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient(hunting): authenticate will time out at 2793.365934s 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): get_auth_request con 0x55c1ac2f3fa0 auth_method 0 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): get_auth_request con 0x55c1ac3024b0 auth_method 0 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.286 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:40:04.862+0000 7fde95c9e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient(hunting): handle_auth_done global_id 7710 payload 824 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient: _finish_hunting 0 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:40:04.862+0000 7fde9549d640 1 monclient: found mon.noname-a 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:40:04.862+0000 7fde9549d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:40:04.862+0000 7fde9649f640 10 monclient: get_auth_request con 0x55c1ac2fd8a0 auth_method 0 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: dump: 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.287 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: _finish_auth 0 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: _check_auth_tickets 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:40:04.862+0000 7fdd677fe640 10 monclient: dump: 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:05.288 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 monclient: authenticate success, global_id 7710 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:40:04.862+0000 7fdd797fa640 4 set_mon_vals no callback set 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _renew_subs 2024-09-12T00:40:05.289 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:40:04.862+0000 7fde981989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:40:04.862+0000 7fde981989c0 1 librados: init done 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:40:04.862+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command cr dump hook 0x55c1ac2f3b08 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:40:04.866+0000 7fdd677fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:40:04.866+0000 7fdd677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:40:04.866+0000 7fdd677fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:40:04.866+0000 7fde95c9e640 10 monclient: get_auth_request con 0x55c1ac31c2b0 auth_method 0 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:40:04.866+0000 7fde9649f640 10 monclient: get_auth_request con 0x7fdd60070c80 auth_method 0 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 realm 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:40:04.866+0000 7fde981989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:05.290 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:40:04.866+0000 7fde9549d640 10 monclient: get_auth_request con 0x55c1ac3205f0 auth_method 0 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:40:04.866+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:40:04.870+0000 7fde9649f640 10 monclient: get_auth_request con 0x55c1ac323d30 auth_method 0 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:40:04.870+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:40:04.870+0000 7fde981989c0 20 searching for the correct realm 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:40:04.870+0000 7fde95c9e640 10 monclient: get_auth_request con 0x55c1ac328ad0 auth_method 0 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:40:04.870+0000 7fde9549d640 10 monclient: get_auth_request con 0x7fde9002c070 auth_method 0 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:40:04.870+0000 7fde9649f640 10 monclient: get_auth_request con 0x7fde8c1392e0 auth_method 0 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:40:04.874+0000 7fde9649f640 0 -- 172.21.15.102:0/2523375249 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55c1ac323d30 msgr2=0x55c1ac326120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:40:04.874+0000 7fdd677fe640 1 client.7710.objecter ms_handle_reset 0x55c1ac323d30 session 0x55c1ac31fe50 osd.7 2024-09-12T00:40:05.291 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:40:04.874+0000 7fdd677fe640 10 monclient: _renew_subs 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:40:04.874+0000 7fdd677fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:40:04.874+0000 7fde9649f640 10 monclient: get_auth_request con 0x7fdd600813a0 auth_method 0 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:40:04.874+0000 7fde95c9e640 10 monclient: get_auth_request con 0x7fde9007d7f0 auth_method 0 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:40:04.878+0000 7fde9549d640 10 monclient: get_auth_request con 0x7fde9007dbf0 auth_method 0 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:40:04.878+0000 7fde9549d640 0 -- 172.21.15.102:0/2523375249 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fde9007dbf0 msgr2=0x7fde9006c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:40:05.082+0000 7fde9549d640 10 monclient: get_auth_request con 0x7fde9007dbf0 auth_method 0 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:05.292 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 zone default found 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:40:05.098+0000 7fde981989c0 4 Realm: () 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:40:05.098+0000 7fde981989c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:40:05.098+0000 7fde981989c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:40:05.098+0000 7fde981989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 zonegroup default 2024-09-12T00:40:05.293 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:40:05.098+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:40:05.102+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:40:05.102+0000 7fde981989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:40:05.102+0000 7fde981989c0 20 started sync module instance, tier type = 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:40:05.102+0000 7fde981989c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=0 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=1 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=2 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=3 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=4 2024-09-12T00:40:05.294 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=5 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:40:05.122+0000 7fde981989c0 20 add_watcher() i=6 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:40:05.126+0000 7fde981989c0 20 add_watcher() i=7 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:40:05.126+0000 7fde981989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding auth protocol: cephx 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding auth protocol: cephx 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding auth protocol: cephx 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.295 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:40:05.130+0000 7fdd477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: crc 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 AuthRegistry(0x7ffcd41b99f0) adding con mode: secure 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:40:05.130+0000 7fde981989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:40:05.130+0000 7fde981989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:40:05.130+0000 7fde981989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command cache list hook 0x55c1ac2f57c0 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command cache inspect hook 0x55c1ac2f57c0 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command cache erase hook 0x55c1ac2f57c0 2024-09-12T00:40:05.296 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command cache zap hook 0x55c1ac2f57c0 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:40:05.130+0000 7fde981989c0 5 note: GC not initialized 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:40:05.134+0000 7fdd467fc640 20 reqs_thread_entry: start 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:40:05.134+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command sync trace show hook 0x7fde88002220 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:40:05.134+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command sync trace history hook 0x7fde88002220 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:40:05.134+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command sync trace active hook 0x7fde88002220 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:40:05.134+0000 7fde981989c0 5 asok(0x55c1ac0222b0) register_command sync trace active_short hook 0x7fde88002220 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 Filter name: none 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:40:05.134+0000 7fdcbbfff640 20 reqs_thread_entry: start 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:40:05.297 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 : miss 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:40:05.134+0000 7fde981989c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:40:05.134+0000 7fde981989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:40:05.146+0000 7fde981989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:40:05.146+0000 7fde981989c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:05.298 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:40:05.146+0000 7fde981989c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:40:05.146+0000 7fde981989c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37, ofs0, ns] 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398872 cookie 94290306062416 notifier 7710 bl.length()=1007 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:40:05.146+0000 7fdd797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_sources= new_sources= 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential sources added=[] removed=[] 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_dests= new_dests= 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:40:05.146+0000 7fde981989c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential dests added=[] removed=[] 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:40:05.154+0000 7fde981989c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde981989c0 time 2024-09-12T00:40:05.158735+0000 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:05.299 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fde9ba722eb] 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde9ba7249f] 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c1a93efcc1] 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422aac) [0x55c1a9e4daac] 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c1a9404ced] 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde9a8d8d90] 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:40:05.154+0000 7fde981989c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fde981989c0 thread_name:radosgw-admin 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.300 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fde9a8f1520] 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fde9ba72345] 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fde9ba7249f] 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c1a93efcc1] 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422aac) [0x55c1a9e4daac] 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55c1a9404ced] 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fde9a8d8d90] 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:40:05.301 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:05.302 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:40:05.303 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:40:05.304 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:40:05.305 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:05.306 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:05.307 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdcbbfff640 / http_manager 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd467fc640 / http_manager 2024-09-12T00:40:05.308 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd477fe640 / rgw_dt_lg_renew 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd677fe640 / ms_dispatch 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd797fa640 / io_context_pool 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd7b7fe640 / ms_dispatch 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd82604640 / ms_dispatch 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: 7fdd83e07640 / io_context_pool 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: 7fde9549d640 / msgr-worker-2 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: 7fde95c9e640 / msgr-worker-1 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: 7fde9649f640 / msgr-worker-0 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: 7fde96ca0640 / io_context_pool 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: 7fde981989c0 / radosgw-admin 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:40:05.309 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:40:05.161257Z_fb51e22d-7a33-4fb5-9944-274ec51ae4ce/log 2024-09-12T00:40:05.310 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:40:05.311 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:40:05.311 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:40:05.311 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:05.311 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:05.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.242+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.311 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.242+0000 7f28effb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.242+0000 7f28effb09c0 20 realm 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.242+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.242+0000 7f28effb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.242+0000 7f28effb09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.242+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.242+0000 7f28effb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.242+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.246+0000 7f28effb09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.246+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.246+0000 7f28effb09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.246+0000 7f28effb09c0 20 searching for the correct realm 2024-09-12T00:40:05.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.250+0000 7f28ed2b5640 0 -- 172.21.15.102:0/748934547 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x55df4e0cfdf0 msgr2=0x7f28e80af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:05.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.466+0000 7f28ee2b7640 0 -- 172.21.15.102:0/748934547 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55df4e30fec0 msgr2=0x55df4e3122b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:05.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:05.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:05.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:05.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:05.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:05.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:05.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:05.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:05.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 zone default found 2024-09-12T00:40:05.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 4 Realm: () 2024-09-12T00:40:05.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:05.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:05.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:05.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 zonegroup default 2024-09-12T00:40:05.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.482+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.486+0000 7f28effb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.486+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.486+0000 7f28effb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.486+0000 7f28effb09c0 20 started sync module instance, tier type = 2024-09-12T00:40:05.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.486+0000 7f28effb09c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:05.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.510+0000 7f28effb09c0 20 add_watcher() i=0 2024-09-12T00:40:05.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.510+0000 7f28effb09c0 20 add_watcher() i=1 2024-09-12T00:40:05.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.510+0000 7f28effb09c0 20 add_watcher() i=2 2024-09-12T00:40:05.508 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.510+0000 7f28effb09c0 20 add_watcher() i=3 2024-09-12T00:40:05.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.510+0000 7f28effb09c0 20 add_watcher() i=4 2024-09-12T00:40:05.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.510+0000 7f28effb09c0 20 add_watcher() i=5 2024-09-12T00:40:05.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.510+0000 7f28effb09c0 20 add_watcher() i=6 2024-09-12T00:40:05.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.510+0000 7f28effb09c0 20 add_watcher() i=7 2024-09-12T00:40:05.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.510+0000 7f28effb09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:05.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.514+0000 7f279ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:05.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.514+0000 7f28effb09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:05.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.514+0000 7f28effb09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:05.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f28effb09c0 5 note: GC not initialized 2024-09-12T00:40:05.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f279effd640 20 reqs_thread_entry: start 2024-09-12T00:40:05.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f28effb09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:05.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f28effb09c0 20 Filter name: none 2024-09-12T00:40:05.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f279cff9640 20 reqs_thread_entry: start 2024-09-12T00:40:05.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f28effb09c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:05.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f28effb09c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:40:05.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f28effb09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:05.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.518+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.522+0000 7f28effb09c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:05.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.522+0000 7f28effb09c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.522+0000 7f28effb09c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:40:05.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.522+0000 7f28effb09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:05.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.526+0000 7f279ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:05.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.530+0000 7f28effb09c0 20 remove_watcher() i=0 2024-09-12T00:40:05.529 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.530+0000 7f28effb09c0 2 removed watcher, disabling cache 2024-09-12T00:40:05.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.530+0000 7f28effb09c0 20 remove_watcher() i=1 2024-09-12T00:40:05.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.534+0000 7f28effb09c0 20 remove_watcher() i=2 2024-09-12T00:40:05.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.538+0000 7f28effb09c0 20 remove_watcher() i=3 2024-09-12T00:40:05.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.538+0000 7f28effb09c0 20 remove_watcher() i=4 2024-09-12T00:40:05.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.542+0000 7f28effb09c0 20 remove_watcher() i=5 2024-09-12T00:40:05.541 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.542+0000 7f28effb09c0 20 remove_watcher() i=6 2024-09-12T00:40:05.543 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.542+0000 7f28effb09c0 20 remove_watcher() i=7 2024-09-12T00:40:05.563 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.563 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:05.564 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-logrecord-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:05.564 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:05.565 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:05.565 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:05.612 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:05.613 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:05.673 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:05.709 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:05.709 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:05.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.754+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.758+0000 7fabf4c2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.758+0000 7fabf4c2c9c0 20 realm 2024-09-12T00:40:05.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.758+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.758+0000 7fabf4c2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.758+0000 7fabf4c2c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:05.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.758+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.758+0000 7fabf4c2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.758+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.758+0000 7fabf4c2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:05.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.758+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.762+0000 7fabf4c2c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:05.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.762+0000 7fabf4c2c9c0 20 searching for the correct realm 2024-09-12T00:40:05.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.766+0000 7fabf2732640 0 -- 172.21.15.102:0/134903966 >> [v2:172.21.15.102:6824/1865676346,v1:172.21.15.102:6825/1865676346] conn(0x55aa61482c60 msgr2=0x55aa614850f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:05.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.770+0000 7fabf1f31640 0 -- 172.21.15.102:0/134903966 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fabec06a770 msgr2=0x7fabec095720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:05.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:05.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:05.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:05.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:05.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:05.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:05.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:05.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:05.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 zone default found 2024-09-12T00:40:05.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 4 Realm: () 2024-09-12T00:40:05.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:05.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:05.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:05.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 zonegroup default 2024-09-12T00:40:05.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.778+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.782+0000 7fabf4c2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.782+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.782+0000 7fabf4c2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.782+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.782+0000 7fabf4c2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:05.782 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.782+0000 7fabf4c2c9c0 20 started sync module instance, tier type = 2024-09-12T00:40:05.782 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.782+0000 7fabf4c2c9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:05.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.798+0000 7fabf4c2c9c0 20 add_watcher() i=0 2024-09-12T00:40:05.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.798+0000 7fabf4c2c9c0 20 add_watcher() i=1 2024-09-12T00:40:05.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.798+0000 7fabf4c2c9c0 20 add_watcher() i=2 2024-09-12T00:40:05.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.798+0000 7fabf4c2c9c0 20 add_watcher() i=3 2024-09-12T00:40:05.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.798+0000 7fabf4c2c9c0 20 add_watcher() i=4 2024-09-12T00:40:05.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.798+0000 7fabf4c2c9c0 20 add_watcher() i=5 2024-09-12T00:40:05.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.798+0000 7fabf4c2c9c0 20 add_watcher() i=6 2024-09-12T00:40:05.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.798+0000 7fabf4c2c9c0 20 add_watcher() i=7 2024-09-12T00:40:05.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.798+0000 7fabf4c2c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:05.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.798+0000 7faaa8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:05.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:05.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:05.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 5 note: GC not initialized 2024-09-12T00:40:05.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7faa237fe640 20 reqs_thread_entry: start 2024-09-12T00:40:05.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:05.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 20 Filter name: none 2024-09-12T00:40:05.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7faa217fa640 20 reqs_thread_entry: start 2024-09-12T00:40:05.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:40:05.801 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:05.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:40:05.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:40:05.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 : miss 2024-09-12T00:40:05.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:05.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:40:05.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:05.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:05.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:05.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:05.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 2024-09-12T00:40:05.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.802+0000 7fabf4c2c9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to be held by another RGW process; skipping for now 2024-09-12T00:40:05.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.806+0000 7faaa8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:05.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.810+0000 7fabf4c2c9c0 20 remove_watcher() i=0 2024-09-12T00:40:05.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.810+0000 7fabf4c2c9c0 2 removed watcher, disabling cache 2024-09-12T00:40:05.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.810+0000 7fabf4c2c9c0 20 remove_watcher() i=1 2024-09-12T00:40:05.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.814+0000 7fabf4c2c9c0 20 remove_watcher() i=2 2024-09-12T00:40:05.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.814+0000 7fabf4c2c9c0 20 remove_watcher() i=3 2024-09-12T00:40:05.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.818+0000 7fabf4c2c9c0 20 remove_watcher() i=4 2024-09-12T00:40:05.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.818+0000 7fabf4c2c9c0 20 remove_watcher() i=5 2024-09-12T00:40:05.820 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.822+0000 7fabf4c2c9c0 20 remove_watcher() i=6 2024-09-12T00:40:05.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:05.822+0000 7fabf4c2c9c0 20 remove_watcher() i=7 2024-09-12T00:40:05.835 INFO:tasks.workunit.client.0.smithi102.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:40:35.867 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:35.903 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:35.903 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:35.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.953+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.953+0000 7f9db2b079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.953+0000 7f9db2b079c0 20 realm 2024-09-12T00:40:35.950 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.953+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.953+0000 7f9db2b079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.953+0000 7f9db2b079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:35.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.953+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.953+0000 7f9db2b079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:35.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.953+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.957+0000 7f9db2b079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:35.952 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.957+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:35.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.957+0000 7f9db2b079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:35.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.957+0000 7f9db2b079c0 20 searching for the correct realm 2024-09-12T00:40:35.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:35.961+0000 7f9db0e0e640 0 -- 172.21.15.102:0/591107987 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f9da4048070 msgr2=0x7f9da4056940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:36.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.177+0000 7f9dafe0c640 0 -- 172.21.15.102:0/591107987 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f9da808d8d0 msgr2=0x7f9da8026aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:36.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.393+0000 7f9db2b079c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:36.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.393+0000 7f9db2b079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:36.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.393+0000 7f9db2b079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:36.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.393+0000 7f9db2b079c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:36.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.393+0000 7f9db2b079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:36.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.393+0000 7f9db2b079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:36.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.393+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.393+0000 7f9db2b079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:36.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.393+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:36.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:36.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 zone default found 2024-09-12T00:40:36.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 4 Realm: () 2024-09-12T00:40:36.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:36.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:36.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:36.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 zonegroup default 2024-09-12T00:40:36.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:36.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:36.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:36.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 started sync module instance, tier type = 2024-09-12T00:40:36.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.397+0000 7f9db2b079c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:36.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.421+0000 7f9db2b079c0 20 add_watcher() i=0 2024-09-12T00:40:36.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.421+0000 7f9db2b079c0 20 add_watcher() i=1 2024-09-12T00:40:36.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.421+0000 7f9db2b079c0 20 add_watcher() i=2 2024-09-12T00:40:36.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.421+0000 7f9db2b079c0 20 add_watcher() i=3 2024-09-12T00:40:36.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.421+0000 7f9db2b079c0 20 add_watcher() i=4 2024-09-12T00:40:36.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.421+0000 7f9db2b079c0 20 add_watcher() i=5 2024-09-12T00:40:36.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.421+0000 7f9db2b079c0 20 add_watcher() i=6 2024-09-12T00:40:36.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.425+0000 7f9db2b079c0 20 add_watcher() i=7 2024-09-12T00:40:36.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.425+0000 7f9db2b079c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:36.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.429+0000 7f9c667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:36.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.429+0000 7f9db2b079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:36.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.429+0000 7f9db2b079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:36.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.429+0000 7f9db2b079c0 5 note: GC not initialized 2024-09-12T00:40:36.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.429+0000 7f9c657e2640 20 reqs_thread_entry: start 2024-09-12T00:40:36.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.429+0000 7f9db2b079c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:36.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.429+0000 7f9db2b079c0 20 Filter name: none 2024-09-12T00:40:36.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.429+0000 7f9bd6ffd640 20 reqs_thread_entry: start 2024-09-12T00:40:36.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.429+0000 7f9db2b079c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:40:36.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.429+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.428 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:36.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:40:36.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:40:36.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 : miss 2024-09-12T00:40:36.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:40:36.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:36.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:36.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:36.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:36.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 2024-09-12T00:40:36.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.433+0000 7f9db2b079c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:40:36.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9db2b079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:36.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9db2b079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:36.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9db2b079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:36.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9db2b079c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37, ofs0, ns] 2024-09-12T00:40:36.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9c8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 93911124298832 notifier 7767 bl.length()=1007 2024-09-12T00:40:36.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9c8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:36.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9c8effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:36.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9c8effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:36.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_sources= new_sources= 2024-09-12T00:40:36.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential sources added=[] removed=[] 2024-09-12T00:40:36.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_dests= new_dests= 2024-09-12T00:40:36.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.449+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential dests added=[] removed=[] 2024-09-12T00:40:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.0 2024-09-12T00:40:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.0 2024-09-12T00:40:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.1 2024-09-12T00:40:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.1 2024-09-12T00:40:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.2 2024-09-12T00:40:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.2 2024-09-12T00:40:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.3 2024-09-12T00:40:36.459 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.3 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.4 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.4 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.5 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.5 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.6 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.6 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.7 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.7 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.8 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.8 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.9 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.9 2024-09-12T00:40:36.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.10 2024-09-12T00:40:36.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.10 2024-09-12T00:40:36.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.11 2024-09-12T00:40:36.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2.11 2024-09-12T00:40:36.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.0 2024-09-12T00:40:36.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.461+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.1 2024-09-12T00:40:36.461 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.465+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2 2024-09-12T00:40:36.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.465+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.3 2024-09-12T00:40:36.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.465+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.4 2024-09-12T00:40:36.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.469+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.5 2024-09-12T00:40:36.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.469+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.6 2024-09-12T00:40:36.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.469+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.7 2024-09-12T00:40:36.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.469+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.8 2024-09-12T00:40:36.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.473+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.9 2024-09-12T00:40:36.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.473+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.10 2024-09-12T00:40:36.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.481+0000 7f9db2b079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:36.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.481+0000 7f9db2b079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 2024-09-12T00:40:36.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.481+0000 7f9db2b079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:36.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9db2b079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:36.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9db2b079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:36.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9db2b079c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37, ofs0, ns] 2024-09-12T00:40:36.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9c8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398874 cookie 93911124298832 notifier 7767 bl.length()=1007 2024-09-12T00:40:36.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9c8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:36.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9c8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:36.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9c8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:36.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_sources= new_sources= 2024-09-12T00:40:36.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential sources added=[] removed=[] 2024-09-12T00:40:36.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_dests= new_dests= 2024-09-12T00:40:36.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.485+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential dests added=[] removed=[] 2024-09-12T00:40:36.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.493+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.0 2024-09-12T00:40:36.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.493+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.1 2024-09-12T00:40:36.490 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.493+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.2 2024-09-12T00:40:36.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.493+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.3 2024-09-12T00:40:36.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.493+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.4 2024-09-12T00:40:36.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.497+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.5 2024-09-12T00:40:36.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.497+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.6 2024-09-12T00:40:36.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.497+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.7 2024-09-12T00:40:36.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.497+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.8 2024-09-12T00:40:36.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.497+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.9 2024-09-12T00:40:36.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9db2b079c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37.10 2024-09-12T00:40:36.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9db2b079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:36.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9db2b079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 2024-09-12T00:40:36.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9db2b079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:36.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9db2b079c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:36.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9db2b079c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:36.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9db2b079c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37, ofs0, ns] 2024-09-12T00:40:36.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9c8f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398875 cookie 93911124298832 notifier 7767 bl.length()=975 2024-09-12T00:40:36.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9c8f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 info.flags=0x17 2024-09-12T00:40:36.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9c8f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 to cache LRU end 2024-09-12T00:40:36.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.501+0000 7f9c8f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:36.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.505+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_sources= new_sources= 2024-09-12T00:40:36.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.505+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential sources added=[] removed=[] 2024-09-12T00:40:36.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.505+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): orig_dests= new_dests= 2024-09-12T00:40:36.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.505+0000 7f9db2b079c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37]): potential dests added=[] removed=[] 2024-09-12T00:40:36.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.509+0000 7f9db2b079c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:40:36.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.513+0000 7f9c667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:36.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.517+0000 7f9db2b079c0 20 remove_watcher() i=0 2024-09-12T00:40:36.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.517+0000 7f9db2b079c0 2 removed watcher, disabling cache 2024-09-12T00:40:36.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.521+0000 7f9db2b079c0 20 remove_watcher() i=1 2024-09-12T00:40:36.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.521+0000 7f9db2b079c0 20 remove_watcher() i=2 2024-09-12T00:40:36.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.525+0000 7f9db2b079c0 20 remove_watcher() i=3 2024-09-12T00:40:36.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.525+0000 7f9db2b079c0 20 remove_watcher() i=4 2024-09-12T00:40:36.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.529+0000 7f9db2b079c0 20 remove_watcher() i=5 2024-09-12T00:40:36.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.529+0000 7f9db2b079c0 20 remove_watcher() i=6 2024-09-12T00:40:36.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.533+0000 7f9db2b079c0 20 remove_watcher() i=7 2024-09-12T00:40:36.545 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:40:36.574 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:36.574 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:36.621 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.625+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.625+0000 7f096e8b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:36.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.625+0000 7f096e8b59c0 20 realm 2024-09-12T00:40:36.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.625+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.625+0000 7f096e8b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:36.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.625+0000 7f096e8b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:36.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.625+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.629+0000 7f096e8b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:36.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.629+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.629+0000 7f096e8b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:36.625 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.629+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:36.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.629+0000 7f096e8b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:36.627 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.629+0000 7f096e8b59c0 20 searching for the correct realm 2024-09-12T00:40:36.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.633+0000 7f096cbbc640 0 -- 172.21.15.102:0/511371051 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f095407c070 msgr2=0x7f0954045400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:36.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:36.849+0000 7f0963fff640 0 -- 172.21.15.102:0/511371051 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f09640df950 msgr2=0x7f09640f73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:37.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.065+0000 7f096e8b59c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:37.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.065+0000 7f096e8b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:37.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.065+0000 7f096e8b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:37.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.065+0000 7f096e8b59c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:37.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.065+0000 7f096e8b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:37.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.065+0000 7f096e8b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:37.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.065+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:37.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:37.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:37.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:37.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:37.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:37.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 20 zone default found 2024-09-12T00:40:37.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 4 Realm: () 2024-09-12T00:40:37.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:37.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:37.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:37.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 20 zonegroup default 2024-09-12T00:40:37.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:37.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:37.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.069+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:37.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.073+0000 7f096e8b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:37.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.073+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:37.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.073+0000 7f096e8b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:37.068 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.073+0000 7f096e8b59c0 20 started sync module instance, tier type = 2024-09-12T00:40:37.069 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.073+0000 7f096e8b59c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:37.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.097+0000 7f096e8b59c0 20 add_watcher() i=0 2024-09-12T00:40:37.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.097+0000 7f096e8b59c0 20 add_watcher() i=1 2024-09-12T00:40:37.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.097+0000 7f096e8b59c0 20 add_watcher() i=2 2024-09-12T00:40:37.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.097+0000 7f096e8b59c0 20 add_watcher() i=3 2024-09-12T00:40:37.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.097+0000 7f096e8b59c0 20 add_watcher() i=4 2024-09-12T00:40:37.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.097+0000 7f096e8b59c0 20 add_watcher() i=5 2024-09-12T00:40:37.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.097+0000 7f096e8b59c0 20 add_watcher() i=6 2024-09-12T00:40:37.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.101+0000 7f096e8b59c0 20 add_watcher() i=7 2024-09-12T00:40:37.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.101+0000 7f096e8b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:37.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.101+0000 7f08227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:37.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.105+0000 7f096e8b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:37.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.105+0000 7f096e8b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:37.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.105+0000 7f096e8b59c0 5 note: GC not initialized 2024-09-12T00:40:37.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.105+0000 7f08217e2640 20 reqs_thread_entry: start 2024-09-12T00:40:37.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.105+0000 7f096e8b59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:37.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.105+0000 7f096e8b59c0 20 Filter name: none 2024-09-12T00:40:37.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.105+0000 7f0792ffd640 20 reqs_thread_entry: start 2024-09-12T00:40:37.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.105+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:37.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.105+0000 7f096e8b59c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:37.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.105+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:37.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.109+0000 7f096e8b59c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:37.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.109+0000 7f096e8b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:37.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.109+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:37.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.109+0000 7f096e8b59c0 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:40:37.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.109+0000 7f096e8b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:37.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.109+0000 7f096e8b59c0 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:40:37.107 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.109+0000 7f096e8b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:37.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.113+0000 7f08227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:37.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.117+0000 7f096e8b59c0 20 remove_watcher() i=0 2024-09-12T00:40:37.115 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.117+0000 7f096e8b59c0 2 removed watcher, disabling cache 2024-09-12T00:40:37.118 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.121+0000 7f096e8b59c0 20 remove_watcher() i=1 2024-09-12T00:40:37.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.125+0000 7f096e8b59c0 20 remove_watcher() i=2 2024-09-12T00:40:37.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.125+0000 7f096e8b59c0 20 remove_watcher() i=3 2024-09-12T00:40:37.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.129+0000 7f096e8b59c0 20 remove_watcher() i=4 2024-09-12T00:40:37.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.129+0000 7f096e8b59c0 20 remove_watcher() i=5 2024-09-12T00:40:37.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.129+0000 7f096e8b59c0 20 remove_watcher() i=6 2024-09-12T00:40:37.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:37.133+0000 7f096e8b59c0 20 remove_watcher() i=7 2024-09-12T00:40:37.143 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:37.143 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:37.143 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-logrecord-writes id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:40:37.143 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:37.144 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:37.144 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:37.170 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:37.170 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:37.668 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:37.668 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:38.040 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:40:38.041 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:38.043 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:38.044 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:38.202 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:38.202 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:38.292 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:38.293 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:38.421 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:38.421 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:38.531 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:38.531 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:38.707 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:38.707 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:38.824 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:38.824 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:38.946 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:38.946 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:39.061 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:39.062 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:39.183 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:39.183 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:39.301 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:39.301 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:39.433 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:39.433 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:39.542 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:39.542 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:39.676 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:39.677 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:39.787 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:39.787 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:39.898 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:39.898 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:40.002 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:40.002 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:40.114 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:40.115 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:40.229 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:40.230 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:40.336 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:40.337 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:40.455 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:40.455 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:40.557 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:40.558 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:40.663 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:40:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:40.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.749+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.753+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:40.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.753+0000 7fcf9eb7a9c0 20 realm 2024-09-12T00:40:40.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.753+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.753+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:40.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.753+0000 7fcf9eb7a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:40.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.753+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.753+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:40.750 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.753+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.757+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:40.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.757+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.757+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:40.754 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.757+0000 7fcf9eb7a9c0 20 searching for the correct realm 2024-09-12T00:40:40.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.761+0000 7fcf9ce81640 0 -- 172.21.15.102:0/1704713799 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fcf900ac5e0 msgr2=0x7fcf900ea3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:40.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.769+0000 7fcf9be7f640 0 -- 172.21.15.102:0/1704713799 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fcf9404a8c0 msgr2=0x7fcf9402c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:40.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.985+0000 7fcf9eb7a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:40.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.985+0000 7fcf9eb7a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:40.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.985+0000 7fcf9eb7a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:40.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.985+0000 7fcf9eb7a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:40.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.985+0000 7fcf9eb7a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:40.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.985+0000 7fcf9eb7a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:40.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.985+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.985+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:40.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.985+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:40.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:40.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 zone default found 2024-09-12T00:40:40.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 4 Realm: () 2024-09-12T00:40:40.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:40.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:40.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:40.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 zonegroup default 2024-09-12T00:40:40.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:40.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:40.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:40.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:40.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 started sync module instance, tier type = 2024-09-12T00:40:40.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:40.989+0000 7fcf9eb7a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:41.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.013+0000 7fcf9eb7a9c0 20 add_watcher() i=0 2024-09-12T00:40:41.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.013+0000 7fcf9eb7a9c0 20 add_watcher() i=1 2024-09-12T00:40:41.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.013+0000 7fcf9eb7a9c0 20 add_watcher() i=2 2024-09-12T00:40:41.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.013+0000 7fcf9eb7a9c0 20 add_watcher() i=3 2024-09-12T00:40:41.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.013+0000 7fcf9eb7a9c0 20 add_watcher() i=4 2024-09-12T00:40:41.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.013+0000 7fcf9eb7a9c0 20 add_watcher() i=5 2024-09-12T00:40:41.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.013+0000 7fcf9eb7a9c0 20 add_watcher() i=6 2024-09-12T00:40:41.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.013+0000 7fcf9eb7a9c0 20 add_watcher() i=7 2024-09-12T00:40:41.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.013+0000 7fcf9eb7a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:41.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fce52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:41.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fcf9eb7a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:41.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fcf9eb7a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:41.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fcf9eb7a9c0 5 note: GC not initialized 2024-09-12T00:40:41.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fce51fdb640 20 reqs_thread_entry: start 2024-09-12T00:40:41.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fcf9eb7a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:41.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fcf9eb7a9c0 20 Filter name: none 2024-09-12T00:40:41.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fcdc37fe640 20 reqs_thread_entry: start 2024-09-12T00:40:41.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:41.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.017+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.021+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:41.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.021+0000 7fcf9eb7a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:41.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.021+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.021+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:41.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.021+0000 7fcf9eb7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.021+0000 7fcf9eb7a9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:41.018 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.021+0000 7fcf9eb7a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:41.021 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.025+0000 7fce52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:41.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.029+0000 7fcf9eb7a9c0 20 remove_watcher() i=0 2024-09-12T00:40:41.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.029+0000 7fcf9eb7a9c0 2 removed watcher, disabling cache 2024-09-12T00:40:41.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.029+0000 7fcf9eb7a9c0 20 remove_watcher() i=1 2024-09-12T00:40:41.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.033+0000 7fcf9eb7a9c0 20 remove_watcher() i=2 2024-09-12T00:40:41.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.037+0000 7fcf9eb7a9c0 20 remove_watcher() i=3 2024-09-12T00:40:41.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.037+0000 7fcf9eb7a9c0 20 remove_watcher() i=4 2024-09-12T00:40:41.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.037+0000 7fcf9eb7a9c0 20 remove_watcher() i=5 2024-09-12T00:40:41.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.041+0000 7fcf9eb7a9c0 20 remove_watcher() i=6 2024-09-12T00:40:41.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.041+0000 7fcf9eb7a9c0 20 remove_watcher() i=7 2024-09-12T00:40:41.055 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:41.055 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:41.055 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-change-reshard-state id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:41.055 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:41.055 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:40:41.092 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:41.092 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:41.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.141+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.141+0000 7fa7b07349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.141+0000 7fa7b07349c0 20 realm 2024-09-12T00:40:41.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.141+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.141+0000 7fa7b07349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.141+0000 7fa7b07349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:41.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.141+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.141+0000 7fa7b07349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.141+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.145+0000 7fa7b07349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:41.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.145+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.145+0000 7fa7b07349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:41.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.145+0000 7fa7b07349c0 20 searching for the correct realm 2024-09-12T00:40:41.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.149+0000 7fa7aea3b640 0 -- 172.21.15.102:0/724628046 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fa798017070 msgr2=0x7fa79806cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:41.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.157+0000 7fa7a5a39640 0 -- 172.21.15.102:0/724628046 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fa7a8069580 msgr2=0x7fa7a8040850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:41.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.373+0000 7fa7b07349c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:41.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.373+0000 7fa7b07349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:41.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.373+0000 7fa7b07349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:41.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.373+0000 7fa7b07349c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:41.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.373+0000 7fa7b07349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:41.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.373+0000 7fa7b07349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:41.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.373+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.373+0000 7fa7b07349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.373+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:41.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:41.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 20 zone default found 2024-09-12T00:40:41.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 4 Realm: () 2024-09-12T00:40:41.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:41.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:41.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:41.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 20 zonegroup default 2024-09-12T00:40:41.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.377+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.381+0000 7fa7b07349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.381+0000 7fa7b07349c0 20 started sync module instance, tier type = 2024-09-12T00:40:41.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.381+0000 7fa7b07349c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:41.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.401+0000 7fa7b07349c0 20 add_watcher() i=0 2024-09-12T00:40:41.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.401+0000 7fa7b07349c0 20 add_watcher() i=1 2024-09-12T00:40:41.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.401+0000 7fa7b07349c0 20 add_watcher() i=2 2024-09-12T00:40:41.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.401+0000 7fa7b07349c0 20 add_watcher() i=3 2024-09-12T00:40:41.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.401+0000 7fa7b07349c0 20 add_watcher() i=4 2024-09-12T00:40:41.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.401+0000 7fa7b07349c0 20 add_watcher() i=5 2024-09-12T00:40:41.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.401+0000 7fa7b07349c0 20 add_watcher() i=6 2024-09-12T00:40:41.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.405+0000 7fa7b07349c0 20 add_watcher() i=7 2024-09-12T00:40:41.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.405+0000 7fa7b07349c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:41.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.409+0000 7fa664fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:41.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.409+0000 7fa7b07349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:41.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.409+0000 7fa7b07349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:41.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.409+0000 7fa7b07349c0 5 note: GC not initialized 2024-09-12T00:40:41.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.409+0000 7fa5df7fe640 20 reqs_thread_entry: start 2024-09-12T00:40:41.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.409+0000 7fa7b07349c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:41.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.409+0000 7fa7b07349c0 20 Filter name: none 2024-09-12T00:40:41.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.409+0000 7fa5dd7fa640 20 reqs_thread_entry: start 2024-09-12T00:40:41.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.409+0000 7fa7b07349c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:40:41.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.409+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:41.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:41.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:40:41.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 : miss 2024-09-12T00:40:41.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:41.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:41.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:41.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:41.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:41.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.413+0000 7fa7b07349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 2024-09-12T00:40:41.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa7b07349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:41.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa7b07349c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:41.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa7b07349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:41.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa7b07349c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38, ofs0, ns] 2024-09-12T00:40:41.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa691ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398930 cookie 94735797746864 notifier 7334 bl.length()=1015 2024-09-12T00:40:41.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa691ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:41.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa691ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:41.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa691ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:41.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa7b07349c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): orig_sources= new_sources= 2024-09-12T00:40:41.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa7b07349c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): potential sources added=[] removed=[] 2024-09-12T00:40:41.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa7b07349c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): orig_dests= new_dests= 2024-09-12T00:40:41.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.425+0000 7fa7b07349c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): potential dests added=[] removed=[] 2024-09-12T00:40:41.437 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.0 2024-09-12T00:40:41.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.0 2024-09-12T00:40:41.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.1 2024-09-12T00:40:41.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.1 2024-09-12T00:40:41.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.2 2024-09-12T00:40:41.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.2 2024-09-12T00:40:41.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.3 2024-09-12T00:40:41.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.3 2024-09-12T00:40:41.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.4 2024-09-12T00:40:41.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.4 2024-09-12T00:40:41.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.5 2024-09-12T00:40:41.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.5 2024-09-12T00:40:41.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.6 2024-09-12T00:40:41.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.6 2024-09-12T00:40:41.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.7 2024-09-12T00:40:41.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.7 2024-09-12T00:40:41.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.8 2024-09-12T00:40:41.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.8 2024-09-12T00:40:41.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.9 2024-09-12T00:40:41.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.9 2024-09-12T00:40:41.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.10 2024-09-12T00:40:41.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.10 2024-09-12T00:40:41.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.11 2024-09-12T00:40:41.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.11 2024-09-12T00:40:41.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.0 2024-09-12T00:40:41.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1 2024-09-12T00:40:41.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.441+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.2 2024-09-12T00:40:41.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.445+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.3 2024-09-12T00:40:41.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.445+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.4 2024-09-12T00:40:41.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.445+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.5 2024-09-12T00:40:41.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.445+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.6 2024-09-12T00:40:41.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.445+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.7 2024-09-12T00:40:41.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.449+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.8 2024-09-12T00:40:41.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.449+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.9 2024-09-12T00:40:41.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.453+0000 7fa7b07349c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.10 2024-09-12T00:40:41.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.457+0000 7fa7b07349c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:40:41.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.457+0000 7fa7b07349c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:40:41.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.481+0000 7fa7b07349c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:41.479 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.481+0000 7fa7b07349c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 2024-09-12T00:40:41.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.485+0000 7fa7b07349c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:41.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.485+0000 7fa7b07349c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:41.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.485+0000 7fa7b07349c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:41.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.485+0000 7fa7b07349c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38, ofs0, ns] 2024-09-12T00:40:41.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.485+0000 7fa691ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398931 cookie 94735797746864 notifier 7334 bl.length()=983 2024-09-12T00:40:41.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.485+0000 7fa691ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:41.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.485+0000 7fa691ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:41.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.485+0000 7fa691ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:41.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.489+0000 7fa7b07349c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): orig_sources= new_sources= 2024-09-12T00:40:41.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.489+0000 7fa7b07349c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): potential sources added=[] removed=[] 2024-09-12T00:40:41.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.489+0000 7fa7b07349c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): orig_dests= new_dests= 2024-09-12T00:40:41.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.489+0000 7fa7b07349c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): potential dests added=[] removed=[] 2024-09-12T00:40:41.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.489+0000 7fa7b07349c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:40:41.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.493+0000 7fa664fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:41.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.497+0000 7fa7b07349c0 20 remove_watcher() i=0 2024-09-12T00:40:41.493 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.497+0000 7fa7b07349c0 2 removed watcher, disabling cache 2024-09-12T00:40:41.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.497+0000 7fa7b07349c0 20 remove_watcher() i=1 2024-09-12T00:40:41.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.501+0000 7fa7b07349c0 20 remove_watcher() i=2 2024-09-12T00:40:41.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.501+0000 7fa7b07349c0 20 remove_watcher() i=3 2024-09-12T00:40:41.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.505+0000 7fa7b07349c0 20 remove_watcher() i=4 2024-09-12T00:40:41.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.505+0000 7fa7b07349c0 20 remove_watcher() i=5 2024-09-12T00:40:41.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.509+0000 7fa7b07349c0 20 remove_watcher() i=6 2024-09-12T00:40:41.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.509+0000 7fa7b07349c0 20 remove_watcher() i=7 2024-09-12T00:40:41.523 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:40:41.553 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:41.553 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:41.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.601+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.605+0000 7fb6ac6b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.605+0000 7fb6ac6b39c0 20 realm 2024-09-12T00:40:41.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.605+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.605+0000 7fb6ac6b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.605+0000 7fb6ac6b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:41.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.605+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.605+0000 7fb6ac6b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.605+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.605+0000 7fb6ac6b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:41.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.605+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.609+0000 7fb6ac6b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:41.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.609+0000 7fb6ac6b39c0 20 searching for the correct realm 2024-09-12T00:40:41.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.613+0000 7fb6aa9ba640 0 -- 172.21.15.102:0/3107286052 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fb6940df030 msgr2=0x7fb6940df410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:41.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.617+0000 7fb6a99b8640 0 -- 172.21.15.102:0/3107286052 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fb69c060410 msgr2=0x7fb69c060870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:41.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:41.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:41.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:41.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:41.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:41.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:41.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.833 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:41.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:41.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 zone default found 2024-09-12T00:40:41.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 4 Realm: () 2024-09-12T00:40:41.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:41.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:41.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:41.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 zonegroup default 2024-09-12T00:40:41.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.837+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.841+0000 7fb6ac6b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.841+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.841+0000 7fb6ac6b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:41.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.841+0000 7fb6ac6b39c0 20 started sync module instance, tier type = 2024-09-12T00:40:41.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.841+0000 7fb6ac6b39c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:41.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.865+0000 7fb6ac6b39c0 20 add_watcher() i=0 2024-09-12T00:40:41.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.865+0000 7fb6ac6b39c0 20 add_watcher() i=1 2024-09-12T00:40:41.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.865+0000 7fb6ac6b39c0 20 add_watcher() i=2 2024-09-12T00:40:41.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.865+0000 7fb6ac6b39c0 20 add_watcher() i=3 2024-09-12T00:40:41.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.865+0000 7fb6ac6b39c0 20 add_watcher() i=4 2024-09-12T00:40:41.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.865+0000 7fb6ac6b39c0 20 add_watcher() i=5 2024-09-12T00:40:41.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.865+0000 7fb6ac6b39c0 20 add_watcher() i=6 2024-09-12T00:40:41.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.865+0000 7fb6ac6b39c0 20 add_watcher() i=7 2024-09-12T00:40:41.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.865+0000 7fb6ac6b39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:41.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.869+0000 7fb560fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:41.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.869+0000 7fb6ac6b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:41.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.869+0000 7fb6ac6b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:41.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb6ac6b39c0 5 note: GC not initialized 2024-09-12T00:40:41.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb4db7fe640 20 reqs_thread_entry: start 2024-09-12T00:40:41.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb6ac6b39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:41.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb6ac6b39c0 20 Filter name: none 2024-09-12T00:40:41.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb4d97fa640 20 reqs_thread_entry: start 2024-09-12T00:40:41.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb6ac6b39c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:41.870 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb6ac6b39c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:41.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb6ac6b39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:41.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.873+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.877+0000 7fb6ac6b39c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:41.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.877+0000 7fb6ac6b39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:41.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.877+0000 7fb6ac6b39c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:41.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.877+0000 7fb6ac6b39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:41.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.881+0000 7fb560fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:41.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.885+0000 7fb6ac6b39c0 20 remove_watcher() i=0 2024-09-12T00:40:41.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.885+0000 7fb6ac6b39c0 2 removed watcher, disabling cache 2024-09-12T00:40:41.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.889+0000 7fb6ac6b39c0 20 remove_watcher() i=1 2024-09-12T00:40:41.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.889+0000 7fb6ac6b39c0 20 remove_watcher() i=2 2024-09-12T00:40:41.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.893+0000 7fb6ac6b39c0 20 remove_watcher() i=3 2024-09-12T00:40:41.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.893+0000 7fb6ac6b39c0 20 remove_watcher() i=4 2024-09-12T00:40:41.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.897+0000 7fb6ac6b39c0 20 remove_watcher() i=5 2024-09-12T00:40:41.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.897+0000 7fb6ac6b39c0 20 remove_watcher() i=6 2024-09-12T00:40:41.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:41.901+0000 7fb6ac6b39c0 20 remove_watcher() i=7 2024-09-12T00:40:41.912 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:41.913 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:41.913 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-change-reshard-state id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:41.913 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:41.914 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:41.914 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:41.963 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:41.963 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:42.050 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:42.087 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:42.087 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:42.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.133+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.137+0000 7f04074b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.137+0000 7f04074b29c0 20 realm 2024-09-12T00:40:42.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.137+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.137+0000 7f04074b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.137+0000 7f04074b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:42.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.137+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.137+0000 7f04074b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.137+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.137+0000 7f04074b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:42.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.137+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.141+0000 7f04074b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:42.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.141+0000 7f04074b29c0 20 searching for the correct realm 2024-09-12T00:40:42.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.141+0000 7f04057b9640 0 -- 172.21.15.102:0/1111905918 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f03f804b060 msgr2=0x7f03f8026a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:42.147 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.149+0000 7f04047b7640 0 -- 172.21.15.102:0/1111905918 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f03fc0fc330 msgr2=0x7f03fc10d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:42.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:42.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:42.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:42.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:42.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:42.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:42.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:42.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:42.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 zone default found 2024-09-12T00:40:42.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 4 Realm: () 2024-09-12T00:40:42.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:42.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:42.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:42.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 zonegroup default 2024-09-12T00:40:42.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.369+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.373+0000 7f04074b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.373+0000 7f04074b29c0 20 started sync module instance, tier type = 2024-09-12T00:40:42.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.373+0000 7f04074b29c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:42.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.393+0000 7f04074b29c0 20 add_watcher() i=0 2024-09-12T00:40:42.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.393+0000 7f04074b29c0 20 add_watcher() i=1 2024-09-12T00:40:42.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.393+0000 7f04074b29c0 20 add_watcher() i=2 2024-09-12T00:40:42.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.393+0000 7f04074b29c0 20 add_watcher() i=3 2024-09-12T00:40:42.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.393+0000 7f04074b29c0 20 add_watcher() i=4 2024-09-12T00:40:42.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.393+0000 7f04074b29c0 20 add_watcher() i=5 2024-09-12T00:40:42.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.393+0000 7f04074b29c0 20 add_watcher() i=6 2024-09-12T00:40:42.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.397+0000 7f04074b29c0 20 add_watcher() i=7 2024-09-12T00:40:42.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.397+0000 7f04074b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:42.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.401+0000 7f02bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:42.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.401+0000 7f04074b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:42.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.401+0000 7f04074b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:42.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.401+0000 7f04074b29c0 5 note: GC not initialized 2024-09-12T00:40:42.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.401+0000 7f02ba7e4640 20 reqs_thread_entry: start 2024-09-12T00:40:42.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.401+0000 7f04074b29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:42.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.401+0000 7f04074b29c0 20 Filter name: none 2024-09-12T00:40:42.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.401+0000 7f02b37fe640 20 reqs_thread_entry: start 2024-09-12T00:40:42.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.401+0000 7f04074b29c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:40:42.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.401+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:42.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:42.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:40:42.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 : miss 2024-09-12T00:40:42.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:42.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:42.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:42.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:42.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:42.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.405+0000 7f04074b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 2024-09-12T00:40:42.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.417+0000 7f04074b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:42.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.417+0000 7f04074b29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:42.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.417+0000 7f04074b29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:42.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.417+0000 7f04074b29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38, ofs0, ns] 2024-09-12T00:40:42.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.421+0000 7f02db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398932 cookie 94704085733760 notifier 7367 bl.length()=1015 2024-09-12T00:40:42.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.421+0000 7f02db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:42.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.421+0000 7f02db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:42.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.421+0000 7f02db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:42.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.421+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): orig_sources= new_sources= 2024-09-12T00:40:42.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.421+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): potential sources added=[] removed=[] 2024-09-12T00:40:42.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.421+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): orig_dests= new_dests= 2024-09-12T00:40:42.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.421+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): potential dests added=[] removed=[] 2024-09-12T00:40:42.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.0 2024-09-12T00:40:42.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.0 2024-09-12T00:40:42.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.1 2024-09-12T00:40:42.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.1 2024-09-12T00:40:42.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.2 2024-09-12T00:40:42.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.2 2024-09-12T00:40:42.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.3 2024-09-12T00:40:42.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.3 2024-09-12T00:40:42.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.4 2024-09-12T00:40:42.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.4 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.5 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.5 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.6 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.6 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.7 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.7 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.8 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.8 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.9 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.9 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.10 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.10 2024-09-12T00:40:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.11 2024-09-12T00:40:42.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1.11 2024-09-12T00:40:42.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.433+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.0 2024-09-12T00:40:42.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.437+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1 2024-09-12T00:40:42.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.437+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.2 2024-09-12T00:40:42.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.437+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.3 2024-09-12T00:40:42.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.437+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.4 2024-09-12T00:40:42.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.437+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.5 2024-09-12T00:40:42.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.441+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.6 2024-09-12T00:40:42.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.441+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.7 2024-09-12T00:40:42.439 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.441+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.8 2024-09-12T00:40:42.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.445+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.9 2024-09-12T00:40:42.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.445+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.10 2024-09-12T00:40:42.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.449+0000 7f04074b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:42.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.449+0000 7f04074b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 2024-09-12T00:40:42.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.453+0000 7f04074b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:42.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.453+0000 7f04074b29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:42.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.453+0000 7f04074b29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:42.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.453+0000 7f04074b29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38, ofs0, ns] 2024-09-12T00:40:42.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.453+0000 7f02dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398933 cookie 94704085733760 notifier 7367 bl.length()=1015 2024-09-12T00:40:42.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.453+0000 7f02dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:42.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.453+0000 7f02dbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:42.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.453+0000 7f02dbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:42.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.457+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): orig_sources= new_sources= 2024-09-12T00:40:42.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.457+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): potential sources added=[] removed=[] 2024-09-12T00:40:42.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.457+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): orig_dests= new_dests= 2024-09-12T00:40:42.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.457+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): potential dests added=[] removed=[] 2024-09-12T00:40:42.460 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.465+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.0 2024-09-12T00:40:42.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.465+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.1 2024-09-12T00:40:42.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.465+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.2 2024-09-12T00:40:42.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.465+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.3 2024-09-12T00:40:42.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.465+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.4 2024-09-12T00:40:42.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.469+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.5 2024-09-12T00:40:42.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.469+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.6 2024-09-12T00:40:42.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.469+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.7 2024-09-12T00:40:42.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.469+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.8 2024-09-12T00:40:42.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.473+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.9 2024-09-12T00:40:42.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.473+0000 7f04074b29c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38.10 2024-09-12T00:40:42.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.473+0000 7f04074b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:42.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.473+0000 7f04074b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 2024-09-12T00:40:42.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.477+0000 7f04074b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:42.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.477+0000 7f04074b29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:42.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.477+0000 7f04074b29c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:42.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.477+0000 7f04074b29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38, ofs0, ns] 2024-09-12T00:40:42.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.477+0000 7f02db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398934 cookie 94704085733760 notifier 7367 bl.length()=983 2024-09-12T00:40:42.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.477+0000 7f02db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 info.flags=0x17 2024-09-12T00:40:42.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.477+0000 7f02db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 to cache LRU end 2024-09-12T00:40:42.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.477+0000 7f02db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:42.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.481+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): orig_sources= new_sources= 2024-09-12T00:40:42.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.481+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): potential sources added=[] removed=[] 2024-09-12T00:40:42.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.481+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): orig_dests= new_dests= 2024-09-12T00:40:42.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.481+0000 7f04074b29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38]): potential dests added=[] removed=[] 2024-09-12T00:40:42.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.485+0000 7f04074b29c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:40:42.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.489+0000 7f02bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:42.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.493+0000 7f04074b29c0 20 remove_watcher() i=0 2024-09-12T00:40:42.492 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.493+0000 7f04074b29c0 2 removed watcher, disabling cache 2024-09-12T00:40:42.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.497+0000 7f04074b29c0 20 remove_watcher() i=1 2024-09-12T00:40:42.496 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.501+0000 7f04074b29c0 20 remove_watcher() i=2 2024-09-12T00:40:42.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.501+0000 7f04074b29c0 20 remove_watcher() i=3 2024-09-12T00:40:42.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.505+0000 7f04074b29c0 20 remove_watcher() i=4 2024-09-12T00:40:42.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.505+0000 7f04074b29c0 20 remove_watcher() i=5 2024-09-12T00:40:42.505 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.509+0000 7f04074b29c0 20 remove_watcher() i=6 2024-09-12T00:40:42.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.509+0000 7f04074b29c0 20 remove_watcher() i=7 2024-09-12T00:40:42.524 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:40:42.555 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:42.555 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:42.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.605+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 realm 2024-09-12T00:40:42.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:42.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:42.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:42.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.609+0000 7f1778a249c0 20 searching for the correct realm 2024-09-12T00:40:42.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.613+0000 7f1775d29640 0 -- 172.21.15.102:0/1221322996 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f1770065b30 msgr2=0x7f177005ba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:42.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.824+0000 7f1776d2b640 0 -- 172.21.15.102:0/1221322996 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x5616e50d8dc0 msgr2=0x5616e50db1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:42.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.840+0000 7f1778a249c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:42.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.840+0000 7f1778a249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:42.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.840+0000 7f1778a249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:42.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.840+0000 7f1778a249c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:42.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.840+0000 7f1778a249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:42.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.840+0000 7f1778a249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:42.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.840+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.840+0000 7f1778a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.840+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:42.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:42.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 zone default found 2024-09-12T00:40:42.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 4 Realm: () 2024-09-12T00:40:42.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:42.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:42.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:42.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 zonegroup default 2024-09-12T00:40:42.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:42.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 started sync module instance, tier type = 2024-09-12T00:40:42.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.844+0000 7f1778a249c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:42.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.868+0000 7f1778a249c0 20 add_watcher() i=0 2024-09-12T00:40:42.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.868+0000 7f1778a249c0 20 add_watcher() i=1 2024-09-12T00:40:42.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.868+0000 7f1778a249c0 20 add_watcher() i=2 2024-09-12T00:40:42.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.868+0000 7f1778a249c0 20 add_watcher() i=3 2024-09-12T00:40:42.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.868+0000 7f1778a249c0 20 add_watcher() i=4 2024-09-12T00:40:42.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.868+0000 7f1778a249c0 20 add_watcher() i=5 2024-09-12T00:40:42.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.868+0000 7f1778a249c0 20 add_watcher() i=6 2024-09-12T00:40:42.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.868+0000 7f1778a249c0 20 add_watcher() i=7 2024-09-12T00:40:42.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.868+0000 7f1778a249c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:42.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.872+0000 7f162cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:42.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.876+0000 7f1778a249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:42.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.876+0000 7f1778a249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:42.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.876+0000 7f1778a249c0 5 note: GC not initialized 2024-09-12T00:40:42.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.876+0000 7f15a77fe640 20 reqs_thread_entry: start 2024-09-12T00:40:42.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.876+0000 7f1778a249c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:42.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.876+0000 7f1778a249c0 20 Filter name: none 2024-09-12T00:40:42.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.876+0000 7f15a57fa640 20 reqs_thread_entry: start 2024-09-12T00:40:42.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.876+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.876+0000 7f1778a249c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:42.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.876+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.880+0000 7f1778a249c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:42.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.880+0000 7f1778a249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:42.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.880+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.880+0000 7f1778a249c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:42.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.880+0000 7f1778a249c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:42.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.880+0000 7f1778a249c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:42.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.880+0000 7f1778a249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:42.881 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.884+0000 7f162cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:42.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.888+0000 7f1778a249c0 20 remove_watcher() i=0 2024-09-12T00:40:42.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.888+0000 7f1778a249c0 2 removed watcher, disabling cache 2024-09-12T00:40:42.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.892+0000 7f1778a249c0 20 remove_watcher() i=1 2024-09-12T00:40:42.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.892+0000 7f1778a249c0 20 remove_watcher() i=2 2024-09-12T00:40:42.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.896+0000 7f1778a249c0 20 remove_watcher() i=3 2024-09-12T00:40:42.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.896+0000 7f1778a249c0 20 remove_watcher() i=4 2024-09-12T00:40:42.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.900+0000 7f1778a249c0 20 remove_watcher() i=5 2024-09-12T00:40:42.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.900+0000 7f1778a249c0 20 remove_watcher() i=6 2024-09-12T00:40:42.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:42.900+0000 7f1778a249c0 20 remove_watcher() i=7 2024-09-12T00:40:42.915 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:42.915 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:42.915 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-change-reshard-state id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:40:42.915 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:42.916 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:42.916 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:42.948 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:42.948 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:43.493 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:43.493 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:43.872 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:40:43.872 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:43.874 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:43.874 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:44.007 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:44.007 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:44.095 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:44.096 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:44.188 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:44.188 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:44.291 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:44.291 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:44.397 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:44.397 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:44.497 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:44.497 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:44.596 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:44.596 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:44.709 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:44.709 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:44.812 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:44.812 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:44.924 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:44.925 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:45.026 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:45.026 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:45.128 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:45.128 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:45.229 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:45.229 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:45.328 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:45.329 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:45.428 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:45.428 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:45.529 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:45.530 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:45.633 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:45.633 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:45.729 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:45.730 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:45.827 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:45.828 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:45.929 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:45.929 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:46.029 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:46.029 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:46.126 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:40:46.159 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:46.159 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:46.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.208+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.208+0000 7f91fabf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:46.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.208+0000 7f91fabf29c0 20 realm 2024-09-12T00:40:46.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.208+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.208+0000 7f91fabf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:46.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.208+0000 7f91fabf29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:46.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.208+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.208+0000 7f91fabf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:46.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.208+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.212+0000 7f91fabf29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:46.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.212+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.212+0000 7f91fabf29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:46.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.212+0000 7f91fabf29c0 20 searching for the correct realm 2024-09-12T00:40:46.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.216+0000 7f91f8ef9640 0 -- 172.21.15.102:0/1664640826 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f91e8008070 msgr2=0x7f91e80383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:46.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.432+0000 7f91f7ef7640 0 -- 172.21.15.102:0/1664640826 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f91f01145a0 msgr2=0x7f91f0118940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:46.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.648+0000 7f91fabf29c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:46.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.648+0000 7f91fabf29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:46.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.648+0000 7f91fabf29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:46.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.648+0000 7f91fabf29c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:46.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.648+0000 7f91fabf29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:46.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.648+0000 7f91fabf29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:46.648 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.648+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:46.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:46.649 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:46.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 zone default found 2024-09-12T00:40:46.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 4 Realm: () 2024-09-12T00:40:46.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:46.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:46.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:46.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 zonegroup default 2024-09-12T00:40:46.650 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:46.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:46.651 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.652+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.656+0000 7f91fabf29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:46.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.656+0000 7f91fabf29c0 20 started sync module instance, tier type = 2024-09-12T00:40:46.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.656+0000 7f91fabf29c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:46.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.676+0000 7f91fabf29c0 20 add_watcher() i=0 2024-09-12T00:40:46.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.676+0000 7f91fabf29c0 20 add_watcher() i=1 2024-09-12T00:40:46.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.676+0000 7f91fabf29c0 20 add_watcher() i=2 2024-09-12T00:40:46.675 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.676+0000 7f91fabf29c0 20 add_watcher() i=3 2024-09-12T00:40:46.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.676+0000 7f91fabf29c0 20 add_watcher() i=4 2024-09-12T00:40:46.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.676+0000 7f91fabf29c0 20 add_watcher() i=5 2024-09-12T00:40:46.676 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.676+0000 7f91fabf29c0 20 add_watcher() i=6 2024-09-12T00:40:46.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.680+0000 7f91fabf29c0 20 add_watcher() i=7 2024-09-12T00:40:46.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.680+0000 7f91fabf29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:46.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.684+0000 7f90aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:46.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.684+0000 7f91fabf29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:46.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.684+0000 7f91fabf29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:46.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.684+0000 7f91fabf29c0 5 note: GC not initialized 2024-09-12T00:40:46.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.684+0000 7f90adfdb640 20 reqs_thread_entry: start 2024-09-12T00:40:46.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.684+0000 7f91fabf29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:46.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.684+0000 7f91fabf29c0 20 Filter name: none 2024-09-12T00:40:46.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.684+0000 7f901f7fe640 20 reqs_thread_entry: start 2024-09-12T00:40:46.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.684+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.685 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.688+0000 7f91fabf29c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:46.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.688+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.688+0000 7f91fabf29c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:46.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.688+0000 7f91fabf29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:46.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.688+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.688+0000 7f91fabf29c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:46.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.688+0000 7f91fabf29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.692+0000 7f91fabf29c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:46.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.692+0000 7f91fabf29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:46.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.696+0000 7f90aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:46.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.700+0000 7f91fabf29c0 20 remove_watcher() i=0 2024-09-12T00:40:46.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.700+0000 7f91fabf29c0 2 removed watcher, disabling cache 2024-09-12T00:40:46.700 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.700+0000 7f91fabf29c0 20 remove_watcher() i=1 2024-09-12T00:40:46.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.704+0000 7f91fabf29c0 20 remove_watcher() i=2 2024-09-12T00:40:46.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.708+0000 7f91fabf29c0 20 remove_watcher() i=3 2024-09-12T00:40:46.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.708+0000 7f91fabf29c0 20 remove_watcher() i=4 2024-09-12T00:40:46.709 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.712+0000 7f91fabf29c0 20 remove_watcher() i=5 2024-09-12T00:40:46.710 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.712+0000 7f91fabf29c0 20 remove_watcher() i=6 2024-09-12T00:40:46.712 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.712+0000 7f91fabf29c0 20 remove_watcher() i=7 2024-09-12T00:40:46.726 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:46.726 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:46.726 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-change-reshard-state id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:46.726 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:46.726 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:40:46.761 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:46.761 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:46.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.808+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.808+0000 7f6833f509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:46.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.808+0000 7f6833f509c0 20 realm 2024-09-12T00:40:46.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.808+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.808+0000 7f6833f509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:46.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.808+0000 7f6833f509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:46.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.808+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.808+0000 7f6833f509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:46.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.808+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.812+0000 7f6833f509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:46.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.812+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:46.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.812+0000 7f6833f509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:46.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.812+0000 7f6833f509c0 20 searching for the correct realm 2024-09-12T00:40:46.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:46.816+0000 7f6832257640 0 -- 172.21.15.102:0/620091783 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f6828018070 msgr2=0x7f68280863b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:47.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.436+0000 7f6831255640 0 -- 172.21.15.102:0/620091783 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f682c0173d0 msgr2=0x7f682c017850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:47.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.652+0000 7f6833f509c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:47.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.652+0000 7f6833f509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:47.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.652+0000 7f6833f509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:47.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.652+0000 7f6833f509c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:47.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.652+0000 7f6833f509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:47.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.652+0000 7f6833f509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:47.652 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.652+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:47.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:47.653 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:47.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 zone default found 2024-09-12T00:40:47.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 4 Realm: () 2024-09-12T00:40:47.654 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:47.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:47.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:47.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 zonegroup default 2024-09-12T00:40:47.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:47.655 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:47.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.656+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.660+0000 7f6833f509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:47.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.660+0000 7f6833f509c0 20 started sync module instance, tier type = 2024-09-12T00:40:47.656 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.660+0000 7f6833f509c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:47.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.684+0000 7f6833f509c0 20 add_watcher() i=0 2024-09-12T00:40:47.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.684+0000 7f6833f509c0 20 add_watcher() i=1 2024-09-12T00:40:47.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.684+0000 7f6833f509c0 20 add_watcher() i=2 2024-09-12T00:40:47.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.684+0000 7f6833f509c0 20 add_watcher() i=3 2024-09-12T00:40:47.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.684+0000 7f6833f509c0 20 add_watcher() i=4 2024-09-12T00:40:47.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.684+0000 7f6833f509c0 20 add_watcher() i=5 2024-09-12T00:40:47.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.684+0000 7f6833f509c0 20 add_watcher() i=6 2024-09-12T00:40:47.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.684+0000 7f6833f509c0 20 add_watcher() i=7 2024-09-12T00:40:47.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.684+0000 7f6833f509c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:47.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f66e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:47.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:47.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:47.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 5 note: GC not initialized 2024-09-12T00:40:47.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f66e27fc640 20 reqs_thread_entry: start 2024-09-12T00:40:47.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:47.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 20 Filter name: none 2024-09-12T00:40:47.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6653fff640 20 reqs_thread_entry: start 2024-09-12T00:40:47.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:40:47.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:47.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:47.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:40:47.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 : miss 2024-09-12T00:40:47.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.692+0000 7f6833f509c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.696+0000 7f6833f509c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:47.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.696+0000 7f6833f509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 info.flags=0x17 2024-09-12T00:40:47.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.696+0000 7f6833f509c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 to cache LRU end 2024-09-12T00:40:47.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.696+0000 7f6833f509c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:47.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.696+0000 7f6833f509c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:47.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.696+0000 7f6833f509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 2024-09-12T00:40:47.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.704+0000 7f6833f509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 info.flags=0x17 2024-09-12T00:40:47.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.704+0000 7f6833f509c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 to cache LRU end 2024-09-12T00:40:47.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.704+0000 7f6833f509c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:47.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.704+0000 7f6833f509c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39, ofs0, ns] 2024-09-12T00:40:47.703 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.704+0000 7f6714ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398937 cookie 94286570450320 notifier 7905 bl.length()=1015 2024-09-12T00:40:47.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.704+0000 7f6714ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 info.flags=0x17 2024-09-12T00:40:47.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.704+0000 7f6714ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 to cache LRU end 2024-09-12T00:40:47.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.704+0000 7f6714ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:47.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.708+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): orig_sources= new_sources= 2024-09-12T00:40:47.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.708+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): potential sources added=[] removed=[] 2024-09-12T00:40:47.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.708+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): orig_dests= new_dests= 2024-09-12T00:40:47.707 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.708+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): potential dests added=[] removed=[] 2024-09-12T00:40:47.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.0 2024-09-12T00:40:47.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.0 2024-09-12T00:40:47.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.1 2024-09-12T00:40:47.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.1 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.2 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.2 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.3 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.3 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.4 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.4 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.5 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.5 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.6 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.6 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.7 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.7 2024-09-12T00:40:47.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.8 2024-09-12T00:40:47.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.8 2024-09-12T00:40:47.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.9 2024-09-12T00:40:47.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.9 2024-09-12T00:40:47.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.10 2024-09-12T00:40:47.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.10 2024-09-12T00:40:47.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.11 2024-09-12T00:40:47.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1.11 2024-09-12T00:40:47.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.0 2024-09-12T00:40:47.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1 2024-09-12T00:40:47.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.724+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.2 2024-09-12T00:40:47.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.728+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.3 2024-09-12T00:40:47.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.728+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.4 2024-09-12T00:40:47.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.728+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.5 2024-09-12T00:40:47.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.732+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.6 2024-09-12T00:40:47.729 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.732+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.7 2024-09-12T00:40:47.730 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.732+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.8 2024-09-12T00:40:47.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.732+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.9 2024-09-12T00:40:47.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.736+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.10 2024-09-12T00:40:47.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.740+0000 7f6833f509c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:40:47.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.740+0000 7f6833f509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:47.740 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.740+0000 7f6833f509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 2024-09-12T00:40:47.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.744+0000 7f6833f509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 info.flags=0x17 2024-09-12T00:40:47.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.744+0000 7f6833f509c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 to cache LRU end 2024-09-12T00:40:47.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.744+0000 7f6833f509c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:47.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.744+0000 7f6833f509c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39, ofs0, ns] 2024-09-12T00:40:47.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.744+0000 7f6714ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398938 cookie 94286570450320 notifier 7905 bl.length()=1015 2024-09-12T00:40:47.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.744+0000 7f6714ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 info.flags=0x17 2024-09-12T00:40:47.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.744+0000 7f6714ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 to cache LRU end 2024-09-12T00:40:47.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.744+0000 7f6714ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:47.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.748+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): orig_sources= new_sources= 2024-09-12T00:40:47.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.748+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): potential sources added=[] removed=[] 2024-09-12T00:40:47.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.748+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): orig_dests= new_dests= 2024-09-12T00:40:47.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.748+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): potential dests added=[] removed=[] 2024-09-12T00:40:47.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.756+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.0 2024-09-12T00:40:47.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.756+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.1 2024-09-12T00:40:47.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.760+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.2 2024-09-12T00:40:47.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.760+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.3 2024-09-12T00:40:47.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.760+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.4 2024-09-12T00:40:47.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.760+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.5 2024-09-12T00:40:47.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.764+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.6 2024-09-12T00:40:47.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.764+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.7 2024-09-12T00:40:47.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.764+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.8 2024-09-12T00:40:47.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.764+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.9 2024-09-12T00:40:47.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.764+0000 7f6833f509c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39.10 2024-09-12T00:40:47.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.768+0000 7f6833f509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:47.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.768+0000 7f6833f509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 2024-09-12T00:40:47.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f6833f509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 info.flags=0x17 2024-09-12T00:40:47.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f6833f509c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 to cache LRU end 2024-09-12T00:40:47.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f6833f509c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:47.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f6833f509c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39, ofs0, ns] 2024-09-12T00:40:47.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f67157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398939 cookie 94286570450320 notifier 7905 bl.length()=983 2024-09-12T00:40:47.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f67157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 info.flags=0x17 2024-09-12T00:40:47.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f67157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 to cache LRU end 2024-09-12T00:40:47.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f67157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:47.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): orig_sources= new_sources= 2024-09-12T00:40:47.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): potential sources added=[] removed=[] 2024-09-12T00:40:47.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): orig_dests= new_dests= 2024-09-12T00:40:47.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.772+0000 7f6833f509c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39]): potential dests added=[] removed=[] 2024-09-12T00:40:47.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.780+0000 7f6833f509c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:40:47.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.784+0000 7f66e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:47.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.788+0000 7f6833f509c0 20 remove_watcher() i=0 2024-09-12T00:40:47.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.788+0000 7f6833f509c0 2 removed watcher, disabling cache 2024-09-12T00:40:47.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.792+0000 7f6833f509c0 20 remove_watcher() i=1 2024-09-12T00:40:47.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.792+0000 7f6833f509c0 20 remove_watcher() i=2 2024-09-12T00:40:47.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.796+0000 7f6833f509c0 20 remove_watcher() i=3 2024-09-12T00:40:47.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.796+0000 7f6833f509c0 20 remove_watcher() i=4 2024-09-12T00:40:47.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.800+0000 7f6833f509c0 20 remove_watcher() i=5 2024-09-12T00:40:47.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.800+0000 7f6833f509c0 20 remove_watcher() i=6 2024-09-12T00:40:47.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.804+0000 7f6833f509c0 20 remove_watcher() i=7 2024-09-12T00:40:47.818 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:40:47.845 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:47.845 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:47.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.892+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.892+0000 7f01dc5d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.892+0000 7f01dc5d29c0 20 realm 2024-09-12T00:40:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.892+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.892+0000 7f01dc5d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.892+0000 7f01dc5d29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.892+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.892+0000 7f01dc5d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:47.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.892+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.896+0000 7f01dc5d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:47.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.896+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:47.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.896+0000 7f01dc5d29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:47.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.896+0000 7f01dc5d29c0 20 searching for the correct realm 2024-09-12T00:40:47.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:47.900+0000 7f01da8d9640 0 -- 172.21.15.102:0/3699743170 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f01d00e4070 msgr2=0x7f01d00db960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:48.114 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.116+0000 7f01d98d7640 0 -- 172.21.15.102:0/3699743170 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f01d4026400 msgr2=0x7f01d4026880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:48.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:48.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:48.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:48.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:48.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:48.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:48.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:48.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:48.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:48.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:48.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.332+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:48.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:48.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 zone default found 2024-09-12T00:40:48.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 4 Realm: () 2024-09-12T00:40:48.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:48.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:48.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:48.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 zonegroup default 2024-09-12T00:40:48.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:48.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:48.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:48.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:48.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:48.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:48.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 started sync module instance, tier type = 2024-09-12T00:40:48.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.336+0000 7f01dc5d29c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:48.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.360+0000 7f01dc5d29c0 20 add_watcher() i=0 2024-09-12T00:40:48.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.360+0000 7f01dc5d29c0 20 add_watcher() i=1 2024-09-12T00:40:48.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.360+0000 7f01dc5d29c0 20 add_watcher() i=2 2024-09-12T00:40:48.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.360+0000 7f01dc5d29c0 20 add_watcher() i=3 2024-09-12T00:40:48.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.360+0000 7f01dc5d29c0 20 add_watcher() i=4 2024-09-12T00:40:48.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.360+0000 7f01dc5d29c0 20 add_watcher() i=5 2024-09-12T00:40:48.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.360+0000 7f01dc5d29c0 20 add_watcher() i=6 2024-09-12T00:40:48.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.364+0000 7f01dc5d29c0 20 add_watcher() i=7 2024-09-12T00:40:48.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.364+0000 7f01dc5d29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:48.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.368+0000 7f0090fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:48.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.368+0000 7f01dc5d29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:48.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.368+0000 7f01dc5d29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:48.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.368+0000 7f01dc5d29c0 5 note: GC not initialized 2024-09-12T00:40:48.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.368+0000 7f000b7fe640 20 reqs_thread_entry: start 2024-09-12T00:40:48.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.368+0000 7f01dc5d29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:48.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.368+0000 7f01dc5d29c0 20 Filter name: none 2024-09-12T00:40:48.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.368+0000 7f00097fa640 20 reqs_thread_entry: start 2024-09-12T00:40:48.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.368+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:48.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.372+0000 7f01dc5d29c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:48.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.372+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:48.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.372+0000 7f01dc5d29c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:48.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.372+0000 7f01dc5d29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:48.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.372+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:48.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.372+0000 7f01dc5d29c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:48.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.372+0000 7f01dc5d29c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:48.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.372+0000 7f01dc5d29c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:48.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.372+0000 7f01dc5d29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:48.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.376+0000 7f0090fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:48.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.380+0000 7f01dc5d29c0 20 remove_watcher() i=0 2024-09-12T00:40:48.379 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.380+0000 7f01dc5d29c0 2 removed watcher, disabling cache 2024-09-12T00:40:48.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.384+0000 7f01dc5d29c0 20 remove_watcher() i=1 2024-09-12T00:40:48.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.384+0000 7f01dc5d29c0 20 remove_watcher() i=2 2024-09-12T00:40:48.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.388+0000 7f01dc5d29c0 20 remove_watcher() i=3 2024-09-12T00:40:48.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.388+0000 7f01dc5d29c0 20 remove_watcher() i=4 2024-09-12T00:40:48.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.392+0000 7f01dc5d29c0 20 remove_watcher() i=5 2024-09-12T00:40:48.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.392+0000 7f01dc5d29c0 20 remove_watcher() i=6 2024-09-12T00:40:48.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:48.392+0000 7f01dc5d29c0 20 remove_watcher() i=7 2024-09-12T00:40:48.406 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:48.406 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:48.406 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: error-at-change-reshard-state id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:40:48.406 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:48.407 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:48.408 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:48.435 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:48.435 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:48.984 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:48.984 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:49.356 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:40:49.357 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:49.360 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:49.360 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:49.515 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:49.515 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:49.605 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:49.605 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:49.719 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:49.719 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:49.825 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:49.825 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:49.927 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:49.928 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:50.027 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:50.028 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:50.128 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:50.128 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:50.231 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:50.232 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:50.329 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:50.427 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:50.428 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:50.531 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:50.531 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:50.634 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:50.634 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:50.737 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:50.737 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:50.841 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:50.841 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:50.939 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:50.939 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:51.040 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.040 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:51.145 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.146 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:51.249 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.249 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:51.348 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.348 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:51.447 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.448 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:51.545 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:51.545 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:51.643 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:40:51.677 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:51.677 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:51.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.724+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 realm 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:51.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.726 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:51.727 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:51.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:51.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.728+0000 7f831678c9c0 20 searching for the correct realm 2024-09-12T00:40:51.731 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.732+0000 7f8314a93640 0 -- 172.21.15.102:0/2086675952 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f8308057040 msgr2=0x7f8308077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:51.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:51.948+0000 7f8313a91640 0 -- 172.21.15.102:0/2086675952 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f830c0513b0 msgr2=0x7f830c039400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:52.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.164+0000 7f831678c9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:52.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.164+0000 7f831678c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.164+0000 7f831678c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.164+0000 7f831678c9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.164+0000 7f831678c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.164+0000 7f831678c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.164+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 20 zone default found 2024-09-12T00:40:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 4 Realm: () 2024-09-12T00:40:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 20 zonegroup default 2024-09-12T00:40:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.168+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.172+0000 7f831678c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.172+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.172+0000 7f831678c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.172+0000 7f831678c9c0 20 started sync module instance, tier type = 2024-09-12T00:40:52.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.172+0000 7f831678c9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:52.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.196+0000 7f831678c9c0 20 add_watcher() i=0 2024-09-12T00:40:52.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.196+0000 7f831678c9c0 20 add_watcher() i=1 2024-09-12T00:40:52.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.196+0000 7f831678c9c0 20 add_watcher() i=2 2024-09-12T00:40:52.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.196+0000 7f831678c9c0 20 add_watcher() i=3 2024-09-12T00:40:52.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.196+0000 7f831678c9c0 20 add_watcher() i=4 2024-09-12T00:40:52.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.196+0000 7f831678c9c0 20 add_watcher() i=5 2024-09-12T00:40:52.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.196+0000 7f831678c9c0 20 add_watcher() i=6 2024-09-12T00:40:52.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.196+0000 7f831678c9c0 20 add_watcher() i=7 2024-09-12T00:40:52.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.196+0000 7f831678c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:52.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.200+0000 7f81cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.204+0000 7f831678c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:52.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.204+0000 7f831678c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:52.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.204+0000 7f831678c9c0 5 note: GC not initialized 2024-09-12T00:40:52.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.204+0000 7f81c9fdb640 20 reqs_thread_entry: start 2024-09-12T00:40:52.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.204+0000 7f831678c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:52.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.204+0000 7f831678c9c0 20 Filter name: none 2024-09-12T00:40:52.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.204+0000 7f813b7fe640 20 reqs_thread_entry: start 2024-09-12T00:40:52.202 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.204+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.204+0000 7f831678c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:52.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.204+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.208+0000 7f831678c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:52.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.208+0000 7f831678c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:52.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.208+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.208+0000 7f831678c9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:52.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.208+0000 7f831678c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.208+0000 7f831678c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:52.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.208+0000 7f831678c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:52.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.212+0000 7f81cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.216+0000 7f831678c9c0 20 remove_watcher() i=0 2024-09-12T00:40:52.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.216+0000 7f831678c9c0 2 removed watcher, disabling cache 2024-09-12T00:40:52.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.216+0000 7f831678c9c0 20 remove_watcher() i=1 2024-09-12T00:40:52.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.220+0000 7f831678c9c0 20 remove_watcher() i=2 2024-09-12T00:40:52.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.220+0000 7f831678c9c0 20 remove_watcher() i=3 2024-09-12T00:40:52.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.224+0000 7f831678c9c0 20 remove_watcher() i=4 2024-09-12T00:40:52.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.224+0000 7f831678c9c0 20 remove_watcher() i=5 2024-09-12T00:40:52.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.228+0000 7f831678c9c0 20 remove_watcher() i=6 2024-09-12T00:40:52.226 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.228+0000 7f831678c9c0 20 remove_watcher() i=7 2024-09-12T00:40:52.240 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.240 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:52.240 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-change-reshard-state id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:52.241 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.241 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:40:52.277 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:52.278 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:52.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.324+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 realm 2024-09-12T00:40:52.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:52.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:52.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 searching for the correct realm 2024-09-12T00:40:52.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.332+0000 7ffa435b2640 0 -- 172.21.15.102:0/1422736489 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7ffa38055040 msgr2=0x7ffa38055930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:52.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.548+0000 7ffa425b0640 0 -- 172.21.15.102:0/1422736489 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7ffa3c096b20 msgr2=0x7ffa3c06c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:52.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:52.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:52.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 zone default found 2024-09-12T00:40:52.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 4 Realm: () 2024-09-12T00:40:52.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:52.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:52.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:52.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 zonegroup default 2024-09-12T00:40:52.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 started sync module instance, tier type = 2024-09-12T00:40:52.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:52.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=0 2024-09-12T00:40:52.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=1 2024-09-12T00:40:52.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=2 2024-09-12T00:40:52.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=3 2024-09-12T00:40:52.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=4 2024-09-12T00:40:52.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=5 2024-09-12T00:40:52.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=6 2024-09-12T00:40:52.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=7 2024-09-12T00:40:52.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.792+0000 7ffa452ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:52.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.796+0000 7ff8f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:52.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:52.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 note: GC not initialized 2024-09-12T00:40:52.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ff8f8fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:52.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:52.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 Filter name: none 2024-09-12T00:40:52.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ff8f1ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:52.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:40:52.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:52.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:52.798 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:40:52.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 : miss 2024-09-12T00:40:52.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:52.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:40:52.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:40:52.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:52.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:52.800 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 2024-09-12T00:40:52.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:40:52.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:40:52.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:52.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40, ofs0, ns] 2024-09-12T00:40:52.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 93919328510512 notifier 7466 bl.length()=1015 2024-09-12T00:40:52.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:40:52.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:40:52.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:52.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_sources= new_sources= 2024-09-12T00:40:52.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential sources added=[] removed=[] 2024-09-12T00:40:52.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_dests= new_dests= 2024-09-12T00:40:52.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential dests added=[] removed=[] 2024-09-12T00:40:52.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.0 2024-09-12T00:40:52.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.0 2024-09-12T00:40:52.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.1 2024-09-12T00:40:52.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.1 2024-09-12T00:40:52.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.2 2024-09-12T00:40:52.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.2 2024-09-12T00:40:52.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.3 2024-09-12T00:40:52.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.3 2024-09-12T00:40:52.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.4 2024-09-12T00:40:52.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.4 2024-09-12T00:40:52.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.5 2024-09-12T00:40:52.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.5 2024-09-12T00:40:52.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.6 2024-09-12T00:40:52.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.6 2024-09-12T00:40:52.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.7 2024-09-12T00:40:52.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.7 2024-09-12T00:40:52.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.8 2024-09-12T00:40:52.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.8 2024-09-12T00:40:52.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.9 2024-09-12T00:40:52.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.9 2024-09-12T00:40:52.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.10 2024-09-12T00:40:52.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.10 2024-09-12T00:40:52.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.11 2024-09-12T00:40:52.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.11 2024-09-12T00:40:52.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.0 2024-09-12T00:40:52.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1 2024-09-12T00:40:52.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2 2024-09-12T00:40:52.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.832+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.3 2024-09-12T00:40:52.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.832+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.4 2024-09-12T00:40:52.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.832+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.5 2024-09-12T00:40:52.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.6 2024-09-12T00:40:52.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.7 2024-09-12T00:40:52.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.8 2024-09-12T00:40:52.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.9 2024-09-12T00:40:52.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.840+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.10 2024-09-12T00:40:52.842 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffa452ab9c0 time 2024-09-12T00:40:52.848428+0000 2024-09-12T00:40:52.842 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:52.844 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:52.844 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffa48b852eb] 2024-09-12T00:40:52.844 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa48b8549f] 2024-09-12T00:40:52.844 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556b49516cc1] 2024-09-12T00:40:52.844 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x556b4952b01c] 2024-09-12T00:40:52.844 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556b4952c6a4] 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa479ebd90] 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.844+0000 7ffa452ab9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffa452ab9c0 time 2024-09-12T00:40:52.848428+0000 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffa48b852eb] 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa48b8549f] 2024-09-12T00:40:52.845 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556b49516cc1] 2024-09-12T00:40:52.846 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x556b4952b01c] 2024-09-12T00:40:52.846 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556b4952c6a4] 2024-09-12T00:40:52.846 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:40:52.846 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa479ebd90] 2024-09-12T00:40:52.846 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:40:52.846 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:40:52.846 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.846 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:40:52.846 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7ffa452ab9c0 thread_name:radosgw-admin 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffa47a04520] 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffa48b85345] 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa48b8549f] 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556b49516cc1] 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x556b4952b01c] 2024-09-12T00:40:52.862 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556b4952c6a4] 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa479ebd90] 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.848+0000 7ffa452ab9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7ffa452ab9c0 thread_name:radosgw-admin 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffa47a04520] 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:40:52.863 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffa48b85345] 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa48b8549f] 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556b49516cc1] 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x556b4952b01c] 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556b4952c6a4] 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa479ebd90] 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26d4f0) adding con mode: secure 2024-09-12T00:40:52.864 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 1 librados: starting msgr at 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 1 librados: starting objecter 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command objecter_requests hook 0x556b4c2714d0 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 1 librados: setting wanted keys 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 1 librados: calling monclient init 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: init 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding auth protocol: cephx 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding auth protocol: cephx 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding auth protocol: cephx 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.865 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command rotate-key hook 0x556b4c26a558 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-c con 0x556b4c1282a0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:52.866 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-b con 0x556b4c1b0110 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-a con 0x556b4c1b3280 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): authenticate will time out at 2840.806272s 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): get_auth_request con 0x556b4c1282a0 auth_method 0 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): get_auth_request con 0x556b4c1b3280 auth_method 0 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.867 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): handle_auth_done global_id 7457 payload 824 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient: _finish_hunting 0 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:40:52.304+0000 7ffa42db1640 1 monclient: found mon.noname-c 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:40:52.304+0000 7ffa425b0640 10 monclient: get_auth_request con 0x556b4c1b0110 auth_method 0 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.868 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: dump: 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: _finish_auth 0 2024-09-12T00:40:52.869 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: _check_auth_tickets 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: dump: 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.870 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:40:52.304+0000 7ff930e09640 4 set_mon_vals no callback set 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 monclient: authenticate success, global_id 7457 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 1 librados: init done 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:40:52.308+0000 7ff92f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:40:52.308+0000 7ff92f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:40:52.308+0000 7ff92f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:40:52.308+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ff928070b10 auth_method 0 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:40:52.308+0000 7ffa435b2640 10 monclient: get_auth_request con 0x556b4c292580 auth_method 0 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:40:52.308+0000 7ffa42db1640 10 monclient: get_auth_request con 0x556b4c2b4f40 auth_method 0 2024-09-12T00:40:52.871 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:40:52.312+0000 7ffa425b0640 10 monclient: get_auth_request con 0x556b4c2b9330 auth_method 0 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:40:52.312+0000 7ffa435b2640 10 monclient: get_auth_request con 0x556b4c2b87f0 auth_method 0 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 10 monclient: monmap: 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:52.872 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding auth protocol: cephx 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding auth protocol: cephx 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding auth protocol: cephx 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.873 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x556b4c2c4f00 EEXIST 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: init 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding auth protocol: cephx 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding auth protocol: cephx 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding auth protocol: cephx 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.874 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x556b4c2c0550 EEXIST 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:40:52.875 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-c con 0x556b4c2e90b0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-a con 0x556b4c2e89e0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-b con 0x556b4c2e73c0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): authenticate will time out at 2840.817075s 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): get_auth_request con 0x556b4c2e90b0 auth_method 0 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): get_auth_request con 0x556b4c2e89e0 auth_method 0 2024-09-12T00:40:52.876 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:40:52.316+0000 7ffa42db1640 10 monclient(hunting): get_auth_request con 0x556b4c2e73c0 auth_method 0 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:40:52.316+0000 7ffa42db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:40:52.316+0000 7ffa42db1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:40:52.316+0000 7ffa42db1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): handle_auth_done global_id 7959 payload 824 2024-09-12T00:40:52.877 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient: _finish_hunting 0 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:40:52.316+0000 7ffa435b2640 1 monclient: found mon.noname-a 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: dump: 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.878 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: _finish_auth 0 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 monclient: authenticate success, global_id 7959 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: dump: 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.879 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:40:52.316+0000 7ffa43db3640 4 set_mon_vals no callback set 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:40:52.320+0000 7ff92ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:40:52.320+0000 7ff92ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:40:52.320+0000 7ff92ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:52.880 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:52.881 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: monmap: 2024-09-12T00:40:52.881 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:52.881 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:52.881 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:52.881 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:52.881 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:52.881 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.881 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:52.882 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:52.882 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:52.882 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.882 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding auth protocol: cephx 2024-09-12T00:40:52.882 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding auth protocol: cephx 2024-09-12T00:40:52.882 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding auth protocol: cephx 2024-09-12T00:40:52.882 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.882 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.882 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.882 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:40:52.320+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ff91c070a20 auth_method 0 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: init 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding auth protocol: cephx 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding auth protocol: cephx 2024-09-12T00:40:52.883 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding auth protocol: cephx 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.884 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd65177da8 EEXIST 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-b con 0x556b4c33cf30 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-a con 0x556b4c337580 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-c con 0x556b4c338930 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): authenticate will time out at 2840.821401s 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): get_auth_request con 0x556b4c337580 auth_method 0 2024-09-12T00:40:52.885 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): get_auth_request con 0x556b4c338930 auth_method 0 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.886 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.887 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.887 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:40:52.320+0000 7ffa425b0640 10 monclient(hunting): get_auth_request con 0x556b4c33cf30 auth_method 0 2024-09-12T00:40:52.887 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:40:52.320+0000 7ffa425b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.887 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:40:52.320+0000 7ffa425b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.887 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:40:52.320+0000 7ffa425b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.887 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): handle_auth_done global_id 7962 payload 274 2024-09-12T00:40:52.887 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient: _finish_hunting 0 2024-09-12T00:40:52.887 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:40:52.320+0000 7ffa435b2640 1 monclient: found mon.noname-a 2024-09-12T00:40:52.887 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:52.887 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: dump: 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.888 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: _finish_auth 0 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: _check_auth_tickets 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: dump: 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.889 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 monclient: authenticate success, global_id 7962 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 4 set_mon_vals no callback set 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: shutdown 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: monmap: 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:52.890 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding auth protocol: cephx 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding auth protocol: cephx 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding auth protocol: cephx 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.891 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 librados: starting msgr at 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 librados: starting objecter 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x556b4c30dfb0 EEXIST 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 librados: setting wanted keys 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 librados: calling monclient init 2024-09-12T00:40:52.892 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: init 2024-09-12T00:40:52.893 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding auth protocol: cephx 2024-09-12T00:40:52.893 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding auth protocol: cephx 2024-09-12T00:40:52.893 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding auth protocol: cephx 2024-09-12T00:40:52.893 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.893 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.893 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.893 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.893 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.893 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.893 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.894 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.894 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.894 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.894 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.894 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.894 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.894 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.894 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x556b4c2eb018 EEXIST 2024-09-12T00:40:52.894 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:52.894 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-a con 0x556b4c338930 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-b con 0x556b4c33cf30 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-c con 0x556b4c32d260 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient(hunting): authenticate will time out at 2840.824010s 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): get_auth_request con 0x556b4c32d260 auth_method 0 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): get_auth_request con 0x556b4c338930 auth_method 0 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.895 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): handle_auth_done global_id 7466 payload 824 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient: _finish_hunting 0 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:40:52.324+0000 7ffa42db1640 1 monclient: found mon.noname-c 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:40:52.324+0000 7ffa435b2640 10 monclient: get_auth_request con 0x556b4c33cf30 auth_method 0 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:52.896 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: dump: 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: _finish_auth 0 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:52.897 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: dump: 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 5 monclient: authenticate success, global_id 7466 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:40:52.324+0000 7ff9267fc640 4 set_mon_vals no callback set 2024-09-12T00:40:52.898 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 1 librados: init done 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command cr dump hook 0x556b4c34b1c8 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:40:52.324+0000 7ff924ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:40:52.324+0000 7ff924ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:40:52.324+0000 7ff924ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:40:52.324+0000 7ffa435b2640 10 monclient: get_auth_request con 0x556b4c356fa0 auth_method 0 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ff90c070ae0 auth_method 0 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 realm 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.899 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:40:52.328+0000 7ffa425b0640 10 monclient: get_auth_request con 0x556b4c35b240 auth_method 0 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:40:52.328+0000 7ffa435b2640 10 monclient: get_auth_request con 0x556b4c35eaa0 auth_method 0 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 searching for the correct realm 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:40:52.328+0000 7ffa42db1640 10 monclient: get_auth_request con 0x556b4c3637c0 auth_method 0 2024-09-12T00:40:52.900 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:40:52.332+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ffa3c0840a0 auth_method 0 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:40:52.332+0000 7ffa435b2640 10 monclient: get_auth_request con 0x7ffa38055040 auth_method 0 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:40:52.332+0000 7ffa435b2640 0 -- 172.21.15.102:0/1422736489 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7ffa38055040 msgr2=0x7ffa38055930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:40:52.536+0000 7ffa435b2640 10 monclient: get_auth_request con 0x7ffa38055040 auth_method 0 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:40:52.540+0000 7ffa42db1640 10 monclient: get_auth_request con 0x7ffa3c0961a0 auth_method 0 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:40:52.548+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ffa3c096b20 auth_method 0 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:40:52.548+0000 7ffa425b0640 0 -- 172.21.15.102:0/1422736489 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7ffa3c096b20 msgr2=0x7ffa3c06c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:40:52.752+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ffa3c096b20 auth_method 0 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:52.901 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 zone default found 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 4 Realm: () 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 zonegroup default 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.902 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 started sync module instance, tier type = 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=0 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=1 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=2 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=3 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=4 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=5 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=6 2024-09-12T00:40:52.903 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=7 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding auth protocol: cephx 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding auth protocol: cephx 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding auth protocol: cephx 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.904 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:40:52.796+0000 7ff8f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command cache list hook 0x556b4c33bbb0 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command cache inspect hook 0x556b4c33bbb0 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command cache erase hook 0x556b4c33bbb0 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command cache zap hook 0x556b4c33bbb0 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 note: GC not initialized 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:40:52.800+0000 7ff8f8fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:52.905 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command sync trace show hook 0x7ffa3c030020 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command sync trace history hook 0x7ffa3c030020 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command sync trace active hook 0x7ffa3c030020 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command sync trace active_short hook 0x7ffa3c030020 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 Filter name: none 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:40:52.800+0000 7ff8f1ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 : miss 2024-09-12T00:40:52.906 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.907 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:52.907 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:40:52.907 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:40:52.907 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:52.907 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:52.907 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 2024-09-12T00:40:52.907 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:40:52.907 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:40:52.907 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:52.908 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40, ofs0, ns] 2024-09-12T00:40:52.908 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 93919328510512 notifier 7466 bl.length()=1015 2024-09-12T00:40:52.908 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:40:52.908 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:40:52.908 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_sources= new_sources= 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential sources added=[] removed=[] 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_dests= new_dests= 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential dests added=[] removed=[] 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.0 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.0 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.1 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.1 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.2 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.2 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.3 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.3 2024-09-12T00:40:52.909 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.4 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.4 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.5 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.5 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.6 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.6 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.7 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.7 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.8 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.8 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.9 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.9 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.10 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.10 2024-09-12T00:40:52.910 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.11 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.11 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.0 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:40:52.832+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.3 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:40:52.832+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.4 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:40:52.832+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.5 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.6 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.7 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.8 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.9 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:40:52.840+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.10 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:40:52.844+0000 7ffa452ab9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffa452ab9c0 time 2024-09-12T00:40:52.848428+0000 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:52.911 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffa48b852eb] 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa48b8549f] 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556b49516cc1] 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x556b4952b01c] 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556b4952c6a4] 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa479ebd90] 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:40:52.848+0000 7ffa452ab9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7ffa452ab9c0 thread_name:radosgw-admin 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.912 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffa47a04520] 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffa48b85345] 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa48b8549f] 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556b49516cc1] 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x556b4952b01c] 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556b4952c6a4] 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa479ebd90] 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:52.913 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:40:52.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:40:52.915 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:52.916 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:40:52.917 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:52.918 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:52.919 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff8f1ffb640 / http_manager 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff8f8fe1640 / http_manager 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff8f9fe3640 / rgw_dt_lg_renew 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff924ff9640 / ms_dispatch 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff9267fc640 / io_context_pool 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff92ce01640 / ms_dispatch 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff92f606640 / ms_dispatch 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff930e09640 / io_context_pool 2024-09-12T00:40:52.920 INFO:tasks.workunit.client.0.smithi102.stderr: 7ffa425b0640 / msgr-worker-2 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr: 7ffa42db1640 / msgr-worker-1 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr: 7ffa435b2640 / msgr-worker-0 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr: 7ffa43db3640 / io_context_pool 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr: 7ffa452ab9c0 / radosgw-admin 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.136572.log 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26d4f0) adding con mode: secure 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.921 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 1 librados: starting msgr at 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 1 librados: starting objecter 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command objecter_requests hook 0x556b4c2714d0 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 1 librados: setting wanted keys 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 1 librados: calling monclient init 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: init 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding auth protocol: cephx 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding auth protocol: cephx 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding auth protocol: cephx 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.922 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: crc 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c26a410) adding con mode: secure 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command rotate-key hook 0x556b4c26a558 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-c con 0x556b4c1282a0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:52.923 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-b con 0x556b4c1b0110 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-a con 0x556b4c1b3280 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient(hunting): authenticate will time out at 2840.806272s 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): get_auth_request con 0x556b4c1282a0 auth_method 0 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): get_auth_request con 0x556b4c1b3280 auth_method 0 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.924 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:40:52.304+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient(hunting): handle_auth_done global_id 7457 payload 824 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient: _finish_hunting 0 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:40:52.304+0000 7ffa42db1640 1 monclient: found mon.noname-c 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:40:52.304+0000 7ffa42db1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:40:52.304+0000 7ffa425b0640 10 monclient: get_auth_request con 0x556b4c1b0110 auth_method 0 2024-09-12T00:40:52.925 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: dump: 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.926 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: _finish_auth 0 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: _check_auth_tickets 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:40:52.304+0000 7ff92f606640 10 monclient: dump: 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.927 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:40:52.304+0000 7ff930e09640 4 set_mon_vals no callback set 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 5 monclient: authenticate success, global_id 7457 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:40:52.304+0000 7ffa452ab9c0 1 librados: init done 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:40:52.308+0000 7ff92f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:40:52.308+0000 7ff92f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.928 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:40:52.308+0000 7ff92f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:40:52.308+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ff928070b10 auth_method 0 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:40:52.308+0000 7ffa435b2640 10 monclient: get_auth_request con 0x556b4c292580 auth_method 0 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:40:52.308+0000 7ffa42db1640 10 monclient: get_auth_request con 0x556b4c2b4f40 auth_method 0 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:40:52.312+0000 7ffa425b0640 10 monclient: get_auth_request con 0x556b4c2b9330 auth_method 0 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:40:52.312+0000 7ffa435b2640 10 monclient: get_auth_request con 0x556b4c2b87f0 auth_method 0 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 10 monclient: monmap: 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:52.929 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding auth protocol: cephx 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding auth protocol: cephx 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding auth protocol: cephx 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.930 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: crc 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:40:52.312+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c1510) adding con mode: secure 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x556b4c2c4f00 EEXIST 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: init 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding auth protocol: cephx 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding auth protocol: cephx 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding auth protocol: cephx 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.931 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: crc 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2c0408) adding con mode: secure 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.932 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x556b4c2c0550 EEXIST 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-c con 0x556b4c2e90b0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-a con 0x556b4c2e89e0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-b con 0x556b4c2e73c0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient(hunting): authenticate will time out at 2840.817075s 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): get_auth_request con 0x556b4c2e90b0 auth_method 0 2024-09-12T00:40:52.933 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): get_auth_request con 0x556b4c2e89e0 auth_method 0 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:40:52.316+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:40:52.316+0000 7ffa42db1640 10 monclient(hunting): get_auth_request con 0x556b4c2e73c0 auth_method 0 2024-09-12T00:40:52.934 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:40:52.316+0000 7ffa42db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:40:52.316+0000 7ffa42db1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:40:52.316+0000 7ffa42db1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient(hunting): handle_auth_done global_id 7959 payload 824 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient: _finish_hunting 0 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:40:52.316+0000 7ffa435b2640 1 monclient: found mon.noname-a 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:40:52.316+0000 7ffa435b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: dump: 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.935 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: _finish_auth 0 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 5 monclient: authenticate success, global_id 7959 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.936 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:40:52.316+0000 7ff92ce01640 10 monclient: dump: 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:40:52.316+0000 7ffa43db3640 4 set_mon_vals no callback set 2024-09-12T00:40:52.937 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:40:52.316+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:40:52.320+0000 7ff92ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:40:52.320+0000 7ff92ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:40:52.320+0000 7ff92ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: monmap: 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:52.938 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding auth protocol: cephx 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding auth protocol: cephx 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding auth protocol: cephx 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.939 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: crc 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c308a90) adding con mode: secure 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:40:52.320+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ff91c070a20 auth_method 0 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: init 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding auth protocol: cephx 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding auth protocol: cephx 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding auth protocol: cephx 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.940 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: crc 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65177c60) adding con mode: secure 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd65177da8 EEXIST 2024-09-12T00:40:52.941 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-b con 0x556b4c33cf30 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-a con 0x556b4c337580 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-c con 0x556b4c338930 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): authenticate will time out at 2840.821401s 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): get_auth_request con 0x556b4c337580 auth_method 0 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.942 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): get_auth_request con 0x556b4c338930 auth_method 0 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:40:52.320+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:40:52.320+0000 7ffa425b0640 10 monclient(hunting): get_auth_request con 0x556b4c33cf30 auth_method 0 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:40:52.320+0000 7ffa425b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:40:52.320+0000 7ffa425b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:40:52.320+0000 7ffa425b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.943 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient(hunting): handle_auth_done global_id 7962 payload 274 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient: _finish_hunting 0 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:40:52.320+0000 7ffa435b2640 1 monclient: found mon.noname-a 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:40:52.320+0000 7ffa435b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: dump: 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.944 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: _finish_auth 0 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: _check_auth_tickets 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:40:52.320+0000 7ff9267fc640 10 monclient: dump: 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.945 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 monclient: authenticate success, global_id 7962 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 4 set_mon_vals no callback set 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: shutdown 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: build_initial_monmap 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: monmap: 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:52.946 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding auth protocol: cephx 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding auth protocol: cephx 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding auth protocol: cephx 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.947 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.948 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.948 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.948 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.948 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.948 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: crc 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c32d750) adding con mode: secure 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 librados: starting msgr at 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 librados: starting objecter 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x556b4c30dfb0 EEXIST 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 librados: setting wanted keys 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 1 librados: calling monclient init 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: init 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding auth protocol: cephx 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding auth protocol: cephx 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding auth protocol: cephx 2024-09-12T00:40:52.949 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: crc 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 AuthRegistry(0x556b4c2eaed0) adding con mode: secure 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.950 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x556b4c2eb018 EEXIST 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-a con 0x556b4c338930 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-b con 0x556b4c33cf30 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): picked mon.noname-c con 0x556b4c32d260 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:40:52.320+0000 7ffa452ab9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient(hunting): authenticate will time out at 2840.824010s 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): get_auth_request con 0x556b4c32d260 auth_method 0 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.951 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): get_auth_request con 0x556b4c338930 auth_method 0 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient(hunting): handle_auth_done global_id 7466 payload 824 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient: _finish_hunting 0 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:40:52.324+0000 7ffa42db1640 1 monclient: found mon.noname-c 2024-09-12T00:40:52.952 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:40:52.324+0000 7ffa42db1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:40:52.324+0000 7ffa435b2640 10 monclient: get_auth_request con 0x556b4c33cf30 auth_method 0 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: dump: 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.953 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: _finish_auth 0 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:40:52.324+0000 7ff924ff9640 10 monclient: dump: 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:40:52.954 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 5 monclient: authenticate success, global_id 7466 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:40:52.324+0000 7ff9267fc640 4 set_mon_vals no callback set 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient: _renew_subs 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 1 librados: init done 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command cr dump hook 0x556b4c34b1c8 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:40:52.324+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:40:52.324+0000 7ff924ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:40:52.324+0000 7ff924ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:40:52.324+0000 7ff924ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:40:52.324+0000 7ffa435b2640 10 monclient: get_auth_request con 0x556b4c356fa0 auth_method 0 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:40:52.324+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ff90c070ae0 auth_method 0 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.955 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 realm 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:40:52.328+0000 7ffa425b0640 10 monclient: get_auth_request con 0x556b4c35b240 auth_method 0 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:40:52.328+0000 7ffa435b2640 10 monclient: get_auth_request con 0x556b4c35eaa0 auth_method 0 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:40:52.328+0000 7ffa452ab9c0 20 searching for the correct realm 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:40:52.328+0000 7ffa42db1640 10 monclient: get_auth_request con 0x556b4c3637c0 auth_method 0 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:40:52.332+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ffa3c0840a0 auth_method 0 2024-09-12T00:40:52.956 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:40:52.332+0000 7ffa435b2640 10 monclient: get_auth_request con 0x7ffa38055040 auth_method 0 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:40:52.332+0000 7ffa435b2640 0 -- 172.21.15.102:0/1422736489 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7ffa38055040 msgr2=0x7ffa38055930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:40:52.536+0000 7ffa435b2640 10 monclient: get_auth_request con 0x7ffa38055040 auth_method 0 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:40:52.540+0000 7ffa42db1640 10 monclient: get_auth_request con 0x7ffa3c0961a0 auth_method 0 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:40:52.548+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ffa3c096b20 auth_method 0 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:40:52.548+0000 7ffa425b0640 0 -- 172.21.15.102:0/1422736489 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7ffa3c096b20 msgr2=0x7ffa3c06c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:40:52.752+0000 7ffa425b0640 10 monclient: get_auth_request con 0x7ffa3c096b20 auth_method 0 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.957 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:40:52.764+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 zone default found 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 4 Realm: () 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 zonegroup default 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.958 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 started sync module instance, tier type = 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:40:52.768+0000 7ffa452ab9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=0 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=1 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=2 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=3 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=4 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=5 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=6 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 20 add_watcher() i=7 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:40:52.792+0000 7ffa452ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding auth protocol: cephx 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding auth protocol: cephx 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding auth protocol: cephx 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.959 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: crc 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:40:52.796+0000 7ffa452ab9c0 5 AuthRegistry(0x7ffd65178140) adding con mode: secure 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:40:52.796+0000 7ff8f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:52.960 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command cache list hook 0x556b4c33bbb0 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command cache inspect hook 0x556b4c33bbb0 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command cache erase hook 0x556b4c33bbb0 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command cache zap hook 0x556b4c33bbb0 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 note: GC not initialized 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:40:52.800+0000 7ff8f8fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command sync trace show hook 0x7ffa3c030020 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command sync trace history hook 0x7ffa3c030020 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command sync trace active hook 0x7ffa3c030020 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 5 asok(0x556b4c05d2b0) register_command sync trace active_short hook 0x7ffa3c030020 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 Filter name: none 2024-09-12T00:40:52.961 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:40:52.800+0000 7ff8f1ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:52.962 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:40:52.962 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.962 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:52.962 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:52.962 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:40:52.962 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 : miss 2024-09-12T00:40:52.962 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.962 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:40:52.962 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:40:52.963 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:40:52.963 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:52.963 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:52.963 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:40:52.800+0000 7ffa452ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 2024-09-12T00:40:52.963 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:40:52.963 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:40:52.963 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:52.964 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40, ofs0, ns] 2024-09-12T00:40:52.964 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 93919328510512 notifier 7466 bl.length()=1015 2024-09-12T00:40:52.964 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:40:52.964 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:40:52.964 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:40:52.816+0000 7ff9267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:52.965 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_sources= new_sources= 2024-09-12T00:40:52.965 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential sources added=[] removed=[] 2024-09-12T00:40:52.965 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_dests= new_dests= 2024-09-12T00:40:52.965 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:40:52.816+0000 7ffa452ab9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential dests added=[] removed=[] 2024-09-12T00:40:52.965 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.0 2024-09-12T00:40:52.965 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.0 2024-09-12T00:40:52.966 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.1 2024-09-12T00:40:52.966 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.1 2024-09-12T00:40:52.966 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.2 2024-09-12T00:40:52.966 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.2 2024-09-12T00:40:52.966 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.3 2024-09-12T00:40:52.966 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.3 2024-09-12T00:40:52.967 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.4 2024-09-12T00:40:52.967 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.4 2024-09-12T00:40:52.967 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.5 2024-09-12T00:40:52.967 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.5 2024-09-12T00:40:52.967 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.6 2024-09-12T00:40:52.967 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.6 2024-09-12T00:40:52.967 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.7 2024-09-12T00:40:52.968 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.7 2024-09-12T00:40:52.968 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.8 2024-09-12T00:40:52.968 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.8 2024-09-12T00:40:52.968 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.9 2024-09-12T00:40:52.968 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.9 2024-09-12T00:40:52.968 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.10 2024-09-12T00:40:52.969 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.10 2024-09-12T00:40:52.969 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.11 2024-09-12T00:40:52.969 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1.11 2024-09-12T00:40:52.969 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.0 2024-09-12T00:40:52.969 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1 2024-09-12T00:40:52.969 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:40:52.828+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2 2024-09-12T00:40:52.969 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:40:52.832+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.3 2024-09-12T00:40:52.970 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:40:52.832+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.4 2024-09-12T00:40:52.970 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:40:52.832+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.5 2024-09-12T00:40:52.970 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.6 2024-09-12T00:40:52.970 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.7 2024-09-12T00:40:52.970 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.8 2024-09-12T00:40:52.970 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:40:52.836+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.9 2024-09-12T00:40:52.971 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:40:52.840+0000 7ffa452ab9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.10 2024-09-12T00:40:52.971 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:40:52.844+0000 7ffa452ab9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffa452ab9c0 time 2024-09-12T00:40:52.848428+0000 2024-09-12T00:40:52.971 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:52.971 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.971 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:52.971 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffa48b852eb] 2024-09-12T00:40:52.971 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa48b8549f] 2024-09-12T00:40:52.972 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556b49516cc1] 2024-09-12T00:40:52.972 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x556b4952b01c] 2024-09-12T00:40:52.972 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556b4952c6a4] 2024-09-12T00:40:52.972 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:40:52.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa479ebd90] 2024-09-12T00:40:52.972 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:40:52.972 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:40:52.973 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.973 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:40:52.848+0000 7ffa452ab9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:52.973 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7ffa452ab9c0 thread_name:radosgw-admin 2024-09-12T00:40:52.973 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.973 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:52.973 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffa47a04520] 2024-09-12T00:40:52.973 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:40:52.974 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:40:52.974 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:40:52.974 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffa48b85345] 2024-09-12T00:40:52.974 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa48b8549f] 2024-09-12T00:40:52.974 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556b49516cc1] 2024-09-12T00:40:52.974 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x556b4952b01c] 2024-09-12T00:40:52.974 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x556b4952c6a4] 2024-09-12T00:40:52.974 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:40:52.975 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa479ebd90] 2024-09-12T00:40:52.975 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:40:52.975 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:40:52.975 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:52.975 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:52.975 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:40:52.975 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:40:52.976 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:40:52.976 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:40:52.976 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:40:52.977 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:40:52.977 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:52.977 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:40:52.977 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:40:52.977 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:52.977 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:52.978 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:52.978 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:40:52.978 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:40:52.978 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:40:52.978 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:40:52.979 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:40:52.979 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:40:52.979 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:40:52.979 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:52.979 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:52.979 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:52.979 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:40:52.979 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:40:52.980 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:52.980 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:40:52.980 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:40:52.980 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:40:52.980 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:40:52.980 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:40:52.980 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:40:52.981 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:40:52.981 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:40:52.981 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:40:52.981 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:40:52.981 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:40:52.981 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:40:52.981 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:40:52.981 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:40:52.982 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:40:52.982 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:52.982 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:40:52.982 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:40:52.982 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:52.982 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:52.982 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:40:52.983 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:52.983 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:52.983 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:52.983 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:40:52.983 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:40:52.983 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:40:52.984 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:40:52.984 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:40:52.984 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:40:52.984 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:40:52.984 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:40:52.984 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:40:52.985 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:40:52.985 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:40:52.985 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:40:52.985 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:40:52.985 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:40:52.985 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:40:52.986 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:40:52.986 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:40:52.986 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:40:52.986 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:52.986 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:52.986 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:52.987 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:40:52.987 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:52.987 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:52.987 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:52.987 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:52.987 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:40:52.988 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:52.988 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:52.988 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:52.988 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:52.988 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:52.988 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:52.989 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:40:52.989 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:52.989 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:40:52.989 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:40:52.989 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:40:52.989 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:52.990 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:40:52.990 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:40:52.990 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:52.990 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:52.990 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:52.990 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:52.991 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff8f1ffb640 / http_manager 2024-09-12T00:40:52.991 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff8f8fe1640 / http_manager 2024-09-12T00:40:52.991 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff8f9fe3640 / rgw_dt_lg_renew 2024-09-12T00:40:52.991 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff924ff9640 / ms_dispatch 2024-09-12T00:40:52.991 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff9267fc640 / io_context_pool 2024-09-12T00:40:52.992 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff92ce01640 / ms_dispatch 2024-09-12T00:40:52.992 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff92f606640 / ms_dispatch 2024-09-12T00:40:52.992 INFO:tasks.workunit.client.0.smithi102.stderr: 7ff930e09640 / io_context_pool 2024-09-12T00:40:52.992 INFO:tasks.workunit.client.0.smithi102.stderr: 7ffa425b0640 / msgr-worker-2 2024-09-12T00:40:52.992 INFO:tasks.workunit.client.0.smithi102.stderr: 7ffa42db1640 / msgr-worker-1 2024-09-12T00:40:52.993 INFO:tasks.workunit.client.0.smithi102.stderr: 7ffa435b2640 / msgr-worker-0 2024-09-12T00:40:52.993 INFO:tasks.workunit.client.0.smithi102.stderr: 7ffa43db3640 / io_context_pool 2024-09-12T00:40:52.993 INFO:tasks.workunit.client.0.smithi102.stderr: 7ffa452ab9c0 / radosgw-admin 2024-09-12T00:40:52.993 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:40:52.993 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:40:52.994 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:40:52.851572Z_afa52853-aa8a-4909-a14e-5b6fb64ce41b/log 2024-09-12T00:40:52.994 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:40:52.994 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:40:52.994 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:40:52.997 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:52.997 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:52.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.932+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.932+0000 7fbaa0ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.932+0000 7fbaa0ced9c0 20 realm 2024-09-12T00:40:52.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.932+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.932+0000 7fbaa0ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.932+0000 7fbaa0ced9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:52.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.932+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.932+0000 7fbaa0ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:52.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.932+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.936+0000 7fbaa0ced9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:52.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.936+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:52.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.936+0000 7fbaa0ced9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:52.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.936+0000 7fbaa0ced9c0 20 searching for the correct realm 2024-09-12T00:40:52.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.940+0000 7fba9eff4640 0 -- 172.21.15.102:0/1343975805 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fba940df930 msgr2=0x7fba940d3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:53.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:52.948+0000 7fba9dff2640 0 -- 172.21.15.102:0/1343975805 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fba980a1b70 msgr2=0x7fba98084960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:53.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.164+0000 7fbaa0ced9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:53.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.164+0000 7fbaa0ced9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:53.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.164+0000 7fbaa0ced9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:53.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.164+0000 7fbaa0ced9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:53.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.164+0000 7fbaa0ced9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:53.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.164+0000 7fbaa0ced9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:53.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.164+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.164+0000 7fbaa0ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.164+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:53.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 zone default found 2024-09-12T00:40:53.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 4 Realm: () 2024-09-12T00:40:53.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:53.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:53.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:53.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 zonegroup default 2024-09-12T00:40:53.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 started sync module instance, tier type = 2024-09-12T00:40:53.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.168+0000 7fbaa0ced9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:53.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.192+0000 7fbaa0ced9c0 20 add_watcher() i=0 2024-09-12T00:40:53.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.192+0000 7fbaa0ced9c0 20 add_watcher() i=1 2024-09-12T00:40:53.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.192+0000 7fbaa0ced9c0 20 add_watcher() i=2 2024-09-12T00:40:53.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.192+0000 7fbaa0ced9c0 20 add_watcher() i=3 2024-09-12T00:40:53.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.192+0000 7fbaa0ced9c0 20 add_watcher() i=4 2024-09-12T00:40:53.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.192+0000 7fbaa0ced9c0 20 add_watcher() i=5 2024-09-12T00:40:53.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.192+0000 7fbaa0ced9c0 20 add_watcher() i=6 2024-09-12T00:40:53.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.192+0000 7fbaa0ced9c0 20 add_watcher() i=7 2024-09-12T00:40:53.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.192+0000 7fbaa0ced9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:53.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.196+0000 7fb954fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:53.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.196+0000 7fbaa0ced9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:53.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.196+0000 7fbaa0ced9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:53.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.196+0000 7fbaa0ced9c0 5 note: GC not initialized 2024-09-12T00:40:53.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.196+0000 7fb8cf7fe640 20 reqs_thread_entry: start 2024-09-12T00:40:53.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.196+0000 7fbaa0ced9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:53.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.196+0000 7fbaa0ced9c0 20 Filter name: none 2024-09-12T00:40:53.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.196+0000 7fb8cd7fa640 20 reqs_thread_entry: start 2024-09-12T00:40:53.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.196+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.200+0000 7fbaa0ced9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:53.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.200+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.200+0000 7fbaa0ced9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:40:53.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.200+0000 7fbaa0ced9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:53.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.200+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.200+0000 7fbaa0ced9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:53.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.200+0000 7fbaa0ced9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.204+0000 7fbaa0ced9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:40:53.200 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.204+0000 7fbaa0ced9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:53.204 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.204+0000 7fb954fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:53.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.212+0000 7fbaa0ced9c0 20 remove_watcher() i=0 2024-09-12T00:40:53.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.212+0000 7fbaa0ced9c0 2 removed watcher, disabling cache 2024-09-12T00:40:53.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.212+0000 7fbaa0ced9c0 20 remove_watcher() i=1 2024-09-12T00:40:53.213 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.216+0000 7fbaa0ced9c0 20 remove_watcher() i=2 2024-09-12T00:40:53.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.216+0000 7fbaa0ced9c0 20 remove_watcher() i=3 2024-09-12T00:40:53.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.220+0000 7fbaa0ced9c0 20 remove_watcher() i=4 2024-09-12T00:40:53.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.220+0000 7fbaa0ced9c0 20 remove_watcher() i=5 2024-09-12T00:40:53.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.224+0000 7fbaa0ced9c0 20 remove_watcher() i=6 2024-09-12T00:40:53.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.224+0000 7fbaa0ced9c0 20 remove_watcher() i=7 2024-09-12T00:40:53.236 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:53.236 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:40:53.237 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-change-reshard-state id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:40:53.237 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:40:53.237 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.237 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:53.282 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:53.282 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:40:53.341 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:40:53.378 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:53.378 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:53.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.620+0000 7f70d1112640 0 --2- 172.21.15.102:0/1645980747 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x56201a8d0b40 0x56201a8c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:40:53.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.636+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.636+0000 7f70d3e0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.636+0000 7f70d3e0d9c0 20 realm 2024-09-12T00:40:53.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.636+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.636+0000 7f70d3e0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.636+0000 7f70d3e0d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:53.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.636+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.636+0000 7f70d3e0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.636 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.636+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.640+0000 7f70d3e0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.637 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.640+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.640+0000 7f70d3e0d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:53.639 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.640+0000 7f70d3e0d9c0 20 searching for the correct realm 2024-09-12T00:40:53.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.644+0000 7f70d2114640 0 -- 172.21.15.102:0/1524006510 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x56201a938880 msgr2=0x56201a93ac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:53.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.648+0000 7f70d1913640 0 -- 172.21.15.102:0/1524006510 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x7f70cc005800 msgr2=0x7f70cc061530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:53.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:40:53.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:53.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:53.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:40:53.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:53.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:53.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.872+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 zone default found 2024-09-12T00:40:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 4 Realm: () 2024-09-12T00:40:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:40:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:40:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 zonegroup default 2024-09-12T00:40:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 started sync module instance, tier type = 2024-09-12T00:40:53.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.876+0000 7f70d3e0d9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:40:53.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.900+0000 7f70d3e0d9c0 20 add_watcher() i=0 2024-09-12T00:40:53.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.900+0000 7f70d3e0d9c0 20 add_watcher() i=1 2024-09-12T00:40:53.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.900+0000 7f70d3e0d9c0 20 add_watcher() i=2 2024-09-12T00:40:53.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.900+0000 7f70d3e0d9c0 20 add_watcher() i=3 2024-09-12T00:40:53.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.900+0000 7f70d3e0d9c0 20 add_watcher() i=4 2024-09-12T00:40:53.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.900+0000 7f70d3e0d9c0 20 add_watcher() i=5 2024-09-12T00:40:53.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.900+0000 7f70d3e0d9c0 20 add_watcher() i=6 2024-09-12T00:40:53.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.900+0000 7f70d3e0d9c0 20 add_watcher() i=7 2024-09-12T00:40:53.900 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.900+0000 7f70d3e0d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:53.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.904+0000 7f6f837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:53.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.904+0000 7f70d3e0d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:53.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.904+0000 7f70d3e0d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:53.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.904+0000 7f70d3e0d9c0 5 note: GC not initialized 2024-09-12T00:40:53.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.904+0000 7f6f827fc640 20 reqs_thread_entry: start 2024-09-12T00:40:53.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.904+0000 7f70d3e0d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:53.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.904+0000 7f70d3e0d9c0 20 Filter name: none 2024-09-12T00:40:53.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.904+0000 7f6ef3fff640 20 reqs_thread_entry: start 2024-09-12T00:40:53.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:40:53.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:40:53.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:40:53.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:40:53.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 : miss 2024-09-12T00:40:53.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:40:53.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:40:53.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:40:53.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:53.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:40:53.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.908+0000 7f70d3e0d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 2024-09-12T00:40:53.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.912+0000 7f70d3e0d9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to be held by another RGW process; skipping for now 2024-09-12T00:40:53.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.912+0000 7f6f837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:53.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.916+0000 7f70d3e0d9c0 20 remove_watcher() i=0 2024-09-12T00:40:53.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.916+0000 7f70d3e0d9c0 2 removed watcher, disabling cache 2024-09-12T00:40:53.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.920+0000 7f70d3e0d9c0 20 remove_watcher() i=1 2024-09-12T00:40:53.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.924+0000 7f70d3e0d9c0 20 remove_watcher() i=2 2024-09-12T00:40:53.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.924+0000 7f70d3e0d9c0 20 remove_watcher() i=3 2024-09-12T00:40:53.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.928+0000 7f70d3e0d9c0 20 remove_watcher() i=4 2024-09-12T00:40:53.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.928+0000 7f70d3e0d9c0 20 remove_watcher() i=5 2024-09-12T00:40:53.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.932+0000 7f70d3e0d9c0 20 remove_watcher() i=6 2024-09-12T00:40:53.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:40:53.932+0000 7f70d3e0d9c0 20 remove_watcher() i=7 2024-09-12T00:40:53.944 INFO:tasks.workunit.client.0.smithi102.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:41:23.976 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:41:24.012 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:24.012 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:24.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.059+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.059+0000 7f6d03bad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:24.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.059+0000 7f6d03bad9c0 20 realm 2024-09-12T00:41:24.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.059+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.059+0000 7f6d03bad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:24.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.059+0000 7f6d03bad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:24.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.059+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.059+0000 7f6d03bad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:24.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.059+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.063+0000 7f6d03bad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:24.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.063+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.063+0000 7f6d03bad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:24.064 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.063+0000 7f6d03bad9c0 20 searching for the correct realm 2024-09-12T00:41:24.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.067+0000 7f6d01eb4640 0 -- 172.21.15.102:0/2368145116 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f6cf8048040 msgr2=0x7f6cf8079310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:24.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.283+0000 7f6d00eb2640 0 -- 172.21.15.102:0/2368145116 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6cfc0e9950 msgr2=0x7f6cfc007cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:24.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.499+0000 7f6d03bad9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:24.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.499+0000 7f6d03bad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:24.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.499+0000 7f6d03bad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:24.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.499+0000 7f6d03bad9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:24.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.499+0000 7f6d03bad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:24.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.499+0000 7f6d03bad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:24.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.499+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.499+0000 7f6d03bad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:24.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.499+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:24.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:24.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 zone default found 2024-09-12T00:41:24.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 4 Realm: () 2024-09-12T00:41:24.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:24.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:24.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:24.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 zonegroup default 2024-09-12T00:41:24.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:24.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:24.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:24.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 started sync module instance, tier type = 2024-09-12T00:41:24.504 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.503+0000 7f6d03bad9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:24.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.527+0000 7f6d03bad9c0 20 add_watcher() i=0 2024-09-12T00:41:24.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.527+0000 7f6d03bad9c0 20 add_watcher() i=1 2024-09-12T00:41:24.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.527+0000 7f6d03bad9c0 20 add_watcher() i=2 2024-09-12T00:41:24.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.527+0000 7f6d03bad9c0 20 add_watcher() i=3 2024-09-12T00:41:24.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.527+0000 7f6d03bad9c0 20 add_watcher() i=4 2024-09-12T00:41:24.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.527+0000 7f6d03bad9c0 20 add_watcher() i=5 2024-09-12T00:41:24.528 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.527+0000 7f6d03bad9c0 20 add_watcher() i=6 2024-09-12T00:41:24.529 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.531+0000 7f6d03bad9c0 20 add_watcher() i=7 2024-09-12T00:41:24.529 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.531+0000 7f6d03bad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:24.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6bb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:24.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:24.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:24.534 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 5 note: GC not initialized 2024-09-12T00:41:24.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6bb67e4640 20 reqs_thread_entry: start 2024-09-12T00:41:24.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:24.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 20 Filter name: none 2024-09-12T00:41:24.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6b27fff640 20 reqs_thread_entry: start 2024-09-12T00:41:24.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:41:24.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:41:24.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:41:24.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:41:24.536 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 : miss 2024-09-12T00:41:24.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.535+0000 7f6d03bad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.539+0000 7f6d03bad9c0 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:41:24.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.539+0000 7f6d03bad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:41:24.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.539+0000 7f6d03bad9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:41:24.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.539+0000 7f6d03bad9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:24.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.539+0000 7f6d03bad9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:41:24.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.539+0000 7f6d03bad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 2024-09-12T00:41:24.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.539+0000 7f6d03bad9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:41:24.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.555+0000 7f6d03bad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:41:24.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.555+0000 7f6d03bad9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:41:24.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.555+0000 7f6d03bad9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:41:24.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.555+0000 7f6d03bad9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40, ofs0, ns] 2024-09-12T00:41:24.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.555+0000 7f6bd3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94748615526656 notifier 7517 bl.length()=1015 2024-09-12T00:41:24.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.555+0000 7f6bd3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:41:24.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.555+0000 7f6bd3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:41:24.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.555+0000 7f6bd3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:41:24.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.559+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_sources= new_sources= 2024-09-12T00:41:24.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.559+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential sources added=[] removed=[] 2024-09-12T00:41:24.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.559+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_dests= new_dests= 2024-09-12T00:41:24.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.559+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential dests added=[] removed=[] 2024-09-12T00:41:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.0 2024-09-12T00:41:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.0 2024-09-12T00:41:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.1 2024-09-12T00:41:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.1 2024-09-12T00:41:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.2 2024-09-12T00:41:24.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.2 2024-09-12T00:41:24.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.3 2024-09-12T00:41:24.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.3 2024-09-12T00:41:24.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.4 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.4 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.5 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.5 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.6 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.6 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.7 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.7 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.8 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.8 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.9 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.9 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.10 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.10 2024-09-12T00:41:24.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.11 2024-09-12T00:41:24.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2.11 2024-09-12T00:41:24.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.567+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.0 2024-09-12T00:41:24.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.571+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1 2024-09-12T00:41:24.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.571+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2 2024-09-12T00:41:24.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.571+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.3 2024-09-12T00:41:24.573 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.575+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.4 2024-09-12T00:41:24.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.575+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.5 2024-09-12T00:41:24.575 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.575+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.6 2024-09-12T00:41:24.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.579+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.7 2024-09-12T00:41:24.577 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.579+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.8 2024-09-12T00:41:24.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.579+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.9 2024-09-12T00:41:24.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.579+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.10 2024-09-12T00:41:24.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.587+0000 7f6d03bad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:24.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.587+0000 7f6d03bad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 2024-09-12T00:41:24.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.587+0000 7f6d03bad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:41:24.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.587+0000 7f6d03bad9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:41:24.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.587+0000 7f6d03bad9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:41:24.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.587+0000 7f6d03bad9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40, ofs0, ns] 2024-09-12T00:41:24.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.591+0000 7f6be4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398880 cookie 94748615526656 notifier 7517 bl.length()=1015 2024-09-12T00:41:24.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.591+0000 7f6be4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:41:24.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.591+0000 7f6be4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:41:24.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.591+0000 7f6be4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:41:24.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.591+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_sources= new_sources= 2024-09-12T00:41:24.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.591+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential sources added=[] removed=[] 2024-09-12T00:41:24.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.591+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_dests= new_dests= 2024-09-12T00:41:24.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.591+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential dests added=[] removed=[] 2024-09-12T00:41:24.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.595+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.0 2024-09-12T00:41:24.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.595+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.1 2024-09-12T00:41:24.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.599+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.2 2024-09-12T00:41:24.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.599+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.3 2024-09-12T00:41:24.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.599+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.4 2024-09-12T00:41:24.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.599+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.5 2024-09-12T00:41:24.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.599+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.6 2024-09-12T00:41:24.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.603+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.7 2024-09-12T00:41:24.601 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.603+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.8 2024-09-12T00:41:24.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.603+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.9 2024-09-12T00:41:24.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.603+0000 7f6d03bad9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40.10 2024-09-12T00:41:24.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.603+0000 7f6d03bad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:24.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.603+0000 7f6d03bad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 2024-09-12T00:41:24.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6d03bad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:41:24.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6d03bad9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:41:24.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6d03bad9c0 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:41:24.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6d03bad9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40, ofs0, ns] 2024-09-12T00:41:24.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6be4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398881 cookie 94748615526656 notifier 7517 bl.length()=983 2024-09-12T00:41:24.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6be4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 info.flags=0x17 2024-09-12T00:41:24.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6be4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 to cache LRU end 2024-09-12T00:41:24.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6be4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:41:24.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_sources= new_sources= 2024-09-12T00:41:24.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential sources added=[] removed=[] 2024-09-12T00:41:24.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): orig_dests= new_dests= 2024-09-12T00:41:24.609 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.607+0000 7f6d03bad9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40]): potential dests added=[] removed=[] 2024-09-12T00:41:24.614 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.615+0000 7f6d03bad9c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:41:24.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.619+0000 7f6bb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:24.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.623+0000 7f6d03bad9c0 20 remove_watcher() i=0 2024-09-12T00:41:24.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.623+0000 7f6d03bad9c0 2 removed watcher, disabling cache 2024-09-12T00:41:24.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.623+0000 7f6d03bad9c0 20 remove_watcher() i=1 2024-09-12T00:41:24.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.627+0000 7f6d03bad9c0 20 remove_watcher() i=2 2024-09-12T00:41:24.628 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.627+0000 7f6d03bad9c0 20 remove_watcher() i=3 2024-09-12T00:41:24.631 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.631+0000 7f6d03bad9c0 20 remove_watcher() i=4 2024-09-12T00:41:24.632 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.631+0000 7f6d03bad9c0 20 remove_watcher() i=5 2024-09-12T00:41:24.634 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.635+0000 7f6d03bad9c0 20 remove_watcher() i=6 2024-09-12T00:41:24.635 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.635+0000 7f6d03bad9c0 20 remove_watcher() i=7 2024-09-12T00:41:24.653 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:41:24.684 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:24.684 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:24.733 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.735+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.735+0000 7f32cfa9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:24.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.735+0000 7f32cfa9d9c0 20 realm 2024-09-12T00:41:24.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.735+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.735+0000 7f32cfa9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:24.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.735+0000 7f32cfa9d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:24.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.735+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.735+0000 7f32cfa9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:24.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.735+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.739+0000 7f32cfa9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:24.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.739+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:24.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.739+0000 7f32cfa9d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:24.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.739+0000 7f32cfa9d9c0 20 searching for the correct realm 2024-09-12T00:41:24.742 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.743+0000 7f32cdda4640 0 -- 172.21.15.102:0/569104107 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f32c4008040 msgr2=0x7f32c4066fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:24.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:24.959+0000 7f32ccda2640 0 -- 172.21.15.102:0/569104107 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f32c80f1930 msgr2=0x7f32c80db3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:25.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.175+0000 7f32cfa9d9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:25.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.175+0000 7f32cfa9d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:25.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.175+0000 7f32cfa9d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:25.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.175+0000 7f32cfa9d9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:25.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.175+0000 7f32cfa9d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:25.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.175+0000 7f32cfa9d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:25.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.175+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:25.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:25.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:25.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:25.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:25.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:25.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 20 zone default found 2024-09-12T00:41:25.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 4 Realm: () 2024-09-12T00:41:25.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:25.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:25.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:25.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 20 zonegroup default 2024-09-12T00:41:25.179 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:25.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:25.180 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.179+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:25.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.183+0000 7f32cfa9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:25.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.183+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:25.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.183+0000 7f32cfa9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:25.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.183+0000 7f32cfa9d9c0 20 started sync module instance, tier type = 2024-09-12T00:41:25.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.183+0000 7f32cfa9d9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:25.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.207+0000 7f32cfa9d9c0 20 add_watcher() i=0 2024-09-12T00:41:25.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.207+0000 7f32cfa9d9c0 20 add_watcher() i=1 2024-09-12T00:41:25.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.207+0000 7f32cfa9d9c0 20 add_watcher() i=2 2024-09-12T00:41:25.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.207+0000 7f32cfa9d9c0 20 add_watcher() i=3 2024-09-12T00:41:25.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.207+0000 7f32cfa9d9c0 20 add_watcher() i=4 2024-09-12T00:41:25.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.207+0000 7f32cfa9d9c0 20 add_watcher() i=5 2024-09-12T00:41:25.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.207+0000 7f32cfa9d9c0 20 add_watcher() i=6 2024-09-12T00:41:25.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.211+0000 7f32cfa9d9c0 20 add_watcher() i=7 2024-09-12T00:41:25.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.211+0000 7f32cfa9d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:25.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f31837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:25.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f32cfa9d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:25.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f32cfa9d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:25.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f32cfa9d9c0 5 note: GC not initialized 2024-09-12T00:41:25.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f31827e4640 20 reqs_thread_entry: start 2024-09-12T00:41:25.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f32cfa9d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:25.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f32cfa9d9c0 20 Filter name: none 2024-09-12T00:41:25.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f30f3fff640 20 reqs_thread_entry: start 2024-09-12T00:41:25.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:25.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f32cfa9d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:41:25.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.215+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:25.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.219+0000 7f32cfa9d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:41:25.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.219+0000 7f32cfa9d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:25.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.219+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:25.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.219+0000 7f32cfa9d9c0 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:41:25.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.219+0000 7f32cfa9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:25.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.219+0000 7f32cfa9d9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:41:25.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.219+0000 7f32cfa9d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:25.223 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.223+0000 7f31837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:25.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.227+0000 7f32cfa9d9c0 20 remove_watcher() i=0 2024-09-12T00:41:25.228 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.227+0000 7f32cfa9d9c0 2 removed watcher, disabling cache 2024-09-12T00:41:25.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.231+0000 7f32cfa9d9c0 20 remove_watcher() i=1 2024-09-12T00:41:25.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.231+0000 7f32cfa9d9c0 20 remove_watcher() i=2 2024-09-12T00:41:25.234 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.235+0000 7f32cfa9d9c0 20 remove_watcher() i=3 2024-09-12T00:41:25.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.235+0000 7f32cfa9d9c0 20 remove_watcher() i=4 2024-09-12T00:41:25.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.239+0000 7f32cfa9d9c0 20 remove_watcher() i=5 2024-09-12T00:41:25.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.239+0000 7f32cfa9d9c0 20 remove_watcher() i=6 2024-09-12T00:41:25.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:25.243+0000 7f32cfa9d9c0 20 remove_watcher() i=7 2024-09-12T00:41:25.255 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:25.255 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:41:25.256 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: abort-at-change-reshard-state id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:41:25.256 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:25.257 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:25.257 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:41:25.297 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:25.297 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:41:25.887 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:25.888 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:41:26.251 INFO:tasks.workunit.client.0.smithi102.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:41:26.251 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:26.284 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:26.284 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:26.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.331+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.331+0000 7fcb73c949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.331+0000 7fcb73c949c0 20 realm 2024-09-12T00:41:26.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.331+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.331+0000 7fcb73c949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.331+0000 7fcb73c949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:26.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.331+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.331+0000 7fcb73c949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.331+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.335+0000 7fcb73c949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:26.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.335+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.335+0000 7fcb73c949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:26.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.335+0000 7fcb73c949c0 20 searching for the correct realm 2024-09-12T00:41:26.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.335+0000 7fcb71f9b640 0 -- 172.21.15.102:0/2208580901 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x556ed46f4ab0 msgr2=0x556ed46f6ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:26.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.343+0000 7fcb7179a640 0 -- 172.21.15.102:0/2208580901 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x556ed44b0df0 msgr2=0x7fcb6c054950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:26.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:26.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.567+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:26.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 zone default found 2024-09-12T00:41:26.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 4 Realm: () 2024-09-12T00:41:26.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:26.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:26.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:26.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 zonegroup default 2024-09-12T00:41:26.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 started sync module instance, tier type = 2024-09-12T00:41:26.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.571+0000 7fcb73c949c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:26.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.595+0000 7fcb73c949c0 20 add_watcher() i=0 2024-09-12T00:41:26.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.595+0000 7fcb73c949c0 20 add_watcher() i=1 2024-09-12T00:41:26.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.595+0000 7fcb73c949c0 20 add_watcher() i=2 2024-09-12T00:41:26.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.595+0000 7fcb73c949c0 20 add_watcher() i=3 2024-09-12T00:41:26.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.595+0000 7fcb73c949c0 20 add_watcher() i=4 2024-09-12T00:41:26.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.595+0000 7fcb73c949c0 20 add_watcher() i=5 2024-09-12T00:41:26.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.595+0000 7fcb73c949c0 20 add_watcher() i=6 2024-09-12T00:41:26.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.599+0000 7fcb73c949c0 20 add_watcher() i=7 2024-09-12T00:41:26.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.599+0000 7fcb73c949c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:26.602 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.603+0000 7fca277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:26.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.603+0000 7fcb73c949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:26.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.603+0000 7fcb73c949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:26.603 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.603+0000 7fcb73c949c0 5 note: GC not initialized 2024-09-12T00:41:26.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.603+0000 7fca267e4640 20 reqs_thread_entry: start 2024-09-12T00:41:26.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.603+0000 7fcb73c949c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:26.604 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.603+0000 7fcb73c949c0 20 Filter name: none 2024-09-12T00:41:26.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.603+0000 7fc997fff640 20 reqs_thread_entry: start 2024-09-12T00:41:26.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.603+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.607+0000 7fcb73c949c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:26.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.607+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.606 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.607+0000 7fcb73c949c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:41:26.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.607+0000 7fcb73c949c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:26.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.607+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.607+0000 7fcb73c949c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:26.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.607+0000 7fcb73c949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.607+0000 7fcb73c949c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:41:26.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.607+0000 7fcb73c949c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:26.611 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.611+0000 7fca277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:26.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.615+0000 7fcb73c949c0 20 remove_watcher() i=0 2024-09-12T00:41:26.616 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.615+0000 7fcb73c949c0 2 removed watcher, disabling cache 2024-09-12T00:41:26.618 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.619+0000 7fcb73c949c0 20 remove_watcher() i=1 2024-09-12T00:41:26.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.619+0000 7fcb73c949c0 20 remove_watcher() i=2 2024-09-12T00:41:26.622 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.623+0000 7fcb73c949c0 20 remove_watcher() i=3 2024-09-12T00:41:26.624 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.623+0000 7fcb73c949c0 20 remove_watcher() i=4 2024-09-12T00:41:26.626 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.627+0000 7fcb73c949c0 20 remove_watcher() i=5 2024-09-12T00:41:26.629 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.631+0000 7fcb73c949c0 20 remove_watcher() i=6 2024-09-12T00:41:26.630 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.631+0000 7fcb73c949c0 20 remove_watcher() i=7 2024-09-12T00:41:26.644 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:26.645 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:41:26.645 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: a-bucket id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:41:26.645 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:26.645 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:26.676 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:26.676 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:26.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.719+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.723+0000 7ffa4c9949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.723+0000 7ffa4c9949c0 20 realm 2024-09-12T00:41:26.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.723+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.723+0000 7ffa4c9949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.723+0000 7ffa4c9949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:26.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.723+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.723+0000 7ffa4c9949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.723+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.723+0000 7ffa4c9949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:26.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.723+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.727+0000 7ffa4c9949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:26.725 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.727+0000 7ffa4c9949c0 20 searching for the correct realm 2024-09-12T00:41:26.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.931+0000 7ffa49c99640 0 -- 172.21.15.102:0/2601025040 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7ffa4404a040 msgr2=0x7ffa4404a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:26.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.943+0000 7ffa4ac9b640 0 -- 172.21.15.102:0/2601025040 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x5606326d7950 msgr2=0x5606326d9d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:26.957 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:26.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:26.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:26.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:26.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:26.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:26.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.958 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:26.959 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:26.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 zone default found 2024-09-12T00:41:26.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 4 Realm: () 2024-09-12T00:41:26.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:26.960 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:26.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:26.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 zonegroup default 2024-09-12T00:41:26.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.959+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.963+0000 7ffa4c9949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.963+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.961 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.963+0000 7ffa4c9949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.963+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.963+0000 7ffa4c9949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:26.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.963+0000 7ffa4c9949c0 20 started sync module instance, tier type = 2024-09-12T00:41:26.962 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.963+0000 7ffa4c9949c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:26.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.987+0000 7ffa4c9949c0 20 add_watcher() i=0 2024-09-12T00:41:26.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.987+0000 7ffa4c9949c0 20 add_watcher() i=1 2024-09-12T00:41:26.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.987+0000 7ffa4c9949c0 20 add_watcher() i=2 2024-09-12T00:41:26.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.987+0000 7ffa4c9949c0 20 add_watcher() i=3 2024-09-12T00:41:26.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.987+0000 7ffa4c9949c0 20 add_watcher() i=4 2024-09-12T00:41:26.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.987+0000 7ffa4c9949c0 20 add_watcher() i=5 2024-09-12T00:41:26.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.987+0000 7ffa4c9949c0 20 add_watcher() i=6 2024-09-12T00:41:26.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.987+0000 7ffa4c9949c0 20 add_watcher() i=7 2024-09-12T00:41:26.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.987+0000 7ffa4c9949c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:26.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.991+0000 7ff900fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:26.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:26.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:26.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 5 note: GC not initialized 2024-09-12T00:41:26.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ff87b7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:26.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:26.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 20 Filter name: none 2024-09-12T00:41:26.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ff8797fa640 20 reqs_thread_entry: start 2024-09-12T00:41:26.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:26.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:41:26.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:26.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.995+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.999+0000 7ffa4c9949c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:26.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.999+0000 7ffa4c9949c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:26.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.999+0000 7ffa4c9949c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:41:26.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.999+0000 7ffa4c9949c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:27.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:26.999+0000 7ff900fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:27.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.007+0000 7ffa4c9949c0 20 remove_watcher() i=0 2024-09-12T00:41:27.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.007+0000 7ffa4c9949c0 2 removed watcher, disabling cache 2024-09-12T00:41:27.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.007+0000 7ffa4c9949c0 20 remove_watcher() i=1 2024-09-12T00:41:27.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.011+0000 7ffa4c9949c0 20 remove_watcher() i=2 2024-09-12T00:41:27.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.011+0000 7ffa4c9949c0 20 remove_watcher() i=3 2024-09-12T00:41:27.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.015+0000 7ffa4c9949c0 20 remove_watcher() i=4 2024-09-12T00:41:27.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.015+0000 7ffa4c9949c0 20 remove_watcher() i=5 2024-09-12T00:41:27.017 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.019+0000 7ffa4c9949c0 20 remove_watcher() i=6 2024-09-12T00:41:27.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.019+0000 7ffa4c9949c0 20 remove_watcher() i=7 2024-09-12T00:41:27.034 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:41:27.068 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:27.069 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:27.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.319+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 realm 2024-09-12T00:41:27.322 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.323 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.323+0000 7fd7933bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:27.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.324 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.325 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:27.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 searching for the correct realm 2024-09-12T00:41:27.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.331+0000 7fd7916c2640 0 -- 172.21.15.102:0/2377772977 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fd77c06b270 msgr2=0x7fd77c0634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.547+0000 7fd78bfff640 0 -- 172.21.15.102:0/2377772977 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd78c0d4bc0 msgr2=0x7fd78c105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:27.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:27.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:27.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:27.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:27.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:27.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:27.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 zone default found 2024-09-12T00:41:27.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 4 Realm: () 2024-09-12T00:41:27.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:27.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:27.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:27.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 zonegroup default 2024-09-12T00:41:27.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 started sync module instance, tier type = 2024-09-12T00:41:27.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:27.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=0 2024-09-12T00:41:27.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=1 2024-09-12T00:41:27.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=2 2024-09-12T00:41:27.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=3 2024-09-12T00:41:27.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=4 2024-09-12T00:41:27.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=5 2024-09-12T00:41:27.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.799+0000 7fd7933bb9c0 20 add_watcher() i=6 2024-09-12T00:41:27.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.799+0000 7fd7933bb9c0 20 add_watcher() i=7 2024-09-12T00:41:27.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.799+0000 7fd7933bb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:27.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.803+0000 7fd6477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:27.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:27.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:27.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 note: GC not initialized 2024-09-12T00:41:27.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.803+0000 7fd6467e4640 20 reqs_thread_entry: start 2024-09-12T00:41:27.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:27.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 Filter name: none 2024-09-12T00:41:27.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.803+0000 7fd63f7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:27.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:27.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:27.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:27.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:27.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:41:27.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:41:27.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:27.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:27.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:27.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:27.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:41:27.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:27.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:27.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:27.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:41:27.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398941 cookie 94915950850560 notifier 7583 bl.length()=911 2024-09-12T00:41:27.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:27.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:27.819 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:27.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:41:27.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:41:27.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:41:27.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:41:27.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.0 2024-09-12T00:41:27.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.0 2024-09-12T00:41:27.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.1 2024-09-12T00:41:27.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.1 2024-09-12T00:41:27.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.2 2024-09-12T00:41:27.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.2 2024-09-12T00:41:27.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.3 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.3 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.4 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.4 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.5 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.5 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.6 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.6 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.7 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.7 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.8 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.8 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.9 2024-09-12T00:41:27.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.9 2024-09-12T00:41:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.10 2024-09-12T00:41:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.10 2024-09-12T00:41:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.11 2024-09-12T00:41:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.11 2024-09-12T00:41:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.12 2024-09-12T00:41:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.12 2024-09-12T00:41:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.13 2024-09-12T00:41:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.13 2024-09-12T00:41:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:41:27.836 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:41:27.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:41:27.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:41:27.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:41:27.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:41:27.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:41:27.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:41:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.839+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:41:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.839+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:41:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.839+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:41:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.839+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:41:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.839+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:41:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.839+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:41:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:41:27.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:41:27.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:41:27.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:41:27.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:41:27.843 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:41:27.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:41:27.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:41:27.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:41:27.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:41:27.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.847+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:41:27.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.847+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:41:27.850 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd7933bb9c0 time 2024-09-12T00:41:27.855091+0000 2024-09-12T00:41:27.850 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:27.851 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:27.851 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd796c952eb] 2024-09-12T00:41:27.851 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd796c9549f] 2024-09-12T00:41:27.851 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565354c9fcc1] 2024-09-12T00:41:27.851 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x565354cb401c] 2024-09-12T00:41:27.851 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565354cb56a4] 2024-09-12T00:41:27.851 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:41:27.851 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd795afbd90] 2024-09-12T00:41:27.851 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:41:27.851 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.851+0000 7fd7933bb9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd7933bb9c0 time 2024-09-12T00:41:27.855091+0000 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd796c952eb] 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd796c9549f] 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565354c9fcc1] 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x565354cb401c] 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565354cb56a4] 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd795afbd90] 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:41:27.852 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:41:27.853 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.853 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:41:27.853 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd7933bb9c0 thread_name:radosgw-admin 2024-09-12T00:41:27.858 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:27.858 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd795b14520] 2024-09-12T00:41:27.858 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:41:27.858 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:41:27.858 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:41:27.858 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd796c95345] 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd796c9549f] 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565354c9fcc1] 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x565354cb401c] 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565354cb56a4] 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd795afbd90] 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.851+0000 7fd7933bb9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd7933bb9c0 thread_name:radosgw-admin 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:27.859 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd795b14520] 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd796c95345] 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd796c9549f] 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565354c9fcc1] 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x565354cb401c] 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565354cb56a4] 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd795afbd90] 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:41:27.860 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command rotate-key hook 0x56535778a598 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-c con 0x5653576081d0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-a con 0x5653576cd0d0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-b con 0x56535778e510 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:27.861 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): authenticate will time out at 2875.596265s 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): get_auth_request con 0x5653576081d0 auth_method 0 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): get_auth_request con 0x5653576cd0d0 auth_method 0 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.862 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): handle_auth_done global_id 7574 payload 824 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:41:27.095+0000 7fd790ec1640 1 monclient: found mon.noname-c 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: dump: 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.863 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: _finish_auth 0 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: _check_auth_tickets 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: dump: 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.864 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:41:27.095+0000 7fd67ee05640 4 set_mon_vals no callback set 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 5 monclient: authenticate success, global_id 7574 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.865 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 1 librados: init done 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:41:27.095+0000 7fd67d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:41:27.095+0000 7fd67d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:41:27.095+0000 7fd67d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient: get_auth_request con 0x7fd678070ae0 auth_method 0 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:41:27.099+0000 7fd7916c2640 10 monclient: get_auth_request con 0x5653577b36d0 auth_method 0 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:41:27.099+0000 7fd790ec1640 10 monclient: get_auth_request con 0x5653577d6120 auth_method 0 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:41:27.099+0000 7fd78bfff640 10 monclient: get_auth_request con 0x5653577da480 auth_method 0 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:41:27.303+0000 7fd78bfff640 10 monclient: get_auth_request con 0x5653577da480 auth_method 0 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:41:27.303+0000 7fd7916c2640 10 monclient: get_auth_request con 0x5653577d99a0 auth_method 0 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient: monmap: 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:41:27.866 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding auth protocol: cephx 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding auth protocol: cephx 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding auth protocol: cephx 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.867 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command objecter_requests cmddesc objecter_requests hook 0x5653577e5ff0 EEXIST 2024-09-12T00:41:27.868 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient: init 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding auth protocol: cephx 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding auth protocol: cephx 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding auth protocol: cephx 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.869 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command rotate-key cmddesc rotate-key hook 0x5653577e1660 EEXIST 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-a con 0x56535780a1a0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-b con 0x565357809ad0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-c con 0x5653578084b0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.870 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): authenticate will time out at 2875.810727s 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): get_auth_request con 0x56535780a1a0 auth_method 0 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): get_auth_request con 0x5653578084b0 auth_method 0 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.871 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): get_auth_request con 0x565357809ad0 auth_method 0 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.872 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): handle_auth_done global_id 8088 payload 824 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient: _finish_hunting 0 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:41:27.307+0000 7fd78bfff640 1 monclient: found mon.noname-a 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: dump: 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.873 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: _finish_auth 0 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: _check_auth_tickets 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: dump: 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.874 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:41:27.311+0000 7fd78b7fe640 4 set_mon_vals no callback set 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 monclient: authenticate success, global_id 8088 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:41:27.311+0000 7fd6767fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:27.875 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:41:27.311+0000 7fd6767fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:41:27.311+0000 7fd6767fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:41:27.311+0000 7fd7916c2640 10 monclient: get_auth_request con 0x7fd668070bc0 auth_method 0 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: get_monmap_and_config 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: monmap: 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:41:27.876 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding auth protocol: cephx 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding auth protocol: cephx 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding auth protocol: cephx 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.877 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: init 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding auth protocol: cephx 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding auth protocol: cephx 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding auth protocol: cephx 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.878 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcb3a1b1b8 EEXIST 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:41:27.879 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-b con 0x56535785e000 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-c con 0x5653578593f0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-a con 0x565357859d70 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): authenticate will time out at 2875.816728s 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): get_auth_request con 0x5653578593f0 auth_method 0 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): get_auth_request con 0x565357859d70 auth_method 0 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.880 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:41:27.315+0000 7fd78bfff640 10 monclient(hunting): get_auth_request con 0x56535785e000 auth_method 0 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:41:27.315+0000 7fd78bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:41:27.315+0000 7fd78bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:41:27.315+0000 7fd78bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): handle_auth_done global_id 7580 payload 274 2024-09-12T00:41:27.881 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient: _finish_hunting 0 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:41:27.315+0000 7fd7916c2640 1 monclient: found mon.noname-c 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: dump: 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.882 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: _finish_auth 0 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: _check_auth_tickets 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 monclient: authenticate success, global_id 7580 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 4 set_mon_vals no callback set 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: dump: 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.883 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: shutdown 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: monmap: 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:27.884 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding auth protocol: cephx 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding auth protocol: cephx 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding auth protocol: cephx 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.885 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 1 librados: starting msgr at 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 1 librados: starting objecter 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command objecter_requests cmddesc objecter_requests hook 0x56535782c370 EEXIST 2024-09-12T00:41:27.886 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 1 librados: setting wanted keys 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 1 librados: calling monclient init 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: init 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding auth protocol: cephx 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding auth protocol: cephx 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding auth protocol: cephx 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.887 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command rotate-key cmddesc rotate-key hook 0x56535780c108 EEXIST 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-b con 0x5653578593f0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-a con 0x565357859d70 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-c con 0x56535785e000 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:41:27.888 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): authenticate will time out at 2875.819922s 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): get_auth_request con 0x565357859d70 auth_method 0 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): get_auth_request con 0x56535785e000 auth_method 0 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.889 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:41:27.319+0000 7fd78bfff640 10 monclient(hunting): get_auth_request con 0x5653578593f0 auth_method 0 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:41:27.319+0000 7fd78bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:41:27.319+0000 7fd78bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:41:27.319+0000 7fd78bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): handle_auth_done global_id 7583 payload 824 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:41:27.319+0000 7fd790ec1640 1 monclient: found mon.noname-c 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.890 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: dump: 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: _finish_auth 0 2024-09-12T00:41:27.891 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: _check_auth_tickets 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: dump: 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.892 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 5 monclient: authenticate success, global_id 7583 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:41:27.319+0000 7fd667fff640 4 set_mon_vals no callback set 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 1 librados: init done 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command cr dump hook 0x565357851ea8 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:41:27.319+0000 7fd6667fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:41:27.319+0000 7fd6667fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:41:27.319+0000 7fd6667fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:41:27.319+0000 7fd78bfff640 10 monclient: get_auth_request con 0x7fd65c070ae0 auth_method 0 2024-09-12T00:41:27.893 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:41:27.323+0000 7fd7916c2640 10 monclient: get_auth_request con 0x565357877650 auth_method 0 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 realm 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:41:27.323+0000 7fd78bfff640 10 monclient: get_auth_request con 0x56535787b9c0 auth_method 0 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.894 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:41:27.327+0000 7fd7916c2640 10 monclient: get_auth_request con 0x56535787f0e0 auth_method 0 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 searching for the correct realm 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:41:27.327+0000 7fd790ec1640 10 monclient: get_auth_request con 0x565357883e20 auth_method 0 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:41:27.331+0000 7fd78bfff640 10 monclient: get_auth_request con 0x7fd78c0c7040 auth_method 0 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:41:27.331+0000 7fd7916c2640 10 monclient: get_auth_request con 0x7fd77c06b270 auth_method 0 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:41:27.331+0000 7fd7916c2640 0 -- 172.21.15.102:0/2377772977 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fd77c06b270 msgr2=0x7fd77c0634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:41:27.535+0000 7fd7916c2640 10 monclient: get_auth_request con 0x7fd77c06b270 auth_method 0 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:41:27.539+0000 7fd790ec1640 10 monclient: get_auth_request con 0x7fd78c0b6040 auth_method 0 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:41:27.547+0000 7fd78bfff640 10 monclient: get_auth_request con 0x7fd78c0d4bc0 auth_method 0 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:41:27.547+0000 7fd78bfff640 0 -- 172.21.15.102:0/2377772977 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd78c0d4bc0 msgr2=0x7fd78c105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:41:27.751+0000 7fd78bfff640 10 monclient: get_auth_request con 0x7fd78c0d4bc0 auth_method 0 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:27.895 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 zone default found 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 4 Realm: () 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:27.896 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 zonegroup default 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 started sync module instance, tier type = 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=0 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=1 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=2 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=3 2024-09-12T00:41:27.897 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=4 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=5 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:41:27.799+0000 7fd7933bb9c0 20 add_watcher() i=6 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:41:27.799+0000 7fd7933bb9c0 20 add_watcher() i=7 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:41:27.799+0000 7fd7933bb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding auth protocol: cephx 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding auth protocol: cephx 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding auth protocol: cephx 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:41:27.803+0000 7fd6477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.898 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command cache list hook 0x565357856a60 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command cache inspect hook 0x565357856a60 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command cache erase hook 0x565357856a60 2024-09-12T00:41:27.899 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command cache zap hook 0x565357856a60 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 note: GC not initialized 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:41:27.803+0000 7fd6467e4640 20 reqs_thread_entry: start 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command sync trace show hook 0x7fd78c0abce0 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command sync trace history hook 0x7fd78c0abce0 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command sync trace active hook 0x7fd78c0abce0 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command sync trace active_short hook 0x7fd78c0abce0 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 Filter name: none 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:41:27.803+0000 7fd63f7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:27.900 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:41:27.901 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398941 cookie 94915950850560 notifier 7583 bl.length()=911 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.0 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.0 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.1 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.1 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.2 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.2 2024-09-12T00:41:27.902 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.3 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.3 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.4 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.4 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.5 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.5 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.6 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.6 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.7 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.7 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.8 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.8 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.9 2024-09-12T00:41:27.903 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.9 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.10 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.10 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.11 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.11 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.12 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.12 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.13 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.13 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:41:27.904 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:41:27.905 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:41:27.847+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:41:27.847+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:41:27.851+0000 7fd7933bb9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd7933bb9c0 time 2024-09-12T00:41:27.855091+0000 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd796c952eb] 2024-09-12T00:41:27.906 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd796c9549f] 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565354c9fcc1] 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x565354cb401c] 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565354cb56a4] 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd795afbd90] 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:41:27.851+0000 7fd7933bb9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd7933bb9c0 thread_name:radosgw-admin 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd795b14520] 2024-09-12T00:41:27.907 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd796c95345] 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd796c9549f] 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565354c9fcc1] 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x565354cb401c] 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565354cb56a4] 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd795afbd90] 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:41:27.908 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:41:27.909 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:41:27.910 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:41:27.911 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:41:27.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:41:27.913 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:41:27.914 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:41:27.915 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd63f7fe640 / http_manager 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6467e4640 / http_manager 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6477e6640 / rgw_dt_lg_renew 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6667fc640 / ms_dispatch 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd667fff640 / io_context_pool 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6767fc640 / ms_dispatch 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd67d602640 / ms_dispatch 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd67ee05640 / io_context_pool 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd78b7fe640 / io_context_pool 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd78bfff640 / msgr-worker-2 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd790ec1640 / msgr-worker-1 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7916c2640 / msgr-worker-0 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7933bb9c0 / radosgw-admin 2024-09-12T00:41:27.916 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.140705.log 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command rotate-key hook 0x56535778a598 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-c con 0x5653576081d0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-a con 0x5653576cd0d0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-b con 0x56535778e510 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.917 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient(hunting): authenticate will time out at 2875.596265s 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): get_auth_request con 0x5653576081d0 auth_method 0 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): get_auth_request con 0x5653576cd0d0 auth_method 0 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.918 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient(hunting): handle_auth_done global_id 7574 payload 824 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:41:27.095+0000 7fd790ec1640 1 monclient: found mon.noname-c 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:41:27.095+0000 7fd790ec1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: dump: 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.919 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: _finish_auth 0 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: _check_auth_tickets 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:41:27.095+0000 7fd67d602640 10 monclient: dump: 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.920 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:41:27.095+0000 7fd67ee05640 4 set_mon_vals no callback set 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 5 monclient: authenticate success, global_id 7574 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.921 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:41:27.095+0000 7fd7933bb9c0 1 librados: init done 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:41:27.095+0000 7fd67d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:41:27.095+0000 7fd67d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:41:27.095+0000 7fd67d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:41:27.095+0000 7fd78bfff640 10 monclient: get_auth_request con 0x7fd678070ae0 auth_method 0 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:41:27.099+0000 7fd7916c2640 10 monclient: get_auth_request con 0x5653577b36d0 auth_method 0 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:41:27.099+0000 7fd790ec1640 10 monclient: get_auth_request con 0x5653577d6120 auth_method 0 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:41:27.099+0000 7fd78bfff640 10 monclient: get_auth_request con 0x5653577da480 auth_method 0 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:41:27.303+0000 7fd78bfff640 10 monclient: get_auth_request con 0x5653577da480 auth_method 0 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:41:27.303+0000 7fd7916c2640 10 monclient: get_auth_request con 0x5653577d99a0 auth_method 0 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:27.922 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient: monmap: 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding auth protocol: cephx 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding auth protocol: cephx 2024-09-12T00:41:27.923 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding auth protocol: cephx 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: crc 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e2620) adding con mode: secure 2024-09-12T00:41:27.924 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command objecter_requests cmddesc objecter_requests hook 0x5653577e5ff0 EEXIST 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient: init 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding auth protocol: cephx 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding auth protocol: cephx 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding auth protocol: cephx 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.925 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: crc 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 AuthRegistry(0x5653577e1518) adding con mode: secure 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command rotate-key cmddesc rotate-key hook 0x5653577e1660 EEXIST 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:27.926 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-a con 0x56535780a1a0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-b con 0x565357809ad0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-c con 0x5653578084b0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:41:27.307+0000 7fd7933bb9c0 10 monclient(hunting): authenticate will time out at 2875.810727s 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): get_auth_request con 0x56535780a1a0 auth_method 0 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.927 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): get_auth_request con 0x5653578084b0 auth_method 0 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): get_auth_request con 0x565357809ad0 auth_method 0 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.928 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:41:27.307+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:41:27.307+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient(hunting): handle_auth_done global_id 8088 payload 824 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient: _finish_hunting 0 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:41:27.307+0000 7fd78bfff640 1 monclient: found mon.noname-a 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:41:27.307+0000 7fd78bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: dump: 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.929 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: _finish_auth 0 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: _check_auth_tickets 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:41:27.311+0000 7fd6767fc640 10 monclient: dump: 2024-09-12T00:41:27.930 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:41:27.311+0000 7fd78b7fe640 4 set_mon_vals no callback set 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 monclient: authenticate success, global_id 8088 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.931 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:41:27.311+0000 7fd6767fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:41:27.311+0000 7fd6767fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:41:27.311+0000 7fd6767fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:41:27.311+0000 7fd7916c2640 10 monclient: get_auth_request con 0x7fd668070bc0 auth_method 0 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: get_monmap_and_config 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 10 monclient: monmap: 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:27.932 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding auth protocol: cephx 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding auth protocol: cephx 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding auth protocol: cephx 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.933 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: crc 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 5 AuthRegistry(0x565357829ae0) adding con mode: secure 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:41:27.311+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: init 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding auth protocol: cephx 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding auth protocol: cephx 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding auth protocol: cephx 2024-09-12T00:41:27.934 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: crc 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b070) adding con mode: secure 2024-09-12T00:41:27.935 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcb3a1b1b8 EEXIST 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-b con 0x56535785e000 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-c con 0x5653578593f0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-a con 0x565357859d70 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): authenticate will time out at 2875.816728s 2024-09-12T00:41:27.936 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): get_auth_request con 0x5653578593f0 auth_method 0 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): get_auth_request con 0x565357859d70 auth_method 0 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.937 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:41:27.315+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:41:27.315+0000 7fd78bfff640 10 monclient(hunting): get_auth_request con 0x56535785e000 auth_method 0 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:41:27.315+0000 7fd78bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:41:27.315+0000 7fd78bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:41:27.315+0000 7fd78bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient(hunting): handle_auth_done global_id 7580 payload 274 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient: _finish_hunting 0 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:41:27.315+0000 7fd7916c2640 1 monclient: found mon.noname-c 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:41:27.315+0000 7fd7916c2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: dump: 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.938 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: _finish_auth 0 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: _check_auth_tickets 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 monclient: authenticate success, global_id 7580 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 4 set_mon_vals no callback set 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.939 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:41:27.315+0000 7fd667fff640 10 monclient: dump: 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: shutdown 2024-09-12T00:41:27.940 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: build_initial_monmap 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 1 build_initial for_mkfs: 0 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: monmap: 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding auth protocol: cephx 2024-09-12T00:41:27.941 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding auth protocol: cephx 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding auth protocol: cephx 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: crc 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x5653578505f0) adding con mode: secure 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.942 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 1 librados: starting msgr at 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 1 librados: starting objecter 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command objecter_requests cmddesc objecter_requests hook 0x56535782c370 EEXIST 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 1 librados: setting wanted keys 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 1 librados: calling monclient init 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: init 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding auth protocol: cephx 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding auth protocol: cephx 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding auth protocol: cephx 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.943 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: crc 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 AuthRegistry(0x56535780bfc0) adding con mode: secure 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command rotate-key cmddesc rotate-key hook 0x56535780c108 EEXIST 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:41:27.944 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-b con 0x5653578593f0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-a con 0x565357859d70 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): picked mon.noname-c con 0x56535785e000 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:41:27.315+0000 7fd7933bb9c0 10 monclient(hunting): authenticate will time out at 2875.819922s 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): get_auth_request con 0x565357859d70 auth_method 0 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.945 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): get_auth_request con 0x56535785e000 auth_method 0 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:41:27.319+0000 7fd7916c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:41:27.319+0000 7fd78bfff640 10 monclient(hunting): get_auth_request con 0x5653578593f0 auth_method 0 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:41:27.319+0000 7fd78bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:41:27.319+0000 7fd78bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:41:27.319+0000 7fd78bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:41:27.946 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient(hunting): handle_auth_done global_id 7583 payload 824 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient: _finish_hunting 0 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:41:27.319+0000 7fd790ec1640 1 monclient: found mon.noname-c 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:41:27.319+0000 7fd790ec1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: dump: 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.947 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: _finish_auth 0 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: _check_auth_tickets 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:41:27.319+0000 7fd6667fc640 10 monclient: dump: 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.948 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 5 monclient: authenticate success, global_id 7583 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:41:27.319+0000 7fd667fff640 4 set_mon_vals no callback set 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 10 monclient: _renew_subs 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:41:27.949 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 1 librados: init done 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command cr dump hook 0x565357851ea8 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:41:27.319+0000 7fd6667fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:41:27.319+0000 7fd6667fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:41:27.319+0000 7fd6667fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:41:27.319+0000 7fd78bfff640 10 monclient: get_auth_request con 0x7fd65c070ae0 auth_method 0 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:41:27.319+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:41:27.323+0000 7fd7916c2640 10 monclient: get_auth_request con 0x565357877650 auth_method 0 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 realm 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.950 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:41:27.323+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:41:27.323+0000 7fd78bfff640 10 monclient: get_auth_request con 0x56535787b9c0 auth_method 0 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:41:27.327+0000 7fd7916c2640 10 monclient: get_auth_request con 0x56535787f0e0 auth_method 0 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:41:27.327+0000 7fd7933bb9c0 20 searching for the correct realm 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:41:27.327+0000 7fd790ec1640 10 monclient: get_auth_request con 0x565357883e20 auth_method 0 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:41:27.331+0000 7fd78bfff640 10 monclient: get_auth_request con 0x7fd78c0c7040 auth_method 0 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:41:27.331+0000 7fd7916c2640 10 monclient: get_auth_request con 0x7fd77c06b270 auth_method 0 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:41:27.331+0000 7fd7916c2640 0 -- 172.21.15.102:0/2377772977 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fd77c06b270 msgr2=0x7fd77c0634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.951 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:41:27.535+0000 7fd7916c2640 10 monclient: get_auth_request con 0x7fd77c06b270 auth_method 0 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:41:27.539+0000 7fd790ec1640 10 monclient: get_auth_request con 0x7fd78c0b6040 auth_method 0 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:41:27.547+0000 7fd78bfff640 10 monclient: get_auth_request con 0x7fd78c0d4bc0 auth_method 0 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:41:27.547+0000 7fd78bfff640 0 -- 172.21.15.102:0/2377772977 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd78c0d4bc0 msgr2=0x7fd78c105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:41:27.751+0000 7fd78bfff640 10 monclient: get_auth_request con 0x7fd78c0d4bc0 auth_method 0 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:41:27.763+0000 7fd7933bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.952 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 zone default found 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 4 Realm: () 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 zonegroup default 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:41:27.767+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.953 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 started sync module instance, tier type = 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:41:27.771+0000 7fd7933bb9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=0 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=1 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=2 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=3 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=4 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:41:27.795+0000 7fd7933bb9c0 20 add_watcher() i=5 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:41:27.799+0000 7fd7933bb9c0 20 add_watcher() i=6 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:41:27.799+0000 7fd7933bb9c0 20 add_watcher() i=7 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:41:27.799+0000 7fd7933bb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding auth protocol: cephx 2024-09-12T00:41:27.954 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding auth protocol: cephx 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding auth protocol: cephx 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:41:27.803+0000 7fd6477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: crc 2024-09-12T00:41:27.955 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 AuthRegistry(0x7ffcb3a1b550) adding con mode: secure 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command cache list hook 0x565357856a60 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command cache inspect hook 0x565357856a60 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command cache erase hook 0x565357856a60 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command cache zap hook 0x565357856a60 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 note: GC not initialized 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:41:27.803+0000 7fd6467e4640 20 reqs_thread_entry: start 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command sync trace show hook 0x7fd78c0abce0 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command sync trace history hook 0x7fd78c0abce0 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command sync trace active hook 0x7fd78c0abce0 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 5 asok(0x5653575802b0) register_command sync trace active_short hook 0x7fd78c0abce0 2024-09-12T00:41:27.956 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:41:27.803+0000 7fd7933bb9c0 20 Filter name: none 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:41:27.803+0000 7fd63f7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:27.957 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:41:27.807+0000 7fd7933bb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:41:27.819+0000 7fd7933bb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398941 cookie 94915950850560 notifier 7583 bl.length()=911 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:41:27.819+0000 7fd667fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:41:27.958 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:41:27.823+0000 7fd7933bb9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.0 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.0 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.1 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.1 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.2 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.2 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.3 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.3 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.4 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.4 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.5 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.5 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.6 2024-09-12T00:41:27.959 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.6 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.7 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.7 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.8 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.8 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.9 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.9 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.10 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.10 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.11 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.11 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.12 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.12 2024-09-12T00:41:27.960 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.13 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.13 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:41:27.835+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:41:27.961 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:41:27.839+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:41:27.843+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:41:27.962 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:41:27.847+0000 7fd7933bb9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:41:27.847+0000 7fd7933bb9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:41:27.851+0000 7fd7933bb9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd7933bb9c0 time 2024-09-12T00:41:27.855091+0000 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd796c952eb] 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd796c9549f] 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565354c9fcc1] 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x565354cb401c] 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565354cb56a4] 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd795afbd90] 2024-09-12T00:41:27.963 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:41:27.851+0000 7fd7933bb9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fd7933bb9c0 thread_name:radosgw-admin 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd795b14520] 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd796c95345] 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd796c9549f] 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565354c9fcc1] 2024-09-12T00:41:27.964 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x565354cb401c] 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565354cb56a4] 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd795afbd90] 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:41:27.965 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:41:27.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:41:27.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:41:27.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:41:27.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:41:27.970 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:41:27.971 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd63f7fe640 / http_manager 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6467e4640 / http_manager 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6477e6640 / rgw_dt_lg_renew 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6667fc640 / ms_dispatch 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd667fff640 / io_context_pool 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd6767fc640 / ms_dispatch 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd67d602640 / ms_dispatch 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd67ee05640 / io_context_pool 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd78b7fe640 / io_context_pool 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd78bfff640 / msgr-worker-2 2024-09-12T00:41:27.972 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd790ec1640 / msgr-worker-1 2024-09-12T00:41:27.973 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7916c2640 / msgr-worker-0 2024-09-12T00:41:27.973 INFO:tasks.workunit.client.0.smithi102.stderr: 7fd7933bb9c0 / radosgw-admin 2024-09-12T00:41:27.973 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:41:27.973 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:41:27.973 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:41:27.857494Z_bdb2c84d-529d-423a-a4ea-229cf28d43e2/log 2024-09-12T00:41:27.973 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:41:27.976 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:41:27.976 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:27.976 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:27.976 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:27.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.935+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.939+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.939+0000 7fe5ef1eb9c0 20 realm 2024-09-12T00:41:27.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.939+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.939+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.939+0000 7fe5ef1eb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.939+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.939+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.939+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.939+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.939+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.943+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.943+0000 7fe5ef1eb9c0 20 searching for the correct realm 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.947+0000 7fe5eccf1640 0 -- 172.21.15.102:0/2215783014 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x556b08c1f5d0 msgr2=0x556b08c21a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.955+0000 7fe5ec4f0640 0 -- 172.21.15.102:0/2215783014 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fe5e4044410 msgr2=0x7fe5e4044890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.959+0000 7fe5ef1eb9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.959+0000 7fe5ef1eb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:27.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.959+0000 7fe5ef1eb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.959+0000 7fe5ef1eb9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.959+0000 7fe5ef1eb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.959+0000 7fe5ef1eb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.959+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 zone default found 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 4 Realm: () 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:27.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:27.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 zonegroup default 2024-09-12T00:41:27.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:27.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 started sync module instance, tier type = 2024-09-12T00:41:27.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.963+0000 7fe5ef1eb9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:27.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.979+0000 7fe5ef1eb9c0 20 add_watcher() i=0 2024-09-12T00:41:27.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.979+0000 7fe5ef1eb9c0 20 add_watcher() i=1 2024-09-12T00:41:27.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.979+0000 7fe5ef1eb9c0 20 add_watcher() i=2 2024-09-12T00:41:27.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.979+0000 7fe5ef1eb9c0 20 add_watcher() i=3 2024-09-12T00:41:27.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.979+0000 7fe5ef1eb9c0 20 add_watcher() i=4 2024-09-12T00:41:27.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.979+0000 7fe5ef1eb9c0 20 add_watcher() i=5 2024-09-12T00:41:27.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.979+0000 7fe5ef1eb9c0 20 add_watcher() i=6 2024-09-12T00:41:27.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.979+0000 7fe5ef1eb9c0 20 add_watcher() i=7 2024-09-12T00:41:27.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.979+0000 7fe5ef1eb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:27.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe4a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:27.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:27.983 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:27.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 5 note: GC not initialized 2024-09-12T00:41:27.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe4a1fe3640 20 reqs_thread_entry: start 2024-09-12T00:41:27.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:27.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 20 Filter name: none 2024-09-12T00:41:27.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe4137fe640 20 reqs_thread_entry: start 2024-09-12T00:41:27.984 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:27.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:41:27.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:27.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.983+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.987+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:27.986 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.987+0000 7fe5ef1eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:27.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.987+0000 7fe5ef1eb9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:41:27.988 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.987+0000 7fe5ef1eb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:27.989 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.991+0000 7fe4a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:27.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.995+0000 7fe5ef1eb9c0 20 remove_watcher() i=0 2024-09-12T00:41:27.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.995+0000 7fe5ef1eb9c0 2 removed watcher, disabling cache 2024-09-12T00:41:27.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.995+0000 7fe5ef1eb9c0 20 remove_watcher() i=1 2024-09-12T00:41:27.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.999+0000 7fe5ef1eb9c0 20 remove_watcher() i=2 2024-09-12T00:41:27.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:27.999+0000 7fe5ef1eb9c0 20 remove_watcher() i=3 2024-09-12T00:41:28.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.003+0000 7fe5ef1eb9c0 20 remove_watcher() i=4 2024-09-12T00:41:28.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.003+0000 7fe5ef1eb9c0 20 remove_watcher() i=5 2024-09-12T00:41:28.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.003+0000 7fe5ef1eb9c0 20 remove_watcher() i=6 2024-09-12T00:41:28.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.007+0000 7fe5ef1eb9c0 20 remove_watcher() i=7 2024-09-12T00:41:28.019 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:28.019 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:41:28.060 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:41:28.086 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:28.086 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:28.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.127+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.131+0000 7f7daf5959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.131+0000 7f7daf5959c0 20 realm 2024-09-12T00:41:28.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.131+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.131+0000 7f7daf5959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.131+0000 7f7daf5959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:28.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.131+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.131+0000 7f7daf5959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.131+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.131+0000 7f7daf5959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:28.132 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.131+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.135+0000 7f7daf5959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:28.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.135+0000 7f7daf5959c0 20 searching for the correct realm 2024-09-12T00:41:28.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.139+0000 7f7dad89c640 0 -- 172.21.15.102:0/2952364881 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f7da40d3070 msgr2=0x7f7da4138a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:28.143 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.143+0000 7f7dac89a640 0 -- 172.21.15.102:0/2952364881 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f7da80630b0 msgr2=0x7f7da80687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:28.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.359+0000 7f7daf5959c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:28.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.359+0000 7f7daf5959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:28.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.359+0000 7f7daf5959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:28.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.359+0000 7f7daf5959c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:28.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.359+0000 7f7daf5959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:28.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.359+0000 7f7daf5959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:28.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.359+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:28.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:28.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 zone default found 2024-09-12T00:41:28.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 4 Realm: () 2024-09-12T00:41:28.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:28.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:28.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:28.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 zonegroup default 2024-09-12T00:41:28.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.363+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.367+0000 7f7daf5959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:28.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.367+0000 7f7daf5959c0 20 started sync module instance, tier type = 2024-09-12T00:41:28.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.367+0000 7f7daf5959c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:28.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.387+0000 7f7daf5959c0 20 add_watcher() i=0 2024-09-12T00:41:28.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.387+0000 7f7daf5959c0 20 add_watcher() i=1 2024-09-12T00:41:28.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.387+0000 7f7daf5959c0 20 add_watcher() i=2 2024-09-12T00:41:28.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.387+0000 7f7daf5959c0 20 add_watcher() i=3 2024-09-12T00:41:28.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.387+0000 7f7daf5959c0 20 add_watcher() i=4 2024-09-12T00:41:28.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.387+0000 7f7daf5959c0 20 add_watcher() i=5 2024-09-12T00:41:28.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.387+0000 7f7daf5959c0 20 add_watcher() i=6 2024-09-12T00:41:28.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.391+0000 7f7daf5959c0 20 add_watcher() i=7 2024-09-12T00:41:28.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.391+0000 7f7daf5959c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:28.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.395+0000 7f7c63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:28.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.395+0000 7f7daf5959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:28.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.395+0000 7f7daf5959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:28.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.395+0000 7f7daf5959c0 5 note: GC not initialized 2024-09-12T00:41:28.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.395+0000 7f7c62fe5640 20 reqs_thread_entry: start 2024-09-12T00:41:28.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.395+0000 7f7daf5959c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:28.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.395+0000 7f7daf5959c0 20 Filter name: none 2024-09-12T00:41:28.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.395+0000 7f7c60fe1640 20 reqs_thread_entry: start 2024-09-12T00:41:28.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.395+0000 7f7daf5959c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:28.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.395+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:28.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:28.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:28.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:41:28.398 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:28.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:41:28.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:28.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:28.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:28.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:28.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:41:28.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:41:28.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:41:28.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:41:28.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:41:28.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:41:28.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:41:28.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:41:28.400 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.399+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:41:28.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.403+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:41:28.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.403+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:41:28.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.403+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:41:28.402 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.403+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:41:28.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.403+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:41:28.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.403+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:41:28.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.403+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:41:28.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.403+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:41:28.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.407+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:41:28.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.407+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:41:28.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.407+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:41:28.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.407+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:41:28.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.407+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:41:28.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.407+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:41:28.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.407+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:41:28.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.407+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:41:28.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.407+0000 7f7daf5959c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:41:28.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.407+0000 7f7daf5959c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:41:28.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.411+0000 7f7c63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:28.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.415+0000 7f7daf5959c0 20 remove_watcher() i=0 2024-09-12T00:41:28.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.415+0000 7f7daf5959c0 2 removed watcher, disabling cache 2024-09-12T00:41:28.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.419+0000 7f7daf5959c0 20 remove_watcher() i=1 2024-09-12T00:41:28.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.419+0000 7f7daf5959c0 20 remove_watcher() i=2 2024-09-12T00:41:28.422 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.423+0000 7f7daf5959c0 20 remove_watcher() i=3 2024-09-12T00:41:28.424 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.423+0000 7f7daf5959c0 20 remove_watcher() i=4 2024-09-12T00:41:28.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.427+0000 7f7daf5959c0 20 remove_watcher() i=5 2024-09-12T00:41:28.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.427+0000 7f7daf5959c0 20 remove_watcher() i=6 2024-09-12T00:41:28.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:28.431+0000 7f7daf5959c0 20 remove_watcher() i=7 2024-09-12T00:41:58.475 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:58.508 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:58.508 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:58.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.554+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.554+0000 7fb5fb43b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:58.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.554+0000 7fb5fb43b9c0 20 realm 2024-09-12T00:41:58.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.554+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.554+0000 7fb5fb43b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:58.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.554+0000 7fb5fb43b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:58.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.554+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.554+0000 7fb5fb43b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:58.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.554+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.558+0000 7fb5fb43b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:58.557 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.558+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.558+0000 7fb5fb43b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:58.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.558+0000 7fb5fb43b9c0 20 searching for the correct realm 2024-09-12T00:41:58.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.562+0000 7fb5f9742640 0 -- 172.21.15.102:0/3530713781 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fb5ec03cc20 msgr2=0x7fb5ec06e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:58.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.570+0000 7fb5f8740640 0 -- 172.21.15.102:0/3530713781 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fb5f000f940 msgr2=0x7fb5f00323c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:58.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.786+0000 7fb5fb43b9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:58.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.786+0000 7fb5fb43b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:58.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.786+0000 7fb5fb43b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:58.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.786+0000 7fb5fb43b9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:58.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.786+0000 7fb5fb43b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:58.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.786+0000 7fb5fb43b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:58.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.786+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.786+0000 7fb5fb43b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:58.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.786+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:58.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:58.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 zone default found 2024-09-12T00:41:58.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 4 Realm: () 2024-09-12T00:41:58.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:58.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:58.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:58.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 zonegroup default 2024-09-12T00:41:58.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:58.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:58.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:58.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 started sync module instance, tier type = 2024-09-12T00:41:58.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.790+0000 7fb5fb43b9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:58.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.814+0000 7fb5fb43b9c0 20 add_watcher() i=0 2024-09-12T00:41:58.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.814+0000 7fb5fb43b9c0 20 add_watcher() i=1 2024-09-12T00:41:58.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.814+0000 7fb5fb43b9c0 20 add_watcher() i=2 2024-09-12T00:41:58.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.814+0000 7fb5fb43b9c0 20 add_watcher() i=3 2024-09-12T00:41:58.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.814+0000 7fb5fb43b9c0 20 add_watcher() i=4 2024-09-12T00:41:58.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.814+0000 7fb5fb43b9c0 20 add_watcher() i=5 2024-09-12T00:41:58.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.814+0000 7fb5fb43b9c0 20 add_watcher() i=6 2024-09-12T00:41:58.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.818+0000 7fb5fb43b9c0 20 add_watcher() i=7 2024-09-12T00:41:58.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.818+0000 7fb5fb43b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:58.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb4aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:58.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb5fb43b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:58.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb5fb43b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:58.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb5fb43b9c0 5 note: GC not initialized 2024-09-12T00:41:58.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb4adfe3640 20 reqs_thread_entry: start 2024-09-12T00:41:58.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb5fb43b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:58.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb5fb43b9c0 20 Filter name: none 2024-09-12T00:41:58.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb41f7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:58.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb5fb43b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:58.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.826+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.830+0000 7fb5fb43b9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:41:58.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.830+0000 7fb5fb43b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:58.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.830+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.830+0000 7fb5fb43b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:58.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.830+0000 7fb5fb43b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:58.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.830+0000 7fb5fb43b9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:41:58.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.830+0000 7fb5fb43b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:58.835 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.834+0000 7fb4aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:58.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.838+0000 7fb5fb43b9c0 20 remove_watcher() i=0 2024-09-12T00:41:58.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.838+0000 7fb5fb43b9c0 2 removed watcher, disabling cache 2024-09-12T00:41:58.842 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.842+0000 7fb5fb43b9c0 20 remove_watcher() i=1 2024-09-12T00:41:58.844 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.842+0000 7fb5fb43b9c0 20 remove_watcher() i=2 2024-09-12T00:41:58.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.846+0000 7fb5fb43b9c0 20 remove_watcher() i=3 2024-09-12T00:41:58.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.846+0000 7fb5fb43b9c0 20 remove_watcher() i=4 2024-09-12T00:41:58.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.850+0000 7fb5fb43b9c0 20 remove_watcher() i=5 2024-09-12T00:41:58.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.850+0000 7fb5fb43b9c0 20 remove_watcher() i=6 2024-09-12T00:41:58.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:58.850+0000 7fb5fb43b9c0 20 remove_watcher() i=7 2024-09-12T00:41:58.869 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:58.869 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:41:59.019 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:41:59.051 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:59.051 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:59.310 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.310+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.514+0000 7feba3c0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:59.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.514+0000 7feba3c0b9c0 20 realm 2024-09-12T00:41:59.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.514+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.514+0000 7feba3c0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:59.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.514+0000 7feba3c0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:59.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.514+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.514+0000 7feba3c0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:59.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.514+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.518+0000 7feba3c0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:59.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.518+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.518+0000 7feba3c0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:59.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.518+0000 7feba3c0b9c0 20 searching for the correct realm 2024-09-12T00:41:59.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.526+0000 7feba0f10640 0 -- 172.21.15.102:0/4276013171 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7feb9c063bf0 msgr2=0x7feb9c047050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:59.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.534+0000 7feba0f10640 0 -- 172.21.15.102:0/4276013171 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7fea6c081200 msgr2=0x7fea6c083630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:59.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:41:59.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:59.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:59.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:41:59.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:59.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:59.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:59.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:59.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:59.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 zone default found 2024-09-12T00:41:59.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 4 Realm: () 2024-09-12T00:41:59.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:41:59.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:41:59.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:59.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 zonegroup default 2024-09-12T00:41:59.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.550+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.554+0000 7feba3c0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:59.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.554+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.554+0000 7feba3c0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:59.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.554+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.554+0000 7feba3c0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:59.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.554+0000 7feba3c0b9c0 20 started sync module instance, tier type = 2024-09-12T00:41:59.556 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.554+0000 7feba3c0b9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:41:59.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.578+0000 7feba3c0b9c0 20 add_watcher() i=0 2024-09-12T00:41:59.578 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.578+0000 7feba3c0b9c0 20 add_watcher() i=1 2024-09-12T00:41:59.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.578+0000 7feba3c0b9c0 20 add_watcher() i=2 2024-09-12T00:41:59.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.578+0000 7feba3c0b9c0 20 add_watcher() i=3 2024-09-12T00:41:59.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.578+0000 7feba3c0b9c0 20 add_watcher() i=4 2024-09-12T00:41:59.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.578+0000 7feba3c0b9c0 20 add_watcher() i=5 2024-09-12T00:41:59.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.578+0000 7feba3c0b9c0 20 add_watcher() i=6 2024-09-12T00:41:59.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.578+0000 7feba3c0b9c0 20 add_watcher() i=7 2024-09-12T00:41:59.580 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.578+0000 7feba3c0b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:59.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.582+0000 7fea577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:59.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.582+0000 7feba3c0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:59.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.582+0000 7feba3c0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:59.584 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.582+0000 7feba3c0b9c0 5 note: GC not initialized 2024-09-12T00:41:59.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.582+0000 7fea567e4640 20 reqs_thread_entry: start 2024-09-12T00:41:59.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:59.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 20 Filter name: none 2024-09-12T00:41:59.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7fe9c7fff640 20 reqs_thread_entry: start 2024-09-12T00:41:59.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:41:59.586 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:41:59.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:41:59.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:41:59.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:41:59.587 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.588 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:41:59.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:41:59.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:41:59.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:59.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:41:59.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:41:59.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:41:59.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:41:59.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:41:59.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.586+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:41:59.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.590+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:41:59.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.590+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:41:59.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.590+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:41:59.591 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.590+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:41:59.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.590+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:41:59.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.590+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:41:59.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.590+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:41:59.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.590+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:41:59.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.594+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:41:59.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.594+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:41:59.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.594+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:41:59.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.594+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:41:59.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.594+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:41:59.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.594+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:41:59.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.594+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:41:59.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.594+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:41:59.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.594+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:41:59.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.594+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:41:59.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.598+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:41:59.597 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.598+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:41:59.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.598+0000 7feba3c0b9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:41:59.598 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.598+0000 7feba3c0b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:41:59.600 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.598+0000 7fea577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:59.605 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.606+0000 7feba3c0b9c0 20 remove_watcher() i=0 2024-09-12T00:41:59.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.606+0000 7feba3c0b9c0 2 removed watcher, disabling cache 2024-09-12T00:41:59.608 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.606+0000 7feba3c0b9c0 20 remove_watcher() i=1 2024-09-12T00:41:59.610 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.610+0000 7feba3c0b9c0 20 remove_watcher() i=2 2024-09-12T00:41:59.613 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.610+0000 7feba3c0b9c0 20 remove_watcher() i=3 2024-09-12T00:41:59.615 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.614+0000 7feba3c0b9c0 20 remove_watcher() i=4 2024-09-12T00:41:59.617 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.614+0000 7feba3c0b9c0 20 remove_watcher() i=5 2024-09-12T00:41:59.619 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.618+0000 7feba3c0b9c0 20 remove_watcher() i=6 2024-09-12T00:41:59.620 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.618+0000 7feba3c0b9c0 20 remove_watcher() i=7 2024-09-12T00:41:59.642 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:41:59.672 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:59.673 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:59.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.718+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.718+0000 7f52fc2b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:59.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.718+0000 7f52fc2b09c0 20 realm 2024-09-12T00:41:59.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.718+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.718+0000 7f52fc2b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:59.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.718+0000 7f52fc2b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:59.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.718+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.722+0000 7f52fc2b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:59.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.722+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.722+0000 7f52fc2b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:59.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.722+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:59.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.722+0000 7f52fc2b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:59.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.722+0000 7f52fc2b09c0 20 searching for the correct realm 2024-09-12T00:41:59.728 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.726+0000 7f52fa5b7640 0 -- 172.21.15.102:0/3031964941 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f52f00eac10 msgr2=0x7f52f0138a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:59.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:41:59.942+0000 7f52f95b5640 0 -- 172.21.15.102:0/3031964941 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f52f406db90 msgr2=0x7f52f4097150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:00.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.158+0000 7f52fc2b09c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:00.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.158+0000 7f52fc2b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:00.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.158+0000 7f52fc2b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:00.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.158+0000 7f52fc2b09c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:00.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.158+0000 7f52fc2b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:00.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.158+0000 7f52fc2b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:00.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.158+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:00.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:00.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 zone default found 2024-09-12T00:42:00.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 4 Realm: () 2024-09-12T00:42:00.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:00.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:00.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:00.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 zonegroup default 2024-09-12T00:42:00.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.162+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.166+0000 7f52fc2b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.166+0000 7f52fc2b09c0 20 started sync module instance, tier type = 2024-09-12T00:42:00.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.166+0000 7f52fc2b09c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:00.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.186+0000 7f52fc2b09c0 20 add_watcher() i=0 2024-09-12T00:42:00.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.186+0000 7f52fc2b09c0 20 add_watcher() i=1 2024-09-12T00:42:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.186+0000 7f52fc2b09c0 20 add_watcher() i=2 2024-09-12T00:42:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.186+0000 7f52fc2b09c0 20 add_watcher() i=3 2024-09-12T00:42:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.186+0000 7f52fc2b09c0 20 add_watcher() i=4 2024-09-12T00:42:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.186+0000 7f52fc2b09c0 20 add_watcher() i=5 2024-09-12T00:42:00.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.186+0000 7f52fc2b09c0 20 add_watcher() i=6 2024-09-12T00:42:00.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.186+0000 7f52fc2b09c0 20 add_watcher() i=7 2024-09-12T00:42:00.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.186+0000 7f52fc2b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:00.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.190+0000 7f51ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:00.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:00.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:00.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 5 note: GC not initialized 2024-09-12T00:42:00.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f51aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:42:00.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:00.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 20 Filter name: none 2024-09-12T00:42:00.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f511bfff640 20 reqs_thread_entry: start 2024-09-12T00:42:00.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:00.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:42:00.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:00.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.194+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.198+0000 7f52fc2b09c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:00.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.198+0000 7f52fc2b09c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.198+0000 7f52fc2b09c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:42:00.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.198+0000 7f52fc2b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:00.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.198+0000 7f51ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:00.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.206+0000 7f52fc2b09c0 20 remove_watcher() i=0 2024-09-12T00:42:00.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.206+0000 7f52fc2b09c0 2 removed watcher, disabling cache 2024-09-12T00:42:00.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.206+0000 7f52fc2b09c0 20 remove_watcher() i=1 2024-09-12T00:42:00.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.210+0000 7f52fc2b09c0 20 remove_watcher() i=2 2024-09-12T00:42:00.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.210+0000 7f52fc2b09c0 20 remove_watcher() i=3 2024-09-12T00:42:00.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.214+0000 7f52fc2b09c0 20 remove_watcher() i=4 2024-09-12T00:42:00.216 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.214+0000 7f52fc2b09c0 20 remove_watcher() i=5 2024-09-12T00:42:00.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.218+0000 7f52fc2b09c0 20 remove_watcher() i=6 2024-09-12T00:42:00.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.218+0000 7f52fc2b09c0 20 remove_watcher() i=7 2024-09-12T00:42:00.237 INFO:tasks.workunit.client.0.smithi102.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:42:00.237 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:42:00.268 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:00.268 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:00.312 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.310+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.314+0000 7f72c47be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.314+0000 7f72c47be9c0 20 realm 2024-09-12T00:42:00.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.314+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.315 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.314+0000 7f72c47be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.314+0000 7f72c47be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:00.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.314+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.314+0000 7f72c47be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.316 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.314+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.314+0000 7f72c47be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:00.317 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.314+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.318+0000 7f72c47be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:00.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.318+0000 7f72c47be9c0 20 searching for the correct realm 2024-09-12T00:42:00.321 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.322+0000 7f72c2ac5640 0 -- 172.21.15.102:0/836545280 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f72b80c9040 msgr2=0x7f72b81230b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:00.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.538+0000 7f72c1ac3640 0 -- 172.21.15.102:0/836545280 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f72bc069980 msgr2=0x7f72bc09a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:00.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.754+0000 7f72c47be9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:00.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.754+0000 7f72c47be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:00.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.754+0000 7f72c47be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:00.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.754+0000 7f72c47be9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:00.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.754+0000 7f72c47be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:00.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.754+0000 7f72c47be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:00.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.754+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.754+0000 7f72c47be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.754+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:00.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:00.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 zone default found 2024-09-12T00:42:00.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 4 Realm: () 2024-09-12T00:42:00.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:00.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:00.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:00.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 zonegroup default 2024-09-12T00:42:00.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.759 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 started sync module instance, tier type = 2024-09-12T00:42:00.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.758+0000 7f72c47be9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:00.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.782+0000 7f72c47be9c0 20 add_watcher() i=0 2024-09-12T00:42:00.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.782+0000 7f72c47be9c0 20 add_watcher() i=1 2024-09-12T00:42:00.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.782+0000 7f72c47be9c0 20 add_watcher() i=2 2024-09-12T00:42:00.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.782+0000 7f72c47be9c0 20 add_watcher() i=3 2024-09-12T00:42:00.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.782+0000 7f72c47be9c0 20 add_watcher() i=4 2024-09-12T00:42:00.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.782+0000 7f72c47be9c0 20 add_watcher() i=5 2024-09-12T00:42:00.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.782+0000 7f72c47be9c0 20 add_watcher() i=6 2024-09-12T00:42:00.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.786+0000 7f72c47be9c0 20 add_watcher() i=7 2024-09-12T00:42:00.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.786+0000 7f72c47be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:00.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.790+0000 7f7178fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:00.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.790+0000 7f72c47be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:00.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.790+0000 7f72c47be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:00.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.790+0000 7f72c47be9c0 5 note: GC not initialized 2024-09-12T00:42:00.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.790+0000 7f70f37fe640 20 reqs_thread_entry: start 2024-09-12T00:42:00.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.790+0000 7f72c47be9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:00.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.790+0000 7f72c47be9c0 20 Filter name: none 2024-09-12T00:42:00.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.790+0000 7f70f17fa640 20 reqs_thread_entry: start 2024-09-12T00:42:00.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.790+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.794+0000 7f72c47be9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:00.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.794+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.794+0000 7f72c47be9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:42:00.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.794+0000 7f72c47be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:00.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.794+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.794+0000 7f72c47be9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:00.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.794+0000 7f72c47be9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.794+0000 7f72c47be9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:42:00.796 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.794+0000 7f72c47be9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:00.799 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.798+0000 7f7178fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:00.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.802+0000 7f72c47be9c0 20 remove_watcher() i=0 2024-09-12T00:42:00.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.802+0000 7f72c47be9c0 2 removed watcher, disabling cache 2024-09-12T00:42:00.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.806+0000 7f72c47be9c0 20 remove_watcher() i=1 2024-09-12T00:42:00.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.806+0000 7f72c47be9c0 20 remove_watcher() i=2 2024-09-12T00:42:00.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.810+0000 7f72c47be9c0 20 remove_watcher() i=3 2024-09-12T00:42:00.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.810+0000 7f72c47be9c0 20 remove_watcher() i=4 2024-09-12T00:42:00.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.814+0000 7f72c47be9c0 20 remove_watcher() i=5 2024-09-12T00:42:00.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.814+0000 7f72c47be9c0 20 remove_watcher() i=6 2024-09-12T00:42:00.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.818+0000 7f72c47be9c0 20 remove_watcher() i=7 2024-09-12T00:42:00.833 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:00.833 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:42:00.834 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: a-bucket id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T00:42:00.834 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:00.834 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:42:00.867 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:00.867 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:00.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.910+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 realm 2024-09-12T00:42:00.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:00.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:00.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:00.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:00.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:00.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.914+0000 7fad205679c0 20 searching for the correct realm 2024-09-12T00:42:00.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:00.918+0000 7fad1e86e640 0 -- 172.21.15.102:0/3316165874 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fad14070040 msgr2=0x7fad14078840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:01.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.130+0000 7fad1d86c640 0 -- 172.21.15.102:0/3316165874 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fad18106990 msgr2=0x7fad181056f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:01.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:01.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:01.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:01.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:01.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:01.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 zone default found 2024-09-12T00:42:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 4 Realm: () 2024-09-12T00:42:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:01.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 zonegroup default 2024-09-12T00:42:01.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.350+0000 7fad205679c0 20 started sync module instance, tier type = 2024-09-12T00:42:01.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.350+0000 7fad205679c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:01.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=0 2024-09-12T00:42:01.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=1 2024-09-12T00:42:01.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=2 2024-09-12T00:42:01.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=3 2024-09-12T00:42:01.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=4 2024-09-12T00:42:01.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=5 2024-09-12T00:42:01.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=6 2024-09-12T00:42:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=7 2024-09-12T00:42:01.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.374+0000 7fad205679c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:01.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.378+0000 7fabd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:01.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:01.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 5 note: GC not initialized 2024-09-12T00:42:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fab4f7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 20 Filter name: none 2024-09-12T00:42:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fab4d7fa640 20 reqs_thread_entry: start 2024-09-12T00:42:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:01.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:01.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:01.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:01.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:42:01.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:42:01.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:01.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:01.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:01.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:01.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.382+0000 7fad205679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:42:01.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.394+0000 7fad205679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:01.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.394+0000 7fad205679c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:01.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.394+0000 7fad205679c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:01.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.394+0000 7fad205679c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:42:01.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398943 cookie 94856688029760 notifier 7700 bl.length()=911 2024-09-12T00:42:01.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:01.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:01.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:01.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:42:01.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:42:01.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:42:01.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:42:01.413 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad205679c0 time 2024-09-12T00:42:01.417685+0000 2024-09-12T00:42:01.413 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad23e412eb] 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad23e4149f] 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5645884ddcc1] 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5645884f2d5a] 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad22ca7d90] 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fad205679c0 thread_name:radosgw-admin 2024-09-12T00:42:01.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.414+0000 7fad205679c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad205679c0 time 2024-09-12T00:42:01.417685+0000 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad23e412eb] 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad23e4149f] 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5645884ddcc1] 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5645884f2d5a] 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad22ca7d90] 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:42:01.415 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.430 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:01.430 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad22cc0520] 2024-09-12T00:42:01.430 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:42:01.430 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:42:01.430 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:42:01.430 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad23e41345] 2024-09-12T00:42:01.430 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad23e4149f] 2024-09-12T00:42:01.430 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5645884ddcc1] 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5645884f2d5a] 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad22ca7d90] 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.414+0000 7fad205679c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fad205679c0 thread_name:radosgw-admin 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad22cc0520] 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:42:01.431 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad23e41345] 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad23e4149f] 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5645884ddcc1] 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5645884f2d5a] 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad22ca7d90] 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:42:01.432 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:42:00.886+0000 7fad1d86c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.433 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.433 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:01.433 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: dump: 2024-09-12T00:42:01.433 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.433 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.433 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.433 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: _finish_auth 0 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: _check_auth_tickets 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.434 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: dump: 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:42:00.886+0000 7fad205679c0 5 monclient: authenticate success, global_id 8214 2024-09-12T00:42:01.435 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:42:00.886+0000 7fad205679c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:42:00.886+0000 7fad205679c0 4 set_mon_vals no callback set 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: shutdown 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 asok(0x56458b0112b0) unregister_commands rotate-key 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: build_initial_monmap 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: monmap: 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.436 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding auth protocol: cephx 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding auth protocol: cephx 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding auth protocol: cephx 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.437 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:42:00.890+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 librados: starting msgr at 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 librados: starting objecter 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command objecter_requests hook 0x56458affb380 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 librados: setting wanted keys 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 librados: calling monclient init 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: init 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding auth protocol: cephx 2024-09-12T00:42:01.438 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding auth protocol: cephx 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding auth protocol: cephx 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.439 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:42:00.890+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:42:00.890+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command rotate-key hook 0x56458b21b638 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-b con 0x56458b0cc2b0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-a con 0x56458b0d7ba0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-c con 0x56458b164090 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:01.440 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): authenticate will time out at 2909.394107s 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): get_auth_request con 0x56458b0d7ba0 auth_method 0 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): get_auth_request con 0x56458b164090 auth_method 0 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.441 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:42:00.890+0000 7fad1e06d640 10 monclient(hunting): get_auth_request con 0x56458b0cc2b0 auth_method 0 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:42:00.890+0000 7fad1e06d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:42:00.890+0000 7fad1e06d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:42:00.890+0000 7fad1e06d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): handle_auth_done global_id 8217 payload 824 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient: _finish_hunting 0 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:42:00.890+0000 7fad1d86c640 1 monclient: found mon.noname-a 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: dump: 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.442 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: _finish_auth 0 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: _check_auth_tickets 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:01.443 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: dump: 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:42:00.890+0000 7fac0c608640 4 set_mon_vals no callback set 2024-09-12T00:42:01.444 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 monclient: authenticate success, global_id 8217 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 librados: init done 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:42:00.894+0000 7fac0ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:42:00.894+0000 7fac0ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:42:00.894+0000 7fac0ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:42:00.894+0000 7fad1e06d640 10 monclient: get_auth_request con 0x7fac04070b10 auth_method 0 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:42:00.894+0000 7fad1e86e640 10 monclient: get_auth_request con 0x56458b25dad0 auth_method 0 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:42:00.894+0000 7fad1e06d640 10 monclient: get_auth_request con 0x56458b266fa0 auth_method 0 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:42:00.898+0000 7fad1d86c640 10 monclient: get_auth_request con 0x56458b26b300 auth_method 0 2024-09-12T00:42:01.445 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:42:00.898+0000 7fad1e86e640 10 monclient: get_auth_request con 0x56458b26f610 auth_method 0 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:42:00.898+0000 7fad205679c0 10 monclient: build_initial_monmap 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:42:00.898+0000 7fad205679c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:42:00.898+0000 7fad205679c0 10 monclient: monmap: 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:01.446 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding auth protocol: cephx 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding auth protocol: cephx 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding auth protocol: cephx 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.447 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:42:00.902+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command objecter_requests cmddesc objecter_requests hook 0x56458b276d50 EEXIST 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: init 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding auth protocol: cephx 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding auth protocol: cephx 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding auth protocol: cephx 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.448 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:42:00.902+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:42:00.902+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command rotate-key cmddesc rotate-key hook 0x56458b2724a0 EEXIST 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:01.449 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-c con 0x56458b29af00 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-a con 0x56458b29a830 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-b con 0x56458b299210 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): authenticate will time out at 2909.404871s 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): get_auth_request con 0x56458b29a830 auth_method 0 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.450 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): get_auth_request con 0x56458b29af00 auth_method 0 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:42:00.902+0000 7fad1e06d640 10 monclient(hunting): get_auth_request con 0x56458b299210 auth_method 0 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:42:00.902+0000 7fad1e06d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:42:00.902+0000 7fad1e06d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.451 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:42:00.902+0000 7fad1e06d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): handle_auth_done global_id 8220 payload 824 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:42:00.902+0000 7fad1e86e640 1 monclient: found mon.noname-a 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: dump: 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.452 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: _finish_auth 0 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: _check_auth_tickets 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: dump: 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.453 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 monclient: authenticate success, global_id 8220 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:42:00.902+0000 7fad1f06f640 4 set_mon_vals no callback set 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.454 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:42:00.902+0000 7fac03fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:42:00.902+0000 7fac03fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:42:00.902+0000 7fac03fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: build_initial_monmap 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: monmap: 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:01.455 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding auth protocol: cephx 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding auth protocol: cephx 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding auth protocol: cephx 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.456 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient: get_auth_request con 0x7fabf8070a20 auth_method 0 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: init 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding auth protocol: cephx 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding auth protocol: cephx 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding auth protocol: cephx 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.457 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.458 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.458 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.458 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.458 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.458 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.458 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.458 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.458 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.458 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.458 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.459 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.459 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe5f214948 EEXIST 2024-09-12T00:42:01.459 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:01.459 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:42:01.459 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-a con 0x56458b2eed50 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:01.459 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-b con 0x56458b2ea100 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:01.459 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-c con 0x56458b2df810 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:01.459 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.459 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.459 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): authenticate will time out at 2909.409020s 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): get_auth_request con 0x56458b2eed50 auth_method 0 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): get_auth_request con 0x56458b2df810 auth_method 0 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.460 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_done global_id 8223 payload 274 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient: _finish_hunting 0 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:42:00.906+0000 7fad1d86c640 1 monclient: found mon.noname-a 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:42:00.906+0000 7fad1e86e640 10 monclient: get_auth_request con 0x56458b2ea100 auth_method 0 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: dump: 2024-09-12T00:42:01.461 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: _finish_auth 0 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 monclient: authenticate success, global_id 8223 2024-09-12T00:42:01.462 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:01.463 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:42:00.906+0000 7fad205679c0 4 set_mon_vals no callback set 2024-09-12T00:42:01.463 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.463 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:01.463 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: dump: 2024-09-12T00:42:01.463 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.463 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.463 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.463 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.464 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.464 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.464 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.464 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.464 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.464 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.464 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: shutdown 2024-09-12T00:42:01.464 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: build_initial_monmap 2024-09-12T00:42:01.464 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:01.464 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: monmap: 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding auth protocol: cephx 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding auth protocol: cephx 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding auth protocol: cephx 2024-09-12T00:42:01.465 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.466 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 librados: starting msgr at 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 librados: starting objecter 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command objecter_requests cmddesc objecter_requests hook 0x56458b2bf060 EEXIST 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 librados: setting wanted keys 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 librados: calling monclient init 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: init 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding auth protocol: cephx 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding auth protocol: cephx 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding auth protocol: cephx 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.467 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.468 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.468 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.468 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.468 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.468 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.468 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.468 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.468 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.468 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command rotate-key cmddesc rotate-key hook 0x56458b29ce68 EEXIST 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-a con 0x56458b2df810 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-b con 0x56458b2ea100 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-c con 0x56458b2eed50 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): authenticate will time out at 2909.411705s 2024-09-12T00:42:01.469 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): get_auth_request con 0x56458b2eed50 auth_method 0 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): get_auth_request con 0x56458b2df810 auth_method 0 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.470 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:42:00.910+0000 7fad1e86e640 10 monclient(hunting): get_auth_request con 0x56458b2ea100 auth_method 0 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:42:00.910+0000 7fad1e86e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:42:00.910+0000 7fad1e86e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:42:00.910+0000 7fad1e86e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:42:00.910+0000 7fad1e06d640 10 monclient(hunting): handle_auth_done global_id 7700 payload 824 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:42:00.910+0000 7fad1e06d640 10 monclient: _finish_hunting 0 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:42:00.910+0000 7fad1e06d640 1 monclient: found mon.noname-c 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:42:00.910+0000 7fad1e06d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: dump: 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.471 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: _finish_auth 0 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: _check_auth_tickets 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:01.472 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: dump: 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:42:00.910+0000 7fac01ffb640 4 set_mon_vals no callback set 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:42:00.910+0000 7fad205679c0 5 monclient: authenticate success, global_id 7700 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:42:00.910+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.473 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:42:00.910+0000 7fad205679c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:42:00.910+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:42:00.910+0000 7fad205679c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:42:00.910+0000 7fad205679c0 1 librados: init done 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:42:00.910+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command cr dump hook 0x56458b2db868 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:42:00.910+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:42:00.910+0000 7fabeffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:42:00.910+0000 7fabeffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:42:00.910+0000 7fabeffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:42:00.910+0000 7fad1d86c640 10 monclient: get_auth_request con 0x7fabe8070ae0 auth_method 0 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:42:00.910+0000 7fad1e86e640 10 monclient: get_auth_request con 0x56458b3083e0 auth_method 0 2024-09-12T00:42:01.474 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 realm 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:42:00.914+0000 7fad205679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:42:00.914+0000 7fad1d86c640 10 monclient: get_auth_request con 0x56458b30c5d0 auth_method 0 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:42:00.914+0000 7fad1e86e640 10 monclient: get_auth_request con 0x56458b30fe30 auth_method 0 2024-09-12T00:42:01.475 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:01.476 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 searching for the correct realm 2024-09-12T00:42:01.476 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:42:00.918+0000 7fad1e06d640 10 monclient: get_auth_request con 0x56458b314b30 auth_method 0 2024-09-12T00:42:01.476 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:42:00.918+0000 7fad1d86c640 10 monclient: get_auth_request con 0x7fad180d9060 auth_method 0 2024-09-12T00:42:01.476 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:42:00.918+0000 7fad1e86e640 10 monclient: get_auth_request con 0x7fad14070040 auth_method 0 2024-09-12T00:42:01.476 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:42:00.918+0000 7fad1e86e640 0 -- 172.21.15.102:0/3316165874 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fad14070040 msgr2=0x7fad14078840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:01.476 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:42:01.122+0000 7fad1e86e640 10 monclient: get_auth_request con 0x7fad14070040 auth_method 0 2024-09-12T00:42:01.476 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:42:01.126+0000 7fad1e06d640 10 monclient: get_auth_request con 0x7fad180fdea0 auth_method 0 2024-09-12T00:42:01.476 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:42:01.130+0000 7fad1d86c640 10 monclient: get_auth_request con 0x7fad18106990 auth_method 0 2024-09-12T00:42:01.476 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:42:01.130+0000 7fad1d86c640 0 -- 172.21.15.102:0/3316165874 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fad18106990 msgr2=0x7fad181056f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:01.476 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:42:01.334+0000 7fad1d86c640 10 monclient: get_auth_request con 0x7fad18106990 auth_method 0 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:01.477 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 zone default found 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:42:01.346+0000 7fad205679c0 4 Realm: () 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:42:01.346+0000 7fad205679c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:42:01.346+0000 7fad205679c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:42:01.346+0000 7fad205679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 zonegroup default 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 started sync module instance, tier type = 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:01.478 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=0 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=1 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=2 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=3 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=4 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=5 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=6 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=7 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:42:01.374+0000 7fad205679c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding auth protocol: cephx 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding auth protocol: cephx 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding auth protocol: cephx 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.479 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:42:01.378+0000 7fabd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:42:01.382+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:01.480 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command cache list hook 0x56458b2ec600 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command cache inspect hook 0x56458b2ec600 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command cache erase hook 0x56458b2ec600 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command cache zap hook 0x56458b2ec600 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 note: GC not initialized 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:42:01.382+0000 7fab4f7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command sync trace show hook 0x7fad1408e070 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command sync trace history hook 0x7fad1408e070 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command sync trace active hook 0x7fad1408e070 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command sync trace active_short hook 0x7fad1408e070 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:01.481 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 Filter name: none 2024-09-12T00:42:01.482 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:42:01.382+0000 7fab4d7fa640 20 reqs_thread_entry: start 2024-09-12T00:42:01.482 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:01.482 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.482 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:01.482 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:01.482 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:01.482 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:42:01.482 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.482 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:42:01.482 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:01.483 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:01.483 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:01.483 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:01.483 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:42:01.483 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:42:01.394+0000 7fad205679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:01.483 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:42:01.394+0000 7fad205679c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:01.483 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:42:01.394+0000 7fad205679c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:01.483 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:42:01.394+0000 7fad205679c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:42:01.483 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398943 cookie 94856688029760 notifier 7700 bl.length()=911 2024-09-12T00:42:01.483 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:42:01.414+0000 7fad205679c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad205679c0 time 2024-09-12T00:42:01.417685+0000 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad23e412eb] 2024-09-12T00:42:01.484 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad23e4149f] 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5645884ddcc1] 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5645884f2d5a] 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad22ca7d90] 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:42:01.414+0000 7fad205679c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fad205679c0 thread_name:radosgw-admin 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad22cc0520] 2024-09-12T00:42:01.485 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad23e41345] 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad23e4149f] 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5645884ddcc1] 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5645884f2d5a] 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad22ca7d90] 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.486 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:42:01.487 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:42:01.488 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:42:01.489 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:42:01.490 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:01.491 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:01.492 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:01.493 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fab4d7fa640 / http_manager 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fab4f7fe640 / http_manager 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabd4fe1640 / rgw_dt_lg_renew 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabeffff640 / ms_dispatch 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fac01ffb640 / io_context_pool 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fac03fff640 / ms_dispatch 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fac0ae05640 / ms_dispatch 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fac0c608640 / io_context_pool 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fad1d86c640 / msgr-worker-2 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fad1e06d640 / msgr-worker-1 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fad1e86e640 / msgr-worker-0 2024-09-12T00:42:01.494 INFO:tasks.workunit.client.0.smithi102.stderr: 7fad1f06f640 / io_context_pool 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr: 7fad205679c0 / radosgw-admin 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.144835.log 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:42:00.886+0000 7fad1d86c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: dump: 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.495 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: _finish_auth 0 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: _check_auth_tickets 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:01.496 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:42:00.886+0000 7fac0c608640 10 monclient: dump: 2024-09-12T00:42:01.497 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.497 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.497 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.497 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.497 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.497 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.497 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.497 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.497 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.497 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.498 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:42:00.886+0000 7fad205679c0 5 monclient: authenticate success, global_id 8214 2024-09-12T00:42:01.498 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:42:00.886+0000 7fad205679c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:01.498 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:42:00.886+0000 7fad205679c0 4 set_mon_vals no callback set 2024-09-12T00:42:01.498 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: shutdown 2024-09-12T00:42:01.498 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 asok(0x56458b0112b0) unregister_commands rotate-key 2024-09-12T00:42:01.498 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: build_initial_monmap 2024-09-12T00:42:01.498 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:01.498 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: monmap: 2024-09-12T00:42:01.498 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding auth protocol: cephx 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding auth protocol: cephx 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding auth protocol: cephx 2024-09-12T00:42:01.499 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.500 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.500 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.500 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.500 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.500 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.500 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.500 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.500 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.500 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.500 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: crc 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b220840) adding con mode: secure 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:42:00.890+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 librados: starting msgr at 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 librados: starting objecter 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command objecter_requests hook 0x56458affb380 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 librados: setting wanted keys 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 librados: calling monclient init 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: init 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding auth protocol: cephx 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding auth protocol: cephx 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding auth protocol: cephx 2024-09-12T00:42:01.501 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: crc 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 AuthRegistry(0x56458b21b4f0) adding con mode: secure 2024-09-12T00:42:01.502 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:42:00.890+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:42:00.890+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command rotate-key hook 0x56458b21b638 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-b con 0x56458b0cc2b0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-a con 0x56458b0d7ba0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-c con 0x56458b164090 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient(hunting): authenticate will time out at 2909.394107s 2024-09-12T00:42:01.503 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): get_auth_request con 0x56458b0d7ba0 auth_method 0 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): get_auth_request con 0x56458b164090 auth_method 0 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.504 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:42:00.890+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:42:00.890+0000 7fad1e06d640 10 monclient(hunting): get_auth_request con 0x56458b0cc2b0 auth_method 0 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:42:00.890+0000 7fad1e06d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:42:00.890+0000 7fad1e06d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:42:00.890+0000 7fad1e06d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient(hunting): handle_auth_done global_id 8217 payload 824 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient: _finish_hunting 0 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:42:00.890+0000 7fad1d86c640 1 monclient: found mon.noname-a 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:42:00.890+0000 7fad1d86c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: dump: 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.505 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: _finish_auth 0 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: _check_auth_tickets 2024-09-12T00:42:01.506 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:42:00.890+0000 7fac0ae05640 10 monclient: dump: 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.507 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:42:00.890+0000 7fac0c608640 4 set_mon_vals no callback set 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:42:00.890+0000 7fad205679c0 5 monclient: authenticate success, global_id 8217 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:42:00.890+0000 7fad205679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:42:00.890+0000 7fad205679c0 1 librados: init done 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:42:00.894+0000 7fac0ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:42:00.894+0000 7fac0ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:42:00.894+0000 7fac0ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.508 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:42:00.894+0000 7fad1e06d640 10 monclient: get_auth_request con 0x7fac04070b10 auth_method 0 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:42:00.894+0000 7fad1e86e640 10 monclient: get_auth_request con 0x56458b25dad0 auth_method 0 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:42:00.894+0000 7fad1e06d640 10 monclient: get_auth_request con 0x56458b266fa0 auth_method 0 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:42:00.898+0000 7fad1d86c640 10 monclient: get_auth_request con 0x56458b26b300 auth_method 0 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:42:00.898+0000 7fad1e86e640 10 monclient: get_auth_request con 0x56458b26f610 auth_method 0 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:42:00.898+0000 7fad205679c0 10 monclient: build_initial_monmap 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:42:00.898+0000 7fad205679c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:42:00.898+0000 7fad205679c0 10 monclient: monmap: 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.509 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding auth protocol: cephx 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding auth protocol: cephx 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding auth protocol: cephx 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.510 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.511 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.511 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.511 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.511 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.511 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.511 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: crc 2024-09-12T00:42:01.511 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:42:00.898+0000 7fad205679c0 5 AuthRegistry(0x56458b2733a0) adding con mode: secure 2024-09-12T00:42:01.511 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:42:00.902+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.511 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command objecter_requests cmddesc objecter_requests hook 0x56458b276d50 EEXIST 2024-09-12T00:42:01.511 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: init 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding auth protocol: cephx 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding auth protocol: cephx 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding auth protocol: cephx 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.512 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: crc 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 AuthRegistry(0x56458b272358) adding con mode: secure 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:42:00.902+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:42:00.902+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command rotate-key cmddesc rotate-key hook 0x56458b2724a0 EEXIST 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-c con 0x56458b29af00 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-a con 0x56458b29a830 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-b con 0x56458b299210 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.513 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient(hunting): authenticate will time out at 2909.404871s 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): get_auth_request con 0x56458b29a830 auth_method 0 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): get_auth_request con 0x56458b29af00 auth_method 0 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.514 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:42:00.902+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:42:00.902+0000 7fad1e06d640 10 monclient(hunting): get_auth_request con 0x56458b299210 auth_method 0 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:42:00.902+0000 7fad1e06d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:42:00.902+0000 7fad1e06d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:42:00.902+0000 7fad1e06d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient(hunting): handle_auth_done global_id 8220 payload 824 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:42:00.902+0000 7fad1e86e640 1 monclient: found mon.noname-a 2024-09-12T00:42:01.515 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:42:00.902+0000 7fad1e86e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: dump: 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.516 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: _finish_auth 0 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: _check_auth_tickets 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:42:00.902+0000 7fac03fff640 10 monclient: dump: 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.517 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:42:00.902+0000 7fad205679c0 5 monclient: authenticate success, global_id 8220 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:42:00.902+0000 7fad1f06f640 4 set_mon_vals no callback set 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:42:00.902+0000 7fad205679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:42:00.902+0000 7fac03fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:42:00.902+0000 7fac03fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:42:00.902+0000 7fac03fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.518 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: build_initial_monmap 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: monmap: 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.519 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding auth protocol: cephx 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding auth protocol: cephx 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding auth protocol: cephx 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.520 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: crc 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2ba810) adding con mode: secure 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient: get_auth_request con 0x7fabf8070a20 auth_method 0 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: init 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding auth protocol: cephx 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding auth protocol: cephx 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding auth protocol: cephx 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.521 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: crc 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214800) adding con mode: secure 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe5f214948 EEXIST 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-a con 0x56458b2eed50 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-b con 0x56458b2ea100 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:01.522 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-c con 0x56458b2df810 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): authenticate will time out at 2909.409020s 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): get_auth_request con 0x56458b2eed50 auth_method 0 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): get_auth_request con 0x56458b2df810 auth_method 0 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.523 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_done global_id 8223 payload 274 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient: _finish_hunting 0 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:42:00.906+0000 7fad1d86c640 1 monclient: found mon.noname-a 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:42:00.906+0000 7fad1e86e640 10 monclient: get_auth_request con 0x56458b2ea100 auth_method 0 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:01.524 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: dump: 2024-09-12T00:42:01.525 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.525 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.526 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.526 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.526 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.526 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.526 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.526 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.526 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.527 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.527 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: _finish_auth 0 2024-09-12T00:42:01.527 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:42:01.527 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:01.527 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 monclient: authenticate success, global_id 8223 2024-09-12T00:42:01.527 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:01.527 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:42:00.906+0000 7fad205679c0 4 set_mon_vals no callback set 2024-09-12T00:42:01.527 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.527 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:01.527 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:42:00.906+0000 7fac01ffb640 10 monclient: dump: 2024-09-12T00:42:01.528 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.528 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.528 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.528 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.528 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.528 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.528 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.529 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.529 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.529 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.529 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: shutdown 2024-09-12T00:42:01.529 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: build_initial_monmap 2024-09-12T00:42:01.529 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:01.529 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: monmap: 2024-09-12T00:42:01.529 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:01.530 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:01.530 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:01.530 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:01.530 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:01.530 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.530 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:01.530 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:01.530 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:01.531 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.531 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding auth protocol: cephx 2024-09-12T00:42:01.531 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding auth protocol: cephx 2024-09-12T00:42:01.531 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding auth protocol: cephx 2024-09-12T00:42:01.531 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.531 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.531 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.531 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.531 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: crc 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b2bf9a0) adding con mode: secure 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 librados: starting msgr at 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 librados: starting objecter 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command objecter_requests cmddesc objecter_requests hook 0x56458b2bf060 EEXIST 2024-09-12T00:42:01.532 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 librados: setting wanted keys 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:42:00.906+0000 7fad205679c0 1 librados: calling monclient init 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: init 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding auth protocol: cephx 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding auth protocol: cephx 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding auth protocol: cephx 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.533 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.534 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.534 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.534 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.534 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: crc 2024-09-12T00:42:01.534 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 AuthRegistry(0x56458b29cd20) adding con mode: secure 2024-09-12T00:42:01.534 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.534 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:42:00.906+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.534 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:42:00.906+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command rotate-key cmddesc rotate-key hook 0x56458b29ce68 EEXIST 2024-09-12T00:42:01.534 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:01.535 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:42:01.535 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-a con 0x56458b2df810 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:01.535 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-b con 0x56458b2ea100 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:01.535 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): picked mon.noname-c con 0x56458b2eed50 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:01.535 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.535 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.535 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:01.536 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:01.536 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:42:00.906+0000 7fad205679c0 10 monclient(hunting): authenticate will time out at 2909.411705s 2024-09-12T00:42:01.536 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): get_auth_request con 0x56458b2eed50 auth_method 0 2024-09-12T00:42:01.536 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.536 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): get_auth_request con 0x56458b2df810 auth_method 0 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:42:00.906+0000 7fad1e06d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:42:00.906+0000 7fad1d86c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:42:00.910+0000 7fad1e86e640 10 monclient(hunting): get_auth_request con 0x56458b2ea100 auth_method 0 2024-09-12T00:42:01.537 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:42:00.910+0000 7fad1e86e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:42:00.910+0000 7fad1e86e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:42:00.910+0000 7fad1e86e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:42:00.910+0000 7fad1e06d640 10 monclient(hunting): handle_auth_done global_id 7700 payload 824 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:42:00.910+0000 7fad1e06d640 10 monclient: _finish_hunting 0 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:42:00.910+0000 7fad1e06d640 1 monclient: found mon.noname-c 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:42:00.910+0000 7fad1e06d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: dump: 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.538 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: _finish_auth 0 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: _check_auth_tickets 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:42:00.910+0000 7fabeffff640 10 monclient: dump: 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:01.539 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:42:00.910+0000 7fac01ffb640 4 set_mon_vals no callback set 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:42:00.910+0000 7fad205679c0 5 monclient: authenticate success, global_id 7700 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:42:00.910+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:42:00.910+0000 7fad205679c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:01.540 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:42:00.910+0000 7fad205679c0 10 monclient: _renew_subs 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:42:00.910+0000 7fad205679c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:42:00.910+0000 7fad205679c0 1 librados: init done 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:42:00.910+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command cr dump hook 0x56458b2db868 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:42:00.910+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:42:00.910+0000 7fabeffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:42:00.910+0000 7fabeffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:42:00.910+0000 7fabeffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:42:00.910+0000 7fad1d86c640 10 monclient: get_auth_request con 0x7fabe8070ae0 auth_method 0 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:42:00.910+0000 7fad1e86e640 10 monclient: get_auth_request con 0x56458b3083e0 auth_method 0 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 realm 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.541 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:42:00.914+0000 7fad205679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:01.542 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.542 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.542 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.542 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:42:00.914+0000 7fad1d86c640 10 monclient: get_auth_request con 0x56458b30c5d0 auth_method 0 2024-09-12T00:42:01.542 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.542 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.542 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:42:00.914+0000 7fad1e86e640 10 monclient: get_auth_request con 0x56458b30fe30 auth_method 0 2024-09-12T00:42:01.542 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:01.542 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:42:00.914+0000 7fad205679c0 20 searching for the correct realm 2024-09-12T00:42:01.542 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:42:00.918+0000 7fad1e06d640 10 monclient: get_auth_request con 0x56458b314b30 auth_method 0 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:42:00.918+0000 7fad1d86c640 10 monclient: get_auth_request con 0x7fad180d9060 auth_method 0 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:42:00.918+0000 7fad1e86e640 10 monclient: get_auth_request con 0x7fad14070040 auth_method 0 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:42:00.918+0000 7fad1e86e640 0 -- 172.21.15.102:0/3316165874 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fad14070040 msgr2=0x7fad14078840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:42:01.122+0000 7fad1e86e640 10 monclient: get_auth_request con 0x7fad14070040 auth_method 0 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:42:01.126+0000 7fad1e06d640 10 monclient: get_auth_request con 0x7fad180fdea0 auth_method 0 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:42:01.130+0000 7fad1d86c640 10 monclient: get_auth_request con 0x7fad18106990 auth_method 0 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:42:01.130+0000 7fad1d86c640 0 -- 172.21.15.102:0/3316165874 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fad18106990 msgr2=0x7fad181056f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:42:01.334+0000 7fad1d86c640 10 monclient: get_auth_request con 0x7fad18106990 auth_method 0 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:01.543 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 zone default found 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:42:01.346+0000 7fad205679c0 4 Realm: () 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:42:01.346+0000 7fad205679c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:42:01.346+0000 7fad205679c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:01.544 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:42:01.346+0000 7fad205679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 zonegroup default 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:42:01.346+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 started sync module instance, tier type = 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:42:01.350+0000 7fad205679c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=0 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=1 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=2 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=3 2024-09-12T00:42:01.545 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=4 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=5 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=6 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:42:01.374+0000 7fad205679c0 20 add_watcher() i=7 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:42:01.374+0000 7fad205679c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding auth protocol: cephx 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding auth protocol: cephx 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding auth protocol: cephx 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.546 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:42:01.378+0000 7fabd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: crc 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:42:01.378+0000 7fad205679c0 5 AuthRegistry(0x7ffe5f214ce0) adding con mode: secure 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:42:01.382+0000 7fad205679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command cache list hook 0x56458b2ec600 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command cache inspect hook 0x56458b2ec600 2024-09-12T00:42:01.547 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command cache erase hook 0x56458b2ec600 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command cache zap hook 0x56458b2ec600 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 note: GC not initialized 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:42:01.382+0000 7fab4f7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command sync trace show hook 0x7fad1408e070 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command sync trace history hook 0x7fad1408e070 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command sync trace active hook 0x7fad1408e070 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:42:01.382+0000 7fad205679c0 5 asok(0x56458b0112b0) register_command sync trace active_short hook 0x7fad1408e070 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 Filter name: none 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:42:01.382+0000 7fab4d7fa640 20 reqs_thread_entry: start 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.548 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:42:01.382+0000 7fad205679c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:42:01.382+0000 7fad205679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:42:01.394+0000 7fad205679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:42:01.394+0000 7fad205679c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:01.549 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:42:01.394+0000 7fad205679c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:42:01.394+0000 7fad205679c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398943 cookie 94856688029760 notifier 7700 bl.length()=911 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:42:01.394+0000 7fac01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:42:01.398+0000 7fad205679c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:42:01.414+0000 7fad205679c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fad205679c0 time 2024-09-12T00:42:01.417685+0000 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:01.550 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fad23e412eb] 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad23e4149f] 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5645884ddcc1] 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5645884f2d5a] 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad22ca7d90] 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:42:01.414+0000 7fad205679c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fad205679c0 thread_name:radosgw-admin 2024-09-12T00:42:01.551 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fad22cc0520] 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fad23e41345] 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fad23e4149f] 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5645884ddcc1] 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5645884f2d5a] 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fad22ca7d90] 2024-09-12T00:42:01.552 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:01.553 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:42:01.554 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:42:01.555 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:42:01.556 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:42:01.556 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:42:01.556 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:42:01.556 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:01.556 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:42:01.556 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:42:01.556 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:42:01.557 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:42:01.558 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:42:01.558 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:42:01.558 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:42:01.558 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:42:01.558 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:42:01.558 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:42:01.558 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:42:01.558 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:42:01.558 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:42:01.559 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:42:01.559 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:01.559 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:01.559 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:01.559 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:42:01.559 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:01.559 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:01.559 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:01.559 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:01.559 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:42:01.560 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:01.560 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:01.560 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:01.560 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:01.560 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:01.560 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:01.560 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:42:01.560 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:01.560 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:42:01.560 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:42:01.561 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:42:01.561 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:01.561 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:42:01.561 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:42:01.561 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:01.561 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:01.561 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:01.561 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:01.562 INFO:tasks.workunit.client.0.smithi102.stderr: 7fab4d7fa640 / http_manager 2024-09-12T00:42:01.562 INFO:tasks.workunit.client.0.smithi102.stderr: 7fab4f7fe640 / http_manager 2024-09-12T00:42:01.562 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabd4fe1640 / rgw_dt_lg_renew 2024-09-12T00:42:01.562 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabeffff640 / ms_dispatch 2024-09-12T00:42:01.562 INFO:tasks.workunit.client.0.smithi102.stderr: 7fac01ffb640 / io_context_pool 2024-09-12T00:42:01.562 INFO:tasks.workunit.client.0.smithi102.stderr: 7fac03fff640 / ms_dispatch 2024-09-12T00:42:01.562 INFO:tasks.workunit.client.0.smithi102.stderr: 7fac0ae05640 / ms_dispatch 2024-09-12T00:42:01.562 INFO:tasks.workunit.client.0.smithi102.stderr: 7fac0c608640 / io_context_pool 2024-09-12T00:42:01.562 INFO:tasks.workunit.client.0.smithi102.stderr: 7fad1d86c640 / msgr-worker-2 2024-09-12T00:42:01.563 INFO:tasks.workunit.client.0.smithi102.stderr: 7fad1e06d640 / msgr-worker-1 2024-09-12T00:42:01.563 INFO:tasks.workunit.client.0.smithi102.stderr: 7fad1e86e640 / msgr-worker-0 2024-09-12T00:42:01.563 INFO:tasks.workunit.client.0.smithi102.stderr: 7fad1f06f640 / io_context_pool 2024-09-12T00:42:01.563 INFO:tasks.workunit.client.0.smithi102.stderr: 7fad205679c0 / radosgw-admin 2024-09-12T00:42:01.563 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:42:01.563 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:42:01.563 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:42:01.419727Z_3acc65ff-21a7-48cb-b784-8cbf4e15f401/log 2024-09-12T00:42:01.563 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:42:01.563 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:42:01.563 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:42:01.565 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:01.566 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:01.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.498+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.498+0000 7f51dacee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.498+0000 7f51dacee9c0 20 realm 2024-09-12T00:42:01.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.498+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.498+0000 7f51dacee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.498+0000 7f51dacee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:01.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.498+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.498+0000 7f51dacee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.498+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.502+0000 7f51dacee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.502+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.502+0000 7f51dacee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:01.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.502+0000 7f51dacee9c0 20 searching for the correct realm 2024-09-12T00:42:01.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.506+0000 7f51d8ff5640 0 -- 172.21.15.102:0/1168062002 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f51cc01f060 msgr2=0x7f51cc0013d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:01.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.722+0000 7f51d7ff3640 0 -- 172.21.15.102:0/1168062002 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f51d000f430 msgr2=0x7f51d000f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:01.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.938+0000 7f51dacee9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:01.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.938+0000 7f51dacee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:01.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.938+0000 7f51dacee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:01.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.938+0000 7f51dacee9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:01.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.938+0000 7f51dacee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:01.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.938+0000 7f51dacee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:01.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.938+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.938+0000 7f51dacee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.938+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:01.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:01.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 zone default found 2024-09-12T00:42:01.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 4 Realm: () 2024-09-12T00:42:01.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:01.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:01.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:01.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 zonegroup default 2024-09-12T00:42:01.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:01.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 started sync module instance, tier type = 2024-09-12T00:42:01.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.942+0000 7f51dacee9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:01.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.966+0000 7f51dacee9c0 20 add_watcher() i=0 2024-09-12T00:42:01.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.966+0000 7f51dacee9c0 20 add_watcher() i=1 2024-09-12T00:42:01.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.966+0000 7f51dacee9c0 20 add_watcher() i=2 2024-09-12T00:42:01.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.966+0000 7f51dacee9c0 20 add_watcher() i=3 2024-09-12T00:42:01.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.966+0000 7f51dacee9c0 20 add_watcher() i=4 2024-09-12T00:42:01.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.966+0000 7f51dacee9c0 20 add_watcher() i=5 2024-09-12T00:42:01.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.966+0000 7f51dacee9c0 20 add_watcher() i=6 2024-09-12T00:42:01.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.970+0000 7f51dacee9c0 20 add_watcher() i=7 2024-09-12T00:42:01.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.970+0000 7f51dacee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:01.975 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.974+0000 7f508e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.974+0000 7f51dacee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:01.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.974+0000 7f51dacee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:01.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.974+0000 7f51dacee9c0 5 note: GC not initialized 2024-09-12T00:42:01.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.974+0000 7f508d7e2640 20 reqs_thread_entry: start 2024-09-12T00:42:01.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f51dacee9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:01.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f51dacee9c0 20 Filter name: none 2024-09-12T00:42:01.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f4ffeffd640 20 reqs_thread_entry: start 2024-09-12T00:42:01.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f51dacee9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:01.979 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f51dacee9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:42:01.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f51dacee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:01.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f51dacee9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:01.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.978+0000 7f51dacee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:01.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.982+0000 7f51dacee9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:42:01.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.982+0000 7f51dacee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:42:01.985 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.982+0000 7f508e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:01.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.990+0000 7f51dacee9c0 20 remove_watcher() i=0 2024-09-12T00:42:01.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.990+0000 7f51dacee9c0 2 removed watcher, disabling cache 2024-09-12T00:42:01.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.990+0000 7f51dacee9c0 20 remove_watcher() i=1 2024-09-12T00:42:01.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.994+0000 7f51dacee9c0 20 remove_watcher() i=2 2024-09-12T00:42:01.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.994+0000 7f51dacee9c0 20 remove_watcher() i=3 2024-09-12T00:42:01.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.998+0000 7f51dacee9c0 20 remove_watcher() i=4 2024-09-12T00:42:02.000 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:01.998+0000 7f51dacee9c0 20 remove_watcher() i=5 2024-09-12T00:42:02.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.002+0000 7f51dacee9c0 20 remove_watcher() i=6 2024-09-12T00:42:02.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.002+0000 7f51dacee9c0 20 remove_watcher() i=7 2024-09-12T00:42:02.021 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:42:02.021 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:42:02.091 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:42:02.122 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:02.122 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:02.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.166+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.170+0000 7f38afae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.170+0000 7f38afae79c0 20 realm 2024-09-12T00:42:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.170+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.170+0000 7f38afae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.170+0000 7f38afae79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.170+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.170+0000 7f38afae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.170+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.170+0000 7f38afae79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:02.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.170+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.174+0000 7f38afae79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:02.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.174+0000 7f38afae79c0 20 searching for the correct realm 2024-09-12T00:42:02.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.174+0000 7f38acdec640 0 -- 172.21.15.102:0/155082248 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x5613a9d3d9c0 msgr2=0x7f38a00fec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:42:02.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.386+0000 7f38addee640 0 -- 172.21.15.102:0/155082248 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x5613a9f7e500 msgr2=0x5613a9f808f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:02.404 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.402+0000 7f38afae79c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:02.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.402+0000 7f38afae79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:02.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.402+0000 7f38afae79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:02.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.402+0000 7f38afae79c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:02.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.402+0000 7f38afae79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:02.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.402+0000 7f38afae79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:02.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.402+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.402+0000 7f38afae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.402+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:02.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:02.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 zone default found 2024-09-12T00:42:02.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 4 Realm: () 2024-09-12T00:42:02.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:02.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:02.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:02.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 zonegroup default 2024-09-12T00:42:02.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:02.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 started sync module instance, tier type = 2024-09-12T00:42:02.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.406+0000 7f38afae79c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:02.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.430+0000 7f38afae79c0 20 add_watcher() i=0 2024-09-12T00:42:02.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.430+0000 7f38afae79c0 20 add_watcher() i=1 2024-09-12T00:42:02.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.430+0000 7f38afae79c0 20 add_watcher() i=2 2024-09-12T00:42:02.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.430+0000 7f38afae79c0 20 add_watcher() i=3 2024-09-12T00:42:02.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.430+0000 7f38afae79c0 20 add_watcher() i=4 2024-09-12T00:42:02.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.430+0000 7f38afae79c0 20 add_watcher() i=5 2024-09-12T00:42:02.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.430+0000 7f38afae79c0 20 add_watcher() i=6 2024-09-12T00:42:02.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.434+0000 7f38afae79c0 20 add_watcher() i=7 2024-09-12T00:42:02.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.434+0000 7f38afae79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:02.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.438+0000 7f37637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:02.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:02.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:02.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 5 note: GC not initialized 2024-09-12T00:42:02.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f37627e4640 20 reqs_thread_entry: start 2024-09-12T00:42:02.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:02.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 20 Filter name: none 2024-09-12T00:42:02.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f36d3fff640 20 reqs_thread_entry: start 2024-09-12T00:42:02.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:02.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:02.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:02.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:02.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:42:02.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:02.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:42:02.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:02.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:02.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:02.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.442+0000 7f38afae79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:02.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:42:02.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:42:02.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:42:02.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:42:02.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:42:02.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:42:02.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:42:02.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:42:02.447 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:42:02.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:42:02.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.446+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:42:02.449 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.450+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:42:02.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.450+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:42:02.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.450+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:42:02.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.450+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:42:02.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.450+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:42:02.451 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.450+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:42:02.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.450+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:42:02.452 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.450+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:42:02.453 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.454+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:42:02.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.454+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:42:02.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.454+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:42:02.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.454+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:42:02.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.454+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:42:02.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.454+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:42:02.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.454+0000 7f38afae79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:42:02.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.454+0000 7f38afae79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:42:02.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.458+0000 7f37637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:02.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.462+0000 7f38afae79c0 20 remove_watcher() i=0 2024-09-12T00:42:02.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.462+0000 7f38afae79c0 2 removed watcher, disabling cache 2024-09-12T00:42:02.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.466+0000 7f38afae79c0 20 remove_watcher() i=1 2024-09-12T00:42:02.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.466+0000 7f38afae79c0 20 remove_watcher() i=2 2024-09-12T00:42:02.470 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.470+0000 7f38afae79c0 20 remove_watcher() i=3 2024-09-12T00:42:02.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.470+0000 7f38afae79c0 20 remove_watcher() i=4 2024-09-12T00:42:02.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.474+0000 7f38afae79c0 20 remove_watcher() i=5 2024-09-12T00:42:02.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.474+0000 7f38afae79c0 20 remove_watcher() i=6 2024-09-12T00:42:02.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:02.474+0000 7f38afae79c0 20 remove_watcher() i=7 2024-09-12T00:42:32.507 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:42:32.545 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:32.546 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:32.590 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.592 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.593+0000 7f14452779c0 20 realm 2024-09-12T00:42:32.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.593+0000 7f14452779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:32.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.593 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.597+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:32.594 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.597+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.597+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:32.596 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.597+0000 7f14452779c0 20 searching for the correct realm 2024-09-12T00:42:32.599 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.601+0000 7f144357e640 0 -- 172.21.15.102:0/1553805566 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f142c103040 msgr2=0x7f142c0ffa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:32.607 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.609+0000 7f144257c640 0 -- 172.21.15.102:0/1553805566 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f143c080bf0 msgr2=0x7f143c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:32.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:32.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:32.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:32.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:32.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:32.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:32.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.825+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.825+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.825+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:32.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:32.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 20 zone default found 2024-09-12T00:42:32.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 4 Realm: () 2024-09-12T00:42:32.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:32.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:32.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:32.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 20 zonegroup default 2024-09-12T00:42:32.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.833+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.833+0000 7f14452779c0 20 started sync module instance, tier type = 2024-09-12T00:42:32.829 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.833+0000 7f14452779c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:32.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=0 2024-09-12T00:42:32.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=1 2024-09-12T00:42:32.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=2 2024-09-12T00:42:32.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=3 2024-09-12T00:42:32.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=4 2024-09-12T00:42:32.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=5 2024-09-12T00:42:32.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=6 2024-09-12T00:42:32.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.857+0000 7f14452779c0 20 add_watcher() i=7 2024-09-12T00:42:32.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.857+0000 7f14452779c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:32.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.861+0000 7f12f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:32.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.861+0000 7f14452779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:32.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.861+0000 7f14452779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:32.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.861+0000 7f14452779c0 5 note: GC not initialized 2024-09-12T00:42:32.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.861+0000 7f1273fff640 20 reqs_thread_entry: start 2024-09-12T00:42:32.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:32.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 20 Filter name: none 2024-09-12T00:42:32.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f1271ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:32.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:32.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:32.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:32.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:32.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:42:32.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:42:32.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:32.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:32.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:32.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:32.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.865+0000 7f14452779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:42:32.867 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.869+0000 7f14452779c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:32.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.885+0000 7f14452779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:32.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.885+0000 7f14452779c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:32.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.885+0000 7f14452779c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:32.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.885+0000 7f14452779c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:42:32.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398944 cookie 94803712367824 notifier 8280 bl.length()=911 2024-09-12T00:42:32.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:32.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:32.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:32.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:42:32.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:42:32.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:42:32.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:42:32.893 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14452779c0 time 2024-09-12T00:42:32.897584+0000 2024-09-12T00:42:32.893 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:32.894 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:32.894 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1448b512eb] 2024-09-12T00:42:32.894 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1448b5149f] 2024-09-12T00:42:32.894 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56393356acc1] 2024-09-12T00:42:32.894 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422aac) [0x563933fc8aac] 2024-09-12T00:42:32.894 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56393357fced] 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14479b7d90] 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.897+0000 7f14452779c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14452779c0 time 2024-09-12T00:42:32.897584+0000 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1448b512eb] 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1448b5149f] 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56393356acc1] 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422aac) [0x563933fc8aac] 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56393357fced] 2024-09-12T00:42:32.895 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:42:32.896 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14479b7d90] 2024-09-12T00:42:32.896 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:42:32.896 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:42:32.896 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.896 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:42:32.896 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f14452779c0 thread_name:radosgw-admin 2024-09-12T00:42:32.912 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:32.912 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f14479d0520] 2024-09-12T00:42:32.912 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:42:32.912 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:42:32.912 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:42:32.912 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1448b51345] 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1448b5149f] 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56393356acc1] 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422aac) [0x563933fc8aac] 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56393357fced] 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14479b7d90] 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.897+0000 7f14452779c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f14452779c0 thread_name:radosgw-admin 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f14479d0520] 2024-09-12T00:42:32.913 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1448b51345] 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1448b5149f] 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56393356acc1] 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422aac) [0x563933fc8aac] 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56393357fced] 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14479b7d90] 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:42:32.914 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:42:32.569+0000 7f144357e640 1 monclient: found mon.noname-c 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:42:32.569+0000 7f144357e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: dump: 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.915 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.916 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.916 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.916 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.916 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.916 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.916 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.916 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: _finish_auth 0 2024-09-12T00:42:32.916 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: _check_auth_tickets 2024-09-12T00:42:32.916 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:32.916 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: dump: 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.917 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:42:32.569+0000 7f14452779c0 5 monclient: authenticate success, global_id 7736 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:42:32.569+0000 7f14452779c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:42:32.569+0000 7f14452779c0 4 set_mon_vals no callback set 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:42:32.569+0000 7f14452779c0 10 monclient: shutdown 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:42:32.569+0000 7f14452779c0 5 asok(0x56393568b2b0) unregister_commands rotate-key 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: build_initial_monmap 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: monmap: 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.918 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding auth protocol: cephx 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding auth protocol: cephx 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding auth protocol: cephx 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.919 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:42:32.573+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 librados: starting msgr at 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 librados: starting objecter 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command objecter_requests hook 0x5639356b3e50 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 librados: setting wanted keys 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 librados: calling monclient init 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: init 2024-09-12T00:42:32.920 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding auth protocol: cephx 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding auth protocol: cephx 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding auth protocol: cephx 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.921 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:42:32.573+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:42:32.573+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command rotate-key hook 0x563935896bd8 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-a con 0x563935751930 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-c con 0x5639357dfab0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-b con 0x5639358999f0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:32.922 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): authenticate will time out at 2941.073238s 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): get_auth_request con 0x5639357dfab0 auth_method 0 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): get_auth_request con 0x563935751930 auth_method 0 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.923 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient: _finish_hunting 0 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:42:32.573+0000 7f144257c640 1 monclient: found mon.noname-c 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: dump: 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.924 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: _finish_auth 0 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: _check_auth_tickets 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: dump: 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.925 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:42:32.573+0000 7f1330e09640 4 set_mon_vals no callback set 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 monclient: authenticate success, global_id 7739 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 librados: init done 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:42:32.577+0000 7f132f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:32.926 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:42:32.577+0000 7f132f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:42:32.577+0000 7f132f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:42:32.577+0000 7f1442d7d640 10 monclient: get_auth_request con 0x7f1328070ae0 auth_method 0 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:42:32.577+0000 7f144357e640 10 monclient: get_auth_request con 0x5639358d8190 auth_method 0 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:42:32.577+0000 7f1442d7d640 10 monclient: get_auth_request con 0x5639358e1960 auth_method 0 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:42:32.577+0000 7f144257c640 10 monclient: get_auth_request con 0x5639358e5ba0 auth_method 0 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient: get_auth_request con 0x5639358ea040 auth_method 0 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient: build_initial_monmap 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:42:32.581+0000 7f14452779c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient: monmap: 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:32.927 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding auth protocol: cephx 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding auth protocol: cephx 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding auth protocol: cephx 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.928 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:42:32.581+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5639358f1790 EEXIST 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient: init 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding auth protocol: cephx 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding auth protocol: cephx 2024-09-12T00:42:32.929 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding auth protocol: cephx 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:42:32.581+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.930 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:42:32.581+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command rotate-key cmddesc rotate-key hook 0x5639358eced0 EEXIST 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-a con 0x563935915940 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-c con 0x563935915270 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-b con 0x563935913c50 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): authenticate will time out at 2941.083562s 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): get_auth_request con 0x563935915270 auth_method 0 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.931 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): get_auth_request con 0x563935915940 auth_method 0 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:42:32.581+0000 7f1442d7d640 10 monclient(hunting): get_auth_request con 0x563935913c50 auth_method 0 2024-09-12T00:42:32.932 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:42:32.581+0000 7f1442d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:42:32.581+0000 7f1442d7d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:42:32.581+0000 7f1442d7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient(hunting): handle_auth_done global_id 7742 payload 824 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:42:32.585+0000 7f144357e640 1 monclient: found mon.noname-c 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: dump: 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.933 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: _finish_auth 0 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: dump: 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.934 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 monclient: authenticate success, global_id 7742 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:42:32.585+0000 7f1443d7f640 4 set_mon_vals no callback set 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.935 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:42:32.585+0000 7f132ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:42:32.585+0000 7f132ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:42:32.585+0000 7f132ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: build_initial_monmap 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:42:32.585+0000 7f14452779c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: monmap: 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.936 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding auth protocol: cephx 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding auth protocol: cephx 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding auth protocol: cephx 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.937 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:42:32.585+0000 7f144257c640 10 monclient: get_auth_request con 0x7f131c070a20 auth_method 0 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:42:32.585+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: init 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding auth protocol: cephx 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding auth protocol: cephx 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding auth protocol: cephx 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:32.938 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:42:32.585+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:42:32.585+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdc5f22628 EEXIST 2024-09-12T00:42:32.939 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-c con 0x5639359637e0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-a con 0x563935964940 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-b con 0x56393595b120 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): authenticate will time out at 2941.087817s 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient(hunting): get_auth_request con 0x563935964940 auth_method 0 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.940 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:42:32.585+0000 7f144257c640 10 monclient(hunting): get_auth_request con 0x5639359637e0 auth_method 0 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:42:32.585+0000 7f144257c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:42:32.585+0000 7f144257c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:42:32.585+0000 7f144257c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:42:32.589+0000 7f1442d7d640 10 monclient(hunting): get_auth_request con 0x56393595b120 auth_method 0 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:42:32.589+0000 7f1442d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.941 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:42:32.589+0000 7f1442d7d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:42:32.589+0000 7f1442d7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_done global_id 8277 payload 274 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:42:32.589+0000 7f144357e640 1 monclient: found mon.noname-a 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: dump: 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.942 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 monclient: authenticate success, global_id 8277 2024-09-12T00:42:32.943 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:42:32.589+0000 7f14452779c0 4 set_mon_vals no callback set 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: dump: 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.944 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: shutdown 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: build_initial_monmap 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: monmap: 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:32.945 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding auth protocol: cephx 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding auth protocol: cephx 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding auth protocol: cephx 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:32.946 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:42:32.589+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 librados: starting msgr at 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 librados: starting objecter 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5639359140b0 EEXIST 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 librados: setting wanted keys 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 librados: calling monclient init 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: init 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding auth protocol: cephx 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding auth protocol: cephx 2024-09-12T00:42:32.947 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding auth protocol: cephx 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:32.948 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:42:32.589+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:42:32.589+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command rotate-key cmddesc rotate-key hook 0x5639359178a8 EEXIST 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-c con 0x56393595b120 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-a con 0x5639359637e0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-b con 0x563935964940 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): authenticate will time out at 2941.090515s 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): get_auth_request con 0x5639359637e0 auth_method 0 2024-09-12T00:42:32.949 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): get_auth_request con 0x56393595b120 auth_method 0 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_done global_id 8280 payload 824 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:32.950 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:42:32.589+0000 7f144357e640 1 monclient: found mon.noname-a 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: dump: 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.951 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: _finish_auth 0 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: dump: 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.952 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:42:32.589+0000 7f13267fc640 4 set_mon_vals no callback set 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 monclient: authenticate success, global_id 8280 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 librados: init done 2024-09-12T00:42:32.953 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command cr dump hook 0x5639359593d8 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:42:32.593+0000 7f1324ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:42:32.593+0000 7f1324ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:42:32.593+0000 7f1324ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:42:32.593+0000 7f1442d7d640 10 monclient: get_auth_request con 0x563935982610 auth_method 0 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:42:32.593+0000 7f144257c640 10 monclient: get_auth_request con 0x7f130c070b10 auth_method 0 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 realm 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:42:32.593+0000 7f14452779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.954 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:42:32.593+0000 7f144257c640 10 monclient: get_auth_request con 0x563935986790 auth_method 0 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:42:32.597+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:42:32.597+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:42:32.597+0000 7f144357e640 10 monclient: get_auth_request con 0x563935989fd0 auth_method 0 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:42:32.597+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:42:32.597+0000 7f14452779c0 20 searching for the correct realm 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:42:32.597+0000 7f1442d7d640 10 monclient: get_auth_request con 0x56393598ed50 auth_method 0 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:42:32.601+0000 7f144257c640 10 monclient: get_auth_request con 0x7f143c001800 auth_method 0 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:42:32.601+0000 7f144357e640 10 monclient: get_auth_request con 0x7f142c103040 auth_method 0 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:42:32.601+0000 7f144357e640 0 -- 172.21.15.102:0/1553805566 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f142c103040 msgr2=0x7f142c0ffa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:42:32.601+0000 7f1324ff9640 1 client.8280.objecter ms_handle_reset 0x7f142c103040 session 0x7f142c118040 osd.4 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:42:32.601+0000 7f1324ff9640 10 monclient: _renew_subs 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:42:32.601+0000 7f1324ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:32.955 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:42:32.601+0000 7f144357e640 10 monclient: get_auth_request con 0x7f130c081230 auth_method 0 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:42:32.605+0000 7f1442d7d640 10 monclient: get_auth_request con 0x7f143c095b60 auth_method 0 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:42:32.609+0000 7f144257c640 0 -- 172.21.15.102:0/1553805566 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f143c080bf0 msgr2=0x7f143c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:42:32.609+0000 7f144257c640 10 monclient: get_auth_request con 0x7f143c080bf0 auth_method 0 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:42:32.813+0000 7f144257c640 10 monclient: get_auth_request con 0x7f143c080bf0 auth_method 0 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.956 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 zone default found 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:42:32.829+0000 7f14452779c0 4 Realm: () 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:42:32.829+0000 7f14452779c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:42:32.829+0000 7f14452779c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:42:32.829+0000 7f14452779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 zonegroup default 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.957 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:42:32.833+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:42:32.833+0000 7f14452779c0 20 started sync module instance, tier type = 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:42:32.833+0000 7f14452779c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=0 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=1 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=2 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=3 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=4 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=5 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=6 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:42:32.857+0000 7f14452779c0 20 add_watcher() i=7 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:42:32.857+0000 7f14452779c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding auth protocol: cephx 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding auth protocol: cephx 2024-09-12T00:42:32.958 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding auth protocol: cephx 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:42:32.861+0000 7f12f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:32.959 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:42:32.861+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:42:32.861+0000 7f14452779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:42:32.861+0000 7f14452779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command cache list hook 0x563935958f40 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command cache inspect hook 0x563935958f40 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command cache erase hook 0x563935958f40 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command cache zap hook 0x563935958f40 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 note: GC not initialized 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:42:32.861+0000 7f1273fff640 20 reqs_thread_entry: start 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:42:32.865+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command sync trace show hook 0x7f1434005600 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:42:32.865+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command sync trace history hook 0x7f1434005600 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:42:32.865+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command sync trace active hook 0x7f1434005600 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:42:32.865+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command sync trace active_short hook 0x7f1434005600 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:32.960 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 Filter name: none 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:42:32.865+0000 7f1271ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:32.961 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:42:32.869+0000 7f14452779c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:42:32.885+0000 7f14452779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:42:32.885+0000 7f14452779c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:42:32.885+0000 7f14452779c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:42:32.885+0000 7f14452779c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398944 cookie 94803712367824 notifier 8280 bl.length()=911 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:42:32.962 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:42:32.897+0000 7f14452779c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14452779c0 time 2024-09-12T00:42:32.897584+0000 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1448b512eb] 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1448b5149f] 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56393356acc1] 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422aac) [0x563933fc8aac] 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56393357fced] 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14479b7d90] 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.963 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:42:32.897+0000 7f14452779c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f14452779c0 thread_name:radosgw-admin 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f14479d0520] 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1448b51345] 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1448b5149f] 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56393356acc1] 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422aac) [0x563933fc8aac] 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56393357fced] 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:42:32.964 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14479b7d90] 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:42:32.965 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:42:32.966 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:42:32.967 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:42:32.968 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:42:32.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:42:32.969 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:42:32.973 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:32.974 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:32.975 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1271ffb640 / http_manager 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1273fff640 / http_manager 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f12f97e2640 / rgw_dt_lg_renew 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1324ff9640 / ms_dispatch 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f13267fc640 / io_context_pool 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f132ce01640 / ms_dispatch 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f132f606640 / ms_dispatch 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1330e09640 / io_context_pool 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f144257c640 / msgr-worker-2 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1442d7d640 / msgr-worker-1 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f144357e640 / msgr-worker-0 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1443d7f640 / io_context_pool 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: 7f14452779c0 / radosgw-admin 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:42:32.976 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.146605.log 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:42:32.569+0000 7f144357e640 1 monclient: found mon.noname-c 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:42:32.569+0000 7f144357e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: dump: 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.977 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: _finish_auth 0 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: _check_auth_tickets 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:42:32.569+0000 7f1330e09640 10 monclient: dump: 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.978 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:42:32.569+0000 7f14452779c0 5 monclient: authenticate success, global_id 7736 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:42:32.569+0000 7f14452779c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:42:32.569+0000 7f14452779c0 4 set_mon_vals no callback set 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:42:32.569+0000 7f14452779c0 10 monclient: shutdown 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:42:32.569+0000 7f14452779c0 5 asok(0x56393568b2b0) unregister_commands rotate-key 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: build_initial_monmap 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: monmap: 2024-09-12T00:42:32.979 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding auth protocol: cephx 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding auth protocol: cephx 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding auth protocol: cephx 2024-09-12T00:42:32.980 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: crc 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935898880) adding con mode: secure 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:42:32.573+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.981 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 librados: starting msgr at 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 librados: starting objecter 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command objecter_requests hook 0x5639356b3e50 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 librados: setting wanted keys 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 librados: calling monclient init 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: init 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding auth protocol: cephx 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding auth protocol: cephx 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding auth protocol: cephx 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.982 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: crc 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 AuthRegistry(0x563935896a90) adding con mode: secure 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:42:32.573+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:42:32.573+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command rotate-key hook 0x563935896bd8 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-a con 0x563935751930 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-c con 0x5639357dfab0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:32.983 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-b con 0x5639358999f0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient(hunting): authenticate will time out at 2941.073238s 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): get_auth_request con 0x5639357dfab0 auth_method 0 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): get_auth_request con 0x563935751930 auth_method 0 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.984 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:42:32.573+0000 7f1442d7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient: _finish_hunting 0 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:42:32.573+0000 7f144257c640 1 monclient: found mon.noname-c 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:42:32.573+0000 7f144257c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: dump: 2024-09-12T00:42:32.985 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: _finish_auth 0 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: _check_auth_tickets 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.986 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:42:32.573+0000 7f132f606640 10 monclient: dump: 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:42:32.573+0000 7f1330e09640 4 set_mon_vals no callback set 2024-09-12T00:42:32.987 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:42:32.573+0000 7f14452779c0 5 monclient: authenticate success, global_id 7739 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:42:32.573+0000 7f14452779c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:42:32.573+0000 7f14452779c0 1 librados: init done 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:42:32.577+0000 7f132f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:42:32.577+0000 7f132f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:42:32.577+0000 7f132f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:42:32.577+0000 7f1442d7d640 10 monclient: get_auth_request con 0x7f1328070ae0 auth_method 0 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:42:32.577+0000 7f144357e640 10 monclient: get_auth_request con 0x5639358d8190 auth_method 0 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:42:32.577+0000 7f1442d7d640 10 monclient: get_auth_request con 0x5639358e1960 auth_method 0 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:42:32.577+0000 7f144257c640 10 monclient: get_auth_request con 0x5639358e5ba0 auth_method 0 2024-09-12T00:42:32.988 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient: get_auth_request con 0x5639358ea040 auth_method 0 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient: build_initial_monmap 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:42:32.581+0000 7f14452779c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient: monmap: 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.989 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding auth protocol: cephx 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding auth protocol: cephx 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding auth protocol: cephx 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.990 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: crc 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358eddd0) adding con mode: secure 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:42:32.581+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5639358f1790 EEXIST 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient: init 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding auth protocol: cephx 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding auth protocol: cephx 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding auth protocol: cephx 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.991 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: crc 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 AuthRegistry(0x5639358ecd88) adding con mode: secure 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:42:32.581+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:42:32.581+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:42:32.581+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command rotate-key cmddesc rotate-key hook 0x5639358eced0 EEXIST 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-a con 0x563935915940 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:32.992 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-c con 0x563935915270 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-b con 0x563935913c50 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:42:32.581+0000 7f14452779c0 10 monclient(hunting): authenticate will time out at 2941.083562s 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): get_auth_request con 0x563935915270 auth_method 0 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): get_auth_request con 0x563935915940 auth_method 0 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.993 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:42:32.581+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:42:32.581+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:42:32.581+0000 7f1442d7d640 10 monclient(hunting): get_auth_request con 0x563935913c50 auth_method 0 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:42:32.581+0000 7f1442d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:42:32.581+0000 7f1442d7d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:42:32.581+0000 7f1442d7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient(hunting): handle_auth_done global_id 7742 payload 824 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:42:32.585+0000 7f144357e640 1 monclient: found mon.noname-c 2024-09-12T00:42:32.994 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: dump: 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.995 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: _finish_auth 0 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:42:32.585+0000 7f132ce01640 10 monclient: dump: 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:32.996 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:32.997 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.997 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 monclient: authenticate success, global_id 7742 2024-09-12T00:42:32.997 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:32.997 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:42:32.585+0000 7f1443d7f640 4 set_mon_vals no callback set 2024-09-12T00:42:32.997 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.997 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:32.997 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:42:32.997 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:42:32.585+0000 7f132ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:32.997 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:42:32.585+0000 7f132ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:32.997 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:42:32.585+0000 7f132ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: get_monmap_and_config 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: build_initial_monmap 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:42:32.585+0000 7f14452779c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: monmap: 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:32.998 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding auth protocol: cephx 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding auth protocol: cephx 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding auth protocol: cephx 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:32.999 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: crc 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x5639359350f0) adding con mode: secure 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:42:32.585+0000 7f144257c640 10 monclient: get_auth_request con 0x7f131c070a20 auth_method 0 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:42:32.585+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: init 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding auth protocol: cephx 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding auth protocol: cephx 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding auth protocol: cephx 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:33.000 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: crc 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f224e0) adding con mode: secure 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:42:32.585+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:42:32.585+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:42:32.585+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdc5f22628 EEXIST 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-c con 0x5639359637e0 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-a con 0x563935964940 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-b con 0x56393595b120 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:33.001 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:42:32.585+0000 7f14452779c0 10 monclient(hunting): authenticate will time out at 2941.087817s 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient(hunting): get_auth_request con 0x563935964940 auth_method 0 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:42:32.585+0000 7f144357e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:42:32.585+0000 7f144257c640 10 monclient(hunting): get_auth_request con 0x5639359637e0 auth_method 0 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:42:32.585+0000 7f144257c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:42:32.585+0000 7f144257c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:42:32.585+0000 7f144257c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:33.002 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:42:32.589+0000 7f1442d7d640 10 monclient(hunting): get_auth_request con 0x56393595b120 auth_method 0 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:42:32.589+0000 7f1442d7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:42:32.589+0000 7f1442d7d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:42:32.589+0000 7f1442d7d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_done global_id 8277 payload 274 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:42:32.589+0000 7f144357e640 1 monclient: found mon.noname-a 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:33.003 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: dump: 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: _finish_auth 0 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: _check_auth_tickets 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:33.004 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 monclient: authenticate success, global_id 8277 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: get_monmap_and_config success 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:42:32.589+0000 7f14452779c0 4 set_mon_vals no callback set 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:42:32.589+0000 7f13267fc640 10 monclient: dump: 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:33.005 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: shutdown 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: build_initial_monmap 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 build_initial for_mkfs: 0 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: monmap: 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:42:33.006 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding auth protocol: cephx 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding auth protocol: cephx 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding auth protocol: cephx 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:33.007 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: crc 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x56393595b650) adding con mode: secure 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:42:32.589+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 librados: starting msgr at 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 librados: starting objecter 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5639359140b0 EEXIST 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 librados: setting wanted keys 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 librados: calling monclient init 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: init 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding auth protocol: cephx 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding auth protocol: cephx 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding auth protocol: cephx 2024-09-12T00:42:33.008 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: crc 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 AuthRegistry(0x563935917760) adding con mode: secure 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:42:32.589+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:33.009 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:42:32.589+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command rotate-key cmddesc rotate-key hook 0x5639359178a8 EEXIST 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _reopen_session rank -1 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-c con 0x56393595b120 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-a con 0x5639359637e0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): picked mon.noname-b con 0x563935964940 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): _renew_subs 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient(hunting): authenticate will time out at 2941.090515s 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): get_auth_request con 0x5639359637e0 auth_method 0 2024-09-12T00:42:33.010 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): get_auth_request con 0x56393595b120 auth_method 0 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:42:32.589+0000 7f144257c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient(hunting): handle_auth_done global_id 8280 payload 824 2024-09-12T00:42:33.011 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient: _finish_hunting 0 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:42:32.589+0000 7f144357e640 1 monclient: found mon.noname-a 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:42:32.589+0000 7f144357e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.102:3300/0 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: dump: 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:33.012 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: _finish_auth 0 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:42:32.589+0000 7f1324ff9640 10 monclient: dump: 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:42:33.013 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:42:32.589+0000 7f13267fc640 4 set_mon_vals no callback set 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 monclient: authenticate success, global_id 8280 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _renew_subs 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:42:32.589+0000 7f14452779c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:42:32.589+0000 7f14452779c0 1 librados: init done 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:42:32.589+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command cr dump hook 0x5639359593d8 2024-09-12T00:42:33.014 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:42:32.593+0000 7f1324ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:42:32.593+0000 7f1324ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:42:32.593+0000 7f1324ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:42:32.593+0000 7f1442d7d640 10 monclient: get_auth_request con 0x563935982610 auth_method 0 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:42:32.593+0000 7f144257c640 10 monclient: get_auth_request con 0x7f130c070b10 auth_method 0 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 realm 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:42:32.593+0000 7f14452779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:42:32.593+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:42:32.593+0000 7f144257c640 10 monclient: get_auth_request con 0x563935986790 auth_method 0 2024-09-12T00:42:33.015 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:42:32.597+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:42:32.597+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:42:32.597+0000 7f144357e640 10 monclient: get_auth_request con 0x563935989fd0 auth_method 0 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:42:32.597+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:42:32.597+0000 7f14452779c0 20 searching for the correct realm 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:42:32.597+0000 7f1442d7d640 10 monclient: get_auth_request con 0x56393598ed50 auth_method 0 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:42:32.601+0000 7f144257c640 10 monclient: get_auth_request con 0x7f143c001800 auth_method 0 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:42:32.601+0000 7f144357e640 10 monclient: get_auth_request con 0x7f142c103040 auth_method 0 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:42:32.601+0000 7f144357e640 0 -- 172.21.15.102:0/1553805566 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f142c103040 msgr2=0x7f142c0ffa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:42:32.601+0000 7f1324ff9640 1 client.8280.objecter ms_handle_reset 0x7f142c103040 session 0x7f142c118040 osd.4 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:42:32.601+0000 7f1324ff9640 10 monclient: _renew_subs 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:42:32.601+0000 7f1324ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.102:3300/0 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:42:32.601+0000 7f144357e640 10 monclient: get_auth_request con 0x7f130c081230 auth_method 0 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:42:32.605+0000 7f1442d7d640 10 monclient: get_auth_request con 0x7f143c095b60 auth_method 0 2024-09-12T00:42:33.016 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:42:32.609+0000 7f144257c640 0 -- 172.21.15.102:0/1553805566 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f143c080bf0 msgr2=0x7f143c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:42:32.609+0000 7f144257c640 10 monclient: get_auth_request con 0x7f143c080bf0 auth_method 0 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:42:32.813+0000 7f144257c640 10 monclient: get_auth_request con 0x7f143c080bf0 auth_method 0 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:42:32.825+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.017 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 zone default found 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:42:32.829+0000 7f14452779c0 4 Realm: () 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:42:32.829+0000 7f14452779c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:42:32.829+0000 7f14452779c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:42:32.829+0000 7f14452779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 zonegroup default 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:42:32.829+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:42:32.833+0000 7f14452779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:42:32.833+0000 7f14452779c0 20 started sync module instance, tier type = 2024-09-12T00:42:33.018 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:42:32.833+0000 7f14452779c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=0 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=1 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=2 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=3 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=4 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=5 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:42:32.853+0000 7f14452779c0 20 add_watcher() i=6 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:42:32.857+0000 7f14452779c0 20 add_watcher() i=7 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:42:32.857+0000 7f14452779c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding auth protocol: cephx 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding auth protocol: cephx 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding auth protocol: cephx 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:33.019 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: crc 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:42:32.861+0000 7f12f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 AuthRegistry(0x7ffdc5f229c0) adding con mode: secure 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:42:32.861+0000 7f14452779c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:42:32.861+0000 7f14452779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:42:32.861+0000 7f14452779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:33.020 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command cache list hook 0x563935958f40 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command cache inspect hook 0x563935958f40 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command cache erase hook 0x563935958f40 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command cache zap hook 0x563935958f40 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:42:32.861+0000 7f14452779c0 5 note: GC not initialized 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:42:32.861+0000 7f1273fff640 20 reqs_thread_entry: start 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:42:32.865+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command sync trace show hook 0x7f1434005600 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:42:32.865+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command sync trace history hook 0x7f1434005600 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:42:32.865+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command sync trace active hook 0x7f1434005600 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:42:32.865+0000 7f14452779c0 5 asok(0x56393568b2b0) register_command sync trace active_short hook 0x7f1434005600 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 Filter name: none 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:42:32.865+0000 7f1271ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:33.021 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:42:32.865+0000 7f14452779c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:42:32.865+0000 7f14452779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:42:32.869+0000 7f14452779c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:42:32.885+0000 7f14452779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:33.022 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:42:32.885+0000 7f14452779c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:42:32.885+0000 7f14452779c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:42:32.885+0000 7f14452779c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398944 cookie 94803712367824 notifier 8280 bl.length()=911 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:42:32.885+0000 7f13267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:42:32.889+0000 7f14452779c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:42:32.897+0000 7f14452779c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f14452779c0 time 2024-09-12T00:42:32.897584+0000 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:33.023 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1448b512eb] 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1448b5149f] 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56393356acc1] 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 4: radosgw-admin(+0x1422aac) [0x563933fc8aac] 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56393357fced] 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 6: main() 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14479b7d90] 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 8: __libc_start_main() 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 9: _start() 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:42:32.897+0000 7f14452779c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7f14452779c0 thread_name:radosgw-admin 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:33.024 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f14479d0520] 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1448b51345] 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1448b5149f] 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56393356acc1] 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 8: radosgw-admin(+0x1422aac) [0x563933fc8aac] 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56393357fced] 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 10: main() 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14479b7d90] 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 12: __libc_start_main() 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: 13: _start() 2024-09-12T00:42:33.025 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:42:33.026 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:42:33.027 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:42:33.028 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:42:33.029 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:42:33.030 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:42:33.031 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1271ffb640 / http_manager 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1273fff640 / http_manager 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 7f12f97e2640 / rgw_dt_lg_renew 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1324ff9640 / ms_dispatch 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 7f13267fc640 / io_context_pool 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 7f132ce01640 / ms_dispatch 2024-09-12T00:42:33.032 INFO:tasks.workunit.client.0.smithi102.stderr: 7f132f606640 / ms_dispatch 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1330e09640 / io_context_pool 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr: 7f144257c640 / msgr-worker-2 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1442d7d640 / msgr-worker-1 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr: 7f144357e640 / msgr-worker-0 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr: 7f1443d7f640 / io_context_pool 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr: 7f14452779c0 / radosgw-admin 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:42:32.900145Z_19c4adce-8982-4484-b074-398499698704/log 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:42:33.033 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:42:33.035 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:33.035 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:33.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.985+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.985+0000 7f79d802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.985+0000 7f79d802e9c0 20 realm 2024-09-12T00:42:33.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.985+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.985+0000 7f79d802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.985+0000 7f79d802e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:33.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.985+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.985+0000 7f79d802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.985+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.989+0000 7f79d802e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:33.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.989+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.989+0000 7f79d802e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:33.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.989+0000 7f79d802e9c0 20 searching for the correct realm 2024-09-12T00:42:33.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:32.989+0000 7f79d5333640 0 -- 172.21.15.102:0/1040916229 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f79d0018040 msgr2=0x7f79d003c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:33.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.201+0000 7f79d6335640 0 -- 172.21.15.102:0/1040916229 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55c96ea675f0 msgr2=0x55c96ea69a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:33.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.217+0000 7f79d802e9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:42:33.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.217+0000 7f79d802e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:33.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.217+0000 7f79d802e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:33.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.217+0000 7f79d802e9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:42:33.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.217+0000 7f79d802e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:33.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.217+0000 7f79d802e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:33.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.217+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.217+0000 7f79d802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.217+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:33.218 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:33.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 zone default found 2024-09-12T00:42:33.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 4 Realm: () 2024-09-12T00:42:33.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:42:33.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:42:33.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:33.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 zonegroup default 2024-09-12T00:42:33.219 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.220 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:33.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 started sync module instance, tier type = 2024-09-12T00:42:33.221 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.221+0000 7f79d802e9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:42:33.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.245+0000 7f79d802e9c0 20 add_watcher() i=0 2024-09-12T00:42:33.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.245+0000 7f79d802e9c0 20 add_watcher() i=1 2024-09-12T00:42:33.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.245+0000 7f79d802e9c0 20 add_watcher() i=2 2024-09-12T00:42:33.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.245+0000 7f79d802e9c0 20 add_watcher() i=3 2024-09-12T00:42:33.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.245+0000 7f79d802e9c0 20 add_watcher() i=4 2024-09-12T00:42:33.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.245+0000 7f79d802e9c0 20 add_watcher() i=5 2024-09-12T00:42:33.243 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.245+0000 7f79d802e9c0 20 add_watcher() i=6 2024-09-12T00:42:33.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.245+0000 7f79d802e9c0 20 add_watcher() i=7 2024-09-12T00:42:33.245 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.245+0000 7f79d802e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:33.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.249+0000 7f78877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:33.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:33.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:33.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 5 note: GC not initialized 2024-09-12T00:42:33.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f78867fc640 20 reqs_thread_entry: start 2024-09-12T00:42:33.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:33.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 20 Filter name: none 2024-09-12T00:42:33.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f77f7fff640 20 reqs_thread_entry: start 2024-09-12T00:42:33.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:42:33.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:42:33.252 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:42:33.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:42:33.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:42:33.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:33.253 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:42:33.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:42:33.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:42:33.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:42:33.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.253+0000 7f79d802e9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:42:33.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:42:33.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:42:33.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:42:33.254 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:42:33.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:42:33.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:42:33.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:42:33.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:42:33.255 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:42:33.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:42:33.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.257+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:42:33.257 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:42:33.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:42:33.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:42:33.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:42:33.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:42:33.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:42:33.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:42:33.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:42:33.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:42:33.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:42:33.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:42:33.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.261+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:42:33.261 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.265+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:42:33.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.265+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:42:33.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.265+0000 7f79d802e9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:42:33.263 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.265+0000 7f79d802e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:42:33.265 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.265+0000 7f78877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:33.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.273+0000 7f79d802e9c0 20 remove_watcher() i=0 2024-09-12T00:42:33.269 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.273+0000 7f79d802e9c0 2 removed watcher, disabling cache 2024-09-12T00:42:33.271 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.273+0000 7f79d802e9c0 20 remove_watcher() i=1 2024-09-12T00:42:33.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.277+0000 7f79d802e9c0 20 remove_watcher() i=2 2024-09-12T00:42:33.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.277+0000 7f79d802e9c0 20 remove_watcher() i=3 2024-09-12T00:42:33.277 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.281+0000 7f79d802e9c0 20 remove_watcher() i=4 2024-09-12T00:42:33.279 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.281+0000 7f79d802e9c0 20 remove_watcher() i=5 2024-09-12T00:42:33.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.281+0000 7f79d802e9c0 20 remove_watcher() i=6 2024-09-12T00:42:33.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:42:33.285+0000 7f79d802e9c0 20 remove_watcher() i=7 2024-09-12T00:42:33.299 INFO:tasks.workunit.client.0.smithi102.stderr: test: duplicated entries can be purged manually 2024-09-12T00:43:03.331 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:43:03.366 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:03.366 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:03.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.412+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.416+0000 7fa26a2009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.416+0000 7fa26a2009c0 20 realm 2024-09-12T00:43:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.416+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.416+0000 7fa26a2009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.416+0000 7fa26a2009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.416+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.416+0000 7fa26a2009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:03.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.416+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.416+0000 7fa26a2009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:03.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.416+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.420+0000 7fa26a2009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:03.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.420+0000 7fa26a2009c0 20 searching for the correct realm 2024-09-12T00:43:03.421 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.424+0000 7fa268507640 0 -- 172.21.15.102:0/3132407198 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fa25c114bb0 msgr2=0x7fa25c132a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:03.640 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.640+0000 7fa267505640 0 -- 172.21.15.102:0/3132407198 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fa26005e920 msgr2=0x7fa26001c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:03.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:03.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:03.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:03.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:03.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:03.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:03.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:03.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:03.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:03.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 zone default found 2024-09-12T00:43:03.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 4 Realm: () 2024-09-12T00:43:03.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:03.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:03.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:03.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 zonegroup default 2024-09-12T00:43:03.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:03.862 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.860+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.864+0000 7fa26a2009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:03.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.864+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.864+0000 7fa26a2009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:03.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.864+0000 7fa26a2009c0 20 started sync module instance, tier type = 2024-09-12T00:43:03.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.864+0000 7fa26a2009c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:03.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.888+0000 7fa26a2009c0 20 add_watcher() i=0 2024-09-12T00:43:03.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.888+0000 7fa26a2009c0 20 add_watcher() i=1 2024-09-12T00:43:03.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.888+0000 7fa26a2009c0 20 add_watcher() i=2 2024-09-12T00:43:03.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.888+0000 7fa26a2009c0 20 add_watcher() i=3 2024-09-12T00:43:03.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.888+0000 7fa26a2009c0 20 add_watcher() i=4 2024-09-12T00:43:03.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.888+0000 7fa26a2009c0 20 add_watcher() i=5 2024-09-12T00:43:03.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.888+0000 7fa26a2009c0 20 add_watcher() i=6 2024-09-12T00:43:03.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.888+0000 7fa26a2009c0 20 add_watcher() i=7 2024-09-12T00:43:03.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.888+0000 7fa26a2009c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:03.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.892+0000 7fa11dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:03.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:03.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:03.894 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 5 note: GC not initialized 2024-09-12T00:43:03.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa11cfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:03.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:03.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 Filter name: none 2024-09-12T00:43:03.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa0967fc640 20 reqs_thread_entry: start 2024-09-12T00:43:03.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:03.896 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:43:03.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:03.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.896+0000 7fa26a2009c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:03.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.900+0000 7fa26a2009c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:03.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.900+0000 7fa26a2009c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:43:03.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.900+0000 7fa26a2009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:03.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.900+0000 7fa11dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:03.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.908+0000 7fa26a2009c0 20 remove_watcher() i=0 2024-09-12T00:43:03.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.908+0000 7fa26a2009c0 2 removed watcher, disabling cache 2024-09-12T00:43:03.908 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.908+0000 7fa26a2009c0 20 remove_watcher() i=1 2024-09-12T00:43:03.911 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.912+0000 7fa26a2009c0 20 remove_watcher() i=2 2024-09-12T00:43:03.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.912+0000 7fa26a2009c0 20 remove_watcher() i=3 2024-09-12T00:43:03.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.916+0000 7fa26a2009c0 20 remove_watcher() i=4 2024-09-12T00:43:03.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.916+0000 7fa26a2009c0 20 remove_watcher() i=5 2024-09-12T00:43:03.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.916+0000 7fa26a2009c0 20 remove_watcher() i=6 2024-09-12T00:43:03.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:03.920+0000 7fa26a2009c0 20 remove_watcher() i=7 2024-09-12T00:43:03.933 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:03.933 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:43:03.933 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: a-bucket id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T00:43:03.933 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:03.934 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:43:03.966 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:03.966 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:04.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 realm 2024-09-12T00:43:04.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.012+0000 7fabcd8879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:04.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:04.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:04.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 searching for the correct realm 2024-09-12T00:43:04.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.020+0000 7fabcbb8e640 0 -- 172.21.15.102:0/1950933284 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fabc001e050 msgr2=0x7fabc00620c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:04.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.028+0000 7fabcab8c640 0 -- 172.21.15.102:0/1950933284 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fabc4004020 msgr2=0x7fabc40fc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:04.246 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:04.246 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:04.246 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:04.246 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:04.246 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:04.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:04.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.247 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:04.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.248 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:04.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 zone default found 2024-09-12T00:43:04.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 4 Realm: () 2024-09-12T00:43:04.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:04.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:04.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:04.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 zonegroup default 2024-09-12T00:43:04.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.249 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.250 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 started sync module instance, tier type = 2024-09-12T00:43:04.251 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:04.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=0 2024-09-12T00:43:04.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=1 2024-09-12T00:43:04.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=2 2024-09-12T00:43:04.274 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=3 2024-09-12T00:43:04.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=4 2024-09-12T00:43:04.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=5 2024-09-12T00:43:04.275 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=6 2024-09-12T00:43:04.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.276+0000 7fabcd8879c0 20 add_watcher() i=7 2024-09-12T00:43:04.276 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.276+0000 7fabcd8879c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:04.280 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.280+0000 7faa81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:04.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.280+0000 7fabcd8879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:04.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.280+0000 7fabcd8879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:04.281 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 note: GC not initialized 2024-09-12T00:43:04.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.280+0000 7faa80fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:04.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.280+0000 7fabcd8879c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:04.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 Filter name: none 2024-09-12T00:43:04.282 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fa9fa7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:04.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:43:04.283 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.284 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:04.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:43:04.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:43:04.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:43:04.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:43:04.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:04.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:04.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:04.285 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:04.286 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:43:04.287 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.288+0000 7fabcd8879c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:43:04.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:04.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:04.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:04.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:43:04.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398945 cookie 93836825888912 notifier 7796 bl.length()=911 2024-09-12T00:43:04.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:04.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:04.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:04.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:43:04.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:43:04.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:43:04.307 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:43:04.318 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fabcd8879c0 time 2024-09-12T00:43:04.322347+0000 2024-09-12T00:43:04.318 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:04.319 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:04.319 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fabd11612eb] 2024-09-12T00:43:04.319 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabd116149f] 2024-09-12T00:43:04.319 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555815298cc1] 2024-09-12T00:43:04.319 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5558152add5a] 2024-09-12T00:43:04.319 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:43:04.319 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabcffc7d90] 2024-09-12T00:43:04.319 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:43:04.319 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.320+0000 7fabcd8879c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fabcd8879c0 time 2024-09-12T00:43:04.322347+0000 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fabd11612eb] 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabd116149f] 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555815298cc1] 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5558152add5a] 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabcffc7d90] 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.320 INFO:tasks.workunit.client.0.smithi102.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:43:04.321 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fabcd8879c0 thread_name:radosgw-admin 2024-09-12T00:43:04.337 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fabcffe0520] 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fabd1161345] 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabd116149f] 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555815298cc1] 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5558152add5a] 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabcffc7d90] 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:43:04.338 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.320+0000 7fabcd8879c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fabcd8879c0 thread_name:radosgw-admin 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fabcffe0520] 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fabd1161345] 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabd116149f] 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555815298cc1] 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5558152add5a] 2024-09-12T00:43:04.339 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabcffc7d90] 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:43:03.988+0000 7fabcab8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:43:03.988+0000 7fabcab8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:43:03.988+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_done global_id 7784 payload 274 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:43:03.988+0000 7fabcbb8e640 10 monclient: _finish_hunting 0 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:43:03.988+0000 7fabcbb8e640 1 monclient: found mon.noname-c 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:43:03.988+0000 7fabcbb8e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.340 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: dump: 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: _finish_auth 0 2024-09-12T00:43:04.341 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: _check_auth_tickets 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: dump: 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.342 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 monclient: authenticate success, global_id 7784 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 4 set_mon_vals no callback set 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 10 monclient: shutdown 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) unregister_commands rotate-key 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 10 monclient: build_initial_monmap 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 10 monclient: monmap: 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:43:04.343 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding auth protocol: cephx 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding auth protocol: cephx 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding auth protocol: cephx 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.344 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 1 librados: starting msgr at 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 1 librados: starting objecter 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command objecter_requests hook 0x55581673a260 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 1 librados: setting wanted keys 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 1 librados: calling monclient init 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: init 2024-09-12T00:43:04.345 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding auth protocol: cephx 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding auth protocol: cephx 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding auth protocol: cephx 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.346 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command rotate-key hook 0x5558169c7508 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-a con 0x5558168782b0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-b con 0x555816883ba0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-c con 0x555816910090 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): authenticate will time out at 2972.493016s 2024-09-12T00:43:04.347 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request con 0x555816910090 auth_method 0 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): get_auth_request con 0x5558168782b0 auth_method 0 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.348 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient: _finish_hunting 0 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 1 monclient: found mon.noname-c 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: dump: 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.349 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: _finish_auth 0 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: _check_auth_tickets 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: dump: 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.350 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.351 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.351 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.351 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.351 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.351 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.351 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.351 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.351 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.351 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 monclient: authenticate success, global_id 7787 2024-09-12T00:43:04.351 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:43:03.992+0000 7faab960a640 4 set_mon_vals no callback set 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 1 librados: init done 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:43:03.992+0000 7faab7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:43:03.992+0000 7faab7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:43:03.992+0000 7faab7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:43:03.996+0000 7fabcb38d640 10 monclient: get_auth_request con 0x7faab0070ae0 auth_method 0 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:43:03.996+0000 7fabcab8c640 10 monclient: get_auth_request con 0x5558169f2b20 auth_method 0 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:43:03.996+0000 7fabcb38d640 10 monclient: get_auth_request con 0x555816856c00 auth_method 0 2024-09-12T00:43:04.352 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:43:03.996+0000 7fabcab8c640 10 monclient: get_auth_request con 0x555816a16cf0 auth_method 0 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:43:04.000+0000 7fabcbb8e640 10 monclient: get_auth_request con 0x555816a16270 auth_method 0 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient: build_initial_monmap 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient: monmap: 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:43:04.353 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.354 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding auth protocol: cephx 2024-09-12T00:43:04.354 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding auth protocol: cephx 2024-09-12T00:43:04.354 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding auth protocol: cephx 2024-09-12T00:43:04.354 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.354 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.354 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.354 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.354 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.354 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x555816a22780 EEXIST 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient: init 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding auth protocol: cephx 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding auth protocol: cephx 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding auth protocol: cephx 2024-09-12T00:43:04.355 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.356 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command rotate-key cmddesc rotate-key hook 0x555816a1ddb0 EEXIST 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-c con 0x555816a46930 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-b con 0x555816a46260 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-a con 0x555816a44c40 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): authenticate will time out at 2972.503599s 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): get_auth_request con 0x555816a46930 auth_method 0 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.357 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): get_auth_request con 0x555816a44c40 auth_method 0 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:43:04.000+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request con 0x555816a46260 auth_method 0 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:43:04.000+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.358 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:43:04.000+0000 7fabcbb8e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:43:04.000+0000 7fabcbb8e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:43:04.004+0000 7fabcab8c640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:43:04.004+0000 7fabcab8c640 10 monclient: _finish_hunting 0 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:43:04.004+0000 7fabcab8c640 1 monclient: found mon.noname-c 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:43:04.004+0000 7fabcab8c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: dump: 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.359 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: _finish_auth 0 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: _check_auth_tickets 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: dump: 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.360 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 monclient: authenticate success, global_id 7790 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:43:04.004+0000 7fabcc38f640 4 set_mon_vals no callback set 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:43:04.004+0000 7faab5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:04.361 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:43:04.004+0000 7faab5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:43:04.004+0000 7faab5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: get_monmap_and_config 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: build_initial_monmap 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: monmap: 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:43:04.362 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:43:04.004+0000 7fabcbb8e640 10 monclient: get_auth_request con 0x7faaa4070a20 auth_method 0 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding auth protocol: cephx 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding auth protocol: cephx 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding auth protocol: cephx 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.363 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: init 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding auth protocol: cephx 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding auth protocol: cephx 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding auth protocol: cephx 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.364 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd2aef5698 EEXIST 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:43:04.365 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-c con 0x555816a9a740 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-b con 0x555816a95b30 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-a con 0x555816a8c360 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): authenticate will time out at 2972.507893s 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): get_auth_request con 0x555816a9a740 auth_method 0 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): get_auth_request con 0x555816a8c360 auth_method 0 2024-09-12T00:43:04.366 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): handle_auth_done global_id 7793 payload 274 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient: _finish_hunting 0 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:43:04.008+0000 7fabcab8c640 1 monclient: found mon.noname-c 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.367 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: dump: 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: _finish_auth 0 2024-09-12T00:43:04.368 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: _check_auth_tickets 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 monclient: authenticate success, global_id 7793 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 4 set_mon_vals no callback set 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: dump: 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.369 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: shutdown 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: build_initial_monmap 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: monmap: 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.370 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding auth protocol: cephx 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding auth protocol: cephx 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding auth protocol: cephx 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.371 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 librados: starting msgr at 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 librados: starting objecter 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x555816a6bb70 EEXIST 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 librados: setting wanted keys 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 librados: calling monclient init 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: init 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding auth protocol: cephx 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding auth protocol: cephx 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding auth protocol: cephx 2024-09-12T00:43:04.372 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.373 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command rotate-key cmddesc rotate-key hook 0x555816a48898 EEXIST 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-b con 0x555816a8c360 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-c con 0x555816a95b30 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-a con 0x555816a9a740 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): authenticate will time out at 2972.510491s 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request con 0x555816a95b30 auth_method 0 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.374 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): get_auth_request con 0x555816a9a740 auth_method 0 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient: _finish_hunting 0 2024-09-12T00:43:04.375 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 1 monclient: found mon.noname-c 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: dump: 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.376 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: _finish_auth 0 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: dump: 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.377 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 monclient: authenticate success, global_id 7796 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:43:04.008+0000 7faaaeffd640 4 set_mon_vals no callback set 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 librados: init done 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command cr dump hook 0x555816a8b748 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:43:04.012+0000 7faaad7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:43:04.012+0000 7faaad7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.378 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:43:04.012+0000 7faaad7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:43:04.012+0000 7fabcab8c640 10 monclient: get_auth_request con 0x7faa94070b10 auth_method 0 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:43:04.012+0000 7fabcb38d640 10 monclient: get_auth_request con 0x555816ab4140 auth_method 0 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 realm 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:43:04.012+0000 7fabcab8c640 10 monclient: get_auth_request con 0x555816ab8390 auth_method 0 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.379 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:43:04.016+0000 7fabcbb8e640 10 monclient: get_auth_request con 0x555816abbbf0 auth_method 0 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 searching for the correct realm 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:43:04.016+0000 7fabcb38d640 10 monclient: get_auth_request con 0x555816ac0940 auth_method 0 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:43:04.016+0000 7fabcab8c640 10 monclient: get_auth_request con 0x7fabc40c9030 auth_method 0 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:43:04.020+0000 7fabcbb8e640 10 monclient: get_auth_request con 0x7fabc001e050 auth_method 0 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:43:04.020+0000 7fabcbb8e640 0 -- 172.21.15.102:0/1950933284 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fabc001e050 msgr2=0x7fabc00620c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:43:04.020+0000 7faaad7fa640 1 client.7796.objecter ms_handle_reset 0x7fabc001e050 session 0x7fabc0096040 osd.4 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:43:04.020+0000 7faaad7fa640 10 monclient: _renew_subs 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:43:04.020+0000 7faaad7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:43:04.020+0000 7fabcbb8e640 10 monclient: get_auth_request con 0x7faa940811b0 auth_method 0 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:43:04.024+0000 7fabcb38d640 10 monclient: get_auth_request con 0x7fabc40d7040 auth_method 0 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:43:04.028+0000 7fabcab8c640 10 monclient: get_auth_request con 0x7fabc4004020 auth_method 0 2024-09-12T00:43:04.380 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:43:04.028+0000 7fabcab8c640 0 -- 172.21.15.102:0/1950933284 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fabc4004020 msgr2=0x7fabc40fc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:43:04.232+0000 7fabcab8c640 10 monclient: get_auth_request con 0x7fabc4004020 auth_method 0 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:04.381 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 zone default found 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 4 Realm: () 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 zonegroup default 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 started sync module instance, tier type = 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=0 2024-09-12T00:43:04.382 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=1 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=2 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=3 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=4 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=5 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=6 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:43:04.276+0000 7fabcd8879c0 20 add_watcher() i=7 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:43:04.276+0000 7fabcd8879c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding auth protocol: cephx 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding auth protocol: cephx 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding auth protocol: cephx 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.383 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:43:04.280+0000 7faa81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:04.384 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command cache list hook 0x555816a8bf10 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command cache inspect hook 0x555816a8bf10 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command cache erase hook 0x555816a8bf10 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command cache zap hook 0x555816a8bf10 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 note: GC not initialized 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:43:04.280+0000 7faa80fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command sync trace show hook 0x7fabbc00e040 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command sync trace history hook 0x7fabbc00e040 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command sync trace active hook 0x7fabbc00e040 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command sync trace active_short hook 0x7fabbc00e040 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 Filter name: none 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:43:04.284+0000 7fa9fa7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:04.385 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:43:04.288+0000 7fabcd8879c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:43:04.386 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398945 cookie 93836825888912 notifier 7796 bl.length()=911 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:43:04.320+0000 7fabcd8879c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fabcd8879c0 time 2024-09-12T00:43:04.322347+0000 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:04.387 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fabd11612eb] 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabd116149f] 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555815298cc1] 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5558152add5a] 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabcffc7d90] 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:43:04.320+0000 7fabcd8879c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fabcd8879c0 thread_name:radosgw-admin 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.388 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fabcffe0520] 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fabd1161345] 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabd116149f] 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555815298cc1] 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5558152add5a] 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabcffc7d90] 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:43:04.389 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:43:04.390 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:43:04.391 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:43:04.392 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:43:04.393 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:43:04.394 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:43:04.395 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 7fa9fa7fc640 / http_manager 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 7faa80fe1640 / http_manager 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 7faa81fe3640 / rgw_dt_lg_renew 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 7faaad7fa640 / ms_dispatch 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 7faaaeffd640 / io_context_pool 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 7faab5602640 / ms_dispatch 2024-09-12T00:43:04.396 INFO:tasks.workunit.client.0.smithi102.stderr: 7faab7e07640 / ms_dispatch 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: 7faab960a640 / io_context_pool 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabcab8c640 / msgr-worker-2 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabcb38d640 / msgr-worker-1 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabcbb8e640 / msgr-worker-0 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabcc38f640 / io_context_pool 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabcd8879c0 / radosgw-admin 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/log/ceph/ceph-client.admin.148376.log 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr:--- begin dump of recent events --- 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: -499> 2024-09-12T00:43:03.988+0000 7fabcab8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: -498> 2024-09-12T00:43:03.988+0000 7fabcab8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.397 INFO:tasks.workunit.client.0.smithi102.stderr: -497> 2024-09-12T00:43:03.988+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_done global_id 7784 payload 274 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr: -496> 2024-09-12T00:43:03.988+0000 7fabcbb8e640 10 monclient: _finish_hunting 0 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr: -495> 2024-09-12T00:43:03.988+0000 7fabcbb8e640 1 monclient: found mon.noname-c 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr: -494> 2024-09-12T00:43:03.988+0000 7fabcbb8e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr: -493> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr: -492> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr: -491> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: dump: 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.398 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr: -490> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: _finish_auth 0 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr: -489> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: _check_auth_tickets 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr: -488> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr: -487> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr: -486> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr: -485> 2024-09-12T00:43:03.988+0000 7faab960a640 10 monclient: dump: 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.399 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr: -484> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 monclient: authenticate success, global_id 7784 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr: -483> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr: -482> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 4 set_mon_vals no callback set 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr: -481> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 10 monclient: shutdown 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr: -480> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) unregister_commands rotate-key 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr: -479> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 10 monclient: build_initial_monmap 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr: -478> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr: -477> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 10 monclient: monmap: 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:04.400 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr: -476> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding auth protocol: cephx 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr: -475> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding auth protocol: cephx 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr: -474> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding auth protocol: cephx 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr: -473> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr: -472> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr: -471> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.401 INFO:tasks.workunit.client.0.smithi102.stderr: -470> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -469> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -468> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -467> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -466> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -465> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -464> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -463> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: crc 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -462> 2024-09-12T00:43:03.988+0000 7fabcd8879c0 5 AuthRegistry(0x5558169ca4d0) adding con mode: secure 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -461> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -460> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 1 librados: starting msgr at 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -459> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 1 librados: starting objecter 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -458> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command objecter_requests hook 0x55581673a260 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -457> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 1 librados: setting wanted keys 2024-09-12T00:43:04.402 INFO:tasks.workunit.client.0.smithi102.stderr: -456> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 1 librados: calling monclient init 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -455> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: init 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -454> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding auth protocol: cephx 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -453> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding auth protocol: cephx 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -452> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding auth protocol: cephx 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -451> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -450> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -449> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -448> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -447> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -446> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -445> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -444> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -443> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.403 INFO:tasks.workunit.client.0.smithi102.stderr: -442> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -441> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: crc 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -440> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 AuthRegistry(0x5558169c73c0) adding con mode: secure 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -439> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -438> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -437> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command rotate-key hook 0x5558169c7508 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -436> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -435> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -434> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-a con 0x5558168782b0 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -433> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-b con 0x555816883ba0 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -432> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-c con 0x555816910090 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -431> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -430> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.404 INFO:tasks.workunit.client.0.smithi102.stderr: -429> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -428> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -427> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient(hunting): authenticate will time out at 2972.493016s 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -426> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request con 0x555816910090 auth_method 0 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -425> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -424> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -423> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -422> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): get_auth_request con 0x5558168782b0 auth_method 0 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -421> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -420> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -419> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -418> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -417> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -416> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.405 INFO:tasks.workunit.client.0.smithi102.stderr: -415> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr: -414> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr: -413> 2024-09-12T00:43:03.992+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr: -412> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr: -411> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient: _finish_hunting 0 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr: -410> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 1 monclient: found mon.noname-c 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr: -409> 2024-09-12T00:43:03.992+0000 7fabcbb8e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr: -408> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr: -407> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr: -406> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: dump: 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.406 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr: -405> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: _finish_auth 0 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr: -404> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: _check_auth_tickets 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr: -403> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr: -402> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr: -401> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr: -400> 2024-09-12T00:43:03.992+0000 7faab7e07640 10 monclient: dump: 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.407 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr: -399> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 5 monclient: authenticate success, global_id 7787 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr: -398> 2024-09-12T00:43:03.992+0000 7faab960a640 4 set_mon_vals no callback set 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr: -397> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr: -396> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr: -395> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr: -394> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr: -393> 2024-09-12T00:43:03.992+0000 7fabcd8879c0 1 librados: init done 2024-09-12T00:43:04.408 INFO:tasks.workunit.client.0.smithi102.stderr: -392> 2024-09-12T00:43:03.992+0000 7faab7e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr: -391> 2024-09-12T00:43:03.992+0000 7faab7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr: -390> 2024-09-12T00:43:03.992+0000 7faab7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr: -389> 2024-09-12T00:43:03.996+0000 7fabcb38d640 10 monclient: get_auth_request con 0x7faab0070ae0 auth_method 0 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr: -388> 2024-09-12T00:43:03.996+0000 7fabcab8c640 10 monclient: get_auth_request con 0x5558169f2b20 auth_method 0 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr: -387> 2024-09-12T00:43:03.996+0000 7fabcb38d640 10 monclient: get_auth_request con 0x555816856c00 auth_method 0 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr: -386> 2024-09-12T00:43:03.996+0000 7fabcab8c640 10 monclient: get_auth_request con 0x555816a16cf0 auth_method 0 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr: -385> 2024-09-12T00:43:04.000+0000 7fabcbb8e640 10 monclient: get_auth_request con 0x555816a16270 auth_method 0 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr: -384> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient: build_initial_monmap 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr: -383> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr: -382> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient: monmap: 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:43:04.409 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr: -381> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding auth protocol: cephx 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr: -380> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding auth protocol: cephx 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr: -379> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding auth protocol: cephx 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr: -378> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr: -377> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr: -376> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr: -375> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.410 INFO:tasks.workunit.client.0.smithi102.stderr: -374> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -373> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -372> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -371> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -370> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -369> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -368> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: crc 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -367> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1ed70) adding con mode: secure 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -366> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -365> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x555816a22780 EEXIST 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -364> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient: init 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -363> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding auth protocol: cephx 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -362> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding auth protocol: cephx 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -361> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding auth protocol: cephx 2024-09-12T00:43:04.411 INFO:tasks.workunit.client.0.smithi102.stderr: -360> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -359> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -358> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -357> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -356> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -355> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -354> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -353> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -352> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -351> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -350> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: crc 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -349> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 AuthRegistry(0x555816a1dc68) adding con mode: secure 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -348> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.412 INFO:tasks.workunit.client.0.smithi102.stderr: -347> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -346> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command rotate-key cmddesc rotate-key hook 0x555816a1ddb0 EEXIST 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -345> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -344> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -343> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-c con 0x555816a46930 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -342> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-b con 0x555816a46260 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -341> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-a con 0x555816a44c40 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -340> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -339> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -338> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -337> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -336> 2024-09-12T00:43:04.000+0000 7fabcd8879c0 10 monclient(hunting): authenticate will time out at 2972.503599s 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -335> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): get_auth_request con 0x555816a46930 auth_method 0 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -334> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.413 INFO:tasks.workunit.client.0.smithi102.stderr: -333> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -332> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -331> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): get_auth_request con 0x555816a44c40 auth_method 0 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -330> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -329> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -328> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -327> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -326> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -325> 2024-09-12T00:43:04.000+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -324> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -323> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -322> 2024-09-12T00:43:04.000+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -321> 2024-09-12T00:43:04.000+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request con 0x555816a46260 auth_method 0 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -320> 2024-09-12T00:43:04.000+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.414 INFO:tasks.workunit.client.0.smithi102.stderr: -319> 2024-09-12T00:43:04.000+0000 7fabcbb8e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr: -318> 2024-09-12T00:43:04.000+0000 7fabcbb8e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr: -317> 2024-09-12T00:43:04.004+0000 7fabcab8c640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr: -316> 2024-09-12T00:43:04.004+0000 7fabcab8c640 10 monclient: _finish_hunting 0 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr: -315> 2024-09-12T00:43:04.004+0000 7fabcab8c640 1 monclient: found mon.noname-c 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr: -314> 2024-09-12T00:43:04.004+0000 7fabcab8c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr: -313> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr: -312> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr: -311> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: dump: 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.415 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr: -310> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: _finish_auth 0 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr: -309> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: _check_auth_tickets 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr: -308> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr: -307> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr: -306> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr: -305> 2024-09-12T00:43:04.004+0000 7faab5602640 10 monclient: dump: 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.416 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr: -304> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 monclient: authenticate success, global_id 7790 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr: -303> 2024-09-12T00:43:04.004+0000 7fabcc38f640 4 set_mon_vals no callback set 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr: -302> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr: -301> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr: -300> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr: -299> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.417 INFO:tasks.workunit.client.0.smithi102.stderr: -298> 2024-09-12T00:43:04.004+0000 7faab5602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr: -297> 2024-09-12T00:43:04.004+0000 7faab5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr: -296> 2024-09-12T00:43:04.004+0000 7faab5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr: -295> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: get_monmap_and_config 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr: -294> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: build_initial_monmap 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr: -293> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr: -292> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: monmap: 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:43:04.418 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -291> 2024-09-12T00:43:04.004+0000 7fabcbb8e640 10 monclient: get_auth_request con 0x7faaa4070a20 auth_method 0 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -290> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding auth protocol: cephx 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -289> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding auth protocol: cephx 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -288> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding auth protocol: cephx 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -287> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -286> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -285> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -284> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -283> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -282> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -281> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.419 INFO:tasks.workunit.client.0.smithi102.stderr: -280> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -279> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -278> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -277> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: crc 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -276> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x555816a66270) adding con mode: secure 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -275> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -274> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: init 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -273> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding auth protocol: cephx 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -272> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding auth protocol: cephx 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -271> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding auth protocol: cephx 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -270> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -269> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -268> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.420 INFO:tasks.workunit.client.0.smithi102.stderr: -267> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -266> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -265> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -264> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -263> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -262> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -261> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -260> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: crc 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -259> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5550) adding con mode: secure 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -258> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -257> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -256> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd2aef5698 EEXIST 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -255> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -254> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:43:04.421 INFO:tasks.workunit.client.0.smithi102.stderr: -253> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-c con 0x555816a9a740 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -252> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-b con 0x555816a95b30 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -251> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-a con 0x555816a8c360 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -250> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -249> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -248> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -247> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -246> 2024-09-12T00:43:04.004+0000 7fabcd8879c0 10 monclient(hunting): authenticate will time out at 2972.507893s 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -245> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): get_auth_request con 0x555816a9a740 auth_method 0 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -244> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -243> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -242> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -241> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): get_auth_request con 0x555816a8c360 auth_method 0 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -240> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -239> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.422 INFO:tasks.workunit.client.0.smithi102.stderr: -238> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -237> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -236> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -235> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -234> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -233> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -232> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -231> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient(hunting): handle_auth_done global_id 7793 payload 274 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -230> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient: _finish_hunting 0 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -229> 2024-09-12T00:43:04.008+0000 7fabcab8c640 1 monclient: found mon.noname-c 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -228> 2024-09-12T00:43:04.008+0000 7fabcab8c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -227> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -226> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr: -225> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: dump: 2024-09-12T00:43:04.423 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr: -224> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: _finish_auth 0 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr: -223> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: _check_auth_tickets 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr: -222> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:04.424 INFO:tasks.workunit.client.0.smithi102.stderr: -221> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 monclient: authenticate success, global_id 7793 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr: -220> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: get_monmap_and_config success 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr: -219> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 4 set_mon_vals no callback set 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr: -218> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr: -217> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr: -216> 2024-09-12T00:43:04.008+0000 7faaaeffd640 10 monclient: dump: 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.425 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr: -215> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: shutdown 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr: -214> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: build_initial_monmap 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr: -213> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 build_initial for_mkfs: 0 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr: -212> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: monmap: 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 0 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 0.000000 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr:created 0.000000 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 0 (unknown) 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.noname-a 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.noname-b 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.noname-c 2024-09-12T00:43:04.426 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -211> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding auth protocol: cephx 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -210> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding auth protocol: cephx 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -209> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding auth protocol: cephx 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -208> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -207> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -206> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -205> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -204> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -203> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -202> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -201> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -200> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -199> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.427 INFO:tasks.workunit.client.0.smithi102.stderr: -198> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: crc 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -197> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a968a0) adding con mode: secure 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -196> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -195> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 librados: starting msgr at 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -194> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 librados: starting objecter 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -193> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command objecter_requests cmddesc objecter_requests hook 0x555816a6bb70 EEXIST 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -192> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 librados: setting wanted keys 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -191> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 librados: calling monclient init 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -190> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: init 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -189> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding auth protocol: cephx 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -188> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding auth protocol: cephx 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -187> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding auth protocol: cephx 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -186> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.428 INFO:tasks.workunit.client.0.smithi102.stderr: -185> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -184> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -183> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -182> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -181> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -180> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -179> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -178> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -177> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -176> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: crc 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -175> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 AuthRegistry(0x555816a48750) adding con mode: secure 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -174> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -173> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -172> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command rotate-key cmddesc rotate-key hook 0x555816a48898 EEXIST 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -171> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _reopen_session rank -1 2024-09-12T00:43:04.429 INFO:tasks.workunit.client.0.smithi102.stderr: -170> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -169> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-b con 0x555816a8c360 addr [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -168> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-c con 0x555816a95b30 addr [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -167> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): picked mon.noname-a con 0x555816a9a740 addr [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -166> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -165> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -164> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -163> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): _renew_subs 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -162> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient(hunting): authenticate will time out at 2972.510491s 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -161> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request con 0x555816a95b30 auth_method 0 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -160> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -159> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -158> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.430 INFO:tasks.workunit.client.0.smithi102.stderr: -157> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): get_auth_request con 0x555816a9a740 auth_method 0 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -156> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -155> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -154> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -153> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -152> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -151> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -150> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -149> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -148> 2024-09-12T00:43:04.008+0000 7fabcb38d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -147> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -146> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient: _finish_hunting 0 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -145> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 1 monclient: found mon.noname-c 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -144> 2024-09-12T00:43:04.008+0000 7fabcbb8e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.431 INFO:tasks.workunit.client.0.smithi102.stderr: -143> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr: -142> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr: -141> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: dump: 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr: -140> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: _finish_auth 0 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr: -139> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:43:04.432 INFO:tasks.workunit.client.0.smithi102.stderr: -138> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr: -137> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr: -136> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr: -135> 2024-09-12T00:43:04.008+0000 7faaad7fa640 10 monclient: dump: 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr:epoch 1 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr:fsid 92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr:last_changed 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr:created 2024-09-12T00:08:45.160875+0000 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr:min_mon_release 19 (squid) 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr:election_strategy: 1 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr:1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.433 INFO:tasks.workunit.client.0.smithi102.stderr: -134> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 monclient: authenticate success, global_id 7796 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -133> 2024-09-12T00:43:04.008+0000 7faaaeffd640 4 set_mon_vals no callback set 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -132> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -131> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -130> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _renew_subs 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -129> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -128> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 1 librados: init done 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -127> 2024-09-12T00:43:04.008+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command cr dump hook 0x555816a8b748 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -126> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -125> 2024-09-12T00:43:04.012+0000 7faaad7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -124> 2024-09-12T00:43:04.012+0000 7faaad7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -123> 2024-09-12T00:43:04.012+0000 7faaad7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.121:6800/3541484140,v1:172.21.15.121:6801/3541484140] 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -122> 2024-09-12T00:43:04.012+0000 7fabcab8c640 10 monclient: get_auth_request con 0x7faa94070b10 auth_method 0 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -121> 2024-09-12T00:43:04.012+0000 7fabcb38d640 10 monclient: get_auth_request con 0x555816ab4140 auth_method 0 2024-09-12T00:43:04.434 INFO:tasks.workunit.client.0.smithi102.stderr: -120> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -119> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 realm 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -118> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -117> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -116> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -115> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -114> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -113> 2024-09-12T00:43:04.012+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -112> 2024-09-12T00:43:04.012+0000 7fabcab8c640 10 monclient: get_auth_request con 0x555816ab8390 auth_method 0 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -111> 2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -110> 2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -109> 2024-09-12T00:43:04.016+0000 7fabcbb8e640 10 monclient: get_auth_request con 0x555816abbbf0 auth_method 0 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -108> 2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -107> 2024-09-12T00:43:04.016+0000 7fabcd8879c0 20 searching for the correct realm 2024-09-12T00:43:04.435 INFO:tasks.workunit.client.0.smithi102.stderr: -106> 2024-09-12T00:43:04.016+0000 7fabcb38d640 10 monclient: get_auth_request con 0x555816ac0940 auth_method 0 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -105> 2024-09-12T00:43:04.016+0000 7fabcab8c640 10 monclient: get_auth_request con 0x7fabc40c9030 auth_method 0 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -104> 2024-09-12T00:43:04.020+0000 7fabcbb8e640 10 monclient: get_auth_request con 0x7fabc001e050 auth_method 0 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -103> 2024-09-12T00:43:04.020+0000 7fabcbb8e640 0 -- 172.21.15.102:0/1950933284 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fabc001e050 msgr2=0x7fabc00620c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -102> 2024-09-12T00:43:04.020+0000 7faaad7fa640 1 client.7796.objecter ms_handle_reset 0x7fabc001e050 session 0x7fabc0096040 osd.4 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -101> 2024-09-12T00:43:04.020+0000 7faaad7fa640 10 monclient: _renew_subs 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -100> 2024-09-12T00:43:04.020+0000 7faaad7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.102:3301/0 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -99> 2024-09-12T00:43:04.020+0000 7fabcbb8e640 10 monclient: get_auth_request con 0x7faa940811b0 auth_method 0 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -98> 2024-09-12T00:43:04.024+0000 7fabcb38d640 10 monclient: get_auth_request con 0x7fabc40d7040 auth_method 0 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -97> 2024-09-12T00:43:04.028+0000 7fabcab8c640 10 monclient: get_auth_request con 0x7fabc4004020 auth_method 0 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -96> 2024-09-12T00:43:04.028+0000 7fabcab8c640 0 -- 172.21.15.102:0/1950933284 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fabc4004020 msgr2=0x7fabc40fc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -95> 2024-09-12T00:43:04.232+0000 7fabcab8c640 10 monclient: get_auth_request con 0x7fabc4004020 auth_method 0 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -94> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -93> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:04.436 INFO:tasks.workunit.client.0.smithi102.stderr: -92> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -91> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -90> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -89> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -88> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -87> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -86> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -85> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -84> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -83> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -82> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 zone default found 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -81> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 4 Realm: () 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -80> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -79> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:04.437 INFO:tasks.workunit.client.0.smithi102.stderr: -78> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -77> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 zonegroup default 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -76> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -75> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -74> 2024-09-12T00:43:04.248+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -73> 2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -72> 2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -71> 2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -70> 2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 started sync module instance, tier type = 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -69> 2024-09-12T00:43:04.252+0000 7fabcd8879c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -68> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=0 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -67> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=1 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -66> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=2 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -65> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=3 2024-09-12T00:43:04.438 INFO:tasks.workunit.client.0.smithi102.stderr: -64> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=4 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -63> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=5 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -62> 2024-09-12T00:43:04.272+0000 7fabcd8879c0 20 add_watcher() i=6 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -61> 2024-09-12T00:43:04.276+0000 7fabcd8879c0 20 add_watcher() i=7 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -60> 2024-09-12T00:43:04.276+0000 7fabcd8879c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -59> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding auth protocol: cephx 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -58> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding auth protocol: cephx 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -57> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding auth protocol: cephx 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -56> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -55> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -54> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -53> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -52> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -51> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.439 INFO:tasks.workunit.client.0.smithi102.stderr: -50> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -49> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -48> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -47> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -46> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: crc 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -45> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 AuthRegistry(0x7ffd2aef5a30) adding con mode: secure 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -44> 2024-09-12T00:43:04.280+0000 7faa81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -43> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -42> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -41> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -40> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command cache list hook 0x555816a8bf10 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -39> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command cache inspect hook 0x555816a8bf10 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -38> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command cache erase hook 0x555816a8bf10 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -37> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command cache zap hook 0x555816a8bf10 2024-09-12T00:43:04.440 INFO:tasks.workunit.client.0.smithi102.stderr: -36> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 note: GC not initialized 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -35> 2024-09-12T00:43:04.280+0000 7faa80fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -34> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command sync trace show hook 0x7fabbc00e040 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -33> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command sync trace history hook 0x7fabbc00e040 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -32> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command sync trace active hook 0x7fabbc00e040 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -31> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 5 asok(0x5558167bd2b0) register_command sync trace active_short hook 0x7fabbc00e040 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -30> 2024-09-12T00:43:04.280+0000 7fabcd8879c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -29> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 Filter name: none 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -28> 2024-09-12T00:43:04.284+0000 7fa9fa7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -27> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -26> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -25> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -24> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -23> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:43:04.441 INFO:tasks.workunit.client.0.smithi102.stderr: -22> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -21> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -20> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -19> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -18> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -17> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -16> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -15> 2024-09-12T00:43:04.284+0000 7fabcd8879c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -14> 2024-09-12T00:43:04.288+0000 7fabcd8879c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -13> 2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -12> 2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -11> 2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -10> 2024-09-12T00:43:04.304+0000 7fabcd8879c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:43:04.442 INFO:tasks.workunit.client.0.smithi102.stderr: -9> 2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398945 cookie 93836825888912 notifier 7796 bl.length()=911 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: -8> 2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: -7> 2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: -6> 2024-09-12T00:43:04.304+0000 7faaaeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: -5> 2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: -4> 2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: -3> 2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: -2> 2024-09-12T00:43:04.308+0000 7fabcd8879c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: -1> 2024-09-12T00:43:04.320+0000 7fabcd8879c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fabcd8879c0 time 2024-09-12T00:43:04.322347+0000 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fabd11612eb] 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabd116149f] 2024-09-12T00:43:04.443 INFO:tasks.workunit.client.0.smithi102.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555815298cc1] 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5558152add5a] 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 5: main() 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabcffc7d90] 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 7: __libc_start_main() 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 8: _start() 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 0> 2024-09-12T00:43:04.320+0000 7fabcd8879c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: in thread 7fabcd8879c0 thread_name:radosgw-admin 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fabcffe0520] 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 2: pthread_kill() 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 3: raise() 2024-09-12T00:43:04.444 INFO:tasks.workunit.client.0.smithi102.stderr: 4: abort() 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fabd1161345] 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fabd116149f] 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555815298cc1] 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5558152add5a] 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 9: main() 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fabcffc7d90] 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 11: __libc_start_main() 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 12: _start() 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr:--- logging levels --- 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 none 2024-09-12T00:43:04.445 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 lockdep 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 context 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 crush 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_balancer 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_locker 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_log_expire 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mds_migrator 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 3/ 5 mds_quiesce 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 buffer 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 timer 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 filer 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 striper 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 1 objecter 2024-09-12T00:43:04.446 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rados 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_mirror 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_replay 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 rbd_pwl 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 journaler 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objectcacher 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 client 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 osd 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 optracker 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 objclass 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 filestore 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 journal 2024-09-12T00:43:04.447 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 ms 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mon 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 0/10 monc 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 paxos 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 tp 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 auth 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 crypto 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 finisher 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 reserver 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 heartbeatmap 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 perfcounter 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_sync 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_datacache 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_access 2024-09-12T00:43:04.448 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_flight 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 20/20 rgw_notification 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 javaclient 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 asok 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 1 throttle 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 0 refs 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 compressor 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluestore 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 bluefs 2024-09-12T00:43:04.449 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 3 bdev 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 kstore 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 4/ 5 rocksdb 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 fuse 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 2/ 5 mgr 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mgrc 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 dpdk 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 eventtrace 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 prioritycache 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 test 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cephsqlite 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_onode 2024-09-12T00:43:04.450 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_odata 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_omap 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_tm 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_t 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_epm 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_lba 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_cache 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_journal 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_device 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 seastore_backref 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 alienstore 2024-09-12T00:43:04.451 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 mclock 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 cyanstore 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 ceph_exporter 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 memstore 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 1/ 5 trace 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 0/ 5 ceph_dedup 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: -2/-2 (syslog threshold) 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 99/99 (stderr threshold) 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 7fa9fa7fc640 / http_manager 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 7faa80fe1640 / http_manager 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 7faa81fe3640 / rgw_dt_lg_renew 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 7faaad7fa640 / ms_dispatch 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 7faaaeffd640 / io_context_pool 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 7faab5602640 / ms_dispatch 2024-09-12T00:43:04.452 INFO:tasks.workunit.client.0.smithi102.stderr: 7faab7e07640 / ms_dispatch 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr: 7faab960a640 / io_context_pool 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabcab8c640 / msgr-worker-2 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabcb38d640 / msgr-worker-1 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabcbb8e640 / msgr-worker-0 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabcc38f640 / io_context_pool 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr: 7fabcd8879c0 / radosgw-admin 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr: max_recent 500 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr: max_new 1000 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:43:04.324437Z_297ad267-ea64-4ae0-96c2-0df5a155ab23/log 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr:--- end dump of recent events --- 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr:Aborted 2024-09-12T00:43:04.453 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:43:04.455 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:04.455 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:04.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.408+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.408+0000 7efff51df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.408+0000 7efff51df9c0 20 realm 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.408+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.408+0000 7efff51df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.408+0000 7efff51df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.408+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.408+0000 7efff51df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.408+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.412+0000 7efff51df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.412+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.412+0000 7efff51df9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.412+0000 7efff51df9c0 20 searching for the correct realm 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.416+0000 7efff34e6640 0 -- 172.21.15.102:0/3673164216 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7effe8008040 msgr2=0x7effe80889e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:04.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.424+0000 7efff24e4640 0 -- 172.21.15.102:0/3673164216 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7effec069860 msgr2=0x7effec07d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:04.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.640+0000 7efff51df9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:04.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:04.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:04.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:04.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:04.642 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:04.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:04.643 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:04.644 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 zone default found 2024-09-12T00:43:04.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 4 Realm: () 2024-09-12T00:43:04.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:04.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:04.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:04.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 zonegroup default 2024-09-12T00:43:04.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.645 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.644+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.648+0000 7efff51df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.648+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.646 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.648+0000 7efff51df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.648+0000 7efff51df9c0 20 started sync module instance, tier type = 2024-09-12T00:43:04.647 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.648+0000 7efff51df9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:04.670 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.672+0000 7efff51df9c0 20 add_watcher() i=0 2024-09-12T00:43:04.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.672+0000 7efff51df9c0 20 add_watcher() i=1 2024-09-12T00:43:04.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.672+0000 7efff51df9c0 20 add_watcher() i=2 2024-09-12T00:43:04.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.672+0000 7efff51df9c0 20 add_watcher() i=3 2024-09-12T00:43:04.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.672+0000 7efff51df9c0 20 add_watcher() i=4 2024-09-12T00:43:04.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.672+0000 7efff51df9c0 20 add_watcher() i=5 2024-09-12T00:43:04.671 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.672+0000 7efff51df9c0 20 add_watcher() i=6 2024-09-12T00:43:04.673 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.672+0000 7efff51df9c0 20 add_watcher() i=7 2024-09-12T00:43:04.673 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.672+0000 7efff51df9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:04.677 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.676+0000 7efea97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:04.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.680+0000 7efff51df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:04.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.680+0000 7efff51df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:04.678 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.680+0000 7efff51df9c0 5 note: GC not initialized 2024-09-12T00:43:04.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.680+0000 7efe23fff640 20 reqs_thread_entry: start 2024-09-12T00:43:04.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.680+0000 7efff51df9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:04.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.680+0000 7efff51df9c0 20 Filter name: none 2024-09-12T00:43:04.679 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.680+0000 7efe21ffb640 20 reqs_thread_entry: start 2024-09-12T00:43:04.680 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.680+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.680+0000 7efff51df9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:04.681 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.680+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.684+0000 7efff51df9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:43:04.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.684+0000 7efff51df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:04.682 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.684+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.684+0000 7efff51df9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:04.683 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.684+0000 7efff51df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.684+0000 7efff51df9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:43:04.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.684+0000 7efff51df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:04.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.688+0000 7efea97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:04.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.692+0000 7efff51df9c0 20 remove_watcher() i=0 2024-09-12T00:43:04.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.692+0000 7efff51df9c0 2 removed watcher, disabling cache 2024-09-12T00:43:04.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.696+0000 7efff51df9c0 20 remove_watcher() i=1 2024-09-12T00:43:04.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.696+0000 7efff51df9c0 20 remove_watcher() i=2 2024-09-12T00:43:04.699 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.700+0000 7efff51df9c0 20 remove_watcher() i=3 2024-09-12T00:43:04.701 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.700+0000 7efff51df9c0 20 remove_watcher() i=4 2024-09-12T00:43:04.702 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.704+0000 7efff51df9c0 20 remove_watcher() i=5 2024-09-12T00:43:04.704 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.704+0000 7efff51df9c0 20 remove_watcher() i=6 2024-09-12T00:43:04.705 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.704+0000 7efff51df9c0 20 remove_watcher() i=7 2024-09-12T00:43:04.723 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:04.723 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:04.783 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:43:04.813 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:04.813 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:04.858 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.859 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 20 realm 2024-09-12T00:43:04.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:04.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:04.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:04.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.860+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:04.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.864+0000 7fa0ddc749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:04.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.864+0000 7fa0ddc749c0 20 searching for the correct realm 2024-09-12T00:43:04.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:04.868+0000 7fa0dbf7b640 0 -- 172.21.15.102:0/3423043831 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fa0d0008040 msgr2=0x7fa0d0019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:05.082 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.084+0000 7fa0daf79640 0 -- 172.21.15.102:0/3423043831 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fa0d4015070 msgr2=0x7fa0d4054930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:05.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.300+0000 7fa0ddc749c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:05.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.300+0000 7fa0ddc749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:05.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.300+0000 7fa0ddc749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:05.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.300+0000 7fa0ddc749c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:05.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.300+0000 7fa0ddc749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:05.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.300+0000 7fa0ddc749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:05.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.300+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:05.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.300+0000 7fa0ddc749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:05.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.300+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:05.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:05.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:05.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:05.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 20 zone default found 2024-09-12T00:43:05.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 4 Realm: () 2024-09-12T00:43:05.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:05.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:05.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:05.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 20 zonegroup default 2024-09-12T00:43:05.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:05.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:05.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:05.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:05.305 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.304+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:05.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.308+0000 7fa0ddc749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:05.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.308+0000 7fa0ddc749c0 20 started sync module instance, tier type = 2024-09-12T00:43:05.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.308+0000 7fa0ddc749c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.328+0000 7fa0ddc749c0 20 add_watcher() i=0 2024-09-12T00:43:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.328+0000 7fa0ddc749c0 20 add_watcher() i=1 2024-09-12T00:43:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.328+0000 7fa0ddc749c0 20 add_watcher() i=2 2024-09-12T00:43:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.328+0000 7fa0ddc749c0 20 add_watcher() i=3 2024-09-12T00:43:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.328+0000 7fa0ddc749c0 20 add_watcher() i=4 2024-09-12T00:43:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.328+0000 7fa0ddc749c0 20 add_watcher() i=5 2024-09-12T00:43:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.328+0000 7fa0ddc749c0 20 add_watcher() i=6 2024-09-12T00:43:05.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.332+0000 7fa0ddc749c0 20 add_watcher() i=7 2024-09-12T00:43:05.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.332+0000 7fa0ddc749c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:05.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.336+0000 7f9f91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:05.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.336+0000 7fa0ddc749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:05.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.336+0000 7fa0ddc749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:05.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.336+0000 7fa0ddc749c0 5 note: GC not initialized 2024-09-12T00:43:05.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.336+0000 7f9f90fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:05.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.336+0000 7fa0ddc749c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:05.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.336+0000 7fa0ddc749c0 20 Filter name: none 2024-09-12T00:43:05.336 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.336+0000 7f9f0a7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:05.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.336+0000 7fa0ddc749c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:43:05.337 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.336+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:05.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:05.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:43:05.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:43:05.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:43:05.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:05.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:43:05.339 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:05.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:05.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:05.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:05.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:43:05.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:43:05.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:43:05.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:43:05.340 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:43:05.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:43:05.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:43:05.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:43:05.341 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:43:05.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:43:05.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.340+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:43:05.342 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.344+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:43:05.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.344+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:43:05.343 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.344+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:43:05.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.344+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:43:05.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.344+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:43:05.344 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.344+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:43:05.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.344+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:43:05.345 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.344+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:43:05.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.348+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:43:05.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.348+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:43:05.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.348+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:43:05.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.348+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:43:05.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.348+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:43:05.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.348+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:43:05.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.348+0000 7fa0ddc749c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:43:05.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.348+0000 7fa0ddc749c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:43:05.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.352+0000 7f9f91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:05.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.356+0000 7fa0ddc749c0 20 remove_watcher() i=0 2024-09-12T00:43:05.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.356+0000 7fa0ddc749c0 2 removed watcher, disabling cache 2024-09-12T00:43:05.357 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.360+0000 7fa0ddc749c0 20 remove_watcher() i=1 2024-09-12T00:43:05.359 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.360+0000 7fa0ddc749c0 20 remove_watcher() i=2 2024-09-12T00:43:05.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.360+0000 7fa0ddc749c0 20 remove_watcher() i=3 2024-09-12T00:43:05.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.364+0000 7fa0ddc749c0 20 remove_watcher() i=4 2024-09-12T00:43:05.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.368+0000 7fa0ddc749c0 20 remove_watcher() i=5 2024-09-12T00:43:05.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.368+0000 7fa0ddc749c0 20 remove_watcher() i=6 2024-09-12T00:43:05.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:05.368+0000 7fa0ddc749c0 20 remove_watcher() i=7 2024-09-12T00:43:35.421 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:43:35.453 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:35.453 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:35.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.499+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.499+0000 7fd78a2269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:35.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.499+0000 7fd78a2269c0 20 realm 2024-09-12T00:43:35.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.499+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.499+0000 7fd78a2269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:35.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.499+0000 7fd78a2269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:35.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.499+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.499+0000 7fd78a2269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:35.502 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.499+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.503+0000 7fd78a2269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:35.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.503+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.503+0000 7fd78a2269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:35.506 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.503+0000 7fd78a2269c0 20 searching for the correct realm 2024-09-12T00:43:35.509 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.507+0000 7fd78852d640 0 -- 172.21.15.102:0/2610214086 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fd770009ce0 msgr2=0x7fd7700ce9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:35.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.723+0000 7fd78752b640 0 -- 172.21.15.102:0/2610214086 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd7800428c0 msgr2=0x7fd78000b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:35.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.939+0000 7fd78a2269c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:35.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.939+0000 7fd78a2269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:35.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.939+0000 7fd78a2269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:35.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.939+0000 7fd78a2269c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:35.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.939+0000 7fd78a2269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:35.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.939+0000 7fd78a2269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:35.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.939+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.941 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.939+0000 7fd78a2269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:35.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.939+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:35.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:35.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 zone default found 2024-09-12T00:43:35.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 4 Realm: () 2024-09-12T00:43:35.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:35.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:35.943 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:35.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 zonegroup default 2024-09-12T00:43:35.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:35.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:35.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:35.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 started sync module instance, tier type = 2024-09-12T00:43:35.945 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.943+0000 7fd78a2269c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:35.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.967+0000 7fd78a2269c0 20 add_watcher() i=0 2024-09-12T00:43:35.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.967+0000 7fd78a2269c0 20 add_watcher() i=1 2024-09-12T00:43:35.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.967+0000 7fd78a2269c0 20 add_watcher() i=2 2024-09-12T00:43:35.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.967+0000 7fd78a2269c0 20 add_watcher() i=3 2024-09-12T00:43:35.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.967+0000 7fd78a2269c0 20 add_watcher() i=4 2024-09-12T00:43:35.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.967+0000 7fd78a2269c0 20 add_watcher() i=5 2024-09-12T00:43:35.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.967+0000 7fd78a2269c0 20 add_watcher() i=6 2024-09-12T00:43:35.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.971+0000 7fd78a2269c0 20 add_watcher() i=7 2024-09-12T00:43:35.971 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.971+0000 7fd78a2269c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:35.976 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.975+0000 7fd63dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:35.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.975+0000 7fd78a2269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:35.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.975+0000 7fd78a2269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:35.977 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.975+0000 7fd78a2269c0 5 note: GC not initialized 2024-09-12T00:43:35.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.975+0000 7fd63cfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:35.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.975+0000 7fd78a2269c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:35.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 20 Filter name: none 2024-09-12T00:43:35.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd5b67fc640 20 reqs_thread_entry: start 2024-09-12T00:43:35.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:43:35.978 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:35.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:43:35.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:43:35.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:43:35.980 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:35.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:43:35.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:35.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:35.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:35.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:35.981 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.979+0000 7fd78a2269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:43:35.987 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.987+0000 7fd63dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:35.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.991+0000 7fd78a2269c0 20 remove_watcher() i=0 2024-09-12T00:43:35.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.991+0000 7fd78a2269c0 2 removed watcher, disabling cache 2024-09-12T00:43:35.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.995+0000 7fd78a2269c0 20 remove_watcher() i=1 2024-09-12T00:43:35.996 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.995+0000 7fd78a2269c0 20 remove_watcher() i=2 2024-09-12T00:43:35.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.999+0000 7fd78a2269c0 20 remove_watcher() i=3 2024-09-12T00:43:36.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:35.999+0000 7fd78a2269c0 20 remove_watcher() i=4 2024-09-12T00:43:36.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.003+0000 7fd78a2269c0 20 remove_watcher() i=5 2024-09-12T00:43:36.004 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.003+0000 7fd78a2269c0 20 remove_watcher() i=6 2024-09-12T00:43:36.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.003+0000 7fd78a2269c0 20 remove_watcher() i=7 2024-09-12T00:43:36.021 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:43:36.053 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:36.053 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:36.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.095+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.099+0000 7f2a8af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.099+0000 7f2a8af2a9c0 20 realm 2024-09-12T00:43:36.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.099+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.099+0000 7f2a8af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.099+0000 7f2a8af2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:36.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.099+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.099+0000 7f2a8af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.099+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.099+0000 7f2a8af2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:36.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.099+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.103+0000 7f2a8af2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:36.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.103+0000 7f2a8af2a9c0 20 searching for the correct realm 2024-09-12T00:43:36.106 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.107+0000 7f2a89231640 0 -- 172.21.15.102:0/1066335884 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f2a7c0f0430 msgr2=0x7f2a7c0f0870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:36.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.111+0000 7f2a8822f640 0 -- 172.21.15.102:0/1066335884 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f2a80038920 msgr2=0x7f2a8002a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:36.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.327+0000 7f2a8af2a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:36.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.327+0000 7f2a8af2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:36.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.327+0000 7f2a8af2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:36.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.327+0000 7f2a8af2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:36.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.327+0000 7f2a8af2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:36.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.327+0000 7f2a8af2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:36.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.327+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:36.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:36.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 zone default found 2024-09-12T00:43:36.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 4 Realm: () 2024-09-12T00:43:36.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:36.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:36.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:36.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 zonegroup default 2024-09-12T00:43:36.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 started sync module instance, tier type = 2024-09-12T00:43:36.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.331+0000 7f2a8af2a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:36.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.355+0000 7f2a8af2a9c0 20 add_watcher() i=0 2024-09-12T00:43:36.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.355+0000 7f2a8af2a9c0 20 add_watcher() i=1 2024-09-12T00:43:36.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.355+0000 7f2a8af2a9c0 20 add_watcher() i=2 2024-09-12T00:43:36.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.355+0000 7f2a8af2a9c0 20 add_watcher() i=3 2024-09-12T00:43:36.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.355+0000 7f2a8af2a9c0 20 add_watcher() i=4 2024-09-12T00:43:36.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.355+0000 7f2a8af2a9c0 20 add_watcher() i=5 2024-09-12T00:43:36.358 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.355+0000 7f2a8af2a9c0 20 add_watcher() i=6 2024-09-12T00:43:36.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.359+0000 7f2a8af2a9c0 20 add_watcher() i=7 2024-09-12T00:43:36.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.359+0000 7f2a8af2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:36.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.363+0000 7f293efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:36.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.363+0000 7f2a8af2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:36.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.363+0000 7f2a8af2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:36.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.363+0000 7f2a8af2a9c0 5 note: GC not initialized 2024-09-12T00:43:36.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f293dfe3640 20 reqs_thread_entry: start 2024-09-12T00:43:36.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:36.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 20 Filter name: none 2024-09-12T00:43:36.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f28af7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:36.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:43:36.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:36.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:43:36.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:43:36.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:43:36.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:43:36.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:36.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:36.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:36.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:36.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:43:36.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:43:36.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:43:36.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:43:36.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.367+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:43:36.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.371+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:43:36.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.371+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:43:36.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.371+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:43:36.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.371+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:43:36.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.371+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:43:36.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.371+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:43:36.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.371+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:43:36.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.371+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:43:36.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.371+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:43:36.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.371+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:43:36.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.375+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:43:36.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.375+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:43:36.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.375+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:43:36.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.375+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:43:36.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.375+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:43:36.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.375+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:43:36.376 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.375+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:43:36.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.375+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:43:36.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.375+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:43:36.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.375+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:43:36.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.379+0000 7f2a8af2a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:43:36.378 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.379+0000 7f2a8af2a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:43:36.380 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.379+0000 7f293efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:36.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.383+0000 7f2a8af2a9c0 20 remove_watcher() i=0 2024-09-12T00:43:36.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.383+0000 7f2a8af2a9c0 2 removed watcher, disabling cache 2024-09-12T00:43:36.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.387+0000 7f2a8af2a9c0 20 remove_watcher() i=1 2024-09-12T00:43:36.390 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.391+0000 7f2a8af2a9c0 20 remove_watcher() i=2 2024-09-12T00:43:36.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.391+0000 7f2a8af2a9c0 20 remove_watcher() i=3 2024-09-12T00:43:36.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.395+0000 7f2a8af2a9c0 20 remove_watcher() i=4 2024-09-12T00:43:36.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.395+0000 7f2a8af2a9c0 20 remove_watcher() i=5 2024-09-12T00:43:36.399 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.399+0000 7f2a8af2a9c0 20 remove_watcher() i=6 2024-09-12T00:43:36.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.399+0000 7f2a8af2a9c0 20 remove_watcher() i=7 2024-09-12T00:43:36.418 INFO:tasks.workunit.client.0.smithi102.stderr:check reshard logrecord successfully 2024-09-12T00:43:36.418 INFO:tasks.workunit.client.0.smithi102.stderr: test: reshard versioned bucket 2024-09-12T00:43:36.419 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:43:36.449 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:36.450 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:36.495 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.495+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.495+0000 7f5076fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.495+0000 7f5076fa39c0 20 realm 2024-09-12T00:43:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.495+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.495+0000 7f5076fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.495+0000 7f5076fa39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.495+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.495+0000 7f5076fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.495+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.499+0000 7f5076fa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:36.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.499+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.499+0000 7f5076fa39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:36.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.499+0000 7f5076fa39c0 20 searching for the correct realm 2024-09-12T00:43:36.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.503+0000 7f50742a8640 0 -- 172.21.15.102:0/4225460248 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f506c0d3070 msgr2=0x7f506c0d3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:36.718 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.715+0000 7f50752aa640 0 -- 172.21.15.102:0/4225460248 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55ff17790d30 msgr2=0x55ff17793120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:36.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.731+0000 7f5076fa39c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:36.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.731+0000 7f5076fa39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:36.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.731+0000 7f5076fa39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:36.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.731+0000 7f5076fa39c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:36.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.731+0000 7f5076fa39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:36.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.731+0000 7f5076fa39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:36.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:36.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:36.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 zone default found 2024-09-12T00:43:36.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 4 Realm: () 2024-09-12T00:43:36.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:36.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:36.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:36.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 zonegroup default 2024-09-12T00:43:36.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.735+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.739+0000 7f5076fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.739+0000 7f5076fa39c0 20 started sync module instance, tier type = 2024-09-12T00:43:36.738 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.739+0000 7f5076fa39c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:36.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.763+0000 7f5076fa39c0 20 add_watcher() i=0 2024-09-12T00:43:36.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.763+0000 7f5076fa39c0 20 add_watcher() i=1 2024-09-12T00:43:36.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.763+0000 7f5076fa39c0 20 add_watcher() i=2 2024-09-12T00:43:36.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.763+0000 7f5076fa39c0 20 add_watcher() i=3 2024-09-12T00:43:36.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.763+0000 7f5076fa39c0 20 add_watcher() i=4 2024-09-12T00:43:36.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.763+0000 7f5076fa39c0 20 add_watcher() i=5 2024-09-12T00:43:36.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.763+0000 7f5076fa39c0 20 add_watcher() i=6 2024-09-12T00:43:36.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.763+0000 7f5076fa39c0 20 add_watcher() i=7 2024-09-12T00:43:36.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.763+0000 7f5076fa39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:36.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.767+0000 7f4f2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:36.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.767+0000 7f5076fa39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:36.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.767+0000 7f5076fa39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:36.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.767+0000 7f5076fa39c0 5 note: GC not initialized 2024-09-12T00:43:36.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f4f29fe3640 20 reqs_thread_entry: start 2024-09-12T00:43:36.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f5076fa39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:36.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f5076fa39c0 20 Filter name: none 2024-09-12T00:43:36.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f4e9b7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:36.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f5076fa39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:36.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f5076fa39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:36.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f5076fa39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:36.773 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f5076fa39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:36.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.771+0000 7f5076fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.775+0000 7f5076fa39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:36.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.775+0000 7f5076fa39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:36.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.779+0000 7f4f2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:36.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.783+0000 7f5076fa39c0 20 remove_watcher() i=0 2024-09-12T00:43:36.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.783+0000 7f5076fa39c0 2 removed watcher, disabling cache 2024-09-12T00:43:36.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.783+0000 7f5076fa39c0 20 remove_watcher() i=1 2024-09-12T00:43:36.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.787+0000 7f5076fa39c0 20 remove_watcher() i=2 2024-09-12T00:43:36.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.791+0000 7f5076fa39c0 20 remove_watcher() i=3 2024-09-12T00:43:36.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.791+0000 7f5076fa39c0 20 remove_watcher() i=4 2024-09-12T00:43:36.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.795+0000 7f5076fa39c0 20 remove_watcher() i=5 2024-09-12T00:43:36.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.795+0000 7f5076fa39c0 20 remove_watcher() i=6 2024-09-12T00:43:36.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.795+0000 7f5076fa39c0 20 remove_watcher() i=7 2024-09-12T00:43:36.813 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:36.813 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:43:36.813 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: myver id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:43:36.813 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:36.813 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T00:43:36.845 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:36.845 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:36.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.887+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.887+0000 7fd54d2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.887+0000 7fd54d2c79c0 20 realm 2024-09-12T00:43:36.889 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.887+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.887+0000 7fd54d2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.887+0000 7fd54d2c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:36.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.887+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.891+0000 7fd54d2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:36.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.891+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.891+0000 7fd54d2c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:36.891 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.891+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:36.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.891+0000 7fd54d2c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:36.893 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.891+0000 7fd54d2c79c0 20 searching for the correct realm 2024-09-12T00:43:36.898 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.899+0000 7fd54b5ce640 0 -- 172.21.15.102:0/3695784306 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55c742adcd20 msgr2=0x55c742adf130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:36.904 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:36.903+0000 7fd54a5cc640 0 -- 172.21.15.102:0/3695784306 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fd54406b400 msgr2=0x7fd54408e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:37.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.119+0000 7fd54d2c79c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:37.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.119+0000 7fd54d2c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:37.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.119+0000 7fd54d2c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:37.121 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.119+0000 7fd54d2c79c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:37.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.119+0000 7fd54d2c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:37.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.119+0000 7fd54d2c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:37.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.119+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.119+0000 7fd54d2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.119+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:37.122 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:37.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 zone default found 2024-09-12T00:43:37.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 4 Realm: () 2024-09-12T00:43:37.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:37.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:37.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:37.123 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 zonegroup default 2024-09-12T00:43:37.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 started sync module instance, tier type = 2024-09-12T00:43:37.125 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.123+0000 7fd54d2c79c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:37.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.147+0000 7fd54d2c79c0 20 add_watcher() i=0 2024-09-12T00:43:37.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.147+0000 7fd54d2c79c0 20 add_watcher() i=1 2024-09-12T00:43:37.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.147+0000 7fd54d2c79c0 20 add_watcher() i=2 2024-09-12T00:43:37.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.147+0000 7fd54d2c79c0 20 add_watcher() i=3 2024-09-12T00:43:37.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.147+0000 7fd54d2c79c0 20 add_watcher() i=4 2024-09-12T00:43:37.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.147+0000 7fd54d2c79c0 20 add_watcher() i=5 2024-09-12T00:43:37.149 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.147+0000 7fd54d2c79c0 20 add_watcher() i=6 2024-09-12T00:43:37.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.151+0000 7fd54d2c79c0 20 add_watcher() i=7 2024-09-12T00:43:37.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.151+0000 7fd54d2c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:37.155 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.155+0000 7fd4017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:37.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.155+0000 7fd54d2c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:37.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.155+0000 7fd54d2c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:37.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.155+0000 7fd54d2c79c0 5 note: GC not initialized 2024-09-12T00:43:37.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.155+0000 7fd37bfff640 20 reqs_thread_entry: start 2024-09-12T00:43:37.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.155+0000 7fd54d2c79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:37.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.155+0000 7fd54d2c79c0 20 Filter name: none 2024-09-12T00:43:37.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.155+0000 7fd379ffb640 20 reqs_thread_entry: start 2024-09-12T00:43:37.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.155+0000 7fd54d2c79c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:43:37.157 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.155+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:37.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:43:37.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:43:37.158 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 : miss 2024-09-12T00:43:37.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:37.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:37.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 10 adding default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:37.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:37.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:37.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.159+0000 7fd54d2c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 2024-09-12T00:43:37.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.171+0000 7fd54d2c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:37.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.171+0000 7fd54d2c79c0 10 moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:37.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.171+0000 7fd54d2c79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:37.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.171+0000 7fd54d2c79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19, ofs0, ns] 2024-09-12T00:43:37.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.171+0000 7fd42e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398909 cookie 94314305583824 notifier 8451 bl.length()=905 2024-09-12T00:43:37.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.171+0000 7fd42e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:37.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.171+0000 7fd42e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:37.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.171+0000 7fd42e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:37.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.175+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_sources= new_sources= 2024-09-12T00:43:37.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.175+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential sources added=[] removed=[] 2024-09-12T00:43:37.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.175+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_dests= new_dests= 2024-09-12T00:43:37.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.175+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential dests added=[] removed=[] 2024-09-12T00:43:37.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.0 2024-09-12T00:43:37.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.0 2024-09-12T00:43:37.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.1 2024-09-12T00:43:37.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.1 2024-09-12T00:43:37.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.2 2024-09-12T00:43:37.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.2 2024-09-12T00:43:37.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.3 2024-09-12T00:43:37.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.3 2024-09-12T00:43:37.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.4 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.4 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.5 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.5 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.6 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.6 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.7 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.7 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.8 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.8 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.9 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.9 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.10 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.10 2024-09-12T00:43:37.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.11 2024-09-12T00:43:37.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.11 2024-09-12T00:43:37.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.183+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.0 2024-09-12T00:43:37.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.187+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1 2024-09-12T00:43:37.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.187+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2 2024-09-12T00:43:37.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.187+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3 2024-09-12T00:43:37.189 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.187+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.4 2024-09-12T00:43:37.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.191+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.5 2024-09-12T00:43:37.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.191+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.6 2024-09-12T00:43:37.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.191+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.7 2024-09-12T00:43:37.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.191+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.8 2024-09-12T00:43:37.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.195+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.9 2024-09-12T00:43:37.194 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.195+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.10 2024-09-12T00:43:37.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.195+0000 7fd54d2c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:37.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.195+0000 7fd54d2c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 2024-09-12T00:43:37.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd54d2c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:37.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd54d2c79c0 10 moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:37.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd54d2c79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:37.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd54d2c79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19, ofs0, ns] 2024-09-12T00:43:37.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd42e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398910 cookie 94314305583824 notifier 8451 bl.length()=905 2024-09-12T00:43:37.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd42e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:37.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd42e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:37.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd42e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:37.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_sources= new_sources= 2024-09-12T00:43:37.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential sources added=[] removed=[] 2024-09-12T00:43:37.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_dests= new_dests= 2024-09-12T00:43:37.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.199+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential dests added=[] removed=[] 2024-09-12T00:43:37.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.203+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.0 2024-09-12T00:43:37.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.207+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1 2024-09-12T00:43:37.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.207+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2 2024-09-12T00:43:37.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.207+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3 2024-09-12T00:43:37.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.207+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.4 2024-09-12T00:43:37.208 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.207+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.5 2024-09-12T00:43:37.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.207+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.6 2024-09-12T00:43:37.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.207+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.7 2024-09-12T00:43:37.210 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.211+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.8 2024-09-12T00:43:37.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.211+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.9 2024-09-12T00:43:37.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.211+0000 7fd54d2c79c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.10 2024-09-12T00:43:37.211 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.211+0000 7fd54d2c79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:37.212 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.211+0000 7fd54d2c79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 2024-09-12T00:43:37.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd54d2c79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:37.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd54d2c79c0 10 moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:37.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd54d2c79c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:37.214 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd54d2c79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19, ofs0, ns] 2024-09-12T00:43:37.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd42dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398911 cookie 94314305583824 notifier 8451 bl.length()=873 2024-09-12T00:43:37.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd42dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:37.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd42dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:37.215 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd42dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:37.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_sources= new_sources= 2024-09-12T00:43:37.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential sources added=[] removed=[] 2024-09-12T00:43:37.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_dests= new_dests= 2024-09-12T00:43:37.217 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.215+0000 7fd54d2c79c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential dests added=[] removed=[] 2024-09-12T00:43:37.222 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.223+0000 7fd54d2c79c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T00:43:37.225 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.223+0000 7fd4017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:37.229 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.227+0000 7fd54d2c79c0 20 remove_watcher() i=0 2024-09-12T00:43:37.230 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.227+0000 7fd54d2c79c0 2 removed watcher, disabling cache 2024-09-12T00:43:37.232 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.231+0000 7fd54d2c79c0 20 remove_watcher() i=1 2024-09-12T00:43:37.233 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.231+0000 7fd54d2c79c0 20 remove_watcher() i=2 2024-09-12T00:43:37.236 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.235+0000 7fd54d2c79c0 20 remove_watcher() i=3 2024-09-12T00:43:37.237 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.235+0000 7fd54d2c79c0 20 remove_watcher() i=4 2024-09-12T00:43:37.239 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.239+0000 7fd54d2c79c0 20 remove_watcher() i=5 2024-09-12T00:43:37.241 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.239+0000 7fd54d2c79c0 20 remove_watcher() i=6 2024-09-12T00:43:37.242 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.243+0000 7fd54d2c79c0 20 remove_watcher() i=7 2024-09-12T00:43:37.257 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:43:37.285 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:37.285 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:37.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.327+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.331+0000 7f65afa789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.331+0000 7f65afa789c0 20 realm 2024-09-12T00:43:37.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.331+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.331+0000 7f65afa789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.332 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.331+0000 7f65afa789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:37.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.331+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.331+0000 7f65afa789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.333 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.331+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.335+0000 7f65afa789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:37.334 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.335+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.335+0000 7f65afa789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:37.335 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.335+0000 7f65afa789c0 20 searching for the correct realm 2024-09-12T00:43:37.338 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.339+0000 7f65add7f640 0 -- 172.21.15.102:0/2405959663 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f65a40c9040 msgr2=0x7f65a40e1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:37.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.555+0000 7f65acd7d640 0 -- 172.21.15.102:0/2405959663 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f65a808a040 msgr2=0x7f65a8092960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:37.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.771+0000 7f65afa789c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:37.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.771+0000 7f65afa789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:37.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.771+0000 7f65afa789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:37.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.771+0000 7f65afa789c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:37.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.771+0000 7f65afa789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:37.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.771+0000 7f65afa789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:37.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.771+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:37.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:37.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 zone default found 2024-09-12T00:43:37.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 4 Realm: () 2024-09-12T00:43:37.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:37.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:37.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:37.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 zonegroup default 2024-09-12T00:43:37.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.775+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.778 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.779+0000 7f65afa789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:37.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.779+0000 7f65afa789c0 20 started sync module instance, tier type = 2024-09-12T00:43:37.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.779+0000 7f65afa789c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:37.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.799+0000 7f65afa789c0 20 add_watcher() i=0 2024-09-12T00:43:37.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.799+0000 7f65afa789c0 20 add_watcher() i=1 2024-09-12T00:43:37.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.799+0000 7f65afa789c0 20 add_watcher() i=2 2024-09-12T00:43:37.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.799+0000 7f65afa789c0 20 add_watcher() i=3 2024-09-12T00:43:37.802 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.799+0000 7f65afa789c0 20 add_watcher() i=4 2024-09-12T00:43:37.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.799+0000 7f65afa789c0 20 add_watcher() i=5 2024-09-12T00:43:37.803 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.799+0000 7f65afa789c0 20 add_watcher() i=6 2024-09-12T00:43:37.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.803+0000 7f65afa789c0 20 add_watcher() i=7 2024-09-12T00:43:37.804 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.803+0000 7f65afa789c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:37.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f6463fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:37.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f65afa789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:37.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f65afa789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:37.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f65afa789c0 5 note: GC not initialized 2024-09-12T00:43:37.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f6462fe5640 20 reqs_thread_entry: start 2024-09-12T00:43:37.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f65afa789c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:37.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f65afa789c0 20 Filter name: none 2024-09-12T00:43:37.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f6460fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:37.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.809 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f65afa789c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:37.810 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.807+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.811+0000 7f65afa789c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:37.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.811+0000 7f65afa789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:37.811 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.811+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.811+0000 7f65afa789c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:37.812 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.811+0000 7f65afa789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:37.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.811+0000 7f65afa789c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:37.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.811+0000 7f65afa789c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:37.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.815+0000 7f6463fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:37.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.819+0000 7f65afa789c0 20 remove_watcher() i=0 2024-09-12T00:43:37.821 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.819+0000 7f65afa789c0 2 removed watcher, disabling cache 2024-09-12T00:43:37.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.823+0000 7f65afa789c0 20 remove_watcher() i=1 2024-09-12T00:43:37.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.823+0000 7f65afa789c0 20 remove_watcher() i=2 2024-09-12T00:43:37.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.827+0000 7f65afa789c0 20 remove_watcher() i=3 2024-09-12T00:43:37.830 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.831+0000 7f65afa789c0 20 remove_watcher() i=4 2024-09-12T00:43:37.831 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.831+0000 7f65afa789c0 20 remove_watcher() i=5 2024-09-12T00:43:37.832 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.831+0000 7f65afa789c0 20 remove_watcher() i=6 2024-09-12T00:43:37.834 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:37.835+0000 7f65afa789c0 20 remove_watcher() i=7 2024-09-12T00:43:37.849 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:37.849 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:43:37.849 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: myver id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:43:37.849 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:37.850 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:37.851 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:37.874 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:37.874 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:37.947 INFO:tasks.workunit.client.0.smithi102.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:43:37.952 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:37.952 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:38.101 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:38.102 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:38.837 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:43:38.869 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:38.869 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:38.913 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.911+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:38.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.915+0000 7f04aa66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:38.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.915+0000 7f04aa66b9c0 20 realm 2024-09-12T00:43:38.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.915+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:38.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.915+0000 7f04aa66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:38.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.915+0000 7f04aa66b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:38.915 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.915+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:38.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.915+0000 7f04aa66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:38.916 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.915+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:38.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.915+0000 7f04aa66b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:38.917 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.915+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:38.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.919+0000 7f04aa66b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:38.919 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.919+0000 7f04aa66b9c0 20 searching for the correct realm 2024-09-12T00:43:38.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:38.919+0000 7f04a7970640 0 -- 172.21.15.102:0/2839361765 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f04980d3070 msgr2=0x7f04980c3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:39.134 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.135+0000 7f04a8972640 0 -- 172.21.15.102:0/2839361765 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55d84d5d96b0 msgr2=0x55d84d5dbaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:39.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.147+0000 7f04aa66b9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:39.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.147+0000 7f04aa66b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:39.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.147+0000 7f04aa66b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:39.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.147+0000 7f04aa66b9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:39.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.147+0000 7f04aa66b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:39.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.147+0000 7f04aa66b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:39.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.147+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.150 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:39.151 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:39.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 zone default found 2024-09-12T00:43:39.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 4 Realm: () 2024-09-12T00:43:39.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:39.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:39.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:39.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 zonegroup default 2024-09-12T00:43:39.152 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.151+0000 7f04aa66b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.155+0000 7f04aa66b9c0 20 started sync module instance, tier type = 2024-09-12T00:43:39.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.155+0000 7f04aa66b9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:39.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.175+0000 7f04aa66b9c0 20 add_watcher() i=0 2024-09-12T00:43:39.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.175+0000 7f04aa66b9c0 20 add_watcher() i=1 2024-09-12T00:43:39.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.175+0000 7f04aa66b9c0 20 add_watcher() i=2 2024-09-12T00:43:39.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.175+0000 7f04aa66b9c0 20 add_watcher() i=3 2024-09-12T00:43:39.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.175+0000 7f04aa66b9c0 20 add_watcher() i=4 2024-09-12T00:43:39.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.175+0000 7f04aa66b9c0 20 add_watcher() i=5 2024-09-12T00:43:39.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.175+0000 7f04aa66b9c0 20 add_watcher() i=6 2024-09-12T00:43:39.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.175+0000 7f04aa66b9c0 20 add_watcher() i=7 2024-09-12T00:43:39.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.175+0000 7f04aa66b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:39.181 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.179+0000 7f035e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:39.182 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.183+0000 7f04aa66b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:39.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.183+0000 7f04aa66b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:39.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.183+0000 7f04aa66b9c0 5 note: GC not initialized 2024-09-12T00:43:39.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.183+0000 7f035d7e2640 20 reqs_thread_entry: start 2024-09-12T00:43:39.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.183+0000 7f04aa66b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:39.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.183+0000 7f04aa66b9c0 20 Filter name: none 2024-09-12T00:43:39.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.183+0000 7f02ceffd640 20 reqs_thread_entry: start 2024-09-12T00:43:39.184 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.183+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.183+0000 7f04aa66b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:39.185 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.183+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.187+0000 7f04aa66b9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:43:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.187+0000 7f04aa66b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:39.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.187+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.187+0000 7f04aa66b9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.187+0000 7f04aa66b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.187+0000 7f04aa66b9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:43:39.187 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.187+0000 7f04aa66b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:39.190 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.191+0000 7f035e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:39.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.195+0000 7f04aa66b9c0 20 remove_watcher() i=0 2024-09-12T00:43:39.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.195+0000 7f04aa66b9c0 2 removed watcher, disabling cache 2024-09-12T00:43:39.197 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.195+0000 7f04aa66b9c0 20 remove_watcher() i=1 2024-09-12T00:43:39.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.199+0000 7f04aa66b9c0 20 remove_watcher() i=2 2024-09-12T00:43:39.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.199+0000 7f04aa66b9c0 20 remove_watcher() i=3 2024-09-12T00:43:39.203 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.203+0000 7f04aa66b9c0 20 remove_watcher() i=4 2024-09-12T00:43:39.205 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.203+0000 7f04aa66b9c0 20 remove_watcher() i=5 2024-09-12T00:43:39.206 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.207+0000 7f04aa66b9c0 20 remove_watcher() i=6 2024-09-12T00:43:39.207 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.207+0000 7f04aa66b9c0 20 remove_watcher() i=7 2024-09-12T00:43:39.222 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:39.223 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:43:39.223 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: a-bucket id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T00:43:39.223 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:39.223 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:43:39.255 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:39.255 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:39.301 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.299+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.303+0000 7fa617d429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.303+0000 7fa617d429c0 20 realm 2024-09-12T00:43:39.302 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.303+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.303+0000 7fa617d429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.303+0000 7fa617d429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:39.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.303+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.303+0000 7fa617d429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.303 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.303+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.303+0000 7fa617d429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:39.304 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.303+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.307+0000 7fa617d429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:39.306 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.307+0000 7fa617d429c0 20 searching for the correct realm 2024-09-12T00:43:39.309 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.307+0000 7fa616049640 0 -- 172.21.15.102:0/2212965192 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fa60c0db420 msgr2=0x7fa60c0db840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:39.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.523+0000 7fa615047640 0 -- 172.21.15.102:0/2212965192 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fa610009a20 msgr2=0x7fa61009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:39.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:39.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:39.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:39.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:39.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:39.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:39.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.744 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:39.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:39.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 zone default found 2024-09-12T00:43:39.745 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 4 Realm: () 2024-09-12T00:43:39.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:39.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:39.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:39.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 zonegroup default 2024-09-12T00:43:39.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.743+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.747+0000 7fa617d429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.746 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.747+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.747+0000 7fa617d429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.747+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.747+0000 7fa617d429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:39.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.747+0000 7fa617d429c0 20 started sync module instance, tier type = 2024-09-12T00:43:39.748 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.747+0000 7fa617d429c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:39.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.767+0000 7fa617d429c0 20 add_watcher() i=0 2024-09-12T00:43:39.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.767+0000 7fa617d429c0 20 add_watcher() i=1 2024-09-12T00:43:39.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.767+0000 7fa617d429c0 20 add_watcher() i=2 2024-09-12T00:43:39.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.767+0000 7fa617d429c0 20 add_watcher() i=3 2024-09-12T00:43:39.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.767+0000 7fa617d429c0 20 add_watcher() i=4 2024-09-12T00:43:39.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.767+0000 7fa617d429c0 20 add_watcher() i=5 2024-09-12T00:43:39.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.767+0000 7fa617d429c0 20 add_watcher() i=6 2024-09-12T00:43:39.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.771+0000 7fa617d429c0 20 add_watcher() i=7 2024-09-12T00:43:39.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.771+0000 7fa617d429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:39.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa4c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:39.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa617d429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:39.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa617d429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:39.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa617d429c0 5 note: GC not initialized 2024-09-12T00:43:39.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa4c67fc640 20 reqs_thread_entry: start 2024-09-12T00:43:39.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa617d429c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:39.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa617d429c0 20 Filter name: none 2024-09-12T00:43:39.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa437fff640 20 reqs_thread_entry: start 2024-09-12T00:43:39.776 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa617d429c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:39.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa617d429c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:39.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa617d429c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:43:39.777 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.775+0000 7fa617d429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:39.779 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.779+0000 7fa4c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:39.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.783+0000 7fa617d429c0 20 remove_watcher() i=0 2024-09-12T00:43:39.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.783+0000 7fa617d429c0 2 removed watcher, disabling cache 2024-09-12T00:43:39.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.783+0000 7fa617d429c0 20 remove_watcher() i=1 2024-09-12T00:43:39.788 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.787+0000 7fa617d429c0 20 remove_watcher() i=2 2024-09-12T00:43:39.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.791+0000 7fa617d429c0 20 remove_watcher() i=3 2024-09-12T00:43:39.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.791+0000 7fa617d429c0 20 remove_watcher() i=4 2024-09-12T00:43:39.794 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.795+0000 7fa617d429c0 20 remove_watcher() i=5 2024-09-12T00:43:39.795 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.795+0000 7fa617d429c0 20 remove_watcher() i=6 2024-09-12T00:43:39.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:39.795+0000 7fa617d429c0 20 remove_watcher() i=7 2024-09-12T00:43:39.812 INFO:tasks.workunit.client.0.smithi102.stderr:rados -p default.rgw.buckets.index setomapval .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:43:40.687 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:40.688 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:40.688 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:43:40.688 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:40.688 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:40.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.135+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.135+0000 7f515740f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.135+0000 7f515740f9c0 20 realm 2024-09-12T00:43:40.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.135+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.135+0000 7f515740f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.135+0000 7f515740f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.135+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.139+0000 7f515740f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.139+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.139+0000 7f515740f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.139+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.139+0000 7f515740f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.139+0000 7f515740f9c0 20 searching for the correct realm 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.143+0000 7f5155716640 0 -- 172.21.15.102:0/2380392553 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f5140085070 msgr2=0x7f51400729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.359+0000 7f514ffff640 0 -- 172.21.15.102:0/2380392553 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f515000e070 msgr2=0x7f5150018410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:40.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.575+0000 7f515740f9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.575+0000 7f515740f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.575+0000 7f515740f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.575+0000 7f515740f9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.575+0000 7f515740f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.575+0000 7f515740f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.575+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.575+0000 7f515740f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.575+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 zone default found 2024-09-12T00:43:40.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 4 Realm: () 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 zonegroup default 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 started sync module instance, tier type = 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.579+0000 7f515740f9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.603+0000 7f515740f9c0 20 add_watcher() i=0 2024-09-12T00:43:40.691 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.603+0000 7f515740f9c0 20 add_watcher() i=1 2024-09-12T00:43:40.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.603+0000 7f515740f9c0 20 add_watcher() i=2 2024-09-12T00:43:40.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.603+0000 7f515740f9c0 20 add_watcher() i=3 2024-09-12T00:43:40.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.603+0000 7f515740f9c0 20 add_watcher() i=4 2024-09-12T00:43:40.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.603+0000 7f515740f9c0 20 add_watcher() i=5 2024-09-12T00:43:40.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.603+0000 7f515740f9c0 20 add_watcher() i=6 2024-09-12T00:43:40.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.607+0000 7f515740f9c0 20 add_watcher() i=7 2024-09-12T00:43:40.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.607+0000 7f515740f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:40.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.607+0000 7f500b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 5 note: GC not initialized 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f500a7e4640 20 reqs_thread_entry: start 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 Filter name: none 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f5003fff640 20 reqs_thread_entry: start 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:40.693 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 INFO: main: starting shard=0 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.611+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 INFO: main: starting shard=1 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 INFO: main: starting shard=2 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:43:40.694 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 INFO: main: starting shard=3 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 INFO: main: starting shard=4 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 INFO: main: starting shard=5 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:43:40.695 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.615+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 INFO: main: starting shard=6 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 INFO: main: starting shard=7 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 INFO: main: starting shard=8 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.696 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 INFO: main: starting shard=9 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.619+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 INFO: main: starting shard=10 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 INFO: main: starting shard=11 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 INFO: main: starting shard=12 2024-09-12T00:43:40.697 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.623+0000 7f515740f9c0 20 INFO: main: done 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.627+0000 7f500b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.631+0000 7f515740f9c0 20 remove_watcher() i=0 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.631+0000 7f515740f9c0 2 removed watcher, disabling cache 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.631+0000 7f515740f9c0 20 remove_watcher() i=1 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.635+0000 7f515740f9c0 20 remove_watcher() i=2 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.639+0000 7f515740f9c0 20 remove_watcher() i=3 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.639+0000 7f515740f9c0 20 remove_watcher() i=4 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.639+0000 7f515740f9c0 20 remove_watcher() i=5 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.643+0000 7f515740f9c0 20 remove_watcher() i=6 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.643+0000 7f515740f9c0 20 remove_watcher() i=7 2024-09-12T00:43:40.698 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:43:40.699 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:40.699 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:40.734 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.731+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.735 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.735+0000 7fc85a48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.735+0000 7fc85a48d9c0 20 realm 2024-09-12T00:43:40.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.735+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.735+0000 7fc85a48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.735+0000 7fc85a48d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:40.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.735+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.735+0000 7fc85a48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.736 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.735+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.735+0000 7fc85a48d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:40.737 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.735+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.739+0000 7fc85a48d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:40.739 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.739+0000 7fc85a48d9c0 20 searching for the correct realm 2024-09-12T00:43:40.743 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.743+0000 7fc858794640 0 -- 172.21.15.102:0/3573471406 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x557c47b8b8b0 msgr2=0x557c47b8dcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:40.749 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.747+0000 7fc857792640 0 -- 172.21.15.102:0/3573471406 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fc8500ca910 msgr2=0x7fc8500b23f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:40.964 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:40.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.963+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:40.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 zone default found 2024-09-12T00:43:40.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 4 Realm: () 2024-09-12T00:43:40.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:40.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:40.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:40.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 zonegroup default 2024-09-12T00:43:40.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:40.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:40.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 started sync module instance, tier type = 2024-09-12T00:43:40.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.967+0000 7fc85a48d9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:40.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.991+0000 7fc85a48d9c0 20 add_watcher() i=0 2024-09-12T00:43:40.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.991+0000 7fc85a48d9c0 20 add_watcher() i=1 2024-09-12T00:43:40.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.991+0000 7fc85a48d9c0 20 add_watcher() i=2 2024-09-12T00:43:40.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.991+0000 7fc85a48d9c0 20 add_watcher() i=3 2024-09-12T00:43:40.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.991+0000 7fc85a48d9c0 20 add_watcher() i=4 2024-09-12T00:43:40.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.991+0000 7fc85a48d9c0 20 add_watcher() i=5 2024-09-12T00:43:40.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.991+0000 7fc85a48d9c0 20 add_watcher() i=6 2024-09-12T00:43:40.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.991+0000 7fc85a48d9c0 20 add_watcher() i=7 2024-09-12T00:43:40.994 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.991+0000 7fc85a48d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:40.997 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.995+0000 7fc70dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:40.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.995+0000 7fc85a48d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:40.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.995+0000 7fc85a48d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:40.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 5 note: GC not initialized 2024-09-12T00:43:40.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc70cfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:40.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:40.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 20 Filter name: none 2024-09-12T00:43:40.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc6867fc640 20 reqs_thread_entry: start 2024-09-12T00:43:40.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:43:40.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:41.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:43:41.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:43:41.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : miss 2024-09-12T00:43:41.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:43:41.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:41.002 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:41.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:41.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:41.003 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:40.999+0000 7fc85a48d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:43:41.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc85a48d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:41.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc85a48d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:41.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc85a48d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:41.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc85a48d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:43:41.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc7367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398947 cookie 93992267632576 notifier 7982 bl.length()=911 2024-09-12T00:43:41.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc7367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:41.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc7367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:41.011 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc7367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:41.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:43:41.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:43:41.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:43:41.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.011+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:43:41.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.023+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.0 2024-09-12T00:43:41.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.023+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.0 2024-09-12T00:43:41.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.023+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:43:41.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.023+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:43:41.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.023+0000 7fc85a48d9c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:43:41.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.023+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:43:41.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.023+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:43:41.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.027+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:43:41.026 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.027+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:43:41.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.027+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:43:41.027 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.027+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:43:41.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.027+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:43:41.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.027+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:43:41.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.027+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:43:41.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.027+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:43:41.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.031+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:43:41.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.031+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:43:41.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.031+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:43:41.031 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.031+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:43:41.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.031+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:43:41.033 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.031+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:43:41.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.035+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:43:41.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.035+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:43:41.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.035+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:43:41.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.035+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:43:41.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.035+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:43:41.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.035+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:43:41.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.035+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:43:41.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.035+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:43:41.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.039+0000 7fc85a48d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:41.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.039+0000 7fc85a48d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:43:41.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.039+0000 7fc85a48d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:41.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.039+0000 7fc85a48d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:41.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.039+0000 7fc85a48d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:41.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.039+0000 7fc85a48d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:43:41.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.043+0000 7fc7367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398948 cookie 93992267632576 notifier 7982 bl.length()=911 2024-09-12T00:43:41.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.043+0000 7fc7367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:41.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.043+0000 7fc7367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:41.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.043+0000 7fc7367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:41.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.043+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:43:41.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.043+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:43:41.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.043+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:43:41.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.043+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:43:41.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.051+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:43:41.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.051+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.0 2024-09-12T00:43:41.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.051+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:43:41.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.051+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.1 2024-09-12T00:43:41.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.051+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:43:41.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.051+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.2 2024-09-12T00:43:41.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.055+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:43:41.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.055+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.3 2024-09-12T00:43:41.055 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.055+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:43:41.056 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.055+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.4 2024-09-12T00:43:41.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.055+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:43:41.057 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.055+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.5 2024-09-12T00:43:41.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.055+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:43:41.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.055+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.6 2024-09-12T00:43:41.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.059+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:43:41.058 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.059+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.7 2024-09-12T00:43:41.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.059+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:43:41.059 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.059+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.8 2024-09-12T00:43:41.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.059+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:43:41.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.059+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.9 2024-09-12T00:43:41.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.059+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:43:41.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.059+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.10 2024-09-12T00:43:41.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.059+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:43:41.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.059+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.11 2024-09-12T00:43:41.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.063+0000 7fc85a48d9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:43:41.062 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.063+0000 7fc85a48d9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.2.12 2024-09-12T00:43:41.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.063+0000 7fc85a48d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:41.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.063+0000 7fc85a48d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 2024-09-12T00:43:41.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.063+0000 7fc85a48d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:41.065 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.063+0000 7fc85a48d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:41.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.063+0000 7fc85a48d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:41.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.063+0000 7fc85a48d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18, ofs0, ns] 2024-09-12T00:43:41.066 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.067+0000 7fc736ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398949 cookie 93992267632576 notifier 7982 bl.length()=879 2024-09-12T00:43:41.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.067+0000 7fc736ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 info.flags=0x17 2024-09-12T00:43:41.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.067+0000 7fc736ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18 to cache LRU end 2024-09-12T00:43:41.067 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.067+0000 7fc736ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:41.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.071+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_sources= new_sources= 2024-09-12T00:43:41.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.071+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential sources added=[] removed=[] 2024-09-12T00:43:41.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.071+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): orig_dests= new_dests= 2024-09-12T00:43:41.070 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.071+0000 7fc85a48d9c0 20 handle_bi_update(): bucket=:a-bucket[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18]): potential dests added=[] removed=[] 2024-09-12T00:43:41.075 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.075+0000 7fc85a48d9c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T00:43:41.080 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.079+0000 7fc70dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:41.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.083+0000 7fc85a48d9c0 20 remove_watcher() i=0 2024-09-12T00:43:41.085 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.083+0000 7fc85a48d9c0 2 removed watcher, disabling cache 2024-09-12T00:43:41.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.087+0000 7fc85a48d9c0 20 remove_watcher() i=1 2024-09-12T00:43:41.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.091+0000 7fc85a48d9c0 20 remove_watcher() i=2 2024-09-12T00:43:41.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.091+0000 7fc85a48d9c0 20 remove_watcher() i=3 2024-09-12T00:43:41.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.095+0000 7fc85a48d9c0 20 remove_watcher() i=4 2024-09-12T00:43:41.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.095+0000 7fc85a48d9c0 20 remove_watcher() i=5 2024-09-12T00:43:41.097 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.095+0000 7fc85a48d9c0 20 remove_watcher() i=6 2024-09-12T00:43:41.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.099+0000 7fc85a48d9c0 20 remove_watcher() i=7 2024-09-12T00:43:41.117 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:43:41.147 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:41.148 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:41.192 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.191+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.195+0000 7f76a09609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.195+0000 7f76a09609c0 20 realm 2024-09-12T00:43:41.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.195+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.195+0000 7f76a09609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.195+0000 7f76a09609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:41.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.195+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.195+0000 7f76a09609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.195+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.195+0000 7f76a09609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:41.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.195+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.199+0000 7f76a09609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:41.199 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.199+0000 7f76a09609c0 20 searching for the correct realm 2024-09-12T00:43:41.201 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.199+0000 7f769ec67640 0 -- 172.21.15.102:0/4089912297 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f769406dd00 msgr2=0x7f7694063bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:41.209 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.207+0000 7f769dc65640 0 -- 172.21.15.102:0/4089912297 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f76980da400 msgr2=0x7f76980da880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:41.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.423+0000 7f76a09609c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:41.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.423+0000 7f76a09609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:41.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.423+0000 7f76a09609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:41.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.423+0000 7f76a09609c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:41.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.423+0000 7f76a09609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:41.426 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.423+0000 7f76a09609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:41.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.423+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:41.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:41.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 20 zone default found 2024-09-12T00:43:41.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 4 Realm: () 2024-09-12T00:43:41.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:41.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:41.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:41.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 20 zonegroup default 2024-09-12T00:43:41.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.427+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.431+0000 7f76a09609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.430 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.431+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.431+0000 7f76a09609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.431+0000 7f76a09609c0 20 started sync module instance, tier type = 2024-09-12T00:43:41.431 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.431+0000 7f76a09609c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:41.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.455+0000 7f76a09609c0 20 add_watcher() i=0 2024-09-12T00:43:41.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.455+0000 7f76a09609c0 20 add_watcher() i=1 2024-09-12T00:43:41.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.455+0000 7f76a09609c0 20 add_watcher() i=2 2024-09-12T00:43:41.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.455+0000 7f76a09609c0 20 add_watcher() i=3 2024-09-12T00:43:41.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.455+0000 7f76a09609c0 20 add_watcher() i=4 2024-09-12T00:43:41.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.455+0000 7f76a09609c0 20 add_watcher() i=5 2024-09-12T00:43:41.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.455+0000 7f76a09609c0 20 add_watcher() i=6 2024-09-12T00:43:41.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.455+0000 7f76a09609c0 20 add_watcher() i=7 2024-09-12T00:43:41.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.455+0000 7f76a09609c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:41.462 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f7554fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:41.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f76a09609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:41.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f76a09609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:41.463 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f76a09609c0 5 note: GC not initialized 2024-09-12T00:43:41.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f74cf7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:41.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f76a09609c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:41.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f76a09609c0 20 Filter name: none 2024-09-12T00:43:41.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f74cd7fa640 20 reqs_thread_entry: start 2024-09-12T00:43:41.464 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f76a09609c0 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:43:41.465 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.463+0000 7f76a09609c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.467+0000 7f76a09609c0 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:43:41.466 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.467+0000 7f76a09609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:41.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.467+0000 7f76a09609c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:43:41.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.467+0000 7f76a09609c0 20 INFO: main: starting shard=0 2024-09-12T00:43:41.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.467+0000 7f76a09609c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.0 2024-09-12T00:43:41.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.467+0000 7f76a09609c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18.3.0 2024-09-12T00:43:41.467 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.467+0000 7f76a09609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:41.468 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.467+0000 7f76a09609c0 20 INFO: main: done 2024-09-12T00:43:41.469 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.467+0000 7f7554fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:41.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.471+0000 7f76a09609c0 20 remove_watcher() i=0 2024-09-12T00:43:41.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.471+0000 7f76a09609c0 2 removed watcher, disabling cache 2024-09-12T00:43:41.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.475+0000 7f76a09609c0 20 remove_watcher() i=1 2024-09-12T00:43:41.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.475+0000 7f76a09609c0 20 remove_watcher() i=2 2024-09-12T00:43:41.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.479+0000 7f76a09609c0 20 remove_watcher() i=3 2024-09-12T00:43:41.482 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.479+0000 7f76a09609c0 20 remove_watcher() i=4 2024-09-12T00:43:41.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.483+0000 7f76a09609c0 20 remove_watcher() i=5 2024-09-12T00:43:41.484 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.483+0000 7f76a09609c0 20 remove_watcher() i=6 2024-09-12T00:43:41.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.487+0000 7f76a09609c0 20 remove_watcher() i=7 2024-09-12T00:43:41.502 INFO:tasks.workunit.client.0.smithi102.stderr: test: PUT succeeds during reshard 2024-09-12T00:43:41.502 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:43:41.534 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:41.534 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:41.579 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.579+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.579+0000 7f3b3f3219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.579+0000 7f3b3f3219c0 20 realm 2024-09-12T00:43:41.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.579+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.579+0000 7f3b3f3219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.579+0000 7f3b3f3219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:41.581 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.579+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.579+0000 7f3b3f3219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.582 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.579+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.583+0000 7f3b3f3219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:41.583 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.583+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.583+0000 7f3b3f3219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:41.585 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.583+0000 7f3b3f3219c0 20 searching for the correct realm 2024-09-12T00:43:41.589 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.587+0000 7f3b3d628640 0 -- 172.21.15.102:0/3659127380 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x559b8cbbb490 msgr2=0x559b8cbbd880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:41.595 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.595+0000 7f3b3c626640 0 -- 172.21.15.102:0/3659127380 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f3b34019440 msgr2=0x7f3b340198a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:41.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.811+0000 7f3b3f3219c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:41.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.811+0000 7f3b3f3219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:41.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.811+0000 7f3b3f3219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:41.813 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.811+0000 7f3b3f3219c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:41.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.811+0000 7f3b3f3219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:41.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.811+0000 7f3b3f3219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:41.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.811+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.811+0000 7f3b3f3219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.814 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.811+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:41.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:41.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 zone default found 2024-09-12T00:43:41.815 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 4 Realm: () 2024-09-12T00:43:41.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:41.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:41.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:41.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 zonegroup default 2024-09-12T00:43:41.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.816 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.817 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 started sync module instance, tier type = 2024-09-12T00:43:41.818 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.815+0000 7f3b3f3219c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:41.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.839+0000 7f3b3f3219c0 20 add_watcher() i=0 2024-09-12T00:43:41.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.839+0000 7f3b3f3219c0 20 add_watcher() i=1 2024-09-12T00:43:41.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.839+0000 7f3b3f3219c0 20 add_watcher() i=2 2024-09-12T00:43:41.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.839+0000 7f3b3f3219c0 20 add_watcher() i=3 2024-09-12T00:43:41.840 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.839+0000 7f3b3f3219c0 20 add_watcher() i=4 2024-09-12T00:43:41.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.839+0000 7f3b3f3219c0 20 add_watcher() i=5 2024-09-12T00:43:41.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.839+0000 7f3b3f3219c0 20 add_watcher() i=6 2024-09-12T00:43:41.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.839+0000 7f3b3f3219c0 20 add_watcher() i=7 2024-09-12T00:43:41.841 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.839+0000 7f3b3f3219c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:41.845 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.843+0000 7f39f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:41.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.847+0000 7f3b3f3219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:41.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.847+0000 7f3b3f3219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:41.846 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.847+0000 7f3b3f3219c0 5 note: GC not initialized 2024-09-12T00:43:41.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.847+0000 7f39f1fe3640 20 reqs_thread_entry: start 2024-09-12T00:43:41.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.847+0000 7f3b3f3219c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:41.847 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.847+0000 7f3b3f3219c0 20 Filter name: none 2024-09-12T00:43:41.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.847+0000 7f39637fe640 20 reqs_thread_entry: start 2024-09-12T00:43:41.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.847+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.847+0000 7f3b3f3219c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:41.848 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.847+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.851+0000 7f3b3f3219c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:41.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.851+0000 7f3b3f3219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:41.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.851+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.851+0000 7f3b3f3219c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:41.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.851+0000 7f3b3f3219c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.851+0000 7f3b3f3219c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:41.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.851+0000 7f3b3f3219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:41.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.855+0000 7f39f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:41.860 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.859+0000 7f3b3f3219c0 20 remove_watcher() i=0 2024-09-12T00:43:41.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.859+0000 7f3b3f3219c0 2 removed watcher, disabling cache 2024-09-12T00:43:41.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.863+0000 7f3b3f3219c0 20 remove_watcher() i=1 2024-09-12T00:43:41.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.863+0000 7f3b3f3219c0 20 remove_watcher() i=2 2024-09-12T00:43:41.868 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.867+0000 7f3b3f3219c0 20 remove_watcher() i=3 2024-09-12T00:43:41.869 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.867+0000 7f3b3f3219c0 20 remove_watcher() i=4 2024-09-12T00:43:41.871 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.871+0000 7f3b3f3219c0 20 remove_watcher() i=5 2024-09-12T00:43:41.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.871+0000 7f3b3f3219c0 20 remove_watcher() i=6 2024-09-12T00:43:41.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.875+0000 7f3b3f3219c0 20 remove_watcher() i=7 2024-09-12T00:43:41.889 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:41.889 INFO:tasks.workunit.client.0.smithi102.stderr:BUCKET_STATS: 2024-09-12T00:43:41.889 INFO:tasks.workunit.client.0.smithi102.stderr:bucket: myver id: 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:43:41.889 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:41.889 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T00:43:41.921 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:41.921 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:41.965 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.963+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 realm 2024-09-12T00:43:41.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:41.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:41.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:41.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:41.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:41.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.967+0000 7fca870e89c0 20 searching for the correct realm 2024-09-12T00:43:41.973 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:41.971+0000 7fca853ef640 0 -- 172.21.15.102:0/2461016326 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fca70054120 msgr2=0x7fca7005b9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:42.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.187+0000 7fca7ffff640 0 -- 172.21.15.102:0/2461016326 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fca800218f0 msgr2=0x7fca8004f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:42.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.403+0000 7fca870e89c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:42.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.403+0000 7fca870e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:42.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.403+0000 7fca870e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:42.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.403+0000 7fca870e89c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:42.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.403+0000 7fca870e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:42.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.403+0000 7fca870e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:42.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.403+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:42.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:42.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:42.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:42.407 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:42.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:42.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 20 zone default found 2024-09-12T00:43:42.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 4 Realm: () 2024-09-12T00:43:42.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:42.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:42.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:42.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 20 zonegroup default 2024-09-12T00:43:42.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:42.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:42.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.407+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:42.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.411+0000 7fca870e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:42.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.411+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:42.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.411+0000 7fca870e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:42.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.411+0000 7fca870e89c0 20 started sync module instance, tier type = 2024-09-12T00:43:42.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.411+0000 7fca870e89c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.431+0000 7fca870e89c0 20 add_watcher() i=0 2024-09-12T00:43:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.431+0000 7fca870e89c0 20 add_watcher() i=1 2024-09-12T00:43:42.433 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.431+0000 7fca870e89c0 20 add_watcher() i=2 2024-09-12T00:43:42.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.431+0000 7fca870e89c0 20 add_watcher() i=3 2024-09-12T00:43:42.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.431+0000 7fca870e89c0 20 add_watcher() i=4 2024-09-12T00:43:42.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.431+0000 7fca870e89c0 20 add_watcher() i=5 2024-09-12T00:43:42.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.431+0000 7fca870e89c0 20 add_watcher() i=6 2024-09-12T00:43:42.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.435+0000 7fca870e89c0 20 add_watcher() i=7 2024-09-12T00:43:42.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.435+0000 7fca870e89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:42.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.439+0000 7fc93afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:42.440 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.439+0000 7fca870e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:42.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.439+0000 7fca870e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:42.441 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.439+0000 7fca870e89c0 5 note: GC not initialized 2024-09-12T00:43:42.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.439+0000 7fc939fe3640 20 reqs_thread_entry: start 2024-09-12T00:43:42.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.439+0000 7fca870e89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:42.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.439+0000 7fca870e89c0 20 Filter name: none 2024-09-12T00:43:42.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.439+0000 7fc8ab7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:42.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:43:42.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:42.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:42.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:43:42.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:43:42.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 : miss 2024-09-12T00:43:42.443 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:42.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:42.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:42.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 10 adding default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:42.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:42.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:42.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.443+0000 7fca870e89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 2024-09-12T00:43:42.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.451+0000 7fca870e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:42.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.451+0000 7fca870e89c0 10 moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:42.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.451+0000 7fca870e89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:42.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.451+0000 7fca870e89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19, ofs0, ns] 2024-09-12T00:43:42.454 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.455+0000 7fc95b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398912 cookie 94797664549936 notifier 8033 bl.length()=905 2024-09-12T00:43:42.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.455+0000 7fc95b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:42.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.455+0000 7fc95b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:42.455 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.455+0000 7fc95b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:42.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.455+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_sources= new_sources= 2024-09-12T00:43:42.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.455+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential sources added=[] removed=[] 2024-09-12T00:43:42.456 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.455+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_dests= new_dests= 2024-09-12T00:43:42.457 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.455+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential dests added=[] removed=[] 2024-09-12T00:43:42.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:42.471+0000 7fca870e89c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:43:42.894 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:42.894 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:43.049 INFO:tasks.workunit.client.0.smithi102.stderr:put object successful 2024-09-12T00:43:47.471 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:47.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:47.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:47.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:47.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:47.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:47.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:47.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:47.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:47.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:47.472 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:47.473 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:47.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:47.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:47.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:47.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:47.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.0 2024-09-12T00:43:47.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.0 2024-09-12T00:43:47.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.1 2024-09-12T00:43:47.474 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.471+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.1 2024-09-12T00:43:47.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.475+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.2 2024-09-12T00:43:47.475 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.475+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.2 2024-09-12T00:43:47.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.475+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.3 2024-09-12T00:43:47.476 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.475+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.3 2024-09-12T00:43:47.477 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.475+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.4 2024-09-12T00:43:47.478 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.475+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.4 2024-09-12T00:43:47.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.479+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.5 2024-09-12T00:43:47.480 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.479+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.5 2024-09-12T00:43:47.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.479+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.6 2024-09-12T00:43:47.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.479+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.6 2024-09-12T00:43:47.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.483+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.7 2024-09-12T00:43:47.483 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.483+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.7 2024-09-12T00:43:47.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.483+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.8 2024-09-12T00:43:47.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.483+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.8 2024-09-12T00:43:47.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.487+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.9 2024-09-12T00:43:47.486 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.487+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.9 2024-09-12T00:43:47.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.487+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.10 2024-09-12T00:43:47.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.487+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.10 2024-09-12T00:43:47.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.487+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.11 2024-09-12T00:43:47.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.487+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.11 2024-09-12T00:43:47.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.491+0000 7fca870e89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:47.494 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.491+0000 7fca870e89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 2024-09-12T00:43:47.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.495+0000 7fca870e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:47.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.495+0000 7fca870e89c0 10 moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:47.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.495+0000 7fca870e89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:47.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.495+0000 7fca870e89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19, ofs0, ns] 2024-09-12T00:43:47.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.499+0000 7fc95b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398913 cookie 94797664549936 notifier 8033 bl.length()=905 2024-09-12T00:43:47.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.499+0000 7fc95b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:47.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.499+0000 7fc95b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:47.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.499+0000 7fc95b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:47.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.503+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_sources= new_sources= 2024-09-12T00:43:47.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.503+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential sources added=[] removed=[] 2024-09-12T00:43:47.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.503+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_dests= new_dests= 2024-09-12T00:43:47.503 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.503+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential dests added=[] removed=[] 2024-09-12T00:43:47.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.511+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.0 2024-09-12T00:43:47.510 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.511+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.0 2024-09-12T00:43:47.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.511+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.1 2024-09-12T00:43:47.511 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.511+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.1 2024-09-12T00:43:47.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.511+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.2 2024-09-12T00:43:47.512 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.511+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.2 2024-09-12T00:43:47.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.511+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.3 2024-09-12T00:43:47.513 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.511+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.3 2024-09-12T00:43:47.514 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.515+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.4 2024-09-12T00:43:47.515 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.515+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.4 2024-09-12T00:43:47.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.515+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.5 2024-09-12T00:43:47.516 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.515+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.5 2024-09-12T00:43:47.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.515+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.6 2024-09-12T00:43:47.517 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.515+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.6 2024-09-12T00:43:47.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.515+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.7 2024-09-12T00:43:47.518 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.515+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.7 2024-09-12T00:43:47.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.519+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.8 2024-09-12T00:43:47.519 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.519+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.8 2024-09-12T00:43:47.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.519+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.9 2024-09-12T00:43:47.520 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.519+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.9 2024-09-12T00:43:47.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.519+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.10 2024-09-12T00:43:47.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.519+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.10 2024-09-12T00:43:47.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.523+0000 7fca870e89c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.11 2024-09-12T00:43:47.522 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.523+0000 7fca870e89c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.1.11 2024-09-12T00:43:47.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.527+0000 7fca870e89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:47.526 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.527+0000 7fca870e89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 2024-09-12T00:43:47.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.527+0000 7fca870e89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:47.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.527+0000 7fca870e89c0 10 moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:47.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.531+0000 7fca870e89c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:47.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.531+0000 7fca870e89c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19, ofs0, ns] 2024-09-12T00:43:47.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.531+0000 7fc95bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398914 cookie 94797664549936 notifier 8033 bl.length()=873 2024-09-12T00:43:47.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.531+0000 7fc95bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:47.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.531+0000 7fc95bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:47.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.531+0000 7fc95bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:47.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.535+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_sources= new_sources= 2024-09-12T00:43:47.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.535+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential sources added=[] removed=[] 2024-09-12T00:43:47.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.535+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_dests= new_dests= 2024-09-12T00:43:47.535 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.535+0000 7fca870e89c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential dests added=[] removed=[] 2024-09-12T00:43:47.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.543+0000 7fca870e89c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T00:43:47.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.547+0000 7fc93afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:47.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.555+0000 7fca870e89c0 20 remove_watcher() i=0 2024-09-12T00:43:47.555 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.555+0000 7fca870e89c0 2 removed watcher, disabling cache 2024-09-12T00:43:47.558 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.555+0000 7fca870e89c0 20 remove_watcher() i=1 2024-09-12T00:43:47.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.559+0000 7fca870e89c0 20 remove_watcher() i=2 2024-09-12T00:43:47.563 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.563+0000 7fca870e89c0 20 remove_watcher() i=3 2024-09-12T00:43:47.566 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.563+0000 7fca870e89c0 20 remove_watcher() i=4 2024-09-12T00:43:47.568 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.567+0000 7fca870e89c0 20 remove_watcher() i=5 2024-09-12T00:43:47.570 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.571+0000 7fca870e89c0 20 remove_watcher() i=6 2024-09-12T00:43:47.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:47.571+0000 7fca870e89c0 20 remove_watcher() i=7 2024-09-12T00:43:48.054 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:43:48.054 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T00:43:48.062 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.062 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:48.162 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.162 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:48.336 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.336 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:48.484 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.484 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:48.560 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.560 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:48.703 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.703 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:48.773 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.774 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:48.926 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:48.926 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:48.996 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:43:49.433 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:43:50.872 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:50.872 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:51.055 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:43:51.056 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:43:51.091 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:51.091 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:51.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.135+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 realm 2024-09-12T00:43:51.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:51.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.139 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:51.140 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:51.141 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.139+0000 7fc19b97a9c0 20 searching for the correct realm 2024-09-12T00:43:51.145 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.143+0000 7fc199c81640 0 -- 172.21.15.102:0/3078553313 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fc190118b30 msgr2=0x7fc190100390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:51.153 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.151+0000 7fc198c7f640 0 -- 172.21.15.102:0/3078553313 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fc194062250 msgr2=0x7fc1940613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:51.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.367+0000 7fc19b97a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:51.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.367+0000 7fc19b97a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:51.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.367+0000 7fc19b97a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:51.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.367+0000 7fc19b97a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:51.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.367+0000 7fc19b97a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:51.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.367+0000 7fc19b97a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:51.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.367+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.367+0000 7fc19b97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.367+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:51.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:51.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 zone default found 2024-09-12T00:43:51.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 4 Realm: () 2024-09-12T00:43:51.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:51.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:51.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:51.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 zonegroup default 2024-09-12T00:43:51.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 started sync module instance, tier type = 2024-09-12T00:43:51.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.371+0000 7fc19b97a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:51.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.395+0000 7fc19b97a9c0 20 add_watcher() i=0 2024-09-12T00:43:51.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.395+0000 7fc19b97a9c0 20 add_watcher() i=1 2024-09-12T00:43:51.395 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.395+0000 7fc19b97a9c0 20 add_watcher() i=2 2024-09-12T00:43:51.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.395+0000 7fc19b97a9c0 20 add_watcher() i=3 2024-09-12T00:43:51.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.395+0000 7fc19b97a9c0 20 add_watcher() i=4 2024-09-12T00:43:51.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.395+0000 7fc19b97a9c0 20 add_watcher() i=5 2024-09-12T00:43:51.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.395+0000 7fc19b97a9c0 20 add_watcher() i=6 2024-09-12T00:43:51.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.395+0000 7fc19b97a9c0 20 add_watcher() i=7 2024-09-12T00:43:51.397 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.395+0000 7fc19b97a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:51.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.399+0000 7fc04f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:51.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.403+0000 7fc19b97a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:51.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.403+0000 7fc19b97a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:51.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.403+0000 7fc19b97a9c0 5 note: GC not initialized 2024-09-12T00:43:51.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.403+0000 7fc04e7e4640 20 reqs_thread_entry: start 2024-09-12T00:43:51.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.403+0000 7fc19b97a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:51.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.403+0000 7fc19b97a9c0 20 Filter name: none 2024-09-12T00:43:51.405 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.403+0000 7fbfbffff640 20 reqs_thread_entry: start 2024-09-12T00:43:51.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.403+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.403+0000 7fc19b97a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:51.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.403+0000 7fc19b97a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:51.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:51.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:43:51.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 INFO: main: starting shard=0 2024-09-12T00:43:51.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:51.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:51.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.409 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 INFO: main: starting shard=1 2024-09-12T00:43:51.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:51.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:51.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 INFO: main: starting shard=2 2024-09-12T00:43:51.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:51.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:51.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 INFO: main: starting shard=3 2024-09-12T00:43:51.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:51.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.407+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:51.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 INFO: main: starting shard=4 2024-09-12T00:43:51.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:51.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:51.413 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 INFO: main: starting shard=5 2024-09-12T00:43:51.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:51.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:51.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:43:51.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 INFO: main: starting shard=6 2024-09-12T00:43:51.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:51.415 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 INFO: main: starting shard=7 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.411+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 INFO: main: starting shard=8 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 INFO: main: starting shard=9 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:51.416 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:51.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.417 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 INFO: main: starting shard=10 2024-09-12T00:43:51.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:51.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:51.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 INFO: main: starting shard=11 2024-09-12T00:43:51.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:51.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:51.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 INFO: main: starting shard=12 2024-09-12T00:43:51.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:51.418 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.415+0000 7fc19b97a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:51.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.419+0000 7fc19b97a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:51.419 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.419+0000 7fc19b97a9c0 20 INFO: main: done 2024-09-12T00:43:51.420 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.419+0000 7fc04f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:51.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.423+0000 7fc19b97a9c0 20 remove_watcher() i=0 2024-09-12T00:43:51.425 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.423+0000 7fc19b97a9c0 2 removed watcher, disabling cache 2024-09-12T00:43:51.427 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.427+0000 7fc19b97a9c0 20 remove_watcher() i=1 2024-09-12T00:43:51.429 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.427+0000 7fc19b97a9c0 20 remove_watcher() i=2 2024-09-12T00:43:51.432 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.431+0000 7fc19b97a9c0 20 remove_watcher() i=3 2024-09-12T00:43:51.434 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.435+0000 7fc19b97a9c0 20 remove_watcher() i=4 2024-09-12T00:43:51.435 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.435+0000 7fc19b97a9c0 20 remove_watcher() i=5 2024-09-12T00:43:51.436 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.435+0000 7fc19b97a9c0 20 remove_watcher() i=6 2024-09-12T00:43:51.438 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.439+0000 7fc19b97a9c0 20 remove_watcher() i=7 2024-09-12T00:43:51.457 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:51.457 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:51.485 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:51.485 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:51.603 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:43:51.604 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:43:51.639 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:51.639 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:51.684 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.683+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 realm 2024-09-12T00:43:51.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.686 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:51.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.687 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:51.688 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.689 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:51.690 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.687+0000 7f74c03909c0 20 searching for the correct realm 2024-09-12T00:43:51.692 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.691+0000 7f74be697640 0 -- 172.21.15.102:0/1656948488 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f74b4113040 msgr2=0x7f74b40f9ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:51.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:51.907+0000 7f74bd695640 0 -- 172.21.15.102:0/1656948488 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f74b801f3e0 msgr2=0x7f74b801f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:52.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.123+0000 7f74c03909c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:52.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.123+0000 7f74c03909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:52.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.123+0000 7f74c03909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:52.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.123+0000 7f74c03909c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:52.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.123+0000 7f74c03909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:52.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.123+0000 7f74c03909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:52.126 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.123+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:52.127 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:52.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 zone default found 2024-09-12T00:43:52.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 4 Realm: () 2024-09-12T00:43:52.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:52.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:52.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:52.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 zonegroup default 2024-09-12T00:43:52.128 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 started sync module instance, tier type = 2024-09-12T00:43:52.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.127+0000 7f74c03909c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:52.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.151+0000 7f74c03909c0 20 add_watcher() i=0 2024-09-12T00:43:52.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.151+0000 7f74c03909c0 20 add_watcher() i=1 2024-09-12T00:43:52.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.151+0000 7f74c03909c0 20 add_watcher() i=2 2024-09-12T00:43:52.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.151+0000 7f74c03909c0 20 add_watcher() i=3 2024-09-12T00:43:52.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.151+0000 7f74c03909c0 20 add_watcher() i=4 2024-09-12T00:43:52.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.151+0000 7f74c03909c0 20 add_watcher() i=5 2024-09-12T00:43:52.154 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.151+0000 7f74c03909c0 20 add_watcher() i=6 2024-09-12T00:43:52.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.155+0000 7f74c03909c0 20 add_watcher() i=7 2024-09-12T00:43:52.156 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.155+0000 7f74c03909c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:52.161 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.159+0000 7f736f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:52.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.159+0000 7f74c03909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:52.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.159+0000 7f74c03909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:52.162 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.159+0000 7f74c03909c0 5 note: GC not initialized 2024-09-12T00:43:52.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f736e7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:52.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:52.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 Filter name: none 2024-09-12T00:43:52.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f72dffff640 20 reqs_thread_entry: start 2024-09-12T00:43:52.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.163 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:52.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.164 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:43:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 INFO: main: starting shard=0 2024-09-12T00:43:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.165 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 INFO: main: starting shard=1 2024-09-12T00:43:52.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:52.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.163+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:52.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 INFO: main: starting shard=2 2024-09-12T00:43:52.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:52.166 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 INFO: main: starting shard=3 2024-09-12T00:43:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:52.167 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:52.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 INFO: main: starting shard=4 2024-09-12T00:43:52.168 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:52.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:52.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 INFO: main: starting shard=5 2024-09-12T00:43:52.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:52.169 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.167+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:52.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.170 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 INFO: main: starting shard=6 2024-09-12T00:43:52.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:52.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:52.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 INFO: main: starting shard=7 2024-09-12T00:43:52.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:52.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:52.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 INFO: main: starting shard=8 2024-09-12T00:43:52.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:52.172 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:52.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 INFO: main: starting shard=9 2024-09-12T00:43:52.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:52.173 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.171+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:52.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:43:52.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 INFO: main: starting shard=10 2024-09-12T00:43:52.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:52.174 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:52.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 INFO: main: starting shard=11 2024-09-12T00:43:52.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:52.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:52.175 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 INFO: main: starting shard=12 2024-09-12T00:43:52.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:52.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:52.176 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.177 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.175+0000 7f74c03909c0 20 INFO: main: done 2024-09-12T00:43:52.178 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.179+0000 7f736f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:52.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.183+0000 7f74c03909c0 20 remove_watcher() i=0 2024-09-12T00:43:52.183 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.183+0000 7f74c03909c0 2 removed watcher, disabling cache 2024-09-12T00:43:52.186 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.183+0000 7f74c03909c0 20 remove_watcher() i=1 2024-09-12T00:43:52.188 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.187+0000 7f74c03909c0 20 remove_watcher() i=2 2024-09-12T00:43:52.191 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.191+0000 7f74c03909c0 20 remove_watcher() i=3 2024-09-12T00:43:52.193 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.191+0000 7f74c03909c0 20 remove_watcher() i=4 2024-09-12T00:43:52.195 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.195+0000 7f74c03909c0 20 remove_watcher() i=5 2024-09-12T00:43:52.196 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.195+0000 7f74c03909c0 20 remove_watcher() i=6 2024-09-12T00:43:52.198 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.199+0000 7f74c03909c0 20 remove_watcher() i=7 2024-09-12T00:43:52.219 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:52.219 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:52.253 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:52.253 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:52.403 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:43:52.403 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:43:52.439 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:52.439 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:52.485 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.483+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.487+0000 7f7309a459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.487+0000 7f7309a459c0 20 realm 2024-09-12T00:43:52.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.487+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.487+0000 7f7309a459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.487+0000 7f7309a459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:52.487 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.487+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.487+0000 7f7309a459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.488 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.487+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.487+0000 7f7309a459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:52.489 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.487+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.491+0000 7f7309a459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:52.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.491+0000 7f7309a459c0 20 searching for the correct realm 2024-09-12T00:43:52.491 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.491+0000 7f730754b640 0 -- 172.21.15.102:0/2951403179 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x556b5e410490 msgr2=0x556b5e412930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:52.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.495+0000 7f730754b640 0 -- 172.21.15.102:0/2951403179 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x556b5e1d46b0 msgr2=0x7f730011ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:52.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:52.719 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:52.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:52.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:52.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:52.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:52.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.720 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:52.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:52.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 zone default found 2024-09-12T00:43:52.721 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 4 Realm: () 2024-09-12T00:43:52.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:52.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:52.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:52.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 zonegroup default 2024-09-12T00:43:52.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.719+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.723+0000 7f7309a459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.722 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.723+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.723+0000 7f7309a459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.723 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.723+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.723+0000 7f7309a459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.723+0000 7f7309a459c0 20 started sync module instance, tier type = 2024-09-12T00:43:52.724 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.723+0000 7f7309a459c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:52.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.747+0000 7f7309a459c0 20 add_watcher() i=0 2024-09-12T00:43:52.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.747+0000 7f7309a459c0 20 add_watcher() i=1 2024-09-12T00:43:52.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.747+0000 7f7309a459c0 20 add_watcher() i=2 2024-09-12T00:43:52.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.747+0000 7f7309a459c0 20 add_watcher() i=3 2024-09-12T00:43:52.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.747+0000 7f7309a459c0 20 add_watcher() i=4 2024-09-12T00:43:52.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.747+0000 7f7309a459c0 20 add_watcher() i=5 2024-09-12T00:43:52.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.747+0000 7f7309a459c0 20 add_watcher() i=6 2024-09-12T00:43:52.751 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.751+0000 7f7309a459c0 20 add_watcher() i=7 2024-09-12T00:43:52.752 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.751+0000 7f7309a459c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:52.755 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.755+0000 7f71bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:52.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.755+0000 7f7309a459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:52.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.755+0000 7f7309a459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:52.756 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.755+0000 7f7309a459c0 5 note: GC not initialized 2024-09-12T00:43:52.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.755+0000 7f71bcfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:52.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.755+0000 7f7309a459c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:52.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.755+0000 7f7309a459c0 20 Filter name: none 2024-09-12T00:43:52.757 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.755+0000 7f71367fc640 20 reqs_thread_entry: start 2024-09-12T00:43:52.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.755+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:52.758 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:52.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:52.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:43:52.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 INFO: main: starting shard=0 2024-09-12T00:43:52.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:52.760 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:52.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:43:52.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 INFO: main: starting shard=1 2024-09-12T00:43:52.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:52.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:52.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.761 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 INFO: main: starting shard=2 2024-09-12T00:43:52.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:52.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.759+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:52.762 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 20 INFO: main: starting shard=3 2024-09-12T00:43:52.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:52.763 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 20 INFO: main: starting shard=4 2024-09-12T00:43:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:52.764 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:52.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 20 INFO: main: starting shard=5 2024-09-12T00:43:52.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:52.765 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.763+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:52.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.766 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 INFO: main: starting shard=6 2024-09-12T00:43:52.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:52.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:52.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 INFO: main: starting shard=7 2024-09-12T00:43:52.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:52.767 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:52.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 INFO: main: starting shard=8 2024-09-12T00:43:52.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:52.768 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:52.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.769 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 INFO: main: starting shard=9 2024-09-12T00:43:52.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:52.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.767+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:52.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.770 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 INFO: main: starting shard=10 2024-09-12T00:43:52.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:52.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:52.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 INFO: main: starting shard=11 2024-09-12T00:43:52.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:52.771 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:52.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 INFO: main: starting shard=12 2024-09-12T00:43:52.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:52.772 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:52.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:43:52.774 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.771+0000 7f7309a459c0 20 INFO: main: done 2024-09-12T00:43:52.775 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.775+0000 7f71bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:52.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.779+0000 7f7309a459c0 20 remove_watcher() i=0 2024-09-12T00:43:52.780 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.779+0000 7f7309a459c0 2 removed watcher, disabling cache 2024-09-12T00:43:52.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.783+0000 7f7309a459c0 20 remove_watcher() i=1 2024-09-12T00:43:52.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.783+0000 7f7309a459c0 20 remove_watcher() i=2 2024-09-12T00:43:52.787 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.787+0000 7f7309a459c0 20 remove_watcher() i=3 2024-09-12T00:43:52.789 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.787+0000 7f7309a459c0 20 remove_watcher() i=4 2024-09-12T00:43:52.790 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.791+0000 7f7309a459c0 20 remove_watcher() i=5 2024-09-12T00:43:52.792 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.791+0000 7f7309a459c0 20 remove_watcher() i=6 2024-09-12T00:43:52.793 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:52.791+0000 7f7309a459c0 20 remove_watcher() i=7 2024-09-12T00:43:52.813 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:52.813 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:52.839 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:43:53.280 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:43:53.714 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:43:53.741 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:53.741 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:53.781 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.779+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.783+0000 7ff8de1339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.783+0000 7ff8de1339c0 20 realm 2024-09-12T00:43:53.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.783+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.783+0000 7ff8de1339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.783+0000 7ff8de1339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:53.783 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.783+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.783+0000 7ff8de1339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.783+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.783+0000 7ff8de1339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:53.785 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.783+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.787+0000 7ff8de1339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:53.786 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.787+0000 7ff8de1339c0 20 searching for the correct realm 2024-09-12T00:43:53.791 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.791+0000 7ff8dbc39640 0 -- 172.21.15.102:0/2289800037 >> [v2:172.21.15.102:6824/1865676346,v1:172.21.15.102:6825/1865676346] conn(0x55bf83f6fc10 msgr2=0x55bf83f72050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:53.797 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.795+0000 7ff8d3438640 0 -- 172.21.15.102:0/2289800037 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7ff8d409e040 msgr2=0x7ff8d400b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:53.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:53.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:53.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:53.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:53.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:53.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:53.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.805 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.806 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:53.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:53.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 zone default found 2024-09-12T00:43:53.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 4 Realm: () 2024-09-12T00:43:53.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:53.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:53.807 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:53.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 zonegroup default 2024-09-12T00:43:53.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.803+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.807+0000 7ff8de1339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.807+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.807+0000 7ff8de1339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.807+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.807+0000 7ff8de1339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.807+0000 7ff8de1339c0 20 started sync module instance, tier type = 2024-09-12T00:43:53.808 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.807+0000 7ff8de1339c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:53.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.819+0000 7ff8de1339c0 20 add_watcher() i=0 2024-09-12T00:43:53.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.819+0000 7ff8de1339c0 20 add_watcher() i=1 2024-09-12T00:43:53.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.819+0000 7ff8de1339c0 20 add_watcher() i=2 2024-09-12T00:43:53.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.819+0000 7ff8de1339c0 20 add_watcher() i=3 2024-09-12T00:43:53.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.819+0000 7ff8de1339c0 20 add_watcher() i=4 2024-09-12T00:43:53.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.819+0000 7ff8de1339c0 20 add_watcher() i=5 2024-09-12T00:43:53.822 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.819+0000 7ff8de1339c0 20 add_watcher() i=6 2024-09-12T00:43:53.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff8de1339c0 20 add_watcher() i=7 2024-09-12T00:43:53.823 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff8de1339c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:53.825 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff791fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:53.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff8de1339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:53.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff8de1339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:53.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff8de1339c0 5 note: GC not initialized 2024-09-12T00:43:53.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff790fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:53.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff8de1339c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:53.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff8de1339c0 20 Filter name: none 2024-09-12T00:43:53.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff70a7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:53.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff8de1339c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:43:53.826 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.823+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:53.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:43:53.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:43:53.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 : miss 2024-09-12T00:43:53.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:53.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:53.827 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 10 adding default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:53.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:53.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:53.828 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.827+0000 7ff8de1339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 2024-09-12T00:43:53.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.835+0000 7ff8de1339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:53.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.835+0000 7ff8de1339c0 10 moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:53.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.835+0000 7ff8de1339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:53.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.835+0000 7ff8de1339c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19, ofs0, ns] 2024-09-12T00:43:53.837 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.835+0000 7ff7baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398915 cookie 94281041183600 notifier 8709 bl.length()=905 2024-09-12T00:43:53.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.835+0000 7ff7baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:53.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.835+0000 7ff7baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:53.838 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.835+0000 7ff7baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:53.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.839+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_sources= new_sources= 2024-09-12T00:43:53.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.839+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential sources added=[] removed=[] 2024-09-12T00:43:53.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.839+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_dests= new_dests= 2024-09-12T00:43:53.839 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.839+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential dests added=[] removed=[] 2024-09-12T00:43:53.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.0 2024-09-12T00:43:53.849 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.0 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.1 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.1 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.2 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.2 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.3 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.3 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.4 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.4 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.5 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.5 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.6 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.6 2024-09-12T00:43:53.850 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.7 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.7 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.8 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.8 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.10 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.10 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.11 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.11 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.12 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.12 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.13 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.13 2024-09-12T00:43:53.851 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.14 2024-09-12T00:43:53.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.14 2024-09-12T00:43:53.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.15 2024-09-12T00:43:53.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.15 2024-09-12T00:43:53.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.16 2024-09-12T00:43:53.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.16 2024-09-12T00:43:53.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:53.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:53.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:53.852 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.847+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:53.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.851+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:53.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.851+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:53.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.851+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:53.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.851+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:53.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.851+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:53.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.851+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:53.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.851+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:53.853 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.851+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:53.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.851+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:53.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.851+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:53.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:53.854 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:53.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:53.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:53.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:53.855 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:53.856 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:53.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:53.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:53.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:53.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:53.857 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.855+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:53.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.859+0000 7ff8de1339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:53.861 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.859+0000 7ff8de1339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 2024-09-12T00:43:53.863 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff8de1339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:53.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff8de1339c0 10 moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:53.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff8de1339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:53.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff8de1339c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19, ofs0, ns] 2024-09-12T00:43:53.864 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff7ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398916 cookie 94281041183600 notifier 8709 bl.length()=905 2024-09-12T00:43:53.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff7ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:53.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff7ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:53.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff7ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:53.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_sources= new_sources= 2024-09-12T00:43:53.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential sources added=[] removed=[] 2024-09-12T00:43:53.865 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_dests= new_dests= 2024-09-12T00:43:53.866 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.863+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential dests added=[] removed=[] 2024-09-12T00:43:53.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.871+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:53.872 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.871+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.0 2024-09-12T00:43:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.871+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.871+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.1 2024-09-12T00:43:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.871+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:53.873 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.871+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.2 2024-09-12T00:43:53.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.871+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:53.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.871+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.3 2024-09-12T00:43:53.874 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:53.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.4 2024-09-12T00:43:53.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:53.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.5 2024-09-12T00:43:53.875 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:53.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.6 2024-09-12T00:43:53.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:53.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.7 2024-09-12T00:43:53.876 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:53.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.8 2024-09-12T00:43:53.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:53.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.9 2024-09-12T00:43:53.877 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:53.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.875+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.10 2024-09-12T00:43:53.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:53.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.11 2024-09-12T00:43:53.878 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff8de1339c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:53.879 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff8de1339c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.2.12 2024-09-12T00:43:53.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff8de1339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:43:53.880 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff8de1339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 2024-09-12T00:43:53.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff8de1339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:53.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff8de1339c0 10 moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:53.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff8de1339c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:53.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff8de1339c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19, ofs0, ns] 2024-09-12T00:43:53.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff7ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398917 cookie 94281041183600 notifier 8709 bl.length()=873 2024-09-12T00:43:53.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff7ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:53.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff7ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:53.882 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.879+0000 7ff7ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:53.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.883+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_sources= new_sources= 2024-09-12T00:43:53.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.883+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential sources added=[] removed=[] 2024-09-12T00:43:53.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.883+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): orig_dests= new_dests= 2024-09-12T00:43:53.883 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.883+0000 7ff8de1339c0 20 handle_bi_update(): bucket=:myver[19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19]): potential dests added=[] removed=[] 2024-09-12T00:43:53.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.887+0000 7ff8de1339c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T00:43:53.890 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.891+0000 7ff791fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:53.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.895+0000 7ff8de1339c0 20 remove_watcher() i=0 2024-09-12T00:43:53.895 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.895+0000 7ff8de1339c0 2 removed watcher, disabling cache 2024-09-12T00:43:53.897 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.895+0000 7ff8de1339c0 20 remove_watcher() i=1 2024-09-12T00:43:53.899 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.899+0000 7ff8de1339c0 20 remove_watcher() i=2 2024-09-12T00:43:53.901 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.899+0000 7ff8de1339c0 20 remove_watcher() i=3 2024-09-12T00:43:53.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.903+0000 7ff8de1339c0 20 remove_watcher() i=4 2024-09-12T00:43:53.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.903+0000 7ff8de1339c0 20 remove_watcher() i=5 2024-09-12T00:43:53.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.907+0000 7ff8de1339c0 20 remove_watcher() i=6 2024-09-12T00:43:53.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.907+0000 7ff8de1339c0 20 remove_watcher() i=7 2024-09-12T00:43:53.919 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:43:53.951 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:53.951 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:53.990 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 20 realm 2024-09-12T00:43:53.991 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:53.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.992 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:53.993 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.991+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.995+0000 7efd9d6879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:53.995 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.995+0000 7efd9d6879c0 20 searching for the correct realm 2024-09-12T00:43:53.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:53.999+0000 7efd9b18d640 0 -- 172.21.15.102:0/670206638 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x55ded92c7e20 msgr2=0x55ded92ca2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:54.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.003+0000 7efd9a98c640 0 -- 172.21.15.102:0/670206638 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7efd94068440 msgr2=0x7efd940798a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:54.012 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:54.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:54.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:54.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:54.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:54.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:54.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.013 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:54.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:54.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 zone default found 2024-09-12T00:43:54.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 4 Realm: () 2024-09-12T00:43:54.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:54.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:54.015 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:54.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 zonegroup default 2024-09-12T00:43:54.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.011+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.015+0000 7efd9d6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.015+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.015+0000 7efd9d6879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.015+0000 7efd9d6879c0 20 started sync module instance, tier type = 2024-09-12T00:43:54.016 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.015+0000 7efd9d6879c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:54.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.027+0000 7efd9d6879c0 20 add_watcher() i=0 2024-09-12T00:43:54.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.027+0000 7efd9d6879c0 20 add_watcher() i=1 2024-09-12T00:43:54.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.027+0000 7efd9d6879c0 20 add_watcher() i=2 2024-09-12T00:43:54.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.027+0000 7efd9d6879c0 20 add_watcher() i=3 2024-09-12T00:43:54.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.027+0000 7efd9d6879c0 20 add_watcher() i=4 2024-09-12T00:43:54.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.027+0000 7efd9d6879c0 20 add_watcher() i=5 2024-09-12T00:43:54.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.027+0000 7efd9d6879c0 20 add_watcher() i=6 2024-09-12T00:43:54.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 20 add_watcher() i=7 2024-09-12T00:43:54.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:54.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efc51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:54.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:54.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:54.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 5 note: GC not initialized 2024-09-12T00:43:54.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efc50fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:54.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:54.034 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 20 Filter name: none 2024-09-12T00:43:54.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efbca7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:54.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:43:54.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:54.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:43:54.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:43:54.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 : miss 2024-09-12T00:43:54.035 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.031+0000 7efd9d6879c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:54.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 info.flags=0x17 2024-09-12T00:43:54.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 10 adding default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 to cache LRU end 2024-09-12T00:43:54.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:54.036 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:43:54.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19 2024-09-12T00:43:54.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.0 2024-09-12T00:43:54.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.0 2024-09-12T00:43:54.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:43:54.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.1 2024-09-12T00:43:54.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.1 2024-09-12T00:43:54.037 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:43:54.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.2 2024-09-12T00:43:54.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.2 2024-09-12T00:43:54.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:43:54.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.3 2024-09-12T00:43:54.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.035+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.3 2024-09-12T00:43:54.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:43:54.038 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.4 2024-09-12T00:43:54.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.4 2024-09-12T00:43:54.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:43:54.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.5 2024-09-12T00:43:54.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.5 2024-09-12T00:43:54.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:43:54.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.6 2024-09-12T00:43:54.039 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.6 2024-09-12T00:43:54.040 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:43:54.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.7 2024-09-12T00:43:54.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.7 2024-09-12T00:43:54.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:43:54.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.8 2024-09-12T00:43:54.041 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.039+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.8 2024-09-12T00:43:54.042 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:43:54.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.10 2024-09-12T00:43:54.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.10 2024-09-12T00:43:54.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:43:54.043 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.11 2024-09-12T00:43:54.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.11 2024-09-12T00:43:54.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:43:54.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.12 2024-09-12T00:43:54.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.12 2024-09-12T00:43:54.044 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:43:54.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.13 2024-09-12T00:43:54.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.13 2024-09-12T00:43:54.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:43:54.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.14 2024-09-12T00:43:54.045 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.14 2024-09-12T00:43:54.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:43:54.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.15 2024-09-12T00:43:54.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.043+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.15 2024-09-12T00:43:54.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.047+0000 7efd9d6879c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:43:54.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.047+0000 7efd9d6879c0 10 bucket_obj is .dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.16 2024-09-12T00:43:54.046 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.047+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.16 2024-09-12T00:43:54.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.047+0000 7efd9d6879c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:43:54.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.047+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.047+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:x state=0x55ded92f9a08 s->prefetch_data=0 2024-09-12T00:43:54.047 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.047+0000 7efd9d6879c0 20 get_obj_state: setting s->obj_tag to wtxaui5ktj7b2wk4gnxojlye2spzgh45 2024-09-12T00:43:54.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.047+0000 7efd9d6879c0 20 get_obj_state_impl: setting s->olh_tag to 4tgy8deuse83c87ak02qie1x7gpnk16j 2024-09-12T00:43:54.048 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.047+0000 7efd9d6879c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4tgy8deuse83c87ak02qie1x7gpnk16j 2024-09-12T00:43:54.051 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.051+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.052 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.051+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.051+0000 7efd9d6879c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:43:54.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.051+0000 7efd9d6879c0 20 olh_log_entry: epoch=2 op=3 key=x[HWxW7c4vIgC8OYqNdiJ44Hcc-Tgyoxr] 2024-09-12T00:43:54.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.051+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:_:HWxW7c4vIgC8OYqNdiJ44Hcc-Tgyoxr_x state=0x55ded93282c8 s->prefetch_data=0 2024-09-12T00:43:54.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.051+0000 7efd9d6879c0 10 manifest: total_size = 11 2024-09-12T00:43:54.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.051+0000 7efd9d6879c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3674502026550225114 2024-09-12T00:43:54.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.051+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:_:HWxW7c4vIgC8OYqNdiJ44Hcc-Tgyoxr_x state=0x55ded93282c8 s->prefetch_data=0 2024-09-12T00:43:54.053 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.051+0000 7efd9d6879c0 20 prepare_atomic_modification: state is not atomic. state=0x55ded93282c8 2024-09-12T00:43:54.054 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.051+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.059+0000 7efd9d6879c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:43:54.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.059+0000 7efd9d6879c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:43:54.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.059+0000 7efd9d6879c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:43:54.060 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.059+0000 7efd9d6879c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19__shadow:HWxW7c4vIgC8OYqNdiJ44Hcc-Tgyoxr_.dFqtZnSwlrSM0nAd_npKEcb56cfOak8_0 2024-09-12T00:43:54.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.059+0000 7efc7effd640 20 handle_completion(): completion ok for obj=x[HWxW7c4vIgC8OYqNdiJ44Hcc-Tgyoxr] 2024-09-12T00:43:54.061 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.059+0000 7efd9d6879c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:43:54.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.063+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:x state=0x55ded92f9a08 s->prefetch_data=0 2024-09-12T00:43:54.063 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.063+0000 7efd9d6879c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4tgy8deuse83c87ak02qie1x7gpnk16j 2024-09-12T00:43:54.071 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.071+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.072 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.071+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.071+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.071+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:y state=0x55ded92fec48 s->prefetch_data=0 2024-09-12T00:43:54.073 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.071+0000 7efd9d6879c0 20 get_obj_state: setting s->obj_tag to 1q1ca21p1592f4w3o9c6s5u2h6kqwua4 2024-09-12T00:43:54.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.071+0000 7efd9d6879c0 20 get_obj_state_impl: setting s->olh_tag to ybbvi7ycm4y0w3k6ppd6xwofrnxzhvpw 2024-09-12T00:43:54.074 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.071+0000 7efd9d6879c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ybbvi7ycm4y0w3k6ppd6xwofrnxzhvpw 2024-09-12T00:43:54.077 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.075+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.079+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.079+0000 7efd9d6879c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:43:54.078 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.079+0000 7efd9d6879c0 20 olh_log_entry: epoch=2 op=3 key=y[N3l4XEimizFkHi9quyNKPl0RTJMgSTm] 2024-09-12T00:43:54.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.079+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:_:N3l4XEimizFkHi9quyNKPl0RTJMgSTm_y state=0x55ded93282c8 s->prefetch_data=0 2024-09-12T00:43:54.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.079+0000 7efd9d6879c0 10 manifest: total_size = 11 2024-09-12T00:43:54.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.079+0000 7efd9d6879c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3794661798014438290 2024-09-12T00:43:54.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.079+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:_:N3l4XEimizFkHi9quyNKPl0RTJMgSTm_y state=0x55ded93282c8 s->prefetch_data=0 2024-09-12T00:43:54.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.079+0000 7efd9d6879c0 20 prepare_atomic_modification: state is not atomic. state=0x55ded93282c8 2024-09-12T00:43:54.079 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.079+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.083+0000 7efd9d6879c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:43:54.083 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.083+0000 7efd9d6879c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:43:54.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.083+0000 7efd9d6879c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:43:54.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.083+0000 7efd9d6879c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19__shadow:N3l4XEimizFkHi9quyNKPl0RTJMgSTm_.lRKZfAs78-alkQDgAHKujqEoMLe1Ezi_0 2024-09-12T00:43:54.084 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.083+0000 7efc7effd640 20 handle_completion(): completion ok for obj=y[N3l4XEimizFkHi9quyNKPl0RTJMgSTm] 2024-09-12T00:43:54.087 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.087+0000 7efd9d6879c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:43:54.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.091+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:y state=0x55ded92fec48 s->prefetch_data=0 2024-09-12T00:43:54.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.091+0000 7efd9d6879c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ybbvi7ycm4y0w3k6ppd6xwofrnxzhvpw 2024-09-12T00:43:54.098 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.099+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.099+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.099 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.099+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.099+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:z state=0x55ded92fec48 s->prefetch_data=0 2024-09-12T00:43:54.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.099+0000 7efd9d6879c0 20 get_obj_state: setting s->obj_tag to 2h0mib4q82lfgt8oopyob5q5fga74ff7 2024-09-12T00:43:54.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.099+0000 7efd9d6879c0 20 get_obj_state_impl: setting s->olh_tag to gc6279xy65k6vvprfsqh7pm7wx2ae0zo 2024-09-12T00:43:54.100 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.099+0000 7efd9d6879c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gc6279xy65k6vvprfsqh7pm7wx2ae0zo 2024-09-12T00:43:54.102 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.103+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.103 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.103+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.103+0000 7efd9d6879c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:43:54.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.103+0000 7efd9d6879c0 20 olh_log_entry: epoch=2 op=3 key=z[IkCas9vZsiNkK-t4NWmc.cCfcJmplj1] 2024-09-12T00:43:54.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.103+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:_:IkCas9vZsiNkK-t4NWmc.cCfcJmplj1_z state=0x55ded93282c8 s->prefetch_data=0 2024-09-12T00:43:54.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.103+0000 7efd9d6879c0 10 manifest: total_size = 9 2024-09-12T00:43:54.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.103+0000 7efd9d6879c0 20 get_obj_state: setting s->obj_tag to 19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6044122798090085409 2024-09-12T00:43:54.104 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.103+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:_:IkCas9vZsiNkK-t4NWmc.cCfcJmplj1_z state=0x55ded93282c8 s->prefetch_data=0 2024-09-12T00:43:54.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.103+0000 7efd9d6879c0 20 prepare_atomic_modification: state is not atomic. state=0x55ded93282c8 2024-09-12T00:43:54.105 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.103+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.107+0000 7efd9d6879c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:43:54.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.107+0000 7efd9d6879c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:43:54.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.107+0000 7efd9d6879c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:43:54.109 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.107+0000 7efd9d6879c0 5 delete_objs_inline: removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19__shadow:IkCas9vZsiNkK-t4NWmc.cCfcJmplj1_.42K5D_tzkT0q0WqtctElrLKG57YhhTZ_0 2024-09-12T00:43:54.110 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.111+0000 7efc7effd640 20 handle_completion(): completion ok for obj=z[IkCas9vZsiNkK-t4NWmc.cCfcJmplj1] 2024-09-12T00:43:54.111 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.111+0000 7efd9d6879c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:43:54.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.111+0000 7efd9d6879c0 20 get_obj_state: octx=0x55ded9049ee0 obj=myver:z state=0x55ded92fec48 s->prefetch_data=0 2024-09-12T00:43:54.113 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.111+0000 7efd9d6879c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gc6279xy65k6vvprfsqh7pm7wx2ae0zo 2024-09-12T00:43:54.117 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.115+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.119+0000 7efd9d6879c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19.3.9 2024-09-12T00:43:54.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.119+0000 7efd9d6879c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:43:54.119 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.119+0000 7efd9d6879c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:43:54.120 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.119+0000 7efc51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:54.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.123+0000 7efd9d6879c0 20 remove_watcher() i=0 2024-09-12T00:43:54.124 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.123+0000 7efd9d6879c0 2 removed watcher, disabling cache 2024-09-12T00:43:54.129 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.127+0000 7efd9d6879c0 20 remove_watcher() i=1 2024-09-12T00:43:54.131 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.131+0000 7efd9d6879c0 20 remove_watcher() i=2 2024-09-12T00:43:54.133 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.131+0000 7efd9d6879c0 20 remove_watcher() i=3 2024-09-12T00:43:54.135 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.135+0000 7efd9d6879c0 20 remove_watcher() i=4 2024-09-12T00:43:54.136 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.135+0000 7efd9d6879c0 20 remove_watcher() i=5 2024-09-12T00:43:54.137 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.135+0000 7efd9d6879c0 20 remove_watcher() i=6 2024-09-12T00:43:54.138 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.139+0000 7efd9d6879c0 20 remove_watcher() i=7 2024-09-12T00:43:54.151 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:54.151 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:54.196 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:54.196 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:54.445 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:43:54.476 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:54.477 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:54.521 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.519+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.523+0000 7f9f256ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.523+0000 7f9f256ee9c0 20 realm 2024-09-12T00:43:54.523 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.523+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.523+0000 7f9f256ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.523+0000 7f9f256ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:54.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.523+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.523+0000 7f9f256ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.524 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.523+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.523+0000 7f9f256ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:54.525 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.523+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.527+0000 7f9f256ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:54.527 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.527+0000 7f9f256ee9c0 20 searching for the correct realm 2024-09-12T00:43:54.530 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.527+0000 7f9f239f5640 0 -- 172.21.15.102:0/1937495661 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f9f18008040 msgr2=0x7f9f18063a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:54.747 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.747+0000 7f9f229f3640 0 -- 172.21.15.102:0/1937495661 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f9f1c0e28f0 msgr2=0x7f9f1c0a93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:54.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.963+0000 7f9f256ee9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:43:54.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.963+0000 7f9f256ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:54.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.963+0000 7f9f256ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:54.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.963+0000 7f9f256ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:43:54.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.963+0000 7f9f256ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:54.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.963+0000 7f9f256ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:54.966 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.963+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:54.967 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:54.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 zone default found 2024-09-12T00:43:54.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 4 Realm: () 2024-09-12T00:43:54.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:43:54.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:43:54.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:54.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 zonegroup default 2024-09-12T00:43:54.968 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.969 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:54.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:54.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 started sync module instance, tier type = 2024-09-12T00:43:54.970 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.967+0000 7f9f256ee9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:43:54.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.998+0000 7f9f256ee9c0 20 add_watcher() i=0 2024-09-12T00:43:54.998 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.998+0000 7f9f256ee9c0 20 add_watcher() i=1 2024-09-12T00:43:54.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.998+0000 7f9f256ee9c0 20 add_watcher() i=2 2024-09-12T00:43:54.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.998+0000 7f9f256ee9c0 20 add_watcher() i=3 2024-09-12T00:43:54.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.998+0000 7f9f256ee9c0 20 add_watcher() i=4 2024-09-12T00:43:54.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.998+0000 7f9f256ee9c0 20 add_watcher() i=5 2024-09-12T00:43:54.999 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.998+0000 7f9f256ee9c0 20 add_watcher() i=6 2024-09-12T00:43:55.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.998+0000 7f9f256ee9c0 20 add_watcher() i=7 2024-09-12T00:43:55.001 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:54.998+0000 7f9f256ee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:55.005 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.002+0000 7f9dd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:55.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.002+0000 7f9f256ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:55.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.002+0000 7f9f256ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:55.006 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 5 note: GC not initialized 2024-09-12T00:43:55.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9dd8fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:55.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:55.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 20 Filter name: none 2024-09-12T00:43:55.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9d527fc640 20 reqs_thread_entry: start 2024-09-12T00:43:55.007 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:55.008 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:55.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:55.009 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:43:55.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.006+0000 7f9f256ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:55.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.010+0000 7f9f256ee9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:43:55.010 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.010+0000 7f9f256ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:43:55.014 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.014+0000 7f9dd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:55.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.018+0000 7f9f256ee9c0 20 remove_watcher() i=0 2024-09-12T00:43:55.019 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.018+0000 7f9f256ee9c0 2 removed watcher, disabling cache 2024-09-12T00:43:55.022 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.018+0000 7f9f256ee9c0 20 remove_watcher() i=1 2024-09-12T00:43:55.023 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.022+0000 7f9f256ee9c0 20 remove_watcher() i=2 2024-09-12T00:43:55.025 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.022+0000 7f9f256ee9c0 20 remove_watcher() i=3 2024-09-12T00:43:55.028 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.026+0000 7f9f256ee9c0 20 remove_watcher() i=4 2024-09-12T00:43:55.029 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.026+0000 7f9f256ee9c0 20 remove_watcher() i=5 2024-09-12T00:43:55.030 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.030+0000 7f9f256ee9c0 20 remove_watcher() i=6 2024-09-12T00:43:55.032 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T00:43:55.030+0000 7f9f256ee9c0 20 remove_watcher() i=7 2024-09-12T00:43:55.048 INFO:tasks.workunit.client.0.smithi102.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:43:55.048 INFO:tasks.workunit.client.0.smithi102.stderr:Deleting bucket a-bucket 2024-09-12T00:43:55.049 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:55.049 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:55.078 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:55.079 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:55.204 INFO:tasks.workunit.client.0.smithi102.stderr:Deleting bucket myver 2024-09-12T00:43:55.205 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:55.205 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:55.363 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:43:55.363 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T00:43:55.830 INFO:tasks.workunit.client.0.smithi102.stderr:Completed resharding tests 2024-09-12T00:43:55.831 INFO:tasks.workunit.client.0.smithi102.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:43:55.831 INFO:tasks.workunit.client.0.smithi102.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:43:55.831 INFO:tasks.workunit.client.0.smithi102.stdout:connected to https://localhost:443 2024-09-12T00:43:55.941 INFO:tasks.workunit.client.0.smithi102.stderr:+ deactivate 2024-09-12T00:43:55.941 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:43:55.941 INFO:tasks.workunit.client.0.smithi102.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:43:55.941 INFO:tasks.workunit.client.0.smithi102.stderr:+ export PATH 2024-09-12T00:43:55.941 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:43:55.942 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n '' ']' 2024-09-12T00:43:55.942 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:43:55.942 INFO:tasks.workunit.client.0.smithi102.stderr:+ hash -r 2024-09-12T00:43:55.942 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n '' ']' 2024-09-12T00:43:55.942 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:43:55.942 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:43:55.942 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:43:55.942 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset -f deactivate 2024-09-12T00:43:55.942 INFO:tasks.workunit.client.0.smithi102.stderr:+ echo OK. 2024-09-12T00:43:55.943 INFO:tasks.workunit.client.0.smithi102.stdout:OK. 2024-09-12T00:43:55.943 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:43:55.944 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:43:55.999 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:43:55.999 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:43:56.442 DEBUG:teuthology.parallel:result is None 2024-09-12T00:43:56.443 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:43:56.455 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:43:56.455 DEBUG:teuthology.orchestra.run.smithi102:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:43:56.502 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:43:56.502 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:43:56.516 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:43:56.516 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:43:56.516 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:43:56.517 DEBUG:teuthology.orchestra.run.smithi102:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:43:56.550 INFO:teuthology.orchestra.run.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:44:01.540 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:44:01.540 DEBUG:teuthology.orchestra.run.smithi102:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:44:01.633 INFO:teuthology.orchestra.run.smithi102.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T00:44:01.695 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-12T00:44:01.908 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-12T00:44:01.909 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-12T00:44:02.094 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:44:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:44:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:44:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:44:02.094 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:44:02.095 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:44:02.095 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:44:02.095 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-12T00:44:02.096 INFO:teuthology.orchestra.run.smithi102.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T00:44:02.096 INFO:teuthology.orchestra.run.smithi102.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T00:44:02.097 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-12T00:44:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T00:44:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T00:44:02.097 INFO:teuthology.orchestra.run.smithi102.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T00:44:02.133 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-12T00:44:02.406 INFO:teuthology.orchestra.run.smithi102.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T00:44:02.406 INFO:teuthology.orchestra.run.smithi102.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T00:44:02.406 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:44:02.407 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 46.0 MB of archives. 2024-09-12T00:44:02.407 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T00:44:02.407 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T00:44:02.682 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T00:44:03.037 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T00:44:03.037 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T00:44:03.044 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T00:44:03.044 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T00:44:04.131 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T00:44:04.133 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T00:44:04.367 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T00:44:04.786 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T00:44:04.786 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T00:44:04.786 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: falling back to frontend: Readline 2024-09-12T00:44:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T00:44:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T00:44:04.799 INFO:teuthology.orchestra.run.smithi102.stderr:debconf: falling back to frontend: Teletype 2024-09-12T00:44:04.803 INFO:teuthology.orchestra.run.smithi102.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T00:44:04.839 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 46.0 MB in 2s (19.7 MB/s) 2024-09-12T00:44:04.939 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T00:44:05.023 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T00:44:05.029 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T00:44:05.070 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T00:44:05.483 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T00:44:05.515 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:44:05.816 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:44:06.237 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T00:44:06.265 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:44:06.304 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:44:06.565 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T00:44:06.593 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:44:06.632 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:44:06.920 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T00:44:06.946 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:44:06.984 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T00:44:07.438 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T00:44:07.467 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:44:07.507 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:44:09.084 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T00:44:09.113 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:44:09.146 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:44:09.573 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T00:44:09.605 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:44:09.643 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:44:10.417 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T00:44:10.435 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:44:10.479 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:44:10.972 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:44:12.092 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T00:44:12.119 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T00:44:12.143 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T00:44:12.526 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T00:44:12.711 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:44:13.062 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:44:13.171 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T00:44:13.248 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:44:13.340 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T00:44:13.360 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T00:44:13.387 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T00:44:13.412 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T00:44:13.539 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T00:44:13.683 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T00:44:13.809 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T00:44:13.910 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T00:44:13.961 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T00:44:14.012 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T00:44:14.037 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T00:44:14.064 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T00:44:14.127 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:44:14.253 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T00:44:14.354 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:44:14.438 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T00:44:14.523 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:44:14.650 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T00:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:44:16.606 INFO:teuthology.orchestra.run.smithi102.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:44:16.633 INFO:teuthology.orchestra.run.smithi102.stderr:--2024-09-12 00:44:16-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:44:16.636 INFO:teuthology.orchestra.run.smithi102.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4965, ... 2024-09-12T00:44:16.650 INFO:teuthology.orchestra.run.smithi102.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-12T00:44:16.701 INFO:teuthology.orchestra.run.smithi102.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:44:16.701 INFO:teuthology.orchestra.run.smithi102.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:44:16.701 INFO:teuthology.orchestra.run.smithi102.stderr:--2024-09-12 00:44:16-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:44:16.711 INFO:teuthology.orchestra.run.smithi102.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-09-12T00:44:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-09-12T00:44:16.820 INFO:teuthology.orchestra.run.smithi102.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:44:16.820 INFO:teuthology.orchestra.run.smithi102.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T004416Z&X-Amz-Expires=300&X-Amz-Signature=68763d94da287da2985c49d76411918c7ff3d7e06f4e10cfdbda66d243c50c30&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:44:16.820 INFO:teuthology.orchestra.run.smithi102.stderr:--2024-09-12 00:44:16-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T004416Z&X-Amz-Expires=300&X-Amz-Signature=68763d94da287da2985c49d76411918c7ff3d7e06f4e10cfdbda66d243c50c30&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:44:16.822 INFO:teuthology.orchestra.run.smithi102.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.111.133, 185.199.108.133, ... 2024-09-12T00:44:16.834 INFO:teuthology.orchestra.run.smithi102.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-09-12T00:44:16.923 INFO:teuthology.orchestra.run.smithi102.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:44:16.923 INFO:teuthology.orchestra.run.smithi102.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:44:16.923 INFO:teuthology.orchestra.run.smithi102.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T00:44:16.923 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T00:44:16.934 INFO:teuthology.orchestra.run.smithi102.stderr: 0K .......... .......... .......... .......... .......... 0% 4.06M 22s 2024-09-12T00:44:16.946 INFO:teuthology.orchestra.run.smithi102.stderr: 50K .......... .......... .......... .......... .......... 0% 4.11M 22s 2024-09-12T00:44:16.948 INFO:teuthology.orchestra.run.smithi102.stderr: 100K .......... .......... .......... .......... .......... 0% 23.9M 16s 2024-09-12T00:44:16.950 INFO:teuthology.orchestra.run.smithi102.stderr: 150K .......... .......... .......... .......... .......... 0% 19.3M 13s 2024-09-12T00:44:16.958 INFO:teuthology.orchestra.run.smithi102.stderr: 200K .......... .......... .......... .......... .......... 0% 7.14M 13s 2024-09-12T00:44:16.959 INFO:teuthology.orchestra.run.smithi102.stderr: 250K .......... .......... .......... .......... .......... 0% 37.2M 11s 2024-09-12T00:44:16.962 INFO:teuthology.orchestra.run.smithi102.stderr: 300K .......... .......... .......... .......... .......... 0% 19.4M 10s 2024-09-12T00:44:16.962 INFO:teuthology.orchestra.run.smithi102.stderr: 350K .......... .......... .......... .......... .......... 0% 60.7M 9s 2024-09-12T00:44:16.964 INFO:teuthology.orchestra.run.smithi102.stderr: 400K .......... .......... .......... .......... .......... 0% 35.6M 8s 2024-09-12T00:44:16.968 INFO:teuthology.orchestra.run.smithi102.stderr: 450K .......... .......... .......... .......... .......... 0% 9.69M 9s 2024-09-12T00:44:16.970 INFO:teuthology.orchestra.run.smithi102.stderr: 500K .......... .......... .......... .......... .......... 0% 53.6M 8s 2024-09-12T00:44:16.971 INFO:teuthology.orchestra.run.smithi102.stderr: 550K .......... .......... .......... .......... .......... 0% 34.3M 7s 2024-09-12T00:44:16.974 INFO:teuthology.orchestra.run.smithi102.stderr: 600K .......... .......... .......... .......... .......... 0% 40.3M 7s 2024-09-12T00:44:16.974 INFO:teuthology.orchestra.run.smithi102.stderr: 650K .......... .......... .......... .......... .......... 0% 149M 7s 2024-09-12T00:44:16.974 INFO:teuthology.orchestra.run.smithi102.stderr: 700K .......... .......... .......... .......... .......... 0% 76.0M 6s 2024-09-12T00:44:16.978 INFO:teuthology.orchestra.run.smithi102.stderr: 750K .......... .......... .......... .......... .......... 0% 65.2M 6s 2024-09-12T00:44:16.978 INFO:teuthology.orchestra.run.smithi102.stderr: 800K .......... .......... .......... .......... .......... 0% 67.9M 6s 2024-09-12T00:44:16.978 INFO:teuthology.orchestra.run.smithi102.stderr: 850K .......... .......... .......... .......... .......... 0% 68.5M 5s 2024-09-12T00:44:16.978 INFO:teuthology.orchestra.run.smithi102.stderr: 900K .......... .......... .......... .......... .......... 1% 146M 5s 2024-09-12T00:44:16.978 INFO:teuthology.orchestra.run.smithi102.stderr: 950K .......... .......... .......... .......... .......... 1% 98.5M 5s 2024-09-12T00:44:16.981 INFO:teuthology.orchestra.run.smithi102.stderr: 1000K .......... .......... .......... .......... .......... 1% 11.5M 5s 2024-09-12T00:44:16.981 INFO:teuthology.orchestra.run.smithi102.stderr: 1050K .......... .......... .......... .......... .......... 1% 89.0M 5s 2024-09-12T00:44:18.198 INFO:teuthology.orchestra.run.smithi102.stderr: 1100K .......... .......... .......... .......... .......... 1% 32.6M 5s 2024-09-12T00:44:18.198 INFO:teuthology.orchestra.run.smithi102.stderr: 1150K .......... .......... .......... .......... .......... 1% 133M 5s 2024-09-12T00:44:18.198 INFO:teuthology.orchestra.run.smithi102.stderr: 1200K .......... .......... .......... .......... .......... 1% 138M 4s 2024-09-12T00:44:18.198 INFO:teuthology.orchestra.run.smithi102.stderr: 1250K .......... .......... .......... .......... .......... 1% 70.0M 4s 2024-09-12T00:44:18.198 INFO:teuthology.orchestra.run.smithi102.stderr: 1300K .......... .......... .......... .......... .......... 1% 129M 4s 2024-09-12T00:44:18.198 INFO:teuthology.orchestra.run.smithi102.stderr: 1350K .......... .......... .......... .......... .......... 1% 144M 4s 2024-09-12T00:44:18.198 INFO:teuthology.orchestra.run.smithi102.stderr: 1400K .......... .......... .......... .......... .......... 1% 150M 4s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1450K .......... .......... .......... .......... .......... 1% 132M 4s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1500K .......... .......... .......... .......... .......... 1% 156M 4s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1550K .......... .......... .......... .......... .......... 1% 156M 4s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1600K .......... .......... .......... .......... .......... 1% 156M 4s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1650K .......... .......... .......... .......... .......... 1% 124M 3s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1700K .......... .......... .......... .......... .......... 1% 145M 3s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1750K .......... .......... .......... .......... .......... 1% 154M 3s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1800K .......... .......... .......... .......... .......... 1% 158M 3s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1850K .......... .......... .......... .......... .......... 2% 138M 3s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1900K .......... .......... .......... .......... .......... 2% 155M 3s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 1950K .......... .......... .......... .......... .......... 2% 134M 3s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 2000K .......... .......... .......... .......... .......... 2% 15.7M 3s 2024-09-12T00:44:18.199 INFO:teuthology.orchestra.run.smithi102.stderr: 2050K .......... .......... .......... .......... .......... 2% 101M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2100K .......... .......... .......... .......... .......... 2% 135M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2150K .......... .......... .......... .......... .......... 2% 143M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2200K .......... .......... .......... .......... .......... 2% 136M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2250K .......... .......... .......... .......... .......... 2% 58.1M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2300K .......... .......... .......... .......... .......... 2% 120M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2350K .......... .......... .......... .......... .......... 2% 142M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2400K .......... .......... .......... .......... .......... 2% 114M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2450K .......... .......... .......... .......... .......... 2% 140M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2500K .......... .......... .......... .......... .......... 2% 136M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2550K .......... .......... .......... .......... .......... 2% 134M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2600K .......... .......... .......... .......... .......... 2% 124M 3s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2650K .......... .......... .......... .......... .......... 2% 135M 2s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2700K .......... .......... .......... .......... .......... 2% 138M 2s 2024-09-12T00:44:18.200 INFO:teuthology.orchestra.run.smithi102.stderr: 2750K .......... .......... .......... .......... .......... 3% 136M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 2800K .......... .......... .......... .......... .......... 3% 116M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 2850K .......... .......... .......... .......... .......... 3% 127M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 2900K .......... .......... .......... .......... .......... 3% 140M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 2950K .......... .......... .......... .......... .......... 3% 139M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 3000K .......... .......... .......... .......... .......... 3% 116M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 3050K .......... .......... .......... .......... .......... 3% 132M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 3100K .......... .......... .......... .......... .......... 3% 146M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 3150K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 3200K .......... .......... .......... .......... .......... 3% 141M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 3250K .......... .......... .......... .......... .......... 3% 158M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 3300K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 3350K .......... .......... .......... .......... .......... 3% 150M 2s 2024-09-12T00:44:18.201 INFO:teuthology.orchestra.run.smithi102.stderr: 3400K .......... .......... .......... .......... .......... 3% 119M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3450K .......... .......... .......... .......... .......... 3% 129M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3500K .......... .......... .......... .......... .......... 3% 91.3M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3550K .......... .......... .......... .......... .......... 3% 137M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3600K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3650K .......... .......... .......... .......... .......... 3% 124M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3700K .......... .......... .......... .......... .......... 4% 141M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3750K .......... .......... .......... .......... .......... 4% 129M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3800K .......... .......... .......... .......... .......... 4% 150M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3850K .......... .......... .......... .......... .......... 4% 122M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3900K .......... .......... .......... .......... .......... 4% 133M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 3950K .......... .......... .......... .......... .......... 4% 133M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 4000K .......... .......... .......... .......... .......... 4% 143M 2s 2024-09-12T00:44:18.202 INFO:teuthology.orchestra.run.smithi102.stderr: 4050K .......... .......... .......... .......... .......... 4% 116M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4100K .......... .......... .......... .......... .......... 4% 130M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4150K .......... .......... .......... .......... .......... 4% 142M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4200K .......... .......... .......... .......... .......... 4% 118M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4250K .......... .......... .......... .......... .......... 4% 132M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4300K .......... .......... .......... .......... .......... 4% 145M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4350K .......... .......... .......... .......... .......... 4% 145M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4400K .......... .......... .......... .......... .......... 4% 146M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4450K .......... .......... .......... .......... .......... 4% 136M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4500K .......... .......... .......... .......... .......... 4% 115M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4550K .......... .......... .......... .......... .......... 4% 150M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4600K .......... .......... .......... .......... .......... 5% 149M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4650K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4700K .......... .......... .......... .......... .......... 5% 138M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4750K .......... .......... .......... .......... .......... 5% 157M 2s 2024-09-12T00:44:18.203 INFO:teuthology.orchestra.run.smithi102.stderr: 4800K .......... .......... .......... .......... .......... 5% 157M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 4850K .......... .......... .......... .......... .......... 5% 158M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 4900K .......... .......... .......... .......... .......... 5% 122M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 4950K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 5000K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 5050K .......... .......... .......... .......... .......... 5% 149M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 5100K .......... .......... .......... .......... .......... 5% 139M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 5150K .......... .......... .......... .......... .......... 5% 142M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 5200K .......... .......... .......... .......... .......... 5% 154M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 5250K .......... .......... .......... .......... .......... 5% 157M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 5300K .......... .......... .......... .......... .......... 5% 125M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 5350K .......... .......... .......... .......... .......... 5% 154M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 5400K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-12T00:44:18.204 INFO:teuthology.orchestra.run.smithi102.stderr: 5450K .......... .......... .......... .......... .......... 5% 139M 2s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 5500K .......... .......... .......... .......... .......... 5% 126M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 5550K .......... .......... .......... .......... .......... 6% 134M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 5600K .......... .......... .......... .......... .......... 6% 142M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 5650K .......... .......... .......... .......... .......... 6% 131M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 5700K .......... .......... .......... .......... .......... 6% 154M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 5750K .......... .......... .......... .......... .......... 6% 132M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 5800K .......... .......... .......... .......... .......... 6% 126M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 5850K .......... .......... .......... .......... .......... 6% 155M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 5900K .......... .......... .......... .......... .......... 6% 149M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 5950K .......... .......... .......... .......... .......... 6% 146M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 6000K .......... .......... .......... .......... .......... 6% 129M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 6050K .......... .......... .......... .......... .......... 6% 146M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 6100K .......... .......... .......... .......... .......... 6% 144M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 6150K .......... .......... .......... .......... .......... 6% 146M 1s 2024-09-12T00:44:18.205 INFO:teuthology.orchestra.run.smithi102.stderr: 6200K .......... .......... .......... .......... .......... 6% 130M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6250K .......... .......... .......... .......... .......... 6% 116M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6300K .......... .......... .......... .......... .......... 6% 140M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6350K .......... .......... .......... .......... .......... 6% 158M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6400K .......... .......... .......... .......... .......... 6% 161M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6450K .......... .......... .......... .......... .......... 6% 149M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6500K .......... .......... .......... .......... .......... 7% 152M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6550K .......... .......... .......... .......... .......... 7% 159M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6600K .......... .......... .......... .......... .......... 7% 140M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6650K .......... .......... .......... .......... .......... 7% 168M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6700K .......... .......... .......... .......... .......... 7% 171M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6750K .......... .......... .......... .......... .......... 7% 138M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6800K .......... .......... .......... .......... .......... 7% 148M 1s 2024-09-12T00:44:18.206 INFO:teuthology.orchestra.run.smithi102.stderr: 6850K .......... .......... .......... .......... .......... 7% 137M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 6900K .......... .......... .......... .......... .......... 7% 177M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 6950K .......... .......... .......... .......... .......... 7% 161M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7000K .......... .......... .......... .......... .......... 7% 162M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7050K .......... .......... .......... .......... .......... 7% 169M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7100K .......... .......... .......... .......... .......... 7% 159M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7150K .......... .......... .......... .......... .......... 7% 179M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7200K .......... .......... .......... .......... .......... 7% 163M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7250K .......... .......... .......... .......... .......... 7% 149M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7300K .......... .......... .......... .......... .......... 7% 167M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7350K .......... .......... .......... .......... .......... 7% 161M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7400K .......... .......... .......... .......... .......... 8% 167M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7450K .......... .......... .......... .......... .......... 8% 162M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7500K .......... .......... .......... .......... .......... 8% 170M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7550K .......... .......... .......... .......... .......... 8% 153M 1s 2024-09-12T00:44:18.207 INFO:teuthology.orchestra.run.smithi102.stderr: 7600K .......... .......... .......... .......... .......... 8% 169M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 7650K .......... .......... .......... .......... .......... 8% 189M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 7700K .......... .......... .......... .......... .......... 8% 186M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 7750K .......... .......... .......... .......... .......... 8% 145M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 7800K .......... .......... .......... .......... .......... 8% 191M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 7850K .......... .......... .......... .......... .......... 8% 181M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 7900K .......... .......... .......... .......... .......... 8% 167M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 7950K .......... .......... .......... .......... .......... 8% 187M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 8000K .......... .......... .......... .......... .......... 8% 157M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 8050K .......... .......... .......... .......... .......... 8% 174M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 8100K .......... .......... .......... .......... .......... 8% 177M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 8150K .......... .......... .......... .......... .......... 8% 166M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 8200K .......... .......... .......... .......... .......... 8% 171M 1s 2024-09-12T00:44:18.208 INFO:teuthology.orchestra.run.smithi102.stderr: 8250K .......... .......... .......... .......... .......... 8% 149M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8300K .......... .......... .......... .......... .......... 8% 153M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8350K .......... .......... .......... .......... .......... 9% 198M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8400K .......... .......... .......... .......... .......... 9% 158M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8450K .......... .......... .......... .......... .......... 9% 188M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8500K .......... .......... .......... .......... .......... 9% 172M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8550K .......... .......... .......... .......... .......... 9% 195M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8600K .......... .......... .......... .......... .......... 9% 192M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8650K .......... .......... .......... .......... .......... 9% 196M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8700K .......... .......... .......... .......... .......... 9% 167M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8750K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8800K .......... .......... .......... .......... .......... 9% 182M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8850K .......... .......... .......... .......... .......... 9% 188M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8900K .......... .......... .......... .......... .......... 9% 158M 1s 2024-09-12T00:44:18.209 INFO:teuthology.orchestra.run.smithi102.stderr: 8950K .......... .......... .......... .......... .......... 9% 194M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9000K .......... .......... .......... .......... .......... 9% 169M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9050K .......... .......... .......... .......... .......... 9% 198M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9100K .......... .......... .......... .......... .......... 9% 162M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9150K .......... .......... .......... .......... .......... 9% 201M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9200K .......... .......... .......... .......... .......... 9% 210M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9250K .......... .......... .......... .......... .......... 10% 196M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9300K .......... .......... .......... .......... .......... 10% 215M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9350K .......... .......... .......... .......... .......... 10% 173M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9400K .......... .......... .......... .......... .......... 10% 192M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9450K .......... .......... .......... .......... .......... 10% 199M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9500K .......... .......... .......... .......... .......... 10% 200M 1s 2024-09-12T00:44:18.210 INFO:teuthology.orchestra.run.smithi102.stderr: 9550K .......... .......... .......... .......... .......... 10% 189M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 9600K .......... .......... .......... .......... .......... 10% 200M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 9650K .......... .......... .......... .......... .......... 10% 199M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 9700K .......... .......... .......... .......... .......... 10% 186M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 9750K .......... .......... .......... .......... .......... 10% 176M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 9800K .......... .......... .......... .......... .......... 10% 167M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 9850K .......... .......... .......... .......... .......... 10% 211M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 9900K .......... .......... .......... .......... .......... 10% 210M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 9950K .......... .......... .......... .......... .......... 10% 191M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 10000K .......... .......... .......... .......... .......... 10% 162M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 10050K .......... .......... .......... .......... .......... 10% 179M 1s 2024-09-12T00:44:18.211 INFO:teuthology.orchestra.run.smithi102.stderr: 10100K .......... .......... .......... .......... .......... 10% 212M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10150K .......... .......... .......... .......... .......... 10% 221M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10200K .......... .......... .......... .......... .......... 11% 210M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10250K .......... .......... .......... .......... .......... 11% 227M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10300K .......... .......... .......... .......... .......... 11% 215M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10350K .......... .......... .......... .......... .......... 11% 176M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10400K .......... .......... .......... .......... .......... 11% 210M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10450K .......... .......... .......... .......... .......... 11% 202M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10500K .......... .......... .......... .......... .......... 11% 200M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10550K .......... .......... .......... .......... .......... 11% 193M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10600K .......... .......... .......... .......... .......... 11% 216M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10650K .......... .......... .......... .......... .......... 11% 226M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10700K .......... .......... .......... .......... .......... 11% 233M 1s 2024-09-12T00:44:18.212 INFO:teuthology.orchestra.run.smithi102.stderr: 10750K .......... .......... .......... .......... .......... 11% 187M 1s 2024-09-12T00:44:18.213 INFO:teuthology.orchestra.run.smithi102.stderr: 10800K .......... .......... .......... .......... .......... 11% 215M 1s 2024-09-12T00:44:18.213 INFO:teuthology.orchestra.run.smithi102.stderr: 10850K .......... .......... .......... .......... .......... 11% 219M 1s 2024-09-12T00:44:18.213 INFO:teuthology.orchestra.run.smithi102.stderr: 10900K .......... .......... .......... .......... .......... 11% 229M 1s 2024-09-12T00:44:18.213 INFO:teuthology.orchestra.run.smithi102.stderr: 10950K .......... .......... .......... .......... .......... 11% 207M 1s 2024-09-12T00:44:18.213 INFO:teuthology.orchestra.run.smithi102.stderr: 11000K .......... .......... .......... .......... .......... 11% 212M 1s 2024-09-12T00:44:18.213 INFO:teuthology.orchestra.run.smithi102.stderr: 11050K .......... .......... .......... .......... .......... 11% 211M 1s 2024-09-12T00:44:18.213 INFO:teuthology.orchestra.run.smithi102.stderr: 11100K .......... .......... .......... .......... .......... 12% 228M 1s 2024-09-12T00:44:18.213 INFO:teuthology.orchestra.run.smithi102.stderr: 11150K .......... .......... .......... .......... .......... 12% 173M 1s 2024-09-12T00:44:18.213 INFO:teuthology.orchestra.run.smithi102.stderr: 11200K .......... .......... .......... .......... .......... 12% 224M 1s 2024-09-12T00:44:18.213 INFO:teuthology.orchestra.run.smithi102.stderr: 11250K .......... .......... .......... .......... .......... 12% 192M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11300K .......... .......... .......... .......... .......... 12% 230M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11350K .......... .......... .......... .......... .......... 12% 190M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11400K .......... .......... .......... .......... .......... 12% 231M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11450K .......... .......... .......... .......... .......... 12% 257M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11500K .......... .......... .......... .......... .......... 12% 184M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11550K .......... .......... .......... .......... .......... 12% 228M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11600K .......... .......... .......... .......... .......... 12% 230M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11650K .......... .......... .......... .......... .......... 12% 231M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11700K .......... .......... .......... .......... .......... 12% 210M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11750K .......... .......... .......... .......... .......... 12% 226M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11800K .......... .......... .......... .......... .......... 12% 231M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11850K .......... .......... .......... .......... .......... 12% 242M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11900K .......... .......... .......... .......... .......... 12% 249M 1s 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi102.stderr: 11950K .......... .......... .......... .......... .......... 12% 201M 1s 2024-09-12T00:44:18.215 INFO:teuthology.orchestra.run.smithi102.stderr: 12000K .......... .......... .......... .......... .......... 12% 227M 1s 2024-09-12T00:44:18.215 INFO:teuthology.orchestra.run.smithi102.stderr: 12050K .......... .......... .......... .......... .......... 13% 250M 1s 2024-09-12T00:44:18.215 INFO:teuthology.orchestra.run.smithi102.stderr: 12100K .......... .......... .......... .......... .......... 13% 233M 1s 2024-09-12T00:44:18.215 INFO:teuthology.orchestra.run.smithi102.stderr: 12150K .......... .......... .......... .......... .......... 13% 220M 1s 2024-09-12T00:44:18.215 INFO:teuthology.orchestra.run.smithi102.stderr: 12200K .......... .......... .......... .......... .......... 13% 220M 1s 2024-09-12T00:44:18.215 INFO:teuthology.orchestra.run.smithi102.stderr: 12250K .......... .......... .......... .......... .......... 13% 239M 1s 2024-09-12T00:44:18.215 INFO:teuthology.orchestra.run.smithi102.stderr: 12300K .......... .......... .......... .......... .......... 13% 243M 1s 2024-09-12T00:44:18.215 INFO:teuthology.orchestra.run.smithi102.stderr: 12350K .......... .......... .......... .......... .......... 13% 194M 1s 2024-09-12T00:44:18.215 INFO:teuthology.orchestra.run.smithi102.stderr: 12400K .......... .......... .......... .......... .......... 13% 165M 1s 2024-09-12T00:44:18.215 INFO:teuthology.orchestra.run.smithi102.stderr: 12450K .......... .......... .......... .......... .......... 13% 247M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 12500K .......... .......... .......... .......... .......... 13% 253M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 12550K .......... .......... .......... .......... .......... 13% 222M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 12600K .......... .......... .......... .......... .......... 13% 235M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 12650K .......... .......... .......... .......... .......... 13% 208M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 12700K .......... .......... .......... .......... .......... 13% 251M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 12750K .......... .......... .......... .......... .......... 13% 214M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 12800K .......... .......... .......... .......... .......... 13% 237M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 12850K .......... .......... .......... .......... .......... 13% 234M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 12900K .......... .......... .......... .......... .......... 13% 249M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 12950K .......... .......... .......... .......... .......... 13% 225M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 13000K .......... .......... .......... .......... .......... 14% 260M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 13050K .......... .......... .......... .......... .......... 14% 264M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 13100K .......... .......... .......... .......... .......... 14% 249M 1s 2024-09-12T00:44:18.216 INFO:teuthology.orchestra.run.smithi102.stderr: 13150K .......... .......... .......... .......... .......... 14% 209M 1s 2024-09-12T00:44:18.217 INFO:teuthology.orchestra.run.smithi102.stderr: 13200K .......... .......... .......... .......... .......... 14% 222M 1s 2024-09-12T00:44:18.217 INFO:teuthology.orchestra.run.smithi102.stderr: 13250K .......... .......... .......... .......... .......... 14% 235M 1s 2024-09-12T00:44:18.217 INFO:teuthology.orchestra.run.smithi102.stderr: 13300K .......... .......... .......... .......... .......... 14% 202M 1s 2024-09-12T00:44:18.217 INFO:teuthology.orchestra.run.smithi102.stderr: 13350K .......... .......... .......... .......... .......... 14% 214M 1s 2024-09-12T00:44:18.217 INFO:teuthology.orchestra.run.smithi102.stderr: 13400K .......... .......... .......... .......... .......... 14% 237M 1s 2024-09-12T00:44:18.217 INFO:teuthology.orchestra.run.smithi102.stderr: 13450K .......... .......... .......... .......... .......... 14% 251M 1s 2024-09-12T00:44:18.217 INFO:teuthology.orchestra.run.smithi102.stderr: 13500K .......... .......... .......... .......... .......... 14% 244M 1s 2024-09-12T00:44:18.217 INFO:teuthology.orchestra.run.smithi102.stderr: 13550K .......... .......... .......... .......... .......... 14% 223M 1s 2024-09-12T00:44:18.217 INFO:teuthology.orchestra.run.smithi102.stderr: 13600K .......... .......... .......... .......... .......... 14% 258M 1s 2024-09-12T00:44:18.217 INFO:teuthology.orchestra.run.smithi102.stderr: 13650K .......... .......... .......... .......... .......... 14% 266M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 13700K .......... .......... .......... .......... .......... 14% 270M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 13750K .......... .......... .......... .......... .......... 14% 215M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 13800K .......... .......... .......... .......... .......... 14% 239M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 13850K .......... .......... .......... .......... .......... 14% 226M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 13900K .......... .......... .......... .......... .......... 15% 222M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 13950K .......... .......... .......... .......... .......... 15% 178M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 14000K .......... .......... .......... .......... .......... 15% 273M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 14050K .......... .......... .......... .......... .......... 15% 272M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 14100K .......... .......... .......... .......... .......... 15% 270M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 14150K .......... .......... .......... .......... .......... 15% 250M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 14200K .......... .......... .......... .......... .......... 15% 221M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 14250K .......... .......... .......... .......... .......... 15% 253M 1s 2024-09-12T00:44:18.218 INFO:teuthology.orchestra.run.smithi102.stderr: 14300K .......... .......... .......... .......... .......... 15% 272M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14350K .......... .......... .......... .......... .......... 15% 224M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14400K .......... .......... .......... .......... .......... 15% 272M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14450K .......... .......... .......... .......... .......... 15% 287M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14500K .......... .......... .......... .......... .......... 15% 289M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14550K .......... .......... .......... .......... .......... 15% 223M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14600K .......... .......... .......... .......... .......... 15% 230M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14650K .......... .......... .......... .......... .......... 15% 283M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14700K .......... .......... .......... .......... .......... 15% 269M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14750K .......... .......... .......... .......... .......... 15% 236M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14800K .......... .......... .......... .......... .......... 15% 287M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14850K .......... .......... .......... .......... .......... 16% 257M 1s 2024-09-12T00:44:18.219 INFO:teuthology.orchestra.run.smithi102.stderr: 14900K .......... .......... .......... .......... .......... 16% 252M 1s 2024-09-12T00:44:18.220 INFO:teuthology.orchestra.run.smithi102.stderr: 14950K .......... .......... .......... .......... .......... 16% 234M 1s 2024-09-12T00:44:18.220 INFO:teuthology.orchestra.run.smithi102.stderr: 15000K .......... .......... .......... .......... .......... 16% 253M 1s 2024-09-12T00:44:18.220 INFO:teuthology.orchestra.run.smithi102.stderr: 15050K .......... .......... .......... .......... .......... 16% 286M 1s 2024-09-12T00:44:18.220 INFO:teuthology.orchestra.run.smithi102.stderr: 15100K .......... .......... .......... .......... .......... 16% 236M 1s 2024-09-12T00:44:18.220 INFO:teuthology.orchestra.run.smithi102.stderr: 15150K .......... .......... .......... .......... .......... 16% 261M 1s 2024-09-12T00:44:18.220 INFO:teuthology.orchestra.run.smithi102.stderr: 15200K .......... .......... .......... .......... .......... 16% 265M 1s 2024-09-12T00:44:18.220 INFO:teuthology.orchestra.run.smithi102.stderr: 15250K .......... .......... .......... .......... .......... 16% 250M 1s 2024-09-12T00:44:18.220 INFO:teuthology.orchestra.run.smithi102.stderr: 15300K .......... .......... .......... .......... .......... 16% 263M 1s 2024-09-12T00:44:18.220 INFO:teuthology.orchestra.run.smithi102.stderr: 15350K .......... .......... .......... .......... .......... 16% 310M 1s 2024-09-12T00:44:18.220 INFO:teuthology.orchestra.run.smithi102.stderr: 15400K .......... .......... .......... .......... .......... 16% 251M 1s 2024-09-12T00:44:18.221 INFO:teuthology.orchestra.run.smithi102.stderr: 15450K .......... .......... .......... .......... .......... 16% 304M 1s 2024-09-12T00:44:18.221 INFO:teuthology.orchestra.run.smithi102.stderr: 15500K .......... .......... .......... .......... .......... 16% 277M 1s 2024-09-12T00:44:18.221 INFO:teuthology.orchestra.run.smithi102.stderr: 15550K .......... .......... .......... .......... .......... 16% 304M 1s 2024-09-12T00:44:18.221 INFO:teuthology.orchestra.run.smithi102.stderr: 15600K .......... .......... .......... .......... .......... 16% 231M 1s 2024-09-12T00:44:18.221 INFO:teuthology.orchestra.run.smithi102.stderr: 15650K .......... .......... .......... .......... .......... 16% 288M 1s 2024-09-12T00:44:18.221 INFO:teuthology.orchestra.run.smithi102.stderr: 15700K .......... .......... .......... .......... .......... 16% 293M 1s 2024-09-12T00:44:18.221 INFO:teuthology.orchestra.run.smithi102.stderr: 15750K .......... .......... .......... .......... .......... 17% 291M 1s 2024-09-12T00:44:18.221 INFO:teuthology.orchestra.run.smithi102.stderr: 15800K .......... .......... .......... .......... .......... 17% 234M 1s 2024-09-12T00:44:18.221 INFO:teuthology.orchestra.run.smithi102.stderr: 15850K .......... .......... .......... .......... .......... 17% 312M 1s 2024-09-12T00:44:18.221 INFO:teuthology.orchestra.run.smithi102.stderr: 15900K .......... .......... .......... .......... .......... 17% 266M 1s 2024-09-12T00:44:18.222 INFO:teuthology.orchestra.run.smithi102.stderr: 15950K .......... .......... .......... .......... .......... 17% 303M 1s 2024-09-12T00:44:18.222 INFO:teuthology.orchestra.run.smithi102.stderr: 16000K .......... .......... .......... .......... .......... 17% 311M 1s 2024-09-12T00:44:18.222 INFO:teuthology.orchestra.run.smithi102.stderr: 16050K .......... .......... .......... .......... .......... 17% 307M 1s 2024-09-12T00:44:18.222 INFO:teuthology.orchestra.run.smithi102.stderr: 16100K .......... .......... .......... .......... .......... 17% 268M 1s 2024-09-12T00:44:18.222 INFO:teuthology.orchestra.run.smithi102.stderr: 16150K .......... .......... .......... .......... .......... 17% 84.4M 1s 2024-09-12T00:44:18.222 INFO:teuthology.orchestra.run.smithi102.stderr: 16200K .......... .......... .......... .......... .......... 17% 287M 1s 2024-09-12T00:44:18.222 INFO:teuthology.orchestra.run.smithi102.stderr: 16250K .......... .......... .......... .......... .......... 17% 227M 1s 2024-09-12T00:44:18.222 INFO:teuthology.orchestra.run.smithi102.stderr: 16300K .......... .......... .......... .......... .......... 17% 291M 1s 2024-09-12T00:44:18.222 INFO:teuthology.orchestra.run.smithi102.stderr: 16350K .......... .......... .......... .......... .......... 17% 311M 1s 2024-09-12T00:44:18.223 INFO:teuthology.orchestra.run.smithi102.stderr: 16400K .......... .......... .......... .......... .......... 17% 296M 1s 2024-09-12T00:44:18.223 INFO:teuthology.orchestra.run.smithi102.stderr: 16450K .......... .......... .......... .......... .......... 17% 138M 1s 2024-09-12T00:44:18.223 INFO:teuthology.orchestra.run.smithi102.stderr: 16500K .......... .......... .......... .......... .......... 17% 214M 1s 2024-09-12T00:44:18.223 INFO:teuthology.orchestra.run.smithi102.stderr: 16550K .......... .......... .......... .......... .......... 17% 312M 1s 2024-09-12T00:44:18.223 INFO:teuthology.orchestra.run.smithi102.stderr: 16600K .......... .......... .......... .......... .......... 17% 318M 1s 2024-09-12T00:44:18.223 INFO:teuthology.orchestra.run.smithi102.stderr: 16650K .......... .......... .......... .......... .......... 17% 171M 1s 2024-09-12T00:44:18.223 INFO:teuthology.orchestra.run.smithi102.stderr: 16700K .......... .......... .......... .......... .......... 18% 261M 1s 2024-09-12T00:44:18.223 INFO:teuthology.orchestra.run.smithi102.stderr: 16750K .......... .......... .......... .......... .......... 18% 291M 1s 2024-09-12T00:44:18.223 INFO:teuthology.orchestra.run.smithi102.stderr: 16800K .......... .......... .......... .......... .......... 18% 239M 1s 2024-09-12T00:44:18.223 INFO:teuthology.orchestra.run.smithi102.stderr: 16850K .......... .......... .......... .......... .......... 18% 298M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 16900K .......... .......... .......... .......... .......... 18% 301M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 16950K .......... .......... .......... .......... .......... 18% 258M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17000K .......... .......... .......... .......... .......... 18% 296M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17050K .......... .......... .......... .......... .......... 18% 277M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17100K .......... .......... .......... .......... .......... 18% 319M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17150K .......... .......... .......... .......... .......... 18% 150M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17200K .......... .......... .......... .......... .......... 18% 272M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17250K .......... .......... .......... .......... .......... 18% 289M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17300K .......... .......... .......... .......... .......... 18% 266M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17350K .......... .......... .......... .......... .......... 18% 269M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17400K .......... .......... .......... .......... .......... 18% 285M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17450K .......... .......... .......... .......... .......... 18% 286M 1s 2024-09-12T00:44:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 17500K .......... .......... .......... .......... .......... 18% 234M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 17550K .......... .......... .......... .......... .......... 18% 268M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 17600K .......... .......... .......... .......... .......... 18% 310M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 17650K .......... .......... .......... .......... .......... 19% 298M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 17700K .......... .......... .......... .......... .......... 19% 310M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 17750K .......... .......... .......... .......... .......... 19% 255M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 17800K .......... .......... .......... .......... .......... 19% 316M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 17850K .......... .......... .......... .......... .......... 19% 320M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 17900K .......... .......... .......... .......... .......... 19% 275M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 17950K .......... .......... .......... .......... .......... 19% 256M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 18000K .......... .......... .......... .......... .......... 19% 283M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 18050K .......... .......... .......... .......... .......... 19% 268M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 18100K .......... .......... .......... .......... .......... 19% 316M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 18150K .......... .......... .......... .......... .......... 19% 247M 1s 2024-09-12T00:44:18.225 INFO:teuthology.orchestra.run.smithi102.stderr: 18200K .......... .......... .......... .......... .......... 19% 298M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18250K .......... .......... .......... .......... .......... 19% 274M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18300K .......... .......... .......... .......... .......... 19% 303M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18350K .......... .......... .......... .......... .......... 19% 69.7M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18400K .......... .......... .......... .......... .......... 19% 247M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18450K .......... .......... .......... .......... .......... 19% 283M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18500K .......... .......... .......... .......... .......... 19% 306M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18550K .......... .......... .......... .......... .......... 20% 264M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18600K .......... .......... .......... .......... .......... 20% 295M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18650K .......... .......... .......... .......... .......... 20% 290M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18700K .......... .......... .......... .......... .......... 20% 291M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18750K .......... .......... .......... .......... .......... 20% 268M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18800K .......... .......... .......... .......... .......... 20% 302M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18850K .......... .......... .......... .......... .......... 20% 319M 1s 2024-09-12T00:44:18.226 INFO:teuthology.orchestra.run.smithi102.stderr: 18900K .......... .......... .......... .......... .......... 20% 303M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 18950K .......... .......... .......... .......... .......... 20% 42.7M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19000K .......... .......... .......... .......... .......... 20% 250M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19050K .......... .......... .......... .......... .......... 20% 292M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19100K .......... .......... .......... .......... .......... 20% 300M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19150K .......... .......... .......... .......... .......... 20% 256M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19200K .......... .......... .......... .......... .......... 20% 312M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19250K .......... .......... .......... .......... .......... 20% 272M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19300K .......... .......... .......... .......... .......... 20% 317M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19350K .......... .......... .......... .......... .......... 20% 253M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19400K .......... .......... .......... .......... .......... 20% 306M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19450K .......... .......... .......... .......... .......... 20% 307M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19500K .......... .......... .......... .......... .......... 21% 315M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19550K .......... .......... .......... .......... .......... 21% 270M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19600K .......... .......... .......... .......... .......... 21% 321M 1s 2024-09-12T00:44:18.227 INFO:teuthology.orchestra.run.smithi102.stderr: 19650K .......... .......... .......... .......... .......... 21% 305M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 19700K .......... .......... .......... .......... .......... 21% 296M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 19750K .......... .......... .......... .......... .......... 21% 249M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 19800K .......... .......... .......... .......... .......... 21% 316M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 19850K .......... .......... .......... .......... .......... 21% 291M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 19900K .......... .......... .......... .......... .......... 21% 202M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 19950K .......... .......... .......... .......... .......... 21% 275M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 20000K .......... .......... .......... .......... .......... 21% 309M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 20050K .......... .......... .......... .......... .......... 21% 295M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 20100K .......... .......... .......... .......... .......... 21% 255M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 20150K .......... .......... .......... .......... .......... 21% 235M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 20200K .......... .......... .......... .......... .......... 21% 306M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 20250K .......... .......... .......... .......... .......... 21% 277M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 20300K .......... .......... .......... .......... .......... 21% 291M 1s 2024-09-12T00:44:18.228 INFO:teuthology.orchestra.run.smithi102.stderr: 20350K .......... .......... .......... .......... .......... 21% 252M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20400K .......... .......... .......... .......... .......... 22% 292M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20450K .......... .......... .......... .......... .......... 22% 276M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20500K .......... .......... .......... .......... .......... 22% 314M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20550K .......... .......... .......... .......... .......... 22% 321M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20600K .......... .......... .......... .......... .......... 22% 228M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20650K .......... .......... .......... .......... .......... 22% 276M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20700K .......... .......... .......... .......... .......... 22% 256M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20750K .......... .......... .......... .......... .......... 22% 314M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20800K .......... .......... .......... .......... .......... 22% 302M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20850K .......... .......... .......... .......... .......... 22% 292M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20900K .......... .......... .......... .......... .......... 22% 272M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 20950K .......... .......... .......... .......... .......... 22% 322M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 21000K .......... .......... .......... .......... .......... 22% 319M 1s 2024-09-12T00:44:18.229 INFO:teuthology.orchestra.run.smithi102.stderr: 21050K .......... .......... .......... .......... .......... 22% 291M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21100K .......... .......... .......... .......... .......... 22% 251M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21150K .......... .......... .......... .......... .......... 22% 306M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21200K .......... .......... .......... .......... .......... 22% 301M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21250K .......... .......... .......... .......... .......... 22% 317M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21300K .......... .......... .......... .......... .......... 22% 276M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21350K .......... .......... .......... .......... .......... 23% 104M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21400K .......... .......... .......... .......... .......... 23% 102M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21450K .......... .......... .......... .......... .......... 23% 241M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21500K .......... .......... .......... .......... .......... 23% 224M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21550K .......... .......... .......... .......... .......... 23% 289M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21600K .......... .......... .......... .......... .......... 23% 298M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21650K .......... .......... .......... .......... .......... 23% 307M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21700K .......... .......... .......... .......... .......... 23% 270M 1s 2024-09-12T00:44:18.230 INFO:teuthology.orchestra.run.smithi102.stderr: 21750K .......... .......... .......... .......... .......... 23% 317M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 21800K .......... .......... .......... .......... .......... 23% 321M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 21850K .......... .......... .......... .......... .......... 23% 73.6M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 21900K .......... .......... .......... .......... .......... 23% 180M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 21950K .......... .......... .......... .......... .......... 23% 321M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22000K .......... .......... .......... .......... .......... 23% 286M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22050K .......... .......... .......... .......... .......... 23% 242M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22100K .......... .......... .......... .......... .......... 23% 255M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22150K .......... .......... .......... .......... .......... 23% 317M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22200K .......... .......... .......... .......... .......... 23% 137M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22250K .......... .......... .......... .......... .......... 24% 275M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22300K .......... .......... .......... .......... .......... 24% 252M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22350K .......... .......... .......... .......... .......... 24% 283M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22400K .......... .......... .......... .......... .......... 24% 299M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22450K .......... .......... .......... .......... .......... 24% 293M 1s 2024-09-12T00:44:18.231 INFO:teuthology.orchestra.run.smithi102.stderr: 22500K .......... .......... .......... .......... .......... 24% 261M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 22550K .......... .......... .......... .......... .......... 24% 321M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 22600K .......... .......... .......... .......... .......... 24% 291M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 22650K .......... .......... .......... .......... .......... 24% 315M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 22700K .......... .......... .......... .......... .......... 24% 244M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 22750K .......... .......... .......... .......... .......... 24% 292M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 22800K .......... .......... .......... .......... .......... 24% 296M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 22850K .......... .......... .......... .......... .......... 24% 301M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 22900K .......... .......... .......... .......... .......... 24% 279M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 22950K .......... .......... .......... .......... .......... 24% 283M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 23000K .......... .......... .......... .......... .......... 24% 310M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 23050K .......... .......... .......... .......... .......... 24% 311M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 23100K .......... .......... .......... .......... .......... 24% 227M 1s 2024-09-12T00:44:18.232 INFO:teuthology.orchestra.run.smithi102.stderr: 23150K .......... .......... .......... .......... .......... 24% 307M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23200K .......... .......... .......... .......... .......... 25% 293M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23250K .......... .......... .......... .......... .......... 25% 271M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23300K .......... .......... .......... .......... .......... 25% 289M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23350K .......... .......... .......... .......... .......... 25% 304M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23400K .......... .......... .......... .......... .......... 25% 286M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23450K .......... .......... .......... .......... .......... 25% 275M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23500K .......... .......... .......... .......... .......... 25% 270M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23550K .......... .......... .......... .......... .......... 25% 325M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23600K .......... .......... .......... .......... .......... 25% 146M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23650K .......... .......... .......... .......... .......... 25% 276M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23700K .......... .......... .......... .......... .......... 25% 248M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23750K .......... .......... .......... .......... .......... 25% 320M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23800K .......... .......... .......... .......... .......... 25% 306M 1s 2024-09-12T00:44:18.233 INFO:teuthology.orchestra.run.smithi102.stderr: 23850K .......... .......... .......... .......... .......... 25% 322M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 23900K .......... .......... .......... .......... .......... 25% 203M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 23950K .......... .......... .......... .......... .......... 25% 284M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 24000K .......... .......... .......... .......... .......... 25% 319M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 24050K .......... .......... .......... .......... .......... 25% 319M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 24100K .......... .......... .......... .......... .......... 25% 216M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 24150K .......... .......... .......... .......... .......... 26% 280M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 24200K .......... .......... .......... .......... .......... 26% 306M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 24250K .......... .......... .......... .......... .......... 26% 325M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 24300K .......... .......... .......... .......... .......... 26% 246M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 24350K .......... .......... .......... .......... .......... 26% 315M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 24400K .......... .......... .......... .......... .......... 26% 135M 1s 2024-09-12T00:44:18.234 INFO:teuthology.orchestra.run.smithi102.stderr: 24450K .......... .......... .......... .......... .......... 26% 282M 1s 2024-09-12T00:44:18.235 INFO:teuthology.orchestra.run.smithi102.stderr: 24500K .......... .......... .......... .......... .......... 26% 188M 1s 2024-09-12T00:44:18.235 INFO:teuthology.orchestra.run.smithi102.stderr: 24550K .......... .......... .......... .......... .......... 26% 164M 1s 2024-09-12T00:44:18.235 INFO:teuthology.orchestra.run.smithi102.stderr: 24600K .......... .......... .......... .......... .......... 26% 256M 1s 2024-09-12T00:44:18.235 INFO:teuthology.orchestra.run.smithi102.stderr: 24650K .......... .......... .......... .......... .......... 26% 261M 0s 2024-09-12T00:44:18.235 INFO:teuthology.orchestra.run.smithi102.stderr: 24700K .......... .......... .......... .......... .......... 26% 49.2M 1s 2024-09-12T00:44:18.235 INFO:teuthology.orchestra.run.smithi102.stderr: 24750K .......... .......... .......... .......... .......... 26% 208M 1s 2024-09-12T00:44:18.235 INFO:teuthology.orchestra.run.smithi102.stderr: 24800K .......... .......... .......... .......... .......... 26% 249M 0s 2024-09-12T00:44:18.235 INFO:teuthology.orchestra.run.smithi102.stderr: 24850K .......... .......... .......... .......... .......... 26% 249M 0s 2024-09-12T00:44:18.236 INFO:teuthology.orchestra.run.smithi102.stderr: 24900K .......... .......... .......... .......... .......... 26% 240M 0s 2024-09-12T00:44:18.236 INFO:teuthology.orchestra.run.smithi102.stderr: 24950K .......... .......... .......... .......... .......... 26% 242M 0s 2024-09-12T00:44:18.236 INFO:teuthology.orchestra.run.smithi102.stderr: 25000K .......... .......... .......... .......... .......... 26% 265M 0s 2024-09-12T00:44:18.236 INFO:teuthology.orchestra.run.smithi102.stderr: 25050K .......... .......... .......... .......... .......... 27% 255M 0s 2024-09-12T00:44:18.236 INFO:teuthology.orchestra.run.smithi102.stderr: 25100K .......... .......... .......... .......... .......... 27% 208M 0s 2024-09-12T00:44:18.236 INFO:teuthology.orchestra.run.smithi102.stderr: 25150K .......... .......... .......... .......... .......... 27% 252M 0s 2024-09-12T00:44:18.236 INFO:teuthology.orchestra.run.smithi102.stderr: 25200K .......... .......... .......... .......... .......... 27% 239M 0s 2024-09-12T00:44:18.236 INFO:teuthology.orchestra.run.smithi102.stderr: 25250K .......... .......... .......... .......... .......... 27% 247M 0s 2024-09-12T00:44:18.236 INFO:teuthology.orchestra.run.smithi102.stderr: 25300K .......... .......... .......... .......... .......... 27% 235M 0s 2024-09-12T00:44:18.236 INFO:teuthology.orchestra.run.smithi102.stderr: 25350K .......... .......... .......... .......... .......... 27% 260M 0s 2024-09-12T00:44:18.237 INFO:teuthology.orchestra.run.smithi102.stderr: 25400K .......... .......... .......... .......... .......... 27% 244M 0s 2024-09-12T00:44:18.237 INFO:teuthology.orchestra.run.smithi102.stderr: 25450K .......... .......... .......... .......... .......... 27% 233M 0s 2024-09-12T00:44:18.237 INFO:teuthology.orchestra.run.smithi102.stderr: 25500K .......... .......... .......... .......... .......... 27% 256M 0s 2024-09-12T00:44:18.237 INFO:teuthology.orchestra.run.smithi102.stderr: 25550K .......... .......... .......... .......... .......... 27% 250M 0s 2024-09-12T00:44:18.237 INFO:teuthology.orchestra.run.smithi102.stderr: 25600K .......... .......... .......... .......... .......... 27% 207M 0s 2024-09-12T00:44:18.237 INFO:teuthology.orchestra.run.smithi102.stderr: 25650K .......... .......... .......... .......... .......... 27% 239M 0s 2024-09-12T00:44:18.237 INFO:teuthology.orchestra.run.smithi102.stderr: 25700K .......... .......... .......... .......... .......... 27% 237M 0s 2024-09-12T00:44:18.237 INFO:teuthology.orchestra.run.smithi102.stderr: 25750K .......... .......... .......... .......... .......... 27% 250M 0s 2024-09-12T00:44:18.237 INFO:teuthology.orchestra.run.smithi102.stderr: 25800K .......... .......... .......... .......... .......... 27% 220M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 25850K .......... .......... .......... .......... .......... 27% 265M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 25900K .......... .......... .......... .......... .......... 27% 250M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 25950K .......... .......... .......... .......... .......... 27% 244M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 26000K .......... .......... .......... .......... .......... 28% 218M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 26050K .......... .......... .......... .......... .......... 28% 254M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 26100K .......... .......... .......... .......... .......... 28% 240M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 26150K .......... .......... .......... .......... .......... 28% 259M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 26200K .......... .......... .......... .......... .......... 28% 239M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 26250K .......... .......... .......... .......... .......... 28% 264M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 26300K .......... .......... .......... .......... .......... 28% 208M 0s 2024-09-12T00:44:18.238 INFO:teuthology.orchestra.run.smithi102.stderr: 26350K .......... .......... .......... .......... .......... 28% 274M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26400K .......... .......... .......... .......... .......... 28% 288M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26450K .......... .......... .......... .......... .......... 28% 267M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26500K .......... .......... .......... .......... .......... 28% 261M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26550K .......... .......... .......... .......... .......... 28% 266M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26600K .......... .......... .......... .......... .......... 28% 290M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26650K .......... .......... .......... .......... .......... 28% 296M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26700K .......... .......... .......... .......... .......... 28% 219M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26750K .......... .......... .......... .......... .......... 28% 280M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26800K .......... .......... .......... .......... .......... 28% 293M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26850K .......... .......... .......... .......... .......... 28% 282M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26900K .......... .......... .......... .......... .......... 29% 247M 0s 2024-09-12T00:44:18.239 INFO:teuthology.orchestra.run.smithi102.stderr: 26950K .......... .......... .......... .......... .......... 29% 257M 0s 2024-09-12T00:44:18.240 INFO:teuthology.orchestra.run.smithi102.stderr: 27000K .......... .......... .......... .......... .......... 29% 255M 0s 2024-09-12T00:44:18.240 INFO:teuthology.orchestra.run.smithi102.stderr: 27050K .......... .......... .......... .......... .......... 29% 268M 0s 2024-09-12T00:44:18.240 INFO:teuthology.orchestra.run.smithi102.stderr: 27100K .......... .......... .......... .......... .......... 29% 216M 0s 2024-09-12T00:44:18.240 INFO:teuthology.orchestra.run.smithi102.stderr: 27150K .......... .......... .......... .......... .......... 29% 261M 0s 2024-09-12T00:44:18.240 INFO:teuthology.orchestra.run.smithi102.stderr: 27200K .......... .......... .......... .......... .......... 29% 266M 0s 2024-09-12T00:44:18.240 INFO:teuthology.orchestra.run.smithi102.stderr: 27250K .......... .......... .......... .......... .......... 29% 277M 0s 2024-09-12T00:44:18.240 INFO:teuthology.orchestra.run.smithi102.stderr: 27300K .......... .......... .......... .......... .......... 29% 230M 0s 2024-09-12T00:44:18.240 INFO:teuthology.orchestra.run.smithi102.stderr: 27350K .......... .......... .......... .......... .......... 29% 290M 0s 2024-09-12T00:44:18.240 INFO:teuthology.orchestra.run.smithi102.stderr: 27400K .......... .......... .......... .......... .......... 29% 304M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27450K .......... .......... .......... .......... .......... 29% 291M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27500K .......... .......... .......... .......... .......... 29% 250M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27550K .......... .......... .......... .......... .......... 29% 307M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27600K .......... .......... .......... .......... .......... 29% 305M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27650K .......... .......... .......... .......... .......... 29% 265M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27700K .......... .......... .......... .......... .......... 29% 234M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27750K .......... .......... .......... .......... .......... 29% 287M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27800K .......... .......... .......... .......... .......... 29% 207M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27850K .......... .......... .......... .......... .......... 30% 287M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27900K .......... .......... .......... .......... .......... 30% 281M 0s 2024-09-12T00:44:18.241 INFO:teuthology.orchestra.run.smithi102.stderr: 27950K .......... .......... .......... .......... .......... 30% 273M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28000K .......... .......... .......... .......... .......... 30% 261M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28050K .......... .......... .......... .......... .......... 30% 98.3M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28100K .......... .......... .......... .......... .......... 30% 271M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28150K .......... .......... .......... .......... .......... 30% 279M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28200K .......... .......... .......... .......... .......... 30% 235M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28250K .......... .......... .......... .......... .......... 30% 305M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28300K .......... .......... .......... .......... .......... 30% 285M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28350K .......... .......... .......... .......... .......... 30% 301M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28400K .......... .......... .......... .......... .......... 30% 246M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28450K .......... .......... .......... .......... .......... 30% 284M 0s 2024-09-12T00:44:18.242 INFO:teuthology.orchestra.run.smithi102.stderr: 28500K .......... .......... .......... .......... .......... 30% 293M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 28550K .......... .......... .......... .......... .......... 30% 296M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 28600K .......... .......... .......... .......... .......... 30% 255M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 28650K .......... .......... .......... .......... .......... 30% 276M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 28700K .......... .......... .......... .......... .......... 30% 296M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 28750K .......... .......... .......... .......... .......... 31% 293M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 28800K .......... .......... .......... .......... .......... 31% 197M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 28850K .......... .......... .......... .......... .......... 31% 132M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 28900K .......... .......... .......... .......... .......... 31% 257M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 28950K .......... .......... .......... .......... .......... 31% 296M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 29000K .......... .......... .......... .......... .......... 31% 245M 0s 2024-09-12T00:44:18.243 INFO:teuthology.orchestra.run.smithi102.stderr: 29050K .......... .......... .......... .......... .......... 31% 272M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29100K .......... .......... .......... .......... .......... 31% 302M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29150K .......... .......... .......... .......... .......... 31% 264M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29200K .......... .......... .......... .......... .......... 31% 232M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29250K .......... .......... .......... .......... .......... 31% 275M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29300K .......... .......... .......... .......... .......... 31% 292M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29350K .......... .......... .......... .......... .......... 31% 260M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29400K .......... .......... .......... .......... .......... 31% 270M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29450K .......... .......... .......... .......... .......... 31% 125M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29500K .......... .......... .......... .......... .......... 31% 240M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29550K .......... .......... .......... .......... .......... 31% 283M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29600K .......... .......... .......... .......... .......... 31% 238M 0s 2024-09-12T00:44:18.244 INFO:teuthology.orchestra.run.smithi102.stderr: 29650K .......... .......... .......... .......... .......... 31% 284M 0s 2024-09-12T00:44:18.245 INFO:teuthology.orchestra.run.smithi102.stderr: 29700K .......... .......... .......... .......... .......... 32% 281M 0s 2024-09-12T00:44:18.245 INFO:teuthology.orchestra.run.smithi102.stderr: 29750K .......... .......... .......... .......... .......... 32% 294M 0s 2024-09-12T00:44:18.245 INFO:teuthology.orchestra.run.smithi102.stderr: 29800K .......... .......... .......... .......... .......... 32% 154M 0s 2024-09-12T00:44:18.245 INFO:teuthology.orchestra.run.smithi102.stderr: 29850K .......... .......... .......... .......... .......... 32% 258M 0s 2024-09-12T00:44:18.245 INFO:teuthology.orchestra.run.smithi102.stderr: 29900K .......... .......... .......... .......... .......... 32% 257M 0s 2024-09-12T00:44:18.245 INFO:teuthology.orchestra.run.smithi102.stderr: 29950K .......... .......... .......... .......... .......... 32% 274M 0s 2024-09-12T00:44:18.245 INFO:teuthology.orchestra.run.smithi102.stderr: 30000K .......... .......... .......... .......... .......... 32% 225M 0s 2024-09-12T00:44:18.245 INFO:teuthology.orchestra.run.smithi102.stderr: 30050K .......... .......... .......... .......... .......... 32% 286M 0s 2024-09-12T00:44:18.245 INFO:teuthology.orchestra.run.smithi102.stderr: 30100K .......... .......... .......... .......... .......... 32% 305M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30150K .......... .......... .......... .......... .......... 32% 256M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30200K .......... .......... .......... .......... .......... 32% 244M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30250K .......... .......... .......... .......... .......... 32% 275M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30300K .......... .......... .......... .......... .......... 32% 273M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30350K .......... .......... .......... .......... .......... 32% 286M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30400K .......... .......... .......... .......... .......... 32% 252M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30450K .......... .......... .......... .......... .......... 32% 77.0M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30500K .......... .......... .......... .......... .......... 32% 234M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30550K .......... .......... .......... .......... .......... 32% 268M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30600K .......... .......... .......... .......... .......... 32% 232M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30650K .......... .......... .......... .......... .......... 33% 281M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30700K .......... .......... .......... .......... .......... 33% 277M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30750K .......... .......... .......... .......... .......... 33% 246M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30800K .......... .......... .......... .......... .......... 33% 301M 0s 2024-09-12T00:44:18.246 INFO:teuthology.orchestra.run.smithi102.stderr: 30850K .......... .......... .......... .......... .......... 33% 273M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 30900K .......... .......... .......... .......... .......... 33% 261M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 30950K .......... .......... .......... .......... .......... 33% 304M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31000K .......... .......... .......... .......... .......... 33% 284M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31050K .......... .......... .......... .......... .......... 33% 241M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31100K .......... .......... .......... .......... .......... 33% 281M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31150K .......... .......... .......... .......... .......... 33% 272M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31200K .......... .......... .......... .......... .......... 33% 288M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31250K .......... .......... .......... .......... .......... 33% 263M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31300K .......... .......... .......... .......... .......... 33% 277M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31350K .......... .......... .......... .......... .......... 33% 256M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31400K .......... .......... .......... .......... .......... 33% 280M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31450K .......... .......... .......... .......... .......... 33% 230M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31500K .......... .......... .......... .......... .......... 33% 298M 0s 2024-09-12T00:44:18.247 INFO:teuthology.orchestra.run.smithi102.stderr: 31550K .......... .......... .......... .......... .......... 34% 263M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 31600K .......... .......... .......... .......... .......... 34% 300M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 31650K .......... .......... .......... .......... .......... 34% 284M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 31700K .......... .......... .......... .......... .......... 34% 258M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 31750K .......... .......... .......... .......... .......... 34% 314M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 31800K .......... .......... .......... .......... .......... 34% 294M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 31850K .......... .......... .......... .......... .......... 34% 270M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 31900K .......... .......... .......... .......... .......... 34% 226M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 31950K .......... .......... .......... .......... .......... 34% 258M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 32000K .......... .......... .......... .......... .......... 34% 173M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 32050K .......... .......... .......... .......... .......... 34% 253M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 32100K .......... .......... .......... .......... .......... 34% 279M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 32150K .......... .......... .......... .......... .......... 34% 297M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 32200K .......... .......... .......... .......... .......... 34% 284M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 32250K .......... .......... .......... .......... .......... 34% 277M 0s 2024-09-12T00:44:18.248 INFO:teuthology.orchestra.run.smithi102.stderr: 32300K .......... .......... .......... .......... .......... 34% 238M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32350K .......... .......... .......... .......... .......... 34% 312M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32400K .......... .......... .......... .......... .......... 34% 277M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32450K .......... .......... .......... .......... .......... 34% 306M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32500K .......... .......... .......... .......... .......... 35% 156M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32550K .......... .......... .......... .......... .......... 35% 262M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32600K .......... .......... .......... .......... .......... 35% 306M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32650K .......... .......... .......... .......... .......... 35% 114M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32700K .......... .......... .......... .......... .......... 35% 285M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32750K .......... .......... .......... .......... .......... 35% 195M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32800K .......... .......... .......... .......... .......... 35% 286M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32850K .......... .......... .......... .......... .......... 35% 111M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32900K .......... .......... .......... .......... .......... 35% 262M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 32950K .......... .......... .......... .......... .......... 35% 313M 0s 2024-09-12T00:44:18.249 INFO:teuthology.orchestra.run.smithi102.stderr: 33000K .......... .......... .......... .......... .......... 35% 315M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33050K .......... .......... .......... .......... .......... 35% 171M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33100K .......... .......... .......... .......... .......... 35% 220M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33150K .......... .......... .......... .......... .......... 35% 290M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33200K .......... .......... .......... .......... .......... 35% 299M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33250K .......... .......... .......... .......... .......... 35% 304M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33300K .......... .......... .......... .......... .......... 35% 289M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33350K .......... .......... .......... .......... .......... 35% 167M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33400K .......... .......... .......... .......... .......... 36% 224M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33450K .......... .......... .......... .......... .......... 36% 262M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33500K .......... .......... .......... .......... .......... 36% 288M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33550K .......... .......... .......... .......... .......... 36% 272M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33600K .......... .......... .......... .......... .......... 36% 279M 0s 2024-09-12T00:44:18.250 INFO:teuthology.orchestra.run.smithi102.stderr: 33650K .......... .......... .......... .......... .......... 36% 320M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 33700K .......... .......... .......... .......... .......... 36% 282M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 33750K .......... .......... .......... .......... .......... 36% 242M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 33800K .......... .......... .......... .......... .......... 36% 290M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 33850K .......... .......... .......... .......... .......... 36% 294M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 33900K .......... .......... .......... .......... .......... 36% 316M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 33950K .......... .......... .......... .......... .......... 36% 285M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 34000K .......... .......... .......... .......... .......... 36% 298M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 34050K .......... .......... .......... .......... .......... 36% 182M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 34100K .......... .......... .......... .......... .......... 36% 271M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 34150K .......... .......... .......... .......... .......... 36% 274M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 34200K .......... .......... .......... .......... .......... 36% 286M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 34250K .......... .......... .......... .......... .......... 36% 281M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 34300K .......... .......... .......... .......... .......... 36% 309M 0s 2024-09-12T00:44:18.251 INFO:teuthology.orchestra.run.smithi102.stderr: 34350K .......... .......... .......... .......... .......... 37% 322M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34400K .......... .......... .......... .......... .......... 37% 101M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34450K .......... .......... .......... .......... .......... 37% 271M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34500K .......... .......... .......... .......... .......... 37% 256M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34550K .......... .......... .......... .......... .......... 37% 327M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34600K .......... .......... .......... .......... .......... 37% 307M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34650K .......... .......... .......... .......... .......... 37% 272M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34700K .......... .......... .......... .......... .......... 37% 328M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34750K .......... .......... .......... .......... .......... 37% 295M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34800K .......... .......... .......... .......... .......... 37% 295M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34850K .......... .......... .......... .......... .......... 37% 331M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34900K .......... .......... .......... .......... .......... 37% 354M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 34950K .......... .......... .......... .......... .......... 37% 328M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 35000K .......... .......... .......... .......... .......... 37% 320M 0s 2024-09-12T00:44:18.252 INFO:teuthology.orchestra.run.smithi102.stderr: 35050K .......... .......... .......... .......... .......... 37% 224M 0s 2024-09-12T00:44:18.253 INFO:teuthology.orchestra.run.smithi102.stderr: 35100K .......... .......... .......... .......... .......... 37% 315M 0s 2024-09-12T00:44:18.253 INFO:teuthology.orchestra.run.smithi102.stderr: 35150K .......... .......... .......... .......... .......... 37% 281M 0s 2024-09-12T00:44:18.253 INFO:teuthology.orchestra.run.smithi102.stderr: 35200K .......... .......... .......... .......... .......... 37% 240M 0s 2024-09-12T00:44:18.253 INFO:teuthology.orchestra.run.smithi102.stderr: 35250K .......... .......... .......... .......... .......... 37% 323M 0s 2024-09-12T00:44:18.253 INFO:teuthology.orchestra.run.smithi102.stderr: 35300K .......... .......... .......... .......... .......... 38% 295M 0s 2024-09-12T00:44:18.253 INFO:teuthology.orchestra.run.smithi102.stderr: 35350K .......... .......... .......... .......... .......... 38% 309M 0s 2024-09-12T00:44:18.253 INFO:teuthology.orchestra.run.smithi102.stderr: 35400K .......... .......... .......... .......... .......... 38% 271M 0s 2024-09-12T00:44:18.253 INFO:teuthology.orchestra.run.smithi102.stderr: 35450K .......... .......... .......... .......... .......... 38% 321M 0s 2024-09-12T00:44:18.253 INFO:teuthology.orchestra.run.smithi102.stderr: 35500K .......... .......... .......... .......... .......... 38% 288M 0s 2024-09-12T00:44:18.253 INFO:teuthology.orchestra.run.smithi102.stderr: 35550K .......... .......... .......... .......... .......... 38% 69.7M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 35600K .......... .......... .......... .......... .......... 38% 279M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 35650K .......... .......... .......... .......... .......... 38% 289M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 35700K .......... .......... .......... .......... .......... 38% 308M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 35750K .......... .......... .......... .......... .......... 38% 295M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 35800K .......... .......... .......... .......... .......... 38% 112M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 35850K .......... .......... .......... .......... .......... 38% 315M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 35900K .......... .......... .......... .......... .......... 38% 309M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 35950K .......... .......... .......... .......... .......... 38% 254M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 36000K .......... .......... .......... .......... .......... 38% 158M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 36050K .......... .......... .......... .......... .......... 38% 300M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 36100K .......... .......... .......... .......... .......... 38% 293M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 36150K .......... .......... .......... .......... .......... 38% 277M 0s 2024-09-12T00:44:18.254 INFO:teuthology.orchestra.run.smithi102.stderr: 36200K .......... .......... .......... .......... .......... 39% 293M 0s 2024-09-12T00:44:18.255 INFO:teuthology.orchestra.run.smithi102.stderr: 36250K .......... .......... .......... .......... .......... 39% 64.7M 0s 2024-09-12T00:44:18.255 INFO:teuthology.orchestra.run.smithi102.stderr: 36300K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-12T00:44:18.255 INFO:teuthology.orchestra.run.smithi102.stderr: 36350K .......... .......... .......... .......... .......... 39% 292M 0s 2024-09-12T00:44:18.255 INFO:teuthology.orchestra.run.smithi102.stderr: 36400K .......... .......... .......... .......... .......... 39% 323M 0s 2024-09-12T00:44:18.255 INFO:teuthology.orchestra.run.smithi102.stderr: 36450K .......... .......... .......... .......... .......... 39% 295M 0s 2024-09-12T00:44:18.255 INFO:teuthology.orchestra.run.smithi102.stderr: 36500K .......... .......... .......... .......... .......... 39% 255M 0s 2024-09-12T00:44:18.255 INFO:teuthology.orchestra.run.smithi102.stderr: 36550K .......... .......... .......... .......... .......... 39% 283M 0s 2024-09-12T00:44:18.255 INFO:teuthology.orchestra.run.smithi102.stderr: 36600K .......... .......... .......... .......... .......... 39% 255M 0s 2024-09-12T00:44:18.255 INFO:teuthology.orchestra.run.smithi102.stderr: 36650K .......... .......... .......... .......... .......... 39% 326M 0s 2024-09-12T00:44:18.255 INFO:teuthology.orchestra.run.smithi102.stderr: 36700K .......... .......... .......... .......... .......... 39% 304M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 36750K .......... .......... .......... .......... .......... 39% 306M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 36800K .......... .......... .......... .......... .......... 39% 270M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 36850K .......... .......... .......... .......... .......... 39% 282M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 36900K .......... .......... .......... .......... .......... 39% 369M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 36950K .......... .......... .......... .......... .......... 39% 224M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 37000K .......... .......... .......... .......... .......... 39% 66.1M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 37050K .......... .......... .......... .......... .......... 39% 266M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 37100K .......... .......... .......... .......... .......... 39% 292M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 37150K .......... .......... .......... .......... .......... 40% 289M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 37200K .......... .......... .......... .......... .......... 40% 242M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 37250K .......... .......... .......... .......... .......... 40% 315M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 37300K .......... .......... .......... .......... .......... 40% 304M 0s 2024-09-12T00:44:18.256 INFO:teuthology.orchestra.run.smithi102.stderr: 37350K .......... .......... .......... .......... .......... 40% 293M 0s 2024-09-12T00:44:18.257 INFO:teuthology.orchestra.run.smithi102.stderr: 37400K .......... .......... .......... .......... .......... 40% 311M 0s 2024-09-12T00:44:18.257 INFO:teuthology.orchestra.run.smithi102.stderr: 37450K .......... .......... .......... .......... .......... 40% 289M 0s 2024-09-12T00:44:18.257 INFO:teuthology.orchestra.run.smithi102.stderr: 37500K .......... .......... .......... .......... .......... 40% 338M 0s 2024-09-12T00:44:18.257 INFO:teuthology.orchestra.run.smithi102.stderr: 37550K .......... .......... .......... .......... .......... 40% 277M 0s 2024-09-12T00:44:18.257 INFO:teuthology.orchestra.run.smithi102.stderr: 37600K .......... .......... .......... .......... .......... 40% 332M 0s 2024-09-12T00:44:18.257 INFO:teuthology.orchestra.run.smithi102.stderr: 37650K .......... .......... .......... .......... .......... 40% 295M 0s 2024-09-12T00:44:18.257 INFO:teuthology.orchestra.run.smithi102.stderr: 37700K .......... .......... .......... .......... .......... 40% 292M 0s 2024-09-12T00:44:18.257 INFO:teuthology.orchestra.run.smithi102.stderr: 37750K .......... .......... .......... .......... .......... 40% 288M 0s 2024-09-12T00:44:18.257 INFO:teuthology.orchestra.run.smithi102.stderr: 37800K .......... .......... .......... .......... .......... 40% 268M 0s 2024-09-12T00:44:18.257 INFO:teuthology.orchestra.run.smithi102.stderr: 37850K .......... .......... .......... .......... .......... 40% 313M 0s 2024-09-12T00:44:18.258 INFO:teuthology.orchestra.run.smithi102.stderr: 37900K .......... .......... .......... .......... .......... 40% 315M 0s 2024-09-12T00:44:18.258 INFO:teuthology.orchestra.run.smithi102.stderr: 37950K .......... .......... .......... .......... .......... 40% 328M 0s 2024-09-12T00:44:18.258 INFO:teuthology.orchestra.run.smithi102.stderr: 38000K .......... .......... .......... .......... .......... 40% 300M 0s 2024-09-12T00:44:18.258 INFO:teuthology.orchestra.run.smithi102.stderr: 38050K .......... .......... .......... .......... .......... 41% 308M 0s 2024-09-12T00:44:18.258 INFO:teuthology.orchestra.run.smithi102.stderr: 38100K .......... .......... .......... .......... .......... 41% 279M 0s 2024-09-12T00:44:18.258 INFO:teuthology.orchestra.run.smithi102.stderr: 38150K .......... .......... .......... .......... .......... 41% 312M 0s 2024-09-12T00:44:18.258 INFO:teuthology.orchestra.run.smithi102.stderr: 38200K .......... .......... .......... .......... .......... 41% 262M 0s 2024-09-12T00:44:18.258 INFO:teuthology.orchestra.run.smithi102.stderr: 38250K .......... .......... .......... .......... .......... 41% 295M 0s 2024-09-12T00:44:18.258 INFO:teuthology.orchestra.run.smithi102.stderr: 38300K .......... .......... .......... .......... .......... 41% 328M 0s 2024-09-12T00:44:18.258 INFO:teuthology.orchestra.run.smithi102.stderr: 38350K .......... .......... .......... .......... .......... 41% 336M 0s 2024-09-12T00:44:18.259 INFO:teuthology.orchestra.run.smithi102.stderr: 38400K .......... .......... .......... .......... .......... 41% 333M 0s 2024-09-12T00:44:18.259 INFO:teuthology.orchestra.run.smithi102.stderr: 38450K .......... .......... .......... .......... .......... 41% 137M 0s 2024-09-12T00:44:18.259 INFO:teuthology.orchestra.run.smithi102.stderr: 38500K .......... .......... .......... .......... .......... 41% 280M 0s 2024-09-12T00:44:18.259 INFO:teuthology.orchestra.run.smithi102.stderr: 38550K .......... .......... .......... .......... .......... 41% 300M 0s 2024-09-12T00:44:18.259 INFO:teuthology.orchestra.run.smithi102.stderr: 38600K .......... .......... .......... .......... .......... 41% 342M 0s 2024-09-12T00:44:18.259 INFO:teuthology.orchestra.run.smithi102.stderr: 38650K .......... .......... .......... .......... .......... 41% 283M 0s 2024-09-12T00:44:18.259 INFO:teuthology.orchestra.run.smithi102.stderr: 38700K .......... .......... .......... .......... .......... 41% 316M 0s 2024-09-12T00:44:18.259 INFO:teuthology.orchestra.run.smithi102.stderr: 38750K .......... .......... .......... .......... .......... 41% 348M 0s 2024-09-12T00:44:18.259 INFO:teuthology.orchestra.run.smithi102.stderr: 38800K .......... .......... .......... .......... .......... 41% 242M 0s 2024-09-12T00:44:18.259 INFO:teuthology.orchestra.run.smithi102.stderr: 38850K .......... .......... .......... .......... .......... 41% 157M 0s 2024-09-12T00:44:18.260 INFO:teuthology.orchestra.run.smithi102.stderr: 38900K .......... .......... .......... .......... .......... 41% 318M 0s 2024-09-12T00:44:18.260 INFO:teuthology.orchestra.run.smithi102.stderr: 38950K .......... .......... .......... .......... .......... 41% 311M 0s 2024-09-12T00:44:18.260 INFO:teuthology.orchestra.run.smithi102.stderr: 39000K .......... .......... .......... .......... .......... 42% 163M 0s 2024-09-12T00:44:18.260 INFO:teuthology.orchestra.run.smithi102.stderr: 39050K .......... .......... .......... .......... .......... 42% 200M 0s 2024-09-12T00:44:18.260 INFO:teuthology.orchestra.run.smithi102.stderr: 39100K .......... .......... .......... .......... .......... 42% 304M 0s 2024-09-12T00:44:18.260 INFO:teuthology.orchestra.run.smithi102.stderr: 39150K .......... .......... .......... .......... .......... 42% 303M 0s 2024-09-12T00:44:18.260 INFO:teuthology.orchestra.run.smithi102.stderr: 39200K .......... .......... .......... .......... .......... 42% 334M 0s 2024-09-12T00:44:18.260 INFO:teuthology.orchestra.run.smithi102.stderr: 39250K .......... .......... .......... .......... .......... 42% 64.8M 0s 2024-09-12T00:44:18.260 INFO:teuthology.orchestra.run.smithi102.stderr: 39300K .......... .......... .......... .......... .......... 42% 302M 0s 2024-09-12T00:44:18.261 INFO:teuthology.orchestra.run.smithi102.stderr: 39350K .......... .......... .......... .......... .......... 42% 285M 0s 2024-09-12T00:44:18.261 INFO:teuthology.orchestra.run.smithi102.stderr: 39400K .......... .......... .......... .......... .......... 42% 80.4M 0s 2024-09-12T00:44:18.261 INFO:teuthology.orchestra.run.smithi102.stderr: 39450K .......... .......... .......... .......... .......... 42% 297M 0s 2024-09-12T00:44:18.261 INFO:teuthology.orchestra.run.smithi102.stderr: 39500K .......... .......... .......... .......... .......... 42% 318M 0s 2024-09-12T00:44:18.261 INFO:teuthology.orchestra.run.smithi102.stderr: 39550K .......... .......... .......... .......... .......... 42% 262M 0s 2024-09-12T00:44:18.261 INFO:teuthology.orchestra.run.smithi102.stderr: 39600K .......... .......... .......... .......... .......... 42% 317M 0s 2024-09-12T00:44:18.261 INFO:teuthology.orchestra.run.smithi102.stderr: 39650K .......... .......... .......... .......... .......... 42% 344M 0s 2024-09-12T00:44:18.261 INFO:teuthology.orchestra.run.smithi102.stderr: 39700K .......... .......... .......... .......... .......... 42% 348M 0s 2024-09-12T00:44:18.261 INFO:teuthology.orchestra.run.smithi102.stderr: 39750K .......... .......... .......... .......... .......... 42% 309M 0s 2024-09-12T00:44:18.261 INFO:teuthology.orchestra.run.smithi102.stderr: 39800K .......... .......... .......... .......... .......... 42% 335M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 39850K .......... .......... .......... .......... .......... 42% 95.0M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 39900K .......... .......... .......... .......... .......... 43% 266M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 39950K .......... .......... .......... .......... .......... 43% 328M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40000K .......... .......... .......... .......... .......... 43% 326M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40050K .......... .......... .......... .......... .......... 43% 107M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40100K .......... .......... .......... .......... .......... 43% 301M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40150K .......... .......... .......... .......... .......... 43% 327M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40200K .......... .......... .......... .......... .......... 43% 310M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40250K .......... .......... .......... .......... .......... 43% 265M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40300K .......... .......... .......... .......... .......... 43% 319M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40350K .......... .......... .......... .......... .......... 43% 304M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40400K .......... .......... .......... .......... .......... 43% 344M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40450K .......... .......... .......... .......... .......... 43% 304M 0s 2024-09-12T00:44:18.262 INFO:teuthology.orchestra.run.smithi102.stderr: 40500K .......... .......... .......... .......... .......... 43% 231M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 40550K .......... .......... .......... .......... .......... 43% 299M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 40600K .......... .......... .......... .......... .......... 43% 328M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 40650K .......... .......... .......... .......... .......... 43% 323M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 40700K .......... .......... .......... .......... .......... 43% 280M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 40750K .......... .......... .......... .......... .......... 43% 278M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 40800K .......... .......... .......... .......... .......... 43% 330M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 40850K .......... .......... .......... .......... .......... 44% 334M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 40900K .......... .......... .......... .......... .......... 44% 343M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 40950K .......... .......... .......... .......... .......... 44% 340M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 41000K .......... .......... .......... .......... .......... 44% 310M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 41050K .......... .......... .......... .......... .......... 44% 279M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 41100K .......... .......... .......... .......... .......... 44% 268M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 41150K .......... .......... .......... .......... .......... 44% 313M 0s 2024-09-12T00:44:18.263 INFO:teuthology.orchestra.run.smithi102.stderr: 41200K .......... .......... .......... .......... .......... 44% 328M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41250K .......... .......... .......... .......... .......... 44% 340M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41300K .......... .......... .......... .......... .......... 44% 305M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41350K .......... .......... .......... .......... .......... 44% 107M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41400K .......... .......... .......... .......... .......... 44% 294M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41450K .......... .......... .......... .......... .......... 44% 280M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41500K .......... .......... .......... .......... .......... 44% 280M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41550K .......... .......... .......... .......... .......... 44% 310M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41600K .......... .......... .......... .......... .......... 44% 319M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41650K .......... .......... .......... .......... .......... 44% 334M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41700K .......... .......... .......... .......... .......... 44% 267M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41750K .......... .......... .......... .......... .......... 44% 304M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41800K .......... .......... .......... .......... .......... 45% 288M 0s 2024-09-12T00:44:18.264 INFO:teuthology.orchestra.run.smithi102.stderr: 41850K .......... .......... .......... .......... .......... 45% 331M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 41900K .......... .......... .......... .......... .......... 45% 282M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 41950K .......... .......... .......... .......... .......... 45% 315M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 42000K .......... .......... .......... .......... .......... 45% 329M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 42050K .......... .......... .......... .......... .......... 45% 124M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 42100K .......... .......... .......... .......... .......... 45% 281M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 42150K .......... .......... .......... .......... .......... 45% 295M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 42200K .......... .......... .......... .......... .......... 45% 335M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 42250K .......... .......... .......... .......... .......... 45% 112M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 42300K .......... .......... .......... .......... .......... 45% 175M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 42350K .......... .......... .......... .......... .......... 45% 335M 0s 2024-09-12T00:44:18.265 INFO:teuthology.orchestra.run.smithi102.stderr: 42400K .......... .......... .......... .......... .......... 45% 88.1M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42450K .......... .......... .......... .......... .......... 45% 183M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42500K .......... .......... .......... .......... .......... 45% 252M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42550K .......... .......... .......... .......... .......... 45% 301M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42600K .......... .......... .......... .......... .......... 45% 336M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42650K .......... .......... .......... .......... .......... 45% 329M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42700K .......... .......... .......... .......... .......... 46% 255M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42750K .......... .......... .......... .......... .......... 46% 336M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42800K .......... .......... .......... .......... .......... 46% 78.9M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42850K .......... .......... .......... .......... .......... 46% 296M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42900K .......... .......... .......... .......... .......... 46% 282M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 42950K .......... .......... .......... .......... .......... 46% 347M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 43000K .......... .......... .......... .......... .......... 46% 119M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 43050K .......... .......... .......... .......... .......... 46% 328M 0s 2024-09-12T00:44:18.266 INFO:teuthology.orchestra.run.smithi102.stderr: 43100K .......... .......... .......... .......... .......... 46% 259M 0s 2024-09-12T00:44:18.267 INFO:teuthology.orchestra.run.smithi102.stderr: 43150K .......... .......... .......... .......... .......... 46% 325M 0s 2024-09-12T00:44:18.267 INFO:teuthology.orchestra.run.smithi102.stderr: 43200K .......... .......... .......... .......... .......... 46% 327M 0s 2024-09-12T00:44:18.267 INFO:teuthology.orchestra.run.smithi102.stderr: 43250K .......... .......... .......... .......... .......... 46% 310M 0s 2024-09-12T00:44:18.267 INFO:teuthology.orchestra.run.smithi102.stderr: 43300K .......... .......... .......... .......... .......... 46% 267M 0s 2024-09-12T00:44:18.267 INFO:teuthology.orchestra.run.smithi102.stderr: 43350K .......... .......... .......... .......... .......... 46% 284M 0s 2024-09-12T00:44:18.267 INFO:teuthology.orchestra.run.smithi102.stderr: 43400K .......... .......... .......... .......... .......... 46% 326M 0s 2024-09-12T00:44:18.267 INFO:teuthology.orchestra.run.smithi102.stderr: 43450K .......... .......... .......... .......... .......... 46% 340M 0s 2024-09-12T00:44:18.267 INFO:teuthology.orchestra.run.smithi102.stderr: 43500K .......... .......... .......... .......... .......... 46% 235M 0s 2024-09-12T00:44:18.267 INFO:teuthology.orchestra.run.smithi102.stderr: 43550K .......... .......... .......... .......... .......... 46% 301M 0s 2024-09-12T00:44:18.267 INFO:teuthology.orchestra.run.smithi102.stderr: 43600K .......... .......... .......... .......... .......... 46% 292M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 43650K .......... .......... .......... .......... .......... 47% 317M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 43700K .......... .......... .......... .......... .......... 47% 286M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 43750K .......... .......... .......... .......... .......... 47% 338M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 43800K .......... .......... .......... .......... .......... 47% 302M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 43850K .......... .......... .......... .......... .......... 47% 297M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 43900K .......... .......... .......... .......... .......... 47% 309M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 43950K .......... .......... .......... .......... .......... 47% 327M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 44000K .......... .......... .......... .......... .......... 47% 302M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 44050K .......... .......... .......... .......... .......... 47% 298M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 44100K .......... .......... .......... .......... .......... 47% 279M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 44150K .......... .......... .......... .......... .......... 47% 344M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 44200K .......... .......... .......... .......... .......... 47% 67.6M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 44250K .......... .......... .......... .......... .......... 47% 190M 0s 2024-09-12T00:44:18.268 INFO:teuthology.orchestra.run.smithi102.stderr: 44300K .......... .......... .......... .......... .......... 47% 287M 0s 2024-09-12T00:44:18.269 INFO:teuthology.orchestra.run.smithi102.stderr: 44350K .......... .......... .......... .......... .......... 47% 300M 0s 2024-09-12T00:44:18.269 INFO:teuthology.orchestra.run.smithi102.stderr: 44400K .......... .......... .......... .......... .......... 47% 305M 0s 2024-09-12T00:44:18.269 INFO:teuthology.orchestra.run.smithi102.stderr: 44450K .......... .......... .......... .......... .......... 47% 350M 0s 2024-09-12T00:44:18.269 INFO:teuthology.orchestra.run.smithi102.stderr: 44500K .......... .......... .......... .......... .......... 47% 289M 0s 2024-09-12T00:44:18.269 INFO:teuthology.orchestra.run.smithi102.stderr: 44550K .......... .......... .......... .......... .......... 48% 345M 0s 2024-09-12T00:44:18.269 INFO:teuthology.orchestra.run.smithi102.stderr: 44600K .......... .......... .......... .......... .......... 48% 287M 0s 2024-09-12T00:44:18.269 INFO:teuthology.orchestra.run.smithi102.stderr: 44650K .......... .......... .......... .......... .......... 48% 314M 0s 2024-09-12T00:44:18.269 INFO:teuthology.orchestra.run.smithi102.stderr: 44700K .......... .......... .......... .......... .......... 48% 298M 0s 2024-09-12T00:44:18.269 INFO:teuthology.orchestra.run.smithi102.stderr: 44750K .......... .......... .......... .......... .......... 48% 331M 0s 2024-09-12T00:44:18.269 INFO:teuthology.orchestra.run.smithi102.stderr: 44800K .......... .......... .......... .......... .......... 48% 328M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 44850K .......... .......... .......... .......... .......... 48% 348M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 44900K .......... .......... .......... .......... .......... 48% 294M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 44950K .......... .......... .......... .......... .......... 48% 254M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 45000K .......... .......... .......... .......... .......... 48% 308M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 45050K .......... .......... .......... .......... .......... 48% 318M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 45100K .......... .......... .......... .......... .......... 48% 303M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 45150K .......... .......... .......... .......... .......... 48% 79.4M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 45200K .......... .......... .......... .......... .......... 48% 301M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 45250K .......... .......... .......... .......... .......... 48% 339M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 45300K .......... .......... .......... .......... .......... 48% 292M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 45350K .......... .......... .......... .......... .......... 48% 67.6M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 45400K .......... .......... .......... .......... .......... 48% 270M 0s 2024-09-12T00:44:18.270 INFO:teuthology.orchestra.run.smithi102.stderr: 45450K .......... .......... .......... .......... .......... 48% 344M 0s 2024-09-12T00:44:18.271 INFO:teuthology.orchestra.run.smithi102.stderr: 45500K .......... .......... .......... .......... .......... 49% 328M 0s 2024-09-12T00:44:18.271 INFO:teuthology.orchestra.run.smithi102.stderr: 45550K .......... .......... .......... .......... .......... 49% 320M 0s 2024-09-12T00:44:18.271 INFO:teuthology.orchestra.run.smithi102.stderr: 45600K .......... .......... .......... .......... .......... 49% 302M 0s 2024-09-12T00:44:18.271 INFO:teuthology.orchestra.run.smithi102.stderr: 45650K .......... .......... .......... .......... .......... 49% 351M 0s 2024-09-12T00:44:18.271 INFO:teuthology.orchestra.run.smithi102.stderr: 45700K .......... .......... .......... .......... .......... 49% 330M 0s 2024-09-12T00:44:18.271 INFO:teuthology.orchestra.run.smithi102.stderr: 45750K .......... .......... .......... .......... .......... 49% 314M 0s 2024-09-12T00:44:18.271 INFO:teuthology.orchestra.run.smithi102.stderr: 45800K .......... .......... .......... .......... .......... 49% 206M 0s 2024-09-12T00:44:18.271 INFO:teuthology.orchestra.run.smithi102.stderr: 45850K .......... .......... .......... .......... .......... 49% 148M 0s 2024-09-12T00:44:18.271 INFO:teuthology.orchestra.run.smithi102.stderr: 45900K .......... .......... .......... .......... .......... 49% 128M 0s 2024-09-12T00:44:18.271 INFO:teuthology.orchestra.run.smithi102.stderr: 45950K .......... .......... .......... .......... .......... 49% 312M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46000K .......... .......... .......... .......... .......... 49% 348M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46050K .......... .......... .......... .......... .......... 49% 318M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46100K .......... .......... .......... .......... .......... 49% 303M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46150K .......... .......... .......... .......... .......... 49% 312M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46200K .......... .......... .......... .......... .......... 49% 342M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46250K .......... .......... .......... .......... .......... 49% 195M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46300K .......... .......... .......... .......... .......... 49% 267M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46350K .......... .......... .......... .......... .......... 49% 106M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46400K .......... .......... .......... .......... .......... 49% 300M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46450K .......... .......... .......... .......... .......... 50% 335M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46500K .......... .......... .......... .......... .......... 50% 293M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46550K .......... .......... .......... .......... .......... 50% 350M 0s 2024-09-12T00:44:18.272 INFO:teuthology.orchestra.run.smithi102.stderr: 46600K .......... .......... .......... .......... .......... 50% 327M 0s 2024-09-12T00:44:18.273 INFO:teuthology.orchestra.run.smithi102.stderr: 46650K .......... .......... .......... .......... .......... 50% 336M 0s 2024-09-12T00:44:18.273 INFO:teuthology.orchestra.run.smithi102.stderr: 46700K .......... .......... .......... .......... .......... 50% 279M 0s 2024-09-12T00:44:18.273 INFO:teuthology.orchestra.run.smithi102.stderr: 46750K .......... .......... .......... .......... .......... 50% 335M 0s 2024-09-12T00:44:18.273 INFO:teuthology.orchestra.run.smithi102.stderr: 46800K .......... .......... .......... .......... .......... 50% 344M 0s 2024-09-12T00:44:18.273 INFO:teuthology.orchestra.run.smithi102.stderr: 46850K .......... .......... .......... .......... .......... 50% 333M 0s 2024-09-12T00:44:18.273 INFO:teuthology.orchestra.run.smithi102.stderr: 46900K .......... .......... .......... .......... .......... 50% 303M 0s 2024-09-12T00:44:18.273 INFO:teuthology.orchestra.run.smithi102.stderr: 46950K .......... .......... .......... .......... .......... 50% 325M 0s 2024-09-12T00:44:18.273 INFO:teuthology.orchestra.run.smithi102.stderr: 47000K .......... .......... .......... .......... .......... 50% 330M 0s 2024-09-12T00:44:18.273 INFO:teuthology.orchestra.run.smithi102.stderr: 47050K .......... .......... .......... .......... .......... 50% 352M 0s 2024-09-12T00:44:18.273 INFO:teuthology.orchestra.run.smithi102.stderr: 47100K .......... .......... .......... .......... .......... 50% 122M 0s 2024-09-12T00:44:18.274 INFO:teuthology.orchestra.run.smithi102.stderr: 47150K .......... .......... .......... .......... .......... 50% 303M 0s 2024-09-12T00:44:18.274 INFO:teuthology.orchestra.run.smithi102.stderr: 47200K .......... .......... .......... .......... .......... 50% 347M 0s 2024-09-12T00:44:18.274 INFO:teuthology.orchestra.run.smithi102.stderr: 47250K .......... .......... .......... .......... .......... 50% 341M 0s 2024-09-12T00:44:18.274 INFO:teuthology.orchestra.run.smithi102.stderr: 47300K .......... .......... .......... .......... .......... 50% 241M 0s 2024-09-12T00:44:18.274 INFO:teuthology.orchestra.run.smithi102.stderr: 47350K .......... .......... .......... .......... .......... 51% 314M 0s 2024-09-12T00:44:18.274 INFO:teuthology.orchestra.run.smithi102.stderr: 47400K .......... .......... .......... .......... .......... 51% 146M 0s 2024-09-12T00:44:18.274 INFO:teuthology.orchestra.run.smithi102.stderr: 47450K .......... .......... .......... .......... .......... 51% 321M 0s 2024-09-12T00:44:18.274 INFO:teuthology.orchestra.run.smithi102.stderr: 47500K .......... .......... .......... .......... .......... 51% 254M 0s 2024-09-12T00:44:18.274 INFO:teuthology.orchestra.run.smithi102.stderr: 47550K .......... .......... .......... .......... .......... 51% 307M 0s 2024-09-12T00:44:18.274 INFO:teuthology.orchestra.run.smithi102.stderr: 47600K .......... .......... .......... .......... .......... 51% 307M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 47650K .......... .......... .......... .......... .......... 51% 296M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 47700K .......... .......... .......... .......... .......... 51% 304M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 47750K .......... .......... .......... .......... .......... 51% 341M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 47800K .......... .......... .......... .......... .......... 51% 121M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 47850K .......... .......... .......... .......... .......... 51% 298M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 47900K .......... .......... .......... .......... .......... 51% 260M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 47950K .......... .......... .......... .......... .......... 51% 338M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 48000K .......... .......... .......... .......... .......... 51% 356M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 48050K .......... .......... .......... .......... .......... 51% 181M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 48100K .......... .......... .......... .......... .......... 51% 256M 0s 2024-09-12T00:44:18.275 INFO:teuthology.orchestra.run.smithi102.stderr: 48150K .......... .......... .......... .......... .......... 51% 315M 0s 2024-09-12T00:44:18.276 INFO:teuthology.orchestra.run.smithi102.stderr: 48200K .......... .......... .......... .......... .......... 51% 330M 0s 2024-09-12T00:44:18.276 INFO:teuthology.orchestra.run.smithi102.stderr: 48250K .......... .......... .......... .......... .......... 51% 68.1M 0s 2024-09-12T00:44:18.276 INFO:teuthology.orchestra.run.smithi102.stderr: 48300K .......... .......... .......... .......... .......... 52% 286M 0s 2024-09-12T00:44:18.276 INFO:teuthology.orchestra.run.smithi102.stderr: 48350K .......... .......... .......... .......... .......... 52% 335M 0s 2024-09-12T00:44:18.276 INFO:teuthology.orchestra.run.smithi102.stderr: 48400K .......... .......... .......... .......... .......... 52% 201M 0s 2024-09-12T00:44:18.276 INFO:teuthology.orchestra.run.smithi102.stderr: 48450K .......... .......... .......... .......... .......... 52% 314M 0s 2024-09-12T00:44:18.276 INFO:teuthology.orchestra.run.smithi102.stderr: 48500K .......... .......... .......... .......... .......... 52% 319M 0s 2024-09-12T00:44:18.276 INFO:teuthology.orchestra.run.smithi102.stderr: 48550K .......... .......... .......... .......... .......... 52% 299M 0s 2024-09-12T00:44:18.276 INFO:teuthology.orchestra.run.smithi102.stderr: 48600K .......... .......... .......... .......... .......... 52% 282M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 48650K .......... .......... .......... .......... .......... 52% 288M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 48700K .......... .......... .......... .......... .......... 52% 340M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 48750K .......... .......... .......... .......... .......... 52% 316M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 48800K .......... .......... .......... .......... .......... 52% 350M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 48850K .......... .......... .......... .......... .......... 52% 193M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 48900K .......... .......... .......... .......... .......... 52% 154M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 48950K .......... .......... .......... .......... .......... 52% 194M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 49000K .......... .......... .......... .......... .......... 52% 329M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 49050K .......... .......... .......... .......... .......... 52% 318M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 49100K .......... .......... .......... .......... .......... 52% 208M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 49150K .......... .......... .......... .......... .......... 52% 257M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 49200K .......... .......... .......... .......... .......... 53% 314M 0s 2024-09-12T00:44:18.277 INFO:teuthology.orchestra.run.smithi102.stderr: 49250K .......... .......... .......... .......... .......... 53% 30.4M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49300K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49350K .......... .......... .......... .......... .......... 53% 323M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49400K .......... .......... .......... .......... .......... 53% 322M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49450K .......... .......... .......... .......... .......... 53% 298M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49500K .......... .......... .......... .......... .......... 53% 312M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49550K .......... .......... .......... .......... .......... 53% 328M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49600K .......... .......... .......... .......... .......... 53% 317M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49650K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49700K .......... .......... .......... .......... .......... 53% 365M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49750K .......... .......... .......... .......... .......... 53% 338M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49800K .......... .......... .......... .......... .......... 53% 286M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49850K .......... .......... .......... .......... .......... 53% 349M 0s 2024-09-12T00:44:18.278 INFO:teuthology.orchestra.run.smithi102.stderr: 49900K .......... .......... .......... .......... .......... 53% 307M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 49950K .......... .......... .......... .......... .......... 53% 340M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 50000K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 50050K .......... .......... .......... .......... .......... 53% 327M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 50100K .......... .......... .......... .......... .......... 53% 297M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 50150K .......... .......... .......... .......... .......... 54% 355M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 50200K .......... .......... .......... .......... .......... 54% 347M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 50250K .......... .......... .......... .......... .......... 54% 295M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 50300K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 50350K .......... .......... .......... .......... .......... 54% 357M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 50400K .......... .......... .......... .......... .......... 54% 317M 0s 2024-09-12T00:44:18.279 INFO:teuthology.orchestra.run.smithi102.stderr: 50450K .......... .......... .......... .......... .......... 54% 303M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 50500K .......... .......... .......... .......... .......... 54% 347M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 50550K .......... .......... .......... .......... .......... 54% 304M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 50600K .......... .......... .......... .......... .......... 54% 339M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 50650K .......... .......... .......... .......... .......... 54% 343M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 50700K .......... .......... .......... .......... .......... 54% 370M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 50750K .......... .......... .......... .......... .......... 54% 125M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 50800K .......... .......... .......... .......... .......... 54% 329M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 50850K .......... .......... .......... .......... .......... 54% 346M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 50900K .......... .......... .......... .......... .......... 54% 315M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 50950K .......... .......... .......... .......... .......... 54% 308M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 51000K .......... .......... .......... .......... .......... 54% 318M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 51050K .......... .......... .......... .......... .......... 55% 317M 0s 2024-09-12T00:44:18.280 INFO:teuthology.orchestra.run.smithi102.stderr: 51100K .......... .......... .......... .......... .......... 55% 330M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51150K .......... .......... .......... .......... .......... 55% 310M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51200K .......... .......... .......... .......... .......... 55% 333M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51250K .......... .......... .......... .......... .......... 55% 289M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51300K .......... .......... .......... .......... .......... 55% 142M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51350K .......... .......... .......... .......... .......... 55% 309M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51400K .......... .......... .......... .......... .......... 55% 334M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51450K .......... .......... .......... .......... .......... 55% 214M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51500K .......... .......... .......... .......... .......... 55% 210M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51550K .......... .......... .......... .......... .......... 55% 326M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51600K .......... .......... .......... .......... .......... 55% 341M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51650K .......... .......... .......... .......... .......... 55% 198M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51700K .......... .......... .......... .......... .......... 55% 271M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51750K .......... .......... .......... .......... .......... 55% 350M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51800K .......... .......... .......... .......... .......... 55% 355M 0s 2024-09-12T00:44:18.281 INFO:teuthology.orchestra.run.smithi102.stderr: 51850K .......... .......... .......... .......... .......... 55% 365M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 51900K .......... .......... .......... .......... .......... 55% 271M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 51950K .......... .......... .......... .......... .......... 55% 78.1M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52000K .......... .......... .......... .......... .......... 56% 237M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52050K .......... .......... .......... .......... .......... 56% 296M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52100K .......... .......... .......... .......... .......... 56% 295M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52150K .......... .......... .......... .......... .......... 56% 344M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52200K .......... .......... .......... .......... .......... 56% 56.9M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52250K .......... .......... .......... .......... .......... 56% 111M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52300K .......... .......... .......... .......... .......... 56% 114M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52350K .......... .......... .......... .......... .......... 56% 328M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52400K .......... .......... .......... .......... .......... 56% 294M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52450K .......... .......... .......... .......... .......... 56% 130M 0s 2024-09-12T00:44:18.282 INFO:teuthology.orchestra.run.smithi102.stderr: 52500K .......... .......... .......... .......... .......... 56% 286M 0s 2024-09-12T00:44:18.283 INFO:teuthology.orchestra.run.smithi102.stderr: 52550K .......... .......... .......... .......... .......... 56% 321M 0s 2024-09-12T00:44:18.283 INFO:teuthology.orchestra.run.smithi102.stderr: 52600K .......... .......... .......... .......... .......... 56% 314M 0s 2024-09-12T00:44:18.283 INFO:teuthology.orchestra.run.smithi102.stderr: 52650K .......... .......... .......... .......... .......... 56% 332M 0s 2024-09-12T00:44:18.283 INFO:teuthology.orchestra.run.smithi102.stderr: 52700K .......... .......... .......... .......... .......... 56% 299M 0s 2024-09-12T00:44:18.283 INFO:teuthology.orchestra.run.smithi102.stderr: 52750K .......... .......... .......... .......... .......... 56% 352M 0s 2024-09-12T00:44:18.283 INFO:teuthology.orchestra.run.smithi102.stderr: 52800K .......... .......... .......... .......... .......... 56% 182M 0s 2024-09-12T00:44:18.283 INFO:teuthology.orchestra.run.smithi102.stderr: 52850K .......... .......... .......... .......... .......... 56% 252M 0s 2024-09-12T00:44:18.283 INFO:teuthology.orchestra.run.smithi102.stderr: 52900K .......... .......... .......... .......... .......... 56% 277M 0s 2024-09-12T00:44:18.283 INFO:teuthology.orchestra.run.smithi102.stderr: 52950K .......... .......... .......... .......... .......... 57% 354M 0s 2024-09-12T00:44:18.283 INFO:teuthology.orchestra.run.smithi102.stderr: 53000K .......... .......... .......... .......... .......... 57% 331M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53050K .......... .......... .......... .......... .......... 57% 298M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53100K .......... .......... .......... .......... .......... 57% 260M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53150K .......... .......... .......... .......... .......... 57% 348M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53200K .......... .......... .......... .......... .......... 57% 353M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53250K .......... .......... .......... .......... .......... 57% 360M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53300K .......... .......... .......... .......... .......... 57% 324M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53350K .......... .......... .......... .......... .......... 57% 183M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53400K .......... .......... .......... .......... .......... 57% 290M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53450K .......... .......... .......... .......... .......... 57% 315M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53500K .......... .......... .......... .......... .......... 57% 287M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53550K .......... .......... .......... .......... .......... 57% 353M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53600K .......... .......... .......... .......... .......... 57% 362M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53650K .......... .......... .......... .......... .......... 57% 341M 0s 2024-09-12T00:44:18.284 INFO:teuthology.orchestra.run.smithi102.stderr: 53700K .......... .......... .......... .......... .......... 57% 302M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 53750K .......... .......... .......... .......... .......... 57% 344M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 53800K .......... .......... .......... .......... .......... 57% 352M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 53850K .......... .......... .......... .......... .......... 58% 320M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 53900K .......... .......... .......... .......... .......... 58% 278M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 53950K .......... .......... .......... .......... .......... 58% 360M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 54000K .......... .......... .......... .......... .......... 58% 105M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 54050K .......... .......... .......... .......... .......... 58% 325M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 54100K .......... .......... .......... .......... .......... 58% 303M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 54150K .......... .......... .......... .......... .......... 58% 337M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 54200K .......... .......... .......... .......... .......... 58% 368M 0s 2024-09-12T00:44:18.285 INFO:teuthology.orchestra.run.smithi102.stderr: 54250K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54300K .......... .......... .......... .......... .......... 58% 282M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54350K .......... .......... .......... .......... .......... 58% 367M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54400K .......... .......... .......... .......... .......... 58% 359M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54450K .......... .......... .......... .......... .......... 58% 368M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54500K .......... .......... .......... .......... .......... 58% 81.3M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54550K .......... .......... .......... .......... .......... 58% 326M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54600K .......... .......... .......... .......... .......... 58% 355M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54650K .......... .......... .......... .......... .......... 58% 342M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54700K .......... .......... .......... .......... .......... 58% 274M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54750K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54800K .......... .......... .......... .......... .......... 59% 308M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54850K .......... .......... .......... .......... .......... 59% 318M 0s 2024-09-12T00:44:18.286 INFO:teuthology.orchestra.run.smithi102.stderr: 54900K .......... .......... .......... .......... .......... 59% 317M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 54950K .......... .......... .......... .......... .......... 59% 371M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 55000K .......... .......... .......... .......... .......... 59% 298M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 55050K .......... .......... .......... .......... .......... 59% 326M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 55100K .......... .......... .......... .......... .......... 59% 297M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 55150K .......... .......... .......... .......... .......... 59% 43.3M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 55200K .......... .......... .......... .......... .......... 59% 304M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 55250K .......... .......... .......... .......... .......... 59% 146M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 55300K .......... .......... .......... .......... .......... 59% 220M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 55350K .......... .......... .......... .......... .......... 59% 316M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 55400K .......... .......... .......... .......... .......... 59% 335M 0s 2024-09-12T00:44:18.287 INFO:teuthology.orchestra.run.smithi102.stderr: 55450K .......... .......... .......... .......... .......... 59% 128M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 55500K .......... .......... .......... .......... .......... 59% 142M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 55550K .......... .......... .......... .......... .......... 59% 195M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 55600K .......... .......... .......... .......... .......... 59% 365M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 55650K .......... .......... .......... .......... .......... 59% 132M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 55700K .......... .......... .......... .......... .......... 60% 285M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 55750K .......... .......... .......... .......... .......... 60% 313M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 55800K .......... .......... .......... .......... .......... 60% 357M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 55850K .......... .......... .......... .......... .......... 60% 301M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 55900K .......... .......... .......... .......... .......... 60% 272M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 55950K .......... .......... .......... .......... .......... 60% 344M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 56000K .......... .......... .......... .......... .......... 60% 348M 0s 2024-09-12T00:44:18.288 INFO:teuthology.orchestra.run.smithi102.stderr: 56050K .......... .......... .......... .......... .......... 60% 301M 0s 2024-09-12T00:44:18.289 INFO:teuthology.orchestra.run.smithi102.stderr: 56100K .......... .......... .......... .......... .......... 60% 315M 0s 2024-09-12T00:44:18.289 INFO:teuthology.orchestra.run.smithi102.stderr: 56150K .......... .......... .......... .......... .......... 60% 368M 0s 2024-09-12T00:44:18.289 INFO:teuthology.orchestra.run.smithi102.stderr: 56200K .......... .......... .......... .......... .......... 60% 328M 0s 2024-09-12T00:44:18.289 INFO:teuthology.orchestra.run.smithi102.stderr: 56250K .......... .......... .......... .......... .......... 60% 336M 0s 2024-09-12T00:44:18.289 INFO:teuthology.orchestra.run.smithi102.stderr: 56300K .......... .......... .......... .......... .......... 60% 285M 0s 2024-09-12T00:44:18.289 INFO:teuthology.orchestra.run.smithi102.stderr: 56350K .......... .......... .......... .......... .......... 60% 252M 0s 2024-09-12T00:44:18.289 INFO:teuthology.orchestra.run.smithi102.stderr: 56400K .......... .......... .......... .......... .......... 60% 302M 0s 2024-09-12T00:44:18.289 INFO:teuthology.orchestra.run.smithi102.stderr: 56450K .......... .......... .......... .......... .......... 60% 323M 0s 2024-09-12T00:44:18.289 INFO:teuthology.orchestra.run.smithi102.stderr: 56500K .......... .......... .......... .......... .......... 60% 329M 0s 2024-09-12T00:44:18.289 INFO:teuthology.orchestra.run.smithi102.stderr: 56550K .......... .......... .......... .......... .......... 60% 313M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 56600K .......... .......... .......... .......... .......... 60% 250M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 56650K .......... .......... .......... .......... .......... 61% 325M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 56700K .......... .......... .......... .......... .......... 61% 277M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 56750K .......... .......... .......... .......... .......... 61% 346M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 56800K .......... .......... .......... .......... .......... 61% 344M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 56850K .......... .......... .......... .......... .......... 61% 324M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 56900K .......... .......... .......... .......... .......... 61% 379M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 56950K .......... .......... .......... .......... .......... 61% 207M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 57000K .......... .......... .......... .......... .......... 61% 370M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 57050K .......... .......... .......... .......... .......... 61% 214M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 57100K .......... .......... .......... .......... .......... 61% 313M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 57150K .......... .......... .......... .......... .......... 61% 336M 0s 2024-09-12T00:44:18.290 INFO:teuthology.orchestra.run.smithi102.stderr: 57200K .......... .......... .......... .......... .......... 61% 260M 0s 2024-09-12T00:44:18.291 INFO:teuthology.orchestra.run.smithi102.stderr: 57250K .......... .......... .......... .......... .......... 61% 348M 0s 2024-09-12T00:44:18.291 INFO:teuthology.orchestra.run.smithi102.stderr: 57300K .......... .......... .......... .......... .......... 61% 328M 0s 2024-09-12T00:44:18.291 INFO:teuthology.orchestra.run.smithi102.stderr: 57350K .......... .......... .......... .......... .......... 61% 374M 0s 2024-09-12T00:44:18.291 INFO:teuthology.orchestra.run.smithi102.stderr: 57400K .......... .......... .......... .......... .......... 61% 336M 0s 2024-09-12T00:44:18.291 INFO:teuthology.orchestra.run.smithi102.stderr: 57450K .......... .......... .......... .......... .......... 61% 108M 0s 2024-09-12T00:44:18.291 INFO:teuthology.orchestra.run.smithi102.stderr: 57500K .......... .......... .......... .......... .......... 61% 362M 0s 2024-09-12T00:44:18.291 INFO:teuthology.orchestra.run.smithi102.stderr: 57550K .......... .......... .......... .......... .......... 62% 368M 0s 2024-09-12T00:44:18.291 INFO:teuthology.orchestra.run.smithi102.stderr: 57600K .......... .......... .......... .......... .......... 62% 66.3M 0s 2024-09-12T00:44:18.291 INFO:teuthology.orchestra.run.smithi102.stderr: 57650K .......... .......... .......... .......... .......... 62% 336M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 57700K .......... .......... .......... .......... .......... 62% 324M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 57750K .......... .......... .......... .......... .......... 62% 329M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 57800K .......... .......... .......... .......... .......... 62% 315M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 57850K .......... .......... .......... .......... .......... 62% 341M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 57900K .......... .......... .......... .......... .......... 62% 344M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 57950K .......... .......... .......... .......... .......... 62% 314M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 58000K .......... .......... .......... .......... .......... 62% 336M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 58050K .......... .......... .......... .......... .......... 62% 367M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 58100K .......... .......... .......... .......... .......... 62% 378M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 58150K .......... .......... .......... .......... .......... 62% 149M 0s 2024-09-12T00:44:18.292 INFO:teuthology.orchestra.run.smithi102.stderr: 58200K .......... .......... .......... .......... .......... 62% 49.8M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58250K .......... .......... .......... .......... .......... 62% 297M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58300K .......... .......... .......... .......... .......... 62% 319M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58350K .......... .......... .......... .......... .......... 62% 311M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58400K .......... .......... .......... .......... .......... 62% 319M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58450K .......... .......... .......... .......... .......... 62% 356M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58500K .......... .......... .......... .......... .......... 63% 249M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58550K .......... .......... .......... .......... .......... 63% 200M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58600K .......... .......... .......... .......... .......... 63% 305M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58650K .......... .......... .......... .......... .......... 63% 168M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58700K .......... .......... .......... .......... .......... 63% 151M 0s 2024-09-12T00:44:18.293 INFO:teuthology.orchestra.run.smithi102.stderr: 58750K .......... .......... .......... .......... .......... 63% 329M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 58800K .......... .......... .......... .......... .......... 63% 295M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 58850K .......... .......... .......... .......... .......... 63% 368M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 58900K .......... .......... .......... .......... .......... 63% 187M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 58950K .......... .......... .......... .......... .......... 63% 310M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 59000K .......... .......... .......... .......... .......... 63% 299M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 59050K .......... .......... .......... .......... .......... 63% 338M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 59100K .......... .......... .......... .......... .......... 63% 368M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 59150K .......... .......... .......... .......... .......... 63% 259M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 59200K .......... .......... .......... .......... .......... 63% 319M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 59250K .......... .......... .......... .......... .......... 63% 343M 0s 2024-09-12T00:44:18.294 INFO:teuthology.orchestra.run.smithi102.stderr: 59300K .......... .......... .......... .......... .......... 63% 299M 0s 2024-09-12T00:44:18.295 INFO:teuthology.orchestra.run.smithi102.stderr: 59350K .......... .......... .......... .......... .......... 63% 364M 0s 2024-09-12T00:44:18.295 INFO:teuthology.orchestra.run.smithi102.stderr: 59400K .......... .......... .......... .......... .......... 63% 350M 0s 2024-09-12T00:44:18.295 INFO:teuthology.orchestra.run.smithi102.stderr: 59450K .......... .......... .......... .......... .......... 64% 134M 0s 2024-09-12T00:44:18.295 INFO:teuthology.orchestra.run.smithi102.stderr: 59500K .......... .......... .......... .......... .......... 64% 266M 0s 2024-09-12T00:44:18.295 INFO:teuthology.orchestra.run.smithi102.stderr: 59550K .......... .......... .......... .......... .......... 64% 367M 0s 2024-09-12T00:44:18.295 INFO:teuthology.orchestra.run.smithi102.stderr: 59600K .......... .......... .......... .......... .......... 64% 330M 0s 2024-09-12T00:44:18.295 INFO:teuthology.orchestra.run.smithi102.stderr: 59650K .......... .......... .......... .......... .......... 64% 331M 0s 2024-09-12T00:44:18.295 INFO:teuthology.orchestra.run.smithi102.stderr: 59700K .......... .......... .......... .......... .......... 64% 324M 0s 2024-09-12T00:44:18.295 INFO:teuthology.orchestra.run.smithi102.stderr: 59750K .......... .......... .......... .......... .......... 64% 371M 0s 2024-09-12T00:44:18.295 INFO:teuthology.orchestra.run.smithi102.stderr: 59800K .......... .......... .......... .......... .......... 64% 367M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 59850K .......... .......... .......... .......... .......... 64% 241M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 59900K .......... .......... .......... .......... .......... 64% 289M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 59950K .......... .......... .......... .......... .......... 64% 56.9M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 60000K .......... .......... .......... .......... .......... 64% 240M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 60050K .......... .......... .......... .......... .......... 64% 351M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 60100K .......... .......... .......... .......... .......... 64% 284M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 60150K .......... .......... .......... .......... .......... 64% 348M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 60200K .......... .......... .......... .......... .......... 64% 344M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 60250K .......... .......... .......... .......... .......... 64% 321M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 60300K .......... .......... .......... .......... .......... 64% 272M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 60350K .......... .......... .......... .......... .......... 65% 327M 0s 2024-09-12T00:44:18.296 INFO:teuthology.orchestra.run.smithi102.stderr: 60400K .......... .......... .......... .......... .......... 65% 359M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60450K .......... .......... .......... .......... .......... 65% 368M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60500K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60550K .......... .......... .......... .......... .......... 65% 334M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60600K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60650K .......... .......... .......... .......... .......... 65% 375M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60700K .......... .......... .......... .......... .......... 65% 134M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60750K .......... .......... .......... .......... .......... 65% 80.9M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60800K .......... .......... .......... .......... .......... 65% 323M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60850K .......... .......... .......... .......... .......... 65% 306M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60900K .......... .......... .......... .......... .......... 65% 298M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 60950K .......... .......... .......... .......... .......... 65% 323M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 61000K .......... .......... .......... .......... .......... 65% 359M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 61050K .......... .......... .......... .......... .......... 65% 366M 0s 2024-09-12T00:44:18.297 INFO:teuthology.orchestra.run.smithi102.stderr: 61100K .......... .......... .......... .......... .......... 65% 309M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61150K .......... .......... .......... .......... .......... 65% 358M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61200K .......... .......... .......... .......... .......... 65% 94.1M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61250K .......... .......... .......... .......... .......... 65% 302M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61300K .......... .......... .......... .......... .......... 66% 279M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61350K .......... .......... .......... .......... .......... 66% 354M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61400K .......... .......... .......... .......... .......... 66% 341M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61450K .......... .......... .......... .......... .......... 66% 280M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61500K .......... .......... .......... .......... .......... 66% 315M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61550K .......... .......... .......... .......... .......... 66% 103M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61600K .......... .......... .......... .......... .......... 66% 251M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61650K .......... .......... .......... .......... .......... 66% 188M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61700K .......... .......... .......... .......... .......... 66% 320M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61750K .......... .......... .......... .......... .......... 66% 275M 0s 2024-09-12T00:44:18.298 INFO:teuthology.orchestra.run.smithi102.stderr: 61800K .......... .......... .......... .......... .......... 66% 285M 0s 2024-09-12T00:44:18.299 INFO:teuthology.orchestra.run.smithi102.stderr: 61850K .......... .......... .......... .......... .......... 66% 285M 0s 2024-09-12T00:44:18.299 INFO:teuthology.orchestra.run.smithi102.stderr: 61900K .......... .......... .......... .......... .......... 66% 341M 0s 2024-09-12T00:44:18.299 INFO:teuthology.orchestra.run.smithi102.stderr: 61950K .......... .......... .......... .......... .......... 66% 278M 0s 2024-09-12T00:44:18.299 INFO:teuthology.orchestra.run.smithi102.stderr: 62000K .......... .......... .......... .......... .......... 66% 241M 0s 2024-09-12T00:44:18.299 INFO:teuthology.orchestra.run.smithi102.stderr: 62050K .......... .......... .......... .......... .......... 66% 130M 0s 2024-09-12T00:44:18.299 INFO:teuthology.orchestra.run.smithi102.stderr: 62100K .......... .......... .......... .......... .......... 66% 315M 0s 2024-09-12T00:44:18.299 INFO:teuthology.orchestra.run.smithi102.stderr: 62150K .......... .......... .......... .......... .......... 66% 281M 0s 2024-09-12T00:44:18.299 INFO:teuthology.orchestra.run.smithi102.stderr: 62200K .......... .......... .......... .......... .......... 67% 315M 0s 2024-09-12T00:44:18.299 INFO:teuthology.orchestra.run.smithi102.stderr: 62250K .......... .......... .......... .......... .......... 67% 322M 0s 2024-09-12T00:44:18.299 INFO:teuthology.orchestra.run.smithi102.stderr: 62300K .......... .......... .......... .......... .......... 67% 374M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62350K .......... .......... .......... .......... .......... 67% 300M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62400K .......... .......... .......... .......... .......... 67% 315M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62450K .......... .......... .......... .......... .......... 67% 355M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62500K .......... .......... .......... .......... .......... 67% 336M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62550K .......... .......... .......... .......... .......... 67% 270M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62600K .......... .......... .......... .......... .......... 67% 315M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62650K .......... .......... .......... .......... .......... 67% 347M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62700K .......... .......... .......... .......... .......... 67% 151M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62750K .......... .......... .......... .......... .......... 67% 252M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62800K .......... .......... .......... .......... .......... 67% 325M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62850K .......... .......... .......... .......... .......... 67% 384M 0s 2024-09-12T00:44:18.300 INFO:teuthology.orchestra.run.smithi102.stderr: 62900K .......... .......... .......... .......... .......... 67% 72.4M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 62950K .......... .......... .......... .......... .......... 67% 263M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63000K .......... .......... .......... .......... .......... 67% 350M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63050K .......... .......... .......... .......... .......... 67% 385M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63100K .......... .......... .......... .......... .......... 67% 212M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63150K .......... .......... .......... .......... .......... 68% 253M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63200K .......... .......... .......... .......... .......... 68% 349M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63250K .......... .......... .......... .......... .......... 68% 368M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63300K .......... .......... .......... .......... .......... 68% 361M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63350K .......... .......... .......... .......... .......... 68% 317M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63400K .......... .......... .......... .......... .......... 68% 386M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63450K .......... .......... .......... .......... .......... 68% 179M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63500K .......... .......... .......... .......... .......... 68% 225M 0s 2024-09-12T00:44:18.301 INFO:teuthology.orchestra.run.smithi102.stderr: 63550K .......... .......... .......... .......... .......... 68% 280M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 63600K .......... .......... .......... .......... .......... 68% 354M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 63650K .......... .......... .......... .......... .......... 68% 364M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 63700K .......... .......... .......... .......... .......... 68% 176M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 63750K .......... .......... .......... .......... .......... 68% 201M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 63800K .......... .......... .......... .......... .......... 68% 204M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 63850K .......... .......... .......... .......... .......... 68% 350M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 63900K .......... .......... .......... .......... .......... 68% 340M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 63950K .......... .......... .......... .......... .......... 68% 298M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 64000K .......... .......... .......... .......... .......... 68% 361M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 64050K .......... .......... .......... .......... .......... 68% 60.3M 0s 2024-09-12T00:44:18.302 INFO:teuthology.orchestra.run.smithi102.stderr: 64100K .......... .......... .......... .......... .......... 69% 257M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64150K .......... .......... .......... .......... .......... 69% 330M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64200K .......... .......... .......... .......... .......... 69% 385M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64250K .......... .......... .......... .......... .......... 69% 329M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64300K .......... .......... .......... .......... .......... 69% 307M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64350K .......... .......... .......... .......... .......... 69% 161M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64400K .......... .......... .......... .......... .......... 69% 285M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64450K .......... .......... .......... .......... .......... 69% 349M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64500K .......... .......... .......... .......... .......... 69% 317M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64550K .......... .......... .......... .......... .......... 69% 340M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64600K .......... .......... .......... .......... .......... 69% 312M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64650K .......... .......... .......... .......... .......... 69% 373M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64700K .......... .......... .......... .......... .......... 69% 99.2M 0s 2024-09-12T00:44:18.303 INFO:teuthology.orchestra.run.smithi102.stderr: 64750K .......... .......... .......... .......... .......... 69% 279M 0s 2024-09-12T00:44:18.304 INFO:teuthology.orchestra.run.smithi102.stderr: 64800K .......... .......... .......... .......... .......... 69% 372M 0s 2024-09-12T00:44:18.304 INFO:teuthology.orchestra.run.smithi102.stderr: 64850K .......... .......... .......... .......... .......... 69% 286M 0s 2024-09-12T00:44:18.304 INFO:teuthology.orchestra.run.smithi102.stderr: 64900K .......... .......... .......... .......... .......... 69% 314M 0s 2024-09-12T00:44:18.304 INFO:teuthology.orchestra.run.smithi102.stderr: 64950K .......... .......... .......... .......... .......... 69% 318M 0s 2024-09-12T00:44:18.304 INFO:teuthology.orchestra.run.smithi102.stderr: 65000K .......... .......... .......... .......... .......... 70% 356M 0s 2024-09-12T00:44:18.304 INFO:teuthology.orchestra.run.smithi102.stderr: 65050K .......... .......... .......... .......... .......... 70% 378M 0s 2024-09-12T00:44:18.304 INFO:teuthology.orchestra.run.smithi102.stderr: 65100K .......... .......... .......... .......... .......... 70% 381M 0s 2024-09-12T00:44:18.304 INFO:teuthology.orchestra.run.smithi102.stderr: 65150K .......... .......... .......... .......... .......... 70% 97.2M 0s 2024-09-12T00:44:18.304 INFO:teuthology.orchestra.run.smithi102.stderr: 65200K .......... .......... .......... .......... .......... 70% 342M 0s 2024-09-12T00:44:18.304 INFO:teuthology.orchestra.run.smithi102.stderr: 65250K .......... .......... .......... .......... .......... 70% 363M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65300K .......... .......... .......... .......... .......... 70% 350M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65350K .......... .......... .......... .......... .......... 70% 323M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65400K .......... .......... .......... .......... .......... 70% 340M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65450K .......... .......... .......... .......... .......... 70% 377M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65500K .......... .......... .......... .......... .......... 70% 353M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65550K .......... .......... .......... .......... .......... 70% 297M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65600K .......... .......... .......... .......... .......... 70% 382M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65650K .......... .......... .......... .......... .......... 70% 103M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65700K .......... .......... .......... .......... .......... 70% 331M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65750K .......... .......... .......... .......... .......... 70% 291M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65800K .......... .......... .......... .......... .......... 70% 379M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65850K .......... .......... .......... .......... .......... 70% 372M 0s 2024-09-12T00:44:18.305 INFO:teuthology.orchestra.run.smithi102.stderr: 65900K .......... .......... .......... .......... .......... 70% 127M 0s 2024-09-12T00:44:18.306 INFO:teuthology.orchestra.run.smithi102.stderr: 65950K .......... .......... .......... .......... .......... 71% 232M 0s 2024-09-12T00:44:18.306 INFO:teuthology.orchestra.run.smithi102.stderr: 66000K .......... .......... .......... .......... .......... 71% 131M 0s 2024-09-12T00:44:18.306 INFO:teuthology.orchestra.run.smithi102.stderr: 66050K .......... .......... .......... .......... .......... 71% 318M 0s 2024-09-12T00:44:18.306 INFO:teuthology.orchestra.run.smithi102.stderr: 66100K .......... .......... .......... .......... .......... 71% 370M 0s 2024-09-12T00:44:18.306 INFO:teuthology.orchestra.run.smithi102.stderr: 66150K .......... .......... .......... .......... .......... 71% 336M 0s 2024-09-12T00:44:18.306 INFO:teuthology.orchestra.run.smithi102.stderr: 66200K .......... .......... .......... .......... .......... 71% 354M 0s 2024-09-12T00:44:18.306 INFO:teuthology.orchestra.run.smithi102.stderr: 66250K .......... .......... .......... .......... .......... 71% 195M 0s 2024-09-12T00:44:18.306 INFO:teuthology.orchestra.run.smithi102.stderr: 66300K .......... .......... .......... .......... .......... 71% 250M 0s 2024-09-12T00:44:18.306 INFO:teuthology.orchestra.run.smithi102.stderr: 66350K .......... .......... .......... .......... .......... 71% 307M 0s 2024-09-12T00:44:18.306 INFO:teuthology.orchestra.run.smithi102.stderr: 66400K .......... .......... .......... .......... .......... 71% 225M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66450K .......... .......... .......... .......... .......... 71% 326M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66500K .......... .......... .......... .......... .......... 71% 351M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66550K .......... .......... .......... .......... .......... 71% 319M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66600K .......... .......... .......... .......... .......... 71% 346M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66650K .......... .......... .......... .......... .......... 71% 167M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66700K .......... .......... .......... .......... .......... 71% 297M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66750K .......... .......... .......... .......... .......... 71% 114M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66800K .......... .......... .......... .......... .......... 71% 315M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66850K .......... .......... .......... .......... .......... 72% 351M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66900K .......... .......... .......... .......... .......... 72% 291M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 66950K .......... .......... .......... .......... .......... 72% 374M 0s 2024-09-12T00:44:18.307 INFO:teuthology.orchestra.run.smithi102.stderr: 67000K .......... .......... .......... .......... .......... 72% 372M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67050K .......... .......... .......... .......... .......... 72% 99.0M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67100K .......... .......... .......... .......... .......... 72% 269M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67150K .......... .......... .......... .......... .......... 72% 171M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67200K .......... .......... .......... .......... .......... 72% 351M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67250K .......... .......... .......... .......... .......... 72% 343M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67300K .......... .......... .......... .......... .......... 72% 284M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67350K .......... .......... .......... .......... .......... 72% 326M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67400K .......... .......... .......... .......... .......... 72% 369M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67450K .......... .......... .......... .......... .......... 72% 274M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67500K .......... .......... .......... .......... .......... 72% 135M 0s 2024-09-12T00:44:18.308 INFO:teuthology.orchestra.run.smithi102.stderr: 67550K .......... .......... .......... .......... .......... 72% 350M 0s 2024-09-12T00:44:18.309 INFO:teuthology.orchestra.run.smithi102.stderr: 67600K .......... .......... .......... .......... .......... 72% 114M 0s 2024-09-12T00:44:18.309 INFO:teuthology.orchestra.run.smithi102.stderr: 67650K .......... .......... .......... .......... .......... 72% 297M 0s 2024-09-12T00:44:18.309 INFO:teuthology.orchestra.run.smithi102.stderr: 67700K .......... .......... .......... .......... .......... 72% 367M 0s 2024-09-12T00:44:18.309 INFO:teuthology.orchestra.run.smithi102.stderr: 67750K .......... .......... .......... .......... .......... 72% 294M 0s 2024-09-12T00:44:18.309 INFO:teuthology.orchestra.run.smithi102.stderr: 67800K .......... .......... .......... .......... .......... 73% 269M 0s 2024-09-12T00:44:18.309 INFO:teuthology.orchestra.run.smithi102.stderr: 67850K .......... .......... .......... .......... .......... 73% 224M 0s 2024-09-12T00:44:18.309 INFO:teuthology.orchestra.run.smithi102.stderr: 67900K .......... .......... .......... .......... .......... 73% 156M 0s 2024-09-12T00:44:18.309 INFO:teuthology.orchestra.run.smithi102.stderr: 67950K .......... .......... .......... .......... .......... 73% 243M 0s 2024-09-12T00:44:18.309 INFO:teuthology.orchestra.run.smithi102.stderr: 68000K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-12T00:44:18.309 INFO:teuthology.orchestra.run.smithi102.stderr: 68050K .......... .......... .......... .......... .......... 73% 208M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68100K .......... .......... .......... .......... .......... 73% 380M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68150K .......... .......... .......... .......... .......... 73% 315M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68200K .......... .......... .......... .......... .......... 73% 349M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68250K .......... .......... .......... .......... .......... 73% 361M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68300K .......... .......... .......... .......... .......... 73% 352M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68350K .......... .......... .......... .......... .......... 73% 368M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68400K .......... .......... .......... .......... .......... 73% 308M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68450K .......... .......... .......... .......... .......... 73% 372M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68500K .......... .......... .......... .......... .......... 73% 315M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68550K .......... .......... .......... .......... .......... 73% 104M 0s 2024-09-12T00:44:18.310 INFO:teuthology.orchestra.run.smithi102.stderr: 68600K .......... .......... .......... .......... .......... 73% 351M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 68650K .......... .......... .......... .......... .......... 73% 307M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 68700K .......... .......... .......... .......... .......... 74% 127M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 68750K .......... .......... .......... .......... .......... 74% 359M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 68800K .......... .......... .......... .......... .......... 74% 366M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 68850K .......... .......... .......... .......... .......... 74% 218M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 68900K .......... .......... .......... .......... .......... 74% 339M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 68950K .......... .......... .......... .......... .......... 74% 383M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 69000K .......... .......... .......... .......... .......... 74% 328M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 69050K .......... .......... .......... .......... .......... 74% 186M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 69100K .......... .......... .......... .......... .......... 74% 317M 0s 2024-09-12T00:44:18.311 INFO:teuthology.orchestra.run.smithi102.stderr: 69150K .......... .......... .......... .......... .......... 74% 344M 0s 2024-09-12T00:44:18.312 INFO:teuthology.orchestra.run.smithi102.stderr: 69200K .......... .......... .......... .......... .......... 74% 363M 0s 2024-09-12T00:44:18.312 INFO:teuthology.orchestra.run.smithi102.stderr: 69250K .......... .......... .......... .......... .......... 74% 187M 0s 2024-09-12T00:44:18.312 INFO:teuthology.orchestra.run.smithi102.stderr: 69300K .......... .......... .......... .......... .......... 74% 133M 0s 2024-09-12T00:44:18.312 INFO:teuthology.orchestra.run.smithi102.stderr: 69350K .......... .......... .......... .......... .......... 74% 254M 0s 2024-09-12T00:44:18.312 INFO:teuthology.orchestra.run.smithi102.stderr: 69400K .......... .......... .......... .......... .......... 74% 337M 0s 2024-09-12T00:44:18.312 INFO:teuthology.orchestra.run.smithi102.stderr: 69450K .......... .......... .......... .......... .......... 74% 348M 0s 2024-09-12T00:44:18.312 INFO:teuthology.orchestra.run.smithi102.stderr: 69500K .......... .......... .......... .......... .......... 74% 316M 0s 2024-09-12T00:44:18.312 INFO:teuthology.orchestra.run.smithi102.stderr: 69550K .......... .......... .......... .......... .......... 74% 223M 0s 2024-09-12T00:44:18.312 INFO:teuthology.orchestra.run.smithi102.stderr: 69600K .......... .......... .......... .......... .......... 74% 242M 0s 2024-09-12T00:44:18.312 INFO:teuthology.orchestra.run.smithi102.stderr: 69650K .......... .......... .......... .......... .......... 75% 346M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 69700K .......... .......... .......... .......... .......... 75% 316M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 69750K .......... .......... .......... .......... .......... 75% 264M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 69800K .......... .......... .......... .......... .......... 75% 228M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 69850K .......... .......... .......... .......... .......... 75% 314M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 69900K .......... .......... .......... .......... .......... 75% 214M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 69950K .......... .......... .......... .......... .......... 75% 80.3M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 70000K .......... .......... .......... .......... .......... 75% 326M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 70050K .......... .......... .......... .......... .......... 75% 346M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 70100K .......... .......... .......... .......... .......... 75% 383M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 70150K .......... .......... .......... .......... .......... 75% 348M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 70200K .......... .......... .......... .......... .......... 75% 83.8M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 70250K .......... .......... .......... .......... .......... 75% 246M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 70300K .......... .......... .......... .......... .......... 75% 346M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 70350K .......... .......... .......... .......... .......... 75% 357M 0s 2024-09-12T00:44:18.313 INFO:teuthology.orchestra.run.smithi102.stderr: 70400K .......... .......... .......... .......... .......... 75% 307M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70450K .......... .......... .......... .......... .......... 75% 352M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70500K .......... .......... .......... .......... .......... 75% 385M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70550K .......... .......... .......... .......... .......... 75% 112M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70600K .......... .......... .......... .......... .......... 76% 314M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70650K .......... .......... .......... .......... .......... 76% 320M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70700K .......... .......... .......... .......... .......... 76% 380M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70750K .......... .......... .......... .......... .......... 76% 207M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70800K .......... .......... .......... .......... .......... 76% 242M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70850K .......... .......... .......... .......... .......... 76% 298M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70900K .......... .......... .......... .......... .......... 76% 174M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 70950K .......... .......... .......... .......... .......... 76% 335M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 71000K .......... .......... .......... .......... .......... 76% 242M 0s 2024-09-12T00:44:18.314 INFO:teuthology.orchestra.run.smithi102.stderr: 71050K .......... .......... .......... .......... .......... 76% 328M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71100K .......... .......... .......... .......... .......... 76% 211M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71150K .......... .......... .......... .......... .......... 76% 305M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71200K .......... .......... .......... .......... .......... 76% 196M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71250K .......... .......... .......... .......... .......... 76% 311M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71300K .......... .......... .......... .......... .......... 76% 305M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71350K .......... .......... .......... .......... .......... 76% 322M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71400K .......... .......... .......... .......... .......... 76% 381M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71450K .......... .......... .......... .......... .......... 76% 381M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71500K .......... .......... .......... .......... .......... 77% 296M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71550K .......... .......... .......... .......... .......... 77% 299M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71600K .......... .......... .......... .......... .......... 77% 108M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71650K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71700K .......... .......... .......... .......... .......... 77% 373M 0s 2024-09-12T00:44:18.315 INFO:teuthology.orchestra.run.smithi102.stderr: 71750K .......... .......... .......... .......... .......... 77% 333M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 71800K .......... .......... .......... .......... .......... 77% 356M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 71850K .......... .......... .......... .......... .......... 77% 394M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 71900K .......... .......... .......... .......... .......... 77% 211M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 71950K .......... .......... .......... .......... .......... 77% 355M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 72000K .......... .......... .......... .......... .......... 77% 337M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 72050K .......... .......... .......... .......... .......... 77% 359M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 72100K .......... .......... .......... .......... .......... 77% 261M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 72150K .......... .......... .......... .......... .......... 77% 188M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 72200K .......... .......... .......... .......... .......... 77% 349M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 72250K .......... .......... .......... .......... .......... 77% 310M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 72300K .......... .......... .......... .......... .......... 77% 152M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 72350K .......... .......... .......... .......... .......... 77% 348M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 72400K .......... .......... .......... .......... .......... 77% 338M 0s 2024-09-12T00:44:18.316 INFO:teuthology.orchestra.run.smithi102.stderr: 72450K .......... .......... .......... .......... .......... 78% 150M 0s 2024-09-12T00:44:18.317 INFO:teuthology.orchestra.run.smithi102.stderr: 72500K .......... .......... .......... .......... .......... 78% 304M 0s 2024-09-12T00:44:18.317 INFO:teuthology.orchestra.run.smithi102.stderr: 72550K .......... .......... .......... .......... .......... 78% 351M 0s 2024-09-12T00:44:18.317 INFO:teuthology.orchestra.run.smithi102.stderr: 72600K .......... .......... .......... .......... .......... 78% 390M 0s 2024-09-12T00:44:18.317 INFO:teuthology.orchestra.run.smithi102.stderr: 72650K .......... .......... .......... .......... .......... 78% 357M 0s 2024-09-12T00:44:18.317 INFO:teuthology.orchestra.run.smithi102.stderr: 72700K .......... .......... .......... .......... .......... 78% 150M 0s 2024-09-12T00:44:18.317 INFO:teuthology.orchestra.run.smithi102.stderr: 72750K .......... .......... .......... .......... .......... 78% 331M 0s 2024-09-12T00:44:18.317 INFO:teuthology.orchestra.run.smithi102.stderr: 72800K .......... .......... .......... .......... .......... 78% 282M 0s 2024-09-12T00:44:18.317 INFO:teuthology.orchestra.run.smithi102.stderr: 72850K .......... .......... .......... .......... .......... 78% 345M 0s 2024-09-12T00:44:18.317 INFO:teuthology.orchestra.run.smithi102.stderr: 72900K .......... .......... .......... .......... .......... 78% 330M 0s 2024-09-12T00:44:18.317 INFO:teuthology.orchestra.run.smithi102.stderr: 72950K .......... .......... .......... .......... .......... 78% 93.1M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73000K .......... .......... .......... .......... .......... 78% 115M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73050K .......... .......... .......... .......... .......... 78% 317M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73100K .......... .......... .......... .......... .......... 78% 203M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73150K .......... .......... .......... .......... .......... 78% 273M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73200K .......... .......... .......... .......... .......... 78% 283M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73250K .......... .......... .......... .......... .......... 78% 226M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73300K .......... .......... .......... .......... .......... 78% 227M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73350K .......... .......... .......... .......... .......... 79% 312M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73400K .......... .......... .......... .......... .......... 79% 346M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73450K .......... .......... .......... .......... .......... 79% 109M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73500K .......... .......... .......... .......... .......... 79% 332M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73550K .......... .......... .......... .......... .......... 79% 357M 0s 2024-09-12T00:44:18.318 INFO:teuthology.orchestra.run.smithi102.stderr: 73600K .......... .......... .......... .......... .......... 79% 297M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 73650K .......... .......... .......... .......... .......... 79% 357M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 73700K .......... .......... .......... .......... .......... 79% 344M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 73750K .......... .......... .......... .......... .......... 79% 361M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 73800K .......... .......... .......... .......... .......... 79% 315M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 73850K .......... .......... .......... .......... .......... 79% 255M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 73900K .......... .......... .......... .......... .......... 79% 262M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 73950K .......... .......... .......... .......... .......... 79% 168M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 74000K .......... .......... .......... .......... .......... 79% 355M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 74050K .......... .......... .......... .......... .......... 79% 129M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 74100K .......... .......... .......... .......... .......... 79% 344M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 74150K .......... .......... .......... .......... .......... 79% 285M 0s 2024-09-12T00:44:18.319 INFO:teuthology.orchestra.run.smithi102.stderr: 74200K .......... .......... .......... .......... .......... 79% 205M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74250K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74300K .......... .......... .......... .......... .......... 80% 357M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74350K .......... .......... .......... .......... .......... 80% 316M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74400K .......... .......... .......... .......... .......... 80% 120M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74450K .......... .......... .......... .......... .......... 80% 286M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74500K .......... .......... .......... .......... .......... 80% 229M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74550K .......... .......... .......... .......... .......... 80% 327M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74600K .......... .......... .......... .......... .......... 80% 210M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74650K .......... .......... .......... .......... .......... 80% 319M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74700K .......... .......... .......... .......... .......... 80% 307M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74750K .......... .......... .......... .......... .......... 80% 321M 0s 2024-09-12T00:44:18.320 INFO:teuthology.orchestra.run.smithi102.stderr: 74800K .......... .......... .......... .......... .......... 80% 218M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 74850K .......... .......... .......... .......... .......... 80% 312M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 74900K .......... .......... .......... .......... .......... 80% 313M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 74950K .......... .......... .......... .......... .......... 80% 325M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 75000K .......... .......... .......... .......... .......... 80% 252M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 75050K .......... .......... .......... .......... .......... 80% 289M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 75100K .......... .......... .......... .......... .......... 80% 321M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 75150K .......... .......... .......... .......... .......... 80% 237M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 75200K .......... .......... .......... .......... .......... 81% 263M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 75250K .......... .......... .......... .......... .......... 81% 324M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 75300K .......... .......... .......... .......... .......... 81% 336M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 75350K .......... .......... .......... .......... .......... 81% 90.9M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 75400K .......... .......... .......... .......... .......... 81% 159M 0s 2024-09-12T00:44:18.321 INFO:teuthology.orchestra.run.smithi102.stderr: 75450K .......... .......... .......... .......... .......... 81% 268M 0s 2024-09-12T00:44:18.322 INFO:teuthology.orchestra.run.smithi102.stderr: 75500K .......... .......... .......... .......... .......... 81% 225M 0s 2024-09-12T00:44:18.322 INFO:teuthology.orchestra.run.smithi102.stderr: 75550K .......... .......... .......... .......... .......... 81% 365M 0s 2024-09-12T00:44:18.322 INFO:teuthology.orchestra.run.smithi102.stderr: 75600K .......... .......... .......... .......... .......... 81% 316M 0s 2024-09-12T00:44:18.322 INFO:teuthology.orchestra.run.smithi102.stderr: 75650K .......... .......... .......... .......... .......... 81% 284M 0s 2024-09-12T00:44:18.322 INFO:teuthology.orchestra.run.smithi102.stderr: 75700K .......... .......... .......... .......... .......... 81% 321M 0s 2024-09-12T00:44:18.322 INFO:teuthology.orchestra.run.smithi102.stderr: 75750K .......... .......... .......... .......... .......... 81% 276M 0s 2024-09-12T00:44:18.322 INFO:teuthology.orchestra.run.smithi102.stderr: 75800K .......... .......... .......... .......... .......... 81% 378M 0s 2024-09-12T00:44:18.322 INFO:teuthology.orchestra.run.smithi102.stderr: 75850K .......... .......... .......... .......... .......... 81% 375M 0s 2024-09-12T00:44:18.322 INFO:teuthology.orchestra.run.smithi102.stderr: 75900K .......... .......... .......... .......... .......... 81% 461M 0s 2024-09-12T00:44:18.322 INFO:teuthology.orchestra.run.smithi102.stderr: 75950K .......... .......... .......... .......... .......... 81% 134M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76000K .......... .......... .......... .......... .......... 81% 209M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76050K .......... .......... .......... .......... .......... 81% 105M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76100K .......... .......... .......... .......... .......... 81% 211M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76150K .......... .......... .......... .......... .......... 82% 258M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76200K .......... .......... .......... .......... .......... 82% 263M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76250K .......... .......... .......... .......... .......... 82% 266M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76300K .......... .......... .......... .......... .......... 82% 258M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76350K .......... .......... .......... .......... .......... 82% 388M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76400K .......... .......... .......... .......... .......... 82% 395M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76450K .......... .......... .......... .......... .......... 82% 221M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76500K .......... .......... .......... .......... .......... 82% 210M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76550K .......... .......... .......... .......... .......... 82% 222M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76600K .......... .......... .......... .......... .......... 82% 280M 0s 2024-09-12T00:44:18.323 INFO:teuthology.orchestra.run.smithi102.stderr: 76650K .......... .......... .......... .......... .......... 82% 245M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 76700K .......... .......... .......... .......... .......... 82% 300M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 76750K .......... .......... .......... .......... .......... 82% 315M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 76800K .......... .......... .......... .......... .......... 82% 389M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 76850K .......... .......... .......... .......... .......... 82% 256M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 76900K .......... .......... .......... .......... .......... 82% 312M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 76950K .......... .......... .......... .......... .......... 82% 317M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 77000K .......... .......... .......... .......... .......... 82% 363M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 77050K .......... .......... .......... .......... .......... 82% 286M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 77100K .......... .......... .......... .......... .......... 83% 142M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 77150K .......... .......... .......... .......... .......... 83% 238M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 77200K .......... .......... .......... .......... .......... 83% 403M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 77250K .......... .......... .......... .......... .......... 83% 263M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 77300K .......... .......... .......... .......... .......... 83% 258M 0s 2024-09-12T00:44:18.324 INFO:teuthology.orchestra.run.smithi102.stderr: 77350K .......... .......... .......... .......... .......... 83% 277M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77400K .......... .......... .......... .......... .......... 83% 367M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77450K .......... .......... .......... .......... .......... 83% 165M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77500K .......... .......... .......... .......... .......... 83% 214M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77550K .......... .......... .......... .......... .......... 83% 403M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77600K .......... .......... .......... .......... .......... 83% 104M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77650K .......... .......... .......... .......... .......... 83% 296M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77700K .......... .......... .......... .......... .......... 83% 277M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77750K .......... .......... .......... .......... .......... 83% 333M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77800K .......... .......... .......... .......... .......... 83% 244M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77850K .......... .......... .......... .......... .......... 83% 359M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77900K .......... .......... .......... .......... .......... 83% 300M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 77950K .......... .......... .......... .......... .......... 83% 183M 0s 2024-09-12T00:44:18.325 INFO:teuthology.orchestra.run.smithi102.stderr: 78000K .......... .......... .......... .......... .......... 84% 272M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78050K .......... .......... .......... .......... .......... 84% 281M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78100K .......... .......... .......... .......... .......... 84% 342M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78150K .......... .......... .......... .......... .......... 84% 318M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78200K .......... .......... .......... .......... .......... 84% 287M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78250K .......... .......... .......... .......... .......... 84% 401M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78300K .......... .......... .......... .......... .......... 84% 114M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78350K .......... .......... .......... .......... .......... 84% 325M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78400K .......... .......... .......... .......... .......... 84% 325M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78450K .......... .......... .......... .......... .......... 84% 180M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78500K .......... .......... .......... .......... .......... 84% 332M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78550K .......... .......... .......... .......... .......... 84% 306M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78600K .......... .......... .......... .......... .......... 84% 293M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78650K .......... .......... .......... .......... .......... 84% 288M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78700K .......... .......... .......... .......... .......... 84% 286M 0s 2024-09-12T00:44:18.326 INFO:teuthology.orchestra.run.smithi102.stderr: 78750K .......... .......... .......... .......... .......... 84% 405M 0s 2024-09-12T00:44:18.327 INFO:teuthology.orchestra.run.smithi102.stderr: 78800K .......... .......... .......... .......... .......... 84% 81.9M 0s 2024-09-12T00:44:18.327 INFO:teuthology.orchestra.run.smithi102.stderr: 78850K .......... .......... .......... .......... .......... 84% 242M 0s 2024-09-12T00:44:18.327 INFO:teuthology.orchestra.run.smithi102.stderr: 78900K .......... .......... .......... .......... .......... 84% 274M 0s 2024-09-12T00:44:18.327 INFO:teuthology.orchestra.run.smithi102.stderr: 78950K .......... .......... .......... .......... .......... 85% 251M 0s 2024-09-12T00:44:18.327 INFO:teuthology.orchestra.run.smithi102.stderr: 79000K .......... .......... .......... .......... .......... 85% 348M 0s 2024-09-12T00:44:18.327 INFO:teuthology.orchestra.run.smithi102.stderr: 79050K .......... .......... .......... .......... .......... 85% 406M 0s 2024-09-12T00:44:18.327 INFO:teuthology.orchestra.run.smithi102.stderr: 79100K .......... .......... .......... .......... .......... 85% 145M 0s 2024-09-12T00:44:18.327 INFO:teuthology.orchestra.run.smithi102.stderr: 79150K .......... .......... .......... .......... .......... 85% 250M 0s 2024-09-12T00:44:18.327 INFO:teuthology.orchestra.run.smithi102.stderr: 79200K .......... .......... .......... .......... .......... 85% 234M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79250K .......... .......... .......... .......... .......... 85% 249M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79300K .......... .......... .......... .......... .......... 85% 407M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79350K .......... .......... .......... .......... .......... 85% 320M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79400K .......... .......... .......... .......... .......... 85% 207M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79450K .......... .......... .......... .......... .......... 85% 262M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79500K .......... .......... .......... .......... .......... 85% 362M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79550K .......... .......... .......... .......... .......... 85% 285M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79600K .......... .......... .......... .......... .......... 85% 256M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79650K .......... .......... .......... .......... .......... 85% 312M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79700K .......... .......... .......... .......... .......... 85% 360M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79750K .......... .......... .......... .......... .......... 85% 308M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79800K .......... .......... .......... .......... .......... 85% 264M 0s 2024-09-12T00:44:18.328 INFO:teuthology.orchestra.run.smithi102.stderr: 79850K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-12T00:44:18.329 INFO:teuthology.orchestra.run.smithi102.stderr: 79900K .......... .......... .......... .......... .......... 86% 164M 0s 2024-09-12T00:44:18.329 INFO:teuthology.orchestra.run.smithi102.stderr: 79950K .......... .......... .......... .......... .......... 86% 236M 0s 2024-09-12T00:44:18.329 INFO:teuthology.orchestra.run.smithi102.stderr: 80000K .......... .......... .......... .......... .......... 86% 265M 0s 2024-09-12T00:44:18.329 INFO:teuthology.orchestra.run.smithi102.stderr: 80050K .......... .......... .......... .......... .......... 86% 350M 0s 2024-09-12T00:44:18.329 INFO:teuthology.orchestra.run.smithi102.stderr: 80100K .......... .......... .......... .......... .......... 86% 405M 0s 2024-09-12T00:44:18.329 INFO:teuthology.orchestra.run.smithi102.stderr: 80150K .......... .......... .......... .......... .......... 86% 158M 0s 2024-09-12T00:44:18.329 INFO:teuthology.orchestra.run.smithi102.stderr: 80200K .......... .......... .......... .......... .......... 86% 226M 0s 2024-09-12T00:44:18.329 INFO:teuthology.orchestra.run.smithi102.stderr: 80250K .......... .......... .......... .......... .......... 86% 320M 0s 2024-09-12T00:44:18.329 INFO:teuthology.orchestra.run.smithi102.stderr: 80300K .......... .......... .......... .......... .......... 86% 303M 0s 2024-09-12T00:44:18.329 INFO:teuthology.orchestra.run.smithi102.stderr: 80350K .......... .......... .......... .......... .......... 86% 292M 0s 2024-09-12T00:44:18.330 INFO:teuthology.orchestra.run.smithi102.stderr: 80400K .......... .......... .......... .......... .......... 86% 382M 0s 2024-09-12T00:44:18.330 INFO:teuthology.orchestra.run.smithi102.stderr: 80450K .......... .......... .......... .......... .......... 86% 311M 0s 2024-09-12T00:44:18.330 INFO:teuthology.orchestra.run.smithi102.stderr: 80500K .......... .......... .......... .......... .......... 86% 80.1M 0s 2024-09-12T00:44:18.330 INFO:teuthology.orchestra.run.smithi102.stderr: 80550K .......... .......... .......... .......... .......... 86% 249M 0s 2024-09-12T00:44:18.330 INFO:teuthology.orchestra.run.smithi102.stderr: 80600K .......... .......... .......... .......... .......... 86% 384M 0s 2024-09-12T00:44:18.330 INFO:teuthology.orchestra.run.smithi102.stderr: 80650K .......... .......... .......... .......... .......... 86% 226M 0s 2024-09-12T00:44:18.330 INFO:teuthology.orchestra.run.smithi102.stderr: 80700K .......... .......... .......... .......... .......... 86% 280M 0s 2024-09-12T00:44:18.330 INFO:teuthology.orchestra.run.smithi102.stderr: 80750K .......... .......... .......... .......... .......... 86% 310M 0s 2024-09-12T00:44:18.330 INFO:teuthology.orchestra.run.smithi102.stderr: 80800K .......... .......... .......... .......... .......... 87% 287M 0s 2024-09-12T00:44:18.330 INFO:teuthology.orchestra.run.smithi102.stderr: 80850K .......... .......... .......... .......... .......... 87% 401M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 80900K .......... .......... .......... .......... .......... 87% 206M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 80950K .......... .......... .......... .......... .......... 87% 287M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 81000K .......... .......... .......... .......... .......... 87% 293M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 81050K .......... .......... .......... .......... .......... 87% 323M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 81100K .......... .......... .......... .......... .......... 87% 289M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 81150K .......... .......... .......... .......... .......... 87% 293M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 81200K .......... .......... .......... .......... .......... 87% 100M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 81250K .......... .......... .......... .......... .......... 87% 254M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 81300K .......... .......... .......... .......... .......... 87% 407M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 81350K .......... .......... .......... .......... .......... 87% 224M 0s 2024-09-12T00:44:18.331 INFO:teuthology.orchestra.run.smithi102.stderr: 81400K .......... .......... .......... .......... .......... 87% 240M 0s 2024-09-12T00:44:18.332 INFO:teuthology.orchestra.run.smithi102.stderr: 81450K .......... .......... .......... .......... .......... 87% 319M 0s 2024-09-12T00:44:18.332 INFO:teuthology.orchestra.run.smithi102.stderr: 81500K .......... .......... .......... .......... .......... 87% 235M 0s 2024-09-12T00:44:18.332 INFO:teuthology.orchestra.run.smithi102.stderr: 81550K .......... .......... .......... .......... .......... 87% 319M 0s 2024-09-12T00:44:18.332 INFO:teuthology.orchestra.run.smithi102.stderr: 81600K .......... .......... .......... .......... .......... 87% 297M 0s 2024-09-12T00:44:18.332 INFO:teuthology.orchestra.run.smithi102.stderr: 81650K .......... .......... .......... .......... .......... 87% 317M 0s 2024-09-12T00:44:18.332 INFO:teuthology.orchestra.run.smithi102.stderr: 81700K .......... .......... .......... .......... .......... 87% 415M 0s 2024-09-12T00:44:18.332 INFO:teuthology.orchestra.run.smithi102.stderr: 81750K .......... .......... .......... .......... .......... 88% 84.7M 0s 2024-09-12T00:44:18.332 INFO:teuthology.orchestra.run.smithi102.stderr: 81800K .......... .......... .......... .......... .......... 88% 354M 0s 2024-09-12T00:44:18.332 INFO:teuthology.orchestra.run.smithi102.stderr: 81850K .......... .......... .......... .......... .......... 88% 198M 0s 2024-09-12T00:44:18.332 INFO:teuthology.orchestra.run.smithi102.stderr: 81900K .......... .......... .......... .......... .......... 88% 421M 0s 2024-09-12T00:44:18.333 INFO:teuthology.orchestra.run.smithi102.stderr: 81950K .......... .......... .......... .......... .......... 88% 355M 0s 2024-09-12T00:44:18.333 INFO:teuthology.orchestra.run.smithi102.stderr: 82000K .......... .......... .......... .......... .......... 88% 66.7M 0s 2024-09-12T00:44:18.333 INFO:teuthology.orchestra.run.smithi102.stderr: 82050K .......... .......... .......... .......... .......... 88% 276M 0s 2024-09-12T00:44:18.333 INFO:teuthology.orchestra.run.smithi102.stderr: 82100K .......... .......... .......... .......... .......... 88% 282M 0s 2024-09-12T00:44:18.333 INFO:teuthology.orchestra.run.smithi102.stderr: 82150K .......... .......... .......... .......... .......... 88% 369M 0s 2024-09-12T00:44:18.333 INFO:teuthology.orchestra.run.smithi102.stderr: 82200K .......... .......... .......... .......... .......... 88% 320M 0s 2024-09-12T00:44:18.333 INFO:teuthology.orchestra.run.smithi102.stderr: 82250K .......... .......... .......... .......... .......... 88% 290M 0s 2024-09-12T00:44:18.333 INFO:teuthology.orchestra.run.smithi102.stderr: 82300K .......... .......... .......... .......... .......... 88% 267M 0s 2024-09-12T00:44:18.333 INFO:teuthology.orchestra.run.smithi102.stderr: 82350K .......... .......... .......... .......... .......... 88% 348M 0s 2024-09-12T00:44:18.333 INFO:teuthology.orchestra.run.smithi102.stderr: 82400K .......... .......... .......... .......... .......... 88% 321M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82450K .......... .......... .......... .......... .......... 88% 299M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82500K .......... .......... .......... .......... .......... 88% 356M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82550K .......... .......... .......... .......... .......... 88% 325M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82600K .......... .......... .......... .......... .......... 88% 305M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82650K .......... .......... .......... .......... .......... 89% 303M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82700K .......... .......... .......... .......... .......... 89% 270M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82750K .......... .......... .......... .......... .......... 89% 299M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82800K .......... .......... .......... .......... .......... 89% 358M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82850K .......... .......... .......... .......... .......... 89% 398M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82900K .......... .......... .......... .......... .......... 89% 377M 0s 2024-09-12T00:44:18.334 INFO:teuthology.orchestra.run.smithi102.stderr: 82950K .......... .......... .......... .......... .......... 89% 183M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83000K .......... .......... .......... .......... .......... 89% 340M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83050K .......... .......... .......... .......... .......... 89% 313M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83100K .......... .......... .......... .......... .......... 89% 218M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83150K .......... .......... .......... .......... .......... 89% 305M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83200K .......... .......... .......... .......... .......... 89% 350M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83250K .......... .......... .......... .......... .......... 89% 318M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83300K .......... .......... .......... .......... .......... 89% 308M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83350K .......... .......... .......... .......... .......... 89% 353M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83400K .......... .......... .......... .......... .......... 89% 262M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83450K .......... .......... .......... .......... .......... 89% 65.4M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83500K .......... .......... .......... .......... .......... 89% 230M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83550K .......... .......... .......... .......... .......... 89% 365M 0s 2024-09-12T00:44:18.335 INFO:teuthology.orchestra.run.smithi102.stderr: 83600K .......... .......... .......... .......... .......... 90% 310M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 83650K .......... .......... .......... .......... .......... 90% 254M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 83700K .......... .......... .......... .......... .......... 90% 243M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 83750K .......... .......... .......... .......... .......... 90% 396M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 83800K .......... .......... .......... .......... .......... 90% 332M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 83850K .......... .......... .......... .......... .......... 90% 274M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 83900K .......... .......... .......... .......... .......... 90% 337M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 83950K .......... .......... .......... .......... .......... 90% 283M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 84000K .......... .......... .......... .......... .......... 90% 260M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 84050K .......... .......... .......... .......... .......... 90% 279M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 84100K .......... .......... .......... .......... .......... 90% 355M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 84150K .......... .......... .......... .......... .......... 90% 85.4M 0s 2024-09-12T00:44:18.336 INFO:teuthology.orchestra.run.smithi102.stderr: 84200K .......... .......... .......... .......... .......... 90% 255M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84250K .......... .......... .......... .......... .......... 90% 293M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84300K .......... .......... .......... .......... .......... 90% 335M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84350K .......... .......... .......... .......... .......... 90% 397M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84400K .......... .......... .......... .......... .......... 90% 178M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84450K .......... .......... .......... .......... .......... 90% 407M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84500K .......... .......... .......... .......... .......... 91% 308M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84550K .......... .......... .......... .......... .......... 91% 275M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84600K .......... .......... .......... .......... .......... 91% 356M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84650K .......... .......... .......... .......... .......... 91% 88.9M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84700K .......... .......... .......... .......... .......... 91% 262M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84750K .......... .......... .......... .......... .......... 91% 254M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84800K .......... .......... .......... .......... .......... 91% 276M 0s 2024-09-12T00:44:18.337 INFO:teuthology.orchestra.run.smithi102.stderr: 84850K .......... .......... .......... .......... .......... 91% 418M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 84900K .......... .......... .......... .......... .......... 91% 78.3M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 84950K .......... .......... .......... .......... .......... 91% 249M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85000K .......... .......... .......... .......... .......... 91% 358M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85050K .......... .......... .......... .......... .......... 91% 193M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85100K .......... .......... .......... .......... .......... 91% 287M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85150K .......... .......... .......... .......... .......... 91% 237M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85200K .......... .......... .......... .......... .......... 91% 260M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85250K .......... .......... .......... .......... .......... 91% 252M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85300K .......... .......... .......... .......... .......... 91% 369M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85350K .......... .......... .......... .......... .......... 91% 228M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85400K .......... .......... .......... .......... .......... 91% 319M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85450K .......... .......... .......... .......... .......... 92% 273M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85500K .......... .......... .......... .......... .......... 92% 307M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85550K .......... .......... .......... .......... .......... 92% 315M 0s 2024-09-12T00:44:18.338 INFO:teuthology.orchestra.run.smithi102.stderr: 85600K .......... .......... .......... .......... .......... 92% 315M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 85650K .......... .......... .......... .......... .......... 92% 279M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 85700K .......... .......... .......... .......... .......... 92% 326M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 85750K .......... .......... .......... .......... .......... 92% 410M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 85800K .......... .......... .......... .......... .......... 92% 238M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 85850K .......... .......... .......... .......... .......... 92% 325M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 85900K .......... .......... .......... .......... .......... 92% 405M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 85950K .......... .......... .......... .......... .......... 92% 239M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 86000K .......... .......... .......... .......... .......... 92% 240M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 86050K .......... .......... .......... .......... .......... 92% 350M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 86100K .......... .......... .......... .......... .......... 92% 203M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 86150K .......... .......... .......... .......... .......... 92% 228M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 86200K .......... .......... .......... .......... .......... 92% 242M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 86250K .......... .......... .......... .......... .......... 92% 391M 0s 2024-09-12T00:44:18.339 INFO:teuthology.orchestra.run.smithi102.stderr: 86300K .......... .......... .......... .......... .......... 92% 417M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86350K .......... .......... .......... .......... .......... 93% 371M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86400K .......... .......... .......... .......... .......... 93% 344M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86450K .......... .......... .......... .......... .......... 93% 258M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86500K .......... .......... .......... .......... .......... 93% 121M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86550K .......... .......... .......... .......... .......... 93% 213M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86600K .......... .......... .......... .......... .......... 93% 307M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86650K .......... .......... .......... .......... .......... 93% 306M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86700K .......... .......... .......... .......... .......... 93% 259M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86750K .......... .......... .......... .......... .......... 93% 283M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86800K .......... .......... .......... .......... .......... 93% 285M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86850K .......... .......... .......... .......... .......... 93% 333M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86900K .......... .......... .......... .......... .......... 93% 212M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 86950K .......... .......... .......... .......... .......... 93% 241M 0s 2024-09-12T00:44:18.340 INFO:teuthology.orchestra.run.smithi102.stderr: 87000K .......... .......... .......... .......... .......... 93% 269M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87050K .......... .......... .......... .......... .......... 93% 416M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87100K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87150K .......... .......... .......... .......... .......... 93% 121M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87200K .......... .......... .......... .......... .......... 93% 204M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87250K .......... .......... .......... .......... .......... 93% 302M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87300K .......... .......... .......... .......... .......... 94% 312M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87350K .......... .......... .......... .......... .......... 94% 192M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87400K .......... .......... .......... .......... .......... 94% 340M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87450K .......... .......... .......... .......... .......... 94% 310M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87500K .......... .......... .......... .......... .......... 94% 201M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87550K .......... .......... .......... .......... .......... 94% 286M 0s 2024-09-12T00:44:18.341 INFO:teuthology.orchestra.run.smithi102.stderr: 87600K .......... .......... .......... .......... .......... 94% 409M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 87650K .......... .......... .......... .......... .......... 94% 134M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 87700K .......... .......... .......... .......... .......... 94% 173M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 87750K .......... .......... .......... .......... .......... 94% 266M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 87800K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 87850K .......... .......... .......... .......... .......... 94% 64.8M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 87900K .......... .......... .......... .......... .......... 94% 252M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 87950K .......... .......... .......... .......... .......... 94% 334M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 88000K .......... .......... .......... .......... .......... 94% 333M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 88050K .......... .......... .......... .......... .......... 94% 253M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 88100K .......... .......... .......... .......... .......... 94% 296M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 88150K .......... .......... .......... .......... .......... 94% 330M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 88200K .......... .......... .......... .......... .......... 94% 182M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 88250K .......... .......... .......... .......... .......... 95% 247M 0s 2024-09-12T00:44:18.342 INFO:teuthology.orchestra.run.smithi102.stderr: 88300K .......... .......... .......... .......... .......... 95% 254M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88350K .......... .......... .......... .......... .......... 95% 341M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88400K .......... .......... .......... .......... .......... 95% 296M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88450K .......... .......... .......... .......... .......... 95% 407M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88500K .......... .......... .......... .......... .......... 95% 343M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88550K .......... .......... .......... .......... .......... 95% 175M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88600K .......... .......... .......... .......... .......... 95% 325M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88650K .......... .......... .......... .......... .......... 95% 392M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88700K .......... .......... .......... .......... .......... 95% 259M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88750K .......... .......... .......... .......... .......... 95% 409M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88800K .......... .......... .......... .......... .......... 95% 166M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88850K .......... .......... .......... .......... .......... 95% 208M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88900K .......... .......... .......... .......... .......... 95% 272M 0s 2024-09-12T00:44:18.343 INFO:teuthology.orchestra.run.smithi102.stderr: 88950K .......... .......... .......... .......... .......... 95% 269M 0s 2024-09-12T00:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr: 89000K .......... .......... .......... .......... .......... 95% 309M 0s 2024-09-12T00:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr: 89050K .......... .......... .......... .......... .......... 95% 372M 0s 2024-09-12T00:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr: 89100K .......... .......... .......... .......... .......... 95% 263M 0s 2024-09-12T00:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr: 89150K .......... .......... .......... .......... .......... 96% 295M 0s 2024-09-12T00:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr: 89200K .......... .......... .......... .......... .......... 96% 396M 0s 2024-09-12T00:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr: 89250K .......... .......... .......... .......... .......... 96% 422M 0s 2024-09-12T00:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr: 89300K .......... .......... .......... .......... .......... 96% 196M 0s 2024-09-12T00:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr: 89350K .......... .......... .......... .......... .......... 96% 238M 0s 2024-09-12T00:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr: 89400K .......... .......... .......... .......... .......... 96% 289M 0s 2024-09-12T00:44:18.344 INFO:teuthology.orchestra.run.smithi102.stderr: 89450K .......... .......... .......... .......... .......... 96% 352M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89500K .......... .......... .......... .......... .......... 96% 256M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89550K .......... .......... .......... .......... .......... 96% 369M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89600K .......... .......... .......... .......... .......... 96% 300M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89650K .......... .......... .......... .......... .......... 96% 262M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89700K .......... .......... .......... .......... .......... 96% 226M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89750K .......... .......... .......... .......... .......... 96% 314M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89800K .......... .......... .......... .......... .......... 96% 285M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89850K .......... .......... .......... .......... .......... 96% 303M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89900K .......... .......... .......... .......... .......... 96% 341M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 89950K .......... .......... .......... .......... .......... 96% 225M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 90000K .......... .......... .......... .......... .......... 96% 282M 0s 2024-09-12T00:44:18.345 INFO:teuthology.orchestra.run.smithi102.stderr: 90050K .......... .......... .......... .......... .......... 96% 117M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90100K .......... .......... .......... .......... .......... 97% 218M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90150K .......... .......... .......... .......... .......... 97% 319M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90200K .......... .......... .......... .......... .......... 97% 251M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90250K .......... .......... .......... .......... .......... 97% 318M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90300K .......... .......... .......... .......... .......... 97% 298M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90350K .......... .......... .......... .......... .......... 97% 365M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90400K .......... .......... .......... .......... .......... 97% 315M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90450K .......... .......... .......... .......... .......... 97% 318M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90500K .......... .......... .......... .......... .......... 97% 294M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90550K .......... .......... .......... .......... .......... 97% 69.5M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90600K .......... .......... .......... .......... .......... 97% 239M 0s 2024-09-12T00:44:18.346 INFO:teuthology.orchestra.run.smithi102.stderr: 90650K .......... .......... .......... .......... .......... 97% 353M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 90700K .......... .......... .......... .......... .......... 97% 312M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 90750K .......... .......... .......... .......... .......... 97% 321M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 90800K .......... .......... .......... .......... .......... 97% 96.3M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 90850K .......... .......... .......... .......... .......... 97% 358M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 90900K .......... .......... .......... .......... .......... 97% 202M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 90950K .......... .......... .......... .......... .......... 97% 258M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 91000K .......... .......... .......... .......... .......... 98% 311M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 91050K .......... .......... .......... .......... .......... 98% 286M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 91100K .......... .......... .......... .......... .......... 98% 328M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 91150K .......... .......... .......... .......... .......... 98% 255M 0s 2024-09-12T00:44:18.347 INFO:teuthology.orchestra.run.smithi102.stderr: 91200K .......... .......... .......... .......... .......... 98% 206M 0s 2024-09-12T00:44:18.348 INFO:teuthology.orchestra.run.smithi102.stderr: 91250K .......... .......... .......... .......... .......... 98% 389M 0s 2024-09-12T00:44:18.348 INFO:teuthology.orchestra.run.smithi102.stderr: 91300K .......... .......... .......... .......... .......... 98% 157M 0s 2024-09-12T00:44:18.348 INFO:teuthology.orchestra.run.smithi102.stderr: 91350K .......... .......... .......... .......... .......... 98% 200M 0s 2024-09-12T00:44:18.348 INFO:teuthology.orchestra.run.smithi102.stderr: 91400K .......... .......... .......... .......... .......... 98% 225M 0s 2024-09-12T00:44:18.348 INFO:teuthology.orchestra.run.smithi102.stderr: 91450K .......... .......... .......... .......... .......... 98% 235M 0s 2024-09-12T00:44:18.348 INFO:teuthology.orchestra.run.smithi102.stderr: 91500K .......... .......... .......... .......... .......... 98% 219M 0s 2024-09-12T00:44:18.348 INFO:teuthology.orchestra.run.smithi102.stderr: 91550K .......... .......... .......... .......... .......... 98% 188M 0s 2024-09-12T00:44:18.348 INFO:teuthology.orchestra.run.smithi102.stderr: 91600K .......... .......... .......... .......... .......... 98% 254M 0s 2024-09-12T00:44:18.348 INFO:teuthology.orchestra.run.smithi102.stderr: 91650K .......... .......... .......... .......... .......... 98% 266M 0s 2024-09-12T00:44:18.349 INFO:teuthology.orchestra.run.smithi102.stderr: 91700K .......... .......... .......... .......... .......... 98% 236M 0s 2024-09-12T00:44:18.349 INFO:teuthology.orchestra.run.smithi102.stderr: 91750K .......... .......... .......... .......... .......... 98% 263M 0s 2024-09-12T00:44:18.349 INFO:teuthology.orchestra.run.smithi102.stderr: 91800K .......... .......... .......... .......... .......... 98% 207M 0s 2024-09-12T00:44:18.349 INFO:teuthology.orchestra.run.smithi102.stderr: 91850K .......... .......... .......... .......... .......... 98% 260M 0s 2024-09-12T00:44:18.349 INFO:teuthology.orchestra.run.smithi102.stderr: 91900K .......... .......... .......... .......... .......... 98% 245M 0s 2024-09-12T00:44:18.349 INFO:teuthology.orchestra.run.smithi102.stderr: 91950K .......... .......... .......... .......... .......... 99% 239M 0s 2024-09-12T00:44:18.349 INFO:teuthology.orchestra.run.smithi102.stderr: 92000K .......... .......... .......... .......... .......... 99% 234M 0s 2024-09-12T00:44:18.349 INFO:teuthology.orchestra.run.smithi102.stderr: 92050K .......... .......... .......... .......... .......... 99% 214M 0s 2024-09-12T00:44:18.349 INFO:teuthology.orchestra.run.smithi102.stderr: 92100K .......... .......... .......... .......... .......... 99% 228M 0s 2024-09-12T00:44:18.349 INFO:teuthology.orchestra.run.smithi102.stderr: 92150K .......... .......... .......... .......... .......... 99% 271M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92200K .......... .......... .......... .......... .......... 99% 330M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92250K .......... .......... .......... .......... .......... 99% 375M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92300K .......... .......... .......... .......... .......... 99% 294M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92350K .......... .......... .......... .......... .......... 99% 203M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92400K .......... .......... .......... .......... .......... 99% 323M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92450K .......... .......... .......... .......... .......... 99% 384M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92500K .......... .......... .......... .......... .......... 99% 298M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92550K .......... .......... .......... .......... .......... 99% 337M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92600K .......... .......... .......... .......... .......... 99% 355M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92650K .......... .......... .......... .......... .......... 99% 357M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92700K .......... .......... .......... .......... .......... 99% 376M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92750K .......... .......... .......... .......... .......... 99% 308M 0s 2024-09-12T00:44:18.350 INFO:teuthology.orchestra.run.smithi102.stderr: 92800K .......... .......... .......... .......... .......... 99% 396M 0s 2024-09-12T00:44:18.351 INFO:teuthology.orchestra.run.smithi102.stderr: 92850K .......... .......... .......... .......... .......... 99% 432M 0s 2024-09-12T00:44:18.351 INFO:teuthology.orchestra.run.smithi102.stderr: 92900K 100% 134G=0.5s 2024-09-12T00:44:18.351 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T00:44:18.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12 00:44:17 (201 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T00:44:18.351 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T00:44:18.380 INFO:teuthology.orchestra.run.smithi102.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:44:18.381 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:44:18.382 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:44:18.383 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:44:18.384 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:44:18.385 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:44:18.386 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:44:18.387 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:44:18.388 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:44:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:44:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:44:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:44:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:44:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:44:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:44:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:44:18.389 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:44:18.390 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:44:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:44:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:44:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:44:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:44:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:44:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:44:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:44:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:44:18.391 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:44:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:44:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:44:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:44:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:44:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:44:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:44:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:44:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:44:18.392 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:44:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:44:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:44:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:44:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:44:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:44:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:44:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:44:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:44:18.393 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:44:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:44:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:44:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:44:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:44:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:44:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:44:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:44:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:44:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:44:18.394 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:44:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:44:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:44:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:44:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:44:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:44:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:44:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:44:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:44:18.395 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:44:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:44:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:44:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:44:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:44:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:44:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:44:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:44:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:44:18.396 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:44:18.397 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:44:18.398 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:44:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:44:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:44:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:44:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:44:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:44:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:44:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:44:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:44:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:44:18.399 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:44:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:44:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:44:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:44:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:44:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:44:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:44:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:44:18.400 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:44:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:44:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:44:18.401 INFO:teuthology.orchestra.run.smithi102.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:44:18.401 INFO:teuthology.orchestra.run.smithi102.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T00:44:18.537 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:18.537 INFO:teuthology.orchestra.run.smithi102.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:44:18.537 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:18.537 INFO:teuthology.orchestra.run.smithi102.stdout:Here are the highlights of this release: 2024-09-12T00:44:18.537 INFO:teuthology.orchestra.run.smithi102.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:44:18.537 INFO:teuthology.orchestra.run.smithi102.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: - Advanced control of transitive versions 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: - Support for optional features and dependencies 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: - Rules to tweak published metadata 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: - Support for Java 13 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: - New Zinc compiler for Scala 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: - VS2019 support 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout:------------------------------------------------------------ 2024-09-12T00:44:18.538 INFO:teuthology.orchestra.run.smithi102.stdout:Gradle 6.0.1 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout:------------------------------------------------------------ 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout:Kotlin: 1.3.50 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout:Groovy: 2.5.8 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T00:44:18.539 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:18.555 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:44:18.555 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:44:18.555 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T00:44:18.555 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:44:18.555 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T00:44:18.555 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:44:18.882 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:44:18.882 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:44:18.882 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'ESVHOOQWLSTABAJTHHKP', 'access_secret': 'umuQCoff1d8MYGAp3ycwat95wDit/49gg30bx+sD/S7jHzgJRxIHaQ==', 'region': 'mexico', 'endpoint': 'smithi102.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi102.front.sepia.ceph.com'} 2024-09-12T00:44:18.883 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:44:18.883 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'ESVHOOQWLSTABAJTHHKP', '--secret', 'umuQCoff1d8MYGAp3ycwat95wDit/49gg30bx+sD/S7jHzgJRxIHaQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:44:18.883 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key ESVHOOQWLSTABAJTHHKP --secret umuQCoff1d8MYGAp3ycwat95wDit/49gg30bx+sD/S7jHzgJRxIHaQ== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:44:18.929 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:18.930 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:18.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.966+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.970+0000 7f1aaeceb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:18.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.970+0000 7f1aaeceb9c0 20 realm 2024-09-12T00:44:18.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.970+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.970+0000 7f1aaeceb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:18.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.970+0000 7f1aaeceb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:18.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.970+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.970+0000 7f1aaeceb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:18.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.970+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.970+0000 7f1aaeceb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:18.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.970+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.974+0000 7f1aaeceb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:18.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.974+0000 7f1aaeceb9c0 20 searching for the correct realm 2024-09-12T00:44:18.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.978+0000 7f1aac7f1640 0 -- 172.21.15.102:0/905235843 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x5594748c1f30 msgr2=0x5594748c43f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:18.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.982+0000 7f1aabff0640 0 -- 172.21.15.102:0/905235843 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f1aa402c3d0 msgr2=0x7f1aa402c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:18.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.990+0000 7f1aaeceb9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:44:18.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.990+0000 7f1aaeceb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:18.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.990+0000 7f1aaeceb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:18.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.990+0000 7f1aaeceb9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:44:18.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.990+0000 7f1aaeceb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:18.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.990+0000 7f1aaeceb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:18.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.990+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.990+0000 7f1aaeceb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:18.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.990+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 zone default found 2024-09-12T00:44:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 4 Realm: () 2024-09-12T00:44:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:44:18.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:44:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 zonegroup default 2024-09-12T00:44:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:18.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 started sync module instance, tier type = 2024-09-12T00:44:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:18.994+0000 7f1aaeceb9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:44:19.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 add_watcher() i=0 2024-09-12T00:44:19.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 add_watcher() i=1 2024-09-12T00:44:19.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 add_watcher() i=2 2024-09-12T00:44:19.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 add_watcher() i=3 2024-09-12T00:44:19.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 add_watcher() i=4 2024-09-12T00:44:19.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 add_watcher() i=5 2024-09-12T00:44:19.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 add_watcher() i=6 2024-09-12T00:44:19.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 add_watcher() i=7 2024-09-12T00:44:19.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:19.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1962fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:19.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:19.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:19.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 5 note: GC not initialized 2024-09-12T00:44:19.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1961fdb640 20 reqs_thread_entry: start 2024-09-12T00:44:19.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:44:19.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f1aaeceb9c0 20 Filter name: none 2024-09-12T00:44:19.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.010+0000 7f18d37fe640 20 reqs_thread_entry: start 2024-09-12T00:44:19.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:44:19.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:19.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:44:19.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:44:19.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:44:19.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:19.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:44:19.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:44:19.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 cache get: name=default.rgw.meta+users.keys+ESVHOOQWLSTABAJTHHKP : miss 2024-09-12T00:44:19.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:19.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 cache put: name=default.rgw.meta+users.keys+ESVHOOQWLSTABAJTHHKP info.flags=0x0 2024-09-12T00:44:19.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 adding default.rgw.meta+users.keys+ESVHOOQWLSTABAJTHHKP to cache LRU end 2024-09-12T00:44:19.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 cache get: name=default.rgw.meta+users.keys+ESVHOOQWLSTABAJTHHKP : hit (negative entry) 2024-09-12T00:44:19.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.014+0000 7f1aaeceb9c0 10 cache get: name=default.rgw.meta+users.keys+ESVHOOQWLSTABAJTHHKP : hit (negative entry) 2024-09-12T00:44:19.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.018+0000 7f1aaeceb9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:44:19.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.018+0000 7f1aaeceb9c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:44:19.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.018+0000 7f1aaeceb9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:44:19.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.018+0000 7f19837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398919 cookie 94096098886848 notifier 8763 bl.length()=670 2024-09-12T00:44:19.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.018+0000 7f19837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:44:19.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.018+0000 7f19837fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:44:19.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.022+0000 7f1aaeceb9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:44:19.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.022+0000 7f1aaeceb9c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:44:19.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.022+0000 7f1aaeceb9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:44:19.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.022+0000 7f1982ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398884 cookie 94096098880272 notifier 8763 bl.length()=200 2024-09-12T00:44:19.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.022+0000 7f1982ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:44:19.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.022+0000 7f1982ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:44:19.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.026+0000 7f1aaeceb9c0 10 cache put: name=default.rgw.meta+users.keys+ESVHOOQWLSTABAJTHHKP info.flags=0x7 2024-09-12T00:44:19.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.026+0000 7f1aaeceb9c0 10 moving default.rgw.meta+users.keys+ESVHOOQWLSTABAJTHHKP to cache LRU end 2024-09-12T00:44:19.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.026+0000 7f1aaeceb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:ESVHOOQWLSTABAJTHHKP, ofs0, ns] 2024-09-12T00:44:19.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.026+0000 7f19837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398910 cookie 94096098888384 notifier 8763 bl.length()=189 2024-09-12T00:44:19.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.026+0000 7f19837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ESVHOOQWLSTABAJTHHKP info.flags=0x7 2024-09-12T00:44:19.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.026+0000 7f19837fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ESVHOOQWLSTABAJTHHKP to cache LRU end 2024-09-12T00:44:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T00:44:19.028 INFO:teuthology.orchestra.run.smithi102.stdout: "user_id": "tester.client.0", 2024-09-12T00:44:19.028 INFO:teuthology.orchestra.run.smithi102.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:44:19.028 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "suspended": 0, 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "subusers": [], 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "keys": [ 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "user": "tester.client.0", 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "access_key": "ESVHOOQWLSTABAJTHHKP", 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "secret_key": "umuQCoff1d8MYGAp3ycwat95wDit/49gg30bx+sD/S7jHzgJRxIHaQ==", 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "active": true, 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T00:44:19.019923Z" 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "swift_keys": [], 2024-09-12T00:44:19.029 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": [], 2024-09-12T00:44:19.030 INFO:teuthology.orchestra.run.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T00:44:19.030 INFO:teuthology.orchestra.run.smithi102.stdout: "default_placement": "", 2024-09-12T00:44:19.030 INFO:teuthology.orchestra.run.smithi102.stdout: "default_storage_class": "", 2024-09-12T00:44:19.030 INFO:teuthology.orchestra.run.smithi102.stdout: "placement_tags": [], 2024-09-12T00:44:19.030 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T00:44:19.030 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T00:44:19.030 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:44:19.030 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T00:44:19.030 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:44:19.030 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "user_quota": { 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "temp_url_keys": [], 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "rgw", 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "mfa_ids": [], 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "account_id": "", 2024-09-12T00:44:19.031 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-12T00:44:19.032 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T00:44:19.019911Z", 2024-09-12T00:44:19.032 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-12T00:44:19.032 INFO:teuthology.orchestra.run.smithi102.stdout: "group_ids": [] 2024-09-12T00:44:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T00:44:19.032 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:19.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.026+0000 7f1962fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:19.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.030+0000 7f1aaeceb9c0 20 remove_watcher() i=0 2024-09-12T00:44:19.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.030+0000 7f1aaeceb9c0 2 removed watcher, disabling cache 2024-09-12T00:44:19.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.034+0000 7f1aaeceb9c0 20 remove_watcher() i=1 2024-09-12T00:44:19.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.034+0000 7f1aaeceb9c0 20 remove_watcher() i=2 2024-09-12T00:44:19.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.038+0000 7f1aaeceb9c0 20 remove_watcher() i=3 2024-09-12T00:44:19.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.038+0000 7f1aaeceb9c0 20 remove_watcher() i=4 2024-09-12T00:44:19.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.042+0000 7f1aaeceb9c0 20 remove_watcher() i=5 2024-09-12T00:44:19.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.042+0000 7f1aaeceb9c0 20 remove_watcher() i=6 2024-09-12T00:44:19.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.042+0000 7f1aaeceb9c0 20 remove_watcher() i=7 2024-09-12T00:44:19.058 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T00:44:19.058 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:44:19.105 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:44:19.105 DEBUG:teuthology.orchestra.run.smithi102:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:44:19.150 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T00:44:19.223 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:19.223 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:19.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.266+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.266+0000 7f2ccc41d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:19.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.266+0000 7f2ccc41d9c0 20 realm 2024-09-12T00:44:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.266+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.266+0000 7f2ccc41d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.266+0000 7f2ccc41d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.266+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.266+0000 7f2ccc41d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:19.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.266+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.270+0000 7f2ccc41d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:19.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.270+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.270+0000 7f2ccc41d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:19.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.270+0000 7f2ccc41d9c0 20 searching for the correct realm 2024-09-12T00:44:19.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.274+0000 7f2cc9722640 0 -- 172.21.15.102:0/3842477200 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x5649ee58eaf0 msgr2=0x7f2cc4109770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:19.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.486+0000 7f2cca724640 0 -- 172.21.15.102:0/3842477200 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x5649ee7cfad0 msgr2=0x5649ee7d1ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:19.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:44:19.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:19.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:19.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:44:19.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:19.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:19.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:19.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:19.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:19.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 zone default found 2024-09-12T00:44:19.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 4 Realm: () 2024-09-12T00:44:19.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:44:19.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:44:19.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:19.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 zonegroup default 2024-09-12T00:44:19.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:19.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.506+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.510+0000 7f2ccc41d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:19.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.510+0000 7f2ccc41d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:19.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.510+0000 7f2ccc41d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:19.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.510+0000 7f2ccc41d9c0 20 started sync module instance, tier type = 2024-09-12T00:44:19.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.510+0000 7f2ccc41d9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:44:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.534+0000 7f2ccc41d9c0 20 add_watcher() i=0 2024-09-12T00:44:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.534+0000 7f2ccc41d9c0 20 add_watcher() i=1 2024-09-12T00:44:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.534+0000 7f2ccc41d9c0 20 add_watcher() i=2 2024-09-12T00:44:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.534+0000 7f2ccc41d9c0 20 add_watcher() i=3 2024-09-12T00:44:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.534+0000 7f2ccc41d9c0 20 add_watcher() i=4 2024-09-12T00:44:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.534+0000 7f2ccc41d9c0 20 add_watcher() i=5 2024-09-12T00:44:19.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.534+0000 7f2ccc41d9c0 20 add_watcher() i=6 2024-09-12T00:44:19.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.534+0000 7f2ccc41d9c0 20 add_watcher() i=7 2024-09-12T00:44:19.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.534+0000 7f2ccc41d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:19.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.538+0000 7f2b7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.542+0000 7f2ccc41d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:19.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.542+0000 7f2ccc41d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:19.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.630+0000 7f2b7a7fc640 20 reqs_thread_entry: start 2024-09-12T00:44:19.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.630+0000 7f2ccc41d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:44:19.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.630+0000 7f2ccc41d9c0 20 Filter name: none 2024-09-12T00:44:19.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.630+0000 7f2aebfff640 20 reqs_thread_entry: start 2024-09-12T00:44:19.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.630+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:44:19.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:44:19.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15309283241685018400', time=2024-09-12T02:34:10.373170+0000, chain.objs.size()=5 2024-09-12T00:44:19.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.1 2024-09-12T00:44:19.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.1_1 2024-09-12T00:44:19.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.2 2024-09-12T00:44:19.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.2_1 2024-09-12T00:44:19.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.3 2024-09-12T00:44:19.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12457598927910242394', time=2024-09-12T02:34:10.547506+0000, chain.objs.size()=3 2024-09-12T00:44:19.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.rQtUDKW9wGKa7Od7jgxzBkD8ynX4BJ9_0 2024-09-12T00:44:19.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.rQtUDKW9wGKa7Od7jgxzBkD8ynX4BJ9_1 2024-09-12T00:44:19.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.rQtUDKW9wGKa7Od7jgxzBkD8ynX4BJ9_2 2024-09-12T00:44:19.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17532496668729812643', time=2024-09-12T02:35:30.746479+0000, chain.objs.size()=1 2024-09-12T00:44:19.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.634+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.7AfvGrkSPWXiFx1Lt5OXJ9M-6nA5PuM_0 2024-09-12T00:44:19.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4841827972588369442', time=2024-09-12T02:36:11.194135+0000, chain.objs.size()=1 2024-09-12T00:44:19.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.CJ_UQ6yxM2u7vdvgiPWr_p0PVWFMNuD_0 2024-09-12T00:44:19.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1127979507160871853', time=2024-09-12T02:37:02.954534+0000, chain.objs.size()=1 2024-09-12T00:44:19.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.oiJg-RvX6FgbLS8XwzWdjAP970iGWTE_0 2024-09-12T00:44:19.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10302370670775622587', time=2024-09-12T02:37:44.388558+0000, chain.objs.size()=1 2024-09-12T00:44:19.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.jVUDUbQ-LT1d1Plq1q88u0uw8UWqUCl_0 2024-09-12T00:44:19.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14888493812331707060', time=2024-09-12T02:38:32.017651+0000, chain.objs.size()=1 2024-09-12T00:44:19.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.VwirGNCF-tbguBM9j9dDNsGQx5Z7ecU_0 2024-09-12T00:44:19.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3165803650380249779', time=2024-09-12T02:38:36.467245+0000, chain.objs.size()=1 2024-09-12T00:44:19.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.TCd22oGPqGALOZP6U7he7CdCMEKb2ke_0 2024-09-12T00:44:19.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12616926646604059690', time=2024-09-12T02:38:36.567211+0000, chain.objs.size()=1 2024-09-12T00:44:19.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.638+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.EXFlfIjbYZaKFJeEZcrGxIWZP68bKqo_0 2024-09-12T00:44:19.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.642+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15874803176312077606', time=2024-09-12T02:39:13.136801+0000, chain.objs.size()=1 2024-09-12T00:44:19.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.642+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.JidFkCzXPfnbuQcOX3vFLGK1p-94oo__0 2024-09-12T00:44:19.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.642+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17230163645693784032', time=2024-09-12T02:39:17.665193+0000, chain.objs.size()=1 2024-09-12T00:44:19.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.642+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.54-3PiqFlAHpalYEPspuIIyAuKpgbYp_0 2024-09-12T00:44:19.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.642+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17389507986041090742', time=2024-09-12T02:39:19.368316+0000, chain.objs.size()=1 2024-09-12T00:44:19.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.642+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.shvhwbGiFx6LxHwI7VIojUVH2dmDpXt_0 2024-09-12T00:44:19.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.642+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17665420199332223421', time=2024-09-12T02:39:19.586908+0000, chain.objs.size()=1 2024-09-12T00:44:19.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.642+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.MA6MZ4hC5cNsspSwMhk6b0SCFPNXseK_0 2024-09-12T00:44:19.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.642+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6150281216642455318', time=2024-09-12T02:39:55.567454+0000, chain.objs.size()=1 2024-09-12T00:44:19.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.642+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.9l6TYMH9AXeQ82QhO_1prQjjom2olZB_0 2024-09-12T00:44:19.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.650+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10806479458369671039', time=2024-09-12T02:40:37.460476+0000, chain.objs.size()=1 2024-09-12T00:44:19.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.650+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.mDFSzse0bheWYvjGp-utKHbmiWsT_jD_0 2024-09-12T00:44:19.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.650+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1549092740927521051', time=2024-09-12T02:40:43.331300+0000, chain.objs.size()=1 2024-09-12T00:44:19.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.650+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.s6zEU0kHjpfrTOPWr8tExov-c0MYbFF_0 2024-09-12T00:44:19.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.650+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14459965841473017863', time=2024-09-12T02:41:25.644718+0000, chain.objs.size()=1 2024-09-12T00:44:19.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.650+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.rMZkM7wcZ5GmY0xxAcVKN7jkpclg9HH_0 2024-09-12T00:44:19.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.654+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15585255260716266676', time=2024-09-12T02:43:38.742116+0000, chain.objs.size()=1 2024-09-12T00:44:19.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.654+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.QLxx6nyS2M9_40pYqv0by37luMynFTN_0 2024-09-12T00:44:19.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.662+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.666+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:44:19.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7220778308589289833', time=2024-09-12T02:34:09.847283+0000, chain.objs.size()=1 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.-GQOhEVzbpW6zv7ViG1JNSStuxzkrlm_0 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6288800053233009163', time=2024-09-12T02:36:11.230866+0000, chain.objs.size()=1 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.-04DaZNDBhyVyrYaQDfppFtbHRi8jTV_0 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16624310615991273802', time=2024-09-12T02:36:16.775382+0000, chain.objs.size()=1 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.U_QURgi0H9LGo-dqbrGTEbiR8Fq-xEQ_0 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14426103347800397688', time=2024-09-12T02:37:44.388636+0000, chain.objs.size()=1 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.kwBHHJApHpo2lki-J_k3eSPjs1ZXbvA_0 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11288768943422264592', time=2024-09-12T02:39:13.192144+0000, chain.objs.size()=1 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.3WXRa3GTaZRohLEa4-IF9DxGdxfXhgW_0 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15148128966480801118', time=2024-09-12T02:39:55.559041+0000, chain.objs.size()=1 2024-09-12T00:44:19.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.hebvY2-vCVTPY1A3nUnHAR4xPgMNu0Y_0 2024-09-12T00:44:19.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3022458358061303604', time=2024-09-12T02:39:55.560656+0000, chain.objs.size()=1 2024-09-12T00:44:19.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.s4OFpnxIUV5TKlEJUEwcMz-zU0GOBGy_0 2024-09-12T00:44:19.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13099531268758145987', time=2024-09-12T02:40:43.419694+0000, chain.objs.size()=1 2024-09-12T00:44:19.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.Y6j6NRWIELGVKlFItj1SjyWZQ8_GNa-_0 2024-09-12T00:44:19.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9205841765168448106', time=2024-09-12T02:41:25.703871+0000, chain.objs.size()=1 2024-09-12T00:44:19.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.pwCBRW95n0zHGKwU2n2TZt-60rANXJZ_0 2024-09-12T00:44:19.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10668325531498625925', time=2024-09-12T02:43:38.723306+0000, chain.objs.size()=1 2024-09-12T00:44:19.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.670+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.BPD9Avi64mdU6j0kg1hOg_KhThqzY74_0 2024-09-12T00:44:19.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.682+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.690+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:44:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:44:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_D8Vg2CU2RxKXR_8KNYC5b5XnU5IwCnL', time=2024-09-12T02:34:10.180035+0000, chain.objs.size()=2 2024-09-12T00:44:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.PhHFjwzUMLKqqrRUE0CTKhnTIh8VDrb_0 2024-09-12T00:44:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.PhHFjwzUMLKqqrRUE0CTKhnTIh8VDrb_1 2024-09-12T00:44:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9029002458042109761', time=2024-09-12T02:34:10.691457+0000, chain.objs.size()=1 2024-09-12T00:44:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8__shadow_.xhVDTP6qIzCuP78s0l2V1KYcQH7Bdax_0 2024-09-12T00:44:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5024602794872115567', time=2024-09-12T02:34:10.804178+0000, chain.objs.size()=1 2024-09-12T00:44:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9__shadow_.PQ0LVi26LtF1Fgh7G2Sc0XDSehfRP-B_0 2024-09-12T00:44:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11602497791430350758', time=2024-09-12T02:35:30.525183+0000, chain.objs.size()=1 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.BJo_KutGKzuYsDiv8bCIEC2IQM5OwsW_0 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14868496436289675479', time=2024-09-12T02:35:30.605120+0000, chain.objs.size()=1 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.mkJ9oferqrWnvDlSFhnmmPidE5Z5Jq8_0 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3767479538296369465', time=2024-09-12T02:35:30.650758+0000, chain.objs.size()=1 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.edHbht3ry5mZ6N52Un0MXZ6kY6LdjcR_0 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9909699096220287641', time=2024-09-12T02:36:11.251528+0000, chain.objs.size()=1 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.fHpWLRbqMxG33jxcujCeAtXbSW4mcAJ_0 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1795126484059170362', time=2024-09-12T02:36:16.502910+0000, chain.objs.size()=1 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.bpsfhloMUP3MvWji5rsMhJ4oG1pfiqv_0 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8108556623719217423', time=2024-09-12T02:36:16.754913+0000, chain.objs.size()=1 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.EQOfKHtIBnLv4uDf9zFgLX8ZJPe6bNq_0 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11239841066198267398', time=2024-09-12T02:36:21.466173+0000, chain.objs.size()=1 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.mR9oxbOUtHUFqZq19kzJexyClvsa2IO_0 2024-09-12T00:44:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5995343437702433595', time=2024-09-12T02:36:21.491117+0000, chain.objs.size()=1 2024-09-12T00:44:19.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.694+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.xU5AxRN1zqk1_MISOxk0SIXygg2IrbN_0 2024-09-12T00:44:19.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.698+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8747160216457226717', time=2024-09-12T02:37:02.736983+0000, chain.objs.size()=1 2024-09-12T00:44:19.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.698+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.sLAW1ePj1cnfFNm5yMzmTOlQDTHiVik_0 2024-09-12T00:44:19.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.702+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17977635381645928507', time=2024-09-12T02:37:02.964069+0000, chain.objs.size()=1 2024-09-12T00:44:19.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.702+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.QSNwfgD-IKPyAwGkV6VMgkDJzQG_eL4_0 2024-09-12T00:44:19.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.702+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17820031182390776257', time=2024-09-12T02:37:07.508616+0000, chain.objs.size()=1 2024-09-12T00:44:19.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.702+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.dYHvvatNp96fiYpDdgkRW3NczlnwpDq_0 2024-09-12T00:44:19.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4024644869354320593', time=2024-09-12T02:37:07.510348+0000, chain.objs.size()=1 2024-09-12T00:44:19.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.LEk9KJa6uQBhkfeTvUdAnp5YWhDzO7-_0 2024-09-12T00:44:19.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8046280583763713219', time=2024-09-12T02:37:49.840038+0000, chain.objs.size()=1 2024-09-12T00:44:19.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.5nlyJ-H_bwq4AnGaHrRnySxsmaD4lnm_0 2024-09-12T00:44:19.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13713956222614363849', time=2024-09-12T02:37:49.842066+0000, chain.objs.size()=1 2024-09-12T00:44:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.8GlGkynLhQJD5obqEWtWg0BEvuQZZVB_0 2024-09-12T00:44:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7771604587698435832', time=2024-09-12T02:37:49.844508+0000, chain.objs.size()=1 2024-09-12T00:44:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.A72R7JK5a4vW4wiqLUvq5fVv2tToteJ_0 2024-09-12T00:44:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4791002737911537305', time=2024-09-12T02:41:25.773018+0000, chain.objs.size()=1 2024-09-12T00:44:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.dhfnnkjiYm1KB7RLJbRqStOYATl4_PK_0 2024-09-12T00:44:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18426666976008455405', time=2024-09-12T02:41:25.877295+0000, chain.objs.size()=1 2024-09-12T00:44:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.706+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.oFJXof7UqvwZc3tX7ZQb2HaTi_X43NR_0 2024-09-12T00:44:19.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.718+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:44:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14408056009544830399', time=2024-09-12T02:34:10.323019+0000, chain.objs.size()=5 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.1 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.1_1 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.2 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.2_1 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.3 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12664758877686854066', time=2024-09-12T02:35:30.600892+0000, chain.objs.size()=1 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.2v6sLJwYzUqDzPKQ0IazIHa53Er6K3r_0 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15165504886572187086', time=2024-09-12T02:35:34.895964+0000, chain.objs.size()=1 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.9AxTrWgmL7WEGnGvfqYGAL3_qIWVu88_0 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9228387936483298046', time=2024-09-12T02:37:44.525837+0000, chain.objs.size()=1 2024-09-12T00:44:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.726+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.Av2om36kp1B_LYLMI2UXJarH88ODYe6_0 2024-09-12T00:44:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.730+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26955004777631006', time=2024-09-12T02:38:25.994479+0000, chain.objs.size()=1 2024-09-12T00:44:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.730+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.1BYDFGLi4foA77VsaiRT-M0fc2gxjJ5_0 2024-09-12T00:44:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.730+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4817965112910706201', time=2024-09-12T02:38:31.912651+0000, chain.objs.size()=1 2024-09-12T00:44:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.730+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.86UWFKZpIYcH7OqIMWhwfUFUKAtmsTA_0 2024-09-12T00:44:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.730+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14076858162333207080', time=2024-09-12T02:38:36.490178+0000, chain.objs.size()=1 2024-09-12T00:44:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.730+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.6laaHq1Rr7CCiMCKNO6AbZK1nq3eYcx_0 2024-09-12T00:44:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.730+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1748707538057082487', time=2024-09-12T02:38:36.491536+0000, chain.objs.size()=1 2024-09-12T00:44:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.730+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.Dh8UZNSC8rUeXvr3gp5vy0j7cELRyK5_0 2024-09-12T00:44:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.730+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6327194855201973352', time=2024-09-12T02:38:36.551101+0000, chain.objs.size()=1 2024-09-12T00:44:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.djtkCTylyXk60AmHqikqMp0nFtiNldW_0 2024-09-12T00:44:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.422543391758414920', time=2024-09-12T02:40:37.464516+0000, chain.objs.size()=1 2024-09-12T00:44:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.U6wCyDHLkqBeZRmF2-yaLW4UbnA2B_w_0 2024-09-12T00:44:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10514030166581650499', time=2024-09-12T02:40:41.958858+0000, chain.objs.size()=1 2024-09-12T00:44:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.eWO0gVGXAGURgVUkE7Wll8WfjQTSPKv_0 2024-09-12T00:44:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17829617742526081382', time=2024-09-12T02:41:25.737675+0000, chain.objs.size()=1 2024-09-12T00:44:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.2oBCDtzOGRfrzcOr8KEd4Fr2zO8NIMi_0 2024-09-12T00:44:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15155556487643037826', time=2024-09-12T02:43:38.688329+0000, chain.objs.size()=1 2024-09-12T00:44:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.UYo6Xgh9fzIlQrYSa-3DrLDUXrQTLdl_0 2024-09-12T00:44:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17731386940008973262', time=2024-09-12T02:43:38.689888+0000, chain.objs.size()=1 2024-09-12T00:44:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.734+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.i2OmxtGVNjkr5_OfnEtDkvf97p6efvI_0 2024-09-12T00:44:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.738+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5977600675141131196', time=2024-09-12T02:43:38.761047+0000, chain.objs.size()=1 2024-09-12T00:44:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.738+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.5C45ydv4atzNLHFyqBE2AnPj02CRzaQ_0 2024-09-12T00:44:19.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.742+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.746+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:44:19.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15993588399308755495', time=2024-09-12T02:34:10.246095+0000, chain.objs.size()=2 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.rpRqJwZ-BbxkDLwhWBOfasSC6xAzk3m_0 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.rpRqJwZ-BbxkDLwhWBOfasSC6xAzk3m_1 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6614455906155235140', time=2024-09-12T02:34:10.480515+0000, chain.objs.size()=5 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-LUKEWARM.2~tk-_39-Iok9YPAB32JboWfBmlG0eIl7.1 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__shadow_foo-LUKEWARM.2~tk-_39-Iok9YPAB32JboWfBmlG0eIl7.1_1 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-LUKEWARM.2~tk-_39-Iok9YPAB32JboWfBmlG0eIl7.2 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__shadow_foo-LUKEWARM.2~tk-_39-Iok9YPAB32JboWfBmlG0eIl7.2_1 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-LUKEWARM.2~tk-_39-Iok9YPAB32JboWfBmlG0eIl7.3 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14886239954771120528', time=2024-09-12T02:35:34.815519+0000, chain.objs.size()=1 2024-09-12T00:44:19.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.HorE_PLAW3eruacOzYQ0g498WE_lF8T_0 2024-09-12T00:44:19.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5321368081530833531', time=2024-09-12T02:35:34.846326+0000, chain.objs.size()=1 2024-09-12T00:44:19.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.8LdK27juA9Yewx2saozgoVXIQx9HpkL_0 2024-09-12T00:44:19.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13895502309563866547', time=2024-09-12T02:35:34.966068+0000, chain.objs.size()=1 2024-09-12T00:44:19.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.zcLtUpy1qrtWZ6KlEa9d4v14kQdjsLB_0 2024-09-12T00:44:19.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3818678923387142786', time=2024-09-12T02:35:38.887844+0000, chain.objs.size()=1 2024-09-12T00:44:19.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.7F0wh-E-6WrTLIsOGdZpL8yKk4---P__0 2024-09-12T00:44:19.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6093827419785464956', time=2024-09-12T02:36:11.040404+0000, chain.objs.size()=1 2024-09-12T00:44:19.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.750+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.i96ANkB9Go4QpQ14MK56J5sUlTJnP3w_0 2024-09-12T00:44:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.754+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18301936874752394656', time=2024-09-12T02:36:11.041949+0000, chain.objs.size()=1 2024-09-12T00:44:19.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.754+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.USagjw8VYbAWAGxn4nD3Ttv4as3Wc7r_0 2024-09-12T00:44:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17286950382431022508', time=2024-09-12T02:36:11.115909+0000, chain.objs.size()=1 2024-09-12T00:44:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.0wirO78WcrQ3UlgNFy_x0SUpQXvKjv-_0 2024-09-12T00:44:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8089162489144468966', time=2024-09-12T02:36:15.298842+0000, chain.objs.size()=1 2024-09-12T00:44:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.w-nRDo_ujxsbj-SEUZ342HS5AvTrLm__0 2024-09-12T00:44:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11866929851701620672', time=2024-09-12T02:36:16.642890+0000, chain.objs.size()=1 2024-09-12T00:44:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.4zyWDD3q3sjm75_X8mfQMT_kZA9wW2i_0 2024-09-12T00:44:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11504874506053927685', time=2024-09-12T02:37:49.633774+0000, chain.objs.size()=1 2024-09-12T00:44:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.c8QE_0OmhGB3G5fUefaCwpEePlPAg99_0 2024-09-12T00:44:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12548466189746126841', time=2024-09-12T02:37:49.819648+0000, chain.objs.size()=1 2024-09-12T00:44:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.DfzKq91pyg-ENfQ4jBaN-43rAP0bn4D_0 2024-09-12T00:44:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11915514369373154990', time=2024-09-12T02:38:25.923590+0000, chain.objs.size()=1 2024-09-12T00:44:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.99IkYQxaJkQZ8WG0p5JBlsf1mDyuyY0_0 2024-09-12T00:44:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13410477207436529094', time=2024-09-12T02:38:36.452564+0000, chain.objs.size()=1 2024-09-12T00:44:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.ejfoK84H5JotDqTv4hN6giYXBKqxK_J_0 2024-09-12T00:44:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9835029856919769603', time=2024-09-12T02:39:13.186452+0000, chain.objs.size()=1 2024-09-12T00:44:19.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.758+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.Gw6xYkL8xkBhG-yTqtwEdWf4OLj34y-_0 2024-09-12T00:44:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.762+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17671205868350522220', time=2024-09-12T02:39:19.486066+0000, chain.objs.size()=1 2024-09-12T00:44:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.762+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.gQz_GVCAorvXKGwThVKuQZ9ykX1v8Rw_0 2024-09-12T00:44:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.762+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3238215714231998206', time=2024-09-12T02:39:55.461453+0000, chain.objs.size()=1 2024-09-12T00:44:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.762+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.VkABcyNf_uiHnWl1cuKEAomixiB_fst_0 2024-09-12T00:44:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.766+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3291426263562146817', time=2024-09-12T02:39:55.635178+0000, chain.objs.size()=1 2024-09-12T00:44:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.766+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.B2z_tdy-wdT6VocCXZpMB4HF6Grj5ZH_0 2024-09-12T00:44:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.766+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12322993380462921248', time=2024-09-12T02:40:43.406996+0000, chain.objs.size()=1 2024-09-12T00:44:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.766+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.CIRLE4p_mgxUsFVbmfjKKvxanWjQWf0_0 2024-09-12T00:44:19.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.770+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.774+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:44:19.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.774+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:44:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17690005587684849383', time=2024-09-12T02:34:09.826979+0000, chain.objs.size()=1 2024-09-12T00:44:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.sq9pZDMDl4RefBfzRZVquEVjTMG56LP_0 2024-09-12T00:44:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15184279982666320151', time=2024-09-12T02:35:35.097805+0000, chain.objs.size()=1 2024-09-12T00:44:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.NYMy9JfFlktvLBEWdp0TVJK_ULI9RS1_0 2024-09-12T00:44:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11506105298693638699', time=2024-09-12T02:36:11.183209+0000, chain.objs.size()=1 2024-09-12T00:44:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_._p_w4tYk0Oxxgcw1ttVsXDItZfi1gSL_0 2024-09-12T00:44:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11339255293937594711', time=2024-09-12T02:36:16.595656+0000, chain.objs.size()=1 2024-09-12T00:44:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.Y1gUTHwT05BT0ZApPvZvDs6RRYAAihp_0 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1698578538059649733', time=2024-09-12T02:36:57.648767+0000, chain.objs.size()=1 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.yic2_m7WTu7imp6P2Om9a5RRJYCCvIj_0 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11654198952887003859', time=2024-09-12T02:36:57.784964+0000, chain.objs.size()=1 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.VWP6v9xbtQKM6ZvhQhRzciV_JjWahEE_0 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2361051456599186251', time=2024-09-12T02:37:12.128269+0000, chain.objs.size()=1 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.vAQBAoHWeab6nqzfYPtOS63vXcwp0Ui_0 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.427336640687319317', time=2024-09-12T02:37:44.388697+0000, chain.objs.size()=1 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.nJGnSJ1Iybz5KSKugw55HZpcuj8UX7n_0 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3242928500613912793', time=2024-09-12T02:38:25.929332+0000, chain.objs.size()=1 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.JDPXwpowKPEzObivz8htYNpGqDtc5-b_0 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13198634594266857066', time=2024-09-12T02:38:32.022293+0000, chain.objs.size()=1 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.yrKLpTyWPPmoQ2dm4I2EIYH6VMbg2Qr_0 2024-09-12T00:44:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12637649847734249347', time=2024-09-12T02:39:13.118217+0000, chain.objs.size()=1 2024-09-12T00:44:19.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.ZH4unfS_5ZEN66lA-XJAlvUVMS9PjHU_0 2024-09-12T00:44:19.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17666436293466628501', time=2024-09-12T02:39:19.407099+0000, chain.objs.size()=1 2024-09-12T00:44:19.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.778+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.Q7tMsOnUVYzpxp6EDli2gijnqvl641R_0 2024-09-12T00:44:19.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.782+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11717270422715348775', time=2024-09-12T02:39:23.351737+0000, chain.objs.size()=1 2024-09-12T00:44:19.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.782+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.0LHSM4vpQ8HeX5Hv_53fMGUSg2SEl61_0 2024-09-12T00:44:19.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.786+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6361810709213559969', time=2024-09-12T02:39:55.558934+0000, chain.objs.size()=1 2024-09-12T00:44:19.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.786+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.xrDjjBcqKpvWwSUL-qMOzHk-tf48aS__0 2024-09-12T00:44:19.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.786+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6533849592611980444', time=2024-09-12T02:39:55.692855+0000, chain.objs.size()=1 2024-09-12T00:44:19.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.786+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.lJ5Cy6B-zX51W7NCOXlACVJF1bmNhwz_0 2024-09-12T00:44:19.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.786+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9018974717561223963', time=2024-09-12T02:40:01.487996+0000, chain.objs.size()=1 2024-09-12T00:44:19.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.786+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.MjHajaLmfk-bp1bUaSAV7zuMegr_arh_0 2024-09-12T00:44:19.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.786+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14502138421011612739', time=2024-09-12T02:43:38.742663+0000, chain.objs.size()=1 2024-09-12T00:44:19.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.786+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.NX09ccXMLzk2CBw9nRJz5muwcAoxQQt_0 2024-09-12T00:44:19.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.790+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.794+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:44:19.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.794+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T00:44:19.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13144894286639926085', time=2024-09-12T02:34:10.532511+0000, chain.objs.size()=3 2024-09-12T00:44:19.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.3dlgU4536Wwt-z60m1AKtdflOwBMUvX_0 2024-09-12T00:44:19.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.3dlgU4536Wwt-z60m1AKtdflOwBMUvX_1 2024-09-12T00:44:19.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.3dlgU4536Wwt-z60m1AKtdflOwBMUvX_2 2024-09-12T00:44:19.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3590546220042700139', time=2024-09-12T02:35:34.892562+0000, chain.objs.size()=1 2024-09-12T00:44:19.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.kC2AhA8bx4iFNN86M0lsO-V6kGaLVLA_0 2024-09-12T00:44:19.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7155145330285461605', time=2024-09-12T02:36:16.586077+0000, chain.objs.size()=1 2024-09-12T00:44:19.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.cKyKLjaoyMBcVnYogq-cEiJrlCkO56C_0 2024-09-12T00:44:19.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4195555041547080215', time=2024-09-12T02:36:21.560335+0000, chain.objs.size()=1 2024-09-12T00:44:19.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.suhvrL2L6CNpS0baUP3ME2EeeQK70lb_0 2024-09-12T00:44:19.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10565391127459023893', time=2024-09-12T02:37:01.852038+0000, chain.objs.size()=1 2024-09-12T00:44:19.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.F9JOwx2GB2T8u1wJ7txFunuPc5xF2Qr_0 2024-09-12T00:44:19.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6828179063996712380', time=2024-09-12T02:37:07.357817+0000, chain.objs.size()=1 2024-09-12T00:44:19.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.6F7qXk-hjEyWvv3EXm4kZHF3H19s-vX_0 2024-09-12T00:44:19.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3322084572741182117', time=2024-09-12T02:37:07.633069+0000, chain.objs.size()=1 2024-09-12T00:44:19.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.gCqtULllojqJhuVfihtGlHm_qUMcekg_0 2024-09-12T00:44:19.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9100371835261343609', time=2024-09-12T02:37:07.644612+0000, chain.objs.size()=1 2024-09-12T00:44:19.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.mZxe5RA7aB-IYag7fLgIzFL1c3gYZd7_0 2024-09-12T00:44:19.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3506307781000539028', time=2024-09-12T02:37:44.337740+0000, chain.objs.size()=1 2024-09-12T00:44:19.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.RIgnqSkJqWlKdOIipsWJf_dheM4xpe__0 2024-09-12T00:44:19.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17648961384341844692', time=2024-09-12T02:38:25.913233+0000, chain.objs.size()=1 2024-09-12T00:44:19.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.798+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.2BiiCEapPrKsTxVTMG3ThPvdgPOKGk2_0 2024-09-12T00:44:19.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.802+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12472373937187833406', time=2024-09-12T02:38:25.965997+0000, chain.objs.size()=1 2024-09-12T00:44:19.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.802+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.9k3CJmI4KTrvq9liEz9AFQGAQeBBv_v_0 2024-09-12T00:44:19.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6624184536330525739', time=2024-09-12T02:38:36.690968+0000, chain.objs.size()=1 2024-09-12T00:44:19.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.IYsyb8spvYqp7Kc4PQ39BBwrSWeBE_M_0 2024-09-12T00:44:19.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16527612933375150489', time=2024-09-12T02:39:11.306579+0000, chain.objs.size()=1 2024-09-12T00:44:19.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.GyiRYVZ-wdr9S93pdFkx8oTVfAV2LQg_0 2024-09-12T00:44:19.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11798521211882101454', time=2024-09-12T02:39:13.138439+0000, chain.objs.size()=1 2024-09-12T00:44:19.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.V1H8cbaeSW5x0Ox40eJOQ-KtI70g2Zr_0 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13118335577300924405', time=2024-09-12T02:39:55.504140+0000, chain.objs.size()=1 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.ihp4gWZhZDhLDyINz7XiNA6Htf0O3R-_0 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17191061276685513173', time=2024-09-12T02:39:55.505756+0000, chain.objs.size()=1 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.3xX8ksqM4o_aEJQnEUA_GarFGlsPWdb_0 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3645679609066075797', time=2024-09-12T02:39:55.651025+0000, chain.objs.size()=1 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.a85jr3Hnzw79TweEs1dcjGN4Qo55BE3_0 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12495690133445148261', time=2024-09-12T02:40:37.592520+0000, chain.objs.size()=1 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.CcCNYXcCX-Mh-8ixoUpxPWd91beU-c3_0 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15321753519116308116', time=2024-09-12T02:40:43.325634+0000, chain.objs.size()=1 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.7j5MJOIyrj32dWsgp9Ye96N4POKW9v-_0 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5770834222610058591', time=2024-09-12T02:40:43.327345+0000, chain.objs.size()=1 2024-09-12T00:44:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.dVACBkRwD_Pw5nXMCPVoaHwQVD82pCS_0 2024-09-12T00:44:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1715120068324976663', time=2024-09-12T02:40:48.710054+0000, chain.objs.size()=1 2024-09-12T00:44:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.806+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.qkhY6V_BYZYwAHTHOmd5l_72Dt76Uel_0 2024-09-12T00:44:19.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.810+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5481611286110316504', time=2024-09-12T02:40:48.712973+0000, chain.objs.size()=1 2024-09-12T00:44:19.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.810+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.mufegBUrfKM3HTLfIywLlJcsR850k4Z_0 2024-09-12T00:44:19.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.810+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1114687366273682254', time=2024-09-12T02:41:25.631135+0000, chain.objs.size()=1 2024-09-12T00:44:19.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.810+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.1skLE3lM7qTes8zoe3G-Qq5vV31sA6O_0 2024-09-12T00:44:19.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.810+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17458202687953469537', time=2024-09-12T02:41:25.798649+0000, chain.objs.size()=1 2024-09-12T00:44:19.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.810+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.mtne0F0omFlWFKdPHddsjlzvw4q90ZF_0 2024-09-12T00:44:19.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.810+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4743630157825719855', time=2024-09-12T02:43:38.760441+0000, chain.objs.size()=1 2024-09-12T00:44:19.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.810+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.WAH-xi9AN2Ha6DBlZzoHyX9QnNbd0PB_0 2024-09-12T00:44:19.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.814+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.818+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:44:19.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.818+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:44:19.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2358758810885434439', time=2024-09-12T02:34:10.088435+0000, chain.objs.size()=4 2024-09-12T00:44:19.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10__multipart_foo.2~05y2U0w054H8nNKylVnDu9YY95Be4cb.1 2024-09-12T00:44:19.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10__multipart_foo.2~05y2U0w054H8nNKylVnDu9YY95Be4cb.2 2024-09-12T00:44:19.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10__multipart_foo.2~05y2U0w054H8nNKylVnDu9YY95Be4cb.3 2024-09-12T00:44:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10__multipart_foo.2~05y2U0w054H8nNKylVnDu9YY95Be4cb.4 2024-09-12T00:44:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_M07buE4WU1Ha57_RxitDd0c3A8T6dLQ', time=2024-09-12T02:34:10.329051+0000, chain.objs.size()=3 2024-09-12T00:44:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.mDmw9DQC8ZU28B23eM1bODkfJktgb68_0 2024-09-12T00:44:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.mDmw9DQC8ZU28B23eM1bODkfJktgb68_1 2024-09-12T00:44:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.mDmw9DQC8ZU28B23eM1bODkfJktgb68_2 2024-09-12T00:44:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6788646005182573753', time=2024-09-12T02:34:10.387063+0000, chain.objs.size()=5 2024-09-12T00:44:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.1 2024-09-12T00:44:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.1_1 2024-09-12T00:44:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.2 2024-09-12T00:44:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.2_1 2024-09-12T00:44:19.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.822+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-LUKEWARM.2~T_kK2tISyaOsGbdTv4Tqilyvx-0TWkF.3 2024-09-12T00:44:19.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_v8hT2cSZHbx-RAfe_wPay4FJhy1K9c2', time=2024-09-12T02:34:10.396822+0000, chain.objs.size()=1 2024-09-12T00:44:19.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.ukS0AZM-yqHAjJaEzOi4-gJMR1eh09f_0 2024-09-12T00:44:19.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15253080010885899978', time=2024-09-12T02:35:30.607289+0000, chain.objs.size()=1 2024-09-12T00:44:19.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.aZ7Iry90hQHV5_tx_uSywtY81x_2QwT_0 2024-09-12T00:44:19.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14254889877676142711', time=2024-09-12T02:35:30.706853+0000, chain.objs.size()=1 2024-09-12T00:44:19.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.QUH2RKb-TWSjvwsr5rnhhhzUZj_v2-H_0 2024-09-12T00:44:19.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16154205404259605813', time=2024-09-12T02:35:34.900377+0000, chain.objs.size()=1 2024-09-12T00:44:19.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.ge9puTAVq0qcRRYldQSoV4r8jU5Gc8H_0 2024-09-12T00:44:19.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4863270474700324155', time=2024-09-12T02:36:10.940224+0000, chain.objs.size()=1 2024-09-12T00:44:19.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.9qQKS1zgJ1CPmdeOZ4Bm2h6-pPfnSMv_0 2024-09-12T00:44:19.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9599925112964187448', time=2024-09-12T02:36:16.702658+0000, chain.objs.size()=1 2024-09-12T00:44:19.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.zKr1BY3nAVthMf9JCTjz2rRb6wftEAE_0 2024-09-12T00:44:19.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11967126433183513574', time=2024-09-12T02:36:57.570962+0000, chain.objs.size()=1 2024-09-12T00:44:19.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.fswQK8DYyOI2jKoMl7dkpnev8q1IsRf_0 2024-09-12T00:44:19.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10786112570514676754', time=2024-09-12T02:36:57.631126+0000, chain.objs.size()=1 2024-09-12T00:44:19.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.BMK8ZiEfGMrXZSsjNYBJdwbD9yO3RY3_0 2024-09-12T00:44:19.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17215523203089578906', time=2024-09-12T02:37:02.877639+0000, chain.objs.size()=1 2024-09-12T00:44:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.3qEz9i9k10WpeUQlyGUnI8mQMoxcKiB_0 2024-09-12T00:44:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12136695581538309692', time=2024-09-12T02:37:44.294731+0000, chain.objs.size()=1 2024-09-12T00:44:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.Mjj9RbLKmzu-SH-ZRUZnI_aG0vLh1FN_0 2024-09-12T00:44:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2241590898397517575', time=2024-09-12T02:37:49.685958+0000, chain.objs.size()=1 2024-09-12T00:44:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.826+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.4t0GfwuRQVjo6hsYgMJSpd8NrYPStIF_0 2024-09-12T00:44:19.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.830+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11692370034701275867', time=2024-09-12T02:38:26.083673+0000, chain.objs.size()=1 2024-09-12T00:44:19.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.830+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.2TKwNxAY4ibtEfYvwlwFXCpzW-XTOOA_0 2024-09-12T00:44:19.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.830+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3657653758057677123', time=2024-09-12T02:39:19.492372+0000, chain.objs.size()=1 2024-09-12T00:44:19.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.830+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.1q5FxWmSfMryxVObybcJKrypLvALNnC_0 2024-09-12T00:44:19.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.830+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11323616532060250792', time=2024-09-12T02:40:43.176869+0000, chain.objs.size()=1 2024-09-12T00:44:19.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.830+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.QEIzvVQGCT_-X6WgXBplAfSSQ5JJA5G_0 2024-09-12T00:44:19.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.834+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.838+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:44:19.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.838+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.838+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:44:19.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7671286631638423017', time=2024-09-12T02:34:10.030120+0000, chain.objs.size()=4 2024-09-12T00:44:19.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11__multipart_foo.2~DjqKVlkyAwprX9SlTywqTbL8wxPllcu.1 2024-09-12T00:44:19.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11__multipart_foo.2~DjqKVlkyAwprX9SlTywqTbL8wxPllcu.2 2024-09-12T00:44:19.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11__multipart_foo.2~DjqKVlkyAwprX9SlTywqTbL8wxPllcu.3 2024-09-12T00:44:19.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11__multipart_foo.2~DjqKVlkyAwprX9SlTywqTbL8wxPllcu.4 2024-09-12T00:44:19.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10755812464411218660', time=2024-09-12T02:34:10.469621+0000, chain.objs.size()=3 2024-09-12T00:44:19.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-STANDARD.2~9URnfvinAH3gIlZU78aZkJNqPP5N9-o.1 2024-09-12T00:44:19.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-STANDARD.2~9URnfvinAH3gIlZU78aZkJNqPP5N9-o.2 2024-09-12T00:44:19.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-STANDARD.2~9URnfvinAH3gIlZU78aZkJNqPP5N9-o.3 2024-09-12T00:44:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7176218769412048291', time=2024-09-12T02:36:21.397860+0000, chain.objs.size()=1 2024-09-12T00:44:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_._ok-_UlWZtwdMo7w3l_oT0bd_Vl--9A_0 2024-09-12T00:44:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3714019363513547328', time=2024-09-12T02:37:44.298184+0000, chain.objs.size()=1 2024-09-12T00:44:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.9naeABOhirxG2ffUAIYutBMLv63AqX4_0 2024-09-12T00:44:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18077623329163794747', time=2024-09-12T02:38:25.909746+0000, chain.objs.size()=1 2024-09-12T00:44:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.LtClPeHlnAyIzB0pvaqqO_mFVBwlZ6K_0 2024-09-12T00:44:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3963468287353306476', time=2024-09-12T02:39:13.248631+0000, chain.objs.size()=1 2024-09-12T00:44:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.tW-lqrLmFBHx9vn0AUuEXGsnsI8ppWJ_0 2024-09-12T00:44:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10356683538530864681', time=2024-09-12T02:39:55.460814+0000, chain.objs.size()=1 2024-09-12T00:44:19.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.842+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.ZCfd4rVaWmryNSIeFPOmbX2hWF8sLxq_0 2024-09-12T00:44:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.846+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3442221456145550413', time=2024-09-12T02:40:48.942488+0000, chain.objs.size()=1 2024-09-12T00:44:19.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.846+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.aXgvFTUZFxpC725DICkmknP3UNsbVVi_0 2024-09-12T00:44:19.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.846+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.850+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:44:19.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:44:19.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_6KxwbkZqXAzjNOghv52OW3PRXXnyzcX', time=2024-09-12T02:34:10.203207+0000, chain.objs.size()=2 2024-09-12T00:44:19.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.WqDC_sDN3FywObJ9ZUgYonNO7MWZJdA_0 2024-09-12T00:44:19.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.WqDC_sDN3FywObJ9ZUgYonNO7MWZJdA_1 2024-09-12T00:44:19.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.252102817784747326', time=2024-09-12T02:35:30.579728+0000, chain.objs.size()=1 2024-09-12T00:44:19.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.LFltxILcHvMxcn-fiwXfUK5pTNvyvQ6_0 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15316497621279794405', time=2024-09-12T02:35:34.890855+0000, chain.objs.size()=1 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.44ewjyHc4ghHjy2-Z030Eon_SrD-nHV_0 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3000668319508504930', time=2024-09-12T02:36:16.577136+0000, chain.objs.size()=1 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.gkm__-6MQe4wSH6glDPlxeJ4K6MoLNL_0 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12000428429237867137', time=2024-09-12T02:36:16.653090+0000, chain.objs.size()=1 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.qXLLjtWJPNlpie2aaGfNln401YUQ5Ks_0 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3896398766538865757', time=2024-09-12T02:36:57.731098+0000, chain.objs.size()=1 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.fLyRx4d3UU2iMtz5wKY8cyDwUkzvIrD_0 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7631660648332182627', time=2024-09-12T02:37:02.956402+0000, chain.objs.size()=1 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.37HJk5NiFNQnxQye0T7EbJPyY0B7Oa8_0 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10791668081171908472', time=2024-09-12T02:37:07.427756+0000, chain.objs.size()=1 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.c2CHHsQ3WHZppjdTW3yYHiYIwujwk_u_0 2024-09-12T00:44:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10807054112310923827', time=2024-09-12T02:37:07.462956+0000, chain.objs.size()=1 2024-09-12T00:44:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.V1V-F9N9NVndblv3RtHxM_ftjAQpcug_0 2024-09-12T00:44:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10501996012132391447', time=2024-09-12T02:37:44.387052+0000, chain.objs.size()=1 2024-09-12T00:44:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.EbxiAKcOMZ4_PG5d18wkD1JS-OQJpW9_0 2024-09-12T00:44:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10474355546685150565', time=2024-09-12T02:37:44.388812+0000, chain.objs.size()=1 2024-09-12T00:44:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.854+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.AD3uDMe7ovIV6E8JVQBCaRZ7Maewnn4_0 2024-09-12T00:44:19.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17669881657293605253', time=2024-09-12T02:37:44.523631+0000, chain.objs.size()=1 2024-09-12T00:44:19.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.zzxLBx5p2v3zdUrx4C13iWu5aGn2hNh_0 2024-09-12T00:44:19.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5948737751503437393', time=2024-09-12T02:37:49.681512+0000, chain.objs.size()=1 2024-09-12T00:44:19.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.rdeXybruFiw1VQzX_rC4tuBgCVhgNSM_0 2024-09-12T00:44:19.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11853690734748116096', time=2024-09-12T02:38:36.467361+0000, chain.objs.size()=1 2024-09-12T00:44:19.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.PK6ZjOjM8pd6m108K24TJcQF9AA58Id_0 2024-09-12T00:44:19.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2926551790989610926', time=2024-09-12T02:39:13.136964+0000, chain.objs.size()=1 2024-09-12T00:44:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.kFhmwwqEA0UKOeNrsl1E47DwMWpD0k9_0 2024-09-12T00:44:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5810234703336230810', time=2024-09-12T02:40:01.551046+0000, chain.objs.size()=1 2024-09-12T00:44:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.PKeNj-_CvuWypPsVjGnWPnHoCNZ7odb_0 2024-09-12T00:44:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11461284883308833558', time=2024-09-12T02:40:43.232344+0000, chain.objs.size()=1 2024-09-12T00:44:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.1DJ4bJ7hV21GTXAaTCE2NM_s4V_K4F8_0 2024-09-12T00:44:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17504473031219193912', time=2024-09-12T02:40:43.483339+0000, chain.objs.size()=1 2024-09-12T00:44:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.858+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.KlCK9GGpSXjxkpnEUPC9cZdWuNaTGj8_0 2024-09-12T00:44:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.862+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13291340543843200496', time=2024-09-12T02:40:48.816427+0000, chain.objs.size()=1 2024-09-12T00:44:19.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.862+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.TeAcJ74iylwCvBTlxxOUg0nT_BvWgf-_0 2024-09-12T00:44:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.866+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.866+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:44:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:44:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9012237583434653119', time=2024-09-12T02:36:16.702666+0000, chain.objs.size()=1 2024-09-12T00:44:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.yHHDVJBqWFV-mfqgacUQI61s5W9EaNi_0 2024-09-12T00:44:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1297582628972834431', time=2024-09-12T02:36:21.560279+0000, chain.objs.size()=1 2024-09-12T00:44:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.ZPGd8VCQUf_rggHdsY0kuwHJ18zA3S7_0 2024-09-12T00:44:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13246975950462081388', time=2024-09-12T02:37:02.780720+0000, chain.objs.size()=1 2024-09-12T00:44:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.XuBukuZHxUha0dNlKP4sawtA5xrxda4_0 2024-09-12T00:44:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18367342275990700309', time=2024-09-12T02:37:07.415322+0000, chain.objs.size()=1 2024-09-12T00:44:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.kCwSbL1pp2_5AkP6WqqVxZPUY0gkDlF_0 2024-09-12T00:44:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15196001085237009516', time=2024-09-12T02:37:49.686061+0000, chain.objs.size()=1 2024-09-12T00:44:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.pbqyjDWZWKHyL2Hsg7Hfu-wSRGtqohv_0 2024-09-12T00:44:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4084213272018499841', time=2024-09-12T02:37:49.841733+0000, chain.objs.size()=1 2024-09-12T00:44:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.CO6AEu2BMc54SShtvZNyITpXgknOA51_0 2024-09-12T00:44:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11577116296742258195', time=2024-09-12T02:38:31.845063+0000, chain.objs.size()=1 2024-09-12T00:44:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.iD8sU7yLCLt4b9KAJKpweQy6FGGRgRF_0 2024-09-12T00:44:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14241691163796144071', time=2024-09-12T02:40:01.400784+0000, chain.objs.size()=1 2024-09-12T00:44:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.rmOvQDojhqgwuMwL0W6L_qywitcjVGT_0 2024-09-12T00:44:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15517887344713847995', time=2024-09-12T02:40:05.607599+0000, chain.objs.size()=1 2024-09-12T00:44:19.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.D0rjAr8ryW20-HAtmYwYdZ2AgIBXP8Q_0 2024-09-12T00:44:19.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8493510313576048725', time=2024-09-12T02:40:48.705098+0000, chain.objs.size()=1 2024-09-12T00:44:19.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.CpYFJLmz08LEMPgJe0-by7Jnm0GJecB_0 2024-09-12T00:44:19.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10121729510452091778', time=2024-09-12T02:41:25.605039+0000, chain.objs.size()=1 2024-09-12T00:44:19.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.mlUK3rv8JsQDNjCFMDb3-P4zYEmvMOU_0 2024-09-12T00:44:19.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1033992287946686450', time=2024-09-12T02:43:54.360046+0000, chain.objs.size()=1 2024-09-12T00:44:19.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.870+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19__shadow:3FEPkjA8N1IqpmP5FLPPFTU6BA554hY_.Dovwov2CM5AveefycGi4tWWJGLSLJvk_0 2024-09-12T00:44:19.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.878+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:44:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:44:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14536320832121734036', time=2024-09-12T02:34:10.383653+0000, chain.objs.size()=3 2024-09-12T00:44:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.1 2024-09-12T00:44:19.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.2 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.3 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10162341673211426958', time=2024-09-12T02:35:34.894175+0000, chain.objs.size()=1 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.Jcl7eLzNAjpUAE0ldwM6PISfVAhyeXP_0 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2395595858975700652', time=2024-09-12T02:36:21.664333+0000, chain.objs.size()=1 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.1ZRuGRelfD24PGXJyj0hQj3Xz782F7Z_0 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.402338708907653437', time=2024-09-12T02:37:07.352205+0000, chain.objs.size()=1 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.Mwisc5el5Dft9XXlJp6N-vR6ZG4iUsF_0 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9737231762858955071', time=2024-09-12T02:37:49.914404+0000, chain.objs.size()=1 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.i-ro2ausJ4ObMvQev4LTsiWZsuUVuk6_0 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16532088053734431113', time=2024-09-12T02:39:13.179467+0000, chain.objs.size()=1 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.4ZQ_TuiZcDo3GmGYTyXOXgNfwDha27o_0 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1307187659759535809', time=2024-09-12T02:39:13.306349+0000, chain.objs.size()=1 2024-09-12T00:44:19.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.h018_obAKkejgyrHgSCjkXOMnNP05nL_0 2024-09-12T00:44:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15165901544938392969', time=2024-09-12T02:39:19.464498+0000, chain.objs.size()=1 2024-09-12T00:44:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.fzbmKKH4GAJX7zxIBhMshpLhy59aPBd_0 2024-09-12T00:44:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10758326968396803514', time=2024-09-12T02:39:55.613394+0000, chain.objs.size()=1 2024-09-12T00:44:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.45udWSapT8537Ni4dUNtXbsFHaoFIIz_0 2024-09-12T00:44:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2982744829751579410', time=2024-09-12T02:40:01.381141+0000, chain.objs.size()=1 2024-09-12T00:44:19.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.882+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.Vv7oeaIUU3SFVvPZZv63pL67nQWP1LE_0 2024-09-12T00:44:19.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.886+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9367350882610050456', time=2024-09-12T02:40:01.570315+0000, chain.objs.size()=1 2024-09-12T00:44:19.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.886+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.SbkWsek6IPRNR6rz9z_C59lxVHs7JH5_0 2024-09-12T00:44:19.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.886+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11611524508935027436', time=2024-09-12T02:40:37.571641+0000, chain.objs.size()=1 2024-09-12T00:44:19.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.886+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_._2-j6gdScEwArcBbYUAd7iN1mS7mkwT_0 2024-09-12T00:44:19.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.886+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6178824785487766685', time=2024-09-12T02:40:37.573200+0000, chain.objs.size()=1 2024-09-12T00:44:19.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.886+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.ucgOLFU3rDf86-buK3BZRxm0BlWDmn0_0 2024-09-12T00:44:19.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.886+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5197746672481193963', time=2024-09-12T02:40:37.655648+0000, chain.objs.size()=1 2024-09-12T00:44:19.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.886+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.luWp9vdNHu27vXPtmnMM90W9GgrzukE_0 2024-09-12T00:44:19.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.886+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4923350360432430743', time=2024-09-12T02:40:43.289151+0000, chain.objs.size()=1 2024-09-12T00:44:19.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.886+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.0cs5oHpnXGTmWbMVpsufqhhegQvlK-n_0 2024-09-12T00:44:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.894+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.894+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:44:19.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T00:44:19.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7939470501903829136', time=2024-09-12T02:34:10.211875+0000, chain.objs.size()=2 2024-09-12T00:44:19.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.JZKSSeWujvWi-C2NXrnN19zathen9DW_0 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.JZKSSeWujvWi-C2NXrnN19zathen9DW_1 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16590547162892045534', time=2024-09-12T02:35:30.642296+0000, chain.objs.size()=1 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.6qIFRFALB-TyUOPoteuwa_lCa31UIFO_0 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3636100024012242016', time=2024-09-12T02:36:16.589776+0000, chain.objs.size()=1 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.qtAh_gNDPnFUXEuvmDoUxNZeqZrnfwU_0 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8381875775310694055', time=2024-09-12T02:36:57.704335+0000, chain.objs.size()=1 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.IXddrDKAfQ6gkuS5ctW0PM69UjI25CW_0 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1876071786991466079', time=2024-09-12T02:37:02.904610+0000, chain.objs.size()=1 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.hOzNHGQvAFlkKERBtQc8homxe8eRZwP_0 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6166467397860307079', time=2024-09-12T02:37:07.652949+0000, chain.objs.size()=1 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.A1O0fr9K4MQQXVoVWfnhNPm3NnNmT8M_0 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14945169896960587452', time=2024-09-12T02:37:48.428683+0000, chain.objs.size()=1 2024-09-12T00:44:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.Fn3d7qKoJmZu2y8qPdO2OFiXDD-u6oB_0 2024-09-12T00:44:19.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10064101546247335106', time=2024-09-12T02:38:25.877756+0000, chain.objs.size()=1 2024-09-12T00:44:19.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.DjuPMNHKbP1buk7LaUr6Ebo04bpAFhS_0 2024-09-12T00:44:19.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.312078801002436415', time=2024-09-12T02:38:25.995154+0000, chain.objs.size()=1 2024-09-12T00:44:19.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.P4uIwqOdMO7QlTDkbeWnVVwOHd6ws1w_0 2024-09-12T00:44:19.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14272002720372017561', time=2024-09-12T02:38:26.042394+0000, chain.objs.size()=1 2024-09-12T00:44:19.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.vIATFg_qJa3WC_unp7jX7Z1Zbol6qrA_0 2024-09-12T00:44:19.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3040981928164845432', time=2024-09-12T02:39:13.046143+0000, chain.objs.size()=1 2024-09-12T00:44:19.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.898+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.-046DjuXf9UQGetGP0K6Icj7lPsnCLG_0 2024-09-12T00:44:19.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5076932686478945255', time=2024-09-12T02:39:13.248619+0000, chain.objs.size()=1 2024-09-12T00:44:19.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.8s8aBYZDphV9Rnu8FO9OJ6cpjVxqUvU_0 2024-09-12T00:44:19.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16852898486351764317', time=2024-09-12T02:39:19.407099+0000, chain.objs.size()=1 2024-09-12T00:44:19.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.IGiUM9TQ-UX8KzYelVGvNfBJBJDsbuo_0 2024-09-12T00:44:19.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4597348895229749886', time=2024-09-12T02:40:01.487736+0000, chain.objs.size()=1 2024-09-12T00:44:19.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.0gk607eR8nxp2ZnCcH79UCa7-tfC29Y_0 2024-09-12T00:44:19.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4387632543733732136', time=2024-09-12T02:40:01.489118+0000, chain.objs.size()=1 2024-09-12T00:44:19.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.uqNRyC1DaMP80qgZzubNfvza6ZpAftA_0 2024-09-12T00:44:19.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4811943837322691060', time=2024-09-12T02:40:43.322031+0000, chain.objs.size()=1 2024-09-12T00:44:19.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.VTTLp8xT5KSn91oshlA1C6et_HHf_pR_0 2024-09-12T00:44:19.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4937674763984952865', time=2024-09-12T02:40:43.421214+0000, chain.objs.size()=1 2024-09-12T00:44:19.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.6l0QErfDXORRvBYl1G0TYEkXDKCYmvn_0 2024-09-12T00:44:19.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16266107009976313275', time=2024-09-12T02:40:48.731259+0000, chain.objs.size()=1 2024-09-12T00:44:19.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.RuacTC1fgXO54WEAynUYzyGW4_h_eIS_0 2024-09-12T00:44:19.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11625138908035228733', time=2024-09-12T02:40:48.752251+0000, chain.objs.size()=1 2024-09-12T00:44:19.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.Psa_KmInQFNeDBxS5GML41CQbHlXE8k_0 2024-09-12T00:44:19.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15187616874097915420', time=2024-09-12T02:41:25.702215+0000, chain.objs.size()=1 2024-09-12T00:44:19.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.902+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.LNCbjr2xtPu6BcdVoCBQE4DHcXOoTJO_0 2024-09-12T00:44:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.906+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15077965805906077346', time=2024-09-12T02:41:25.738854+0000, chain.objs.size()=1 2024-09-12T00:44:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.906+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.oZixxCz-LHpXtvyFQARdGx6E-JYBkNO_0 2024-09-12T00:44:19.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.910+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:44:19.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12907920396944960048', time=2024-09-12T02:34:10.190276+0000, chain.objs.size()=1 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.UZPWG0gzTqv6bp1ahMDgckqb317an0e_0 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9858672795371025214', time=2024-09-12T02:34:10.226133+0000, chain.objs.size()=2 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.JZKSSeWujvWi-C2NXrnN19zathen9DW_0 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.JZKSSeWujvWi-C2NXrnN19zathen9DW_1 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_x12j2X52TU6XxqDfmZ52v89gyrjWGsi', time=2024-09-12T02:34:10.340151+0000, chain.objs.size()=3 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.0vg4kXqwWVMrqlk8RSJBAU2AvJb4XzY_0 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.0vg4kXqwWVMrqlk8RSJBAU2AvJb4XzY_1 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.0vg4kXqwWVMrqlk8RSJBAU2AvJb4XzY_2 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13756711011000805167', time=2024-09-12T02:34:10.717054+0000, chain.objs.size()=1 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8__shadow_.mA1ynOo3Mn-jsiKRHah89fVkFoh2tjv_0 2024-09-12T00:44:19.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10643655452170635002', time=2024-09-12T02:34:10.815418+0000, chain.objs.size()=1 2024-09-12T00:44:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9__shadow_.JNxSjSR-q58lqfzK1RWI7QENo9ThhG7_0 2024-09-12T00:44:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12941259819637208495', time=2024-09-12T02:35:34.960142+0000, chain.objs.size()=1 2024-09-12T00:44:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.B061BUxmvMdv580UEPogsZCuesFXK-g_0 2024-09-12T00:44:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3980947671869034337', time=2024-09-12T02:37:03.022519+0000, chain.objs.size()=1 2024-09-12T00:44:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.OQ-BB6e6IPhB1HUgjnhpx9SDlmQ34yJ_0 2024-09-12T00:44:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14968658002776682216', time=2024-09-12T02:37:07.518975+0000, chain.objs.size()=1 2024-09-12T00:44:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.amawNg7And2v0c-HIX3U7ugwPs9UF77_0 2024-09-12T00:44:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15802171255658951945', time=2024-09-12T02:37:44.301887+0000, chain.objs.size()=1 2024-09-12T00:44:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.914+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.7idRSDBW-YwCW6tBhMDY1GRUU4sscLj_0 2024-09-12T00:44:19.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8687541064062342173', time=2024-09-12T02:37:44.329087+0000, chain.objs.size()=1 2024-09-12T00:44:19.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.WydE4JUugrFVBOhA1kZMWvfuyAaXeNh_0 2024-09-12T00:44:19.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10905854925873305349', time=2024-09-12T02:37:44.429279+0000, chain.objs.size()=1 2024-09-12T00:44:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.5aK4aaOTctMjlJheBqeYYODJHulXYEy_0 2024-09-12T00:44:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17656696118328902574', time=2024-09-12T02:38:30.419260+0000, chain.objs.size()=1 2024-09-12T00:44:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.YWs1H3LLJPqM06TJsQVNoCKW9UryDRJ_0 2024-09-12T00:44:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15835124778962280845', time=2024-09-12T02:38:31.857934+0000, chain.objs.size()=1 2024-09-12T00:44:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.ZRDuRUEFOqEd5b21TVOQCiu1OCN3huu_0 2024-09-12T00:44:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.768299404389387576', time=2024-09-12T02:38:36.540363+0000, chain.objs.size()=1 2024-09-12T00:44:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.sn8pQqjK6-ogmFxM4qXrmBT4-YLVxmZ_0 2024-09-12T00:44:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5680633154069753316', time=2024-09-12T02:39:13.315502+0000, chain.objs.size()=1 2024-09-12T00:44:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.918+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.jWzuQlUvurT6vnf2E6Uzel6dVt0aXPg_0 2024-09-12T00:44:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.922+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11390910638472083057', time=2024-09-12T02:40:00.166158+0000, chain.objs.size()=1 2024-09-12T00:44:19.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.922+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.5rYFGKe-13tlGmKZ5utxgd_gM7l6J67_0 2024-09-12T00:44:19.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.922+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6502455010755083223', time=2024-09-12T02:40:43.257602+0000, chain.objs.size()=1 2024-09-12T00:44:19.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.922+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.qG4wj8lAGMp8GMgnaZ7MMrNIwkQ6ixl_0 2024-09-12T00:44:19.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.922+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15980138561020783941', time=2024-09-12T02:40:48.793813+0000, chain.objs.size()=1 2024-09-12T00:44:19.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.922+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.n3sMY89LsNinjRrojUVgLJZF3fzxXxq_0 2024-09-12T00:44:19.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.922+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8631692621813080687', time=2024-09-12T02:43:54.368316+0000, chain.objs.size()=1 2024-09-12T00:44:19.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.922+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19__shadow:L6x8-RlWGOSOL0fxXnMp-W5R4e0VjCR_.AoOqD-RVw9a928uxIETKSqjvfCYYJLJ_0 2024-09-12T00:44:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.926+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:44:19.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:44:19.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11671590268409154190', time=2024-09-12T02:34:09.773163+0000, chain.objs.size()=1 2024-09-12T00:44:19.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.lRtw9nhTM47NKPJ95WgfbV1qd9CSOkK_0 2024-09-12T00:44:19.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14231876287855177345', time=2024-09-12T02:34:09.831622+0000, chain.objs.size()=1 2024-09-12T00:44:19.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.QXjfaPWP0TpKcCTxEYNvSvLKJiEx4fx_0 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9656881585989730591', time=2024-09-12T02:34:10.553581+0000, chain.objs.size()=3 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.KP53dOLro91u4jD8IEIZSex_8_adCFT_0 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.KP53dOLro91u4jD8IEIZSex_8_adCFT_1 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14__shadow_.KP53dOLro91u4jD8IEIZSex_8_adCFT_2 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9918844939870093135', time=2024-09-12T02:35:30.633983+0000, chain.objs.size()=1 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.kWn-LBb_wYgoD4BgMh9NH_c7HJQ7t8m_0 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17083725411552202029', time=2024-09-12T02:37:02.959960+0000, chain.objs.size()=1 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.-zGFVGa8irxqFFU8jIy_2wOQGxgfZVH_0 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13855501185845959334', time=2024-09-12T02:37:07.512054+0000, chain.objs.size()=1 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.nHq3RKDabc2psPZONl46i_0f-orpiCa_0 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13933287775459245192', time=2024-09-12T02:39:13.305707+0000, chain.objs.size()=1 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.EoU3sJalYeSv_HnXFZ3_FTnL_FNp1bY_0 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5974857986347412374', time=2024-09-12T02:39:55.650905+0000, chain.objs.size()=1 2024-09-12T00:44:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.y7DAecGYPU37bljkPkDQ_L6amZ2UkHv_0 2024-09-12T00:44:19.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12740676469738287299', time=2024-09-12T02:40:01.421975+0000, chain.objs.size()=1 2024-09-12T00:44:19.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.930+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.YrBrAkE8We_GYeX30m1FoQrSgpJH1t-_0 2024-09-12T00:44:19.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.938+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.938+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:44:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:44:19.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13634469972292428969', time=2024-09-12T02:34:09.816982+0000, chain.objs.size()=1 2024-09-12T00:44:19.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.ZyTNT8ahW-Dr1v5ubzL_5a-eLGfgxME_0 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_vGJJbJhVhThrWpzWjbuG6vVGT2a8iAJ', time=2024-09-12T02:34:10.144465+0000, chain.objs.size()=1 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.DHqTXpzhIkdbgxtT9Kehh9ciBJzYmP9_0 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1827983661902159064', time=2024-09-12T02:34:10.165944+0000, chain.objs.size()=2 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.rpRqJwZ-BbxkDLwhWBOfasSC6xAzk3m_0 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.rpRqJwZ-BbxkDLwhWBOfasSC6xAzk3m_1 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5016697132734001603', time=2024-09-12T02:34:10.732855+0000, chain.objs.size()=1 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8__shadow_.O_ML5icwa3qiiPpTN4ZCjaht7x2Z_J4_0 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10489917118806195046', time=2024-09-12T02:34:10.786386+0000, chain.objs.size()=1 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9__shadow_.NGtH7yJorKlWgaf2ED44TT_eB9w3ZgX_0 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17839157021143912806', time=2024-09-12T02:35:30.600808+0000, chain.objs.size()=1 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.egs1hWY82xjZDL8ktut00l4gvzvcZdL_0 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3041861432680421094', time=2024-09-12T02:35:34.896536+0000, chain.objs.size()=1 2024-09-12T00:44:19.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.4ZMw2RQQItgvcgCqpYAJzNyWP_4MgUl_0 2024-09-12T00:44:19.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11752721924988276694', time=2024-09-12T02:36:11.053815+0000, chain.objs.size()=1 2024-09-12T00:44:19.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.RA8Yq2ptmyO7_qVXC-gMOiUURKNdAxy_0 2024-09-12T00:44:19.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12876436423234206249', time=2024-09-12T02:36:57.533418+0000, chain.objs.size()=1 2024-09-12T00:44:19.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.FkuWJNb7N5fcRqzGxzsJVJIdbP3wqsW_0 2024-09-12T00:44:19.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.481080270497451089', time=2024-09-12T02:36:57.636808+0000, chain.objs.size()=1 2024-09-12T00:44:19.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.N9uPODDfUiCkwJSQ1EKPs1DSeVILJe2_0 2024-09-12T00:44:19.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8207988712219795531', time=2024-09-12T02:37:07.505150+0000, chain.objs.size()=1 2024-09-12T00:44:19.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.942+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.XGDFJ7COQrzrg4dvcI7oqVy-ZSQfF2P_0 2024-09-12T00:44:19.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14388979735102149090', time=2024-09-12T02:37:44.351029+0000, chain.objs.size()=1 2024-09-12T00:44:19.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.Wt7uvTT_Dc8cUc7i8freHxz11sQOH5P_0 2024-09-12T00:44:19.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10366708699863706426', time=2024-09-12T02:37:49.763991+0000, chain.objs.size()=1 2024-09-12T00:44:19.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.T3RyWxbcPLhSFj-ZawYzRXtAkB2BqAy_0 2024-09-12T00:44:19.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5390687682452563955', time=2024-09-12T02:38:26.100923+0000, chain.objs.size()=1 2024-09-12T00:44:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.fs9yWba-r921uknv-cPWUYbreT0hngI_0 2024-09-12T00:44:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4156817313820761462', time=2024-09-12T02:39:13.054524+0000, chain.objs.size()=1 2024-09-12T00:44:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.4WPmp3Anen3FLC5NR8ut4pNS8wbPIrB_0 2024-09-12T00:44:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5097567919548061867', time=2024-09-12T02:39:19.510088+0000, chain.objs.size()=1 2024-09-12T00:44:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.snm4jVCyqRcjW8UCU2_hmF1vABmtufu_0 2024-09-12T00:44:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4264188181063956053', time=2024-09-12T02:40:01.404228+0000, chain.objs.size()=1 2024-09-12T00:44:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.-htDAJo14X8PnN7etvoCTL6Eopopjmo_0 2024-09-12T00:44:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3337929632102043028', time=2024-09-12T02:40:37.464486+0000, chain.objs.size()=1 2024-09-12T00:44:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.noARr4hMaYuOmmiJ1K-q8WVXND97oNS_0 2024-09-12T00:44:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17995727265503392375', time=2024-09-12T02:40:43.289090+0000, chain.objs.size()=1 2024-09-12T00:44:19.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.946+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.OoDSRbII-vUEK7DiiJuk__Gq1WARNRZ_0 2024-09-12T00:44:19.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.954+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.954+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:44:19.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:44:19.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_2uEks0qrkkOWBt8aPZ0qbr-ARKzPqMT', time=2024-09-12T02:34:10.150546+0000, chain.objs.size()=2 2024-09-12T00:44:19.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.WnFB3raBzI3BG8QXfR86sj0tQs7sp-O_0 2024-09-12T00:44:19.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.WnFB3raBzI3BG8QXfR86sj0tQs7sp-O_1 2024-09-12T00:44:19.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2300748505700008841', time=2024-09-12T02:34:10.216051+0000, chain.objs.size()=1 2024-09-12T00:44:19.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.UZPWG0gzTqv6bp1ahMDgckqb317an0e_0 2024-09-12T00:44:19.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12878692507752745736', time=2024-09-12T02:35:30.505986+0000, chain.objs.size()=1 2024-09-12T00:44:19.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.Y2Zt3Yrs14qILC85Fa-uS8ElMXNAAol_0 2024-09-12T00:44:19.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9447926441799334545', time=2024-09-12T02:35:35.043061+0000, chain.objs.size()=1 2024-09-12T00:44:19.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.KFpNJffC5sLttcN-jz720FC_oQ6MyvA_0 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13630246345711232787', time=2024-09-12T02:36:11.054617+0000, chain.objs.size()=1 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.9O3ma44DwzYKRIhvgGGSVz20dXKfuCO_0 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1120265075643096633', time=2024-09-12T02:37:49.733025+0000, chain.objs.size()=1 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.m3ktCKRpCtKRLpXrfjHWtijq8Nxkh5g_0 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1149088777332516844', time=2024-09-12T02:39:13.249134+0000, chain.objs.size()=1 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.2NykAYoK6Pv8llYi_29omWxfIgwJsvY_0 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7086321080408255585', time=2024-09-12T02:40:48.768453+0000, chain.objs.size()=1 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.eopXJZZQz7FSdqi7GZ3IZxNOWDCOmCw_0 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11370633864031097558', time=2024-09-12T02:40:48.772011+0000, chain.objs.size()=1 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.ogYAGZvdQyKjjZw2qKVISMFUDvZmBI__0 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.61656664317317691', time=2024-09-12T02:41:25.643205+0000, chain.objs.size()=1 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.KxPgGjDOYiFDceJ1uHEQ0zs5wsUGXx6_0 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13217690995740346313', time=2024-09-12T02:41:25.757812+0000, chain.objs.size()=1 2024-09-12T00:44:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.958+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.gh4Le-qHK4KPPGBkDVioY08wyhxpbRo_0 2024-09-12T00:44:19.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.962+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11207461898333628319', time=2024-09-12T02:41:25.796316+0000, chain.objs.size()=1 2024-09-12T00:44:19.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.962+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.PFmgCUkaBbj2pTX9gjgpEKxYBelgANJ_0 2024-09-12T00:44:19.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.966+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:44:19.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16515131115276443157', time=2024-09-12T02:34:09.806723+0000, chain.objs.size()=1 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.aP1HB-1la_mXZrDtgcC0Dnd9NNgRVEO_0 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14491418996404770659', time=2024-09-12T02:34:09.857464+0000, chain.objs.size()=1 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.QZb3zz9QPaH4xdt0K-9XOBoDVs6OKof_0 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2990934157372064209', time=2024-09-12T02:35:34.969847+0000, chain.objs.size()=1 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.7LjpTaX9AYRX1UWn5RxWYANsBSf7Iah_0 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6872756560572758714', time=2024-09-12T02:36:21.460046+0000, chain.objs.size()=1 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.xD3iguaqxzwGvbVGzpRrZEBT3syV175_0 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8681005520098312151', time=2024-09-12T02:36:57.679136+0000, chain.objs.size()=1 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.AUGqgAmyWIv3YZmgZf2UoE2EVBbZeGC_0 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17872054634272947851', time=2024-09-12T02:37:02.902636+0000, chain.objs.size()=1 2024-09-12T00:44:19.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.mVfI9bOeg4buBWDDfUBMHYkxygzl_cY_0 2024-09-12T00:44:19.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626833660302019615', time=2024-09-12T02:37:49.815835+0000, chain.objs.size()=1 2024-09-12T00:44:19.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.0iMnWVHr_AXVwUuCR8a6pYlGU7Vs1to_0 2024-09-12T00:44:19.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17497548744575644571', time=2024-09-12T02:38:36.454997+0000, chain.objs.size()=1 2024-09-12T00:44:19.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.cb6PSln69k474U5Apc2nVFNgJxTdKq2_0 2024-09-12T00:44:19.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11414453494812227056', time=2024-09-12T02:39:13.043458+0000, chain.objs.size()=1 2024-09-12T00:44:19.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.ZbkpdDkaq_TSS-HibBRrTAVDL6iQP9r_0 2024-09-12T00:44:19.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6255945957053153710', time=2024-09-12T02:39:19.517080+0000, chain.objs.size()=1 2024-09-12T00:44:19.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.rvFw9a7jGkfj2IYiXMBrf2p4kYFASbz_0 2024-09-12T00:44:19.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3487133812467249843', time=2024-09-12T02:40:37.531269+0000, chain.objs.size()=1 2024-09-12T00:44:19.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.nToTFAFpkGlkqM-lD-dhOhGP_Iz2nxT_0 2024-09-12T00:44:19.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14938973355270601169', time=2024-09-12T02:40:37.572455+0000, chain.objs.size()=1 2024-09-12T00:44:19.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.970+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.IxsH0CbfzIejSAkvz89RVjdwCjW46Q-_0 2024-09-12T00:44:19.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.974+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8582934897492492848', time=2024-09-12T02:40:37.652926+0000, chain.objs.size()=1 2024-09-12T00:44:19.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.974+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.RXC0C9MxyV94gD-uV4mDj9j5odkl8Q3_0 2024-09-12T00:44:19.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.978+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:19.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.982+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:44:19.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.982+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:19.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:19.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:44:19.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8611142453384407858', time=2024-09-12T02:34:09.783783+0000, chain.objs.size()=1 2024-09-12T00:44:19.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.VA2Ueg3-oKFbN7mXGjsuoNX7uUtTKVU_0 2024-09-12T00:44:19.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4405199013687830053', time=2024-09-12T02:34:10.459444+0000, chain.objs.size()=5 2024-09-12T00:44:19.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-FROZEN.2~bFQAEIx1UCoLMaC_kEMrTNtFYjssFiN.1 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__shadow_foo-FROZEN.2~bFQAEIx1UCoLMaC_kEMrTNtFYjssFiN.1_1 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-FROZEN.2~bFQAEIx1UCoLMaC_kEMrTNtFYjssFiN.2 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__shadow_foo-FROZEN.2~bFQAEIx1UCoLMaC_kEMrTNtFYjssFiN.2_1 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15__multipart_foo-FROZEN.2~bFQAEIx1UCoLMaC_kEMrTNtFYjssFiN.3 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2080646953682668019', time=2024-09-12T02:36:10.969714+0000, chain.objs.size()=1 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.boMVvmZFuacXFKvgW-TSpsdrHdywCQa_0 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6571502175474328355', time=2024-09-12T02:36:11.080195+0000, chain.objs.size()=1 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.YnvIn97__t8IlSxUQx4nOOtyACaR04q_0 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12520866058652377399', time=2024-09-12T02:36:16.570178+0000, chain.objs.size()=1 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.W5RbeE9ZHf7kUpeQgfHlC_Wx3h70qp1_0 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17041039418342772566', time=2024-09-12T02:36:21.460061+0000, chain.objs.size()=1 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.pnAu-aD2VwIymt4VnGTrKfJQ2wlUCoa_0 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5524814910681453440', time=2024-09-12T02:36:21.462426+0000, chain.objs.size()=1 2024-09-12T00:44:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.JiMvTS4t3cj8vb1fvwodfVJ_VoFA1wG_0 2024-09-12T00:44:19.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4433919334705442844', time=2024-09-12T02:36:21.464378+0000, chain.objs.size()=1 2024-09-12T00:44:19.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.986+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.75GdMjDsoaqXAmqv08H780N7Og9nz2U_0 2024-09-12T00:44:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6560479515213504057', time=2024-09-12T02:37:02.853879+0000, chain.objs.size()=1 2024-09-12T00:44:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.A6BhQaj0z558K-GIuMuyYBB-bg-ST9L_0 2024-09-12T00:44:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12364651940735553791', time=2024-09-12T02:37:03.021071+0000, chain.objs.size()=1 2024-09-12T00:44:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.-k_uYg2pAW4Lhsst7Ii159yatXfqNQC_0 2024-09-12T00:44:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12081277171959794162', time=2024-09-12T02:37:03.052973+0000, chain.objs.size()=1 2024-09-12T00:44:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.F3EW5DN9Vsnx0jVx_gmVlrOfxcFzfx5_0 2024-09-12T00:44:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1975075416939147086', time=2024-09-12T02:37:07.372025+0000, chain.objs.size()=1 2024-09-12T00:44:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.N_xe3rqMzG5rF5-MVw0-ExlLUWK34Tf_0 2024-09-12T00:44:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16012507736565815211', time=2024-09-12T02:38:31.941102+0000, chain.objs.size()=1 2024-09-12T00:44:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.azQ3lpECREZEYY9ETzEoHM3LjJMs2S8_0 2024-09-12T00:44:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.139086165407761450', time=2024-09-12T02:38:32.050441+0000, chain.objs.size()=1 2024-09-12T00:44:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.oZAsmZ7TC6Bg-mSSvhnSrN4KFDhj2j7_0 2024-09-12T00:44:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9047018079863486693', time=2024-09-12T02:38:36.719630+0000, chain.objs.size()=1 2024-09-12T00:44:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.oHIqUve0d4wr7hM_uuOctKOjQ8cPRAq_0 2024-09-12T00:44:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16562936279263527921', time=2024-09-12T02:39:55.611482+0000, chain.objs.size()=1 2024-09-12T00:44:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.OECFNl2XEFrDTeuWfuel6m5sbY4G2h2_0 2024-09-12T00:44:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10451327594381155535', time=2024-09-12T02:40:43.359200+0000, chain.objs.size()=1 2024-09-12T00:44:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.TVx2f2ZPO6wsKYhvbA-esTJecNLbijN_0 2024-09-12T00:44:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13883943375489885477', time=2024-09-12T02:40:43.403023+0000, chain.objs.size()=1 2024-09-12T00:44:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.hcUmsvX_x6BtbVQLdAGF1bGeuaPHLfT_0 2024-09-12T00:44:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12531547090246120745', time=2024-09-12T02:40:48.775112+0000, chain.objs.size()=1 2024-09-12T00:44:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.BGbD2uqdv_ZPTts5_X7T2QMO28JpYIZ_0 2024-09-12T00:44:19.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4887961081985145305', time=2024-09-12T02:41:25.845805+0000, chain.objs.size()=1 2024-09-12T00:44:19.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.990+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.BCJ95bx4bLIog8Tv575mYZJjPcxkh35_0 2024-09-12T00:44:19.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:19.998+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:44:20.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:44:20.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15473035945192523776', time=2024-09-12T02:35:30.572740+0000, chain.objs.size()=1 2024-09-12T00:44:20.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.lsFtTP2qbtHBJFHaAyh3Nwc_0P0mYuY_0 2024-09-12T00:44:20.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10865608475998648322', time=2024-09-12T02:36:11.055826+0000, chain.objs.size()=1 2024-09-12T00:44:20.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.xQ4MkKmCiTCon78GnkkKXCSP3AQ6wda_0 2024-09-12T00:44:20.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.653174254462494638', time=2024-09-12T02:37:49.734366+0000, chain.objs.size()=1 2024-09-12T00:44:20.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.85_kFmIMxHFJDRFJmAQk-i7NEFlH2DU_0 2024-09-12T00:44:20.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162972900995461145', time=2024-09-12T02:37:49.836336+0000, chain.objs.size()=1 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.Hkii2M_2bmKQnlCZaOVSRRUwynM5rWF_0 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.892450674815814452', time=2024-09-12T02:37:49.914723+0000, chain.objs.size()=1 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.XjaU6Wq25QlWF3CpZct68lfiUfN7IIi_0 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13039394519361544412', time=2024-09-12T02:38:26.071955+0000, chain.objs.size()=1 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.Wi9Y9J_fu8X8SFdUGh6Qit5DxGvkoZi_0 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1953748856229149390', time=2024-09-12T02:38:32.065190+0000, chain.objs.size()=1 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.09NmwylUngoiWGA8w7bma8pCRWJHhMH_0 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16732618980999777320', time=2024-09-12T02:39:13.056446+0000, chain.objs.size()=1 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.5jAW0CdFYKT1Muls2ZDzQPJGsf8Xzmg_0 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11289398098777514067', time=2024-09-12T02:39:13.248952+0000, chain.objs.size()=1 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.EMF8VOIQ8457m3k-tlnoR6rkvd3JyO2_0 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4992792471960003911', time=2024-09-12T02:39:19.404701+0000, chain.objs.size()=1 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.nDFdtp04__QZRUFXcKg1TYc6KSsJNwe_0 2024-09-12T00:44:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13103059942717713227', time=2024-09-12T02:40:43.260188+0000, chain.objs.size()=1 2024-09-12T00:44:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.a9J6XUcraffYQToznhKMOX6uVP7gOW1_0 2024-09-12T00:44:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15050627541017600336', time=2024-09-12T02:40:48.972434+0000, chain.objs.size()=1 2024-09-12T00:44:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.002+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.6vRnH8d2j2YmLWY_cHeRk5taxRK2NOb_0 2024-09-12T00:44:20.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.006+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13326169842219828495', time=2024-09-12T02:40:53.277566+0000, chain.objs.size()=1 2024-09-12T00:44:20.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.006+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.-rW5dOLUt-2Kd_RknV6Nz8Pc_qaSj-l_0 2024-09-12T00:44:20.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.010+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:44:20.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:44:20.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.320307612566250072', time=2024-09-12T02:36:11.008173+0000, chain.objs.size()=1 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.z_YYrXGrSgnQ_vrT9B0Jg1geletFneP_0 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8034475702905334612', time=2024-09-12T02:36:16.786247+0000, chain.objs.size()=1 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.z3TIo5kAFclMji8mg3y5i8ixjicKE4s_0 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12285475707874031703', time=2024-09-12T02:36:57.511980+0000, chain.objs.size()=1 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.AqhHTWI3sfaJtCHz1wz6nZneWe22CVV_0 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1131913560485984609', time=2024-09-12T02:38:25.885955+0000, chain.objs.size()=1 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.r1wHu9zF57eQipxgNElSHmZpFM3fKbe_0 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6733685455585674153', time=2024-09-12T02:38:36.567309+0000, chain.objs.size()=1 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.O8x0D8k4OYdw1crF5-8xv0IZ-hQTtjF_0 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9829459891436971936', time=2024-09-12T02:38:36.606368+0000, chain.objs.size()=1 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.DBhhp-2matuvzYco4BGZ0uLHcgXFVaC_0 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15069128852278946819', time=2024-09-12T02:38:36.685080+0000, chain.objs.size()=1 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.nTkiVNQXcpz1b7wXYCvlIAzdmzbSR-l_0 2024-09-12T00:44:20.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10362624675844458415', time=2024-09-12T02:38:36.703145+0000, chain.objs.size()=1 2024-09-12T00:44:20.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.VBHcsWTxL8qhTDCJcsmJugRPZkipDkM_0 2024-09-12T00:44:20.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1811136628222371548', time=2024-09-12T02:39:19.369419+0000, chain.objs.size()=1 2024-09-12T00:44:20.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.NODkftD6FLOvLmmR2NX5ZyvhwPU3Ns9_0 2024-09-12T00:44:20.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7447036263365666721', time=2024-09-12T02:39:19.598488+0000, chain.objs.size()=1 2024-09-12T00:44:20.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.qqqKITeRjIVTZttV2YJc-5QUcuP0zz8_0 2024-09-12T00:44:20.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2931567475867936610', time=2024-09-12T02:40:48.948820+0000, chain.objs.size()=1 2024-09-12T00:44:20.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.014+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.XIDZWi-YQpXshBkjl7Z17GPHmZL3gqQ_0 2024-09-12T00:44:20.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.022+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.022+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:44:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:44:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10612524271981817302', time=2024-09-12T02:35:34.886132+0000, chain.objs.size()=1 2024-09-12T00:44:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.y5dOzC3mU1dkkV3w4S2uzM856qAorux_0 2024-09-12T00:44:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5977394053385045801', time=2024-09-12T02:35:35.097166+0000, chain.objs.size()=1 2024-09-12T00:44:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.2beBoIuhSsJuKXDLaXJLuwU0t54Lb6F_0 2024-09-12T00:44:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1247910666464344108', time=2024-09-12T02:36:11.239049+0000, chain.objs.size()=1 2024-09-12T00:44:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.1E4uKX6fXbgY5JQ9bBy-FY-BxOulkk9_0 2024-09-12T00:44:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.853462673091685367', time=2024-09-12T02:36:25.723523+0000, chain.objs.size()=1 2024-09-12T00:44:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.TFkMuqGrDhF4nHsQOIZeHbdi3Ugj4mt_0 2024-09-12T00:44:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7819924374399110222', time=2024-09-12T02:36:57.515939+0000, chain.objs.size()=1 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.yOK6oF75Wi0bz9z8YhyJ9P1q1FSeG1W_0 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3660223719094943443', time=2024-09-12T02:37:02.776218+0000, chain.objs.size()=1 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.SxakAnmmugvtSf-bQQR2yvjSvILnXeK_0 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17178592032201958156', time=2024-09-12T02:37:02.877737+0000, chain.objs.size()=1 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.s4-lwwUUK3ylIP_LEzLXqwwd1TZL3cL_0 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8197883195714986626', time=2024-09-12T02:37:07.607972+0000, chain.objs.size()=1 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.L9Ffu-_78gtP8vh59SCbOZAWtMnxlnN_0 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15315986376584417348', time=2024-09-12T02:38:25.921150+0000, chain.objs.size()=1 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.RpIigH1bP8Tajxna6aTs-dzPUljpM9R_0 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14957651775189324274', time=2024-09-12T02:38:26.051689+0000, chain.objs.size()=1 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.YFIrBYyu7YKRy4dwXjHz2AZOHLFgnnI_0 2024-09-12T00:44:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16413250629296741700', time=2024-09-12T02:38:36.464898+0000, chain.objs.size()=1 2024-09-12T00:44:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.PzBy72L7IP-fTqSJ1huX6W-dyc-Ynyr_0 2024-09-12T00:44:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5311518106842446167', time=2024-09-12T02:38:36.467825+0000, chain.objs.size()=1 2024-09-12T00:44:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.026+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_._FdPsaeT2r8xcZ99-tpwlFHzi4M2GE2_0 2024-09-12T00:44:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10243265690119215733', time=2024-09-12T02:38:36.551478+0000, chain.objs.size()=1 2024-09-12T00:44:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.k4mZPgMUkp35t3LsDlNTmK47U8Yj0D9_0 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2841802025647055544', time=2024-09-12T02:39:13.138612+0000, chain.objs.size()=1 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33__shadow_.d3BIxP8oub7Z2sdLvBnBSWPuXql1Ydx_0 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18323271671126629607', time=2024-09-12T02:40:37.436646+0000, chain.objs.size()=1 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.LkXY_Y3dBDuuTDv0k1e1D7b7u1DViEF_0 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11140071083533896105', time=2024-09-12T02:40:48.812973+0000, chain.objs.size()=1 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.fVDD4dCBc7cRMSV6m7Iuw610-_WLTpS_0 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11514885700043839924', time=2024-09-12T02:40:48.817054+0000, chain.objs.size()=1 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.0_x-BnpAmN5Vtzlf3ZbU1E2C32Stmh2_0 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14018705866565329575', time=2024-09-12T02:40:48.820517+0000, chain.objs.size()=1 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.PE9UiyPYyV09kGNAnm0uW55esCum7pu_0 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13130807063774969160', time=2024-09-12T02:41:25.632216+0000, chain.objs.size()=1 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.4iLjunZVPAw45ScySZOXBQTViFBp3Z5_0 2024-09-12T00:44:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10426975394512735837', time=2024-09-12T02:43:38.785724+0000, chain.objs.size()=1 2024-09-12T00:44:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.030+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.MBPzqiatd6bgXcw8WEYHGvCho8okPj-_0 2024-09-12T00:44:20.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.034+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.038+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:44:20.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.038+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.038+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:44:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_d4DW6mvUm7wcpsS2qzp6VVIbqtnw4uz', time=2024-09-12T02:34:10.240524+0000, chain.objs.size()=1 2024-09-12T00:44:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.BGVJdbLeESRKdXjH2n-ypVk3hXJ8qwx_0 2024-09-12T00:44:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_J41v_5Xy4r0QG7FXOz5m3CbugGJAotd', time=2024-09-12T02:34:10.312514+0000, chain.objs.size()=3 2024-09-12T00:44:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.dXu6J5kSJnuG7arjiAzFrte0ml3yFvz_0 2024-09-12T00:44:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.dXu6J5kSJnuG7arjiAzFrte0ml3yFvz_1 2024-09-12T00:44:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.dXu6J5kSJnuG7arjiAzFrte0ml3yFvz_2 2024-09-12T00:44:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14885762382882863317', time=2024-09-12T02:34:10.797691+0000, chain.objs.size()=1 2024-09-12T00:44:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9__shadow_.EpcXhaX0dNH-LRZYHoa8KBCbFmR4dmd_0 2024-09-12T00:44:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15981040169758522332', time=2024-09-12T02:35:28.927407+0000, chain.objs.size()=1 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.JDNs11z9TsPfjX50CDZFIMnsVq91TH4_0 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7669046573915764269', time=2024-09-12T02:35:30.579597+0000, chain.objs.size()=1 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.D1oyu8D7qnAx2yFzOUt_Ps7a3jdmvxD_0 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10845019448549261652', time=2024-09-12T02:35:30.736474+0000, chain.objs.size()=1 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.IyGJbBOtIypS6CdCPvKkREcYH5U1atc_0 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11359214846054130797', time=2024-09-12T02:36:11.194321+0000, chain.objs.size()=1 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.I4Ze2JmEuXyh8XAlSnP1to4esaLplZK_0 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15417734499226180891', time=2024-09-12T02:37:44.386635+0000, chain.objs.size()=1 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.USQEjRPj5U2gZPwDFbR92y_FJSNiLlq_0 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14907173516455701059', time=2024-09-12T02:37:49.732571+0000, chain.objs.size()=1 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.a4s1iwyLfQ0dzzp7sFR4kQuecVUWdg1_0 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12256011698859509588', time=2024-09-12T02:38:26.041917+0000, chain.objs.size()=1 2024-09-12T00:44:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.ijxZvLA33ybLFRQ-OUZ0Ymh_vOSkKma_0 2024-09-12T00:44:20.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11038691066092281745', time=2024-09-12T02:38:32.080126+0000, chain.objs.size()=1 2024-09-12T00:44:20.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.042+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.w-H9nPTVooXWR-w9eKxWWEf5Q6HPJXe_0 2024-09-12T00:44:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16338542855248078224', time=2024-09-12T02:39:19.423214+0000, chain.objs.size()=1 2024-09-12T00:44:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.NTHlIIadkX93f9SSfgcrKSu4VYBvwA__0 2024-09-12T00:44:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14810720191473640063', time=2024-09-12T02:40:01.439933+0000, chain.objs.size()=1 2024-09-12T00:44:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.AQequ8zs_0v_jK7W53f5L0R7RWw8baO_0 2024-09-12T00:44:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1108806092682699542', time=2024-09-12T02:40:01.442046+0000, chain.objs.size()=1 2024-09-12T00:44:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.OVnjeWTCop7SYGhb64wbjjQFxlGfb8S_0 2024-09-12T00:44:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17330771686114988087', time=2024-09-12T02:40:37.527272+0000, chain.objs.size()=1 2024-09-12T00:44:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.XSrIt0bb1s7Hr7_5lJv0G9msYMcADwQ_0 2024-09-12T00:44:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13145089079963533162', time=2024-09-12T02:40:48.869122+0000, chain.objs.size()=1 2024-09-12T00:44:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.EukbXx0Wej2ZKDS90h3H7pBv5MkY7Ry_0 2024-09-12T00:44:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15644879425377208522', time=2024-09-12T02:41:25.867200+0000, chain.objs.size()=1 2024-09-12T00:44:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.046+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.-kxHdkMFHPTTm_DR0KLRWxCQ7nr_v6J_0 2024-09-12T00:44:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.050+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.054+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:44:20.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.054+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:44:20.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10115152549794325198', time=2024-09-12T02:34:09.967662+0000, chain.objs.size()=4 2024-09-12T00:44:20.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13__multipart_foo.2~UK8-FJQIYzfCMy6eXUaGq6ugxjWanIk.1 2024-09-12T00:44:20.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13__multipart_foo.2~UK8-FJQIYzfCMy6eXUaGq6ugxjWanIk.2 2024-09-12T00:44:20.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13__multipart_foo.2~UK8-FJQIYzfCMy6eXUaGq6ugxjWanIk.3 2024-09-12T00:44:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13__multipart_foo.2~UK8-FJQIYzfCMy6eXUaGq6ugxjWanIk.4 2024-09-12T00:44:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2116958877782146242', time=2024-09-12T02:35:34.894037+0000, chain.objs.size()=1 2024-09-12T00:44:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.aiHWeMkPmQWWmk6Qkv2KQJpeGQWZgtI_0 2024-09-12T00:44:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5566522865612005436', time=2024-09-12T02:35:35.077844+0000, chain.objs.size()=1 2024-09-12T00:44:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.Z5dhKjwaeKkp6Zik7-Wg02glxJbV4Yy_0 2024-09-12T00:44:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2723453941400122588', time=2024-09-12T02:36:21.570528+0000, chain.objs.size()=1 2024-09-12T00:44:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.es_lAbJeDdVTm3vQj-w3XxwPiZpy-kB_0 2024-09-12T00:44:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12957470342772695011', time=2024-09-12T02:36:57.499828+0000, chain.objs.size()=1 2024-09-12T00:44:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.S-U614nod0_ages9uHklJ4rOMXZCANl_0 2024-09-12T00:44:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10876945399328280993', time=2024-09-12T02:37:53.788319+0000, chain.objs.size()=1 2024-09-12T00:44:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.bds7KA6HIq8nNadl1z-98-_Qk8Jsb0__0 2024-09-12T00:44:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2041167348302305015', time=2024-09-12T02:38:32.015970+0000, chain.objs.size()=1 2024-09-12T00:44:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.IIYUcPRkllu8Jp_EB_tfuKhTYNV8NVS_0 2024-09-12T00:44:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14451103373393005243', time=2024-09-12T02:39:19.366694+0000, chain.objs.size()=1 2024-09-12T00:44:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.0zb_DgvxNv0ANTeeWn0qpOFViRZiWux_0 2024-09-12T00:44:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10408581733154097338', time=2024-09-12T02:39:55.696572+0000, chain.objs.size()=1 2024-09-12T00:44:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.058+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.oaJNcoJOyivaeIcaj31c_VgL86zLqcM_0 2024-09-12T00:44:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.062+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14037506990364936194', time=2024-09-12T02:40:48.841593+0000, chain.objs.size()=1 2024-09-12T00:44:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.062+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.VXByQIEYmDd8kVP6OYYVcavOwflzAWc_0 2024-09-12T00:44:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.062+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10055726554327685739', time=2024-09-12T02:43:54.382865+0000, chain.objs.size()=1 2024-09-12T00:44:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.062+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19__shadow:RaeK69zkqI0RJXqtH5LgkgrcWTp412h_.CIX857wkhMe_VueUJGzOARdtl0KFltq_0 2024-09-12T00:44:20.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.062+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.066+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:44:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.066+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:44:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2519118478709484508', time=2024-09-12T02:34:10.353511+0000, chain.objs.size()=3 2024-09-12T00:44:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.1 2024-09-12T00:44:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.2 2024-09-12T00:44:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-STANDARD.2~6JKcxyuImde4-P12-mBO-bvR79bXrKk.3 2024-09-12T00:44:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14342746313811713144', time=2024-09-12T02:35:30.579392+0000, chain.objs.size()=1 2024-09-12T00:44:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.2EVTI2WwxBI3RTLhg7m8Uu80r1hML9h_0 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1708544149204929788', time=2024-09-12T02:35:34.966551+0000, chain.objs.size()=1 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.FqHCQxu1PXTAdptl7NUN_sWTclql6Qy_0 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4871892036179519235', time=2024-09-12T02:36:11.087992+0000, chain.objs.size()=1 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.7GArqbA9uiB2jgCcQolaEfHdHqbPQQD_0 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2236288958151291544', time=2024-09-12T02:36:16.577778+0000, chain.objs.size()=1 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.s5AZX5RYQNEI7ef2J8m9zP9rFPFAdCy_0 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10453322564319597946', time=2024-09-12T02:36:16.646412+0000, chain.objs.size()=1 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.PPzdZR9h1vAslGzMht2PK3X3NB_ykN-_0 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14774600535237252995', time=2024-09-12T02:36:21.465167+0000, chain.objs.size()=1 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.-rL_P_Fdhkfn108hma-Ce7KqL4LSm6c_0 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14327527463435463386', time=2024-09-12T02:36:57.650493+0000, chain.objs.size()=1 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.AwIBIuRv5QIX0CGA8QOPKZyDbCte9hp_0 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18152121691853267575', time=2024-09-12T02:37:07.427350+0000, chain.objs.size()=1 2024-09-12T00:44:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.iDmN9yercvAiXGZQh2TxwvaQ2bD934n_0 2024-09-12T00:44:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1759003488459562073', time=2024-09-12T02:37:44.386854+0000, chain.objs.size()=1 2024-09-12T00:44:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.070+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.rBozmxyjVA7TaAsIg33GKFxFOxGewDy_0 2024-09-12T00:44:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13272595566442937562', time=2024-09-12T02:38:36.606231+0000, chain.objs.size()=1 2024-09-12T00:44:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.6jN1cvV_0zdfN0RZNwISvPzn5i14lSm_0 2024-09-12T00:44:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10413188763728703487', time=2024-09-12T02:40:01.372049+0000, chain.objs.size()=1 2024-09-12T00:44:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.mhi27nZxaDwZGOKNsmPSLAeG4IY_Dzu_0 2024-09-12T00:44:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11841597730196426226', time=2024-09-12T02:40:01.439814+0000, chain.objs.size()=1 2024-09-12T00:44:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.2RyW3VKZdDtat8plMGhqDggjE01t7NP_0 2024-09-12T00:44:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2770689044949423531', time=2024-09-12T02:40:01.499402+0000, chain.objs.size()=1 2024-09-12T00:44:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.R8xkygo55HoxDa70gRFCQ5IjIWVaR9z_0 2024-09-12T00:44:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9819750135643179560', time=2024-09-12T02:40:01.556363+0000, chain.objs.size()=1 2024-09-12T00:44:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.HY2z3r6c550k_71c8kiggRW834gUh2t_0 2024-09-12T00:44:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18381119973172848179', time=2024-09-12T02:40:43.331296+0000, chain.objs.size()=1 2024-09-12T00:44:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.074+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.SBdnSCJbej-ZA6m9XYX5tRf7H8ALWgX_0 2024-09-12T00:44:20.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.078+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.082+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:44:20.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.082+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:44:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1577802116135324901', time=2024-09-12T02:34:09.903112+0000, chain.objs.size()=4 2024-09-12T00:44:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12__multipart_foo.2~b10p9vcnypOkW1PsNntLd1bQWfVC14U.1 2024-09-12T00:44:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12__multipart_foo.2~b10p9vcnypOkW1PsNntLd1bQWfVC14U.2 2024-09-12T00:44:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12__multipart_foo.2~b10p9vcnypOkW1PsNntLd1bQWfVC14U.3 2024-09-12T00:44:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12__multipart_foo.2~b10p9vcnypOkW1PsNntLd1bQWfVC14U.4 2024-09-12T00:44:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14809247830802971985', time=2024-09-12T02:35:30.649048+0000, chain.objs.size()=1 2024-09-12T00:44:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.7EIzIerw4lzdppEsLHUGwYrnnKQMEw5_0 2024-09-12T00:44:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13945427245478236623', time=2024-09-12T02:36:21.421875+0000, chain.objs.size()=1 2024-09-12T00:44:20.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.gJkk4CVSPtX6kWhQ0f77LSohjHcaT4r_0 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11536906229820259088', time=2024-09-12T02:36:21.503711+0000, chain.objs.size()=1 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.-nmxz0bhzHw27eRPaP7emZNDbVR8G9x_0 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17505918112191624337', time=2024-09-12T02:36:21.560939+0000, chain.objs.size()=1 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.liVddkR4JmfrQh0tCskb6YAaAngLaqV_0 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5273143233677685818', time=2024-09-12T02:37:07.339172+0000, chain.objs.size()=1 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.vCDIqQVQElqtosdLy_y-xjctAnKwHuK_0 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.657894103973399142', time=2024-09-12T02:37:44.506394+0000, chain.objs.size()=1 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.6PlLydU7m3s3A4Ff_vXQfW1EQUQcKF2_0 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7780375451999125284', time=2024-09-12T02:38:25.815687+0000, chain.objs.size()=1 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.vctdW7thm4ZTl9uJRLi0bV5Zj0Vf4bL_0 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11325005760840882787', time=2024-09-12T02:38:31.959000+0000, chain.objs.size()=1 2024-09-12T00:44:20.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.086+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.LFsb1hRgWDtkhBvEJz-TI6g2IlIMbat_0 2024-09-12T00:44:20.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.090+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1862017148150882523', time=2024-09-12T02:39:19.433707+0000, chain.objs.size()=1 2024-09-12T00:44:20.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.090+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.x7JvQ_IBKiBpriI2A2XjrF9eaYbAToa_0 2024-09-12T00:44:20.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.090+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17267022424341134152', time=2024-09-12T02:40:37.558340+0000, chain.objs.size()=1 2024-09-12T00:44:20.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.090+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.W9hPHBDZbM2sMrLotu_F72odoW77l2Y_0 2024-09-12T00:44:20.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.090+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17968357466718246707', time=2024-09-12T02:40:43.454182+0000, chain.objs.size()=1 2024-09-12T00:44:20.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.090+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.Umr2yEUiLUMGZqDubltoZji5lx6Q4kx_0 2024-09-12T00:44:20.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.090+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13504845281561086753', time=2024-09-12T02:43:38.798273+0000, chain.objs.size()=1 2024-09-12T00:44:20.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.090+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.4LkqLauqc7OE06q3ZlgrLC5mpxMY95v_0 2024-09-12T00:44:20.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.094+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:44:20.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:44:20.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11949667394087077435', time=2024-09-12T02:34:09.797544+0000, chain.objs.size()=1 2024-09-12T00:44:20.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5__shadow_.Psz0S1bKVT9sdpn9efJu7XS75xieRVG_0 2024-09-12T00:44:20.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3870916058006906045', time=2024-09-12T02:34:10.412870+0000, chain.objs.size()=5 2024-09-12T00:44:20.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.1 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.1_1 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.2 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.2_1 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__multipart_foo-FROZEN.2~Kb4HRGJC72J9p3XjxmBqhuvePUl0j_J.3 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.268379715864251972', time=2024-09-12T02:36:21.503364+0000, chain.objs.size()=1 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.boXMVkRyPblllEgRD_rmXd8nfWUI5fk_0 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9077830628967557812', time=2024-09-12T02:36:21.573832+0000, chain.objs.size()=1 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.cfUxRk6m68vap4waYdsjY2hvyjf8Lzi_0 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2096266819703525991', time=2024-09-12T02:36:21.666539+0000, chain.objs.size()=1 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.tLKZ4yKNUThxhV5uwkL4z3IOK15KBuF_0 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3914497881030354876', time=2024-09-12T02:37:02.964860+0000, chain.objs.size()=1 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.tKdYGI8jXni12j0VMs88op4wE-4_PNE_0 2024-09-12T00:44:20.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6900697373285889335', time=2024-09-12T02:38:25.995206+0000, chain.objs.size()=1 2024-09-12T00:44:20.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.oUzcnIBAsu44-QICn-hgTxX9sRHBHVZ_0 2024-09-12T00:44:20.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6037863130624266385', time=2024-09-12T02:38:31.944899+0000, chain.objs.size()=1 2024-09-12T00:44:20.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.098+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.Uix3_7JaIcHU9rUEwd8QOAcpghggtpR_0 2024-09-12T00:44:20.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.102+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5888018636491456307', time=2024-09-12T02:39:19.517085+0000, chain.objs.size()=1 2024-09-12T00:44:20.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.102+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.xx7zk58AG0O_PbigrVtz8P17lbbae6C_0 2024-09-12T00:44:20.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.102+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12309286361815682514', time=2024-09-12T02:39:55.445227+0000, chain.objs.size()=1 2024-09-12T00:44:20.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.102+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.wYsSxPie5kgI1ZnRLJCextEnj68tXli_0 2024-09-12T00:44:20.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.102+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13182336569077912612', time=2024-09-12T02:40:37.391395+0000, chain.objs.size()=1 2024-09-12T00:44:20.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.102+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.IaqC-ciIxxnbc7kg9mJzPaB4EWIZcI-_0 2024-09-12T00:44:20.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.102+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7996464768789861432', time=2024-09-12T02:40:48.731267+0000, chain.objs.size()=1 2024-09-12T00:44:20.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.102+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.iEsDLYotKsSCTdIwJ4TQF3_1C8ZxlqJ_0 2024-09-12T00:44:20.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.106+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.110+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:44:20.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.110+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13975625676025230173', time=2024-09-12T02:34:10.702996+0000, chain.objs.size()=1 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8__shadow_.8MMdnXpFDxi84s7rw5JZhk8fkpBUrQt_0 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5512145716725703693', time=2024-09-12T02:36:11.055700+0000, chain.objs.size()=1 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.rJmSWLLCmDXYvoPDPtrljVHKhGZwj91_0 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16118222795059627846', time=2024-09-12T02:36:16.695733+0000, chain.objs.size()=1 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.46yhDxSv44FdHpW4QtKkIhZc7ru8qCw_0 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13158561129848690095', time=2024-09-12T02:36:57.649978+0000, chain.objs.size()=1 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.r7nyx2ZzISnMZq0-EHWDDzXBjvoyExS_0 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6970892003332234563', time=2024-09-12T02:36:57.724187+0000, chain.objs.size()=1 2024-09-12T00:44:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.9ExAVW6YHA7-Z64nxLJbMRaE1ZKudT7_0 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6831366072781690967', time=2024-09-12T02:36:57.761866+0000, chain.objs.size()=1 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.5XIFgAmDHWiMKVjNlhcYHTMPsYz4IfM_0 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9577174145268637164', time=2024-09-12T02:37:02.857336+0000, chain.objs.size()=1 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.L7rR8y-zZLP5eroRXzQzILIW0trlC9__0 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15981255828196530757', time=2024-09-12T02:37:03.002349+0000, chain.objs.size()=1 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.F2ca_f3DhFqTePc0zRRa6Whz7VjdXb3_0 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5915900358582122180', time=2024-09-12T02:37:03.032045+0000, chain.objs.size()=1 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26__shadow_.lDkygIWZsqxMAtp_yRP-QVJ8XNcVY2U_0 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17426038841369267762', time=2024-09-12T02:37:07.516862+0000, chain.objs.size()=1 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.4wjNQ4hC2bXlAnHm02xte_xgC9KQOEk_0 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8960018681093752636', time=2024-09-12T02:39:19.404508+0000, chain.objs.size()=1 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.m4IK8VNnhsPPIi-DF0ffoZepwDmRD6l_0 2024-09-12T00:44:20.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8757066356872461843', time=2024-09-12T02:39:55.712150+0000, chain.objs.size()=1 2024-09-12T00:44:20.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.114+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.8hYjqYdQoDLHT0gcnXh3or1PY5romhe_0 2024-09-12T00:44:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.118+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13948707896020468275', time=2024-09-12T02:40:01.365961+0000, chain.objs.size()=1 2024-09-12T00:44:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.118+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.Un3kWinPs5VCidTs7YkOxtByoo_xYI6_0 2024-09-12T00:44:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.118+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18127464609198018208', time=2024-09-12T02:40:01.431326+0000, chain.objs.size()=1 2024-09-12T00:44:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.118+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.Sw3-SQjMIfbqNgnLmwYRSqH1Xvt4eQZ_0 2024-09-12T00:44:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.118+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4810735831810303635', time=2024-09-12T02:40:37.432222+0000, chain.objs.size()=1 2024-09-12T00:44:20.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.118+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.axsbz3f_dRie6Ggact6jiZjvlp_cMX__0 2024-09-12T00:44:20.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.118+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18258223790058740300', time=2024-09-12T02:43:38.826542+0000, chain.objs.size()=1 2024-09-12T00:44:20.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.118+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.Wh2Hf-A88sDJBDEFUNAfCOZUVg4xfm9_0 2024-09-12T00:44:20.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.122+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:44:20.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11424174952335987829', time=2024-09-12T02:35:30.528539+0000, chain.objs.size()=1 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.FJwxK1TkfVOUWHgoL8Ht0yC0uzsSdRv_0 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7490508787206042858', time=2024-09-12T02:36:16.691110+0000, chain.objs.size()=1 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.zUrDiOoqDU6Zd01IufsC6pTQ17anisN_0 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7739243085172523131', time=2024-09-12T02:36:16.693156+0000, chain.objs.size()=1 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.ccDjj6JAHiOWFhe1uJHLnk9pG3O5C39_0 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3055721873055039860', time=2024-09-12T02:36:57.636618+0000, chain.objs.size()=1 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.2vxGS8TfPZUhq5XhAL6XO0LST2u8fd3_0 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2448649140405157908', time=2024-09-12T02:37:07.505100+0000, chain.objs.size()=1 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.v-LwFlI6QsKf0TTUNu9aDC8CBRu3kuE_0 2024-09-12T00:44:20.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9478948460245108543', time=2024-09-12T02:37:07.507139+0000, chain.objs.size()=1 2024-09-12T00:44:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.27__shadow_.a86fYvZehZXVIleO-jhbJ5oeRJng8v8_0 2024-09-12T00:44:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11169456878434419507', time=2024-09-12T02:40:01.404578+0000, chain.objs.size()=1 2024-09-12T00:44:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.PUO6BImWTIm1QlL-DISZMCKeGLEO3jX_0 2024-09-12T00:44:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6190640637925959669', time=2024-09-12T02:40:37.525340+0000, chain.objs.size()=1 2024-09-12T00:44:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.-6Tm4lt_pnuiVjPCCzBjBuMa0vejo6e_0 2024-09-12T00:44:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12845994831210902703', time=2024-09-12T02:43:38.761137+0000, chain.objs.size()=1 2024-09-12T00:44:20.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.126+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.vqT6RSwKUzMeJlO9dPb4-VG7RX4x2e__0 2024-09-12T00:44:20.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.134+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.134+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:44:20.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.134+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.134+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:44:20.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_5vwNy4MIl_8JUZdS-FOZPdDmqlrG4Af', time=2024-09-12T02:34:10.175109+0000, chain.objs.size()=2 2024-09-12T00:44:20.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.ianXGxFJwM3pdJOodBGB-eHZmrcUOpa_0 2024-09-12T00:44:20.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16__shadow_.ianXGxFJwM3pdJOodBGB-eHZmrcUOpa_1 2024-09-12T00:44:20.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4418947399636294926', time=2024-09-12T02:35:30.571697+0000, chain.objs.size()=1 2024-09-12T00:44:20.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.20__shadow_.w7h5Y1zTym_nXcxWOVAXH3vTsLDItk8_0 2024-09-12T00:44:20.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.718795277631301015', time=2024-09-12T02:36:16.673751+0000, chain.objs.size()=1 2024-09-12T00:44:20.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.23__shadow_.cSDtAOi07j-y9pHrM39QBtde15Q88Ak_0 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.309541011669456488', time=2024-09-12T02:36:21.678769+0000, chain.objs.size()=1 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.Yvsu8t1mO_uoKZopBhXz-Cv0Y5snF4B_0 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7463976502860115343', time=2024-09-12T02:36:57.647608+0000, chain.objs.size()=1 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_._M6_rJJf-irRui6g9NWFWEGtS68LunV_0 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16580564406103131921', time=2024-09-12T02:37:44.353836+0000, chain.objs.size()=1 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.WpGs2h477VlmxDmg1nm1Mdm5qv-QHMO_0 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16298410607300011284', time=2024-09-12T02:37:44.454404+0000, chain.objs.size()=1 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.28__shadow_.dryaxt2_Ia0MvLbi4JnSj51K_0Olok__0 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10131018996112197536', time=2024-09-12T02:37:49.815101+0000, chain.objs.size()=1 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.B9T-0qMqzBwE11NQ60b7pXvryQMiXNi_0 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.529470430787970289', time=2024-09-12T02:37:49.890382+0000, chain.objs.size()=1 2024-09-12T00:44:20.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.29__shadow_.Y6OhQufK3x9UVeTkHFHzkIA2Gu5np-E_0 2024-09-12T00:44:20.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9851497081521922280', time=2024-09-12T02:38:31.901418+0000, chain.objs.size()=1 2024-09-12T00:44:20.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.HUGh4JFMi_JWEsnNJDrM5bwauemefFz_0 2024-09-12T00:44:20.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2052651147777936974', time=2024-09-12T02:38:31.968711+0000, chain.objs.size()=1 2024-09-12T00:44:20.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.-1dOtiHsOm_O55W9YGe1ddqStO-Kdan_0 2024-09-12T00:44:20.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12009484719971282078', time=2024-09-12T02:39:55.592480+0000, chain.objs.size()=1 2024-09-12T00:44:20.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.138+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.BkM-l-o9O3_Oay8NR0LbK6DrbvbS05F_0 2024-09-12T00:44:20.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17309989997809977781', time=2024-09-12T02:39:55.595033+0000, chain.objs.size()=1 2024-09-12T00:44:20.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.35__shadow_.iAAq7SjkP6ilK_2Flw4aIZ58gmylNqM_0 2024-09-12T00:44:20.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4260694234334214276', time=2024-09-12T02:40:37.497566+0000, chain.objs.size()=1 2024-09-12T00:44:20.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.pW0dweOEBiE7d4_YD1SZpZPKhb0ZfbI_0 2024-09-12T00:44:20.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.138892913989496433', time=2024-09-12T02:40:37.627368+0000, chain.objs.size()=1 2024-09-12T00:44:20.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.Kjx1tw5YzDXcDJWv_bwtc33_RZ4oGk2_0 2024-09-12T00:44:20.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14561236989231650129', time=2024-09-12T02:40:43.466906+0000, chain.objs.size()=1 2024-09-12T00:44:20.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.38__shadow_.kO0RHJIO1KTsscm9T3wpjolmRhpqxLS_0 2024-09-12T00:44:20.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3947348470341953774', time=2024-09-12T02:41:25.713978+0000, chain.objs.size()=1 2024-09-12T00:44:20.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.mvNLAGgNYsW8TSHXZvb8vE34n6tD1Sr_0 2024-09-12T00:44:20.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13906063362454784430', time=2024-09-12T02:41:25.716230+0000, chain.objs.size()=1 2024-09-12T00:44:20.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.A8axJQHkOQ9CJ-G52A7XTj3Xh0MiG29_0 2024-09-12T00:44:20.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13177205750257783433', time=2024-09-12T02:43:38.666776+0000, chain.objs.size()=1 2024-09-12T00:44:20.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18__shadow_.qmTr3MMh4TVloN9cmf6J3VPWRDJwemn_0 2024-09-12T00:44:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18216909506321264064', time=2024-09-12T02:43:48.300674+0000, chain.objs.size()=1 2024-09-12T00:44:20.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.142+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19__shadow:JCU7TvmM13U1ScpLylpwV.QIWhiVdcA_.1tYEXBK73buPIuHSmBXsXOaX2tzu25S_0 2024-09-12T00:44:20.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.146+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:44:20.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:44:20.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Nr5HWU4fHMmgoONQaSq83TryPwxRnwb', time=2024-09-12T02:34:10.299010+0000, chain.objs.size()=1 2024-09-12T00:44:20.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.-LpWt4zCZX7NWX-TP7NzP6fYAU_mZfT_0 2024-09-12T00:44:20.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14768603234344295146', time=2024-09-12T02:35:34.858878+0000, chain.objs.size()=1 2024-09-12T00:44:20.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.aSVZBxk5YwoYOucv1aQ8qICiQrgCuzK_0 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3503957339607078821', time=2024-09-12T02:35:34.860433+0000, chain.objs.size()=1 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.21__shadow_.aa4UoOIZhk6vSAu2jbjFD3OVnttWmt6_0 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12112020129164185363', time=2024-09-12T02:36:57.796384+0000, chain.objs.size()=1 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.25__shadow_.q7A5S7zBLAVJvL2Afir_T_62zJoz9qA_0 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.991804922867472669', time=2024-09-12T02:38:25.911838+0000, chain.objs.size()=1 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.30__shadow_.k8urabNa90a_Yd1Zr6Jh-ARI2MLK-PA_0 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2308696885917150687', time=2024-09-12T02:38:31.857913+0000, chain.objs.size()=1 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.SVPhQx18jRKd2SFdv_u6lMi28lwFZL9_0 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3577932923376241529', time=2024-09-12T02:38:31.944191+0000, chain.objs.size()=1 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.mwRry-NSlnub4FDHOgTDxY3UAi2zIJ8_0 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1190507584212058302', time=2024-09-12T02:38:36.540836+0000, chain.objs.size()=1 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.32__shadow_.YALlrzk-RJaghrR6RhLLudRjMVbW_Wz_0 2024-09-12T00:44:20.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12418065583478543518', time=2024-09-12T02:39:19.361364+0000, chain.objs.size()=1 2024-09-12T00:44:20.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.l9XKytr3A0bl0SBZULtkujbJTOr3lV3_0 2024-09-12T00:44:20.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7968895411377620286', time=2024-09-12T02:39:19.571131+0000, chain.objs.size()=1 2024-09-12T00:44:20.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.34__shadow_.WnSRU5EWnEjNsrWguNGqFKrfoK9xfi3_0 2024-09-12T00:44:20.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.272473637713087860', time=2024-09-12T02:40:01.477318+0000, chain.objs.size()=1 2024-09-12T00:44:20.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.36__shadow_.WklBUooDlV5YWgXl9b9vlQwOdW7ZsQ3_0 2024-09-12T00:44:20.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12456143347808114058', time=2024-09-12T02:40:48.917124+0000, chain.objs.size()=1 2024-09-12T00:44:20.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.150+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.39__shadow_.g0TJuSv_-jv7Tnl3_U19Ea-7xT7KxyX_0 2024-09-12T00:44:20.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.158+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:44:20.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:44:20.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='_vFc5908twqob9iIend3LaPVLcgo7ytX', time=2024-09-12T02:34:10.363931+0000, chain.objs.size()=3 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.2xXYcTM8sQuJ_As-s1wqgJ_Ek8YEp8K_0 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.2xXYcTM8sQuJ_As-s1wqgJ_Ek8YEp8K_1 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17__shadow_.2xXYcTM8sQuJ_As-s1wqgJ_Ek8YEp8K_2 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14552198615094514567', time=2024-09-12T02:36:11.134836+0000, chain.objs.size()=1 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22__shadow_.dDyiqhcF0RyItzerdeDlS5dukELacYe_0 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15194041048688436056', time=2024-09-12T02:36:21.694298+0000, chain.objs.size()=1 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.24__shadow_.0AUPZEunxrzCtjOKjdT_9aERADRtcC6_0 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4554786239413854378', time=2024-09-12T02:38:31.912848+0000, chain.objs.size()=1 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.J3m6RO-WDD61wVgjlgCpaL-b2JV0vfP_0 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15480579998319358882', time=2024-09-12T02:38:31.914670+0000, chain.objs.size()=1 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.w7m-hawDOm_uGNmkAGy6430u2UNU85A_0 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12495456715178393526', time=2024-09-12T02:38:32.016044+0000, chain.objs.size()=1 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.31__shadow_.k7hHuTcgh8nRp8fTl2xSozbfCtbAAfo_0 2024-09-12T00:44:20.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16874769350379112552', time=2024-09-12T02:40:37.470657+0000, chain.objs.size()=1 2024-09-12T00:44:20.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37__shadow_.n6PpaDLwFw09SR_u9CQUSrMSsG6vQn5_0 2024-09-12T00:44:20.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5659569483922727327', time=2024-09-12T02:41:25.737617+0000, chain.objs.size()=1 2024-09-12T00:44:20.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.162+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.40__shadow_.ZztnUtIQdW0VUT3wIdINIHDYnbtRRFx_0 2024-09-12T00:44:20.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.170+0000 7f2ccc41d9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:44:20.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.174+0000 7f2b7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.174+0000 7f2ccc41d9c0 20 remove_watcher() i=0 2024-09-12T00:44:20.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.174+0000 7f2ccc41d9c0 2 removed watcher, disabling cache 2024-09-12T00:44:20.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.178+0000 7f2ccc41d9c0 20 remove_watcher() i=1 2024-09-12T00:44:20.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.178+0000 7f2ccc41d9c0 20 remove_watcher() i=2 2024-09-12T00:44:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.178+0000 7f2ccc41d9c0 20 remove_watcher() i=3 2024-09-12T00:44:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.178+0000 7f2ccc41d9c0 20 remove_watcher() i=4 2024-09-12T00:44:20.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.182+0000 7f2ccc41d9c0 20 remove_watcher() i=5 2024-09-12T00:44:20.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.182+0000 7f2ccc41d9c0 20 remove_watcher() i=6 2024-09-12T00:44:20.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.182+0000 7f2ccc41d9c0 20 remove_watcher() i=7 2024-09-12T00:44:20.196 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T00:44:20.263 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:20.263 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:20.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.302+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.302+0000 7f1db3ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.302+0000 7f1db3ea89c0 20 realm 2024-09-12T00:44:20.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.302+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.302+0000 7f1db3ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.302+0000 7f1db3ea89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:20.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.302+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.302+0000 7f1db3ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.302+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.306+0000 7f1db3ea89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:20.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.306+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.306+0000 7f1db3ea89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:20.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.306+0000 7f1db3ea89c0 20 searching for the correct realm 2024-09-12T00:44:20.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.310+0000 7f1db11ad640 0 -- 172.21.15.102:0/839910937 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f1dac051060 msgr2=0x7f1dac003420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:20.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.522+0000 7f1db21af640 0 -- 172.21.15.102:0/839910937 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x5641d58ce750 msgr2=0x5641d58d0b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:20.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.538+0000 7f1db3ea89c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:44:20.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.538+0000 7f1db3ea89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:20.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.538+0000 7f1db3ea89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:20.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.538+0000 7f1db3ea89c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:44:20.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.538+0000 7f1db3ea89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:20.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.538+0000 7f1db3ea89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:20.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.538+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:20.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:20.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 zone default found 2024-09-12T00:44:20.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 4 Realm: () 2024-09-12T00:44:20.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:44:20.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:44:20.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:20.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 zonegroup default 2024-09-12T00:44:20.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados->read ofs=0 len=0 2024-09-12T00:44:20.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:20.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 started sync module instance, tier type = 2024-09-12T00:44:20.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.542+0000 7f1db3ea89c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:44:20.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.562+0000 7f1db3ea89c0 20 add_watcher() i=0 2024-09-12T00:44:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.562+0000 7f1db3ea89c0 20 add_watcher() i=1 2024-09-12T00:44:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.562+0000 7f1db3ea89c0 20 add_watcher() i=2 2024-09-12T00:44:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.562+0000 7f1db3ea89c0 20 add_watcher() i=3 2024-09-12T00:44:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.562+0000 7f1db3ea89c0 20 add_watcher() i=4 2024-09-12T00:44:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.562+0000 7f1db3ea89c0 20 add_watcher() i=5 2024-09-12T00:44:20.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.562+0000 7f1db3ea89c0 20 add_watcher() i=6 2024-09-12T00:44:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.566+0000 7f1db3ea89c0 20 add_watcher() i=7 2024-09-12T00:44:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.566+0000 7f1db3ea89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:20.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.570+0000 7f1c67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:20.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.570+0000 7f1db3ea89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:20.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.570+0000 7f1db3ea89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:20.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.650+0000 7f1c66fe5640 20 reqs_thread_entry: start 2024-09-12T00:44:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.654+0000 7f1db3ea89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:44:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.654+0000 7f1db3ea89c0 20 Filter name: none 2024-09-12T00:44:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.654+0000 7f1c64fe1640 20 reqs_thread_entry: start 2024-09-12T00:44:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.654+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:44:20.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.654+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.658+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.658+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.662+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:44:20.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.662+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.662+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.662+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.666+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:44:20.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.670+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.670+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.670+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.674+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:44:20.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.678+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.678+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.678+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.682+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:44:20.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.686+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.686+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.690+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.690+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:44:20.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.694+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.694+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.694+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.698+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:44:20.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.702+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.702+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.702+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.706+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:44:20.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.710+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.710+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.710+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.710+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:44:20.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.714+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.714+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.714+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.718+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:44:20.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.718+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.722+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.722+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.726+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:44:20.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.730+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.730+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.734+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.734+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:44:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.738+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.738+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.738+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.742+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:44:20.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.746+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.746+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.746+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.750+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:44:20.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.754+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.754+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.754+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.758+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:44:20.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.758+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.762+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.762+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.766+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:44:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.770+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.770+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.770+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.774+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:44:20.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.778+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.778+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.778+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.782+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:44:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.786+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.790+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.790+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.794+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:44:20.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.798+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.798+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.798+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.802+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:44:20.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.806+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.806+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.806+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.810+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:44:20.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.814+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.818+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.818+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.822+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:44:20.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.826+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.826+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.826+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.830+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:44:20.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.834+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.834+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.834+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.838+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:44:20.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.842+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.842+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.842+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.846+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:44:20.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.850+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.850+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.850+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.854+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:44:20.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.854+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.858+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.858+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.858+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:44:20.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.862+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.866+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.866+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.870+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:44:20.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.874+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.874+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.874+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.878+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:44:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.878+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.882+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.882+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.886+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:44:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.886+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.890+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.890+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.890+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:44:20.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.894+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.898+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.898+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.898+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:44:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.902+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.906+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:44:20.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.906+0000 7f1db3ea89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:44:20.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.910+0000 7f1c67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:20.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.914+0000 7f1db3ea89c0 20 remove_watcher() i=0 2024-09-12T00:44:20.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.914+0000 7f1db3ea89c0 2 removed watcher, disabling cache 2024-09-12T00:44:20.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.918+0000 7f1db3ea89c0 20 remove_watcher() i=1 2024-09-12T00:44:20.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.918+0000 7f1db3ea89c0 20 remove_watcher() i=2 2024-09-12T00:44:20.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.922+0000 7f1db3ea89c0 20 remove_watcher() i=3 2024-09-12T00:44:20.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.926+0000 7f1db3ea89c0 20 remove_watcher() i=4 2024-09-12T00:44:20.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.926+0000 7f1db3ea89c0 20 remove_watcher() i=5 2024-09-12T00:44:20.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.926+0000 7f1db3ea89c0 20 remove_watcher() i=6 2024-09-12T00:44:20.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:44:20.930+0000 7f1db3ea89c0 20 remove_watcher() i=7 2024-09-12T00:44:20.953 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:44:21.559 INFO:teuthology.orchestra.run.smithi102.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:44:26.157 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:44:44.656 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :compileJava 2024-09-12T00:44:44.657 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :processResources 2024-09-12T00:44:44.657 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :classes 2024-09-12T00:44:45.456 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:45.456 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :compileTestJava 2024-09-12T00:44:45.456 INFO:teuthology.orchestra.run.smithi102.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:44:45.457 INFO:teuthology.orchestra.run.smithi102.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:44:45.457 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:45.458 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:44:45.458 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :testClasses 2024-09-12T00:44:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:51.856 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :test 2024-09-12T00:44:51.856 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:44:51.857 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:45:02.756 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:02.756 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:45:03.556 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:03.556 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:45:03.856 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:03.856 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:45:04.556 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:04.556 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:45:25.956 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:25.957 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:45:26.856 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:26.856 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:45:26.956 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:26.956 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:45:27.156 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:27.156 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:45:27.356 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:27.356 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:45:28.158 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:28.158 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:45:40.956 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:40.957 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:45:42.556 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:42.556 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:45:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:45:43.056 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:45:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12 00:45:42,991 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:46:42.357 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:46:42.358 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:46:43.856 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:46:43.857 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:46:44.056 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:46:44.057 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:46:44.956 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:46:44.957 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:46:45.257 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:46:45.257 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:46:46.656 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:46:46.657 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:46:59.257 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:46:59.257 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:47:00.157 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:47:00.157 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:47:00.157 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:47:00.157 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:47:00.357 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:47:00.357 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:47:19.057 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:47:19.057 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:47:24.958 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:47:24.959 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-12T00:47:24.959 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12 00:47:24,903 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:47:24.959 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12 00:47:24,912 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:47:24.959 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12 00:47:24,933 [s3-transfer-manager-worker-7] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:47:24.959 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12 00:47:24,948 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:47:25.857 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:47:25.857 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:47:56.158 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:47:56.158 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:47:57.357 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:47:57.357 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:48:03.457 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:48:03.457 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:48:04.357 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:48:04.357 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:51:02.758 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:51:02.759 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:51:03.557 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:51:03.557 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T00:51:28.957 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:51:28.958 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T00:51:29.857 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:51:29.857 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T00:51:41.258 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:51:41.258 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T00:51:42.057 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:51:42.057 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T00:51:46.757 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:51:46.757 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T00:52:06.757 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:06.758 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T00:52:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:06.958 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T00:52:07.857 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:07.857 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T00:52:08.157 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:08.157 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T00:52:09.057 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:09.058 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T00:52:09.257 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:09.257 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T00:52:10.157 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:10.157 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T00:52:10.357 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:10.357 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T00:52:11.357 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:11.357 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T00:52:11.557 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:11.557 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T00:52:12.459 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:12.459 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T00:52:12.657 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:12.657 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T00:52:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:13.557 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T00:52:13.757 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:13.757 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T00:52:14.657 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:14.657 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T00:52:42.958 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:42.958 INFO:teuthology.orchestra.run.smithi102.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T00:52:43.857 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:43.857 INFO:teuthology.orchestra.run.smithi102.stdout:---------------------------------------------------------------------- 2024-09-12T00:52:43.857 INFO:teuthology.orchestra.run.smithi102.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T00:52:43.857 INFO:teuthology.orchestra.run.smithi102.stdout:---------------------------------------------------------------------- 2024-09-12T00:52:43.920 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:43.920 INFO:teuthology.orchestra.run.smithi102.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:52:43.920 INFO:teuthology.orchestra.run.smithi102.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:52:43.920 INFO:teuthology.orchestra.run.smithi102.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:52:43.920 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:43.920 INFO:teuthology.orchestra.run.smithi102.stdout:BUILD SUCCESSFUL in 8m 22s 2024-09-12T00:52:43.920 INFO:teuthology.orchestra.run.smithi102.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T00:52:44.248 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T00:52:44.280 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:44.280 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:44.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.322+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.322+0000 7fe7552919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.322+0000 7fe7552919c0 20 realm 2024-09-12T00:52:44.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.322+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.322+0000 7fe7552919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.322+0000 7fe7552919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:44.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.322+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.322+0000 7fe7552919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.322+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.326+0000 7fe7552919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:44.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.326+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.326+0000 7fe7552919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:44.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.326+0000 7fe7552919c0 20 searching for the correct realm 2024-09-12T00:52:44.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.330+0000 7fe753598640 0 -- 172.21.15.102:0/3356004185 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fe7480c9070 msgr2=0x7fe748009760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:44.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.338+0000 7fe752596640 0 -- 172.21.15.102:0/3356004185 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fe74c08a1f0 msgr2=0x7fe74c05c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:44.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.554+0000 7fe7552919c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:52:44.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.554+0000 7fe7552919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:44.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.554+0000 7fe7552919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:44.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.554+0000 7fe7552919c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:52:44.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.554+0000 7fe7552919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:44.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.554+0000 7fe7552919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:44.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.554+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.554+0000 7fe7552919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.554+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:44.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 20 zone default found 2024-09-12T00:52:44.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 4 Realm: () 2024-09-12T00:52:44.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:52:44.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:52:44.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:44.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 20 zonegroup default 2024-09-12T00:52:44.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.558+0000 7fe7552919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.562+0000 7fe7552919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.562+0000 7fe7552919c0 20 started sync module instance, tier type = 2024-09-12T00:52:44.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.562+0000 7fe7552919c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:52:44.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.586+0000 7fe7552919c0 20 add_watcher() i=0 2024-09-12T00:52:44.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.586+0000 7fe7552919c0 20 add_watcher() i=1 2024-09-12T00:52:44.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.586+0000 7fe7552919c0 20 add_watcher() i=2 2024-09-12T00:52:44.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.586+0000 7fe7552919c0 20 add_watcher() i=3 2024-09-12T00:52:44.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.586+0000 7fe7552919c0 20 add_watcher() i=4 2024-09-12T00:52:44.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.586+0000 7fe7552919c0 20 add_watcher() i=5 2024-09-12T00:52:44.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.586+0000 7fe7552919c0 20 add_watcher() i=6 2024-09-12T00:52:44.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.590+0000 7fe7552919c0 20 add_watcher() i=7 2024-09-12T00:52:44.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.590+0000 7fe7552919c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:44.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.594+0000 7fe6097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:44.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.594+0000 7fe7552919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:44.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.594+0000 7fe7552919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.682+0000 7fe583fff640 20 reqs_thread_entry: start 2024-09-12T00:52:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.682+0000 7fe7552919c0 20 init_complete bucket index max shards: 11 2024-09-12T00:52:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.682+0000 7fe7552919c0 20 Filter name: none 2024-09-12T00:52:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.682+0000 7fe581ffb640 20 reqs_thread_entry: start 2024-09-12T00:52:44.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.682+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:52:44.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.686+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.690+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.690+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.690+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:52:44.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.694+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:52:44.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17889332991271253576', time=2024-09-12T02:49:49.404252+0000, chain.objs.size()=19 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.1 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.1_1 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.2 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.2_1 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.3 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.3_1 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.4 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.4_1 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.5 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.5_1 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.6 2024-09-12T00:52:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.698+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.6_1 2024-09-12T00:52:44.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.706+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.7 2024-09-12T00:52:44.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.706+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.7_1 2024-09-12T00:52:44.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.710+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.8 2024-09-12T00:52:44.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.710+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.8_1 2024-09-12T00:52:44.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.714+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.9 2024-09-12T00:52:44.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.714+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.9_1 2024-09-12T00:52:44.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.718+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~OH5piS--ZH8S8NXLgRbtkZis5wcuvbG.10 2024-09-12T00:52:44.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.718+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1265160740881683823', time=2024-09-12T02:52:09.507489+0000, chain.objs.size()=1 2024-09-12T00:52:44.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.718+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.62__shadow_.jR92fVqmfZdWq57M8PVfXVVulmtfqii_0 2024-09-12T00:52:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.726+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:44.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.734+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:52:44.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.734+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:52:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9148809000041794879', time=2024-09-12T02:45:26.247295+0000, chain.objs.size()=9 2024-09-12T00:52:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.43__multipart_key1.2~_1FilmhonkgQDK2mNhIpz7L0ZNL3RJm.1 2024-09-12T00:52:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.43__shadow_key1.2~_1FilmhonkgQDK2mNhIpz7L0ZNL3RJm.1_1 2024-09-12T00:52:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.43__multipart_key1.2~_1FilmhonkgQDK2mNhIpz7L0ZNL3RJm.2 2024-09-12T00:52:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.43__shadow_key1.2~_1FilmhonkgQDK2mNhIpz7L0ZNL3RJm.2_1 2024-09-12T00:52:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.43__multipart_key1.2~_1FilmhonkgQDK2mNhIpz7L0ZNL3RJm.3 2024-09-12T00:52:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.43__shadow_key1.2~_1FilmhonkgQDK2mNhIpz7L0ZNL3RJm.3_1 2024-09-12T00:52:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.43__multipart_key1.2~_1FilmhonkgQDK2mNhIpz7L0ZNL3RJm.4 2024-09-12T00:52:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.43__shadow_key1.2~_1FilmhonkgQDK2mNhIpz7L0ZNL3RJm.4_1 2024-09-12T00:52:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.43__multipart_key1.2~_1FilmhonkgQDK2mNhIpz7L0ZNL3RJm.5 2024-09-12T00:52:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15870203294766479494', time=2024-09-12T02:50:36.231604+0000, chain.objs.size()=16 2024-09-12T00:52:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.1 2024-09-12T00:52:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.1_1 2024-09-12T00:52:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.738+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.1_2 2024-09-12T00:52:44.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.746+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.2 2024-09-12T00:52:44.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.746+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.2_1 2024-09-12T00:52:44.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.746+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.2_2 2024-09-12T00:52:44.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.746+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.3 2024-09-12T00:52:44.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.746+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.3_1 2024-09-12T00:52:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.750+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.3_2 2024-09-12T00:52:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.750+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.4 2024-09-12T00:52:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.750+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.4_1 2024-09-12T00:52:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.750+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.4_2 2024-09-12T00:52:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.750+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.5 2024-09-12T00:52:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.750+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.5_1 2024-09-12T00:52:44.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.754+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.5_2 2024-09-12T00:52:44.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.762+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~vKurd2NCzqlivZ4TJYdT7BESpgtk8_I.6 2024-09-12T00:52:44.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.766+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:44.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.770+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:52:44.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14045654645739130528', time=2024-09-12T02:51:24.666113+0000, chain.objs.size()=1 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.57__shadow_.0tzZS8cyoiGmfioPL9HExPCtodDVlzM_0 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2831638636152538742', time=2024-09-12T02:51:29.154392+0000, chain.objs.size()=9 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.57__multipart_key1.2~IliQ8wrhSiz1Cv4M9q7RjtW5lvkopvH.1 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.57__shadow_key1.2~IliQ8wrhSiz1Cv4M9q7RjtW5lvkopvH.1_1 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.57__multipart_key1.2~IliQ8wrhSiz1Cv4M9q7RjtW5lvkopvH.2 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.57__shadow_key1.2~IliQ8wrhSiz1Cv4M9q7RjtW5lvkopvH.2_1 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.57__multipart_key1.2~IliQ8wrhSiz1Cv4M9q7RjtW5lvkopvH.3 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.57__shadow_key1.2~IliQ8wrhSiz1Cv4M9q7RjtW5lvkopvH.3_1 2024-09-12T00:52:44.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.57__multipart_key1.2~IliQ8wrhSiz1Cv4M9q7RjtW5lvkopvH.4 2024-09-12T00:52:44.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.57__shadow_key1.2~IliQ8wrhSiz1Cv4M9q7RjtW5lvkopvH.4_1 2024-09-12T00:52:44.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.774+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.57__multipart_key1.2~IliQ8wrhSiz1Cv4M9q7RjtW5lvkopvH.5 2024-09-12T00:52:44.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.786+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:44.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.790+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:52:44.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.790+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.794+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.794+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.794+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:52:44.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.794+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:52:44.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~uUWt-qaHKNfO5U2tIBHt17C70Jzn9wB', time=2024-09-12T02:45:02.692203+0000, chain.objs.size()=9 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.41__multipart_key1.2~uUWt-qaHKNfO5U2tIBHt17C70Jzn9wB.1 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.41__shadow_key1.2~uUWt-qaHKNfO5U2tIBHt17C70Jzn9wB.1_1 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.41__multipart_key1.2~uUWt-qaHKNfO5U2tIBHt17C70Jzn9wB.2 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.41__shadow_key1.2~uUWt-qaHKNfO5U2tIBHt17C70Jzn9wB.2_1 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.41__multipart_key1.2~uUWt-qaHKNfO5U2tIBHt17C70Jzn9wB.3 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.41__shadow_key1.2~uUWt-qaHKNfO5U2tIBHt17C70Jzn9wB.3_1 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.41__multipart_key1.2~uUWt-qaHKNfO5U2tIBHt17C70Jzn9wB.4 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.41__shadow_key1.2~uUWt-qaHKNfO5U2tIBHt17C70Jzn9wB.4_1 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.41__multipart_key1.2~uUWt-qaHKNfO5U2tIBHt17C70Jzn9wB.5 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12416891888580893674', time=2024-09-12T02:46:04.730939+0000, chain.objs.size()=9 2024-09-12T00:52:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~awEUZsLADDS2jlFpcsymZpjh4UtRY9e.1 2024-09-12T00:52:44.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~awEUZsLADDS2jlFpcsymZpjh4UtRY9e.1_1 2024-09-12T00:52:44.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.798+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~awEUZsLADDS2jlFpcsymZpjh4UtRY9e.2 2024-09-12T00:52:44.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.802+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~awEUZsLADDS2jlFpcsymZpjh4UtRY9e.2_1 2024-09-12T00:52:44.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~awEUZsLADDS2jlFpcsymZpjh4UtRY9e.3 2024-09-12T00:52:44.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~awEUZsLADDS2jlFpcsymZpjh4UtRY9e.3_1 2024-09-12T00:52:44.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~awEUZsLADDS2jlFpcsymZpjh4UtRY9e.4 2024-09-12T00:52:44.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~awEUZsLADDS2jlFpcsymZpjh4UtRY9e.4_1 2024-09-12T00:52:44.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~awEUZsLADDS2jlFpcsymZpjh4UtRY9e.5 2024-09-12T00:52:44.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12741722772761564730', time=2024-09-12T02:51:41.473514+0000, chain.objs.size()=9 2024-09-12T00:52:44.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.58__multipart_key1.2~7paeyq7cTZjddDyW9laEUW4AYx8d_qH.1 2024-09-12T00:52:44.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.58__shadow_key1.2~7paeyq7cTZjddDyW9laEUW4AYx8d_qH.1_1 2024-09-12T00:52:44.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.58__multipart_key1.2~7paeyq7cTZjddDyW9laEUW4AYx8d_qH.2 2024-09-12T00:52:44.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.58__shadow_key1.2~7paeyq7cTZjddDyW9laEUW4AYx8d_qH.2_1 2024-09-12T00:52:44.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.806+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.58__multipart_key1.2~7paeyq7cTZjddDyW9laEUW4AYx8d_qH.3 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.814+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.58__shadow_key1.2~7paeyq7cTZjddDyW9laEUW4AYx8d_qH.3_1 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.814+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.58__multipart_key1.2~7paeyq7cTZjddDyW9laEUW4AYx8d_qH.4 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.814+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.58__shadow_key1.2~7paeyq7cTZjddDyW9laEUW4AYx8d_qH.4_1 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.814+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.58__multipart_key1.2~7paeyq7cTZjddDyW9laEUW4AYx8d_qH.5 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.814+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP', time=2024-09-12T02:51:59.674955+0000, chain.objs.size()=1 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.814+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.15 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.814+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP', time=2024-09-12T02:52:00.081658+0000, chain.objs.size()=1 2024-09-12T00:52:44.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.814+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.16 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.814+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP', time=2024-09-12T02:52:00.161100+0000, chain.objs.size()=1 2024-09-12T00:52:44.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.814+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.17 2024-09-12T00:52:44.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.818+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP', time=2024-09-12T02:52:00.346184+0000, chain.objs.size()=1 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.818+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.18 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.818+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP', time=2024-09-12T02:52:00.575013+0000, chain.objs.size()=1 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.818+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.19 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.818+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP', time=2024-09-12T02:52:00.878173+0000, chain.objs.size()=1 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.818+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.20 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.818+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP', time=2024-09-12T02:52:01.060586+0000, chain.objs.size()=53 2024-09-12T00:52:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.818+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.1 2024-09-12T00:52:44.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.2 2024-09-12T00:52:44.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.3 2024-09-12T00:52:44.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.4 2024-09-12T00:52:44.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.5 2024-09-12T00:52:44.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.6 2024-09-12T00:52:44.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.7 2024-09-12T00:52:44.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.8 2024-09-12T00:52:44.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.9 2024-09-12T00:52:44.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.10 2024-09-12T00:52:44.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.11 2024-09-12T00:52:44.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.826+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.12 2024-09-12T00:52:44.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.830+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.13 2024-09-12T00:52:44.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.830+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.14 2024-09-12T00:52:44.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.830+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.WAzDk3AcfBC73L4bxJJSoZ3x8ucxJLG2.15 2024-09-12T00:52:44.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.834+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.Ho2hJ5FrVXsofL57r7EJY7bSPga4Sgns.16 2024-09-12T00:52:44.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.834+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.JaXZHF9OjSoyem3CMbQpu1G9RZc-R5Fi.17 2024-09-12T00:52:44.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.834+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.wGzCkL3_HINGqG4pyAXOgr9tu6MxvEZO.18 2024-09-12T00:52:44.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.834+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.j3Tl1Rl3Zpm2VF3KXANCaMf-EFNOPZH2.19 2024-09-12T00:52:44.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.834+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.fpDXznMVVShvoiGldJAnnoLkrFITIky0.20 2024-09-12T00:52:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.838+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.21 2024-09-12T00:52:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.838+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.22 2024-09-12T00:52:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.838+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.23 2024-09-12T00:52:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.838+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.24 2024-09-12T00:52:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.838+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.25 2024-09-12T00:52:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.838+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.26 2024-09-12T00:52:44.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.27 2024-09-12T00:52:44.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.28 2024-09-12T00:52:44.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.29 2024-09-12T00:52:44.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.30 2024-09-12T00:52:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.31 2024-09-12T00:52:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.32 2024-09-12T00:52:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.33 2024-09-12T00:52:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.34 2024-09-12T00:52:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.35 2024-09-12T00:52:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.36 2024-09-12T00:52:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.842+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.37 2024-09-12T00:52:44.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.846+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.38 2024-09-12T00:52:44.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.846+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.39 2024-09-12T00:52:44.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.40 2024-09-12T00:52:44.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.41 2024-09-12T00:52:44.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.42 2024-09-12T00:52:44.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.43 2024-09-12T00:52:44.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.44 2024-09-12T00:52:44.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.45 2024-09-12T00:52:44.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.46 2024-09-12T00:52:44.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.47 2024-09-12T00:52:44.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.48 2024-09-12T00:52:44.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.49 2024-09-12T00:52:44.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.850+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.50 2024-09-12T00:52:44.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.854+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.51 2024-09-12T00:52:44.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.858+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.52 2024-09-12T00:52:44.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.858+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.59__multipart_key1.2~sa1fdw8w9k170P53lB1EOZK8Th5gXYP.53 2024-09-12T00:52:44.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.862+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:44.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.862+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:52:44.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.866+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.866+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.866+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.866+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:52:44.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.870+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.870+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.870+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.870+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:52:44.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.874+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.874+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.874+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.874+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:52:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:52:44.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13987301515728871657', time=2024-09-12T02:47:23.811634+0000, chain.objs.size()=9 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.53__multipart_key1.2~Wr8_lQ85XDkBYSfs3cQt89N7jl5sOnh.1 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.53__shadow_key1.2~Wr8_lQ85XDkBYSfs3cQt89N7jl5sOnh.1_1 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.53__multipart_key1.2~Wr8_lQ85XDkBYSfs3cQt89N7jl5sOnh.2 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.53__shadow_key1.2~Wr8_lQ85XDkBYSfs3cQt89N7jl5sOnh.2_1 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.53__multipart_key1.2~Wr8_lQ85XDkBYSfs3cQt89N7jl5sOnh.3 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.53__shadow_key1.2~Wr8_lQ85XDkBYSfs3cQt89N7jl5sOnh.3_1 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.53__multipart_key1.2~Wr8_lQ85XDkBYSfs3cQt89N7jl5sOnh.4 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.53__shadow_key1.2~Wr8_lQ85XDkBYSfs3cQt89N7jl5sOnh.4_1 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.53__multipart_key1.2~Wr8_lQ85XDkBYSfs3cQt89N7jl5sOnh.5 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11615203314651263906', time=2024-09-12T02:51:02.939338+0000, chain.objs.size()=16 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.1 2024-09-12T00:52:44.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.1_1 2024-09-12T00:52:44.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.878+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.1_2 2024-09-12T00:52:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.2 2024-09-12T00:52:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.2_1 2024-09-12T00:52:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.2_2 2024-09-12T00:52:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.3 2024-09-12T00:52:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.3_1 2024-09-12T00:52:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.3_2 2024-09-12T00:52:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.4 2024-09-12T00:52:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.4_1 2024-09-12T00:52:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.4_2 2024-09-12T00:52:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.5 2024-09-12T00:52:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.882+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.5_1 2024-09-12T00:52:44.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.886+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.5_2 2024-09-12T00:52:44.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.886+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~CPApPfHOJDH6V6Mh2z8-_zPW5947puS.6 2024-09-12T00:52:44.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.894+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:44.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.894+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:52:44.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.898+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.898+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.898+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:44.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.898+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4620856957767571186', time=2024-09-12T02:52:11.803541+0000, chain.objs.size()=1 2024-09-12T00:52:44.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.898+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.64__shadow_.rq3rNuqz6RYaJ0g4bCWzm5Xix6u0tsY_0 2024-09-12T00:52:44.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.898+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:44.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.902+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:52:44.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.902+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.902+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.902+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:52:44.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:52:44.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13629761444403912681', time=2024-09-12T02:46:10.283448+0000, chain.objs.size()=9 2024-09-12T00:52:44.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~UfI5bsC_VW9M7FVYkvQC22eNClvYp05.1 2024-09-12T00:52:44.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~UfI5bsC_VW9M7FVYkvQC22eNClvYp05.1_1 2024-09-12T00:52:44.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~UfI5bsC_VW9M7FVYkvQC22eNClvYp05.2 2024-09-12T00:52:44.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~UfI5bsC_VW9M7FVYkvQC22eNClvYp05.2_1 2024-09-12T00:52:44.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~UfI5bsC_VW9M7FVYkvQC22eNClvYp05.3 2024-09-12T00:52:44.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~UfI5bsC_VW9M7FVYkvQC22eNClvYp05.3_1 2024-09-12T00:52:44.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~UfI5bsC_VW9M7FVYkvQC22eNClvYp05.4 2024-09-12T00:52:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~UfI5bsC_VW9M7FVYkvQC22eNClvYp05.4_1 2024-09-12T00:52:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~UfI5bsC_VW9M7FVYkvQC22eNClvYp05.5 2024-09-12T00:52:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9179030065243563049', time=2024-09-12T02:47:56.718653+0000, chain.objs.size()=1 2024-09-12T00:52:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.906+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__shadow_.7RHDqa0dpQhAa1jIBAkYApL3OlGfDSk_0 2024-09-12T00:52:44.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.914+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:44.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.914+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:52:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:52:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15256903729932721694', time=2024-09-12T02:46:23.884524+0000, chain.objs.size()=9 2024-09-12T00:52:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~Ofa_XIfhhorxOBPzcWmHoLSGWSLwYqa.1 2024-09-12T00:52:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~Ofa_XIfhhorxOBPzcWmHoLSGWSLwYqa.1_1 2024-09-12T00:52:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~Ofa_XIfhhorxOBPzcWmHoLSGWSLwYqa.2 2024-09-12T00:52:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~Ofa_XIfhhorxOBPzcWmHoLSGWSLwYqa.2_1 2024-09-12T00:52:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~Ofa_XIfhhorxOBPzcWmHoLSGWSLwYqa.3 2024-09-12T00:52:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~Ofa_XIfhhorxOBPzcWmHoLSGWSLwYqa.3_1 2024-09-12T00:52:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~Ofa_XIfhhorxOBPzcWmHoLSGWSLwYqa.4 2024-09-12T00:52:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~Ofa_XIfhhorxOBPzcWmHoLSGWSLwYqa.4_1 2024-09-12T00:52:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~Ofa_XIfhhorxOBPzcWmHoLSGWSLwYqa.5 2024-09-12T00:52:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3884833250375996242', time=2024-09-12T02:46:43.226544+0000, chain.objs.size()=6 2024-09-12T00:52:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.47__shadow_.-9MtF2Kab4UT4OSrEZjhwgJo-uizV70_0 2024-09-12T00:52:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.47__shadow_.-9MtF2Kab4UT4OSrEZjhwgJo-uizV70_1 2024-09-12T00:52:44.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.918+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.47__shadow_.-9MtF2Kab4UT4OSrEZjhwgJo-uizV70_2 2024-09-12T00:52:44.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.922+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.47__shadow_.-9MtF2Kab4UT4OSrEZjhwgJo-uizV70_3 2024-09-12T00:52:44.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.922+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.47__shadow_.-9MtF2Kab4UT4OSrEZjhwgJo-uizV70_4 2024-09-12T00:52:44.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.922+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.47__shadow_.-9MtF2Kab4UT4OSrEZjhwgJo-uizV70_5 2024-09-12T00:52:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.926+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:44.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.930+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:52:44.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.934+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.934+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.934+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.934+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:52:44.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7142859712123141259', time=2024-09-12T02:47:56.375295+0000, chain.objs.size()=9 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__multipart_file.mpg.2~yPoY_w9G8ZKf4oW4K02PwKXelAeakCw.1 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__shadow_file.mpg.2~yPoY_w9G8ZKf4oW4K02PwKXelAeakCw.1_1 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__multipart_file.mpg.2~yPoY_w9G8ZKf4oW4K02PwKXelAeakCw.2 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__shadow_file.mpg.2~yPoY_w9G8ZKf4oW4K02PwKXelAeakCw.2_1 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__multipart_file.mpg.2~yPoY_w9G8ZKf4oW4K02PwKXelAeakCw.3 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__shadow_file.mpg.2~yPoY_w9G8ZKf4oW4K02PwKXelAeakCw.3_1 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__multipart_file.mpg.2~yPoY_w9G8ZKf4oW4K02PwKXelAeakCw.4 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__shadow_file.mpg.2~yPoY_w9G8ZKf4oW4K02PwKXelAeakCw.4_1 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__multipart_file.mpg.2~yPoY_w9G8ZKf4oW4K02PwKXelAeakCw.5 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~3jtX0JMUkBw_rAxndogMHauK36dujIo', time=2024-09-12T02:48:04.021950+0000, chain.objs.size()=5 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.55__multipart_key1.2~3jtX0JMUkBw_rAxndogMHauK36dujIo.7 2024-09-12T00:52:44.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.55__shadow_key1.2~3jtX0JMUkBw_rAxndogMHauK36dujIo.7_1 2024-09-12T00:52:44.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.938+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.55__multipart_key1.2~3jtX0JMUkBw_rAxndogMHauK36dujIo.10 2024-09-12T00:52:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.942+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.55__shadow_key1.2~3jtX0JMUkBw_rAxndogMHauK36dujIo.10_1 2024-09-12T00:52:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.942+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.55__multipart_key1.2~3jtX0JMUkBw_rAxndogMHauK36dujIo.13 2024-09-12T00:52:44.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.946+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:44.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.950+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:52:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.950+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.954+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.954+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.954+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:52:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.954+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.954+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.954+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:52:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:44.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11276897202284765477', time=2024-09-12T02:52:43.184410+0000, chain.objs.size()=21 2024-09-12T00:52:44.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.1 2024-09-12T00:52:44.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__shadow_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.1_1 2024-09-12T00:52:44.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.2 2024-09-12T00:52:44.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__shadow_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.2_1 2024-09-12T00:52:44.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.3 2024-09-12T00:52:44.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__shadow_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.3_1 2024-09-12T00:52:44.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.4 2024-09-12T00:52:44.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__shadow_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.4_1 2024-09-12T00:52:44.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.5 2024-09-12T00:52:44.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__shadow_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.5_1 2024-09-12T00:52:44.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.6 2024-09-12T00:52:44.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.958+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__shadow_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.6_1 2024-09-12T00:52:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.962+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.7 2024-09-12T00:52:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.962+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__shadow_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.7_1 2024-09-12T00:52:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.966+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.8 2024-09-12T00:52:44.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.966+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__shadow_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.8_1 2024-09-12T00:52:44.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.966+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.9 2024-09-12T00:52:44.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.966+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__shadow_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.9_1 2024-09-12T00:52:44.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.966+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.10 2024-09-12T00:52:44.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.966+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__shadow_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.10_1 2024-09-12T00:52:44.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.966+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.67__multipart_key1.2~gATCy-_JfFtvn5lRpoTXbtuOQa_E037.11 2024-09-12T00:52:44.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.974+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.974+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:52:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:52:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15666768659123431719', time=2024-09-12T02:45:41.944828+0000, chain.objs.size()=9 2024-09-12T00:52:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__multipart_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.1 2024-09-12T00:52:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__shadow_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.1_1 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__multipart_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.2 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__shadow_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.2_1 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__multipart_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.3 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__shadow_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.3_1 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__multipart_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.4 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__shadow_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.4_1 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__multipart_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.5 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2104789473754340444', time=2024-09-12T02:47:56.445257+0000, chain.objs.size()=1 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__shadow_.v_PF98FuuVYrPeJAigFtwms9I0KJWtl_0 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17992437183139171147', time=2024-09-12T02:48:55.459126+0000, chain.objs.size()=21 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.1 2024-09-12T00:52:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.978+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.1_1 2024-09-12T00:52:44.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.2 2024-09-12T00:52:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.2_1 2024-09-12T00:52:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.3 2024-09-12T00:52:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.3_1 2024-09-12T00:52:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.4 2024-09-12T00:52:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.4_1 2024-09-12T00:52:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.5 2024-09-12T00:52:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.5_1 2024-09-12T00:52:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.6 2024-09-12T00:52:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.6_1 2024-09-12T00:52:44.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.982+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.7 2024-09-12T00:52:44.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.986+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.7_1 2024-09-12T00:52:44.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.990+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.8 2024-09-12T00:52:44.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.990+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.8_1 2024-09-12T00:52:44.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.990+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.9 2024-09-12T00:52:44.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.990+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.9_1 2024-09-12T00:52:44.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.990+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.10 2024-09-12T00:52:44.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.990+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.10_1 2024-09-12T00:52:44.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.990+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~04oMsAmx2dpCcWrp9pixAr6Nuyj-7s2.11 2024-09-12T00:52:44.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.990+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17568510614256400786', time=2024-09-12T02:52:10.656714+0000, chain.objs.size()=1 2024-09-12T00:52:44.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.990+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.63__shadow_.M2yDY7g2Vp64IxEQdBe6oReQoYTjRxQ_0 2024-09-12T00:52:45.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.998+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:45.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:44.998+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:52:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3057248748024707343', time=2024-09-12T02:46:37.761160+0000, chain.objs.size()=7 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~80GOJgX6jaOb7AokFThdL9HWElDvEKQ.1 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~80GOJgX6jaOb7AokFThdL9HWElDvEKQ.1_1 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~80GOJgX6jaOb7AokFThdL9HWElDvEKQ.1_2 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~80GOJgX6jaOb7AokFThdL9HWElDvEKQ.2 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~80GOJgX6jaOb7AokFThdL9HWElDvEKQ.2_1 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~80GOJgX6jaOb7AokFThdL9HWElDvEKQ.2_2 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~80GOJgX6jaOb7AokFThdL9HWElDvEKQ.3 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8755976648570028376', time=2024-09-12T02:46:59.473621+0000, chain.objs.size()=9 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.52__multipart_key1.2~vlogg0Qm2evctnWVao9JHWAQL_d1x9o.1 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.52__shadow_key1.2~vlogg0Qm2evctnWVao9JHWAQL_d1x9o.1_1 2024-09-12T00:52:45.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.52__multipart_key1.2~vlogg0Qm2evctnWVao9JHWAQL_d1x9o.2 2024-09-12T00:52:45.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.52__shadow_key1.2~vlogg0Qm2evctnWVao9JHWAQL_d1x9o.2_1 2024-09-12T00:52:45.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.002+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.52__multipart_key1.2~vlogg0Qm2evctnWVao9JHWAQL_d1x9o.3 2024-09-12T00:52:45.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.006+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.52__shadow_key1.2~vlogg0Qm2evctnWVao9JHWAQL_d1x9o.3_1 2024-09-12T00:52:45.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.006+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.52__multipart_key1.2~vlogg0Qm2evctnWVao9JHWAQL_d1x9o.4 2024-09-12T00:52:45.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.006+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.52__shadow_key1.2~vlogg0Qm2evctnWVao9JHWAQL_d1x9o.4_1 2024-09-12T00:52:45.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.006+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.52__multipart_key1.2~vlogg0Qm2evctnWVao9JHWAQL_d1x9o.5 2024-09-12T00:52:45.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.014+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:45.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.014+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:52:45.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.018+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.018+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.018+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:45.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.018+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5328761281340830393', time=2024-09-12T02:52:08.372134+0000, chain.objs.size()=1 2024-09-12T00:52:45.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.018+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.61__shadow_.tfbOJo9Pj1DSKOdN95thUFGmxtuVIeY_0 2024-09-12T00:52:45.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.018+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:45.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.022+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:52:45.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.022+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.022+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.022+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.022+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:52:45.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.026+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.026+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.026+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:45.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.026+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17427390761624529788', time=2024-09-12T02:52:07.256961+0000, chain.objs.size()=1 2024-09-12T00:52:45.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.026+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.60__shadow_.grW3XXxlInPqL2f_N1WwfXbUXTjl_BB_0 2024-09-12T00:52:45.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.026+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.030+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:52:45.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.030+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.030+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.030+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.034+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:52:45.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.034+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.034+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.034+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.034+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15661385927762646569', time=2024-09-12T02:47:56.626630+0000, chain.objs.size()=1 2024-09-12T00:52:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.034+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__shadow_.FmXZejldfVEbi6S1ONDsA9xri1nheQx_0 2024-09-12T00:52:45.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.038+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:45.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.038+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:52:45.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.038+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.042+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.042+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:45.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.042+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14028304109103099020', time=2024-09-12T02:47:56.560628+0000, chain.objs.size()=5 2024-09-12T00:52:45.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.042+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__multipart_file2.mpg.2~RJwahcDJDw2HVmeuEwUVXiktdVT5I7i.1 2024-09-12T00:52:45.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.042+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__multipart_file2.mpg.2~RJwahcDJDw2HVmeuEwUVXiktdVT5I7i.2 2024-09-12T00:52:45.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.042+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__multipart_file2.mpg.2~RJwahcDJDw2HVmeuEwUVXiktdVT5I7i.3 2024-09-12T00:52:45.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.042+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__multipart_file2.mpg.2~RJwahcDJDw2HVmeuEwUVXiktdVT5I7i.4 2024-09-12T00:52:45.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.042+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.54__multipart_file2.mpg.2~RJwahcDJDw2HVmeuEwUVXiktdVT5I7i.5 2024-09-12T00:52:45.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.046+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:45.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.046+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:52:45.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11514999846135418233', time=2024-09-12T02:45:41.251918+0000, chain.objs.size()=9 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__multipart_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.1 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__shadow_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.1_1 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__multipart_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.2 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__shadow_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.2_1 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__multipart_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.3 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__shadow_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.3_1 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__multipart_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.4 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__shadow_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.4_1 2024-09-12T00:52:45.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.45__multipart_key1.2~KuMS5Bm7WTu_wJfFu9Ale9ZD-gUOCn9.5 2024-09-12T00:52:45.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4082141883276437425', time=2024-09-12T02:46:42.184485+0000, chain.objs.size()=7 2024-09-12T00:52:45.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~NAv8AYlcJVsJ8rAwImdh-EX9JTOVYD6.1 2024-09-12T00:52:45.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~NAv8AYlcJVsJ8rAwImdh-EX9JTOVYD6.1_1 2024-09-12T00:52:45.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.050+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~NAv8AYlcJVsJ8rAwImdh-EX9JTOVYD6.1_2 2024-09-12T00:52:45.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.054+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~NAv8AYlcJVsJ8rAwImdh-EX9JTOVYD6.2 2024-09-12T00:52:45.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.054+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~NAv8AYlcJVsJ8rAwImdh-EX9JTOVYD6.2_1 2024-09-12T00:52:45.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.054+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~NAv8AYlcJVsJ8rAwImdh-EX9JTOVYD6.2_2 2024-09-12T00:52:45.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.054+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~NAv8AYlcJVsJ8rAwImdh-EX9JTOVYD6.3 2024-09-12T00:52:45.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.054+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11774311548061265531', time=2024-09-12T02:52:12.938185+0000, chain.objs.size()=1 2024-09-12T00:52:45.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.054+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.65__shadow_.fX_ItK6trf9TpuH3HNuHFKqzvQz7Ns5_0 2024-09-12T00:52:45.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.058+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:45.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.062+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:52:45.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.062+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:45.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.111636219758209369', time=2024-09-12T02:51:02.600463+0000, chain.objs.size()=16 2024-09-12T00:52:45.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.1 2024-09-12T00:52:45.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.1_1 2024-09-12T00:52:45.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.1_2 2024-09-12T00:52:45.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.2 2024-09-12T00:52:45.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.2_1 2024-09-12T00:52:45.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.2_2 2024-09-12T00:52:45.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.3 2024-09-12T00:52:45.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.3_1 2024-09-12T00:52:45.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.3_2 2024-09-12T00:52:45.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.4 2024-09-12T00:52:45.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.4_1 2024-09-12T00:52:45.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.4_2 2024-09-12T00:52:45.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.066+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.5 2024-09-12T00:52:45.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.070+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.5_1 2024-09-12T00:52:45.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.070+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.5_2 2024-09-12T00:52:45.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.070+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~IurB6NT5pEuQ2YqqZHhd2aBVyBFlRnL.6 2024-09-12T00:52:45.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.074+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:45.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.078+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:52:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.078+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.078+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.078+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:52:45.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9737343755007595827', time=2024-09-12T02:49:22.812286+0000, chain.objs.size()=21 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.1 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.1_1 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.2 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.2_1 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.3 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.3_1 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.4 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.4_1 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.5 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.5_1 2024-09-12T00:52:45.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.6 2024-09-12T00:52:45.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.082+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.6_1 2024-09-12T00:52:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.086+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.7 2024-09-12T00:52:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.086+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.7_1 2024-09-12T00:52:45.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.090+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.8 2024-09-12T00:52:45.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.090+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.8_1 2024-09-12T00:52:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.090+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.9 2024-09-12T00:52:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.090+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.9_1 2024-09-12T00:52:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.090+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.10 2024-09-12T00:52:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.090+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__shadow_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.10_1 2024-09-12T00:52:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.090+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.56__multipart_key1.2~rIQ6RU3WhJ7Wte5V5upiy3HKOQaJvz9.11 2024-09-12T00:52:45.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.094+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:45.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.098+0000 7fe7552919c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:52:45.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.098+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.098+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.102+0000 7fe7552919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:45.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.102+0000 7fe7552919c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5058432560637848828', time=2024-09-12T02:46:42.586622+0000, chain.objs.size()=7 2024-09-12T00:52:45.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.102+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~QbugNPaZMV-EKiYVwQexX-aIuI3zE-J.1 2024-09-12T00:52:45.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.102+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~QbugNPaZMV-EKiYVwQexX-aIuI3zE-J.1_1 2024-09-12T00:52:45.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.102+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~QbugNPaZMV-EKiYVwQexX-aIuI3zE-J.1_2 2024-09-12T00:52:45.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.102+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~QbugNPaZMV-EKiYVwQexX-aIuI3zE-J.2 2024-09-12T00:52:45.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.102+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~QbugNPaZMV-EKiYVwQexX-aIuI3zE-J.2_1 2024-09-12T00:52:45.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.102+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__shadow_key1.2~QbugNPaZMV-EKiYVwQexX-aIuI3zE-J.2_2 2024-09-12T00:52:45.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.102+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.48__multipart_key1.2~QbugNPaZMV-EKiYVwQexX-aIuI3zE-J.3 2024-09-12T00:52:45.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.102+0000 7fe7552919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.106+0000 7fe6097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.110+0000 7fe7552919c0 20 remove_watcher() i=0 2024-09-12T00:52:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.110+0000 7fe7552919c0 2 removed watcher, disabling cache 2024-09-12T00:52:45.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.110+0000 7fe7552919c0 20 remove_watcher() i=1 2024-09-12T00:52:45.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.114+0000 7fe7552919c0 20 remove_watcher() i=2 2024-09-12T00:52:45.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.114+0000 7fe7552919c0 20 remove_watcher() i=3 2024-09-12T00:52:45.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.114+0000 7fe7552919c0 20 remove_watcher() i=4 2024-09-12T00:52:45.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.114+0000 7fe7552919c0 20 remove_watcher() i=5 2024-09-12T00:52:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.118+0000 7fe7552919c0 20 remove_watcher() i=6 2024-09-12T00:52:45.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.118+0000 7fe7552919c0 20 remove_watcher() i=7 2024-09-12T00:52:45.134 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T00:52:45.201 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:45.201 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:45.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.450+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.450+0000 7f5ce41329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:45.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.450+0000 7f5ce41329c0 20 realm 2024-09-12T00:52:45.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.450+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.450+0000 7f5ce41329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:45.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.450+0000 7f5ce41329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:45.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.450+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.450+0000 7f5ce41329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:45.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.450+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.454+0000 7f5ce41329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:45.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.454+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.454+0000 7f5ce41329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:45.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.454+0000 7f5ce41329c0 20 searching for the correct realm 2024-09-12T00:52:45.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.454+0000 7f5ce1c38640 0 -- 172.21.15.102:0/2063550199 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x55885cd14ea0 msgr2=0x55885cd17360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:45.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.462+0000 7f5ce1c38640 0 -- 172.21.15.102:0/2063550199 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x7f5cdc008040 msgr2=0x7f5cdc022470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:45.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:52:45.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:45.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:45.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:52:45.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:45.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:45.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:45.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:45.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 zone default found 2024-09-12T00:52:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 4 Realm: () 2024-09-12T00:52:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:52:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:52:45.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:45.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 zonegroup default 2024-09-12T00:52:45.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:45.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.686+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.690+0000 7f5ce41329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:45.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.690+0000 7f5ce41329c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:45.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.690+0000 7f5ce41329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:45.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.690+0000 7f5ce41329c0 20 started sync module instance, tier type = 2024-09-12T00:52:45.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.690+0000 7f5ce41329c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:52:45.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.714+0000 7f5ce41329c0 20 add_watcher() i=0 2024-09-12T00:52:45.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.714+0000 7f5ce41329c0 20 add_watcher() i=1 2024-09-12T00:52:45.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.714+0000 7f5ce41329c0 20 add_watcher() i=2 2024-09-12T00:52:45.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.714+0000 7f5ce41329c0 20 add_watcher() i=3 2024-09-12T00:52:45.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.714+0000 7f5ce41329c0 20 add_watcher() i=4 2024-09-12T00:52:45.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.714+0000 7f5ce41329c0 20 add_watcher() i=5 2024-09-12T00:52:45.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.714+0000 7f5ce41329c0 20 add_watcher() i=6 2024-09-12T00:52:45.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.714+0000 7f5ce41329c0 20 add_watcher() i=7 2024-09-12T00:52:45.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.714+0000 7f5ce41329c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.718+0000 7f5b937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.718+0000 7f5ce41329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.718+0000 7f5ce41329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.806+0000 7f5b927fc640 20 reqs_thread_entry: start 2024-09-12T00:52:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.806+0000 7f5ce41329c0 20 init_complete bucket index max shards: 11 2024-09-12T00:52:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.806+0000 7f5ce41329c0 20 Filter name: none 2024-09-12T00:52:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.806+0000 7f5b03fff640 20 reqs_thread_entry: start 2024-09-12T00:52:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.806+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:52:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.806+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.810+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.810+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.810+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:52:45.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.814+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.814+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.814+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.818+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:52:45.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.822+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.822+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.822+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.830+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:52:45.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.834+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.834+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.834+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.834+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:52:45.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.834+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.842+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.842+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.842+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:52:45.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.842+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.842+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.842+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.842+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:52:45.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.846+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.846+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.846+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.846+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:52:45.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.850+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.854+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.854+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.858+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:52:45.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.858+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.858+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.858+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.862+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:52:45.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.866+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.866+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.866+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.866+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:52:45.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.870+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.870+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.870+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.874+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:52:45.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.882+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.882+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.882+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.882+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:52:45.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.886+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.886+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.886+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.890+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:52:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.890+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.894+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.894+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.898+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:52:45.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.898+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.898+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.902+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.902+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:52:45.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.906+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.906+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.910+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.910+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:52:45.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.914+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.918+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.918+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.926+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:52:45.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.926+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.926+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.926+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.934+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:52:45.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.934+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.934+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.934+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.938+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:52:45.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.942+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.950+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.950+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.950+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:52:45.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.950+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.954+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.954+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.958+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:52:45.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.962+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.962+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.962+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.966+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:52:45.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.970+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.970+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.970+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.974+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:52:45.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.978+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.978+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.982+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.990+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:52:45.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.990+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.990+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:45.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.990+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:45.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.994+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:52:46.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.998+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.998+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:45.998+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.002+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:52:46.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.006+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.006+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.010+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.010+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:52:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.018+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.018+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.018+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.022+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:52:46.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.026+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.026+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.026+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.030+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:52:46.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.034+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.034+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.034+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.042+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:52:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.042+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.050+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.050+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.050+0000 7f5ce41329c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:52:46.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.058+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.058+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.058+0000 7f5ce41329c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.062+0000 7f5b937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:46.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.066+0000 7f5ce41329c0 20 remove_watcher() i=0 2024-09-12T00:52:46.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.066+0000 7f5ce41329c0 2 removed watcher, disabling cache 2024-09-12T00:52:46.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.070+0000 7f5ce41329c0 20 remove_watcher() i=1 2024-09-12T00:52:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.070+0000 7f5ce41329c0 20 remove_watcher() i=2 2024-09-12T00:52:46.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.074+0000 7f5ce41329c0 20 remove_watcher() i=3 2024-09-12T00:52:46.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.074+0000 7f5ce41329c0 20 remove_watcher() i=4 2024-09-12T00:52:46.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.078+0000 7f5ce41329c0 20 remove_watcher() i=5 2024-09-12T00:52:46.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.078+0000 7f5ce41329c0 20 remove_watcher() i=6 2024-09-12T00:52:46.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.082+0000 7f5ce41329c0 20 remove_watcher() i=7 2024-09-12T00:52:46.111 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T00:52:46.187 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:46.187 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:46.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.230+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.230+0000 7fe38e6919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.230+0000 7fe38e6919c0 20 realm 2024-09-12T00:52:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.230+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.230+0000 7fe38e6919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.230+0000 7fe38e6919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.230+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.230+0000 7fe38e6919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.230+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.234+0000 7fe38e6919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.234+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.234+0000 7fe38e6919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:46.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.234+0000 7fe38e6919c0 20 searching for the correct realm 2024-09-12T00:52:46.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.238+0000 7fe38c998640 0 -- 172.21.15.102:0/3774722313 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fe3800d2040 msgr2=0x7fe3800dd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:46.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.246+0000 7fe38b996640 0 -- 172.21.15.102:0/3774722313 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fe384077950 msgr2=0x7fe38407e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:46.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.462+0000 7fe38e6919c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:52:46.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.462+0000 7fe38e6919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:46.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.462+0000 7fe38e6919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:46.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.462+0000 7fe38e6919c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:52:46.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.462+0000 7fe38e6919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:46.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.462+0000 7fe38e6919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:46.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.462+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.462+0000 7fe38e6919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:46.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:46.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 zone default found 2024-09-12T00:52:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 4 Realm: () 2024-09-12T00:52:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:52:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:52:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 zonegroup default 2024-09-12T00:52:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 started sync module instance, tier type = 2024-09-12T00:52:46.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.466+0000 7fe38e6919c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:52:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.494+0000 7fe38e6919c0 20 add_watcher() i=0 2024-09-12T00:52:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.494+0000 7fe38e6919c0 20 add_watcher() i=1 2024-09-12T00:52:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.494+0000 7fe38e6919c0 20 add_watcher() i=2 2024-09-12T00:52:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.494+0000 7fe38e6919c0 20 add_watcher() i=3 2024-09-12T00:52:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.494+0000 7fe38e6919c0 20 add_watcher() i=4 2024-09-12T00:52:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.494+0000 7fe38e6919c0 20 add_watcher() i=5 2024-09-12T00:52:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.494+0000 7fe38e6919c0 20 add_watcher() i=6 2024-09-12T00:52:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.494+0000 7fe38e6919c0 20 add_watcher() i=7 2024-09-12T00:52:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.494+0000 7fe38e6919c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:46.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.502+0000 7fe242fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.502+0000 7fe38e6919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.502+0000 7fe38e6919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:46.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.598+0000 7fe241fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:46.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.598+0000 7fe38e6919c0 20 init_complete bucket index max shards: 11 2024-09-12T00:52:46.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.598+0000 7fe38e6919c0 20 Filter name: none 2024-09-12T00:52:46.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.598+0000 7fe1b37fe640 20 reqs_thread_entry: start 2024-09-12T00:52:46.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.598+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:52:46.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.602+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.602+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.602+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.602+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:52:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.606+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.610+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.610+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.610+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:52:46.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.614+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.614+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.614+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.618+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:52:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.618+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.622+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.622+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.626+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:52:46.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.626+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.630+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.630+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.634+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:52:46.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.634+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.634+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.634+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.638+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:52:46.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.638+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.642+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.642+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.646+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:52:46.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.646+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.646+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.646+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.650+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:52:46.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.654+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.654+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.654+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.654+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:52:46.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.658+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.658+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.658+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.662+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:52:46.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.666+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.666+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.670+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.670+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:52:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.674+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.674+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.674+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.678+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:52:46.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.682+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.682+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.682+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.686+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:52:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.686+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.690+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.690+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.690+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:52:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.694+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.694+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.694+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.694+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:52:46.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.698+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.702+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.702+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.702+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:52:46.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.706+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.706+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.706+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.710+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:52:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.710+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.710+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.714+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.714+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:52:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.718+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.718+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.718+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.718+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:52:46.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.722+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.726+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.726+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.730+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:52:46.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.730+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.734+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.734+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.734+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:52:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.738+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.742+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.742+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.746+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:52:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.750+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.750+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.750+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.754+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:52:46.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.758+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.758+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.762+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.762+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:52:46.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.766+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.770+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.770+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.770+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:52:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.774+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.778+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.778+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.778+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:52:46.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.782+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.782+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.786+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.786+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:52:46.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.790+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.790+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.794+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.794+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:52:46.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.798+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.802+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.802+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.802+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:52:46.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.806+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.806+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.810+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.810+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:52:46.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.814+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.814+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.814+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.818+0000 7fe38e6919c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:52:46.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.822+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.822+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:46.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.826+0000 7fe38e6919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:46.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.830+0000 7fe242fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:46.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.834+0000 7fe38e6919c0 20 remove_watcher() i=0 2024-09-12T00:52:46.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.834+0000 7fe38e6919c0 2 removed watcher, disabling cache 2024-09-12T00:52:46.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.838+0000 7fe38e6919c0 20 remove_watcher() i=1 2024-09-12T00:52:46.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.838+0000 7fe38e6919c0 20 remove_watcher() i=2 2024-09-12T00:52:46.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.842+0000 7fe38e6919c0 20 remove_watcher() i=3 2024-09-12T00:52:46.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.846+0000 7fe38e6919c0 20 remove_watcher() i=4 2024-09-12T00:52:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.846+0000 7fe38e6919c0 20 remove_watcher() i=5 2024-09-12T00:52:46.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.846+0000 7fe38e6919c0 20 remove_watcher() i=6 2024-09-12T00:52:46.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.850+0000 7fe38e6919c0 20 remove_watcher() i=7 2024-09-12T00:52:46.869 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T00:52:46.942 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:46.942 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:46.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 20 realm 2024-09-12T00:52:46.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:46.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.990+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.994+0000 7f75a7db69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:46.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.994+0000 7f75a7db69c0 20 searching for the correct realm 2024-09-12T00:52:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:46.994+0000 7f75a50bb640 0 -- 172.21.15.102:0/1409399319 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7f75a00bb020 msgr2=0x7f75a00daa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:47.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.206+0000 7f75a60bd640 0 -- 172.21.15.102:0/1409399319 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55d220d9f9c0 msgr2=0x55d220da1db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:47.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:52:47.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:52:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:47.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:47.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 zone default found 2024-09-12T00:52:47.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 4 Realm: () 2024-09-12T00:52:47.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:52:47.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:52:47.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:47.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 zonegroup default 2024-09-12T00:52:47.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:47.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.226+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.230+0000 7f75a7db69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:47.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.230+0000 7f75a7db69c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.230+0000 7f75a7db69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:47.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.230+0000 7f75a7db69c0 20 started sync module instance, tier type = 2024-09-12T00:52:47.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.230+0000 7f75a7db69c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:52:47.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.250+0000 7f75a7db69c0 20 add_watcher() i=0 2024-09-12T00:52:47.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.250+0000 7f75a7db69c0 20 add_watcher() i=1 2024-09-12T00:52:47.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.250+0000 7f75a7db69c0 20 add_watcher() i=2 2024-09-12T00:52:47.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.250+0000 7f75a7db69c0 20 add_watcher() i=3 2024-09-12T00:52:47.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.250+0000 7f75a7db69c0 20 add_watcher() i=4 2024-09-12T00:52:47.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.250+0000 7f75a7db69c0 20 add_watcher() i=5 2024-09-12T00:52:47.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.250+0000 7f75a7db69c0 20 add_watcher() i=6 2024-09-12T00:52:47.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.250+0000 7f75a7db69c0 20 add_watcher() i=7 2024-09-12T00:52:47.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.250+0000 7f75a7db69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:47.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.254+0000 7f7457fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.254+0000 7f75a7db69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.254+0000 7f75a7db69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.346+0000 7f7456ffd640 20 reqs_thread_entry: start 2024-09-12T00:52:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.346+0000 7f75a7db69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:52:47.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.346+0000 7f75a7db69c0 20 Filter name: none 2024-09-12T00:52:47.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.346+0000 7f7454ff9640 20 reqs_thread_entry: start 2024-09-12T00:52:47.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.346+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:52:47.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.350+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.350+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.350+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.354+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:52:47.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.354+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.354+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.358+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.358+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:52:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.362+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.362+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.362+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.366+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:52:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.366+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.366+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.370+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.374+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:52:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.378+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.378+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.378+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.382+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:52:47.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.382+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.386+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.386+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.386+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:52:47.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.390+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.390+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.390+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.394+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:52:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.394+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.394+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.398+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.398+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:52:47.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.398+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.402+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.402+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.402+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:52:47.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.406+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.406+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.406+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.410+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:52:47.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.410+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.414+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.414+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.414+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:52:47.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.418+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.418+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.418+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.418+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:52:47.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.422+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.422+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.422+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.426+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:52:47.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.430+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.430+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.430+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.434+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:52:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.438+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.438+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.438+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.438+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:52:47.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.442+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.446+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.446+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.446+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:52:47.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.450+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.450+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.450+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.454+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:52:47.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.454+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.458+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.458+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.462+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:52:47.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.466+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.466+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.466+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.470+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:52:47.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.474+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.474+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.474+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.478+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:52:47.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.478+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.482+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.482+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.482+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:52:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.486+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.490+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.490+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.490+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:52:47.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.494+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.494+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.494+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.498+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:52:47.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.498+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.502+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.502+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.506+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:52:47.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.506+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.510+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.510+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.514+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:52:47.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.518+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.518+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.518+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.522+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:52:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.526+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.526+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.526+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.530+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:52:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.534+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.534+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.538+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.538+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:52:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.542+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.542+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.546+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.546+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:52:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.550+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.554+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.554+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.554+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:52:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.558+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.562+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.562+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.566+0000 7f75a7db69c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:52:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.570+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.570+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:47.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.570+0000 7f75a7db69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:47.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.574+0000 7f7457fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:47.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.578+0000 7f75a7db69c0 20 remove_watcher() i=0 2024-09-12T00:52:47.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.578+0000 7f75a7db69c0 2 removed watcher, disabling cache 2024-09-12T00:52:47.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.582+0000 7f75a7db69c0 20 remove_watcher() i=1 2024-09-12T00:52:47.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.586+0000 7f75a7db69c0 20 remove_watcher() i=2 2024-09-12T00:52:47.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.586+0000 7f75a7db69c0 20 remove_watcher() i=3 2024-09-12T00:52:47.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.590+0000 7f75a7db69c0 20 remove_watcher() i=4 2024-09-12T00:52:47.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.590+0000 7f75a7db69c0 20 remove_watcher() i=5 2024-09-12T00:52:47.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.594+0000 7f75a7db69c0 20 remove_watcher() i=6 2024-09-12T00:52:47.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:47.594+0000 7f75a7db69c0 20 remove_watcher() i=7 2024-09-12T00:52:47.613 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T00:52:48.336 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :clean 2024-09-12T00:52:49.133 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :compileJava 2024-09-12T00:52:49.134 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :processResources 2024-09-12T00:52:49.134 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :classes 2024-09-12T00:52:49.733 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:49.733 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :compileTestJava 2024-09-12T00:52:49.734 INFO:teuthology.orchestra.run.smithi102.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:52:49.734 INFO:teuthology.orchestra.run.smithi102.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:52:49.735 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:49.735 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:52:49.735 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :testClasses 2024-09-12T00:52:51.734 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:51.734 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :test 2024-09-12T00:52:51.734 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:51.734 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T00:52:51.735 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12 00:52:51,070 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:52:51.735 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:51.735 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T00:52:51.735 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:51.735 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T00:52:52.233 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:52.233 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T00:52:52.333 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:52.333 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T00:52:53.033 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:53.033 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T00:52:53.133 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:53.133 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T00:52:53.833 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:53.833 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T00:52:54.433 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:54.434 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T00:52:54.533 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:54.533 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T00:52:54.933 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:54.934 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T00:52:55.733 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:55.733 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T00:52:55.833 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:55.834 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T00:52:56.033 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:56.033 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T00:52:56.433 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:56.433 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T00:52:57.733 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:57.734 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T00:52:57.933 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:57.933 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T00:52:58.633 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:58.633 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T00:52:58.733 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:58.733 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T00:52:58.906 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:58.907 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------- 2024-09-12T00:52:58.907 INFO:teuthology.orchestra.run.smithi102.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T00:52:58.907 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------- 2024-09-12T00:52:58.907 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:58.907 INFO:teuthology.orchestra.run.smithi102.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:52:58.907 INFO:teuthology.orchestra.run.smithi102.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:52:58.907 INFO:teuthology.orchestra.run.smithi102.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:52:58.907 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:52:58.907 INFO:teuthology.orchestra.run.smithi102.stdout:BUILD SUCCESSFUL in 11s 2024-09-12T00:52:58.907 INFO:teuthology.orchestra.run.smithi102.stdout:5 actionable tasks: 5 executed 2024-09-12T00:52:58.915 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T00:52:58.944 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:58.944 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:58.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:58.997+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.001+0000 7feae2a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.001+0000 7feae2a369c0 20 realm 2024-09-12T00:52:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.001+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.001+0000 7feae2a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.001+0000 7feae2a369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.001+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.001+0000 7feae2a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:59.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.001+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.005+0000 7feae2a369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:59.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.005+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.005+0000 7feae2a369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:59.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.005+0000 7feae2a369c0 20 searching for the correct realm 2024-09-12T00:52:59.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.009+0000 7feae0d3d640 0 -- 172.21.15.102:0/623009043 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fead4043040 msgr2=0x7fead4034420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:59.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.225+0000 7feadfd3b640 0 -- 172.21.15.102:0/623009043 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fead8009c40 msgr2=0x7fead8133340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:59.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:52:59.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:59.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:52:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:59.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:59.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 zone default found 2024-09-12T00:52:59.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 4 Realm: () 2024-09-12T00:52:59.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:52:59.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:52:59.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:59.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 zonegroup default 2024-09-12T00:52:59.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:59.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.445+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.449+0000 7feae2a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:59.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.449+0000 7feae2a369c0 20 rados->read ofs=0 len=0 2024-09-12T00:52:59.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.449+0000 7feae2a369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:59.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.449+0000 7feae2a369c0 20 started sync module instance, tier type = 2024-09-12T00:52:59.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.449+0000 7feae2a369c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:52:59.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.469+0000 7feae2a369c0 20 add_watcher() i=0 2024-09-12T00:52:59.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.469+0000 7feae2a369c0 20 add_watcher() i=1 2024-09-12T00:52:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.469+0000 7feae2a369c0 20 add_watcher() i=2 2024-09-12T00:52:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.469+0000 7feae2a369c0 20 add_watcher() i=3 2024-09-12T00:52:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.469+0000 7feae2a369c0 20 add_watcher() i=4 2024-09-12T00:52:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.469+0000 7feae2a369c0 20 add_watcher() i=5 2024-09-12T00:52:59.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.469+0000 7feae2a369c0 20 add_watcher() i=6 2024-09-12T00:52:59.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.473+0000 7feae2a369c0 20 add_watcher() i=7 2024-09-12T00:52:59.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.473+0000 7feae2a369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:59.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.477+0000 7fe996fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:59.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.477+0000 7feae2a369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:59.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.477+0000 7feae2a369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:59.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.573+0000 7fe995fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:59.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.573+0000 7feae2a369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:52:59.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.573+0000 7feae2a369c0 20 Filter name: none 2024-09-12T00:52:59.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.573+0000 7fe9077fe640 20 reqs_thread_entry: start 2024-09-12T00:52:59.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.573+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:52:59.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.577+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.577+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.581+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:59.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.581+0000 7feae2a369c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14731078859406491788', time=2024-09-12T02:52:56.597822+0000, chain.objs.size()=1 2024-09-12T00:52:59.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.581+0000 7feae2a369c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.73__shadow_.rGLq_1xg1nOuzGyedlz_19PiUfXLhMt_0 2024-09-12T00:52:59.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.585+0000 7feae2a369c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:59.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.589+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:52:59.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.589+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.593+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.593+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.593+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:52:59.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.597+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.597+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.597+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.597+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:52:59.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.601+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.601+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.601+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.605+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:52:59.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.609+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.609+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.609+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.613+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:52:59.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.617+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.617+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.617+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.617+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:52:59.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.621+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.625+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.625+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.625+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:52:59.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.629+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.633+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.633+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.633+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:52:59.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.637+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.637+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.641+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.641+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:52:59.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.649+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.649+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.649+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.653+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:52:59.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.657+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.661+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.661+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.665+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:52:59.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.669+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.669+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.669+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.673+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:52:59.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.677+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.677+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.677+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.681+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:52:59.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.685+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.685+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.685+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.689+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:52:59.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.693+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.693+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.693+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.697+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:52:59.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.701+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.701+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.701+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.705+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:52:59.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.709+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.709+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.713+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.713+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:52:59.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.717+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.721+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.721+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.721+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:52:59.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.725+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.729+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.729+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.733+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:52:59.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.737+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.737+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.737+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.741+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:52:59.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.745+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.745+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.745+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.749+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:52:59.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.753+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.753+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.757+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.757+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:52:59.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.761+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.761+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.765+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.765+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:52:59.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.769+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.773+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.773+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.773+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:52:59.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.777+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.781+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.781+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.781+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:52:59.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.785+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.789+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.789+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.793+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:52:59.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.793+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.797+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.797+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:52:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.797+0000 7feae2a369c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.19932414153328331', time=2024-09-12T02:52:55.146732+0000, chain.objs.size()=1 2024-09-12T00:52:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.797+0000 7feae2a369c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.72__shadow_.MRcsh0eWLjFmu9_RnnFp2-hTjENiOog_0 2024-09-12T00:52:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.801+0000 7feae2a369c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:52:59.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.805+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:52:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.809+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.813+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.813+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.813+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:52:59.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.817+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.821+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.821+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.825+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:52:59.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.829+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.829+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.829+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.833+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:52:59.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.837+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.837+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.837+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.841+0000 7feae2a369c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:52:59.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.845+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.845+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:52:59.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.845+0000 7feae2a369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:52:59.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.849+0000 7fe996fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:59.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.857+0000 7feae2a369c0 20 remove_watcher() i=0 2024-09-12T00:52:59.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.857+0000 7feae2a369c0 2 removed watcher, disabling cache 2024-09-12T00:52:59.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.857+0000 7feae2a369c0 20 remove_watcher() i=1 2024-09-12T00:52:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.861+0000 7feae2a369c0 20 remove_watcher() i=2 2024-09-12T00:52:59.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.865+0000 7feae2a369c0 20 remove_watcher() i=3 2024-09-12T00:52:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.865+0000 7feae2a369c0 20 remove_watcher() i=4 2024-09-12T00:52:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.869+0000 7feae2a369c0 20 remove_watcher() i=5 2024-09-12T00:52:59.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.869+0000 7feae2a369c0 20 remove_watcher() i=6 2024-09-12T00:52:59.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:52:59.873+0000 7feae2a369c0 20 remove_watcher() i=7 2024-09-12T00:52:59.891 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T00:52:59.963 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:59.963 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:00.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.009+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.009+0000 7f2f355369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.009+0000 7f2f355369c0 20 realm 2024-09-12T00:53:00.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.009+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.009+0000 7f2f355369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.009+0000 7f2f355369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:00.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.013+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.013+0000 7f2f355369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.013+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.013+0000 7f2f355369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:00.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.013+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.013+0000 7f2f355369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:00.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.013+0000 7f2f355369c0 20 searching for the correct realm 2024-09-12T00:53:00.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.017+0000 7f2f3383d640 0 -- 172.21.15.102:0/4189260438 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f2f1c0d7070 msgr2=0x7f2f1c1372e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:00.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.233+0000 7f2f3283b640 0 -- 172.21.15.102:0/4189260438 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f2f2401f8e0 msgr2=0x7f2f24037400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:00.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.449+0000 7f2f355369c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:53:00.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.449+0000 7f2f355369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:00.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.449+0000 7f2f355369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:00.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.449+0000 7f2f355369c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:53:00.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.449+0000 7f2f355369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:00.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.449+0000 7f2f355369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:00.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.449+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:00.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:00.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 zone default found 2024-09-12T00:53:00.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 4 Realm: () 2024-09-12T00:53:00.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:53:00.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:53:00.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:00.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 zonegroup default 2024-09-12T00:53:00.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.453+0000 7f2f355369c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:00.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.457+0000 7f2f355369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:00.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.457+0000 7f2f355369c0 20 started sync module instance, tier type = 2024-09-12T00:53:00.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.457+0000 7f2f355369c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:53:00.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.477+0000 7f2f355369c0 20 add_watcher() i=0 2024-09-12T00:53:00.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.477+0000 7f2f355369c0 20 add_watcher() i=1 2024-09-12T00:53:00.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.477+0000 7f2f355369c0 20 add_watcher() i=2 2024-09-12T00:53:00.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.477+0000 7f2f355369c0 20 add_watcher() i=3 2024-09-12T00:53:00.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.477+0000 7f2f355369c0 20 add_watcher() i=4 2024-09-12T00:53:00.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.477+0000 7f2f355369c0 20 add_watcher() i=5 2024-09-12T00:53:00.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.477+0000 7f2f355369c0 20 add_watcher() i=6 2024-09-12T00:53:00.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.477+0000 7f2f355369c0 20 add_watcher() i=7 2024-09-12T00:53:00.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.477+0000 7f2f355369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:00.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.481+0000 7f2dea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:00.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.485+0000 7f2f355369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:00.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.485+0000 7f2f355369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:00.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.601+0000 7f2de97e2640 20 reqs_thread_entry: start 2024-09-12T00:53:00.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.601+0000 7f2f355369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:53:00.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.601+0000 7f2f355369c0 20 Filter name: none 2024-09-12T00:53:00.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.601+0000 7f2de27fc640 20 reqs_thread_entry: start 2024-09-12T00:53:00.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.601+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:53:00.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.605+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.605+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.605+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.609+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:53:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.613+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.613+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.613+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.613+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:53:00.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.621+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.621+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.621+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.625+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:53:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.629+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.629+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.629+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.633+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:53:00.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.633+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.637+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.637+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.641+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:53:00.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.645+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.645+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.645+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.645+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:53:00.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.653+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.653+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.657+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.657+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:53:00.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.661+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.665+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.665+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.669+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:53:00.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.669+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.673+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.673+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.677+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:53:00.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.681+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.681+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.681+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.681+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:53:00.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.685+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.689+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.689+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.693+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:53:00.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.697+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.697+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.697+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.701+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:53:00.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.701+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.705+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.705+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.705+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:53:00.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.709+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.709+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.709+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.713+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:53:00.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.717+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.717+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.721+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.721+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:53:00.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.725+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.725+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.725+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.729+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:53:00.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.733+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.733+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.733+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.737+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:53:00.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.741+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.741+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.745+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.745+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:53:00.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.749+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.749+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.753+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.753+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:53:00.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.757+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.761+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.761+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.761+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:53:00.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.765+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.769+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.769+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.769+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:53:00.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.773+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.773+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.773+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.777+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:53:00.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.781+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.781+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.781+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.785+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:53:00.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.789+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.789+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.789+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.793+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:53:00.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.793+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.797+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.797+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.797+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:53:00.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.801+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.801+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.805+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.805+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:53:00.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.809+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.809+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.809+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.813+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:53:00.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.813+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.817+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.817+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.821+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:53:00.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.821+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.821+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.825+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.825+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:53:00.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.829+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.829+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.829+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.833+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:53:00.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.833+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.837+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.837+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.841+0000 7f2f355369c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:53:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.841+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.845+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:00.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.845+0000 7f2f355369c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:00.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.849+0000 7f2dea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:00.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.853+0000 7f2f355369c0 20 remove_watcher() i=0 2024-09-12T00:53:00.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.853+0000 7f2f355369c0 2 removed watcher, disabling cache 2024-09-12T00:53:00.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.857+0000 7f2f355369c0 20 remove_watcher() i=1 2024-09-12T00:53:00.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.857+0000 7f2f355369c0 20 remove_watcher() i=2 2024-09-12T00:53:00.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.861+0000 7f2f355369c0 20 remove_watcher() i=3 2024-09-12T00:53:00.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.861+0000 7f2f355369c0 20 remove_watcher() i=4 2024-09-12T00:53:00.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.865+0000 7f2f355369c0 20 remove_watcher() i=5 2024-09-12T00:53:00.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.865+0000 7f2f355369c0 20 remove_watcher() i=6 2024-09-12T00:53:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:00.869+0000 7f2f355369c0 20 remove_watcher() i=7 2024-09-12T00:53:00.887 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T00:53:00.959 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:00.960 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:01.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.005+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.009+0000 7faf13e129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.009+0000 7faf13e129c0 20 realm 2024-09-12T00:53:01.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.009+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.009+0000 7faf13e129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.009+0000 7faf13e129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.009+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.009+0000 7faf13e129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.009+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.009+0000 7faf13e129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.009+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.013+0000 7faf13e129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:01.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.013+0000 7faf13e129c0 20 searching for the correct realm 2024-09-12T00:53:01.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.013+0000 7faf12119640 0 -- 172.21.15.102:0/2374453228 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7faf08044450 msgr2=0x7faf08044890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.229+0000 7faf11117640 0 -- 172.21.15.102:0/2374453228 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7faf04123b20 msgr2=0x7faf04138130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:01.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.445+0000 7faf13e129c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:53:01.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.445+0000 7faf13e129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:01.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.445+0000 7faf13e129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:01.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.445+0000 7faf13e129c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:53:01.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.445+0000 7faf13e129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:01.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.445+0000 7faf13e129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:01.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.445+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:01.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 zone default found 2024-09-12T00:53:01.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 4 Realm: () 2024-09-12T00:53:01.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:53:01.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:53:01.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:01.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 zonegroup default 2024-09-12T00:53:01.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.449+0000 7faf13e129c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.453+0000 7faf13e129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.453+0000 7faf13e129c0 20 started sync module instance, tier type = 2024-09-12T00:53:01.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.453+0000 7faf13e129c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:53:01.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.473+0000 7faf13e129c0 20 add_watcher() i=0 2024-09-12T00:53:01.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.473+0000 7faf13e129c0 20 add_watcher() i=1 2024-09-12T00:53:01.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.473+0000 7faf13e129c0 20 add_watcher() i=2 2024-09-12T00:53:01.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.473+0000 7faf13e129c0 20 add_watcher() i=3 2024-09-12T00:53:01.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.473+0000 7faf13e129c0 20 add_watcher() i=4 2024-09-12T00:53:01.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.473+0000 7faf13e129c0 20 add_watcher() i=5 2024-09-12T00:53:01.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.473+0000 7faf13e129c0 20 add_watcher() i=6 2024-09-12T00:53:01.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.477+0000 7faf13e129c0 20 add_watcher() i=7 2024-09-12T00:53:01.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.477+0000 7faf13e129c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:01.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.477+0000 7fadc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.481+0000 7faf13e129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:01.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.481+0000 7faf13e129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:01.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.565+0000 7fadc27fc640 20 reqs_thread_entry: start 2024-09-12T00:53:01.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.565+0000 7faf13e129c0 20 init_complete bucket index max shards: 11 2024-09-12T00:53:01.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.565+0000 7faf13e129c0 20 Filter name: none 2024-09-12T00:53:01.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.565+0000 7fad33fff640 20 reqs_thread_entry: start 2024-09-12T00:53:01.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.565+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:53:01.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.565+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.569+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.569+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.569+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:53:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.573+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.573+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.573+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.573+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:53:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.577+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.577+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.581+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.581+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:53:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.585+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.585+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.585+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.589+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:53:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.589+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.589+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.593+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.593+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:53:01.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.597+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.597+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.597+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.597+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:53:01.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.601+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.605+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.605+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.609+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:53:01.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.613+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.613+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.613+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.617+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:53:01.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.617+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.621+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.621+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.625+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:53:01.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.625+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.629+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.629+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.629+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:53:01.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.633+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.633+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.637+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.637+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:53:01.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.641+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.641+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.645+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.649+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:53:01.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.649+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.653+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.653+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.657+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:53:01.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.657+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.661+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.661+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.661+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:53:01.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.665+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.669+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.669+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.669+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:53:01.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.673+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.677+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.677+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.677+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:53:01.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.681+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.681+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.681+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.685+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:53:01.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.689+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.689+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.689+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.693+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:53:01.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.697+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.697+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.697+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.701+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:53:01.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.705+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.705+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.705+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.705+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:53:01.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.709+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.713+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.713+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.717+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:53:01.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.717+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.717+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.721+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.721+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:53:01.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.725+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.725+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.725+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.729+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:53:01.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.733+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.733+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.737+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.737+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:53:01.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.741+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.741+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.745+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.745+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:53:01.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.749+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.749+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.753+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.753+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:53:01.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.757+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.757+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.757+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.761+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:53:01.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.765+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.765+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.765+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.769+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:53:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.773+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.773+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.773+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.777+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:53:01.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.781+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.781+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.781+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.785+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:53:01.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.789+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.789+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.789+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.793+0000 7faf13e129c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:53:01.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.793+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.797+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:01.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.797+0000 7faf13e129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:01.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.801+0000 7fadc37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:01.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.805+0000 7faf13e129c0 20 remove_watcher() i=0 2024-09-12T00:53:01.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.805+0000 7faf13e129c0 2 removed watcher, disabling cache 2024-09-12T00:53:01.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.809+0000 7faf13e129c0 20 remove_watcher() i=1 2024-09-12T00:53:01.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.813+0000 7faf13e129c0 20 remove_watcher() i=2 2024-09-12T00:53:01.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.813+0000 7faf13e129c0 20 remove_watcher() i=3 2024-09-12T00:53:01.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.817+0000 7faf13e129c0 20 remove_watcher() i=4 2024-09-12T00:53:01.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.817+0000 7faf13e129c0 20 remove_watcher() i=5 2024-09-12T00:53:01.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.817+0000 7faf13e129c0 20 remove_watcher() i=6 2024-09-12T00:53:01.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.821+0000 7faf13e129c0 20 remove_watcher() i=7 2024-09-12T00:53:01.838 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T00:53:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:01.912 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:01.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.957+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.957+0000 7fe36ad1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.957+0000 7fe36ad1b9c0 20 realm 2024-09-12T00:53:01.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.957+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.957+0000 7fe36ad1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.957+0000 7fe36ad1b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:01.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.957+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.957+0000 7fe36ad1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:01.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.957+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.961+0000 7fe36ad1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:01.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.961+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:01.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.961+0000 7fe36ad1b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:01.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.961+0000 7fe36ad1b9c0 20 searching for the correct realm 2024-09-12T00:53:01.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:01.965+0000 7fe369022640 0 -- 172.21.15.102:0/3236995571 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fe35c07c9e0 msgr2=0x7fe35c01ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:02.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.181+0000 7fe368020640 0 -- 172.21.15.102:0/3236995571 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fe36008c040 msgr2=0x7fe360083650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:02.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T00:53:02.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:02.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:02.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T00:53:02.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:02.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:02.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:02.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.397+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:02.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 zone default found 2024-09-12T00:53:02.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 4 Realm: () 2024-09-12T00:53:02.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T00:53:02.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T00:53:02.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:02.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 zonegroup default 2024-09-12T00:53:02.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:53:02.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:02.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 started sync module instance, tier type = 2024-09-12T00:53:02.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.401+0000 7fe36ad1b9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T00:53:02.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.425+0000 7fe36ad1b9c0 20 add_watcher() i=0 2024-09-12T00:53:02.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.425+0000 7fe36ad1b9c0 20 add_watcher() i=1 2024-09-12T00:53:02.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.425+0000 7fe36ad1b9c0 20 add_watcher() i=2 2024-09-12T00:53:02.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.425+0000 7fe36ad1b9c0 20 add_watcher() i=3 2024-09-12T00:53:02.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.425+0000 7fe36ad1b9c0 20 add_watcher() i=4 2024-09-12T00:53:02.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.425+0000 7fe36ad1b9c0 20 add_watcher() i=5 2024-09-12T00:53:02.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.425+0000 7fe36ad1b9c0 20 add_watcher() i=6 2024-09-12T00:53:02.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.429+0000 7fe36ad1b9c0 20 add_watcher() i=7 2024-09-12T00:53:02.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.429+0000 7fe36ad1b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:02.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.433+0000 7fe21efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:02.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.437+0000 7fe36ad1b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:02.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.437+0000 7fe36ad1b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:02.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.529+0000 7fe21dfe3640 20 reqs_thread_entry: start 2024-09-12T00:53:02.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.529+0000 7fe36ad1b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:53:02.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.529+0000 7fe36ad1b9c0 20 Filter name: none 2024-09-12T00:53:02.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.529+0000 7fe18f7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:02.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.529+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:53:02.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.533+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.533+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.533+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.537+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:53:02.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.537+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.537+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.541+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.541+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:53:02.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.545+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.545+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.545+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.549+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:53:02.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.553+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.553+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.557+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.557+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:53:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.561+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.565+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.565+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.569+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:53:02.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.569+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.573+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.573+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.573+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:53:02.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.577+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.577+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.581+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.581+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:53:02.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.585+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.585+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.585+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.589+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:53:02.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.593+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.593+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.597+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.601+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:53:02.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.601+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.605+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.605+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.609+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:53:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.609+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.613+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.613+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.613+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:53:02.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.617+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.617+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.621+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.621+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:53:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.625+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.625+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.625+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.629+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:53:02.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.629+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.633+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.633+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.633+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:53:02.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.637+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.637+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.641+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.641+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:53:02.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.645+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.649+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.649+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.649+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:53:02.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.653+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.653+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.657+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.657+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:53:02.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.661+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.665+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.665+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.669+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:53:02.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.669+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.669+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.669+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.673+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:53:02.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.677+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.677+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.677+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.681+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:53:02.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.685+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.685+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.685+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.689+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:53:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.693+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.693+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.693+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.693+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:53:02.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.697+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.701+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.701+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.701+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:53:02.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.705+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.709+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.709+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.709+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:53:02.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.713+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.713+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.713+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.717+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:53:02.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.721+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.721+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.721+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.725+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:53:02.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.729+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.729+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.733+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.733+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:53:02.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.737+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.737+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.741+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.741+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:53:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.745+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.749+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.749+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.753+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:53:02.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.757+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.757+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.757+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.761+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:53:02.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.765+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.765+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.765+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.769+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:53:02.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.773+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.773+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:53:02.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.773+0000 7fe36ad1b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:53:02.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.781+0000 7fe21efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:02.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.785+0000 7fe36ad1b9c0 20 remove_watcher() i=0 2024-09-12T00:53:02.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.785+0000 7fe36ad1b9c0 2 removed watcher, disabling cache 2024-09-12T00:53:02.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.789+0000 7fe36ad1b9c0 20 remove_watcher() i=1 2024-09-12T00:53:02.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.793+0000 7fe36ad1b9c0 20 remove_watcher() i=2 2024-09-12T00:53:02.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.793+0000 7fe36ad1b9c0 20 remove_watcher() i=3 2024-09-12T00:53:02.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.797+0000 7fe36ad1b9c0 20 remove_watcher() i=4 2024-09-12T00:53:02.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.797+0000 7fe36ad1b9c0 20 remove_watcher() i=5 2024-09-12T00:53:02.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.801+0000 7fe36ad1b9c0 20 remove_watcher() i=6 2024-09-12T00:53:02.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T00:53:02.805+0000 7fe36ad1b9c0 20 remove_watcher() i=7 2024-09-12T00:53:02.832 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T00:53:03.544 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :clean 2024-09-12T00:53:04.342 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :compileJava 2024-09-12T00:53:04.342 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :processResources 2024-09-12T00:53:04.342 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :classes 2024-09-12T00:53:04.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:04.942 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :compileTestJava 2024-09-12T00:53:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:53:04.943 INFO:teuthology.orchestra.run.smithi102.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:53:04.944 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:04.944 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:53:04.944 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :testClasses 2024-09-12T00:53:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:06.943 INFO:teuthology.orchestra.run.smithi102.stdout:> Task :test 2024-09-12T00:53:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:06.943 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:53:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12 00:53:06,324 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:53:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:06.943 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T00:53:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:06.944 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T00:53:08.243 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:08.243 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T00:53:08.442 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:08.442 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T00:53:09.242 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:09.242 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T00:53:09.442 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:09.443 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T00:53:10.142 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:10.142 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T00:53:30.443 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:30.443 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T00:53:31.142 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:31.142 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T00:53:31.342 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:31.342 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T00:53:32.042 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:32.042 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T00:53:32.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:32.542 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T00:53:33.342 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:33.343 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T00:53:33.343 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:33.343 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T00:53:33.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:33.542 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T00:53:33.642 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:33.642 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T00:53:34.342 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:34.342 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T00:53:42.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:42.943 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T00:53:43.642 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:43.642 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T00:53:44.042 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:44.042 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T00:53:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:44.742 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T00:53:45.142 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:45.142 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T00:53:45.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:45.942 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T00:53:46.142 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:46.142 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T00:53:46.842 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:46.842 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T00:53:47.042 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:47.042 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T00:53:47.742 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:47.742 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T00:53:47.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:47.942 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T00:53:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:48.542 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T00:53:48.742 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:48.742 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T00:53:49.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:49.543 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T00:53:49.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:49.942 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T00:53:50.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:53:50.542 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T00:54:03.242 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:54:03.242 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T00:54:04.642 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:54:04.642 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T00:55:13.243 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:13.244 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T00:55:14.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:14.542 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T00:55:14.742 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:14.742 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T00:55:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:15.442 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T00:55:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:15.642 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T00:55:16.842 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:16.842 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T00:55:38.342 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:38.343 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T00:55:39.142 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:39.142 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T00:55:39.242 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:39.242 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T00:55:39.342 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:39.342 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T00:55:56.642 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:55:56.642 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T00:56:01.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:56:01.542 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:56:01.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12 00:56:01,439 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:56:01.542 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12 00:56:01,524 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:56:02.642 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:56:02.642 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:56:35.843 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:56:35.843 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:56:36.942 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:56:36.942 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T00:56:48.842 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:56:48.842 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T00:56:49.541 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:56:49.542 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T00:58:07.742 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:58:07.743 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T00:58:08.441 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:58:08.441 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T00:58:23.842 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:58:23.842 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T00:58:24.441 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:58:24.441 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T00:58:36.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:58:36.242 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T00:58:36.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:58:36.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T00:58:41.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:58:41.742 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T00:59:03.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:03.842 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T00:59:03.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:03.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T00:59:04.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:04.041 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T00:59:04.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:04.241 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T00:59:05.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:05.042 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T00:59:05.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:05.241 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T00:59:05.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:05.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T00:59:06.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:06.241 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T00:59:06.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:06.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T00:59:07.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:07.141 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T00:59:07.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:07.841 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T00:59:07.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:07.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T00:59:08.641 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:08.641 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T00:59:08.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:08.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T00:59:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:09.742 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T00:59:10.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:10.341 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T00:59:11.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:11.341 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T00:59:11.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:11.841 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T00:59:12.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:12.841 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T00:59:13.541 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:13.541 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T00:59:14.541 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:14.541 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T00:59:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:15.141 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T00:59:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:16.141 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T00:59:16.644 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:16.644 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T00:59:17.641 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:17.641 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T00:59:18.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:18.141 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T00:59:19.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T00:59:19.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:19.741 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T00:59:20.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:20.741 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T00:59:21.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:21.241 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T00:59:22.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:22.241 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T00:59:22.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:22.841 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T00:59:23.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:23.741 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T00:59:24.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:24.341 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T00:59:25.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:25.341 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T00:59:25.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:25.841 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T00:59:26.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:26.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T00:59:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:27.341 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T00:59:28.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:28.341 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T00:59:28.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:28.741 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T00:59:29.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:29.741 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:30.241 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T00:59:31.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:31.341 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T00:59:31.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:31.841 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T00:59:32.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:32.841 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T00:59:33.441 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:33.441 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T00:59:34.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:34.341 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T00:59:34.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:34.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T00:59:35.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:35.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T00:59:36.441 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:36.441 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T00:59:37.441 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:37.441 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T00:59:37.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:38.015 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T00:59:38.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:38.841 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T00:59:39.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:39.341 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T00:59:40.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:40.241 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T00:59:40.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:40.741 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T00:59:41.641 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:41.641 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T00:59:42.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:42.041 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T00:59:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:43.041 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T00:59:43.242 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:43.242 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T00:59:43.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:43.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T00:59:44.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:44.041 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T00:59:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:44.741 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T00:59:45.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:45.041 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T00:59:45.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:45.841 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T00:59:46.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:46.141 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T00:59:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:46.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T00:59:47.541 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:47.541 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T00:59:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:48.241 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T00:59:48.341 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:48.341 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T00:59:48.441 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:48.441 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T00:59:48.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:48.741 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T00:59:49.441 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:49.441 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T00:59:49.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:49.741 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T00:59:50.541 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:50.541 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T00:59:50.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:50.941 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T00:59:51.641 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:51.643 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T00:59:51.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:51.841 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T00:59:52.541 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T00:59:52.541 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T01:00:04.641 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:04.641 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T01:00:05.441 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:05.441 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T01:00:18.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:18.041 INFO:teuthology.orchestra.run.smithi102.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T01:00:18.918 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:18.918 INFO:teuthology.orchestra.run.smithi102.stdout:---------------------------------------------------------------------- 2024-09-12T01:00:18.918 INFO:teuthology.orchestra.run.smithi102.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T01:00:18.918 INFO:teuthology.orchestra.run.smithi102.stdout:---------------------------------------------------------------------- 2024-09-12T01:00:18.918 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:18.918 INFO:teuthology.orchestra.run.smithi102.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:00:18.918 INFO:teuthology.orchestra.run.smithi102.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:00:18.918 INFO:teuthology.orchestra.run.smithi102.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:00:18.918 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:18.918 INFO:teuthology.orchestra.run.smithi102.stdout:BUILD SUCCESSFUL in 7m 15s 2024-09-12T01:00:18.919 INFO:teuthology.orchestra.run.smithi102.stdout:5 actionable tasks: 5 executed 2024-09-12T01:00:18.926 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T01:00:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:18.953 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:18.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:18.997+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:18.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:18.997+0000 7fbd7028a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:18.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:18.997+0000 7fbd7028a9c0 20 realm 2024-09-12T01:00:18.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:18.997+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:18.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:18.997+0000 7fbd7028a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:18.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:18.997+0000 7fbd7028a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:18.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:18.997+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:18.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.001+0000 7fbd7028a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:18.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.001+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:19.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.001+0000 7fbd7028a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:19.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.001+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:19.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.001+0000 7fbd7028a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:19.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.001+0000 7fbd7028a9c0 20 searching for the correct realm 2024-09-12T01:00:19.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.005+0000 7fbd6e591640 0 -- 172.21.15.102:0/3739394717 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fbd58048060 msgr2=0x7fbd58022920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:19.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.221+0000 7fbd6d58f640 0 -- 172.21.15.102:0/3739394717 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fbd600ee190 msgr2=0x7fbd600e4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:19.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:19.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:19.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:19.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:19.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:19.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:19.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:19.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 zone default found 2024-09-12T01:00:19.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 4 Realm: () 2024-09-12T01:00:19.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:19.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:19.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:19.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 zonegroup default 2024-09-12T01:00:19.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:19.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:19.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.441+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:19.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.445+0000 7fbd7028a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:19.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.445+0000 7fbd7028a9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:19.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.445+0000 7fbd7028a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:19.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.445+0000 7fbd7028a9c0 20 started sync module instance, tier type = 2024-09-12T01:00:19.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.445+0000 7fbd7028a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:19.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.469+0000 7fbd7028a9c0 20 add_watcher() i=0 2024-09-12T01:00:19.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.469+0000 7fbd7028a9c0 20 add_watcher() i=1 2024-09-12T01:00:19.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.469+0000 7fbd7028a9c0 20 add_watcher() i=2 2024-09-12T01:00:19.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.469+0000 7fbd7028a9c0 20 add_watcher() i=3 2024-09-12T01:00:19.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.469+0000 7fbd7028a9c0 20 add_watcher() i=4 2024-09-12T01:00:19.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.469+0000 7fbd7028a9c0 20 add_watcher() i=5 2024-09-12T01:00:19.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.469+0000 7fbd7028a9c0 20 add_watcher() i=6 2024-09-12T01:00:19.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.469+0000 7fbd7028a9c0 20 add_watcher() i=7 2024-09-12T01:00:19.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.469+0000 7fbd7028a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:19.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.473+0000 7fbc23fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:19.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.477+0000 7fbd7028a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:19.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.477+0000 7fbd7028a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:19.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.561+0000 7fbc22fe5640 20 reqs_thread_entry: start 2024-09-12T01:00:19.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.561+0000 7fbd7028a9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:19.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.561+0000 7fbd7028a9c0 20 Filter name: none 2024-09-12T01:00:19.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.561+0000 7fbc20fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:19.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.561+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:00:19.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:19.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5587967792251971586', time=2024-09-12T02:54:03.409122+0000, chain.objs.size()=9 2024-09-12T01:00:19.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__multipart_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.1 2024-09-12T01:00:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__shadow_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.1_1 2024-09-12T01:00:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__multipart_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.2 2024-09-12T01:00:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__shadow_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.2_1 2024-09-12T01:00:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__multipart_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.3 2024-09-12T01:00:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__shadow_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.3_1 2024-09-12T01:00:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__multipart_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.4 2024-09-12T01:00:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__shadow_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.4_1 2024-09-12T01:00:19.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.565+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__multipart_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.5 2024-09-12T01:00:19.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.577+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.581+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:00:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3387936570321227715', time=2024-09-12T02:57:33.320820+0000, chain.objs.size()=9 2024-09-12T01:00:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~LQ9sz52C0MlbHqGGWUg4Uar18DurEWE.1 2024-09-12T01:00:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~LQ9sz52C0MlbHqGGWUg4Uar18DurEWE.1_1 2024-09-12T01:00:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~LQ9sz52C0MlbHqGGWUg4Uar18DurEWE.2 2024-09-12T01:00:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~LQ9sz52C0MlbHqGGWUg4Uar18DurEWE.2_1 2024-09-12T01:00:19.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~LQ9sz52C0MlbHqGGWUg4Uar18DurEWE.3 2024-09-12T01:00:19.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~LQ9sz52C0MlbHqGGWUg4Uar18DurEWE.3_1 2024-09-12T01:00:19.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~LQ9sz52C0MlbHqGGWUg4Uar18DurEWE.4 2024-09-12T01:00:19.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~LQ9sz52C0MlbHqGGWUg4Uar18DurEWE.4_1 2024-09-12T01:00:19.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~LQ9sz52C0MlbHqGGWUg4Uar18DurEWE.5 2024-09-12T01:00:19.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17199927427728819494', time=2024-09-12T02:57:56.033431+0000, chain.objs.size()=7 2024-09-12T01:00:19.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~5dsslYd7XYgAIXvaQEPVhbS3iQRxLXB.1 2024-09-12T01:00:19.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~5dsslYd7XYgAIXvaQEPVhbS3iQRxLXB.1_1 2024-09-12T01:00:19.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.585+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~5dsslYd7XYgAIXvaQEPVhbS3iQRxLXB.1_2 2024-09-12T01:00:19.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.593+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~5dsslYd7XYgAIXvaQEPVhbS3iQRxLXB.2 2024-09-12T01:00:19.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.593+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~5dsslYd7XYgAIXvaQEPVhbS3iQRxLXB.2_1 2024-09-12T01:00:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.601+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~5dsslYd7XYgAIXvaQEPVhbS3iQRxLXB.2_2 2024-09-12T01:00:19.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.601+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~5dsslYd7XYgAIXvaQEPVhbS3iQRxLXB.3 2024-09-12T01:00:19.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.609+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.613+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:00:19.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.617+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.617+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.617+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:19.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.617+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13833969826607744033', time=2024-09-12T02:59:24.722973+0000, chain.objs.size()=1 2024-09-12T01:00:19.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.617+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.122__shadow_.-UHSKm4ibsl9arFD8I53Btr3-vUsmWI_0 2024-09-12T01:00:19.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.617+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6679388365516260250', time=2024-09-12T02:59:30.702974+0000, chain.objs.size()=1 2024-09-12T01:00:19.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.617+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.126__shadow_.O4PtkMxLNJnEUGqc3GA5geT5yQQYQ3e_0 2024-09-12T01:00:19.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.621+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.625+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:00:19.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.625+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.625+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13036795167633061528', time=2024-09-12T02:54:04.043196+0000, chain.objs.size()=9 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__multipart_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.1 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__shadow_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.1_1 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__multipart_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.2 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__shadow_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.2_1 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__multipart_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.3 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__shadow_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.3_1 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__multipart_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.4 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__shadow_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.4_1 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.92__multipart_key1.2~_nmLN-srLh6YZlPKsTa6ROZGTeOAffE.5 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10672509916804044438', time=2024-09-12T02:59:16.913893+0000, chain.objs.size()=1 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.117__shadow_.uyuuL3hyJRlu2gIBr3SRBcBeUagbIoB_0 2024-09-12T01:00:19.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8616375778843660086', time=2024-09-12T02:59:27.628871+0000, chain.objs.size()=1 2024-09-12T01:00:19.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.124__shadow_.OBUojtj7Pxgle1AzGmOEr__kxPeDnZb_0 2024-09-12T01:00:19.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11437429846975320596', time=2024-09-12T02:59:32.281054+0000, chain.objs.size()=1 2024-09-12T01:00:19.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.629+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.127__shadow_.PLsbz9bSd-UN239W1AnsN-WdU-hJXqM_0 2024-09-12T01:00:19.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.645+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.649+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:00:19.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:19.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14752346668799096310', time=2024-09-12T02:56:36.252710+0000, chain.objs.size()=5 2024-09-12T01:00:19.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__multipart_file2.mpg.2~HYbZMkBrPiBD089mGCKtpQn8AKeJm1a.1 2024-09-12T01:00:19.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__multipart_file2.mpg.2~HYbZMkBrPiBD089mGCKtpQn8AKeJm1a.2 2024-09-12T01:00:19.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__multipart_file2.mpg.2~HYbZMkBrPiBD089mGCKtpQn8AKeJm1a.3 2024-09-12T01:00:19.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__multipart_file2.mpg.2~HYbZMkBrPiBD089mGCKtpQn8AKeJm1a.4 2024-09-12T01:00:19.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__multipart_file2.mpg.2~HYbZMkBrPiBD089mGCKtpQn8AKeJm1a.5 2024-09-12T01:00:19.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2024991565281646680', time=2024-09-12T02:59:16.988495+0000, chain.objs.size()=1 2024-09-12T01:00:19.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.653+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.117__shadow_.S1mKY8tQReX32zp0_5LFqx-mbeqV1yx_0 2024-09-12T01:00:19.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.661+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.665+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:00:19.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8142434403300062052', time=2024-09-12T02:53:43.096703+0000, chain.objs.size()=3 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.84__shadow_.59qy8b3xGA3zCFM2Op6L5vLqrv5klJ__0 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.84__shadow_.59qy8b3xGA3zCFM2Op6L5vLqrv5klJ__1 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.84__shadow_.59qy8b3xGA3zCFM2Op6L5vLqrv5klJ__2 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9815125237864804451', time=2024-09-12T02:59:18.548550+0000, chain.objs.size()=1 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.118__shadow_.PBhu_SvtbcNsnK0y1uA7yNH3kQhyhNw_0 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6466846766719108546', time=2024-09-12T02:59:24.646717+0000, chain.objs.size()=1 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.122__shadow_.imh8ohHYMRk5I2Y6KylNB_7ZlFsB1eX_0 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11672475470243431661', time=2024-09-12T02:59:33.674056+0000, chain.objs.size()=1 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.128__shadow_.M2zUYH5ppnxrVOQULk6no8kez99ylo5_0 2024-09-12T01:00:19.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1126130303110694529', time=2024-09-12T02:59:48.918078+0000, chain.objs.size()=1 2024-09-12T01:00:19.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.669+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.140__shadow_.wnbbAJlnq6sLogB1ESIhBj6gR1XYgjc_0 2024-09-12T01:00:19.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.681+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.685+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:00:19.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.685+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:00:19.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1687006040372807515', time=2024-09-12T02:58:07.893937+0000, chain.objs.size()=7 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~d2fuFgPTdp2S4N92W7uV8yTRkOeUZwk.1 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~d2fuFgPTdp2S4N92W7uV8yTRkOeUZwk.1_1 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~d2fuFgPTdp2S4N92W7uV8yTRkOeUZwk.1_2 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~d2fuFgPTdp2S4N92W7uV8yTRkOeUZwk.2 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~d2fuFgPTdp2S4N92W7uV8yTRkOeUZwk.2_1 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~d2fuFgPTdp2S4N92W7uV8yTRkOeUZwk.2_2 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~d2fuFgPTdp2S4N92W7uV8yTRkOeUZwk.3 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11036467552713112909', time=2024-09-12T02:59:26.085674+0000, chain.objs.size()=1 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.123__shadow_.ydKF6RfAi_CaPwH-nVvEXzDPTjk9gdY_0 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4557536981334271950', time=2024-09-12T02:59:26.158534+0000, chain.objs.size()=1 2024-09-12T01:00:19.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.689+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.123__shadow_.1VUZtbcNtFpZAW0wkaR3LMwJTJfPLTb_0 2024-09-12T01:00:19.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.697+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.701+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:00:19.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.701+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:00:19.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11187080703830616148', time=2024-09-12T02:55:13.441477+0000, chain.objs.size()=6 2024-09-12T01:00:19.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.94__shadow_.cvyulMZ1TVauZlbgd-iDtT2iYZaJyk0_0 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.94__shadow_.cvyulMZ1TVauZlbgd-iDtT2iYZaJyk0_1 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.94__shadow_.cvyulMZ1TVauZlbgd-iDtT2iYZaJyk0_2 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.94__shadow_.cvyulMZ1TVauZlbgd-iDtT2iYZaJyk0_3 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.94__shadow_.cvyulMZ1TVauZlbgd-iDtT2iYZaJyk0_4 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.94__shadow_.cvyulMZ1TVauZlbgd-iDtT2iYZaJyk0_5 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10570049972924560026', time=2024-09-12T02:56:36.084355+0000, chain.objs.size()=9 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__multipart_file.mpg.2~WiO1HK4puZxlJEjm4GAaPkbHh--9nss.1 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__shadow_file.mpg.2~WiO1HK4puZxlJEjm4GAaPkbHh--9nss.1_1 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__multipart_file.mpg.2~WiO1HK4puZxlJEjm4GAaPkbHh--9nss.2 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__shadow_file.mpg.2~WiO1HK4puZxlJEjm4GAaPkbHh--9nss.2_1 2024-09-12T01:00:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__multipart_file.mpg.2~WiO1HK4puZxlJEjm4GAaPkbHh--9nss.3 2024-09-12T01:00:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.705+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__shadow_file.mpg.2~WiO1HK4puZxlJEjm4GAaPkbHh--9nss.3_1 2024-09-12T01:00:19.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.709+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__multipart_file.mpg.2~WiO1HK4puZxlJEjm4GAaPkbHh--9nss.4 2024-09-12T01:00:19.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.713+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__shadow_file.mpg.2~WiO1HK4puZxlJEjm4GAaPkbHh--9nss.4_1 2024-09-12T01:00:19.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.713+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__multipart_file.mpg.2~WiO1HK4puZxlJEjm4GAaPkbHh--9nss.5 2024-09-12T01:00:19.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.713+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7238953362991797938', time=2024-09-12T02:58:36.375883+0000, chain.objs.size()=9 2024-09-12T01:00:19.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.713+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.105__multipart_key1.2~GomFmNmkFxUsszIOqPHbfOUN3m3eAHC.1 2024-09-12T01:00:19.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.713+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.105__shadow_key1.2~GomFmNmkFxUsszIOqPHbfOUN3m3eAHC.1_1 2024-09-12T01:00:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.713+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.105__multipart_key1.2~GomFmNmkFxUsszIOqPHbfOUN3m3eAHC.2 2024-09-12T01:00:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.713+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.105__shadow_key1.2~GomFmNmkFxUsszIOqPHbfOUN3m3eAHC.2_1 2024-09-12T01:00:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.713+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.105__multipart_key1.2~GomFmNmkFxUsszIOqPHbfOUN3m3eAHC.3 2024-09-12T01:00:19.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.713+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.105__shadow_key1.2~GomFmNmkFxUsszIOqPHbfOUN3m3eAHC.3_1 2024-09-12T01:00:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.717+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.105__multipart_key1.2~GomFmNmkFxUsszIOqPHbfOUN3m3eAHC.4 2024-09-12T01:00:19.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.717+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.105__shadow_key1.2~GomFmNmkFxUsszIOqPHbfOUN3m3eAHC.4_1 2024-09-12T01:00:19.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.721+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.105__multipart_key1.2~GomFmNmkFxUsszIOqPHbfOUN3m3eAHC.5 2024-09-12T01:00:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.721+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1165288814223291361', time=2024-09-12T02:59:30.479734+0000, chain.objs.size()=1 2024-09-12T01:00:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.721+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.126__shadow_.5Z7jY6zLNuQVnAif_VmsU05k1Fp17wD_0 2024-09-12T01:00:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.721+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160009165685114127', time=2024-09-12T02:59:33.733113+0000, chain.objs.size()=1 2024-09-12T01:00:19.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.721+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.128__shadow_.wo0jNgPU_Z3Yt1PyG3ZUrBHNH_1Gxj8_0 2024-09-12T01:00:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.721+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4648749185430453135', time=2024-09-12T02:59:35.284255+0000, chain.objs.size()=1 2024-09-12T01:00:19.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.721+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.129__shadow_.OgY7c0OxJvf7ZE6wuzHVwADvpJaI-gy_0 2024-09-12T01:00:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.725+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18256111010392946762', time=2024-09-12T02:59:39.487313+0000, chain.objs.size()=1 2024-09-12T01:00:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.725+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.132__shadow_.PoFMNNIuFfVwWysd-AZhnmXntfiOp0O_0 2024-09-12T01:00:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.729+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.733+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:00:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.733+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15551522085225925255', time=2024-09-12T02:53:32.762008+0000, chain.objs.size()=1 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.82__shadow_.4-SvhjmC2wnehFzkGVihMg0-H3Rdzva_0 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4580686812878993348', time=2024-09-12T02:58:19.913510+0000, chain.objs.size()=1 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.104__shadow_.be58Ayl2ghy0XppROsDhAfJNImYkWU6_0 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12758840820998537652', time=2024-09-12T02:59:12.071229+0000, chain.objs.size()=1 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.114__shadow_.aterq1AedacPdKFkuoGQKeVQjfUsN-b_0 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14072727561176633952', time=2024-09-12T02:59:15.355526+0000, chain.objs.size()=1 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.116__shadow_.OI5xsk9vzJd74Qv_HRG13MlYJjrHIRI_0 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9769757613594552668', time=2024-09-12T02:59:35.125478+0000, chain.objs.size()=1 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.129__shadow_.p50ss-32kReTfAsWG2_heb8TC3pzTSk_0 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6396171176028757661', time=2024-09-12T02:59:40.969004+0000, chain.objs.size()=1 2024-09-12T01:00:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.737+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.133__shadow_.M8EKYUxQmHgwWSYUtZ2dzuq9Nayq5cl_0 2024-09-12T01:00:19.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.741+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:00:19.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:00:19.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15284379613092745109', time=2024-09-12T02:53:45.306314+0000, chain.objs.size()=1 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.86__shadow_.q52sTuRzTCcukMJtyluxOCgNEcWH18-_0 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15906929259100813376', time=2024-09-12T02:54:35.079318+0000, chain.objs.size()=9 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~ZOVb6uJl1sEPY3w6So7Egmt_KgXMUMW.1 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~ZOVb6uJl1sEPY3w6So7Egmt_KgXMUMW.1_1 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~ZOVb6uJl1sEPY3w6So7Egmt_KgXMUMW.2 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~ZOVb6uJl1sEPY3w6So7Egmt_KgXMUMW.2_1 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~ZOVb6uJl1sEPY3w6So7Egmt_KgXMUMW.3 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~ZOVb6uJl1sEPY3w6So7Egmt_KgXMUMW.3_1 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~ZOVb6uJl1sEPY3w6So7Egmt_KgXMUMW.4 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~ZOVb6uJl1sEPY3w6So7Egmt_KgXMUMW.4_1 2024-09-12T01:00:19.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~ZOVb6uJl1sEPY3w6So7Egmt_KgXMUMW.5 2024-09-12T01:00:19.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15198378806328724182', time=2024-09-12T02:54:54.850523+0000, chain.objs.size()=9 2024-09-12T01:00:19.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~_-j_aJqy6MRLh3QPXVLJD4rqDbCp5fI.1 2024-09-12T01:00:19.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.745+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~_-j_aJqy6MRLh3QPXVLJD4rqDbCp5fI.1_1 2024-09-12T01:00:19.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~_-j_aJqy6MRLh3QPXVLJD4rqDbCp5fI.2 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~_-j_aJqy6MRLh3QPXVLJD4rqDbCp5fI.2_1 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~_-j_aJqy6MRLh3QPXVLJD4rqDbCp5fI.3 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~_-j_aJqy6MRLh3QPXVLJD4rqDbCp5fI.3_1 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~_-j_aJqy6MRLh3QPXVLJD4rqDbCp5fI.4 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~_-j_aJqy6MRLh3QPXVLJD4rqDbCp5fI.4_1 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~_-j_aJqy6MRLh3QPXVLJD4rqDbCp5fI.5 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14848300588255760832', time=2024-09-12T02:56:36.328440+0000, chain.objs.size()=1 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__shadow_.NAbDuhKr6XqJOqa55GjmH2ASpmhFaLq_0 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13583816378736820116', time=2024-09-12T02:59:13.953975+0000, chain.objs.size()=1 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.115__shadow_.l6aOiZzT818hvBM-Rvx0WssQRz7wUDL_0 2024-09-12T01:00:19.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10541732336159424236', time=2024-09-12T02:59:15.508786+0000, chain.objs.size()=1 2024-09-12T01:00:19.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.116__shadow_.W0AzJA0ymddzJuS0z42Vyu31BBOUf9G_0 2024-09-12T01:00:19.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18237964094688874316', time=2024-09-12T02:59:30.626987+0000, chain.objs.size()=1 2024-09-12T01:00:19.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.753+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.126__shadow_.wplqvxQn9_H_eDyXX-gCTQozOxhNixN_0 2024-09-12T01:00:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.757+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15200668913696940548', time=2024-09-12T02:59:39.635507+0000, chain.objs.size()=1 2024-09-12T01:00:19.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.757+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.132__shadow_.fejihgCyCzzLVbjYjYUvLqtWPnWrTG0_0 2024-09-12T01:00:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.761+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16936942872957974636', time=2024-09-12T03:00:18.336047+0000, chain.objs.size()=1 2024-09-12T01:00:19.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.761+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.145__shadow_.aO53mc-rZV3v09mfIxWkCydFf_huKVG_0 2024-09-12T01:00:19.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.765+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.765+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:00:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.769+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.769+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.769+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.769+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2633956282338246975', time=2024-09-12T02:53:44.183368+0000, chain.objs.size()=1 2024-09-12T01:00:19.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.769+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.85__shadow_.JFeKrCAPm5Wi8_fbLQ21n5gBklFxF_x_0 2024-09-12T01:00:19.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.769+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.773+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:00:19.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.773+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:00:19.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13225940272983477060', time=2024-09-12T02:57:21.848111+0000, chain.objs.size()=9 2024-09-12T01:00:19.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~BS2AfgmpLsgdp7USyXD40HNfRdLGgsF.1 2024-09-12T01:00:19.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~BS2AfgmpLsgdp7USyXD40HNfRdLGgsF.1_1 2024-09-12T01:00:19.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~BS2AfgmpLsgdp7USyXD40HNfRdLGgsF.2 2024-09-12T01:00:19.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~BS2AfgmpLsgdp7USyXD40HNfRdLGgsF.2_1 2024-09-12T01:00:19.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~BS2AfgmpLsgdp7USyXD40HNfRdLGgsF.3 2024-09-12T01:00:19.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~BS2AfgmpLsgdp7USyXD40HNfRdLGgsF.3_1 2024-09-12T01:00:19.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~BS2AfgmpLsgdp7USyXD40HNfRdLGgsF.4 2024-09-12T01:00:19.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~BS2AfgmpLsgdp7USyXD40HNfRdLGgsF.4_1 2024-09-12T01:00:19.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~BS2AfgmpLsgdp7USyXD40HNfRdLGgsF.5 2024-09-12T01:00:19.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2262121567522077164', time=2024-09-12T02:58:07.584173+0000, chain.objs.size()=7 2024-09-12T01:00:19.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~JOmZK6G99uXmd92F5anDeI8pixWOUUo.1 2024-09-12T01:00:19.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~JOmZK6G99uXmd92F5anDeI8pixWOUUo.1_1 2024-09-12T01:00:19.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.777+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~JOmZK6G99uXmd92F5anDeI8pixWOUUo.1_2 2024-09-12T01:00:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.781+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~JOmZK6G99uXmd92F5anDeI8pixWOUUo.2 2024-09-12T01:00:19.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.781+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~JOmZK6G99uXmd92F5anDeI8pixWOUUo.2_1 2024-09-12T01:00:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.781+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~JOmZK6G99uXmd92F5anDeI8pixWOUUo.2_2 2024-09-12T01:00:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.781+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~JOmZK6G99uXmd92F5anDeI8pixWOUUo.3 2024-09-12T01:00:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.781+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12681990923837890846', time=2024-09-12T02:59:24.576327+0000, chain.objs.size()=1 2024-09-12T01:00:19.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.781+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.122__shadow_.SjfSi03579zmaZFI23bhLlY0t4Qk1fZ_0 2024-09-12T01:00:19.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.785+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5608996299226580153', time=2024-09-12T02:59:35.210283+0000, chain.objs.size()=1 2024-09-12T01:00:19.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.785+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.129__shadow_.YoY7iybnP9KG9IV_O_hk4djU3kH3X1m_0 2024-09-12T01:00:19.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.789+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:00:19.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10082370521582171972', time=2024-09-12T02:53:49.730799+0000, chain.objs.size()=1 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.91__shadow_.UbwghNOO_w_Dwj8NkRlQ10eHcJ_YBoG_0 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RDhOsufDQviyY74zSVLUx69GeNTI0LA', time=2024-09-12T02:56:49.264934+0000, chain.objs.size()=9 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.102__multipart_key1.2~RDhOsufDQviyY74zSVLUx69GeNTI0LA.7 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.102__shadow_key1.2~RDhOsufDQviyY74zSVLUx69GeNTI0LA.7_1 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.102__multipart_key1.2~RDhOsufDQviyY74zSVLUx69GeNTI0LA.8 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.102__shadow_key1.2~RDhOsufDQviyY74zSVLUx69GeNTI0LA.8_1 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.102__multipart_key1.2~RDhOsufDQviyY74zSVLUx69GeNTI0LA.9 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.102__shadow_key1.2~RDhOsufDQviyY74zSVLUx69GeNTI0LA.9_1 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.102__multipart_key1.2~RDhOsufDQviyY74zSVLUx69GeNTI0LA.10 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.102__shadow_key1.2~RDhOsufDQviyY74zSVLUx69GeNTI0LA.10_1 2024-09-12T01:00:19.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.102__multipart_key1.2~RDhOsufDQviyY74zSVLUx69GeNTI0LA.11 2024-09-12T01:00:19.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8458201061733144332', time=2024-09-12T02:59:29.026907+0000, chain.objs.size()=1 2024-09-12T01:00:19.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.125__shadow_.GbUIVnvL9-w4k-bKgwKIGO99iu8L7c2_0 2024-09-12T01:00:19.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2776285031695193393', time=2024-09-12T02:59:33.596776+0000, chain.objs.size()=1 2024-09-12T01:00:19.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.793+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.128__shadow_.VBfgUMfq3FzYhCr-Fj3wvZCWfcrP_bR_0 2024-09-12T01:00:19.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.797+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7295058549657734645', time=2024-09-12T02:59:45.265338+0000, chain.objs.size()=1 2024-09-12T01:00:19.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.797+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.137__shadow_.K8kV8pt2iUboECz5r6Wh5ynRXw4vKWz_0 2024-09-12T01:00:19.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.801+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8448108230513511298', time=2024-09-12T02:59:49.945817+0000, chain.objs.size()=1 2024-09-12T01:00:19.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.801+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.141__shadow_.kjGwvvxm0jH0Ivc3wRj9Hr4hfMqFrrE_0 2024-09-12T01:00:19.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.801+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.805+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:00:19.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.805+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:00:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16916555034088560883', time=2024-09-12T02:56:36.161079+0000, chain.objs.size()=1 2024-09-12T01:00:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__shadow_.Bufo2w5ld5DPvGjiiEanv1sNNsP4il1_0 2024-09-12T01:00:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ONcrOZRamM8gqohVVNee7odl6U0FuLp', time=2024-09-12T02:58:54.455938+0000, chain.objs.size()=60 2024-09-12T01:00:19.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.1 2024-09-12T01:00:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.2 2024-09-12T01:00:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.3 2024-09-12T01:00:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.4 2024-09-12T01:00:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.5 2024-09-12T01:00:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.6 2024-09-12T01:00:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.7 2024-09-12T01:00:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.8 2024-09-12T01:00:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.9 2024-09-12T01:00:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.10 2024-09-12T01:00:19.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.809+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.11 2024-09-12T01:00:19.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.813+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.12 2024-09-12T01:00:19.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.813+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.13 2024-09-12T01:00:19.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.813+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.14 2024-09-12T01:00:19.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.813+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.15 2024-09-12T01:00:19.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.817+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.16 2024-09-12T01:00:19.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.817+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.17 2024-09-12T01:00:19.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.817+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.18 2024-09-12T01:00:19.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.817+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.19 2024-09-12T01:00:19.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.817+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.20 2024-09-12T01:00:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.821+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.21 2024-09-12T01:00:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.821+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.22 2024-09-12T01:00:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.821+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.23 2024-09-12T01:00:19.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.821+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.24 2024-09-12T01:00:19.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.821+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.25 2024-09-12T01:00:19.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.821+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.26 2024-09-12T01:00:19.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.27 2024-09-12T01:00:19.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.28 2024-09-12T01:00:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.29 2024-09-12T01:00:19.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.30 2024-09-12T01:00:19.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.31 2024-09-12T01:00:19.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.32 2024-09-12T01:00:19.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.33 2024-09-12T01:00:19.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.34 2024-09-12T01:00:19.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.35 2024-09-12T01:00:19.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.36 2024-09-12T01:00:19.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.825+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.37 2024-09-12T01:00:19.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.829+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.38 2024-09-12T01:00:19.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.829+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.39 2024-09-12T01:00:19.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.829+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.40 2024-09-12T01:00:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.829+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.41 2024-09-12T01:00:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.829+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.42 2024-09-12T01:00:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.829+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.43 2024-09-12T01:00:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.829+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.44 2024-09-12T01:00:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.829+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.45 2024-09-12T01:00:19.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.829+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.46 2024-09-12T01:00:19.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.833+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.47 2024-09-12T01:00:19.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.833+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.48 2024-09-12T01:00:19.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.833+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.49 2024-09-12T01:00:19.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.837+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.50 2024-09-12T01:00:19.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.837+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.51 2024-09-12T01:00:19.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.837+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.52 2024-09-12T01:00:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.837+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.53 2024-09-12T01:00:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.837+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.54 2024-09-12T01:00:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.837+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.55 2024-09-12T01:00:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.837+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.56 2024-09-12T01:00:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.837+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.57 2024-09-12T01:00:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.837+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.58 2024-09-12T01:00:19.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.837+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.59 2024-09-12T01:00:19.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.841+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.106__multipart_key1.2~ONcrOZRamM8gqohVVNee7odl6U0FuLp.60 2024-09-12T01:00:19.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.841+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8056441299620166036', time=2024-09-12T02:59:32.133379+0000, chain.objs.size()=1 2024-09-12T01:00:19.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.841+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.127__shadow_.90UY08-RfQ54YQt_fH5Q4ddiIAdIAtT_0 2024-09-12T01:00:19.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.845+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.849+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:00:19.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.849+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.853+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.853+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:00:19.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.853+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12872399289887349493', time=2024-09-12T02:59:10.655098+0000, chain.objs.size()=1 2024-09-12T01:00:19.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.853+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.113__shadow_.teKQ5i3nSFWxUBrBE6g2g1iABUmEyX-_0 2024-09-12T01:00:19.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.853+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7295364465392282207', time=2024-09-12T02:59:12.289509+0000, chain.objs.size()=1 2024-09-12T01:00:19.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.853+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.114__shadow_.XGtZ6Ppmq5u8IYSU-WHABvUF1q12uAA_0 2024-09-12T01:00:19.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.853+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8485433989576901239', time=2024-09-12T02:59:26.232596+0000, chain.objs.size()=1 2024-09-12T01:00:19.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.853+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.123__shadow_.ZSHVQZ72TfQaJ5HqOXzlWSgOYGTLhX5_0 2024-09-12T01:00:19.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.853+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:00:19.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:00:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7370197930494959320', time=2024-09-12T02:53:08.642840+0000, chain.objs.size()=1 2024-09-12T01:00:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.78__shadow_.WB8HMvfWa7PuCISLY7Hm6UlaITxG1lV_0 2024-09-12T01:00:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16058485240227267147', time=2024-09-12T02:56:36.400201+0000, chain.objs.size()=1 2024-09-12T01:00:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101__shadow_.kgS8Ox1aDRS7LdGY9KfzNNO87gCCKZC_0 2024-09-12T01:00:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.866087164678005466', time=2024-09-12T02:59:19.905058+0000, chain.objs.size()=1 2024-09-12T01:00:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.119__shadow_.4Kg56nLoIwvALZpvo1ThLk8f2z9QgOi_0 2024-09-12T01:00:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17886661492117551704', time=2024-09-12T02:59:39.560530+0000, chain.objs.size()=1 2024-09-12T01:00:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.132__shadow_.GxOZq6-kGkDG7J5snJQWplUn70wuiV4_0 2024-09-12T01:00:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1621917217208781763', time=2024-09-12T02:59:42.285298+0000, chain.objs.size()=1 2024-09-12T01:00:19.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.857+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.134__shadow_._r5KaWHslwMdF5GqlmuDhi8gZnv1Ub0_0 2024-09-12T01:00:19.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.861+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.865+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:00:19.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.865+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.865+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.865+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.865+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2007812079204213881', time=2024-09-12T02:59:12.144228+0000, chain.objs.size()=1 2024-09-12T01:00:19.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.865+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.114__shadow_.2nLa9guZ00TgbZe3kFhoxZsekLv64pi_0 2024-09-12T01:00:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.865+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17046297918949852119', time=2024-09-12T02:59:17.061312+0000, chain.objs.size()=1 2024-09-12T01:00:19.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.865+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.117__shadow_.tkpHjrKsPpObiofzbsDtnDGkDCgzagO_0 2024-09-12T01:00:19.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.869+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.869+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:00:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:00:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7596412132097089980', time=2024-09-12T02:59:21.619388+0000, chain.objs.size()=1 2024-09-12T01:00:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.120__shadow_.6JUpuV6TrfYttRy4w0yntBgfjg8UWKA_0 2024-09-12T01:00:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16949837818603861908', time=2024-09-12T02:59:23.142357+0000, chain.objs.size()=1 2024-09-12T01:00:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.121__shadow_.ab3yc46IxLVzwBj1w5oUXXjp7nAutlC_0 2024-09-12T01:00:19.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10971225462441756547', time=2024-09-12T02:59:26.307009+0000, chain.objs.size()=1 2024-09-12T01:00:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.123__shadow_.IVIO3sW3g_afBoGTqAW7G297tvvJrUn_0 2024-09-12T01:00:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.206545124691885066', time=2024-09-12T02:59:27.703057+0000, chain.objs.size()=1 2024-09-12T01:00:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.124__shadow_.OiLdDwvJrPBTrPGzIXaEHhzbdckzASR_0 2024-09-12T01:00:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11440900710222693076', time=2024-09-12T02:59:32.208004+0000, chain.objs.size()=1 2024-09-12T01:00:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.127__shadow_.vtVdLdQV647VJjFHQwIbFAvK7brnJSE_0 2024-09-12T01:00:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16382776232056501320', time=2024-09-12T02:59:36.835514+0000, chain.objs.size()=1 2024-09-12T01:00:19.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.873+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.130__shadow_.eWWNAEvPNad6oc0pGKoMjfyemSk_GG0_0 2024-09-12T01:00:19.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.877+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:00:19.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:00:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8rkc86ZaUerc9ccknELLPrkp0-tKrt4', time=2024-09-12T02:53:30.384550+0000, chain.objs.size()=9 2024-09-12T01:00:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.80__multipart_key1.2~8rkc86ZaUerc9ccknELLPrkp0-tKrt4.1 2024-09-12T01:00:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.80__shadow_key1.2~8rkc86ZaUerc9ccknELLPrkp0-tKrt4.1_1 2024-09-12T01:00:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.80__multipart_key1.2~8rkc86ZaUerc9ccknELLPrkp0-tKrt4.2 2024-09-12T01:00:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.80__shadow_key1.2~8rkc86ZaUerc9ccknELLPrkp0-tKrt4.2_1 2024-09-12T01:00:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.80__multipart_key1.2~8rkc86ZaUerc9ccknELLPrkp0-tKrt4.3 2024-09-12T01:00:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.80__shadow_key1.2~8rkc86ZaUerc9ccknELLPrkp0-tKrt4.3_1 2024-09-12T01:00:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.80__multipart_key1.2~8rkc86ZaUerc9ccknELLPrkp0-tKrt4.4 2024-09-12T01:00:19.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.80__shadow_key1.2~8rkc86ZaUerc9ccknELLPrkp0-tKrt4.4_1 2024-09-12T01:00:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.80__multipart_key1.2~8rkc86ZaUerc9ccknELLPrkp0-tKrt4.5 2024-09-12T01:00:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1481723401132318837', time=2024-09-12T02:59:20.131200+0000, chain.objs.size()=1 2024-09-12T01:00:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.119__shadow_.COmCgW15OzgBKo-l3frC5swPLljbkTf_0 2024-09-12T01:00:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5432981318739194894', time=2024-09-12T02:59:27.554113+0000, chain.objs.size()=1 2024-09-12T01:00:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.124__shadow_.u4g0YnU2K-c2CnTfN796fYaydKYZOOA_0 2024-09-12T01:00:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9676448602940964166', time=2024-09-12T02:59:28.953459+0000, chain.objs.size()=1 2024-09-12T01:00:19.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.881+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.125__shadow_.-3pfcFJQciQg_gZmERqE78vWsz2lfq-_0 2024-09-12T01:00:19.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.889+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:00:19.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15316530654131762451', time=2024-09-12T02:55:13.131434+0000, chain.objs.size()=7 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~nmT0KiuNyV1LoEcBUMapVcbwA11-MuA.1 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~nmT0KiuNyV1LoEcBUMapVcbwA11-MuA.1_1 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~nmT0KiuNyV1LoEcBUMapVcbwA11-MuA.1_2 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~nmT0KiuNyV1LoEcBUMapVcbwA11-MuA.2 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~nmT0KiuNyV1LoEcBUMapVcbwA11-MuA.2_1 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~nmT0KiuNyV1LoEcBUMapVcbwA11-MuA.2_2 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~nmT0KiuNyV1LoEcBUMapVcbwA11-MuA.3 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10981631495864974172', time=2024-09-12T02:57:44.988456+0000, chain.objs.size()=9 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~zEu5Ibh70Qx2rbtzpMCFjlLW5-mxXYg.1 2024-09-12T01:00:19.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~zEu5Ibh70Qx2rbtzpMCFjlLW5-mxXYg.1_1 2024-09-12T01:00:19.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~zEu5Ibh70Qx2rbtzpMCFjlLW5-mxXYg.2 2024-09-12T01:00:19.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~zEu5Ibh70Qx2rbtzpMCFjlLW5-mxXYg.2_1 2024-09-12T01:00:19.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.893+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~zEu5Ibh70Qx2rbtzpMCFjlLW5-mxXYg.3 2024-09-12T01:00:19.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.897+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~zEu5Ibh70Qx2rbtzpMCFjlLW5-mxXYg.3_1 2024-09-12T01:00:19.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.901+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~zEu5Ibh70Qx2rbtzpMCFjlLW5-mxXYg.4 2024-09-12T01:00:19.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.901+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__shadow_key1.2~zEu5Ibh70Qx2rbtzpMCFjlLW5-mxXYg.4_1 2024-09-12T01:00:19.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.901+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.103__multipart_key1.2~zEu5Ibh70Qx2rbtzpMCFjlLW5-mxXYg.5 2024-09-12T01:00:19.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.901+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18120425493557729698', time=2024-09-12T02:59:36.758997+0000, chain.objs.size()=1 2024-09-12T01:00:19.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.901+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.130__shadow_.SAm89y3mdouLyZZLimYLYkIAOtfMn05_0 2024-09-12T01:00:19.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.901+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4670224351024297978', time=2024-09-12T02:59:41.043257+0000, chain.objs.size()=1 2024-09-12T01:00:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.901+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.133__shadow_.irPtrxY1IpckaYrf5CAf2Vx7udLscJU_0 2024-09-12T01:00:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.901+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.473363801001745972', time=2024-09-12T02:59:42.431937+0000, chain.objs.size()=1 2024-09-12T01:00:19.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.901+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.134__shadow_.YQHNROnqCaAp6NcVc0PprB_Vq48x9-z_0 2024-09-12T01:00:19.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.905+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:00:19.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:00:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15398281379256506689', time=2024-09-12T02:59:10.729322+0000, chain.objs.size()=1 2024-09-12T01:00:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.113__shadow_.ZifUdvB023ukCK7POgwgaet23z05uyG_0 2024-09-12T01:00:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13285491983126635139', time=2024-09-12T02:59:16.841049+0000, chain.objs.size()=1 2024-09-12T01:00:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.117__shadow_.u_R17zmx5eYjBmD3RZfDa9kIkD3YG_5_0 2024-09-12T01:00:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4215869079415926170', time=2024-09-12T02:59:32.061135+0000, chain.objs.size()=1 2024-09-12T01:00:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.127__shadow_.0-OS1WkZUZ6Vb0Fn2dPiXi1iEbs4ma1_0 2024-09-12T01:00:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6865228061791704687', time=2024-09-12T02:59:36.685146+0000, chain.objs.size()=1 2024-09-12T01:00:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.130__shadow_._89bC8lerivxhdV7bW3KVBUkjHGePtz_0 2024-09-12T01:00:19.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5478308885683496868', time=2024-09-12T02:59:38.247198+0000, chain.objs.size()=1 2024-09-12T01:00:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.131__shadow_.vvVGpB3uMcDT7inJD6WxZkDGcne9JFk_0 2024-09-12T01:00:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1915010336075163480', time=2024-09-12T03:00:18.258036+0000, chain.objs.size()=9 2024-09-12T01:00:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.145__multipart_key1/data/file.mpg.2~gWg4ZKcHT9-sA8Qen5zyQjRie98e9i0.1 2024-09-12T01:00:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.145__shadow_key1/data/file.mpg.2~gWg4ZKcHT9-sA8Qen5zyQjRie98e9i0.1_1 2024-09-12T01:00:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.145__multipart_key1/data/file.mpg.2~gWg4ZKcHT9-sA8Qen5zyQjRie98e9i0.2 2024-09-12T01:00:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.145__shadow_key1/data/file.mpg.2~gWg4ZKcHT9-sA8Qen5zyQjRie98e9i0.2_1 2024-09-12T01:00:19.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.145__multipart_key1/data/file.mpg.2~gWg4ZKcHT9-sA8Qen5zyQjRie98e9i0.3 2024-09-12T01:00:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.145__shadow_key1/data/file.mpg.2~gWg4ZKcHT9-sA8Qen5zyQjRie98e9i0.3_1 2024-09-12T01:00:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.909+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.145__multipart_key1/data/file.mpg.2~gWg4ZKcHT9-sA8Qen5zyQjRie98e9i0.4 2024-09-12T01:00:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.917+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.145__shadow_key1/data/file.mpg.2~gWg4ZKcHT9-sA8Qen5zyQjRie98e9i0.4_1 2024-09-12T01:00:19.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.917+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.145__multipart_key1/data/file.mpg.2~gWg4ZKcHT9-sA8Qen5zyQjRie98e9i0.5 2024-09-12T01:00:19.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.921+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.921+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:00:19.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:00:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1765129259272119741', time=2024-09-12T02:58:23.899347+0000, chain.objs.size()=9 2024-09-12T01:00:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.104__multipart_key1.2~6Ti2aVR7_nL7Qoksf2eH4OVoRFsTx9r.1 2024-09-12T01:00:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.104__shadow_key1.2~6Ti2aVR7_nL7Qoksf2eH4OVoRFsTx9r.1_1 2024-09-12T01:00:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.104__multipart_key1.2~6Ti2aVR7_nL7Qoksf2eH4OVoRFsTx9r.2 2024-09-12T01:00:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.104__shadow_key1.2~6Ti2aVR7_nL7Qoksf2eH4OVoRFsTx9r.2_1 2024-09-12T01:00:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.104__multipart_key1.2~6Ti2aVR7_nL7Qoksf2eH4OVoRFsTx9r.3 2024-09-12T01:00:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.104__shadow_key1.2~6Ti2aVR7_nL7Qoksf2eH4OVoRFsTx9r.3_1 2024-09-12T01:00:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.104__multipart_key1.2~6Ti2aVR7_nL7Qoksf2eH4OVoRFsTx9r.4 2024-09-12T01:00:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.104__shadow_key1.2~6Ti2aVR7_nL7Qoksf2eH4OVoRFsTx9r.4_1 2024-09-12T01:00:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.104__multipart_key1.2~6Ti2aVR7_nL7Qoksf2eH4OVoRFsTx9r.5 2024-09-12T01:00:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1265011725825250153', time=2024-09-12T02:59:04.475228+0000, chain.objs.size()=1 2024-09-12T01:00:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.107__shadow_.r61ohtvjkrVLLjgz4VRvkcdaFmMchyR_0 2024-09-12T01:00:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10595998551614825358', time=2024-09-12T02:59:13.739047+0000, chain.objs.size()=1 2024-09-12T01:00:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.115__shadow_.qxhMZ6UaHIWAM_SCIpyPBpfM0eSDHnW_0 2024-09-12T01:00:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4097779167673469680', time=2024-09-12T02:59:13.814183+0000, chain.objs.size()=1 2024-09-12T01:00:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.925+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.115__shadow_.7wekBfLibp0vNkK7yrkUzKbKjNHR9y4_0 2024-09-12T01:00:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.929+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4141992284962619174', time=2024-09-12T02:59:21.691786+0000, chain.objs.size()=1 2024-09-12T01:00:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.929+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.120__shadow_.pfgZOlWamga8yY9oUJcu7Ok7kAmJRsX_0 2024-09-12T01:00:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.929+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10748717829441735547', time=2024-09-12T02:59:23.080333+0000, chain.objs.size()=1 2024-09-12T01:00:19.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.929+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.121__shadow_.0XFJArPXXoTLS3hlAR2x9FX5Yq16BOw_0 2024-09-12T01:00:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.937+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.937+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:00:19.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:00:19.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2257023214613796439', time=2024-09-12T02:59:10.577899+0000, chain.objs.size()=1 2024-09-12T01:00:19.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.113__shadow_.UCQtSNxQBglbMelyOV5GFNnBdjNRCxh_0 2024-09-12T01:00:19.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.881970185404390864', time=2024-09-12T02:59:18.409264+0000, chain.objs.size()=1 2024-09-12T01:00:19.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.118__shadow_.DKPDUemclEqZNYu2os2d5xygJgRdQ7A_0 2024-09-12T01:00:19.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.66904807529695619', time=2024-09-12T02:59:19.970197+0000, chain.objs.size()=1 2024-09-12T01:00:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.119__shadow_.rZ1rOaRZmVlaRXTeYNfmxP9XLe4ObUe_0 2024-09-12T01:00:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11249701189973795640', time=2024-09-12T02:59:30.553546+0000, chain.objs.size()=1 2024-09-12T01:00:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.126__shadow_.U8jwQN8LGyQy9RsDDQg47rr6zCkNfJZ_0 2024-09-12T01:00:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4098344209402694840', time=2024-09-12T02:59:33.806391+0000, chain.objs.size()=1 2024-09-12T01:00:19.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.941+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.128__shadow_.rRIjbZ00YdHUVuX1ekC4I1K-4LNjJVA_0 2024-09-12T01:00:19.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.945+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:00:19.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:00:19.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10810249124830090745', time=2024-09-12T02:54:41.087421+0000, chain.objs.size()=9 2024-09-12T01:00:19.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~v5rmKGkK-I6SOzWzZPn1IU6O-MrUF7z.1 2024-09-12T01:00:19.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~v5rmKGkK-I6SOzWzZPn1IU6O-MrUF7z.1_1 2024-09-12T01:00:19.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~v5rmKGkK-I6SOzWzZPn1IU6O-MrUF7z.2 2024-09-12T01:00:19.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~v5rmKGkK-I6SOzWzZPn1IU6O-MrUF7z.2_1 2024-09-12T01:00:19.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~v5rmKGkK-I6SOzWzZPn1IU6O-MrUF7z.3 2024-09-12T01:00:19.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~v5rmKGkK-I6SOzWzZPn1IU6O-MrUF7z.3_1 2024-09-12T01:00:19.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~v5rmKGkK-I6SOzWzZPn1IU6O-MrUF7z.4 2024-09-12T01:00:19.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~v5rmKGkK-I6SOzWzZPn1IU6O-MrUF7z.4_1 2024-09-12T01:00:19.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~v5rmKGkK-I6SOzWzZPn1IU6O-MrUF7z.5 2024-09-12T01:00:19.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5662796288038600457', time=2024-09-12T02:59:10.503404+0000, chain.objs.size()=1 2024-09-12T01:00:19.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.113__shadow_.F19A0ZoEQJeq8-piT34lBWrPzal5R_h_0 2024-09-12T01:00:19.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13597446630685365459', time=2024-09-12T02:59:18.334954+0000, chain.objs.size()=1 2024-09-12T01:00:19.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.118__shadow_.tjvEUZnx_V3UJIiFO751FgrBe-MZde0_0 2024-09-12T01:00:19.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7555432669450258686', time=2024-09-12T02:59:20.048274+0000, chain.objs.size()=1 2024-09-12T01:00:19.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.949+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.119__shadow_.KnWIBvftb_S3lsfgmA1T-JuFcxHYDHi_0 2024-09-12T01:00:19.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.953+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3492703717820018020', time=2024-09-12T02:59:24.501013+0000, chain.objs.size()=1 2024-09-12T01:00:19.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.953+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.122__shadow_.mqS9eZ-UgVRytGmLwsXi4PjaRA3Y9Rd_0 2024-09-12T01:00:19.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.953+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11495244733914507294', time=2024-09-12T02:59:36.910490+0000, chain.objs.size()=1 2024-09-12T01:00:19.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.953+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.130__shadow_.3SDlwNamVZw9RuNBsJhVD8z5DFxuXh-_0 2024-09-12T01:00:19.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.953+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12140296866783193768', time=2024-09-12T02:59:47.392238+0000, chain.objs.size()=1 2024-09-12T01:00:19.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.953+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.139__shadow_.GMxu5OjrKpWVht6GmtnJHwL3UdFCk6b_0 2024-09-12T01:00:19.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.961+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.961+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:00:19.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.961+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.965+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.965+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:19.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.965+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11655604311543555143', time=2024-09-12T02:59:23.000566+0000, chain.objs.size()=1 2024-09-12T01:00:19.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.965+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.121__shadow_.TSbfzpTZ9R9XhCc05f2jlfU3HwIBL7K_0 2024-09-12T01:00:19.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.965+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4256419834399807815', time=2024-09-12T02:59:46.340818+0000, chain.objs.size()=1 2024-09-12T01:00:19.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.965+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.138__shadow_.2-k48p9mLRSu11H5Ko1d0VBLPszPV3r_0 2024-09-12T01:00:19.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.965+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.969+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:00:19.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.969+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.969+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.969+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:00:19.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.969+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.140834610884201273', time=2024-09-12T02:59:15.432414+0000, chain.objs.size()=1 2024-09-12T01:00:19.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.969+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.116__shadow_.pEgkJ78qJx_fVqM4jyc4yAiqR5Ogpas_0 2024-09-12T01:00:19.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.969+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16843828451615450176', time=2024-09-12T02:59:23.216664+0000, chain.objs.size()=1 2024-09-12T01:00:19.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.969+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.121__shadow_.yqaHaKlJH6e6WYTu_RXpZaD3fGcFPzB_0 2024-09-12T01:00:19.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.973+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.973+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:00:19.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.977+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.977+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.977+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.977+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:00:19.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.981+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.981+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.981+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:00:19.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.981+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4561385398783803619', time=2024-09-12T02:59:38.303930+0000, chain.objs.size()=1 2024-09-12T01:00:19.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.981+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.131__shadow_.g7b9X__2PANzzRfCW7HjZqqAoYwjy9X_0 2024-09-12T01:00:19.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.981+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8261999110978717128', time=2024-09-12T02:59:42.358883+0000, chain.objs.size()=1 2024-09-12T01:00:19.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.981+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.134__shadow_.J8qgA-12hAjKFmbyxEj5C2-f3iuEuAO_0 2024-09-12T01:00:19.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.981+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15514446200725261388', time=2024-09-12T02:59:47.223664+0000, chain.objs.size()=1 2024-09-12T01:00:19.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.981+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.139__shadow_.RsORj85TODRtitSMIeHGRE4-py-Ir9v_0 2024-09-12T01:00:19.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.981+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.985+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:00:19.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.985+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:00:19.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12444225817665972883', time=2024-09-12T02:55:08.391572+0000, chain.objs.size()=7 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~eyiuXEZKugYKyfcvqpFvN9c1tbwMPtJ.1 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~eyiuXEZKugYKyfcvqpFvN9c1tbwMPtJ.1_1 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~eyiuXEZKugYKyfcvqpFvN9c1tbwMPtJ.1_2 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~eyiuXEZKugYKyfcvqpFvN9c1tbwMPtJ.2 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~eyiuXEZKugYKyfcvqpFvN9c1tbwMPtJ.2_1 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~eyiuXEZKugYKyfcvqpFvN9c1tbwMPtJ.2_2 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~eyiuXEZKugYKyfcvqpFvN9c1tbwMPtJ.3 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3862266220389246314', time=2024-09-12T02:59:15.281896+0000, chain.objs.size()=1 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.116__shadow_.InOcM3UQGzArvEgi21tgZjQ-B0-a_Im_0 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9549165941843790950', time=2024-09-12T02:59:21.547018+0000, chain.objs.size()=1 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.120__shadow_.NDYjmv6mcTnPY2NCBmBsPuD9ilDr-yG_0 2024-09-12T01:00:19.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17605796240831325063', time=2024-09-12T02:59:29.079366+0000, chain.objs.size()=1 2024-09-12T01:00:19.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.989+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.125__shadow_.-LnapIPiJcIx43lx78jM8aYGHfGyzmL_0 2024-09-12T01:00:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.993+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:19.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.997+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:00:19.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.997+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:19.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:19.997+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:19.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.001+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:00:19.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.001+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9580052272620925790', time=2024-09-12T02:59:12.217699+0000, chain.objs.size()=1 2024-09-12T01:00:19.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.001+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.114__shadow_.9StnsEwwZqNjFA9Q-gqGkUFfyFi0kDU_0 2024-09-12T01:00:20.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.001+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:20.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:00:20.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:00:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10992148619486642293', time=2024-09-12T02:56:01.358209+0000, chain.objs.size()=9 2024-09-12T01:00:20.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.100__multipart_key1.2~1dSt61uwalTu1J6T0MakbQXvOsm7XYf.1 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.100__shadow_key1.2~1dSt61uwalTu1J6T0MakbQXvOsm7XYf.1_1 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.100__multipart_key1.2~1dSt61uwalTu1J6T0MakbQXvOsm7XYf.2 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.100__shadow_key1.2~1dSt61uwalTu1J6T0MakbQXvOsm7XYf.2_1 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.100__multipart_key1.2~1dSt61uwalTu1J6T0MakbQXvOsm7XYf.3 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.100__shadow_key1.2~1dSt61uwalTu1J6T0MakbQXvOsm7XYf.3_1 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.100__multipart_key1.2~1dSt61uwalTu1J6T0MakbQXvOsm7XYf.4 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.100__shadow_key1.2~1dSt61uwalTu1J6T0MakbQXvOsm7XYf.4_1 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.100__multipart_key1.2~1dSt61uwalTu1J6T0MakbQXvOsm7XYf.5 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10676659774597179617', time=2024-09-12T02:59:18.472500+0000, chain.objs.size()=1 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.118__shadow_.5NZQdChGwuwCMGxCUB8pHZztklphMjj_0 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3048362479197174124', time=2024-09-12T02:59:21.473422+0000, chain.objs.size()=1 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.120__shadow_.wl2hSwEoNbOet_QJ0djcUyfs64y6eYK_0 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4984159936753510807', time=2024-09-12T02:59:35.367525+0000, chain.objs.size()=1 2024-09-12T01:00:20.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.005+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.129__shadow_.eXT2A2DN-ts99xi2jL0wCF4ZosxKTCm_0 2024-09-12T01:00:20.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.009+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9905928139112095682', time=2024-09-12T02:59:40.897583+0000, chain.objs.size()=1 2024-09-12T01:00:20.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.009+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.133__shadow_.M8Hu743Iz3YVwJ-bOC-XH23AHZtEvRw_0 2024-09-12T01:00:20.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.017+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:20.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:00:20.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:00:20.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.454318302388056606', time=2024-09-12T02:55:14.049597+0000, chain.objs.size()=7 2024-09-12T01:00:20.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~bc3Kj1PHsgLmCCGS4MzuqZ8rLYNoQg6.1 2024-09-12T01:00:20.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~bc3Kj1PHsgLmCCGS4MzuqZ8rLYNoQg6.1_1 2024-09-12T01:00:20.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~bc3Kj1PHsgLmCCGS4MzuqZ8rLYNoQg6.1_2 2024-09-12T01:00:20.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~bc3Kj1PHsgLmCCGS4MzuqZ8rLYNoQg6.2 2024-09-12T01:00:20.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~bc3Kj1PHsgLmCCGS4MzuqZ8rLYNoQg6.2_1 2024-09-12T01:00:20.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__shadow_key1.2~bc3Kj1PHsgLmCCGS4MzuqZ8rLYNoQg6.2_2 2024-09-12T01:00:20.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.95__multipart_key1.2~bc3Kj1PHsgLmCCGS4MzuqZ8rLYNoQg6.3 2024-09-12T01:00:20.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14474592316734259871', time=2024-09-12T02:55:38.582247+0000, chain.objs.size()=9 2024-09-12T01:00:20.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.99__multipart_key1.2~FEQVyn0cZ_UqbSnuaomnMCJecE9yZkz.1 2024-09-12T01:00:20.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.99__shadow_key1.2~FEQVyn0cZ_UqbSnuaomnMCJecE9yZkz.1_1 2024-09-12T01:00:20.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.99__multipart_key1.2~FEQVyn0cZ_UqbSnuaomnMCJecE9yZkz.2 2024-09-12T01:00:20.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.99__shadow_key1.2~FEQVyn0cZ_UqbSnuaomnMCJecE9yZkz.2_1 2024-09-12T01:00:20.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.021+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.99__multipart_key1.2~FEQVyn0cZ_UqbSnuaomnMCJecE9yZkz.3 2024-09-12T01:00:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.99__shadow_key1.2~FEQVyn0cZ_UqbSnuaomnMCJecE9yZkz.3_1 2024-09-12T01:00:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.99__multipart_key1.2~FEQVyn0cZ_UqbSnuaomnMCJecE9yZkz.4 2024-09-12T01:00:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.99__shadow_key1.2~FEQVyn0cZ_UqbSnuaomnMCJecE9yZkz.4_1 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.99__multipart_key1.2~FEQVyn0cZ_UqbSnuaomnMCJecE9yZkz.5 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11003265046059745930', time=2024-09-12T02:59:13.881890+0000, chain.objs.size()=1 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.115__shadow_.OJvJT-xzt-pCrCtiNDcASAS_sascXTY_0 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17674256173699147380', time=2024-09-12T02:59:38.169904+0000, chain.objs.size()=1 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.131__shadow_.LG1LYk17NsYjDxM20XJSOmo2kC0sjpI_0 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6805449332933158619', time=2024-09-12T03:00:04.824129+0000, chain.objs.size()=9 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.144__multipart_key1.2~B7jDtcLaQWhdRY2V0qKppyzHFfutMty.1 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.144__shadow_key1.2~B7jDtcLaQWhdRY2V0qKppyzHFfutMty.1_1 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.144__multipart_key1.2~B7jDtcLaQWhdRY2V0qKppyzHFfutMty.2 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.144__shadow_key1.2~B7jDtcLaQWhdRY2V0qKppyzHFfutMty.2_1 2024-09-12T01:00:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.029+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.144__multipart_key1.2~B7jDtcLaQWhdRY2V0qKppyzHFfutMty.3 2024-09-12T01:00:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.033+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.144__shadow_key1.2~B7jDtcLaQWhdRY2V0qKppyzHFfutMty.3_1 2024-09-12T01:00:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.033+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.144__multipart_key1.2~B7jDtcLaQWhdRY2V0qKppyzHFfutMty.4 2024-09-12T01:00:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.033+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.144__shadow_key1.2~B7jDtcLaQWhdRY2V0qKppyzHFfutMty.4_1 2024-09-12T01:00:20.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.037+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.144__multipart_key1.2~B7jDtcLaQWhdRY2V0qKppyzHFfutMty.5 2024-09-12T01:00:20.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.041+0000 7fbd7028a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:00:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.045+0000 7fbc23fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.049+0000 7fbd7028a9c0 20 remove_watcher() i=0 2024-09-12T01:00:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.049+0000 7fbd7028a9c0 2 removed watcher, disabling cache 2024-09-12T01:00:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.049+0000 7fbd7028a9c0 20 remove_watcher() i=1 2024-09-12T01:00:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.049+0000 7fbd7028a9c0 20 remove_watcher() i=2 2024-09-12T01:00:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.049+0000 7fbd7028a9c0 20 remove_watcher() i=3 2024-09-12T01:00:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.053+0000 7fbd7028a9c0 20 remove_watcher() i=4 2024-09-12T01:00:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.053+0000 7fbd7028a9c0 20 remove_watcher() i=5 2024-09-12T01:00:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.053+0000 7fbd7028a9c0 20 remove_watcher() i=6 2024-09-12T01:00:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.053+0000 7fbd7028a9c0 20 remove_watcher() i=7 2024-09-12T01:00:20.067 DEBUG:teuthology.orchestra.run.smithi102:> radosgw-admin gc process --include-all 2024-09-12T01:00:20.136 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:20.136 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:20.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.177+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.181+0000 7f1d447e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.181+0000 7f1d447e39c0 20 realm 2024-09-12T01:00:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.181+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.181+0000 7f1d447e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.181+0000 7f1d447e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.181+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.181+0000 7f1d447e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:20.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.181+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.181+0000 7f1d447e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:20.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.181+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.185+0000 7f1d447e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:20.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.185+0000 7f1d447e39c0 20 searching for the correct realm 2024-09-12T01:00:20.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.189+0000 7f1d42aea640 0 -- 172.21.15.102:0/838781617 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55ad4fb088f0 msgr2=0x55ad4fb0ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:20.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.193+0000 7f1d41ae8640 0 -- 172.21.15.102:0/838781617 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f1d3c0378f0 msgr2=0x7f1d3c02c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:20.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.409+0000 7f1d447e39c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:20.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.409+0000 7f1d447e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:20.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.409+0000 7f1d447e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:20.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.409+0000 7f1d447e39c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:20.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.409+0000 7f1d447e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:20.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.409+0000 7f1d447e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:20.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.409+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:20.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:20.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:20.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 zone default found 2024-09-12T01:00:20.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 4 Realm: () 2024-09-12T01:00:20.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:20.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:20.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:20.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 zonegroup default 2024-09-12T01:00:20.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:20.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:20.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.413+0000 7f1d447e39c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:20.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.417+0000 7f1d447e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:20.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.417+0000 7f1d447e39c0 20 started sync module instance, tier type = 2024-09-12T01:00:20.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.417+0000 7f1d447e39c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:20.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.437+0000 7f1d447e39c0 20 add_watcher() i=0 2024-09-12T01:00:20.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.437+0000 7f1d447e39c0 20 add_watcher() i=1 2024-09-12T01:00:20.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.437+0000 7f1d447e39c0 20 add_watcher() i=2 2024-09-12T01:00:20.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.437+0000 7f1d447e39c0 20 add_watcher() i=3 2024-09-12T01:00:20.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.437+0000 7f1d447e39c0 20 add_watcher() i=4 2024-09-12T01:00:20.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.437+0000 7f1d447e39c0 20 add_watcher() i=5 2024-09-12T01:00:20.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.437+0000 7f1d447e39c0 20 add_watcher() i=6 2024-09-12T01:00:20.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.437+0000 7f1d447e39c0 20 add_watcher() i=7 2024-09-12T01:00:20.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.437+0000 7f1d447e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:20.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.441+0000 7f1bf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:20.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.441+0000 7f1d447e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:20.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.441+0000 7f1d447e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.529+0000 7f1b737fe640 20 reqs_thread_entry: start 2024-09-12T01:00:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.529+0000 7f1d447e39c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.529+0000 7f1d447e39c0 20 Filter name: none 2024-09-12T01:00:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.529+0000 7f1b717fa640 20 reqs_thread_entry: start 2024-09-12T01:00:20.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.529+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:00:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.533+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.533+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.533+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.537+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:00:20.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.537+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.541+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.541+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.545+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:00:20.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.545+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.545+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.549+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.549+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:00:20.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.553+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.553+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.553+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.557+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:00:20.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.561+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.561+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.561+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.565+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:00:20.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.569+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.569+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.569+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.573+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:00:20.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.573+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.577+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.577+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.577+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:00:20.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.581+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.585+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.585+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.585+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:00:20.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.589+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.589+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.589+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.593+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:00:20.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.593+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.597+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.597+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.597+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:00:20.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.601+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.605+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.605+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.605+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:00:20.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.609+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.613+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.613+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.617+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:00:20.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.617+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.621+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.621+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.621+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:00:20.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.625+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.625+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.625+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.629+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:00:20.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.633+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.633+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.633+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.637+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:00:20.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.641+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.641+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.641+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.645+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:00:20.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.649+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.649+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.649+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.653+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:00:20.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.657+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.657+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.657+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.657+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:00:20.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.661+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.665+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.665+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.665+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:00:20.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.669+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.673+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.673+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.677+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:00:20.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.681+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.681+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.681+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.685+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:00:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.689+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.689+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.689+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.693+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:00:20.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.697+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.697+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.697+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.701+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:00:20.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.705+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.705+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.705+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.709+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:00:20.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.709+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.713+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.713+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.713+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:00:20.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.717+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.717+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.721+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.721+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:00:20.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.725+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.725+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.725+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.725+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:00:20.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.729+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.733+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.733+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.733+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:00:20.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.737+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.737+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.737+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.741+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:00:20.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.745+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.745+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.745+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.749+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:00:20.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.753+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.753+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.753+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.757+0000 7f1d447e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:00:20.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.761+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.765+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:00:20.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.765+0000 7f1d447e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:00:20.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.769+0000 7f1bf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:20.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.777+0000 7f1d447e39c0 20 remove_watcher() i=0 2024-09-12T01:00:20.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.777+0000 7f1d447e39c0 2 removed watcher, disabling cache 2024-09-12T01:00:20.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.777+0000 7f1d447e39c0 20 remove_watcher() i=1 2024-09-12T01:00:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.781+0000 7f1d447e39c0 20 remove_watcher() i=2 2024-09-12T01:00:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.785+0000 7f1d447e39c0 20 remove_watcher() i=3 2024-09-12T01:00:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.785+0000 7f1d447e39c0 20 remove_watcher() i=4 2024-09-12T01:00:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.789+0000 7f1d447e39c0 20 remove_watcher() i=5 2024-09-12T01:00:20.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.789+0000 7f1d447e39c0 20 remove_watcher() i=6 2024-09-12T01:00:20.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:20.793+0000 7f1d447e39c0 20 remove_watcher() i=7 2024-09-12T01:00:20.812 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T01:00:20.831 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T01:00:20.831 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T01:00:20.832 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T01:00:20.832 DEBUG:teuthology.orchestra.run.smithi102:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:00:20.860 INFO:teuthology.orchestra.run.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T01:00:21.722 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T01:00:21.722 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-12T01:00:21.723 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key KUWMICRLEISXZJFPWIIG --secret Yu1LdX24FyLeduv4SkcQIF8UKJe/ZiKYzqwefWhPGjKvMYjbiTaqzg== --cluster ceph 2024-09-12T01:00:21.808 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:21.808 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:21.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.849+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:21.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.853+0000 7f425bf999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:21.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.853+0000 7f425bf999c0 20 realm 2024-09-12T01:00:21.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.853+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:21.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.853+0000 7f425bf999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:21.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.853+0000 7f425bf999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:21.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.853+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:21.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.853+0000 7f425bf999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:21.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.853+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:21.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.853+0000 7f425bf999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:21.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.853+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:21.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.857+0000 7f425bf999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:21.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.857+0000 7f425bf999c0 20 searching for the correct realm 2024-09-12T01:00:21.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:21.861+0000 7f425a2a0640 0 -- 172.21.15.102:0/846696300 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f4250039040 msgr2=0x7f4250039420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:22.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.077+0000 7f425929e640 0 -- 172.21.15.102:0/846696300 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f424c099330 msgr2=0x7f424c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.293+0000 7f425bf999c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.293+0000 7f425bf999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.293+0000 7f425bf999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.293+0000 7f425bf999c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.293+0000 7f425bf999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.293+0000 7f425bf999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:22.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.293+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.293+0000 7f425bf999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.293+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:22.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:22.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 zone default found 2024-09-12T01:00:22.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 4 Realm: () 2024-09-12T01:00:22.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:22.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:22.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:22.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 zonegroup default 2024-09-12T01:00:22.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 started sync module instance, tier type = 2024-09-12T01:00:22.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.297+0000 7f425bf999c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:22.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.325+0000 7f425bf999c0 20 add_watcher() i=0 2024-09-12T01:00:22.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.325+0000 7f425bf999c0 20 add_watcher() i=1 2024-09-12T01:00:22.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.325+0000 7f425bf999c0 20 add_watcher() i=2 2024-09-12T01:00:22.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.325+0000 7f425bf999c0 20 add_watcher() i=3 2024-09-12T01:00:22.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.325+0000 7f425bf999c0 20 add_watcher() i=4 2024-09-12T01:00:22.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.325+0000 7f425bf999c0 20 add_watcher() i=5 2024-09-12T01:00:22.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.325+0000 7f425bf999c0 20 add_watcher() i=6 2024-09-12T01:00:22.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.325+0000 7f425bf999c0 20 add_watcher() i=7 2024-09-12T01:00:22.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.325+0000 7f425bf999c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:22.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.329+0000 7f410b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:22.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.329+0000 7f425bf999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:22.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.329+0000 7f425bf999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:22.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.329+0000 7f425bf999c0 5 note: GC not initialized 2024-09-12T01:00:22.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.329+0000 7f410a7fc640 20 reqs_thread_entry: start 2024-09-12T01:00:22.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.329+0000 7f425bf999c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:22.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.329+0000 7f425bf999c0 20 Filter name: none 2024-09-12T01:00:22.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f407bfff640 20 reqs_thread_entry: start 2024-09-12T01:00:22.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T01:00:22.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T01:00:22.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:00:22.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T01:00:22.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T01:00:22.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:00:22.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 cache get: name=default.rgw.meta+users.keys+KUWMICRLEISXZJFPWIIG : miss 2024-09-12T01:00:22.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 cache put: name=default.rgw.meta+users.keys+KUWMICRLEISXZJFPWIIG info.flags=0x0 2024-09-12T01:00:22.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 adding default.rgw.meta+users.keys+KUWMICRLEISXZJFPWIIG to cache LRU end 2024-09-12T01:00:22.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 cache get: name=default.rgw.meta+users.keys+KUWMICRLEISXZJFPWIIG : hit (negative entry) 2024-09-12T01:00:22.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.333+0000 7f425bf999c0 10 cache get: name=default.rgw.meta+users.keys+KUWMICRLEISXZJFPWIIG : hit (negative entry) 2024-09-12T01:00:22.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.337+0000 7f425bf999c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:00:22.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.337+0000 7f425bf999c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:00:22.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.337+0000 7f425bf999c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T01:00:22.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.337+0000 7f413d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399065 cookie 94372619414736 notifier 9012 bl.length()=645 2024-09-12T01:00:22.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.337+0000 7f413d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:00:22.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.337+0000 7f413d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:00:22.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.341+0000 7f425bf999c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T01:00:22.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.341+0000 7f425bf999c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:00:22.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.341+0000 7f425bf999c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T01:00:22.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.341+0000 7f413d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399066 cookie 94372619427680 notifier 9012 bl.length()=185 2024-09-12T01:00:22.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.341+0000 7f413d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T01:00:22.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.341+0000 7f413d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:00:22.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.345+0000 7f425bf999c0 10 cache put: name=default.rgw.meta+users.keys+KUWMICRLEISXZJFPWIIG info.flags=0x7 2024-09-12T01:00:22.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.345+0000 7f425bf999c0 10 moving default.rgw.meta+users.keys+KUWMICRLEISXZJFPWIIG to cache LRU end 2024-09-12T01:00:22.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.345+0000 7f425bf999c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:KUWMICRLEISXZJFPWIIG, ofs0, ns] 2024-09-12T01:00:22.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.349+0000 7f413d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398935 cookie 94372619425776 notifier 9012 bl.length()=186 2024-09-12T01:00:22.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.349+0000 7f413d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KUWMICRLEISXZJFPWIIG info.flags=0x7 2024-09-12T01:00:22.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.349+0000 7f413d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KUWMICRLEISXZJFPWIIG to cache LRU end 2024-09-12T01:00:22.349 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T01:00:22.349 INFO:teuthology.orchestra.run.smithi102.stdout: "user_id": "foo.client.0", 2024-09-12T01:00:22.349 INFO:teuthology.orchestra.run.smithi102.stdout: "display_name": "Mr.foo.client.0", 2024-09-12T01:00:22.349 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "foo+test@test.test", 2024-09-12T01:00:22.349 INFO:teuthology.orchestra.run.smithi102.stdout: "suspended": 0, 2024-09-12T01:00:22.349 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T01:00:22.349 INFO:teuthology.orchestra.run.smithi102.stdout: "subusers": [], 2024-09-12T01:00:22.349 INFO:teuthology.orchestra.run.smithi102.stdout: "keys": [ 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "user": "foo.client.0", 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "access_key": "KUWMICRLEISXZJFPWIIG", 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "secret_key": "Yu1LdX24FyLeduv4SkcQIF8UKJe/ZiKYzqwefWhPGjKvMYjbiTaqzg==", 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "active": true, 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:22.335983Z" 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "swift_keys": [], 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": [], 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "default_placement": "", 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "default_storage_class": "", 2024-09-12T01:00:22.350 INFO:teuthology.orchestra.run.smithi102.stdout: "placement_tags": [], 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "user_quota": { 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:22.351 INFO:teuthology.orchestra.run.smithi102.stdout: "temp_url_keys": [], 2024-09-12T01:00:22.352 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "rgw", 2024-09-12T01:00:22.352 INFO:teuthology.orchestra.run.smithi102.stdout: "mfa_ids": [], 2024-09-12T01:00:22.352 INFO:teuthology.orchestra.run.smithi102.stdout: "account_id": "", 2024-09-12T01:00:22.352 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-12T01:00:22.352 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:22.335949Z", 2024-09-12T01:00:22.352 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-12T01:00:22.352 INFO:teuthology.orchestra.run.smithi102.stdout: "group_ids": [] 2024-09-12T01:00:22.352 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T01:00:22.352 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:22.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.349+0000 7f410b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:22.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.357+0000 7f425bf999c0 20 remove_watcher() i=0 2024-09-12T01:00:22.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.357+0000 7f425bf999c0 2 removed watcher, disabling cache 2024-09-12T01:00:22.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.357+0000 7f425bf999c0 20 remove_watcher() i=1 2024-09-12T01:00:22.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.361+0000 7f425bf999c0 20 remove_watcher() i=2 2024-09-12T01:00:22.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.361+0000 7f425bf999c0 20 remove_watcher() i=3 2024-09-12T01:00:22.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.365+0000 7f425bf999c0 20 remove_watcher() i=4 2024-09-12T01:00:22.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.365+0000 7f425bf999c0 20 remove_watcher() i=5 2024-09-12T01:00:22.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.369+0000 7f425bf999c0 20 remove_watcher() i=6 2024-09-12T01:00:22.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.369+0000 7f425bf999c0 20 remove_watcher() i=7 2024-09-12T01:00:22.394 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 6127941502 --totp-seed NEVOKX7CQCE5LHJDCVTVNLZUOBJSX6O3WBZ7ZKKRATPQROIXRJTVWUIIBEAJ5FQJ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:00:22.441 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:22.441 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:22.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.481+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.485+0000 7f92ff5ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.485+0000 7f92ff5ae9c0 20 realm 2024-09-12T01:00:22.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.485+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.485+0000 7f92ff5ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.485+0000 7f92ff5ae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:22.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.485+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.485+0000 7f92ff5ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.485+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.485+0000 7f92ff5ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:22.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.485+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.489+0000 7f92ff5ae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:22.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.489+0000 7f92ff5ae9c0 20 searching for the correct realm 2024-09-12T01:00:22.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.493+0000 7f92fd8b5640 0 -- 172.21.15.102:0/852703726 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x563e13f95580 msgr2=0x563e13f97990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:22.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.497+0000 7f92fc8b3640 0 -- 172.21.15.102:0/852703726 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f92f806be80 msgr2=0x7f92f8078900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:22.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.713+0000 7f92ff5ae9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:22.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.713+0000 7f92ff5ae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:22.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.713+0000 7f92ff5ae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:22.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.713+0000 7f92ff5ae9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:22.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.713+0000 7f92ff5ae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:22.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.713+0000 7f92ff5ae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:22.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.713+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.713+0000 7f92ff5ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.713+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:22.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:22.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 zone default found 2024-09-12T01:00:22.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 4 Realm: () 2024-09-12T01:00:22.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:22.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:22.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:22.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 zonegroup default 2024-09-12T01:00:22.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:22.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 started sync module instance, tier type = 2024-09-12T01:00:22.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.717+0000 7f92ff5ae9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:22.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.741+0000 7f92ff5ae9c0 20 add_watcher() i=0 2024-09-12T01:00:22.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.741+0000 7f92ff5ae9c0 20 add_watcher() i=1 2024-09-12T01:00:22.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.741+0000 7f92ff5ae9c0 20 add_watcher() i=2 2024-09-12T01:00:22.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.741+0000 7f92ff5ae9c0 20 add_watcher() i=3 2024-09-12T01:00:22.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.741+0000 7f92ff5ae9c0 20 add_watcher() i=4 2024-09-12T01:00:22.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.741+0000 7f92ff5ae9c0 20 add_watcher() i=5 2024-09-12T01:00:22.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.741+0000 7f92ff5ae9c0 20 add_watcher() i=6 2024-09-12T01:00:22.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.745+0000 7f92ff5ae9c0 20 add_watcher() i=7 2024-09-12T01:00:22.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.745+0000 7f92ff5ae9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:22.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f91b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:22.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:22.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:22.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 5 note: GC not initialized 2024-09-12T01:00:22.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f91b2fe5640 20 reqs_thread_entry: start 2024-09-12T01:00:22.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:22.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 20 Filter name: none 2024-09-12T01:00:22.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f91b0fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:22.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T01:00:22.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:22.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T01:00:22.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T01:00:22.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:00:22.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:22.749+0000 7f92ff5ae9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:24.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.081+0000 7f92ff5ae9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:00:24.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.081+0000 7f92ff5ae9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:00:24.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.081+0000 7f92ff5ae9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T01:00:24.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.081+0000 7f91cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333659 cookie 94824623076384 notifier 9027 bl.length()=659 2024-09-12T01:00:24.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.081+0000 7f91cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:00:24.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.081+0000 7f91cffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:00:24.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.089+0000 7f91b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:24.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.093+0000 7f92ff5ae9c0 20 remove_watcher() i=0 2024-09-12T01:00:24.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.093+0000 7f92ff5ae9c0 2 removed watcher, disabling cache 2024-09-12T01:00:24.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.093+0000 7f92ff5ae9c0 20 remove_watcher() i=1 2024-09-12T01:00:24.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.097+0000 7f92ff5ae9c0 20 remove_watcher() i=2 2024-09-12T01:00:24.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.097+0000 7f92ff5ae9c0 20 remove_watcher() i=3 2024-09-12T01:00:24.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.101+0000 7f92ff5ae9c0 20 remove_watcher() i=4 2024-09-12T01:00:24.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.105+0000 7f92ff5ae9c0 20 remove_watcher() i=5 2024-09-12T01:00:24.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.105+0000 7f92ff5ae9c0 20 remove_watcher() i=6 2024-09-12T01:00:24.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.105+0000 7f92ff5ae9c0 20 remove_watcher() i=7 2024-09-12T01:00:24.131 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T01:00:24.132 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key EBPNMITYOFERHKGWGANP --secret 1rdEHl0ds6R9a7pUbquZ85jt99pw2KTL5VPGr6so1OTlqQVC4CTNbA== --cluster ceph 2024-09-12T01:00:24.175 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:24.176 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:24.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.217+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 20 realm 2024-09-12T01:00:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.221+0000 7f25458419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:24.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.225+0000 7f25458419c0 20 searching for the correct realm 2024-09-12T01:00:24.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.225+0000 7f2543b48640 0 -- 172.21.15.102:0/2375467228 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f252c125b80 msgr2=0x7f252c138a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:24.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.441+0000 7f2542b46640 0 -- 172.21.15.102:0/2375467228 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f253c099040 msgr2=0x7f253c092800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:24.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.657+0000 7f25458419c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:24.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.657+0000 7f25458419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:24.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.657+0000 7f25458419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:24.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.657+0000 7f25458419c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:24.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.657+0000 7f25458419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:24.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.657+0000 7f25458419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:24.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.657+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.657+0000 7f25458419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.657+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:24.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 zone default found 2024-09-12T01:00:24.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 4 Realm: () 2024-09-12T01:00:24.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:24.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:24.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:24.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 zonegroup default 2024-09-12T01:00:24.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 started sync module instance, tier type = 2024-09-12T01:00:24.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.661+0000 7f25458419c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:24.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.685+0000 7f25458419c0 20 add_watcher() i=0 2024-09-12T01:00:24.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.685+0000 7f25458419c0 20 add_watcher() i=1 2024-09-12T01:00:24.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.685+0000 7f25458419c0 20 add_watcher() i=2 2024-09-12T01:00:24.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.685+0000 7f25458419c0 20 add_watcher() i=3 2024-09-12T01:00:24.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.685+0000 7f25458419c0 20 add_watcher() i=4 2024-09-12T01:00:24.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.685+0000 7f25458419c0 20 add_watcher() i=5 2024-09-12T01:00:24.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.685+0000 7f25458419c0 20 add_watcher() i=6 2024-09-12T01:00:24.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.689+0000 7f25458419c0 20 add_watcher() i=7 2024-09-12T01:00:24.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.689+0000 7f25458419c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:24.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.693+0000 7f23fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:24.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.693+0000 7f25458419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:24.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.693+0000 7f25458419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:24.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.693+0000 7f25458419c0 5 note: GC not initialized 2024-09-12T01:00:24.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.693+0000 7f23f97e2640 20 reqs_thread_entry: start 2024-09-12T01:00:24.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.693+0000 7f25458419c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:24.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.693+0000 7f25458419c0 20 Filter name: none 2024-09-12T01:00:24.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.693+0000 7f23f27fc640 20 reqs_thread_entry: start 2024-09-12T01:00:24.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T01:00:24.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T01:00:24.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:00:24.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T01:00:24.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T01:00:24.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:00:24.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 cache get: name=default.rgw.meta+users.keys+EBPNMITYOFERHKGWGANP : miss 2024-09-12T01:00:24.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 cache put: name=default.rgw.meta+users.keys+EBPNMITYOFERHKGWGANP info.flags=0x0 2024-09-12T01:00:24.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 adding default.rgw.meta+users.keys+EBPNMITYOFERHKGWGANP to cache LRU end 2024-09-12T01:00:24.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 cache get: name=default.rgw.meta+users.keys+EBPNMITYOFERHKGWGANP : hit (negative entry) 2024-09-12T01:00:24.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.697+0000 7f25458419c0 10 cache get: name=default.rgw.meta+users.keys+EBPNMITYOFERHKGWGANP : hit (negative entry) 2024-09-12T01:00:24.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.701+0000 7f25458419c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:00:24.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.701+0000 7f25458419c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:00:24.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.701+0000 7f25458419c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T01:00:24.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.701+0000 7f2426ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333607 cookie 94383571723584 notifier 9045 bl.length()=645 2024-09-12T01:00:24.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.701+0000 7f2426ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:00:24.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.701+0000 7f2426ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:00:24.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.705+0000 7f25458419c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T01:00:24.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.705+0000 7f25458419c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:00:24.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.705+0000 7f25458419c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T01:00:24.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.709+0000 7f2426ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333640 cookie 94383571691120 notifier 9045 bl.length()=185 2024-09-12T01:00:24.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.709+0000 7f2426ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T01:00:24.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.709+0000 7f2426ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:00:24.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.713+0000 7f25458419c0 10 cache put: name=default.rgw.meta+users.keys+EBPNMITYOFERHKGWGANP info.flags=0x7 2024-09-12T01:00:24.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.713+0000 7f25458419c0 10 moving default.rgw.meta+users.keys+EBPNMITYOFERHKGWGANP to cache LRU end 2024-09-12T01:00:24.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.713+0000 7f25458419c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:EBPNMITYOFERHKGWGANP, ofs0, ns] 2024-09-12T01:00:24.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.713+0000 7f24267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94383571738176 notifier 9045 bl.length()=186 2024-09-12T01:00:24.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.713+0000 7f24267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EBPNMITYOFERHKGWGANP info.flags=0x7 2024-09-12T01:00:24.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.713+0000 7f24267fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EBPNMITYOFERHKGWGANP to cache LRU end 2024-09-12T01:00:24.713 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "user_id": "bar.client.0", 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "bar+test@test.test", 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "suspended": 0, 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "subusers": [], 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "keys": [ 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "user": "bar.client.0", 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "access_key": "EBPNMITYOFERHKGWGANP", 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "secret_key": "1rdEHl0ds6R9a7pUbquZ85jt99pw2KTL5VPGr6so1OTlqQVC4CTNbA==", 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "active": true, 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:24.700644Z" 2024-09-12T01:00:24.714 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "swift_keys": [], 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": [], 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "default_placement": "", 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "default_storage_class": "", 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "placement_tags": [], 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:24.715 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "user_quota": { 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "temp_url_keys": [], 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "rgw", 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "mfa_ids": [], 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "account_id": "", 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-12T01:00:24.716 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:24.700601Z", 2024-09-12T01:00:24.717 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-12T01:00:24.717 INFO:teuthology.orchestra.run.smithi102.stdout: "group_ids": [] 2024-09-12T01:00:24.717 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T01:00:24.717 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:24.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.717+0000 7f23fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:24.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.721+0000 7f25458419c0 20 remove_watcher() i=0 2024-09-12T01:00:24.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.721+0000 7f25458419c0 2 removed watcher, disabling cache 2024-09-12T01:00:24.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.721+0000 7f25458419c0 20 remove_watcher() i=1 2024-09-12T01:00:24.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.725+0000 7f25458419c0 20 remove_watcher() i=2 2024-09-12T01:00:24.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.725+0000 7f25458419c0 20 remove_watcher() i=3 2024-09-12T01:00:24.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.729+0000 7f25458419c0 20 remove_watcher() i=4 2024-09-12T01:00:24.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.733+0000 7f25458419c0 20 remove_watcher() i=5 2024-09-12T01:00:24.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.733+0000 7f25458419c0 20 remove_watcher() i=6 2024-09-12T01:00:24.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.737+0000 7f25458419c0 20 remove_watcher() i=7 2024-09-12T01:00:24.753 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 5402047633 --totp-seed ESJMOXI3OATRS4YXKW2JQFTAGZ4QK6HANLM4TMJQTY7I7VMQBEXO2X4L4ZQXWRAS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:00:24.841 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:24.841 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:24.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 20 realm 2024-09-12T01:00:24.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:24.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:24.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:24.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.885+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:24.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.889+0000 7fb6809ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:24.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.889+0000 7fb6809ca9c0 20 searching for the correct realm 2024-09-12T01:00:24.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:24.893+0000 7fb67ecd1640 0 -- 172.21.15.102:0/1000369851 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fb674008050 msgr2=0x7fb674046950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:25.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.125+0000 7fb67dccf640 0 -- 172.21.15.102:0/1000369851 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fb670112c40 msgr2=0x7fb67012a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:25.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:25.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:25.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:25.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:25.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:25.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:25.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 zone default found 2024-09-12T01:00:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 4 Realm: () 2024-09-12T01:00:25.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 zonegroup default 2024-09-12T01:00:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.377+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.381+0000 7fb6809ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.381+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.381+0000 7fb6809ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.381+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.381+0000 7fb6809ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.381+0000 7fb6809ca9c0 20 started sync module instance, tier type = 2024-09-12T01:00:25.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.381+0000 7fb6809ca9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:25.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.401+0000 7fb6809ca9c0 20 add_watcher() i=0 2024-09-12T01:00:25.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.401+0000 7fb6809ca9c0 20 add_watcher() i=1 2024-09-12T01:00:25.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.401+0000 7fb6809ca9c0 20 add_watcher() i=2 2024-09-12T01:00:25.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.401+0000 7fb6809ca9c0 20 add_watcher() i=3 2024-09-12T01:00:25.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.401+0000 7fb6809ca9c0 20 add_watcher() i=4 2024-09-12T01:00:25.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.401+0000 7fb6809ca9c0 20 add_watcher() i=5 2024-09-12T01:00:25.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.401+0000 7fb6809ca9c0 20 add_watcher() i=6 2024-09-12T01:00:25.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.405+0000 7fb6809ca9c0 20 add_watcher() i=7 2024-09-12T01:00:25.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.405+0000 7fb6809ca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:25.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.409+0000 7fb534fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:25.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.409+0000 7fb6809ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:25.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.409+0000 7fb6809ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:25.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.409+0000 7fb6809ca9c0 5 note: GC not initialized 2024-09-12T01:00:25.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.409+0000 7fb4af7fe640 20 reqs_thread_entry: start 2024-09-12T01:00:25.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.409+0000 7fb6809ca9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:25.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.409+0000 7fb6809ca9c0 20 Filter name: none 2024-09-12T01:00:25.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.409+0000 7fb4ad7fa640 20 reqs_thread_entry: start 2024-09-12T01:00:25.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.409+0000 7fb6809ca9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T01:00:25.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.409+0000 7fb6809ca9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.413+0000 7fb6809ca9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T01:00:25.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.413+0000 7fb6809ca9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T01:00:25.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.413+0000 7fb6809ca9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:00:25.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.413+0000 7fb6809ca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:25.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.417+0000 7fb6809ca9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:00:25.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.417+0000 7fb6809ca9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:00:25.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.417+0000 7fb6809ca9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T01:00:25.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.421+0000 7fb561ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300904 cookie 94474000932656 notifier 9060 bl.length()=659 2024-09-12T01:00:25.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.421+0000 7fb561ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:00:25.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.421+0000 7fb561ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:00:25.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.425+0000 7fb534fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:25.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.429+0000 7fb6809ca9c0 20 remove_watcher() i=0 2024-09-12T01:00:25.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.429+0000 7fb6809ca9c0 2 removed watcher, disabling cache 2024-09-12T01:00:25.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.433+0000 7fb6809ca9c0 20 remove_watcher() i=1 2024-09-12T01:00:25.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.433+0000 7fb6809ca9c0 20 remove_watcher() i=2 2024-09-12T01:00:25.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.437+0000 7fb6809ca9c0 20 remove_watcher() i=3 2024-09-12T01:00:25.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.437+0000 7fb6809ca9c0 20 remove_watcher() i=4 2024-09-12T01:00:25.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.441+0000 7fb6809ca9c0 20 remove_watcher() i=5 2024-09-12T01:00:25.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.441+0000 7fb6809ca9c0 20 remove_watcher() i=6 2024-09-12T01:00:25.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.441+0000 7fb6809ca9c0 20 remove_watcher() i=7 2024-09-12T01:00:25.459 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T01:00:25.498 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:25.498 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:25.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.537+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.541+0000 7f6fdee599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.541+0000 7f6fdee599c0 20 realm 2024-09-12T01:00:25.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.541+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.541+0000 7f6fdee599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.541+0000 7f6fdee599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:25.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.541+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.541+0000 7f6fdee599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.541+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.541+0000 7f6fdee599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:25.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.541+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.545+0000 7f6fdee599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:25.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.545+0000 7f6fdee599c0 20 searching for the correct realm 2024-09-12T01:00:25.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.545+0000 7f6fdd160640 0 -- 172.21.15.102:0/1714377814 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f6fc8115020 msgr2=0x7f6fc810f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:25.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.553+0000 7f6fd7fff640 0 -- 172.21.15.102:0/1714377814 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6fd802e040 msgr2=0x7f6fd8021440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:25.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.769+0000 7f6fdee599c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:25.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.769+0000 7f6fdee599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:25.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.769+0000 7f6fdee599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:25.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.769+0000 7f6fdee599c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:25.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.769+0000 7f6fdee599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:25.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.769+0000 7f6fdee599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:25.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:25.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:25.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 zone default found 2024-09-12T01:00:25.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 4 Realm: () 2024-09-12T01:00:25.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:25.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:25.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:25.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 zonegroup default 2024-09-12T01:00:25.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.773+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.777+0000 7f6fdee599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.777+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.777+0000 7f6fdee599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.777+0000 7f6fdee599c0 20 started sync module instance, tier type = 2024-09-12T01:00:25.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.777+0000 7f6fdee599c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:25.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.797+0000 7f6fdee599c0 20 add_watcher() i=0 2024-09-12T01:00:25.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.797+0000 7f6fdee599c0 20 add_watcher() i=1 2024-09-12T01:00:25.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.797+0000 7f6fdee599c0 20 add_watcher() i=2 2024-09-12T01:00:25.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.797+0000 7f6fdee599c0 20 add_watcher() i=3 2024-09-12T01:00:25.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.797+0000 7f6fdee599c0 20 add_watcher() i=4 2024-09-12T01:00:25.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.797+0000 7f6fdee599c0 20 add_watcher() i=5 2024-09-12T01:00:25.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.797+0000 7f6fdee599c0 20 add_watcher() i=6 2024-09-12T01:00:25.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.801+0000 7f6fdee599c0 20 add_watcher() i=7 2024-09-12T01:00:25.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.801+0000 7f6fdee599c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:25.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.805+0000 7f6e937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:25.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.805+0000 7f6fdee599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:25.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.805+0000 7f6fdee599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:25.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.805+0000 7f6fdee599c0 5 note: GC not initialized 2024-09-12T01:00:25.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.805+0000 7f6e927e4640 20 reqs_thread_entry: start 2024-09-12T01:00:25.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.805+0000 7f6fdee599c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:25.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.805+0000 7f6fdee599c0 20 Filter name: none 2024-09-12T01:00:25.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.805+0000 7f6e8bfff640 20 reqs_thread_entry: start 2024-09-12T01:00:25.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.805+0000 7f6fdee599c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T01:00:25.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.805+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.809+0000 7f6fdee599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.809+0000 7f6fdee599c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T01:00:25.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.809+0000 7f6fdee599c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T01:00:25.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.809+0000 7f6fdee599c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T01:00:25.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.809+0000 7f6fdee599c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T01:00:25.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.809+0000 7f6fdee599c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.809+0000 7f6fdee599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.809+0000 7f6fdee599c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T01:00:25.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.809+0000 7f6fdee599c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T01:00:25.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.809+0000 7f6fdee599c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T01:00:25.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.813+0000 7f6fdee599c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T01:00:25.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.813+0000 7f6fdee599c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T01:00:25.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.813+0000 7f6fdee599c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T01:00:25.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.813+0000 7f6eb3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300905 cookie 94392555469440 notifier 9081 bl.length()=389 2024-09-12T01:00:25.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.813+0000 7f6eb3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T01:00:25.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.813+0000 7f6eb3fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T01:00:25.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.817+0000 7f6fdee599c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T01:00:25.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.817+0000 7f6fdee599c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T01:00:25.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.817+0000 7f6fdee599c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T01:00:25.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.817+0000 7f6eb3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300956 cookie 94392555474032 notifier 9081 bl.length()=230 2024-09-12T01:00:25.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.817+0000 7f6eb3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T01:00:25.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.817+0000 7f6eb3fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T01:00:25.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.825+0000 7f6fdee599c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T01:00:25.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.825+0000 7f6fdee599c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T01:00:25.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.825+0000 7f6fdee599c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T01:00:25.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.825+0000 7f6eb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300825 cookie 94392555476256 notifier 9081 bl.length()=234 2024-09-12T01:00:25.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.825+0000 7f6eb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T01:00:25.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.825+0000 7f6eb37fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T01:00:25.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.829+0000 7f6e937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:25.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.833+0000 7f6fdee599c0 20 remove_watcher() i=0 2024-09-12T01:00:25.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.833+0000 7f6fdee599c0 2 removed watcher, disabling cache 2024-09-12T01:00:25.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.837+0000 7f6fdee599c0 20 remove_watcher() i=1 2024-09-12T01:00:25.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.837+0000 7f6fdee599c0 20 remove_watcher() i=2 2024-09-12T01:00:25.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.841+0000 7f6fdee599c0 20 remove_watcher() i=3 2024-09-12T01:00:25.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.841+0000 7f6fdee599c0 20 remove_watcher() i=4 2024-09-12T01:00:25.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.845+0000 7f6fdee599c0 20 remove_watcher() i=5 2024-09-12T01:00:25.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.845+0000 7f6fdee599c0 20 remove_watcher() i=6 2024-09-12T01:00:25.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.849+0000 7f6fdee599c0 20 remove_watcher() i=7 2024-09-12T01:00:25.860 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "id": "RGW33333333333333333", 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "tenant": "testx", 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "quota": { 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:25.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max_users": 1000, 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max_roles": 1000, 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max_groups": 1000, 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max_access_keys": 4 2024-09-12T01:00:25.862 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T01:00:25.863 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T01:00:25.864 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key MHVIIUKMLCCSNRGTMCNR --secret fYSo1A7JF5Usakk8Gdf9Ou4pjfPewh+0UJZM8Kesuy0kGlUn3YX1eA== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T01:00:25.955 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:25.955 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:25.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:25.997+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.001+0000 7f516b8569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.001+0000 7f516b8569c0 20 realm 2024-09-12T01:00:25.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.001+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:25.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.001+0000 7f516b8569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:25.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.001+0000 7f516b8569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:25.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.001+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.001+0000 7f516b8569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.001+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.001+0000 7f516b8569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:26.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.001+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.005+0000 7f516b8569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:26.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.005+0000 7f516b8569c0 20 searching for the correct realm 2024-09-12T01:00:26.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.005+0000 7f5169b5d640 0 -- 172.21.15.102:0/924173592 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f5154008040 msgr2=0x7f515405b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:26.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.013+0000 7f5168b5b640 0 -- 172.21.15.102:0/924173592 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f516406b0b0 msgr2=0x7f5164090980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.229+0000 7f516b8569c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.229+0000 7f516b8569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.229+0000 7f516b8569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.229+0000 7f516b8569c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.229+0000 7f516b8569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.229+0000 7f516b8569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:26.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.229+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:26.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 20 zone default found 2024-09-12T01:00:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 4 Realm: () 2024-09-12T01:00:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:26.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 20 zonegroup default 2024-09-12T01:00:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.233+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.237+0000 7f516b8569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.237+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.237+0000 7f516b8569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.237+0000 7f516b8569c0 20 started sync module instance, tier type = 2024-09-12T01:00:26.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.237+0000 7f516b8569c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:26.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.257+0000 7f516b8569c0 20 add_watcher() i=0 2024-09-12T01:00:26.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.257+0000 7f516b8569c0 20 add_watcher() i=1 2024-09-12T01:00:26.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.257+0000 7f516b8569c0 20 add_watcher() i=2 2024-09-12T01:00:26.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.257+0000 7f516b8569c0 20 add_watcher() i=3 2024-09-12T01:00:26.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.257+0000 7f516b8569c0 20 add_watcher() i=4 2024-09-12T01:00:26.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.257+0000 7f516b8569c0 20 add_watcher() i=5 2024-09-12T01:00:26.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.257+0000 7f516b8569c0 20 add_watcher() i=6 2024-09-12T01:00:26.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.261+0000 7f516b8569c0 20 add_watcher() i=7 2024-09-12T01:00:26.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.261+0000 7f516b8569c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:26.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f501ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:26.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:26.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:26.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 5 note: GC not initialized 2024-09-12T01:00:26.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f501efe5640 20 reqs_thread_entry: start 2024-09-12T01:00:26.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:26.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 20 Filter name: none 2024-09-12T01:00:26.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f501cfe1640 20 reqs_thread_entry: start 2024-09-12T01:00:26.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T01:00:26.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T01:00:26.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:00:26.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T01:00:26.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T01:00:26.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:00:26.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 10 cache get: name=default.rgw.meta+users.keys+MHVIIUKMLCCSNRGTMCNR : miss 2024-09-12T01:00:26.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.265+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 10 cache put: name=default.rgw.meta+users.keys+MHVIIUKMLCCSNRGTMCNR info.flags=0x0 2024-09-12T01:00:26.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 10 adding default.rgw.meta+users.keys+MHVIIUKMLCCSNRGTMCNR to cache LRU end 2024-09-12T01:00:26.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T01:00:26.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T01:00:26.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T01:00:26.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T01:00:26.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:26.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 10 cache get: name=default.rgw.meta+users.keys+MHVIIUKMLCCSNRGTMCNR : hit (negative entry) 2024-09-12T01:00:26.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.269+0000 7f516b8569c0 10 cache get: name=default.rgw.meta+users.keys+MHVIIUKMLCCSNRGTMCNR : hit (negative entry) 2024-09-12T01:00:26.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.273+0000 7f516b8569c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:00:26.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.273+0000 7f516b8569c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:00:26.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.273+0000 7f516b8569c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T01:00:26.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.273+0000 7f504cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300937 cookie 94562827434240 notifier 8465 bl.length()=732 2024-09-12T01:00:26.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.273+0000 7f504cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:00:26.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.273+0000 7f504cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:00:26.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.277+0000 7f516b8569c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T01:00:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.277+0000 7f516b8569c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:00:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.277+0000 7f516b8569c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T01:00:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.277+0000 7f504cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300841 cookie 94562827427056 notifier 8465 bl.length()=215 2024-09-12T01:00:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.277+0000 7f504cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T01:00:26.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.277+0000 7f504cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:00:26.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.281+0000 7f516b8569c0 10 cache put: name=default.rgw.meta+users.keys+MHVIIUKMLCCSNRGTMCNR info.flags=0x7 2024-09-12T01:00:26.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.281+0000 7f516b8569c0 10 moving default.rgw.meta+users.keys+MHVIIUKMLCCSNRGTMCNR to cache LRU end 2024-09-12T01:00:26.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.281+0000 7f516b8569c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:MHVIIUKMLCCSNRGTMCNR, ofs0, ns] 2024-09-12T01:00:26.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.285+0000 7f503bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300938 cookie 94562827434240 notifier 8465 bl.length()=201 2024-09-12T01:00:26.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.285+0000 7f503bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MHVIIUKMLCCSNRGTMCNR info.flags=0x7 2024-09-12T01:00:26.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.285+0000 7f503bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MHVIIUKMLCCSNRGTMCNR to cache LRU end 2024-09-12T01:00:26.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.285+0000 7f516b8569c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T01:00:26.287 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T01:00:26.287 INFO:teuthology.orchestra.run.smithi102.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T01:00:26.287 INFO:teuthology.orchestra.run.smithi102.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T01:00:26.287 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T01:00:26.287 INFO:teuthology.orchestra.run.smithi102.stdout: "suspended": 0, 2024-09-12T01:00:26.287 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T01:00:26.287 INFO:teuthology.orchestra.run.smithi102.stdout: "subusers": [], 2024-09-12T01:00:26.287 INFO:teuthology.orchestra.run.smithi102.stdout: "keys": [ 2024-09-12T01:00:26.287 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "access_key": "MHVIIUKMLCCSNRGTMCNR", 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "secret_key": "fYSo1A7JF5Usakk8Gdf9Ou4pjfPewh+0UJZM8Kesuy0kGlUn3YX1eA==", 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "active": true, 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:26.272039Z" 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "swift_keys": [], 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": [], 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "default_placement": "", 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "default_storage_class": "", 2024-09-12T01:00:26.288 INFO:teuthology.orchestra.run.smithi102.stdout: "placement_tags": [], 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "user_quota": { 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:26.289 INFO:teuthology.orchestra.run.smithi102.stdout: "temp_url_keys": [], 2024-09-12T01:00:26.290 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "root", 2024-09-12T01:00:26.290 INFO:teuthology.orchestra.run.smithi102.stdout: "mfa_ids": [], 2024-09-12T01:00:26.290 INFO:teuthology.orchestra.run.smithi102.stdout: "account_id": "RGW33333333333333333", 2024-09-12T01:00:26.290 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-12T01:00:26.290 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:26.272009Z", 2024-09-12T01:00:26.290 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-12T01:00:26.290 INFO:teuthology.orchestra.run.smithi102.stdout: "group_ids": [] 2024-09-12T01:00:26.290 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T01:00:26.290 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:26.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.289+0000 7f501ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:26.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.293+0000 7f516b8569c0 20 remove_watcher() i=0 2024-09-12T01:00:26.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.293+0000 7f516b8569c0 2 removed watcher, disabling cache 2024-09-12T01:00:26.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.297+0000 7f516b8569c0 20 remove_watcher() i=1 2024-09-12T01:00:26.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.297+0000 7f516b8569c0 20 remove_watcher() i=2 2024-09-12T01:00:26.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.301+0000 7f516b8569c0 20 remove_watcher() i=3 2024-09-12T01:00:26.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.301+0000 7f516b8569c0 20 remove_watcher() i=4 2024-09-12T01:00:26.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.305+0000 7f516b8569c0 20 remove_watcher() i=5 2024-09-12T01:00:26.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.305+0000 7f516b8569c0 20 remove_watcher() i=6 2024-09-12T01:00:26.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.305+0000 7f516b8569c0 20 remove_watcher() i=7 2024-09-12T01:00:26.321 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 9779373917 --totp-seed MDRFIRE2ODJLW4A7PPQ3AQNM54TCVTELDZLDX7CVLIWSBNUWSGNRVLTG5HS6XUSX --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:00:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:26.366 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:26.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.405+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.409+0000 7f326dbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.409+0000 7f326dbb59c0 20 realm 2024-09-12T01:00:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.409+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.409+0000 7f326dbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.409+0000 7f326dbb59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.409+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.409+0000 7f326dbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.409+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.413+0000 7f326dbb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:26.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.413+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.413+0000 7f326dbb59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:26.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.413+0000 7f326dbb59c0 20 searching for the correct realm 2024-09-12T01:00:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.417+0000 7f326bebc640 0 -- 172.21.15.102:0/4091520263 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f32540ca070 msgr2=0x7f325412daa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:26.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.425+0000 7f3263fff640 0 -- 172.21.15.102:0/4091520263 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f3264068350 msgr2=0x7f32640664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:26.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.641+0000 7f326dbb59c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:26.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.641+0000 7f326dbb59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.641+0000 7f326dbb59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.641+0000 7f326dbb59c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.641+0000 7f326dbb59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.641+0000 7f326dbb59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.641+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:26.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 zone default found 2024-09-12T01:00:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 4 Realm: () 2024-09-12T01:00:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 zonegroup default 2024-09-12T01:00:26.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.645+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.649+0000 7f326dbb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.649+0000 7f326dbb59c0 20 started sync module instance, tier type = 2024-09-12T01:00:26.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.649+0000 7f326dbb59c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.673+0000 7f326dbb59c0 20 add_watcher() i=0 2024-09-12T01:00:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.673+0000 7f326dbb59c0 20 add_watcher() i=1 2024-09-12T01:00:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.673+0000 7f326dbb59c0 20 add_watcher() i=2 2024-09-12T01:00:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.673+0000 7f326dbb59c0 20 add_watcher() i=3 2024-09-12T01:00:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.673+0000 7f326dbb59c0 20 add_watcher() i=4 2024-09-12T01:00:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.673+0000 7f326dbb59c0 20 add_watcher() i=5 2024-09-12T01:00:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.673+0000 7f326dbb59c0 20 add_watcher() i=6 2024-09-12T01:00:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.677+0000 7f326dbb59c0 20 add_watcher() i=7 2024-09-12T01:00:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.677+0000 7f326dbb59c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f3121fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 5 note: GC not initialized 2024-09-12T01:00:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f3120fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 20 Filter name: none 2024-09-12T01:00:26.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f309a7fc640 20 reqs_thread_entry: start 2024-09-12T01:00:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T01:00:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T01:00:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T01:00:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:00:26.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.681+0000 7f326dbb59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.685+0000 7f326dbb59c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:00:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.685+0000 7f326dbb59c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:00:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.685+0000 7f326dbb59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T01:00:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.689+0000 7f314effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300939 cookie 94407333863472 notifier 8483 bl.length()=746 2024-09-12T01:00:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.689+0000 7f314effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:00:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.689+0000 7f314effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:00:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.693+0000 7f3121fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:26.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.697+0000 7f326dbb59c0 20 remove_watcher() i=0 2024-09-12T01:00:26.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.697+0000 7f326dbb59c0 2 removed watcher, disabling cache 2024-09-12T01:00:26.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.697+0000 7f326dbb59c0 20 remove_watcher() i=1 2024-09-12T01:00:26.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.701+0000 7f326dbb59c0 20 remove_watcher() i=2 2024-09-12T01:00:26.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.705+0000 7f326dbb59c0 20 remove_watcher() i=3 2024-09-12T01:00:26.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.705+0000 7f326dbb59c0 20 remove_watcher() i=4 2024-09-12T01:00:26.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.709+0000 7f326dbb59c0 20 remove_watcher() i=5 2024-09-12T01:00:26.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.709+0000 7f326dbb59c0 20 remove_watcher() i=6 2024-09-12T01:00:26.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.709+0000 7f326dbb59c0 20 remove_watcher() i=7 2024-09-12T01:00:26.725 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T01:00:26.725 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key GNJDHRYSLQRFSRJMRQPR --secret XU1GNYBxwkjraenytNKzAGDhq3WJDhZXfu3O5IE6Igl/Dzqvkmu4+g== --cluster ceph 2024-09-12T01:00:26.807 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:26.807 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:26.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.849+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.849+0000 7fbf8db0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.849+0000 7fbf8db0b9c0 20 realm 2024-09-12T01:00:26.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.849+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.853+0000 7fbf8db0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.853+0000 7fbf8db0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:26.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.853+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.853+0000 7fbf8db0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:26.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.853+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.853+0000 7fbf8db0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:26.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.853+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:26.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.857+0000 7fbf8db0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:26.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.857+0000 7fbf8db0b9c0 20 searching for the correct realm 2024-09-12T01:00:26.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:26.857+0000 7fbf8be12640 0 -- 172.21.15.102:0/1573131313 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7fbf8002a130 msgr2=0x7fbf8007d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:27.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.073+0000 7fbf8ae10640 0 -- 172.21.15.102:0/1573131313 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7fbf840d84b0 msgr2=0x7fbf840aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.289+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 zone default found 2024-09-12T01:00:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 4 Realm: () 2024-09-12T01:00:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 zonegroup default 2024-09-12T01:00:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 started sync module instance, tier type = 2024-09-12T01:00:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.293+0000 7fbf8db0b9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:27.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.317+0000 7fbf8db0b9c0 20 add_watcher() i=0 2024-09-12T01:00:27.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.317+0000 7fbf8db0b9c0 20 add_watcher() i=1 2024-09-12T01:00:27.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.317+0000 7fbf8db0b9c0 20 add_watcher() i=2 2024-09-12T01:00:27.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.317+0000 7fbf8db0b9c0 20 add_watcher() i=3 2024-09-12T01:00:27.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.317+0000 7fbf8db0b9c0 20 add_watcher() i=4 2024-09-12T01:00:27.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.317+0000 7fbf8db0b9c0 20 add_watcher() i=5 2024-09-12T01:00:27.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.317+0000 7fbf8db0b9c0 20 add_watcher() i=6 2024-09-12T01:00:27.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.317+0000 7fbf8db0b9c0 20 add_watcher() i=7 2024-09-12T01:00:27.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.317+0000 7fbf8db0b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.321+0000 7fbe41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.321+0000 7fbf8db0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.321+0000 7fbf8db0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.321+0000 7fbf8db0b9c0 5 note: GC not initialized 2024-09-12T01:00:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.321+0000 7fbe40fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.321+0000 7fbf8db0b9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 20 Filter name: none 2024-09-12T01:00:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbdba7fc640 20 reqs_thread_entry: start 2024-09-12T01:00:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:00:27.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T01:00:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:00:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T01:00:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T01:00:27.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:00:27.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 cache get: name=default.rgw.meta+users.keys+GNJDHRYSLQRFSRJMRQPR : miss 2024-09-12T01:00:27.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 cache put: name=default.rgw.meta+users.keys+GNJDHRYSLQRFSRJMRQPR info.flags=0x0 2024-09-12T01:00:27.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 adding default.rgw.meta+users.keys+GNJDHRYSLQRFSRJMRQPR to cache LRU end 2024-09-12T01:00:27.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 cache get: name=default.rgw.meta+users.keys+GNJDHRYSLQRFSRJMRQPR : hit (negative entry) 2024-09-12T01:00:27.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 cache get: name=default.rgw.meta+users.keys+GNJDHRYSLQRFSRJMRQPR : hit (negative entry) 2024-09-12T01:00:27.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:00:27.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:00:27.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbf8db0b9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:00:27.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbe6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300842 cookie 94923251380368 notifier 9132 bl.length()=660 2024-09-12T01:00:27.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbe6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:00:27.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.325+0000 7fbe6effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:00:27.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.333+0000 7fbf8db0b9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T01:00:27.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.333+0000 7fbf8db0b9c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:00:27.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.333+0000 7fbf8db0b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T01:00:27.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.333+0000 7fbe6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300906 cookie 94923251362800 notifier 9132 bl.length()=191 2024-09-12T01:00:27.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.333+0000 7fbe6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T01:00:27.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.333+0000 7fbe6e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:00:27.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.337+0000 7fbf8db0b9c0 10 cache put: name=default.rgw.meta+users.keys+GNJDHRYSLQRFSRJMRQPR info.flags=0x7 2024-09-12T01:00:27.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.337+0000 7fbf8db0b9c0 10 moving default.rgw.meta+users.keys+GNJDHRYSLQRFSRJMRQPR to cache LRU end 2024-09-12T01:00:27.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.337+0000 7fbf8db0b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:GNJDHRYSLQRFSRJMRQPR, ofs0, ns] 2024-09-12T01:00:27.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.337+0000 7fbe6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300957 cookie 94923251372592 notifier 9132 bl.length()=189 2024-09-12T01:00:27.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.337+0000 7fbe6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GNJDHRYSLQRFSRJMRQPR info.flags=0x7 2024-09-12T01:00:27.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.337+0000 7fbe6e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GNJDHRYSLQRFSRJMRQPR to cache LRU end 2024-09-12T01:00:27.340 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T01:00:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: "user_id": "foobar.client.0", 2024-09-12T01:00:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T01:00:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "foobar+test@test.test", 2024-09-12T01:00:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: "suspended": 0, 2024-09-12T01:00:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T01:00:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: "subusers": [], 2024-09-12T01:00:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: "keys": [ 2024-09-12T01:00:27.340 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "user": "foobar.client.0", 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "access_key": "GNJDHRYSLQRFSRJMRQPR", 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "secret_key": "XU1GNYBxwkjraenytNKzAGDhq3WJDhZXfu3O5IE6Igl/Dzqvkmu4+g==", 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "active": true, 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:27.327856Z" 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "swift_keys": [], 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": [], 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "default_placement": "", 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "default_storage_class": "", 2024-09-12T01:00:27.341 INFO:teuthology.orchestra.run.smithi102.stdout: "placement_tags": [], 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "user_quota": { 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:27.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "temp_url_keys": [], 2024-09-12T01:00:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "rgw", 2024-09-12T01:00:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "mfa_ids": [], 2024-09-12T01:00:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "account_id": "", 2024-09-12T01:00:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-12T01:00:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:27.327838Z", 2024-09-12T01:00:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-12T01:00:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: "group_ids": [] 2024-09-12T01:00:27.343 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T01:00:27.343 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:27.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.341+0000 7fbe41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:27.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.345+0000 7fbf8db0b9c0 20 remove_watcher() i=0 2024-09-12T01:00:27.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.345+0000 7fbf8db0b9c0 2 removed watcher, disabling cache 2024-09-12T01:00:27.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.349+0000 7fbf8db0b9c0 20 remove_watcher() i=1 2024-09-12T01:00:27.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.349+0000 7fbf8db0b9c0 20 remove_watcher() i=2 2024-09-12T01:00:27.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.353+0000 7fbf8db0b9c0 20 remove_watcher() i=3 2024-09-12T01:00:27.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.353+0000 7fbf8db0b9c0 20 remove_watcher() i=4 2024-09-12T01:00:27.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.357+0000 7fbf8db0b9c0 20 remove_watcher() i=5 2024-09-12T01:00:27.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.357+0000 7fbf8db0b9c0 20 remove_watcher() i=6 2024-09-12T01:00:27.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.361+0000 7fbf8db0b9c0 20 remove_watcher() i=7 2024-09-12T01:00:27.375 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 0948984246 --totp-seed 2EEU4NPX73WR7Q2N2LNCPH5C5FYVQIBUAFGGKYVM553S4D3JVZLCM7KWXL464D5Z --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:00:27.465 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:27.465 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:27.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.505+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 20 realm 2024-09-12T01:00:27.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:27.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:27.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.509+0000 7f62696bd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:27.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.513+0000 7f62696bd9c0 20 searching for the correct realm 2024-09-12T01:00:27.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.513+0000 7f62679c4640 0 -- 172.21.15.102:0/3474331714 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f62500ed400 msgr2=0x7f62500ed880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:27.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.729+0000 7f62669c2640 0 -- 172.21.15.102:0/3474331714 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f6260081150 msgr2=0x7f626002c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:27.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.945+0000 7f62696bd9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:27.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.945+0000 7f62696bd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:27.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.945+0000 7f62696bd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:27.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.945+0000 7f62696bd9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:27.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.945+0000 7f62696bd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:27.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.945+0000 7f62696bd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:27.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.945+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 20 zone default found 2024-09-12T01:00:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 4 Realm: () 2024-09-12T01:00:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 20 zonegroup default 2024-09-12T01:00:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.949+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.953+0000 7f62696bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.953+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.953+0000 7f62696bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.953+0000 7f62696bd9c0 20 started sync module instance, tier type = 2024-09-12T01:00:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.953+0000 7f62696bd9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.977+0000 7f62696bd9c0 20 add_watcher() i=0 2024-09-12T01:00:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.977+0000 7f62696bd9c0 20 add_watcher() i=1 2024-09-12T01:00:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.977+0000 7f62696bd9c0 20 add_watcher() i=2 2024-09-12T01:00:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.977+0000 7f62696bd9c0 20 add_watcher() i=3 2024-09-12T01:00:27.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.977+0000 7f62696bd9c0 20 add_watcher() i=4 2024-09-12T01:00:27.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.977+0000 7f62696bd9c0 20 add_watcher() i=5 2024-09-12T01:00:27.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.977+0000 7f62696bd9c0 20 add_watcher() i=6 2024-09-12T01:00:27.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.977+0000 7f62696bd9c0 20 add_watcher() i=7 2024-09-12T01:00:27.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.977+0000 7f62696bd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:27.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.981+0000 7f611dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:27.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.981+0000 7f62696bd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:27.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.981+0000 7f62696bd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:27.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.981+0000 7f62696bd9c0 5 note: GC not initialized 2024-09-12T01:00:27.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.985+0000 7f611cfe1640 20 reqs_thread_entry: start 2024-09-12T01:00:27.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.985+0000 7f62696bd9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:27.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.985+0000 7f62696bd9c0 20 Filter name: none 2024-09-12T01:00:27.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.985+0000 7f60967fc640 20 reqs_thread_entry: start 2024-09-12T01:00:27.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.985+0000 7f62696bd9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:00:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.985+0000 7f62696bd9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.985+0000 7f62696bd9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T01:00:27.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.985+0000 7f62696bd9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T01:00:27.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.985+0000 7f62696bd9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:00:27.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.985+0000 7f62696bd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:27.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.989+0000 7f62696bd9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:00:27.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.989+0000 7f62696bd9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:00:27.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.989+0000 7f62696bd9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:00:27.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.989+0000 7f614affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300843 cookie 94599625102384 notifier 8516 bl.length()=674 2024-09-12T01:00:27.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.989+0000 7f614affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:00:27.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.989+0000 7f614affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:00:27.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:27.993+0000 7f611dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:27.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.001+0000 7f62696bd9c0 20 remove_watcher() i=0 2024-09-12T01:00:28.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.001+0000 7f62696bd9c0 2 removed watcher, disabling cache 2024-09-12T01:00:28.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.001+0000 7f62696bd9c0 20 remove_watcher() i=1 2024-09-12T01:00:28.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.005+0000 7f62696bd9c0 20 remove_watcher() i=2 2024-09-12T01:00:28.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.005+0000 7f62696bd9c0 20 remove_watcher() i=3 2024-09-12T01:00:28.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.009+0000 7f62696bd9c0 20 remove_watcher() i=4 2024-09-12T01:00:28.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.009+0000 7f62696bd9c0 20 remove_watcher() i=5 2024-09-12T01:00:28.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.013+0000 7f62696bd9c0 20 remove_watcher() i=6 2024-09-12T01:00:28.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.013+0000 7f62696bd9c0 20 remove_watcher() i=7 2024-09-12T01:00:28.028 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T01:00:28.066 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:28.067 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 20 realm 2024-09-12T01:00:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.109+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.113+0000 7f18ad8c69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.113+0000 7f18ad8c69c0 20 searching for the correct realm 2024-09-12T01:00:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.117+0000 7f18abbcd640 0 -- 172.21.15.102:0/472568081 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f18940ec940 msgr2=0x7f18940c5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:28.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.333+0000 7f18aabcb640 0 -- 172.21.15.102:0/472568081 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f189c052450 msgr2=0x7f189c0528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:28.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:28.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:28.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:28.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:28.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:28.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:28.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:28.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:28.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:28.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 zone default found 2024-09-12T01:00:28.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 4 Realm: () 2024-09-12T01:00:28.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:28.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:28.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:28.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 zonegroup default 2024-09-12T01:00:28.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.553+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.557+0000 7f18ad8c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:28.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.557+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.557+0000 7f18ad8c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:28.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.557+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.557+0000 7f18ad8c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:28.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.557+0000 7f18ad8c69c0 20 started sync module instance, tier type = 2024-09-12T01:00:28.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.557+0000 7f18ad8c69c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:28.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.581+0000 7f18ad8c69c0 20 add_watcher() i=0 2024-09-12T01:00:28.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.581+0000 7f18ad8c69c0 20 add_watcher() i=1 2024-09-12T01:00:28.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.581+0000 7f18ad8c69c0 20 add_watcher() i=2 2024-09-12T01:00:28.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.581+0000 7f18ad8c69c0 20 add_watcher() i=3 2024-09-12T01:00:28.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.581+0000 7f18ad8c69c0 20 add_watcher() i=4 2024-09-12T01:00:28.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.581+0000 7f18ad8c69c0 20 add_watcher() i=5 2024-09-12T01:00:28.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.581+0000 7f18ad8c69c0 20 add_watcher() i=6 2024-09-12T01:00:28.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.585+0000 7f18ad8c69c0 20 add_watcher() i=7 2024-09-12T01:00:28.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.585+0000 7f18ad8c69c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:28.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f1761fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:28.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:28.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:28.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 5 note: GC not initialized 2024-09-12T01:00:28.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f1760fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:28.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:28.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 20 Filter name: none 2024-09-12T01:00:28.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f16da7fc640 20 reqs_thread_entry: start 2024-09-12T01:00:28.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:00:28.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T01:00:28.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T01:00:28.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:00:28.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.589+0000 7f18ad8c69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:28.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.593+0000 7f18ad8c69c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:00:28.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.593+0000 7f18ad8c69c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:00:28.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.593+0000 7f18ad8c69c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:00:28.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.593+0000 7f178effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300844 cookie 94872217230560 notifier 8534 bl.length()=727 2024-09-12T01:00:28.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.593+0000 7f178effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:00:28.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.593+0000 7f178effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:00:28.595 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T01:00:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "user_id": "foobar.client.0", 2024-09-12T01:00:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T01:00:28.595 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "foobar+test@test.test", 2024-09-12T01:00:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "suspended": 0, 2024-09-12T01:00:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T01:00:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "subusers": [], 2024-09-12T01:00:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "keys": [ 2024-09-12T01:00:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T01:00:28.596 INFO:teuthology.orchestra.run.smithi102.stdout: "user": "foobar.client.0", 2024-09-12T01:00:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "access_key": "GNJDHRYSLQRFSRJMRQPR", 2024-09-12T01:00:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "secret_key": "XU1GNYBxwkjraenytNKzAGDhq3WJDhZXfu3O5IE6Igl/Dzqvkmu4+g==", 2024-09-12T01:00:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "active": true, 2024-09-12T01:00:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:27.327856Z" 2024-09-12T01:00:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T01:00:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T01:00:28.597 INFO:teuthology.orchestra.run.smithi102.stdout: "swift_keys": [], 2024-09-12T01:00:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": [ 2024-09-12T01:00:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T01:00:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "oidc-provider", 2024-09-12T01:00:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: "perm": "*" 2024-09-12T01:00:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:28.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "roles", 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "perm": "*" 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "user-policy", 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "perm": "*" 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "default_placement": "", 2024-09-12T01:00:28.599 INFO:teuthology.orchestra.run.smithi102.stdout: "default_storage_class": "", 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "placement_tags": [], 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "user_quota": { 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:28.600 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "temp_url_keys": [], 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "rgw", 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "mfa_ids": [ 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "0948984246" 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "account_id": "", 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:27.327838Z", 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: "group_ids": [] 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T01:00:28.601 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:28.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.597+0000 7f1761fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:28.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.601+0000 7f18ad8c69c0 20 remove_watcher() i=0 2024-09-12T01:00:28.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.601+0000 7f18ad8c69c0 2 removed watcher, disabling cache 2024-09-12T01:00:28.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.605+0000 7f18ad8c69c0 20 remove_watcher() i=1 2024-09-12T01:00:28.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.605+0000 7f18ad8c69c0 20 remove_watcher() i=2 2024-09-12T01:00:28.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.609+0000 7f18ad8c69c0 20 remove_watcher() i=3 2024-09-12T01:00:28.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.609+0000 7f18ad8c69c0 20 remove_watcher() i=4 2024-09-12T01:00:28.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.613+0000 7f18ad8c69c0 20 remove_watcher() i=5 2024-09-12T01:00:28.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.613+0000 7f18ad8c69c0 20 remove_watcher() i=6 2024-09-12T01:00:28.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.617+0000 7f18ad8c69c0 20 remove_watcher() i=7 2024-09-12T01:00:28.630 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T01:00:28.711 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:28.712 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:28.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.753+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.757+0000 7f70b2adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:28.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.757+0000 7f70b2adc9c0 20 realm 2024-09-12T01:00:28.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.757+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.757+0000 7f70b2adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:28.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.757+0000 7f70b2adc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:28.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.757+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.757+0000 7f70b2adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:28.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.757+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.757+0000 7f70b2adc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:28.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.757+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:28.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.761+0000 7f70b2adc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:28.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.761+0000 7f70b2adc9c0 20 searching for the correct realm 2024-09-12T01:00:28.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.761+0000 7f70b0de3640 0 -- 172.21.15.102:0/2863124203 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f70a408fba0 msgr2=0x7f70a4062560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:28.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:28.977+0000 7f70afde1640 0 -- 172.21.15.102:0/2863124203 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f70a80e3b90 msgr2=0x7f70a8100920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:29.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.193+0000 7f70b2adc9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:29.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.193+0000 7f70b2adc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:29.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.193+0000 7f70b2adc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:29.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.193+0000 7f70b2adc9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:29.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.193+0000 7f70b2adc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:29.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.193+0000 7f70b2adc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:29.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.193+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.193+0000 7f70b2adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.193+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:29.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 20 zone default found 2024-09-12T01:00:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 4 Realm: () 2024-09-12T01:00:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 20 zonegroup default 2024-09-12T01:00:29.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.197+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.201+0000 7f70b2adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.201+0000 7f70b2adc9c0 20 started sync module instance, tier type = 2024-09-12T01:00:29.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.201+0000 7f70b2adc9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:29.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.221+0000 7f70b2adc9c0 20 add_watcher() i=0 2024-09-12T01:00:29.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.221+0000 7f70b2adc9c0 20 add_watcher() i=1 2024-09-12T01:00:29.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.221+0000 7f70b2adc9c0 20 add_watcher() i=2 2024-09-12T01:00:29.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.221+0000 7f70b2adc9c0 20 add_watcher() i=3 2024-09-12T01:00:29.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.221+0000 7f70b2adc9c0 20 add_watcher() i=4 2024-09-12T01:00:29.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.221+0000 7f70b2adc9c0 20 add_watcher() i=5 2024-09-12T01:00:29.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.221+0000 7f70b2adc9c0 20 add_watcher() i=6 2024-09-12T01:00:29.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.225+0000 7f70b2adc9c0 20 add_watcher() i=7 2024-09-12T01:00:29.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.225+0000 7f70b2adc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:29.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f6f66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:29.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:29.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:29.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 5 note: GC not initialized 2024-09-12T01:00:29.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f6f65fdb640 20 reqs_thread_entry: start 2024-09-12T01:00:29.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:29.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 20 Filter name: none 2024-09-12T01:00:29.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f6ed77fe640 20 reqs_thread_entry: start 2024-09-12T01:00:29.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T01:00:29.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T01:00:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:00:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T01:00:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T01:00:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.229+0000 7f70b2adc9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.233+0000 7f70b2adc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.233+0000 7f70b2adc9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T01:00:29.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.233+0000 7f70b2adc9c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:00:29.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.233+0000 7f70b2adc9c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T01:00:29.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.233+0000 7f70b2adc9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:00:29.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.233+0000 7f70b2adc9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:00:29.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.233+0000 7f70b2adc9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T01:00:29.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.237+0000 7f6f877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300907 cookie 93864064837984 notifier 9186 bl.length()=384 2024-09-12T01:00:29.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.237+0000 7f6f877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:00:29.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.237+0000 7f6f877fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:00:29.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.241+0000 7f70b2adc9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T01:00:29.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.241+0000 7f70b2adc9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:00:29.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.241+0000 7f70b2adc9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T01:00:29.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.245+0000 7f6f877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300958 cookie 93864064844352 notifier 9186 bl.length()=225 2024-09-12T01:00:29.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.245+0000 7f6f877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T01:00:29.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.245+0000 7f6f877fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:00:29.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.249+0000 7f70b2adc9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T01:00:29.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.249+0000 7f70b2adc9c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:00:29.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.249+0000 7f70b2adc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T01:00:29.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.249+0000 7f6f877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300826 cookie 93864064851072 notifier 9186 bl.length()=234 2024-09-12T01:00:29.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.249+0000 7f6f877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T01:00:29.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.249+0000 7f6f877fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:00:29.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.253+0000 7f6f66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:29.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.261+0000 7f70b2adc9c0 20 remove_watcher() i=0 2024-09-12T01:00:29.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.261+0000 7f70b2adc9c0 2 removed watcher, disabling cache 2024-09-12T01:00:29.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.261+0000 7f70b2adc9c0 20 remove_watcher() i=1 2024-09-12T01:00:29.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.265+0000 7f70b2adc9c0 20 remove_watcher() i=2 2024-09-12T01:00:29.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.265+0000 7f70b2adc9c0 20 remove_watcher() i=3 2024-09-12T01:00:29.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.269+0000 7f70b2adc9c0 20 remove_watcher() i=4 2024-09-12T01:00:29.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.273+0000 7f70b2adc9c0 20 remove_watcher() i=5 2024-09-12T01:00:29.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.273+0000 7f70b2adc9c0 20 remove_watcher() i=6 2024-09-12T01:00:29.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.273+0000 7f70b2adc9c0 20 remove_watcher() i=7 2024-09-12T01:00:29.288 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T01:00:29.288 INFO:teuthology.orchestra.run.smithi102.stdout: "id": "RGW88888888888888888", 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "tenant": "", 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "quota": { 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T01:00:29.289 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:29.290 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:29.290 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:29.290 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:29.290 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:29.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:29.290 INFO:teuthology.orchestra.run.smithi102.stdout: "max_users": 1000, 2024-09-12T01:00:29.290 INFO:teuthology.orchestra.run.smithi102.stdout: "max_roles": 1000, 2024-09-12T01:00:29.290 INFO:teuthology.orchestra.run.smithi102.stdout: "max_groups": 1000, 2024-09-12T01:00:29.290 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T01:00:29.291 INFO:teuthology.orchestra.run.smithi102.stdout: "max_access_keys": 4 2024-09-12T01:00:29.291 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T01:00:29.292 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T01:00:29.292 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key BDDVFGURNVFJVYDZOMAP --secret xb0vEcrzlGQotjiPDa02LdhmnWO7El6zSyR8vOo2K6BiNJmWV0hmIA== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T01:00:29.388 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:29.388 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:29.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.429+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.433+0000 7f42c41ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.433+0000 7f42c41ac9c0 20 realm 2024-09-12T01:00:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.433+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.433+0000 7f42c41ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.433+0000 7f42c41ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.433+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.433+0000 7f42c41ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.433+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.433+0000 7f42c41ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:29.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.433+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.437+0000 7f42c41ac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.437+0000 7f42c41ac9c0 20 searching for the correct realm 2024-09-12T01:00:29.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.441+0000 7f42c24b3640 0 -- 172.21.15.102:0/3951839526 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x56080e361d50 msgr2=0x56080e364140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:29.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.445+0000 7f42c14b1640 0 -- 172.21.15.102:0/3951839526 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f42bc0800c0 msgr2=0x7f42bc06c760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:29.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.661+0000 7f42c41ac9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:29.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.661+0000 7f42c41ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:29.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.661+0000 7f42c41ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:29.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.661+0000 7f42c41ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:29.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.661+0000 7f42c41ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:29.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.661+0000 7f42c41ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:29.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.661+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.661+0000 7f42c41ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.661+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 20 zone default found 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 4 Realm: () 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 20 zonegroup default 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.665+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.669+0000 7f42c41ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.669+0000 7f42c41ac9c0 20 started sync module instance, tier type = 2024-09-12T01:00:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.669+0000 7f42c41ac9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:29.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.693+0000 7f42c41ac9c0 20 add_watcher() i=0 2024-09-12T01:00:29.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.693+0000 7f42c41ac9c0 20 add_watcher() i=1 2024-09-12T01:00:29.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.693+0000 7f42c41ac9c0 20 add_watcher() i=2 2024-09-12T01:00:29.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.693+0000 7f42c41ac9c0 20 add_watcher() i=3 2024-09-12T01:00:29.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.693+0000 7f42c41ac9c0 20 add_watcher() i=4 2024-09-12T01:00:29.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.693+0000 7f42c41ac9c0 20 add_watcher() i=5 2024-09-12T01:00:29.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.693+0000 7f42c41ac9c0 20 add_watcher() i=6 2024-09-12T01:00:29.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.693+0000 7f42c41ac9c0 20 add_watcher() i=7 2024-09-12T01:00:29.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.693+0000 7f42c41ac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:29.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.697+0000 7f41737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:29.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.697+0000 7f42c41ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:29.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.697+0000 7f42c41ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:29.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.697+0000 7f42c41ac9c0 5 note: GC not initialized 2024-09-12T01:00:29.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.697+0000 7f41727fc640 20 reqs_thread_entry: start 2024-09-12T01:00:29.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:29.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 20 Filter name: none 2024-09-12T01:00:29.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f40e3fff640 20 reqs_thread_entry: start 2024-09-12T01:00:29.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T01:00:29.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T01:00:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:00:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T01:00:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T01:00:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:00:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 cache get: name=default.rgw.meta+users.keys+BDDVFGURNVFJVYDZOMAP : miss 2024-09-12T01:00:29.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 cache put: name=default.rgw.meta+users.keys+BDDVFGURNVFJVYDZOMAP info.flags=0x0 2024-09-12T01:00:29.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 adding default.rgw.meta+users.keys+BDDVFGURNVFJVYDZOMAP to cache LRU end 2024-09-12T01:00:29.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T01:00:29.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:00:29.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:00:29.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:00:29.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:29.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.701+0000 7f42c41ac9c0 10 cache get: name=default.rgw.meta+users.keys+BDDVFGURNVFJVYDZOMAP : hit (negative entry) 2024-09-12T01:00:29.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.705+0000 7f42c41ac9c0 10 cache get: name=default.rgw.meta+users.keys+BDDVFGURNVFJVYDZOMAP : hit (negative entry) 2024-09-12T01:00:29.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.705+0000 7f42c41ac9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:00:29.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.705+0000 7f42c41ac9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:00:29.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.705+0000 7f42c41ac9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T01:00:29.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.705+0000 7f41a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300908 cookie 94592598187872 notifier 8567 bl.length()=681 2024-09-12T01:00:29.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.705+0000 7f41a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:00:29.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.705+0000 7f41a57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:00:29.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.713+0000 7f42c41ac9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T01:00:29.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.713+0000 7f42c41ac9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:00:29.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.713+0000 7f42c41ac9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T01:00:29.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.713+0000 7f41a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300940 cookie 94592598200896 notifier 8567 bl.length()=189 2024-09-12T01:00:29.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.713+0000 7f41a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T01:00:29.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.713+0000 7f41a57fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:00:29.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.717+0000 7f42c41ac9c0 10 cache put: name=default.rgw.meta+users.keys+BDDVFGURNVFJVYDZOMAP info.flags=0x7 2024-09-12T01:00:29.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.717+0000 7f42c41ac9c0 10 moving default.rgw.meta+users.keys+BDDVFGURNVFJVYDZOMAP to cache LRU end 2024-09-12T01:00:29.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.717+0000 7f42c41ac9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:BDDVFGURNVFJVYDZOMAP, ofs0, ns] 2024-09-12T01:00:29.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.717+0000 7f41a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300909 cookie 94592598187872 notifier 8567 bl.length()=188 2024-09-12T01:00:29.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.717+0000 7f41a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BDDVFGURNVFJVYDZOMAP info.flags=0x7 2024-09-12T01:00:29.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.717+0000 7f41a4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BDDVFGURNVFJVYDZOMAP to cache LRU end 2024-09-12T01:00:29.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.725+0000 7f42c41ac9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T01:00:29.724 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "user_id": "root1.client.0", 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "root1+test@test.test", 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "suspended": 0, 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "subusers": [], 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "keys": [ 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "user": "root1.client.0", 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "access_key": "BDDVFGURNVFJVYDZOMAP", 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "secret_key": "xb0vEcrzlGQotjiPDa02LdhmnWO7El6zSyR8vOo2K6BiNJmWV0hmIA==", 2024-09-12T01:00:29.725 INFO:teuthology.orchestra.run.smithi102.stdout: "active": true, 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:29.706053Z" 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "swift_keys": [], 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": [], 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "default_placement": "", 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "default_storage_class": "", 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "placement_tags": [], 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:29.726 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "user_quota": { 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "temp_url_keys": [], 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "root", 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "mfa_ids": [], 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "account_id": "RGW88888888888888888", 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-12T01:00:29.727 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:29.706021Z", 2024-09-12T01:00:29.728 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-12T01:00:29.728 INFO:teuthology.orchestra.run.smithi102.stdout: "group_ids": [] 2024-09-12T01:00:29.728 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T01:00:29.728 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:29.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.725+0000 7f41737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:29.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.729+0000 7f42c41ac9c0 20 remove_watcher() i=0 2024-09-12T01:00:29.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.729+0000 7f42c41ac9c0 2 removed watcher, disabling cache 2024-09-12T01:00:29.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.733+0000 7f42c41ac9c0 20 remove_watcher() i=1 2024-09-12T01:00:29.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.737+0000 7f42c41ac9c0 20 remove_watcher() i=2 2024-09-12T01:00:29.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.737+0000 7f42c41ac9c0 20 remove_watcher() i=3 2024-09-12T01:00:29.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.741+0000 7f42c41ac9c0 20 remove_watcher() i=4 2024-09-12T01:00:29.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.741+0000 7f42c41ac9c0 20 remove_watcher() i=5 2024-09-12T01:00:29.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.741+0000 7f42c41ac9c0 20 remove_watcher() i=6 2024-09-12T01:00:29.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.745+0000 7f42c41ac9c0 20 remove_watcher() i=7 2024-09-12T01:00:29.761 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 0976115064 --totp-seed FFSTMWCSCKKECPPRV7JMQ7D6TPIMM4LTUBBGYT2Z2FLUZGUD6XBG5Q3OHZSERFDO --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:00:29.802 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:29.802 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:29.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.845+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.845+0000 7f283043b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.845+0000 7f283043b9c0 20 realm 2024-09-12T01:00:29.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.845+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.845+0000 7f283043b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.845+0000 7f283043b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:29.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.845+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.845+0000 7f283043b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:29.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.845+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.849+0000 7f283043b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:29.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.849+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:29.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.849+0000 7f283043b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:29.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.849+0000 7f283043b9c0 20 searching for the correct realm 2024-09-12T01:00:29.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:29.853+0000 7f282e742640 0 -- 172.21.15.102:0/3778176718 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f28240fa040 msgr2=0x7f28240fa930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:30.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.069+0000 7f282d740640 0 -- 172.21.15.102:0/3778176718 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f282806ed00 msgr2=0x7f282807f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:30.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:30.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:30.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:30.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:30.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:30.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:30.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:30.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:30.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 zone default found 2024-09-12T01:00:30.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 4 Realm: () 2024-09-12T01:00:30.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:30.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:30.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:30.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 zonegroup default 2024-09-12T01:00:30.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.289+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.293+0000 7f283043b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.293+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.293+0000 7f283043b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.293+0000 7f283043b9c0 20 started sync module instance, tier type = 2024-09-12T01:00:30.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.293+0000 7f283043b9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:30.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.317+0000 7f283043b9c0 20 add_watcher() i=0 2024-09-12T01:00:30.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.317+0000 7f283043b9c0 20 add_watcher() i=1 2024-09-12T01:00:30.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.317+0000 7f283043b9c0 20 add_watcher() i=2 2024-09-12T01:00:30.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.317+0000 7f283043b9c0 20 add_watcher() i=3 2024-09-12T01:00:30.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.317+0000 7f283043b9c0 20 add_watcher() i=4 2024-09-12T01:00:30.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.317+0000 7f283043b9c0 20 add_watcher() i=5 2024-09-12T01:00:30.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.317+0000 7f283043b9c0 20 add_watcher() i=6 2024-09-12T01:00:30.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.321+0000 7f283043b9c0 20 add_watcher() i=7 2024-09-12T01:00:30.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.321+0000 7f283043b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:30.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f26df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:30.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:30.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:30.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 5 note: GC not initialized 2024-09-12T01:00:30.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f26de7fc640 20 reqs_thread_entry: start 2024-09-12T01:00:30.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:30.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 20 Filter name: none 2024-09-12T01:00:30.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f264ffff640 20 reqs_thread_entry: start 2024-09-12T01:00:30.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T01:00:30.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T01:00:30.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T01:00:30.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:00:30.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.325+0000 7f283043b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:30.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.329+0000 7f283043b9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:00:30.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.329+0000 7f283043b9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:00:30.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.329+0000 7f283043b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T01:00:30.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.329+0000 7f27117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300910 cookie 93978131277424 notifier 9228 bl.length()=695 2024-09-12T01:00:30.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.329+0000 7f27117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:00:30.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.329+0000 7f27117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:00:30.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.333+0000 7f26df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:30.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.341+0000 7f283043b9c0 20 remove_watcher() i=0 2024-09-12T01:00:30.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.341+0000 7f283043b9c0 2 removed watcher, disabling cache 2024-09-12T01:00:30.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.341+0000 7f283043b9c0 20 remove_watcher() i=1 2024-09-12T01:00:30.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.345+0000 7f283043b9c0 20 remove_watcher() i=2 2024-09-12T01:00:30.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.345+0000 7f283043b9c0 20 remove_watcher() i=3 2024-09-12T01:00:30.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.349+0000 7f283043b9c0 20 remove_watcher() i=4 2024-09-12T01:00:30.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.349+0000 7f283043b9c0 20 remove_watcher() i=5 2024-09-12T01:00:30.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.353+0000 7f283043b9c0 20 remove_watcher() i=6 2024-09-12T01:00:30.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.353+0000 7f283043b9c0 20 remove_watcher() i=7 2024-09-12T01:00:30.377 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T01:00:30.458 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:30.458 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:30.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.501+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.501+0000 7f4661ab29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.501+0000 7f4661ab29c0 20 realm 2024-09-12T01:00:30.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.501+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.501+0000 7f4661ab29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.501+0000 7f4661ab29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:30.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.501+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.501+0000 7f4661ab29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.501+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.505+0000 7f4661ab29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:30.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.505+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.505+0000 7f4661ab29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:30.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.505+0000 7f4661ab29c0 20 searching for the correct realm 2024-09-12T01:00:30.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.509+0000 7f465fdb9640 0 -- 172.21.15.102:0/1433399184 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f4654027070 msgr2=0x7f4654042930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:30.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.725+0000 7f465edb7640 0 -- 172.21.15.102:0/1433399184 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f46580fa0b0 msgr2=0x7f46580e4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:30.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:30.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:30.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:30.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 zone default found 2024-09-12T01:00:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 4 Realm: () 2024-09-12T01:00:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 zonegroup default 2024-09-12T01:00:30.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.945+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.949+0000 7f4661ab29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.949+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.949+0000 7f4661ab29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.949+0000 7f4661ab29c0 20 started sync module instance, tier type = 2024-09-12T01:00:30.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.949+0000 7f4661ab29c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.973+0000 7f4661ab29c0 20 add_watcher() i=0 2024-09-12T01:00:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.973+0000 7f4661ab29c0 20 add_watcher() i=1 2024-09-12T01:00:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.973+0000 7f4661ab29c0 20 add_watcher() i=2 2024-09-12T01:00:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.973+0000 7f4661ab29c0 20 add_watcher() i=3 2024-09-12T01:00:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.973+0000 7f4661ab29c0 20 add_watcher() i=4 2024-09-12T01:00:30.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.973+0000 7f4661ab29c0 20 add_watcher() i=5 2024-09-12T01:00:30.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.973+0000 7f4661ab29c0 20 add_watcher() i=6 2024-09-12T01:00:30.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.977+0000 7f4661ab29c0 20 add_watcher() i=7 2024-09-12T01:00:30.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.977+0000 7f4661ab29c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:30.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4515fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:30.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:30.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:30.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 5 note: GC not initialized 2024-09-12T01:00:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4514fe1640 20 reqs_thread_entry: start 2024-09-12T01:00:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 20 Filter name: none 2024-09-12T01:00:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f448e7fc640 20 reqs_thread_entry: start 2024-09-12T01:00:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T01:00:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T01:00:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:00:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T01:00:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T01:00:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T01:00:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:00:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.981+0000 7f4661ab29c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T01:00:30.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.985+0000 7f4661ab29c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:00:30.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.985+0000 7f4661ab29c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:00:30.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.985+0000 7f4661ab29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T01:00:30.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.989+0000 7f4542ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300911 cookie 94097008537440 notifier 8600 bl.length()=384 2024-09-12T01:00:30.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.989+0000 7f4542ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:00:30.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.989+0000 7f4542ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:00:30.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.993+0000 7f4661ab29c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T01:00:30.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.993+0000 7f4661ab29c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:00:30.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.993+0000 7f4661ab29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T01:00:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.993+0000 7f45427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300959 cookie 94097008545072 notifier 8600 bl.length()=225 2024-09-12T01:00:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.993+0000 7f45427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T01:00:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.993+0000 7f45427fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:00:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.997+0000 7f4661ab29c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T01:00:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.997+0000 7f4661ab29c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:00:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.997+0000 7f4661ab29c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T01:00:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.997+0000 7f45427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300827 cookie 94097008543824 notifier 8600 bl.length()=234 2024-09-12T01:00:30.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.997+0000 7f45427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T01:00:30.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:30.997+0000 7f45427fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:00:31.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.001+0000 7f4515fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:31.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.005+0000 7f4661ab29c0 20 remove_watcher() i=0 2024-09-12T01:00:31.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.005+0000 7f4661ab29c0 2 removed watcher, disabling cache 2024-09-12T01:00:31.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.009+0000 7f4661ab29c0 20 remove_watcher() i=1 2024-09-12T01:00:31.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.013+0000 7f4661ab29c0 20 remove_watcher() i=2 2024-09-12T01:00:31.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.013+0000 7f4661ab29c0 20 remove_watcher() i=3 2024-09-12T01:00:31.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.017+0000 7f4661ab29c0 20 remove_watcher() i=4 2024-09-12T01:00:31.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.017+0000 7f4661ab29c0 20 remove_watcher() i=5 2024-09-12T01:00:31.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.017+0000 7f4661ab29c0 20 remove_watcher() i=6 2024-09-12T01:00:31.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.021+0000 7f4661ab29c0 20 remove_watcher() i=7 2024-09-12T01:00:31.033 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T01:00:31.033 INFO:teuthology.orchestra.run.smithi102.stdout: "id": "RGW99999999999999999", 2024-09-12T01:00:31.033 INFO:teuthology.orchestra.run.smithi102.stdout: "tenant": "", 2024-09-12T01:00:31.033 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T01:00:31.033 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T01:00:31.033 INFO:teuthology.orchestra.run.smithi102.stdout: "quota": { 2024-09-12T01:00:31.033 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:31.033 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:31.034 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:31.034 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:31.034 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:31.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:31.034 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T01:00:31.034 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:31.034 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:31.034 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:31.034 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:31.035 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:31.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:31.035 INFO:teuthology.orchestra.run.smithi102.stdout: "max_users": 1000, 2024-09-12T01:00:31.035 INFO:teuthology.orchestra.run.smithi102.stdout: "max_roles": 1000, 2024-09-12T01:00:31.035 INFO:teuthology.orchestra.run.smithi102.stdout: "max_groups": 1000, 2024-09-12T01:00:31.035 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T01:00:31.035 INFO:teuthology.orchestra.run.smithi102.stdout: "max_access_keys": 4 2024-09-12T01:00:31.035 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T01:00:31.037 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T01:00:31.037 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key WTLYQKMWRAXWTZZTUPOY --secret OWCEZQiuL7ceRriYAprxahMXMg4u/kSrPaMVwjy8Xxu0Qu3OaK1wwQ== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T01:00:31.127 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:31.127 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:31.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.169+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.173+0000 7f703a0859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.173+0000 7f703a0859c0 20 realm 2024-09-12T01:00:31.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.173+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.173+0000 7f703a0859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.173+0000 7f703a0859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:31.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.173+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.173+0000 7f703a0859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.173+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.173+0000 7f703a0859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:31.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.173+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.177+0000 7f703a0859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.177+0000 7f703a0859c0 20 searching for the correct realm 2024-09-12T01:00:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.177+0000 7f703838c640 0 -- 172.21.15.102:0/340607138 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f702c015040 msgr2=0x7f702c013400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.393+0000 7f703738a640 0 -- 172.21.15.102:0/340607138 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f70300fc300 msgr2=0x7f7030113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:31.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:31.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:31.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:31.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:31.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:31.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:31.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:31.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.609+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:31.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 zone default found 2024-09-12T01:00:31.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 4 Realm: () 2024-09-12T01:00:31.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:31.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:31.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:31.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 zonegroup default 2024-09-12T01:00:31.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 started sync module instance, tier type = 2024-09-12T01:00:31.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.613+0000 7f703a0859c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:31.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.641+0000 7f703a0859c0 20 add_watcher() i=0 2024-09-12T01:00:31.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.641+0000 7f703a0859c0 20 add_watcher() i=1 2024-09-12T01:00:31.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.641+0000 7f703a0859c0 20 add_watcher() i=2 2024-09-12T01:00:31.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.641+0000 7f703a0859c0 20 add_watcher() i=3 2024-09-12T01:00:31.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.641+0000 7f703a0859c0 20 add_watcher() i=4 2024-09-12T01:00:31.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.641+0000 7f703a0859c0 20 add_watcher() i=5 2024-09-12T01:00:31.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.645+0000 7f703a0859c0 20 add_watcher() i=6 2024-09-12T01:00:31.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.645+0000 7f703a0859c0 20 add_watcher() i=7 2024-09-12T01:00:31.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.645+0000 7f703a0859c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:31.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.649+0000 7f6eedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:31.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:31.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:31.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 5 note: GC not initialized 2024-09-12T01:00:31.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f6eecfe1640 20 reqs_thread_entry: start 2024-09-12T01:00:31.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:31.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 Filter name: none 2024-09-12T01:00:31.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f6e667fc640 20 reqs_thread_entry: start 2024-09-12T01:00:31.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T01:00:31.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T01:00:31.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:00:31.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T01:00:31.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T01:00:31.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:00:31.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 10 cache get: name=default.rgw.meta+users.keys+WTLYQKMWRAXWTZZTUPOY : miss 2024-09-12T01:00:31.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 10 cache put: name=default.rgw.meta+users.keys+WTLYQKMWRAXWTZZTUPOY info.flags=0x0 2024-09-12T01:00:31.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 10 adding default.rgw.meta+users.keys+WTLYQKMWRAXWTZZTUPOY to cache LRU end 2024-09-12T01:00:31.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T01:00:31.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.653+0000 7f703a0859c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.657+0000 7f703a0859c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:00:31.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.657+0000 7f703a0859c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:00:31.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.657+0000 7f703a0859c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:00:31.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.657+0000 7f703a0859c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:31.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.657+0000 7f703a0859c0 10 cache get: name=default.rgw.meta+users.keys+WTLYQKMWRAXWTZZTUPOY : hit (negative entry) 2024-09-12T01:00:31.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.657+0000 7f703a0859c0 10 cache get: name=default.rgw.meta+users.keys+WTLYQKMWRAXWTZZTUPOY : hit (negative entry) 2024-09-12T01:00:31.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.657+0000 7f703a0859c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:00:31.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.657+0000 7f703a0859c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:00:31.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.657+0000 7f703a0859c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T01:00:31.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.661+0000 7f6f16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300912 cookie 94855082929408 notifier 9264 bl.length()=681 2024-09-12T01:00:31.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.661+0000 7f6f16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:00:31.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.661+0000 7f6f16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:00:31.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.665+0000 7f703a0859c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T01:00:31.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.665+0000 7f703a0859c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:00:31.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.665+0000 7f703a0859c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T01:00:31.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.665+0000 7f6f16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300941 cookie 94855082943840 notifier 9264 bl.length()=189 2024-09-12T01:00:31.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.665+0000 7f6f16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T01:00:31.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.665+0000 7f6f16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:00:31.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.669+0000 7f703a0859c0 10 cache put: name=default.rgw.meta+users.keys+WTLYQKMWRAXWTZZTUPOY info.flags=0x7 2024-09-12T01:00:31.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.669+0000 7f703a0859c0 10 moving default.rgw.meta+users.keys+WTLYQKMWRAXWTZZTUPOY to cache LRU end 2024-09-12T01:00:31.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.669+0000 7f703a0859c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:WTLYQKMWRAXWTZZTUPOY, ofs0, ns] 2024-09-12T01:00:31.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.669+0000 7f6f16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300960 cookie 94855082935696 notifier 9264 bl.length()=188 2024-09-12T01:00:31.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.669+0000 7f6f16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WTLYQKMWRAXWTZZTUPOY info.flags=0x7 2024-09-12T01:00:31.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.669+0000 7f6f16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WTLYQKMWRAXWTZZTUPOY to cache LRU end 2024-09-12T01:00:31.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.673+0000 7f703a0859c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T01:00:31.674 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "user_id": "root2.client.0", 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "email": "root2+test@test.test", 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "suspended": 0, 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "max_buckets": 1000, 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "subusers": [], 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "keys": [ 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "user": "root2.client.0", 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "access_key": "WTLYQKMWRAXWTZZTUPOY", 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "secret_key": "OWCEZQiuL7ceRriYAprxahMXMg4u/kSrPaMVwjy8Xxu0Qu3OaK1wwQ==", 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "active": true, 2024-09-12T01:00:31.675 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:31.658717Z" 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "swift_keys": [], 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": [], 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "op_mask": "read, write, delete", 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "default_placement": "", 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "default_storage_class": "", 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "placement_tags": [], 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "bucket_quota": { 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:31.676 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "user_quota": { 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": false, 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "check_on_raw": false, 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size": -1, 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "max_size_kb": 0, 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "max_objects": -1 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "temp_url_keys": [], 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "root", 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "mfa_ids": [], 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "account_id": "RGW99999999999999999", 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-12T01:00:31.677 INFO:teuthology.orchestra.run.smithi102.stdout: "create_date": "2024-09-12T01:00:31.658676Z", 2024-09-12T01:00:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-12T01:00:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: "group_ids": [] 2024-09-12T01:00:31.678 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T01:00:31.678 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:00:31.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.677+0000 7f6eedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:31.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.681+0000 7f703a0859c0 20 remove_watcher() i=0 2024-09-12T01:00:31.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.681+0000 7f703a0859c0 2 removed watcher, disabling cache 2024-09-12T01:00:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.681+0000 7f703a0859c0 20 remove_watcher() i=1 2024-09-12T01:00:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.685+0000 7f703a0859c0 20 remove_watcher() i=2 2024-09-12T01:00:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.685+0000 7f703a0859c0 20 remove_watcher() i=3 2024-09-12T01:00:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.689+0000 7f703a0859c0 20 remove_watcher() i=4 2024-09-12T01:00:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.689+0000 7f703a0859c0 20 remove_watcher() i=5 2024-09-12T01:00:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.693+0000 7f703a0859c0 20 remove_watcher() i=6 2024-09-12T01:00:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.693+0000 7f703a0859c0 20 remove_watcher() i=7 2024-09-12T01:00:31.709 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 6772897256 --totp-seed EEMHZIAXXOP4JR4VOP4P2WIHJJZN5XVKN3UA6SJR6W4GCWYEEDFBZIAOMQK3UH5G --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:00:31.751 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:00:31.752 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:00:31.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.793+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.793+0000 7f5b89c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.793+0000 7f5b89c2f9c0 20 realm 2024-09-12T01:00:31.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.793+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.793+0000 7f5b89c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.793+0000 7f5b89c2f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:00:31.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.793+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.797+0000 7f5b89c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:31.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.797+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.797+0000 7f5b89c2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:31.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.797+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:31.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.797+0000 7f5b89c2f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:00:31.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.797+0000 7f5b89c2f9c0 20 searching for the correct realm 2024-09-12T01:00:31.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.801+0000 7f5b87f36640 0 -- 172.21.15.102:0/3266273328 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x558079d26ce0 msgr2=0x558079d290f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:00:31.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:31.805+0000 7f5b87735640 0 -- 172.21.15.102:0/3266273328 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x7f5b80024040 msgr2=0x7f5b80065890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:00:32.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T01:00:32.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:00:32.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:00:32.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T01:00:32.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:00:32.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:00:32.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:32.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:32.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:32.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:00:32.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:32.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:00:32.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 zone default found 2024-09-12T01:00:32.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 4 Realm: () 2024-09-12T01:00:32.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T01:00:32.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T01:00:32.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:00:32.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 zonegroup default 2024-09-12T01:00:32.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:32.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:32.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.029+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:32.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.033+0000 7f5b89c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:32.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.033+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:32.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.033+0000 7f5b89c2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:00:32.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.033+0000 7f5b89c2f9c0 20 started sync module instance, tier type = 2024-09-12T01:00:32.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.033+0000 7f5b89c2f9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T01:00:32.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.057+0000 7f5b89c2f9c0 20 add_watcher() i=0 2024-09-12T01:00:32.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.057+0000 7f5b89c2f9c0 20 add_watcher() i=1 2024-09-12T01:00:32.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.057+0000 7f5b89c2f9c0 20 add_watcher() i=2 2024-09-12T01:00:32.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.057+0000 7f5b89c2f9c0 20 add_watcher() i=3 2024-09-12T01:00:32.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.057+0000 7f5b89c2f9c0 20 add_watcher() i=4 2024-09-12T01:00:32.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.057+0000 7f5b89c2f9c0 20 add_watcher() i=5 2024-09-12T01:00:32.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.057+0000 7f5b89c2f9c0 20 add_watcher() i=6 2024-09-12T01:00:32.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.057+0000 7f5b89c2f9c0 20 add_watcher() i=7 2024-09-12T01:00:32.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.057+0000 7f5b89c2f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:00:32.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.061+0000 7f5a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:32.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.061+0000 7f5b89c2f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:00:32.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5b89c2f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:00:32.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5b89c2f9c0 5 note: GC not initialized 2024-09-12T01:00:32.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5a3cfe1640 20 reqs_thread_entry: start 2024-09-12T01:00:32.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5b89c2f9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:00:32.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5b89c2f9c0 20 Filter name: none 2024-09-12T01:00:32.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f59b67fc640 20 reqs_thread_entry: start 2024-09-12T01:00:32.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5b89c2f9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T01:00:32.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5b89c2f9c0 20 rados->read ofs=0 len=0 2024-09-12T01:00:32.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5b89c2f9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T01:00:32.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5b89c2f9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T01:00:32.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5b89c2f9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:00:32.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.065+0000 7f5b89c2f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:00:32.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.069+0000 7f5b89c2f9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:00:32.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.069+0000 7f5b89c2f9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:00:32.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.069+0000 7f5b89c2f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T01:00:32.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.073+0000 7f5a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300913 cookie 94010288013968 notifier 9282 bl.length()=695 2024-09-12T01:00:32.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.073+0000 7f5a6a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:00:32.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.073+0000 7f5a6a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:00:32.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.077+0000 7f5a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:00:32.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.081+0000 7f5b89c2f9c0 20 remove_watcher() i=0 2024-09-12T01:00:32.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.081+0000 7f5b89c2f9c0 2 removed watcher, disabling cache 2024-09-12T01:00:32.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.081+0000 7f5b89c2f9c0 20 remove_watcher() i=1 2024-09-12T01:00:32.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.085+0000 7f5b89c2f9c0 20 remove_watcher() i=2 2024-09-12T01:00:32.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.085+0000 7f5b89c2f9c0 20 remove_watcher() i=3 2024-09-12T01:00:32.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.089+0000 7f5b89c2f9c0 20 remove_watcher() i=4 2024-09-12T01:00:32.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.089+0000 7f5b89c2f9c0 20 remove_watcher() i=5 2024-09-12T01:00:32.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.093+0000 7f5b89c2f9c0 20 remove_watcher() i=6 2024-09-12T01:00:32.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T01:00:32.093+0000 7f5b89c2f9c0 20 remove_watcher() i=7 2024-09-12T01:00:32.110 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T01:00:32.110 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T01:00:32.110 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T01:00:32.156 INFO:tasks.s3tests:Configuring boto... 2024-09-12T01:00:32.157 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T01:00:32.157 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:00:32.204 DEBUG:teuthology.orchestra.run.smithi102:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T01:00:32.382 INFO:teuthology.orchestra.run.smithi102.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T01:00:32.575 INFO:teuthology.orchestra.run.smithi102.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T01:00:32.905 INFO:teuthology.orchestra.run.smithi102.stdout:py installdeps: -rrequirements.txt 2024-09-12T01:02:33.743 INFO:teuthology.orchestra.run.smithi102.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T01:02:35.606 INFO:teuthology.orchestra.run.smithi102.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=89c6fbdb8e2ec3139db68663e8c454d63ee517253c23ce880c558967aa91e11a,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T01:02:35.607 INFO:teuthology.orchestra.run.smithi102.stdout:py run-test-pre: PYTHONHASHSEED='440486986' 2024-09-12T01:02:35.607 INFO:teuthology.orchestra.run.smithi102.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T01:02:35.770 INFO:teuthology.orchestra.run.smithi102.stdout:============================= test session starts ============================== 2024-09-12T01:02:35.770 INFO:teuthology.orchestra.run.smithi102.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T01:02:35.770 INFO:teuthology.orchestra.run.smithi102.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T01:02:35.770 INFO:teuthology.orchestra.run.smithi102.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:02:35.770 INFO:teuthology.orchestra.run.smithi102.stdout:configfile: pytest.ini 2024-09-12T01:02:37.549 INFO:teuthology.orchestra.run.smithi102.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T01:02:37.550 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T01:02:38.969 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T01:02:39.817 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T01:02:40.747 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T01:02:41.604 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T01:02:42.469 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T01:02:43.208 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T01:02:44.247 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T01:02:44.971 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T01:02:45.149 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T01:02:45.324 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T01:02:46.230 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T01:02:47.134 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T01:02:47.992 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T01:02:48.853 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T01:02:49.040 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T01:02:49.226 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T01:02:49.360 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T01:02:49.488 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T01:02:49.615 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T01:02:49.745 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T01:02:49.862 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T01:02:49.992 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T01:02:50.121 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T01:02:50.249 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T01:02:50.377 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T01:02:50.504 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T01:02:50.632 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T01:02:50.801 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T01:02:50.930 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T01:02:51.063 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T01:02:51.192 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T01:02:51.322 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T01:02:51.452 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T01:02:51.580 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T01:02:51.709 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T01:02:51.838 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T01:02:51.970 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T01:02:52.097 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T01:02:52.225 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:02:52.354 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T01:02:52.484 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T01:02:52.610 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:02:52.737 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:02:52.867 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T01:02:52.997 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T01:02:53.125 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T01:02:53.252 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T01:02:53.381 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T01:02:53.509 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T01:02:53.637 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T01:02:53.766 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T01:02:53.893 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T01:02:54.025 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T01:02:55.777 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T01:03:13.192 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T01:03:31.581 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T01:03:58.453 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T01:04:35.078 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T01:04:44.528 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T01:04:54.930 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T01:04:58.615 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T01:04:59.745 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T01:05:02.601 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T01:05:05.436 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T01:05:07.533 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T01:05:08.810 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T01:05:09.804 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T01:05:09.806 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T01:05:09.809 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T01:05:09.811 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T01:05:09.818 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T01:05:09.820 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T01:05:09.822 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T01:05:09.825 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T01:05:09.827 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:05:09.829 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:05:09.832 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:05:09.835 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:05:09.837 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T01:05:09.839 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:05:09.841 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:05:09.843 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:05:09.849 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:05:09.850 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:05:09.850 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:05:09.851 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:05:09.853 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T01:05:09.855 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T01:05:09.856 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T01:05:09.858 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T01:05:09.859 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T01:05:09.861 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T01:05:09.863 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T01:05:09.864 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T01:05:09.967 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T01:05:09.980 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T01:05:12.630 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T01:05:20.835 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T01:05:22.778 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T01:05:24.914 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T01:05:27.186 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T01:05:29.398 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T01:05:31.590 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T01:05:33.534 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T01:05:35.794 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T01:05:37.830 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T01:05:39.839 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T01:05:41.734 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T01:05:43.414 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T01:05:45.106 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T01:05:46.243 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T01:05:48.350 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T01:05:50.370 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T01:05:52.570 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T01:05:54.442 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T01:05:56.252 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T01:05:58.126 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T01:06:00.042 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T01:06:01.902 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T01:06:03.606 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T01:06:05.298 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T01:06:06.442 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T01:06:07.602 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T01:06:08.783 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T01:06:09.898 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T01:06:11.030 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T01:06:13.070 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T01:06:14.154 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:06:15.390 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T01:06:16.910 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T01:06:18.374 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T01:06:19.506 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:06:20.950 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T01:06:22.454 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:06:24.226 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T01:06:25.574 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T01:06:26.978 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T01:06:28.490 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T01:06:30.538 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T01:06:32.902 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T01:06:35.042 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T01:06:37.466 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:40.038 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:44.690 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:49.194 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:51.918 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:54.462 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:56.558 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T01:06:58.962 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T01:07:00.642 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T01:07:03.658 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T01:07:05.738 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T01:07:08.227 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T01:07:12.646 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T01:07:18.319 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T01:07:21.843 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T01:07:24.998 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T01:07:27.574 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T01:07:29.466 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T01:07:32.383 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T01:07:34.646 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T01:07:37.418 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T01:07:39.582 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T01:07:43.143 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T01:07:46.474 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T01:07:50.283 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T01:07:54.058 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T01:07:56.942 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T01:07:59.570 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T01:08:01.682 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T01:08:06.083 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T01:08:09.598 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T01:08:13.352 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T01:08:16.926 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T01:08:20.502 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T01:08:24.134 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T01:08:27.252 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T01:08:29.578 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T01:08:32.078 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T01:08:36.290 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T01:08:41.470 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T01:08:43.970 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T01:08:47.434 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T01:08:50.962 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T01:08:54.650 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:08:58.683 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:09:03.014 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T01:09:07.087 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T01:09:10.895 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T01:09:13.426 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T01:09:15.530 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:09:17.570 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:09:19.646 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T01:09:23.606 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:09:27.635 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:09:31.538 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:09:35.491 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:09:39.363 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:09:43.418 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:09:47.358 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T01:09:51.318 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T01:09:55.298 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T01:09:59.238 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:10:03.167 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T01:10:07.159 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T01:10:10.031 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T01:10:12.974 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T01:10:15.847 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:10:18.635 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T01:10:21.105 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T01:10:23.865 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T01:10:26.398 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T01:10:28.938 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T01:10:31.417 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T01:10:33.898 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T01:10:36.442 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T01:10:39.177 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T01:10:42.053 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T01:10:46.502 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T01:10:50.730 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T01:10:52.861 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:10:55.017 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:10:57.538 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T01:11:00.026 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T01:11:04.129 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:11:08.146 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:11:10.598 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T01:11:13.209 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T01:11:15.698 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:11:18.206 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:11:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T01:11:23.170 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T01:11:25.726 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:11:28.326 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:11:30.762 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T01:11:33.273 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T01:11:35.823 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T01:11:38.238 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T01:11:40.610 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T01:11:42.970 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T01:11:45.462 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T01:11:47.966 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:11:50.434 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:14:06.623 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T01:14:08.998 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T01:14:11.374 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T01:14:13.790 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T01:14:16.146 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T01:14:18.486 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T01:14:20.914 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T01:14:23.379 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T01:14:25.722 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T01:14:28.134 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T01:14:30.490 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T01:14:32.890 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T01:14:35.214 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T01:14:37.734 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:14:40.370 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:14:42.914 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:14:45.326 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:14:47.826 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T01:14:50.378 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T01:14:52.866 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:14:55.502 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:14:57.970 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:15:00.494 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:15:03.042 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T01:15:05.755 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T01:15:08.238 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T01:15:10.746 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T01:15:13.271 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T01:15:15.774 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T01:15:16.950 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T01:15:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T01:15:24.922 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T01:15:30.994 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T01:15:33.451 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T01:15:36.026 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T01:15:38.514 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T01:15:41.038 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T01:15:43.658 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T01:15:46.254 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T01:15:48.826 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T01:15:51.334 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T01:15:53.838 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T01:15:56.318 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T01:15:58.850 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T01:16:01.318 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T01:16:04.302 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T01:16:08.058 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T01:16:10.094 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T01:16:12.190 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T01:16:14.034 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:16:15.858 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:16:16.986 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T01:16:18.146 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T01:16:19.363 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T01:16:21.530 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T01:16:31.018 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T01:16:32.130 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T01:16:34.210 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T01:16:35.919 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T01:16:37.778 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T01:16:39.686 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T01:16:46.006 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T01:16:48.790 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T01:16:51.782 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T01:19:09.023 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T01:21:26.815 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T01:21:28.985 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T01:21:31.018 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T01:21:33.046 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T01:21:35.150 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T01:21:37.470 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T01:21:39.618 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T01:21:41.738 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T01:21:44.198 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T01:21:46.382 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T01:21:48.570 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T01:21:50.798 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T01:21:53.178 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T01:21:55.330 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T01:21:57.194 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T01:21:59.246 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T01:22:01.198 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T01:22:04.882 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T01:22:07.162 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T01:22:09.205 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T01:22:11.238 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T01:22:13.350 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T01:22:15.586 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T01:22:17.441 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T01:22:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T01:22:21.157 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T01:22:23.022 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T01:22:24.941 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T01:22:26.830 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T01:22:29.094 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T01:22:30.897 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T01:22:32.725 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T01:22:34.610 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T01:22:36.466 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T01:22:39.090 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T01:22:40.910 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T01:22:42.774 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T01:22:44.682 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T01:22:46.498 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T01:22:48.378 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T01:22:50.194 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T01:22:52.173 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T01:22:56.114 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T01:22:58.056 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T01:23:00.206 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T01:23:02.314 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T01:23:04.414 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T01:23:06.537 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T01:23:08.614 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T01:23:11.890 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T01:23:14.046 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T01:23:16.246 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T01:23:18.586 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T01:23:21.010 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T01:23:23.417 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T01:23:25.574 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T01:23:27.970 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T01:23:30.405 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T01:23:32.533 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T01:23:34.993 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T01:23:36.994 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T01:23:38.994 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T01:23:41.006 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T01:23:43.149 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T01:23:45.049 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T01:23:46.190 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T01:23:48.938 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T01:23:51.054 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T01:23:53.041 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T01:23:58.297 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T01:24:00.441 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T01:24:02.510 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T01:24:04.662 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T01:24:06.745 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T01:24:08.729 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T01:24:10.833 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T01:24:13.078 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T01:24:15.297 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T01:24:17.361 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T01:24:19.481 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T01:24:21.553 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T01:24:23.850 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T01:24:26.094 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T01:24:28.085 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T01:24:30.306 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T01:24:32.502 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T01:24:34.710 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T01:24:35.878 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T01:24:37.017 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T01:24:38.114 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T01:24:39.929 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T01:24:41.581 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T01:24:43.233 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T01:24:44.957 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T01:24:46.721 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T01:24:47.853 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T01:24:49.054 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T01:24:50.753 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T01:24:51.905 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T01:24:53.046 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T01:24:54.237 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T01:24:55.398 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T01:24:57.173 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T01:24:59.001 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T01:25:00.885 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T01:25:02.650 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T01:25:04.537 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T01:25:06.402 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T01:25:08.169 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T01:25:10.141 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T01:25:11.893 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:25:13.701 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:25:15.913 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T01:25:18.001 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T01:25:20.353 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T01:25:22.533 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:25:24.749 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:25:26.989 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T01:25:29.257 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T01:25:31.625 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T01:25:34.129 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T01:25:36.074 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T01:25:38.409 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T01:25:40.810 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T01:25:43.221 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T01:25:45.613 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T01:25:47.941 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T01:25:51.117 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T01:25:54.221 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T01:25:57.113 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T01:26:00.149 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T01:26:02.957 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T01:26:05.069 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T01:26:07.177 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T01:26:09.342 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T01:26:11.489 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T01:26:13.573 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T01:26:15.993 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T01:26:19.166 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T01:26:22.337 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T01:26:25.537 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T01:26:28.681 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T01:26:31.857 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:26:35.101 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T01:26:38.365 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T01:26:41.621 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T01:26:44.821 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:26:47.985 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T01:26:51.281 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T01:26:54.397 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T01:26:58.877 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T01:27:03.121 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T01:27:04.250 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T01:27:05.441 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T01:27:06.621 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T01:27:08.657 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T01:27:10.690 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T01:27:12.429 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T01:27:14.129 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T01:27:16.985 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T01:27:23.166 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T01:27:25.997 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T01:27:28.441 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T01:27:36.981 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T01:27:39.393 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T01:27:41.841 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T01:27:44.085 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T01:27:46.437 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T01:27:49.585 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T01:27:52.365 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T01:27:55.325 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T01:27:58.117 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T01:28:02.545 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T01:28:06.529 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T01:28:08.421 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T01:28:10.309 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T01:28:16.701 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T01:28:19.369 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T01:28:56.537 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T01:28:58.701 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T01:29:01.333 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T01:29:09.401 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T01:29:11.756 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T01:29:15.822 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T01:29:40.518 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T01:30:19.721 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T01:31:13.002 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T01:34:35.046 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T01:35:00.850 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T01:35:35.858 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T01:35:39.274 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T01:35:52.682 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T01:36:03.914 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T01:36:10.934 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T01:36:13.014 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T01:36:23.310 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T01:36:25.930 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T01:36:28.189 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T01:36:30.410 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T01:36:57.194 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T01:37:03.734 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T01:37:05.986 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T01:37:08.106 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T01:37:10.342 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T01:37:20.698 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T01:37:26.062 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T01:37:31.152 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T01:37:33.490 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T01:37:35.766 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T01:37:38.062 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T01:37:40.378 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T01:37:42.742 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T01:37:45.006 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T01:37:47.230 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T01:37:51.242 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T01:37:58.818 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T01:38:10.746 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T01:38:15.871 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T01:38:25.147 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T01:38:41.451 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T01:38:45.835 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T01:38:54.931 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T01:39:09.667 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T01:39:14.247 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T01:39:16.710 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T01:39:20.123 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T01:39:22.235 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T01:39:32.635 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T01:39:34.855 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T01:39:37.003 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T01:39:39.211 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T01:39:41.303 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T01:39:44.459 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T01:40:09.535 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T01:40:13.267 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T01:40:16.107 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T01:40:19.387 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T01:40:22.783 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T01:40:33.967 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T01:40:37.491 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T01:40:50.555 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T01:41:34.783 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T01:42:32.075 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T01:42:38.223 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T01:42:44.571 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T01:42:47.640 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T01:42:51.092 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T01:42:53.603 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T01:42:57.343 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T01:43:00.755 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T01:43:06.847 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T01:43:08.963 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T01:43:11.032 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T01:43:13.167 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T01:43:15.015 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T01:43:16.811 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T01:43:18.907 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T01:43:20.719 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T01:43:22.647 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T01:43:24.923 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T01:43:26.807 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T01:43:28.847 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T01:43:30.763 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T01:43:32.847 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T01:43:34.732 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T01:43:36.911 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T01:43:39.167 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T01:43:42.175 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T01:43:44.347 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T01:43:46.611 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T01:43:48.812 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T01:43:50.963 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T01:43:52.951 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T01:43:54.811 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T01:43:56.787 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T01:43:58.759 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T01:45:07.423 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T01:46:14.507 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T01:46:34.559 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T01:46:36.759 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T01:47:39.803 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T01:48:43.224 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T01:48:45.567 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T01:48:47.727 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T01:48:49.707 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T01:48:51.576 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T01:49:41.823 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T01:50:00.267 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T01:50:18.883 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T01:50:21.083 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T01:50:23.307 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T01:50:25.504 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T01:50:28.391 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T01:50:30.543 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T01:50:32.696 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T01:50:34.971 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T01:50:37.395 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T01:50:39.907 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T01:50:42.687 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T01:50:45.339 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T01:50:47.943 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T01:50:51.639 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T01:50:55.399 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T01:51:00.879 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T01:51:06.279 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T01:51:11.442 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T01:51:16.687 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T01:51:21.995 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T01:51:27.380 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T01:51:33.387 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T01:51:39.356 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T01:51:44.647 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T01:51:46.884 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T01:51:49.096 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T01:51:51.355 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T01:51:57.008 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T01:52:02.632 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T01:52:08.415 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T01:52:13.152 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T01:53:02.864 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T01:53:06.164 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T01:53:09.420 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:53:12.616 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:53:16.891 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T01:53:20.679 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T01:53:23.047 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T01:53:26.676 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T01:53:28.552 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T01:53:30.472 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T01:53:32.303 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T01:53:34.183 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T01:53:36.476 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T01:53:38.448 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T01:53:41.796 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T01:53:43.727 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T01:53:45.589 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T01:53:47.368 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T01:53:49.112 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T01:53:51.008 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T01:53:52.864 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T01:53:54.791 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T01:53:56.532 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T01:53:58.383 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T01:54:00.235 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T01:54:02.520 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T01:54:04.608 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T01:54:06.824 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T01:54:09.048 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T01:54:11.212 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T01:54:13.207 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T01:54:15.753 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T01:54:18.080 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T01:54:20.488 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T01:54:22.716 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T01:54:25.120 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T01:54:27.344 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:54:29.848 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T01:54:32.383 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T01:54:34.868 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:54:37.052 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T01:54:39.072 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T01:54:41.280 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T01:54:43.720 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T01:54:45.800 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T01:54:48.136 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:54:50.731 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:54:52.824 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T01:54:55.292 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T01:54:57.492 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T01:55:09.124 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T01:55:11.439 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T01:55:22.400 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T01:55:24.788 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T01:55:27.124 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T01:55:29.016 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T01:55:31.072 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:55:33.048 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:55:35.163 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:55:37.208 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T01:55:39.124 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T01:55:41.124 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T01:55:43.144 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T01:55:45.380 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T01:55:47.340 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T01:55:49.592 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T01:55:51.828 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T01:55:53.872 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T01:55:55.888 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T01:55:58.649 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T01:56:23.744 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T01:56:25.704 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:56:27.724 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:56:29.896 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:56:32.385 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:56:37.624 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:56:39.920 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:56:43.365 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:56:54.648 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:56:58.732 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:57:23.244 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:57:45.752 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:57:47.720 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:57:50.488 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:58:08.372 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:58:35.408 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:58:42.264 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:58:46.760 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:58:57.084 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:59:05.236 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:59:07.190 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:59:14.372 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:59:22.584 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:59:45.360 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:59:51.909 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:59:55.756 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:59:59.328 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T02:00:01.440 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T02:00:10.263 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T02:00:15.832 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T02:00:18.884 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T02:00:21.764 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T02:00:30.884 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T02:00:36.784 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T02:00:44.385 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T02:00:48.133 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T02:00:49.253 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T02:01:10.968 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T02:01:17.896 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T02:01:28.328 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T02:01:34.797 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T02:01:37.860 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T02:04:50.864 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T02:04:51.932 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T02:04:54.367 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T02:04:56.187 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T02:04:58.252 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T02:05:00.743 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T02:05:00.786 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T02:05:00.786 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi102.stdout:=============================== warnings summary =============================== 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi102.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi102.stdout: import imp 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py:120 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi102.stdout: if boto_type is 'S3Connection': 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_headers.py:124 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3.py:359 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout: if k is 'BucketName': 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout: @pytest.mark.timeout(10) 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.789 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T02:05:00.790 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T02:05:00.791 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi102.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout: warnings.warn( 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout: s = ssl.wrap_socket(s); 2024-09-12T02:05:00.793 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.794 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T02:05:00.794 INFO:teuthology.orchestra.run.smithi102.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T02:05:00.794 INFO:teuthology.orchestra.run.smithi102.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-12T02:05:00.794 INFO:teuthology.orchestra.run.smithi102.stdout: context = SSLContext(ssl_version) 2024-09-12T02:05:00.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:05:00.794 INFO:teuthology.orchestra.run.smithi102.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T02:05:00.794 INFO:teuthology.orchestra.run.smithi102.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 3745.01s (1:02:25) = 2024-09-12T02:05:00.967 INFO:teuthology.orchestra.run.smithi102.stdout:___________________________________ summary ____________________________________ 2024-09-12T02:05:00.967 INFO:teuthology.orchestra.run.smithi102.stdout: py: commands succeeded 2024-09-12T02:05:00.967 INFO:teuthology.orchestra.run.smithi102.stdout: congratulations :) 2024-09-12T02:05:01.005 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T02:05:01.006 DEBUG:teuthology.orchestra.run.smithi102:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T02:05:01.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:05:01.111 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T02:05:01.111 DEBUG:teuthology.orchestra.run.smithi102:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T02:05:01.117 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T02:05:01.118 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T02:05:01.303 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T02:05:01.315 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T02:05:01.315 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T02:05:01.315 DEBUG:teuthology.orchestra.run.smithi102:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:01.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:05:01.321 INFO:teuthology.orchestra.run.smithi102.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T02:05:01.322 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:01.369 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T02:05:01.369 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T02:05:01.424 INFO:tasks.workunit:timeout=3h 2024-09-12T02:05:01.424 INFO:tasks.workunit:cleanup=True 2024-09-12T02:05:01.425 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T02:05:01.475 INFO:tasks.workunit.client.0.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T02:05:44.053 INFO:tasks.workunit.client.0.smithi102.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T02:05:44.054 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:05:44.054 INFO:tasks.workunit.client.0.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:05:44.054 INFO:tasks.workunit.client.0.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:05:44.054 INFO:tasks.workunit.client.0.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:05:44.054 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:05:44.054 INFO:tasks.workunit.client.0.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:05:44.054 INFO:tasks.workunit.client.0.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:05:44.055 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:05:44.055 INFO:tasks.workunit.client.0.smithi102.stderr: git switch -c 2024-09-12T02:05:44.055 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:05:44.055 INFO:tasks.workunit.client.0.smithi102.stderr:Or undo this operation with: 2024-09-12T02:05:44.055 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:05:44.055 INFO:tasks.workunit.client.0.smithi102.stderr: git switch - 2024-09-12T02:05:44.055 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:05:44.055 INFO:tasks.workunit.client.0.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:05:44.055 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:05:44.055 INFO:tasks.workunit.client.0.smithi102.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T02:05:44.060 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:05:44.113 INFO:tasks.workunit.client.0.smithi102.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:05:44.116 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:05:44.117 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:05:44.174 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:05:44.232 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:05:44.274 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:05:44.275 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:05:44.275 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:05:44.320 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:05:44.324 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-12T02:05:44.324 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:05:44.369 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T02:05:44.370 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T02:05:44.371 DEBUG:teuthology.orchestra.run.smithi102:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T02:05:44.421 INFO:tasks.workunit.client.0.smithi102.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T02:05:44.422 INFO:tasks.workunit.client.0.smithi102.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T02:05:44.422 INFO:tasks.workunit.client.0.smithi102.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T02:05:47.326 INFO:tasks.workunit.client.0.smithi102.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T02:05:47.326 INFO:tasks.workunit.client.0.smithi102.stderr:++ deactivate nondestructive 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ hash -r 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ unset VIRTUAL_ENV 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ export VIRTUAL_ENV 2024-09-12T02:05:47.327 INFO:tasks.workunit.client.0.smithi102.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T02:05:47.328 INFO:tasks.workunit.client.0.smithi102.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:++ export PATH 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n '' ']' 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -z '' ']' 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:++ PS1='(rgw) ' 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:++ export PS1 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:++ hash -r 2024-09-12T02:05:47.329 INFO:tasks.workunit.client.0.smithi102.stderr:+ pip install pip --upgrade 2024-09-12T02:05:47.693 INFO:tasks.workunit.client.0.smithi102.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T02:05:47.900 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting pip 2024-09-12T02:05:47.905 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T02:05:47.940 INFO:tasks.workunit.client.0.smithi102.stdout:Installing collected packages: pip 2024-09-12T02:05:47.940 INFO:tasks.workunit.client.0.smithi102.stdout: Attempting uninstall: pip 2024-09-12T02:05:47.940 INFO:tasks.workunit.client.0.smithi102.stdout: Found existing installation: pip 22.0.2 2024-09-12T02:05:48.199 INFO:tasks.workunit.client.0.smithi102.stdout: Uninstalling pip-22.0.2: 2024-09-12T02:05:48.205 INFO:tasks.workunit.client.0.smithi102.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T02:05:49.230 INFO:tasks.workunit.client.0.smithi102.stdout:Successfully installed pip-24.2 2024-09-12T02:05:49.301 INFO:tasks.workunit.client.0.smithi102.stderr:+ pip install boto3 2024-09-12T02:05:50.334 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting boto3 2024-09-12T02:05:50.335 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T02:05:50.866 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T02:05:50.867 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T02:05:50.915 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T02:05:50.916 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T02:05:50.961 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T02:05:50.962 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T02:05:51.017 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T02:05:51.019 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T02:05:51.115 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T02:05:51.117 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T02:05:51.261 INFO:tasks.workunit.client.0.smithi102.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T02:05:51.262 INFO:tasks.workunit.client.0.smithi102.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T02:05:51.265 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T02:05:51.266 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T02:05:51.276 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T02:05:51.277 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T02:05:51.278 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T02:05:51.279 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T02:05:51.281 INFO:tasks.workunit.client.0.smithi102.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T02:05:51.348 INFO:tasks.workunit.client.0.smithi102.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T02:05:52.483 INFO:tasks.workunit.client.0.smithi102.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T02:05:52.685 INFO:tasks.workunit.client.0.smithi102.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T02:05:52.822 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T02:05:52.861 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T02:05:52.861 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T02:05:52.903 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.899+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:52.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.903+0000 7f9d66a769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:52.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.903+0000 7f9d66a769c0 20 realm 2024-09-12T02:05:52.905 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.903+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:52.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.903+0000 7f9d66a769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:52.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.903+0000 7f9d66a769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T02:05:52.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.903+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:52.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.903+0000 7f9d66a769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:52.906 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.903+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:52.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.903+0000 7f9d66a769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:05:52.907 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.903+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:52.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.907+0000 7f9d66a769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T02:05:52.909 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.907+0000 7f9d66a769c0 20 searching for the correct realm 2024-09-12T02:05:52.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:52.911+0000 7f9d64d7d640 0 -- 172.21.15.102:0/1089327211 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f9d4c07b040 msgr2=0x7f9d4c061780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T02:05:53.130 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.127+0000 7f9d63d7b640 0 -- 172.21.15.102:0/1089327211 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f9d540c9960 msgr2=0x7f9d541249c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:05:53.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.343+0000 7f9d66a769c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T02:05:53.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.343+0000 7f9d66a769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T02:05:53.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.343+0000 7f9d66a769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T02:05:53.347 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.343+0000 7f9d66a769c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T02:05:53.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.343+0000 7f9d66a769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T02:05:53.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.343+0000 7f9d66a769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T02:05:53.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.343+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:53.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.343+0000 7f9d66a769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:53.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.343+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:53.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:05:53.348 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:53.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T02:05:53.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 zone default found 2024-09-12T02:05:53.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 4 Realm: () 2024-09-12T02:05:53.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T02:05:53.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T02:05:53.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T02:05:53.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 zonegroup default 2024-09-12T02:05:53.349 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:53.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:53.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:53.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:53.350 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:53.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:53.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 started sync module instance, tier type = 2024-09-12T02:05:53.351 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.347+0000 7f9d66a769c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T02:05:53.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.371+0000 7f9d66a769c0 20 add_watcher() i=0 2024-09-12T02:05:53.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.371+0000 7f9d66a769c0 20 add_watcher() i=1 2024-09-12T02:05:53.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.371+0000 7f9d66a769c0 20 add_watcher() i=2 2024-09-12T02:05:53.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.371+0000 7f9d66a769c0 20 add_watcher() i=3 2024-09-12T02:05:53.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.371+0000 7f9d66a769c0 20 add_watcher() i=4 2024-09-12T02:05:53.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.371+0000 7f9d66a769c0 20 add_watcher() i=5 2024-09-12T02:05:53.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.371+0000 7f9d66a769c0 20 add_watcher() i=6 2024-09-12T02:05:53.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.375+0000 7f9d66a769c0 20 add_watcher() i=7 2024-09-12T02:05:53.377 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.375+0000 7f9d66a769c0 2 all 8 watchers are set, enabling cache 2024-09-12T02:05:53.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.379+0000 7f9c1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:05:53.382 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.379+0000 7f9d66a769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T02:05:53.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.379+0000 7f9d66a769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T02:05:53.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.379+0000 7f9d66a769c0 5 note: GC not initialized 2024-09-12T02:05:53.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.379+0000 7f9c197e2640 20 reqs_thread_entry: start 2024-09-12T02:05:53.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.379+0000 7f9d66a769c0 20 init_complete bucket index max shards: 11 2024-09-12T02:05:53.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.379+0000 7f9d66a769c0 20 Filter name: none 2024-09-12T02:05:53.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.379+0000 7f9b8affd640 20 reqs_thread_entry: start 2024-09-12T02:05:53.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.379+0000 7f9d66a769c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T02:05:53.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.379+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:53.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.383+0000 7f9d66a769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:53.384 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.383+0000 7f9d66a769c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T02:05:53.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.383+0000 7f9d66a769c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T02:05:53.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.383+0000 7f9d66a769c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T02:05:53.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.383+0000 7f9d66a769c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:53.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.383+0000 7f9d66a769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:53.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.383+0000 7f9d66a769c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T02:05:53.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.383+0000 7f9d66a769c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T02:05:53.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.383+0000 7f9d66a769c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T02:05:53.386 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.383+0000 7f9d66a769c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T02:05:53.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.387+0000 7f9d66a769c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T02:05:53.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.387+0000 7f9d66a769c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T02:05:53.388 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.387+0000 7f9d66a769c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T02:05:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.387+0000 7f9c437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301002 cookie 94139215676896 notifier 9300 bl.length()=613 2024-09-12T02:05:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.387+0000 7f9c437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T02:05:53.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.387+0000 7f9c437fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T02:05:53.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.391+0000 7f9d66a769c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T02:05:53.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.391+0000 7f9d66a769c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T02:05:53.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.391+0000 7f9d66a769c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T02:05:53.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.391+0000 7f9c437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302127 cookie 94139215681696 notifier 9300 bl.length()=191 2024-09-12T02:05:53.393 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.391+0000 7f9c437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T02:05:53.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.391+0000 7f9c437fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T02:05:53.396 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.395+0000 7f9c1a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:05:53.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.399+0000 7f9d66a769c0 20 remove_watcher() i=0 2024-09-12T02:05:53.401 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.399+0000 7f9d66a769c0 2 removed watcher, disabling cache 2024-09-12T02:05:53.403 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.399+0000 7f9d66a769c0 20 remove_watcher() i=1 2024-09-12T02:05:53.406 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.403+0000 7f9d66a769c0 20 remove_watcher() i=2 2024-09-12T02:05:53.408 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.403+0000 7f9d66a769c0 20 remove_watcher() i=3 2024-09-12T02:05:53.410 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.407+0000 7f9d66a769c0 20 remove_watcher() i=4 2024-09-12T02:05:53.411 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.407+0000 7f9d66a769c0 20 remove_watcher() i=5 2024-09-12T02:05:53.412 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.411+0000 7f9d66a769c0 20 remove_watcher() i=6 2024-09-12T02:05:53.414 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:53.411+0000 7f9d66a769c0 20 remove_watcher() i=7 2024-09-12T02:05:53.657 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:53.657 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:53.738 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:53.738 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:53.834 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:53.834 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:53.955 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:53.955 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:54.033 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T02:05:54.034 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:05:54.041 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:54.041 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:54.145 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:54.145 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:54.248 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:54.248 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:54.364 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T02:05:54.397 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T02:05:54.398 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T02:05:54.442 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.439+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.439+0000 7f0551e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:54.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.439+0000 7f0551e7e9c0 20 realm 2024-09-12T02:05:54.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.439+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.443+0000 7f0551e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:54.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.443+0000 7f0551e7e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T02:05:54.444 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.443+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.443+0000 7f0551e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:54.445 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.443+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.443+0000 7f0551e7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:05:54.446 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.443+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.443+0000 7f0551e7e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T02:05:54.448 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.443+0000 7f0551e7e9c0 20 searching for the correct realm 2024-09-12T02:05:54.450 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.447+0000 7f0550185640 0 -- 172.21.15.102:0/3337495350 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7f05440fdc00 msgr2=0x7f05440caa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T02:05:54.665 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.663+0000 7f054f183640 0 -- 172.21.15.102:0/3337495350 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7f0548081130 msgr2=0x7f054808f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T02:05:54.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.879+0000 7f0551e7e9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T02:05:54.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.879+0000 7f0551e7e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T02:05:54.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.879+0000 7f0551e7e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T02:05:54.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.879+0000 7f0551e7e9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T02:05:54.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.879+0000 7f0551e7e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T02:05:54.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.879+0000 7f0551e7e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T02:05:54.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.879+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.879+0000 7f0551e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:54.884 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.879+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:05:54.885 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T02:05:54.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 zone default found 2024-09-12T02:05:54.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 4 Realm: () 2024-09-12T02:05:54.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T02:05:54.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T02:05:54.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T02:05:54.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 zonegroup default 2024-09-12T02:05:54.886 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:54.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:54.887 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:54.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 started sync module instance, tier type = 2024-09-12T02:05:54.888 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.883+0000 7f0551e7e9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T02:05:54.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.907+0000 7f0551e7e9c0 20 add_watcher() i=0 2024-09-12T02:05:54.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.907+0000 7f0551e7e9c0 20 add_watcher() i=1 2024-09-12T02:05:54.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.907+0000 7f0551e7e9c0 20 add_watcher() i=2 2024-09-12T02:05:54.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.907+0000 7f0551e7e9c0 20 add_watcher() i=3 2024-09-12T02:05:54.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.907+0000 7f0551e7e9c0 20 add_watcher() i=4 2024-09-12T02:05:54.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.907+0000 7f0551e7e9c0 20 add_watcher() i=5 2024-09-12T02:05:54.912 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.907+0000 7f0551e7e9c0 20 add_watcher() i=6 2024-09-12T02:05:54.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.911+0000 7f0551e7e9c0 20 add_watcher() i=7 2024-09-12T02:05:54.914 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.911+0000 7f0551e7e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T02:05:54.918 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.915+0000 7f0405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:05:54.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.915+0000 7f0551e7e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T02:05:54.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.915+0000 7f0551e7e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T02:05:54.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.915+0000 7f0551e7e9c0 5 note: GC not initialized 2024-09-12T02:05:54.920 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.915+0000 7f0404fe1640 20 reqs_thread_entry: start 2024-09-12T02:05:54.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 init_complete bucket index max shards: 11 2024-09-12T02:05:54.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 Filter name: none 2024-09-12T02:05:54.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f037e7fc640 20 reqs_thread_entry: start 2024-09-12T02:05:54.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.921 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T02:05:54.922 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:54.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T02:05:54.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T02:05:54.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T02:05:54.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 INFO: main: starting shard=0 2024-09-12T02:05:54.923 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.0 2024-09-12T02:05:54.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 INFO: main: starting shard=1 2024-09-12T02:05:54.924 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.919+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.1 2024-09-12T02:05:54.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 INFO: main: starting shard=2 2024-09-12T02:05:54.925 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.2 2024-09-12T02:05:54.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 INFO: main: starting shard=3 2024-09-12T02:05:54.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.3 2024-09-12T02:05:54.926 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 INFO: main: starting shard=4 2024-09-12T02:05:54.927 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.4 2024-09-12T02:05:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 INFO: main: starting shard=5 2024-09-12T02:05:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.923+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.5 2024-09-12T02:05:54.928 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 INFO: main: starting shard=6 2024-09-12T02:05:54.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.6 2024-09-12T02:05:54.929 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 INFO: main: starting shard=7 2024-09-12T02:05:54.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.7 2024-09-12T02:05:54.930 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 INFO: main: starting shard=8 2024-09-12T02:05:54.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.8 2024-09-12T02:05:54.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.931 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 INFO: main: starting shard=9 2024-09-12T02:05:54.932 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.927+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.9 2024-09-12T02:05:54.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.931+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.931+0000 7f0551e7e9c0 20 INFO: main: starting shard=10 2024-09-12T02:05:54.933 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.931+0000 7f0551e7e9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.10 2024-09-12T02:05:54.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.931+0000 7f0551e7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:54.934 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.931+0000 7f0551e7e9c0 20 INFO: main: done 2024-09-12T02:05:54.935 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.931+0000 7f0405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:05:54.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.939+0000 7f0551e7e9c0 20 remove_watcher() i=0 2024-09-12T02:05:54.940 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.939+0000 7f0551e7e9c0 2 removed watcher, disabling cache 2024-09-12T02:05:54.942 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.939+0000 7f0551e7e9c0 20 remove_watcher() i=1 2024-09-12T02:05:54.944 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.943+0000 7f0551e7e9c0 20 remove_watcher() i=2 2024-09-12T02:05:54.946 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.943+0000 7f0551e7e9c0 20 remove_watcher() i=3 2024-09-12T02:05:54.948 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.947+0000 7f0551e7e9c0 20 remove_watcher() i=4 2024-09-12T02:05:54.951 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.947+0000 7f0551e7e9c0 20 remove_watcher() i=5 2024-09-12T02:05:54.953 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.951+0000 7f0551e7e9c0 20 remove_watcher() i=6 2024-09-12T02:05:54.954 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:54.951+0000 7f0551e7e9c0 20 remove_watcher() i=7 2024-09-12T02:05:54.971 INFO:tasks.workunit.client.0.smithi102.stderr:rados -p default.rgw.buckets.data ls | grep 98bd123a-206b-4f8c-b669-08be2de0a4eb 2024-09-12T02:05:54.996 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T02:05:54.996 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T02:05:55.171 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:55.167+0000 7f9c73174640 0 -- 172.21.15.102:0/2066576836 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x7f9c680c0070 msgr2=0x7f9c680bf3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:05:55.198 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T02:05:55.198 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:05:55.199 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T02:05:56.658 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:56.658 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:56.744 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T02:05:57.182 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T02:05:57.212 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T02:05:57.212 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T02:05:57.256 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.255+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.255+0000 7f1dfd80b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:57.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.255+0000 7f1dfd80b9c0 20 realm 2024-09-12T02:05:57.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.255+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.255+0000 7f1dfd80b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:57.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.255+0000 7f1dfd80b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T02:05:57.258 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.255+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.255+0000 7f1dfd80b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:57.259 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.255+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.259+0000 7f1dfd80b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:05:57.260 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.259+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.259+0000 7f1dfd80b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T02:05:57.262 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.259+0000 7f1dfd80b9c0 20 searching for the correct realm 2024-09-12T02:05:57.264 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.263+0000 7f1dfab10640 0 -- 172.21.15.102:0/251467881 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x55b49b9b09c0 msgr2=0x7f1dec035920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T02:05:57.481 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.479+0000 7f1dfbb12640 0 -- 172.21.15.102:0/251467881 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55b49bbf4720 msgr2=0x55b49bbf6b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:05:57.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T02:05:57.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T02:05:57.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T02:05:57.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T02:05:57.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T02:05:57.497 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T02:05:57.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:57.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:05:57.498 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T02:05:57.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 zone default found 2024-09-12T02:05:57.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 4 Realm: () 2024-09-12T02:05:57.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T02:05:57.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T02:05:57.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T02:05:57.499 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 zonegroup default 2024-09-12T02:05:57.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:57.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.495+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.499+0000 7f1dfd80b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:57.500 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.499+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.499+0000 7f1dfd80b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:05:57.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.499+0000 7f1dfd80b9c0 20 started sync module instance, tier type = 2024-09-12T02:05:57.501 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.499+0000 7f1dfd80b9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T02:05:57.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.527+0000 7f1dfd80b9c0 20 add_watcher() i=0 2024-09-12T02:05:57.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.527+0000 7f1dfd80b9c0 20 add_watcher() i=1 2024-09-12T02:05:57.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.527+0000 7f1dfd80b9c0 20 add_watcher() i=2 2024-09-12T02:05:57.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.527+0000 7f1dfd80b9c0 20 add_watcher() i=3 2024-09-12T02:05:57.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.527+0000 7f1dfd80b9c0 20 add_watcher() i=4 2024-09-12T02:05:57.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.527+0000 7f1dfd80b9c0 20 add_watcher() i=5 2024-09-12T02:05:57.531 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.527+0000 7f1dfd80b9c0 20 add_watcher() i=6 2024-09-12T02:05:57.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.531+0000 7f1dfd80b9c0 20 add_watcher() i=7 2024-09-12T02:05:57.533 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.531+0000 7f1dfd80b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T02:05:57.537 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.535+0000 7f1cb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:05:57.538 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.535+0000 7f1dfd80b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T02:05:57.539 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.535+0000 7f1dfd80b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T02:05:57.539 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.535+0000 7f1dfd80b9c0 5 note: GC not initialized 2024-09-12T02:05:57.539 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.535+0000 7f1cb0fe1640 20 reqs_thread_entry: start 2024-09-12T02:05:57.539 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.535+0000 7f1dfd80b9c0 20 init_complete bucket index max shards: 11 2024-09-12T02:05:57.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.535+0000 7f1dfd80b9c0 20 Filter name: none 2024-09-12T02:05:57.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.535+0000 7f1c2a7fc640 20 reqs_thread_entry: start 2024-09-12T02:05:57.540 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T02:05:57.544 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 rados->read ofs=0 len=0 2024-09-12T02:05:57.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T02:05:57.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T02:05:57.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T02:05:57.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 INFO: main: starting shard=0 2024-09-12T02:05:57.545 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.0 2024-09-12T02:05:57.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 INFO: main: starting shard=1 2024-09-12T02:05:57.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.539+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.1 2024-09-12T02:05:57.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 INFO: main: starting shard=2 2024-09-12T02:05:57.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.2 2024-09-12T02:05:57.546 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 INFO: main: starting shard=3 2024-09-12T02:05:57.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.3 2024-09-12T02:05:57.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 INFO: main: starting shard=4 2024-09-12T02:05:57.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.4 2024-09-12T02:05:57.547 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 INFO: main: starting shard=5 2024-09-12T02:05:57.548 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.543+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.5 2024-09-12T02:05:57.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 INFO: main: starting shard=6 2024-09-12T02:05:57.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.6 2024-09-12T02:05:57.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 INFO: main: starting shard=7 2024-09-12T02:05:57.549 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.7 2024-09-12T02:05:57.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 INFO: main: starting shard=8 2024-09-12T02:05:57.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.8 2024-09-12T02:05:57.550 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 INFO: main: starting shard=9 2024-09-12T02:05:57.551 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.547+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.9 2024-09-12T02:05:57.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.551+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.551+0000 7f1dfd80b9c0 20 INFO: main: starting shard=10 2024-09-12T02:05:57.552 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.551+0000 7f1dfd80b9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.10 2024-09-12T02:05:57.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.551+0000 7f1dfd80b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T02:05:57.553 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.551+0000 7f1dfd80b9c0 20 INFO: main: done 2024-09-12T02:05:57.554 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.551+0000 7f1cb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:05:57.559 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.555+0000 7f1dfd80b9c0 20 remove_watcher() i=0 2024-09-12T02:05:57.560 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.555+0000 7f1dfd80b9c0 2 removed watcher, disabling cache 2024-09-12T02:05:57.562 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.559+0000 7f1dfd80b9c0 20 remove_watcher() i=1 2024-09-12T02:05:57.565 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.563+0000 7f1dfd80b9c0 20 remove_watcher() i=2 2024-09-12T02:05:57.567 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.563+0000 7f1dfd80b9c0 20 remove_watcher() i=3 2024-09-12T02:05:57.569 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.567+0000 7f1dfd80b9c0 20 remove_watcher() i=4 2024-09-12T02:05:57.571 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.567+0000 7f1dfd80b9c0 20 remove_watcher() i=5 2024-09-12T02:05:57.572 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.571+0000 7f1dfd80b9c0 20 remove_watcher() i=6 2024-09-12T02:05:57.574 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.571+0000 7f1dfd80b9c0 20 remove_watcher() i=7 2024-09-12T02:05:57.590 INFO:tasks.workunit.client.0.smithi102.stderr:rados -p default.rgw.buckets.data ls | grep 4c66e222-9a99-4401-bb5c-c23dd91ff071 2024-09-12T02:05:57.617 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T02:05:57.617 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T02:05:57.784 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:05:57.779+0000 7feaad64d640 0 -- 172.21.15.102:0/971524264 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x7fea9800a2f0 msgr2=0x7fea9800a710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:05:57.814 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T02:05:57.814 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:05:57.817 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:57.817 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:57.895 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:57.895 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:58.005 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:58.005 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:58.083 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T02:05:59.538 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:05:59.538 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:05:59.717 INFO:tasks.workunit.client.0.smithi102.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T02:05:59.717 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T02:06:00.191 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:06:00.191 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:06:00.344 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:06:00.344 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:06:00.414 INFO:tasks.workunit.client.0.smithi102.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T02:06:00.414 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-12T02:06:00.418 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:06:00.418 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:06:00.552 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:06:00.552 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:06:00.717 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:06:00.717 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:06:00.814 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T02:06:02.260 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:06:02.260 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:06:02.395 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:06:02.395 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:06:04.580 INFO:tasks.workunit.client.0.smithi102.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T02:06:05.020 INFO:tasks.workunit.client.0.smithi102.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T02:06:05.047 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T02:06:05.047 INFO:tasks.workunit.client.0.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T02:06:05.090 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.087+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.087+0000 7f70e581a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:05.092 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.087+0000 7f70e581a9c0 20 realm 2024-09-12T02:06:05.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.087+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.091+0000 7f70e581a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:05.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.091+0000 7f70e581a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T02:06:05.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.091+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.091+0000 7f70e581a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:05.093 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.091+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.091+0000 7f70e581a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:06:05.094 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.091+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.095 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.091+0000 7f70e581a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T02:06:05.096 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.091+0000 7f70e581a9c0 20 searching for the correct realm 2024-09-12T02:06:05.101 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.099+0000 7f70e3320640 0 -- 172.21.15.102:0/692833028 >> [v2:172.21.15.121:6802/901978356,v1:172.21.15.121:6803/901978356] conn(0x7f70dc046040 msgr2=0x7f70dc02d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:06:05.318 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.315+0000 7f70dbfff640 0 -- 172.21.15.102:0/692833028 >> [v2:172.21.15.121:6810/1906913778,v1:172.21.15.121:6811/1906913778] conn(0x55bf14874890 msgr2=0x55bf14876ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:06:05.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T02:06:05.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T02:06:05.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T02:06:05.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T02:06:05.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T02:06:05.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T02:06:05.326 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:05.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:06:05.327 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T02:06:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 zone default found 2024-09-12T02:06:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 4 Realm: () 2024-09-12T02:06:05.328 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T02:06:05.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T02:06:05.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T02:06:05.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 zonegroup default 2024-09-12T02:06:05.329 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.323+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.327+0000 7f70e581a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:05.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.327+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.327+0000 7f70e581a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:05.330 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.327+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.327+0000 7f70e581a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:05.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.327+0000 7f70e581a9c0 20 started sync module instance, tier type = 2024-09-12T02:06:05.331 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.327+0000 7f70e581a9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T02:06:05.353 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.351+0000 7f70e581a9c0 20 add_watcher() i=0 2024-09-12T02:06:05.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.351+0000 7f70e581a9c0 20 add_watcher() i=1 2024-09-12T02:06:05.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.351+0000 7f70e581a9c0 20 add_watcher() i=2 2024-09-12T02:06:05.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.351+0000 7f70e581a9c0 20 add_watcher() i=3 2024-09-12T02:06:05.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.351+0000 7f70e581a9c0 20 add_watcher() i=4 2024-09-12T02:06:05.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.351+0000 7f70e581a9c0 20 add_watcher() i=5 2024-09-12T02:06:05.354 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.351+0000 7f70e581a9c0 20 add_watcher() i=6 2024-09-12T02:06:05.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.355+0000 7f70e581a9c0 20 add_watcher() i=7 2024-09-12T02:06:05.356 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.355+0000 7f70e581a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T02:06:05.360 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f6f99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:06:05.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T02:06:05.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T02:06:05.361 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 5 note: GC not initialized 2024-09-12T02:06:05.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f6f98fe1640 20 reqs_thread_entry: start 2024-09-12T02:06:05.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 20 init_complete bucket index max shards: 11 2024-09-12T02:06:05.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 20 Filter name: none 2024-09-12T02:06:05.362 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f6f127fc640 20 reqs_thread_entry: start 2024-09-12T02:06:05.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T02:06:05.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T02:06:05.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T02:06:05.363 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T02:06:05.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783 : miss 2024-09-12T02:06:05.364 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.359+0000 7f70e581a9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:05.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T02:06:05.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783 info.flags=0x17 2024-09-12T02:06:05.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783 to cache LRU end 2024-09-12T02:06:05.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T02:06:05.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T02:06:05.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783 2024-09-12T02:06:05.365 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.0 2024-09-12T02:06:05.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T02:06:05.366 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.1 2024-09-12T02:06:05.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T02:06:05.367 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.363+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.2 2024-09-12T02:06:05.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.367+0000 7f70e581a9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T02:06:05.368 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.367+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.3 2024-09-12T02:06:05.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.367+0000 7f70e581a9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T02:06:05.369 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.367+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.4 2024-09-12T02:06:05.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.367+0000 7f70e581a9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T02:06:05.370 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.367+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.5 2024-09-12T02:06:05.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.367+0000 7f70e581a9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T02:06:05.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.367+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.6 2024-09-12T02:06:05.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.367+0000 7f70e581a9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T02:06:05.371 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.367+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.7 2024-09-12T02:06:05.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.371+0000 7f70e581a9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T02:06:05.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.371+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.8 2024-09-12T02:06:05.372 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.371+0000 7f70e581a9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T02:06:05.373 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.371+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.9 2024-09-12T02:06:05.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.371+0000 7f70e581a9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T02:06:05.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.371+0000 7f70e581a9c0 20 bucket index object: :.dir.19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783.10 2024-09-12T02:06:05.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.371+0000 7f70e581a9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T02:06:05.374 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.371+0000 7f70e581a9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T02:06:05.375 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.371+0000 7f6f99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:06:05.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.379+0000 7f70e581a9c0 20 remove_watcher() i=0 2024-09-12T02:06:05.381 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.379+0000 7f70e581a9c0 2 removed watcher, disabling cache 2024-09-12T02:06:05.383 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.379+0000 7f70e581a9c0 20 remove_watcher() i=1 2024-09-12T02:06:05.385 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.383+0000 7f70e581a9c0 20 remove_watcher() i=2 2024-09-12T02:06:05.387 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.383+0000 7f70e581a9c0 20 remove_watcher() i=3 2024-09-12T02:06:05.389 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.387+0000 7f70e581a9c0 20 remove_watcher() i=4 2024-09-12T02:06:05.391 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.387+0000 7f70e581a9c0 20 remove_watcher() i=5 2024-09-12T02:06:05.392 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.391+0000 7f70e581a9c0 20 remove_watcher() i=6 2024-09-12T02:06:05.394 INFO:tasks.workunit.client.0.smithi102.stderr:2024-09-12T02:06:05.391+0000 7f70e581a9c0 20 remove_watcher() i=7 2024-09-12T02:06:05.410 INFO:tasks.workunit.client.0.smithi102.stderr:Deleting bucket versioning-bucket 2024-09-12T02:06:05.413 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:06:05.413 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:06:05.455 INFO:tasks.workunit.client.0.smithi102.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T02:06:05.455 INFO:tasks.workunit.client.0.smithi102.stderr: warnings.warn( 2024-09-12T02:06:05.752 INFO:tasks.workunit.client.0.smithi102.stderr:Completed bucket versioning tests 2024-09-12T02:06:05.753 INFO:tasks.workunit.client.0.smithi102.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T02:06:05.753 INFO:tasks.workunit.client.0.smithi102.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T02:06:05.753 INFO:tasks.workunit.client.0.smithi102.stdout:connected to https://localhost:443 2024-09-12T02:06:05.855 INFO:tasks.workunit.client.0.smithi102.stderr:+ deactivate 2024-09-12T02:06:05.855 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T02:06:05.855 INFO:tasks.workunit.client.0.smithi102.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T02:06:05.855 INFO:tasks.workunit.client.0.smithi102.stderr:+ export PATH 2024-09-12T02:06:05.855 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T02:06:05.855 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n '' ']' 2024-09-12T02:06:05.855 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T02:06:05.855 INFO:tasks.workunit.client.0.smithi102.stderr:+ hash -r 2024-09-12T02:06:05.855 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' -n '' ']' 2024-09-12T02:06:05.856 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset VIRTUAL_ENV 2024-09-12T02:06:05.856 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T02:06:05.856 INFO:tasks.workunit.client.0.smithi102.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T02:06:05.856 INFO:tasks.workunit.client.0.smithi102.stderr:+ unset -f deactivate 2024-09-12T02:06:05.856 INFO:tasks.workunit.client.0.smithi102.stderr:+ echo OK. 2024-09-12T02:06:05.857 INFO:tasks.workunit.client.0.smithi102.stdout:OK. 2024-09-12T02:06:05.857 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:06:05.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:06:05.912 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T02:06:05.912 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:06:06.318 DEBUG:teuthology.parallel:result is None 2024-09-12T02:06:06.319 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:06:06.330 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:06:06.330 DEBUG:teuthology.orchestra.run.smithi102:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:06:06.376 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:06:06.376 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T02:06:06.387 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T02:06:06.397 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T02:06:06.397 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T02:06:06.397 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T02:06:06.468 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T02:06:06.468 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T02:06:06.500 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T02:06:06.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.535+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.539+0000 7ff9bcdad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.539+0000 7ff9bcdad9c0 20 realm 2024-09-12T02:06:06.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.539+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.539+0000 7ff9bcdad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:06.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.539+0000 7ff9bcdad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T02:06:06.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.539+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.539+0000 7ff9bcdad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:06.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.539+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.539+0000 7ff9bcdad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:06:06.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.539+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.543+0000 7ff9bcdad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T02:06:06.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.543+0000 7ff9bcdad9c0 20 searching for the correct realm 2024-09-12T02:06:06.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.543+0000 7ff9bb0b4640 0 -- 172.21.15.102:0/2081237873 >> [v2:172.21.15.121:6826/1318321638,v1:172.21.15.121:6827/1318321638] conn(0x7ff9ac094040 msgr2=0x7ff9ac0833d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T02:06:06.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.759+0000 7ff9ba0b2640 0 -- 172.21.15.102:0/2081237873 >> [v2:172.21.15.102:6808/1237794167,v1:172.21.15.102:6809/1237794167] conn(0x7ff9b4029400 msgr2=0x7ff9b4029880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T02:06:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.975+0000 7ff9bcdad9c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T02:06:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.975+0000 7ff9bcdad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T02:06:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.975+0000 7ff9bcdad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T02:06:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.975+0000 7ff9bcdad9c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T02:06:06.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.975+0000 7ff9bcdad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T02:06:06.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.975+0000 7ff9bcdad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T02:06:06.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.975+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.975+0000 7ff9bcdad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:06.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.975+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:06:06.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T02:06:06.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 zone default found 2024-09-12T02:06:06.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 4 Realm: () 2024-09-12T02:06:06.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T02:06:06.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T02:06:06.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T02:06:06.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 zonegroup default 2024-09-12T02:06:06.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:06.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:06.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:06.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:06.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 started sync module instance, tier type = 2024-09-12T02:06:06.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:06.979+0000 7ff9bcdad9c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T02:06:07.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.003+0000 7ff9bcdad9c0 20 add_watcher() i=0 2024-09-12T02:06:07.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.003+0000 7ff9bcdad9c0 20 add_watcher() i=1 2024-09-12T02:06:07.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.003+0000 7ff9bcdad9c0 20 add_watcher() i=2 2024-09-12T02:06:07.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.003+0000 7ff9bcdad9c0 20 add_watcher() i=3 2024-09-12T02:06:07.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.003+0000 7ff9bcdad9c0 20 add_watcher() i=4 2024-09-12T02:06:07.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.003+0000 7ff9bcdad9c0 20 add_watcher() i=5 2024-09-12T02:06:07.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.003+0000 7ff9bcdad9c0 20 add_watcher() i=6 2024-09-12T02:06:07.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.007+0000 7ff9bcdad9c0 20 add_watcher() i=7 2024-09-12T02:06:07.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.007+0000 7ff9bcdad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T02:06:07.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.011+0000 7ff8717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:06:07.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.011+0000 7ff9bcdad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T02:06:07.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.011+0000 7ff9bcdad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T02:06:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.103+0000 7ff7ebfff640 20 reqs_thread_entry: start 2024-09-12T02:06:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.103+0000 7ff9bcdad9c0 20 init_complete bucket index max shards: 11 2024-09-12T02:06:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.103+0000 7ff9bcdad9c0 20 Filter name: none 2024-09-12T02:06:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.103+0000 7ff7e9ffb640 20 reqs_thread_entry: start 2024-09-12T02:06:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.103+0000 7ff9bcdad9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T02:06:07.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.103+0000 7ff9bcdad9c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:07.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.107+0000 7ff9bcdad9c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T02:06:07.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.107+0000 7ff9bcdad9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T02:06:07.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.107+0000 7ff9bcdad9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T02:06:07.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.107+0000 7ff9bcdad9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T02:06:07.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.107+0000 7ff9bcdad9c0 10 removing key index: ESVHOOQWLSTABAJTHHKP 2024-09-12T02:06:07.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.111+0000 7ff9bcdad9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:ESVHOOQWLSTABAJTHHKP, ofs0, ns] 2024-09-12T02:06:07.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.111+0000 7ff89e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301003 cookie 94494987580448 notifier 8762 bl.length()=170 2024-09-12T02:06:07.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.111+0000 7ff9bcdad9c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T02:06:07.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.115+0000 7ff9bcdad9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T02:06:07.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.115+0000 7ff89e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301048 cookie 94494987570768 notifier 8762 bl.length()=181 2024-09-12T02:06:07.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.119+0000 7ff9bcdad9c0 10 removing user buckets index 2024-09-12T02:06:07.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.119+0000 7ff9bcdad9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T02:06:07.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.119+0000 7ff89e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301004 cookie 94494987580448 notifier 8762 bl.length()=172 2024-09-12T02:06:07.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.123+0000 7ff9bcdad9c0 10 removing user index: tester.client.0 2024-09-12T02:06:07.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.127+0000 7ff9bcdad9c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T02:06:07.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.127+0000 7ff9bcdad9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T02:06:07.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.127+0000 7ff89e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302130 cookie 94494987576896 notifier 8762 bl.length()=164 2024-09-12T02:06:07.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.131+0000 7ff8717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:06:07.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.135+0000 7ff9bcdad9c0 20 remove_watcher() i=0 2024-09-12T02:06:07.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.135+0000 7ff9bcdad9c0 2 removed watcher, disabling cache 2024-09-12T02:06:07.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.139+0000 7ff9bcdad9c0 20 remove_watcher() i=1 2024-09-12T02:06:07.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.139+0000 7ff9bcdad9c0 20 remove_watcher() i=2 2024-09-12T02:06:07.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.143+0000 7ff9bcdad9c0 20 remove_watcher() i=3 2024-09-12T02:06:07.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.143+0000 7ff9bcdad9c0 20 remove_watcher() i=4 2024-09-12T02:06:07.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.147+0000 7ff9bcdad9c0 20 remove_watcher() i=5 2024-09-12T02:06:07.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.147+0000 7ff9bcdad9c0 20 remove_watcher() i=6 2024-09-12T02:06:07.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:07.151+0000 7ff9bcdad9c0 20 remove_watcher() i=7 2024-09-12T02:06:07.169 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T02:06:07.180 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T02:06:07.189 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T02:06:07.256 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T02:06:07.266 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T02:06:07.266 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:06:07.309 INFO:tasks.rgw.client.0.smithi102.stdout:2024-09-12T02:06:07.303+0000 e571640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 39825) UID: 0 2024-09-12T02:06:07.309 INFO:tasks.rgw.client.0.smithi102.stdout:2024-09-12T02:06:07.303+0000 8ed9f80 -1 shutting down 2024-09-12T02:06:41.682 INFO:tasks.rgw.client.0.smithi102.stderr:==00:01:56:28.350 39829== could not unlink /tmp/vgdb-pipe-from-vgdb-to-39829-by-root-on-??? 2024-09-12T02:06:41.682 INFO:tasks.rgw.client.0.smithi102.stderr:==00:01:56:28.350 39829== could not unlink /tmp/vgdb-pipe-to-vgdb-from-39829-by-root-on-??? 2024-09-12T02:06:41.682 INFO:tasks.rgw.client.0.smithi102.stderr:==00:01:56:28.350 39829== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-39829-by-root-on-??? 2024-09-12T02:06:43.874 INFO:tasks.rgw.client.0:Stopped 2024-09-12T02:06:43.875 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T02:06:43.882 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T02:06:43.938 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T02:06:43.994 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T02:06:43.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T02:06:43.995 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T02:06:44.073 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-12T02:06:44.073 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T02:06:44.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.114+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.114+0000 7fe151b989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:44.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.114+0000 7fe151b989c0 20 realm 2024-09-12T02:06:44.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.114+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.114+0000 7fe151b989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:44.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.114+0000 7fe151b989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T02:06:44.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.114+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.114+0000 7fe151b989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:44.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.114+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.118+0000 7fe151b989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:06:44.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.118+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.118+0000 7fe151b989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T02:06:44.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.118+0000 7fe151b989c0 20 searching for the correct realm 2024-09-12T02:06:44.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.118+0000 7fe14ee9d640 0 -- 172.21.15.102:0/1109906186 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7fe148068c20 msgr2=0x7fe148061ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:06:44.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.330+0000 7fe14fe9f640 0 -- 172.21.15.102:0/1109906186 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55d161f8b840 msgr2=0x55d161f8dc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:06:44.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.346+0000 7fe151b989c0 20 RGWRados::pool_iterate: got zone_info.19f4f3c1-461e-436c-9c0f-f6c5a929bad9 2024-09-12T02:06:44.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.346+0000 7fe151b989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T02:06:44.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.346+0000 7fe151b989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T02:06:44.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.346+0000 7fe151b989c0 20 RGWRados::pool_iterate: got zonegroup_info.da336416-8990-458a-b4db-6c959b288603 2024-09-12T02:06:44.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.346+0000 7fe151b989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T02:06:44.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.346+0000 7fe151b989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T02:06:44.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.346+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.346+0000 7fe151b989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:44.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.346+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T02:06:44.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T02:06:44.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 20 zone default found 2024-09-12T02:06:44.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 4 Realm: () 2024-09-12T02:06:44.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 4 ZoneGroup: default (da336416-8990-458a-b4db-6c959b288603) 2024-09-12T02:06:44.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 4 Zone: default (19f4f3c1-461e-436c-9c0f-f6c5a929bad9) 2024-09-12T02:06:44.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T02:06:44.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 20 zonegroup default 2024-09-12T02:06:44.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:44.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:44.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.350+0000 7fe151b989c0 20 rados->read ofs=0 len=0 2024-09-12T02:06:44.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.354+0000 7fe151b989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T02:06:44.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.354+0000 7fe151b989c0 20 started sync module instance, tier type = 2024-09-12T02:06:44.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.354+0000 7fe151b989c0 20 started zone id=19f4f3c1-461e-436c-9c0f-f6c5a929bad9 (name=default) with tier type = 2024-09-12T02:06:44.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.374+0000 7fe151b989c0 20 add_watcher() i=0 2024-09-12T02:06:44.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.374+0000 7fe151b989c0 20 add_watcher() i=1 2024-09-12T02:06:44.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.374+0000 7fe151b989c0 20 add_watcher() i=2 2024-09-12T02:06:44.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.374+0000 7fe151b989c0 20 add_watcher() i=3 2024-09-12T02:06:44.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.374+0000 7fe151b989c0 20 add_watcher() i=4 2024-09-12T02:06:44.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.374+0000 7fe151b989c0 20 add_watcher() i=5 2024-09-12T02:06:44.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.374+0000 7fe151b989c0 20 add_watcher() i=6 2024-09-12T02:06:44.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.378+0000 7fe151b989c0 20 add_watcher() i=7 2024-09-12T02:06:44.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.378+0000 7fe151b989c0 2 all 8 watchers are set, enabling cache 2024-09-12T02:06:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.378+0000 7fe005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:06:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.382+0000 7fe151b989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T02:06:44.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.382+0000 7fe151b989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T02:06:44.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.466+0000 7fe004fe1640 20 reqs_thread_entry: start 2024-09-12T02:06:44.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.466+0000 7fe151b989c0 20 init_complete bucket index max shards: 11 2024-09-12T02:06:44.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.466+0000 7fe151b989c0 20 Filter name: none 2024-09-12T02:06:44.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.466+0000 7fdf7e7fc640 20 reqs_thread_entry: start 2024-09-12T02:06:44.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T02:06:44.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:44.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:44.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47860' 2024-09-12T02:06:44.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18212241428751280484', time=2024-09-12T03:02:55.281725+0000, chain.objs.size()=1 2024-09-12T02:06:44.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.158__shadow:xGbBu5PtocIx5M-X.8rGez9l9GKE5X-_.DbFACvZ23UFMWUiSS2MaVEXWnErXE4X_0 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11281295624665350400', time=2024-09-12T03:10:56.376560+0000, chain.objs.size()=1 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.242__shadow_.lpTuINrR8fnOz2bIk15CVl6y8sWw21__0 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2374521167856349867', time=2024-09-12T03:11:17.096424+0000, chain.objs.size()=1 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.249__shadow_.dPvsnIl9Wkx_k_Kz9l0U5LAhlgQNEYj_0 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6622368154677255261', time=2024-09-12T03:11:29.649755+0000, chain.objs.size()=1 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.254__shadow_.k34pvuX7az2zkDJaP3IAAYcY4j8crcV_0 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10431918418713234266', time=2024-09-12T03:11:46.849836+0000, chain.objs.size()=1 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.261__shadow_.Ppe_Frj3lZBEqDEMbOA6uH76ninxYoF_0 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17321536158551264407', time=2024-09-12T03:13:33.851855+0000, chain.objs.size()=1 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aqujKCvYc0DYO2uabkPvd4smPY2u_-O_0 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7760128362456901604', time=2024-09-12T03:13:34.739131+0000, chain.objs.size()=1 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8IBlu8XHoy3vjEXO8M5NQ3BA3ie2uNJ_0 2024-09-12T02:06:44.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6784312647770730630', time=2024-09-12T03:13:35.746321+0000, chain.objs.size()=1 2024-09-12T02:06:44.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.FHVoCCriMNq6SDYoFSgYONlbhVhmhIu_0 2024-09-12T02:06:44.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15918177039686642017', time=2024-09-12T03:13:35.973362+0000, chain.objs.size()=1 2024-09-12T02:06:44.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2f9zupHQCBNFRfDl2seShvZIn6lpRIK_0 2024-09-12T02:06:44.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5658493425133189934', time=2024-09-12T03:13:37.240412+0000, chain.objs.size()=1 2024-09-12T02:06:44.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4FPvV9yZyVwwtFaG0SQ3qMco0iMfmBg_0 2024-09-12T02:06:44.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7817787845525790151', time=2024-09-12T03:13:38.336892+0000, chain.objs.size()=1 2024-09-12T02:06:44.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cuvr-hC7EDm7Sw5QeIC1I7XTjrqGF58_0 2024-09-12T02:06:44.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17381251415886421607', time=2024-09-12T03:13:40.316874+0000, chain.objs.size()=1 2024-09-12T02:06:44.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.YKuObizjyAgsvtYWwOZGEApMFRekQWw_0 2024-09-12T02:06:44.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15883287274139758897', time=2024-09-12T03:13:40.592205+0000, chain.objs.size()=1 2024-09-12T02:06:44.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.oDB8GOKnwSnsaQCWkQ8lV8zi12hCExJ_0 2024-09-12T02:06:44.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9978426659184581436', time=2024-09-12T03:13:40.992415+0000, chain.objs.size()=1 2024-09-12T02:06:44.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4vXgmn1_3v7zzg3Zzh6AkGbegQ2YJ5v_0 2024-09-12T02:06:44.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10652708414278347793', time=2024-09-12T03:13:41.080221+0000, chain.objs.size()=1 2024-09-12T02:06:44.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6mxvtDajJGaTeZUiRoYecvo2Q5Z81MK_0 2024-09-12T02:06:44.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3146469456838162264', time=2024-09-12T03:13:41.082537+0000, chain.objs.size()=1 2024-09-12T02:06:44.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ENyCE8IEyVIlkgVwg7RwfSRxfGPoKBQ_0 2024-09-12T02:06:44.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.682630171695309849', time=2024-09-12T03:13:44.233097+0000, chain.objs.size()=1 2024-09-12T02:06:44.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Gve456eA2d_NRmGexV-0XONYfMPkRln_0 2024-09-12T02:06:44.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6782401078159880927', time=2024-09-12T03:13:45.488024+0000, chain.objs.size()=1 2024-09-12T02:06:44.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mWFwXhxdsZluBGrZinWqCmEOsfRvSIL_0 2024-09-12T02:06:44.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13923745801728362059', time=2024-09-12T03:13:47.092266+0000, chain.objs.size()=1 2024-09-12T02:06:44.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.7vbR5xWZuC9UUvYJGGCG1708UkExiW6_0 2024-09-12T02:06:44.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16770630039670276774', time=2024-09-12T03:13:47.874401+0000, chain.objs.size()=1 2024-09-12T02:06:44.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.O4sVN8pXKzETNvWMR2Sql5pmfgzUyxu_0 2024-09-12T02:06:44.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2757205737866891972', time=2024-09-12T03:13:47.917430+0000, chain.objs.size()=1 2024-09-12T02:06:44.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.SwaWw88IRtSKeyAQ8C8n4hS50_UQXCe_0 2024-09-12T02:06:44.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6323239844419939769', time=2024-09-12T03:13:49.669074+0000, chain.objs.size()=1 2024-09-12T02:06:44.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.B1xsqOWf0vjCgcbguCfSpyZYAuBXfn9_0 2024-09-12T02:06:44.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18344804106262555054', time=2024-09-12T03:13:51.977816+0000, chain.objs.size()=1 2024-09-12T02:06:44.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.B3a_rCbvv0z0mHcPkEdaGud1XhTVS8J_0 2024-09-12T02:06:44.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17633182714957488276', time=2024-09-12T03:13:52.189719+0000, chain.objs.size()=1 2024-09-12T02:06:44.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._HBraltt6kwL3vbumolYtjQ-vYUJY51_0 2024-09-12T02:06:44.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5946796864216403334', time=2024-09-12T03:13:52.732614+0000, chain.objs.size()=1 2024-09-12T02:06:44.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ManMm2fv-7awVrwzwzUYWTG3HztQCqJ_0 2024-09-12T02:06:44.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17622337889209176908', time=2024-09-12T03:13:53.147386+0000, chain.objs.size()=1 2024-09-12T02:06:44.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3FqC1LBcb-cxMVc7lgKQOrzIRjdoeAC_0 2024-09-12T02:06:44.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10593626173504237756', time=2024-09-12T03:13:53.620864+0000, chain.objs.size()=1 2024-09-12T02:06:44.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.EStyXbrjR5r7oEk7UQFJFjHRC0XnHnD_0 2024-09-12T02:06:44.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2770111118217480371', time=2024-09-12T03:13:53.885334+0000, chain.objs.size()=1 2024-09-12T02:06:44.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CIVML4wwHAISCXeKbg-p1ITvH--IUSq_0 2024-09-12T02:06:44.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5094063868828688725', time=2024-09-12T03:13:55.528196+0000, chain.objs.size()=1 2024-09-12T02:06:44.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.fc_QWyJmSh9D5wN4wSuWHRP4izgoHhZ_0 2024-09-12T02:06:44.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12825329058537843978', time=2024-09-12T03:13:56.631352+0000, chain.objs.size()=1 2024-09-12T02:06:44.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-f3rMwZu_K75V1LeIzBgjlFzsMRpbB5_0 2024-09-12T02:06:44.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16566667352993306764', time=2024-09-12T03:13:57.756655+0000, chain.objs.size()=1 2024-09-12T02:06:44.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.UvQ6Pudbd5EA3Fu8MClm-QufY5BDa5O_0 2024-09-12T02:06:44.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.689706179245880446', time=2024-09-12T03:13:59.444723+0000, chain.objs.size()=1 2024-09-12T02:06:44.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.86O0EjTH3BzZC1d2PvPB1IajSf9bNbj_0 2024-09-12T02:06:44.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12205668792784438057', time=2024-09-12T03:13:59.618637+0000, chain.objs.size()=1 2024-09-12T02:06:44.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qeZGWQwu5UOPNC7n_qtG20ARF7ruEoW_0 2024-09-12T02:06:44.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5485768617205028123', time=2024-09-12T03:14:00.220992+0000, chain.objs.size()=1 2024-09-12T02:06:44.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.sct2Fejw-JDvyUg6MJoI3R_n4GfRp4s_0 2024-09-12T02:06:44.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14035814220985257655', time=2024-09-12T03:14:00.745433+0000, chain.objs.size()=1 2024-09-12T02:06:44.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pZZ-sN5-xgMIhv5RCStsLuyUBaC2Xjr_0 2024-09-12T02:06:44.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9407687630583772033', time=2024-09-12T03:14:01.303050+0000, chain.objs.size()=1 2024-09-12T02:06:44.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vYsy9rnU0Xtj75O8t9wKtevQuCsQZL8_0 2024-09-12T02:06:44.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8621462593232006842', time=2024-09-12T03:14:01.861332+0000, chain.objs.size()=1 2024-09-12T02:06:44.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.HTwS0uheki94AisHE3Cx61hLZg3RmnK_0 2024-09-12T02:06:44.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7207750001017770808', time=2024-09-12T03:14:04.552217+0000, chain.objs.size()=1 2024-09-12T02:06:44.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0rx3Zlqk71FDAP23wtl-UsvmL2kvzcb_0 2024-09-12T02:06:44.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1959812364561073229', time=2024-09-12T03:14:07.866752+0000, chain.objs.size()=1 2024-09-12T02:06:44.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.264__shadow_.xIg3Jycd-PH8NnFeMavUV8fcmPtK8hq_0 2024-09-12T02:06:44.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4842819668970127989', time=2024-09-12T03:14:31.749493+0000, chain.objs.size()=1 2024-09-12T02:06:44.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.274__shadow_.qJDdbVIXSMp0aUItq9DUwKXqCzIENLs_0 2024-09-12T02:06:44.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1677760971464554350', time=2024-09-12T03:14:39.200446+0000, chain.objs.size()=1 2024-09-12T02:06:44.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.277__shadow_.dfj-O0fERMQyzPDFwsEf0Yrw0E70KEe_0 2024-09-12T02:06:44.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13054100529449563728', time=2024-09-12T03:15:01.981358+0000, chain.objs.size()=1 2024-09-12T02:06:44.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.286__shadow_.yJ79v5pUTs9q4-vq3A1Cnc0efkSm5KY_0 2024-09-12T02:06:44.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5162611108327444563', time=2024-09-12T03:15:01.994550+0000, chain.objs.size()=1 2024-09-12T02:06:44.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.286__shadow_.uVbLo68CVJTvW22Mp__Fiet5tgkuk-g_0 2024-09-12T02:06:44.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9594099305014921626', time=2024-09-12T03:15:09.624349+0000, chain.objs.size()=1 2024-09-12T02:06:44.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.289__shadow_.sbGD6ke_lC1Nv8E1cq1BnA30i-mKd2B_0 2024-09-12T02:06:44.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6280519976538364684', time=2024-09-12T03:15:17.922120+0000, chain.objs.size()=1 2024-09-12T02:06:44.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.292__shadow_.vAwH52ngEILYH6kQdTDb02JCRkHHEAm_0 2024-09-12T02:06:44.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18134126703216243067', time=2024-09-12T03:15:23.390515+0000, chain.objs.size()=1 2024-09-12T02:06:44.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.SgP9AbF77oqCc3kp9zjsq-uq9y353Ue_0 2024-09-12T02:06:44.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6964076229886592118', time=2024-09-12T03:15:29.377364+0000, chain.objs.size()=1 2024-09-12T02:06:44.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.xzNDlGGw_OwPItEXAfoxj0pTRdOAy6W_0 2024-09-12T02:06:44.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5223633532008440075', time=2024-09-12T03:15:29.391310+0000, chain.objs.size()=1 2024-09-12T02:06:44.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.__BbaddkrcpEAbwTTkLIem7ZBFlGQOZ_0 2024-09-12T02:06:44.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1994631303395515956', time=2024-09-12T03:15:42.541504+0000, chain.objs.size()=1 2024-09-12T02:06:44.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.299__shadow_.QNqmwuTlscTz3XPjtgokwwc3z__uVug_0 2024-09-12T02:06:44.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14873466714418422931', time=2024-09-12T03:16:06.882022+0000, chain.objs.size()=1 2024-09-12T02:06:44.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.308__shadow:zRs4uy1-u4JNRK8FtxIm52Vub7AqfHT_.pJ77FY-ljNUpfn7IBMKrDujGwjT-ef-_0 2024-09-12T02:06:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4313074119751589804', time=2024-09-12T03:18:37.344838+0000, chain.objs.size()=1 2024-09-12T02:06:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QlF0Az6A_gLJ2OpXUVgWKbeW_Xgx398_0 2024-09-12T02:06:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.602705522040880931', time=2024-09-12T03:18:37.757551+0000, chain.objs.size()=1 2024-09-12T02:06:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jWFJ44HpMlwKe5tjh3mtb_TYm_mcMOC_0 2024-09-12T02:06:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7935402865460554774', time=2024-09-12T03:18:39.570827+0000, chain.objs.size()=1 2024-09-12T02:06:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Lv2PfukGN-d5vmjaTbkFgMtb8IJFuTv_0 2024-09-12T02:06:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13299716577300569568', time=2024-09-12T03:18:40.714182+0000, chain.objs.size()=1 2024-09-12T02:06:44.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MEHiq4m5zl1IopCO4GSuoq3bxmhuDXd_0 2024-09-12T02:06:44.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9757570567850525475', time=2024-09-12T03:18:40.898979+0000, chain.objs.size()=1 2024-09-12T02:06:44.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PwYNiRjezF92IMFez4Z1S5jfLkalvtR_0 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2145474350879031010', time=2024-09-12T03:18:41.337530+0000, chain.objs.size()=1 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.XMiv-i6GJSLAT56HDNYsUZ2d8WpSHvC_0 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12851229365712909970', time=2024-09-12T03:18:41.983837+0000, chain.objs.size()=1 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.q3yDP6cQK_YUWO10azsdX6yiLEj8ezs_0 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1258264032438951908', time=2024-09-12T03:18:43.382009+0000, chain.objs.size()=1 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.200SOpdjGHX1OzEPElIf6ZXqDfB4YiY_0 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.157415182707763743', time=2024-09-12T03:18:44.972716+0000, chain.objs.size()=1 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.C8UBryuxZ8Ai89FQBU57tLG-ZL6SUkW_0 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13161502788854397079', time=2024-09-12T03:18:45.108281+0000, chain.objs.size()=1 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.A8uqt35X9kAFRgYpMfiez10Slpz5frq_0 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7139247861176028423', time=2024-09-12T03:18:45.639123+0000, chain.objs.size()=1 2024-09-12T02:06:44.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4yzABvMf-Cx7q7GA5plCZbQ4Sbu0DZA_0 2024-09-12T02:06:44.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14156701468965477264', time=2024-09-12T03:18:46.014835+0000, chain.objs.size()=1 2024-09-12T02:06:44.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2XhTvXKqM8PS1BzVKBE6Nbrxh2jxVGy_0 2024-09-12T02:06:44.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5717068512200269073', time=2024-09-12T03:18:46.786857+0000, chain.objs.size()=1 2024-09-12T02:06:44.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.pW1Kq6dQoQhjwT85sAQNO-EZ0Cvj7M__0 2024-09-12T02:06:44.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2031154736962110602', time=2024-09-12T03:18:47.251881+0000, chain.objs.size()=1 2024-09-12T02:06:44.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.O4-tsUhkxyNVbCWgNkgUIEB6fpdpQjt_0 2024-09-12T02:06:44.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14095978385372642228', time=2024-09-12T03:18:47.910297+0000, chain.objs.size()=1 2024-09-12T02:06:44.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.b_RpsCcveK5Q_ogADfah0d2xILjdoLQ_0 2024-09-12T02:06:44.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5573808726906859999', time=2024-09-12T03:18:49.193262+0000, chain.objs.size()=1 2024-09-12T02:06:44.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.e5hINI4SQSzCbcRDvcdYqmEcCRPgCJQ_0 2024-09-12T02:06:44.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9440312685102795965', time=2024-09-12T03:18:49.784217+0000, chain.objs.size()=1 2024-09-12T02:06:44.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Vsg1DNjnXvHKgtPPvyzFX029hyJYlHa_0 2024-09-12T02:06:44.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11075160135684908696', time=2024-09-12T03:18:51.406765+0000, chain.objs.size()=1 2024-09-12T02:06:44.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OaL1mFYXfm8JpkcBK1Iy4E_IQi6-Cgf_0 2024-09-12T02:06:44.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5603381317839303506', time=2024-09-12T03:18:52.409919+0000, chain.objs.size()=1 2024-09-12T02:06:44.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.f8T2eh9NiKNwSAoDMVE5P6DQYPbTu___0 2024-09-12T02:06:44.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7007081133355793440', time=2024-09-12T03:18:53.342379+0000, chain.objs.size()=1 2024-09-12T02:06:44.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.swuVU2bb7RFaoHGCwqM6FYI4VjmkkFD_0 2024-09-12T02:06:44.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9828962377859508167', time=2024-09-12T03:18:54.331097+0000, chain.objs.size()=1 2024-09-12T02:06:44.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.sOnimK8_LZ-tM8xLJQE91n5TIVpC88m_0 2024-09-12T02:06:44.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1806481740600170294', time=2024-09-12T03:18:55.593991+0000, chain.objs.size()=1 2024-09-12T02:06:44.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RqDHZps6zXXFfUaIKn_Hx-jMtPBDHzc_0 2024-09-12T02:06:44.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12341562125386009190', time=2024-09-12T03:18:55.700037+0000, chain.objs.size()=1 2024-09-12T02:06:44.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.YOoS1_BnZQNr9ZQrEG1atVt8CyXAl9b_0 2024-09-12T02:06:44.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1571833366260889687', time=2024-09-12T03:18:56.031783+0000, chain.objs.size()=1 2024-09-12T02:06:44.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eRy9Yx9uJaA51t0i6pdg3gHFVvoc2Js_0 2024-09-12T02:06:44.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16193229745986417370', time=2024-09-12T03:18:57.684813+0000, chain.objs.size()=1 2024-09-12T02:06:44.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.XuBQSD_XuWoCrLvHO_tZrk0pY6XN27z_0 2024-09-12T02:06:44.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8038341847971105796', time=2024-09-12T03:18:58.264290+0000, chain.objs.size()=1 2024-09-12T02:06:44.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ewcgvkFmO_y4R_xKjCpom8QqAlJpUp4_0 2024-09-12T02:06:44.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8917774652067585997', time=2024-09-12T03:18:59.070495+0000, chain.objs.size()=1 2024-09-12T02:06:44.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Hsh79i0LGdc-jSfKMvRXWwauoi8eGei_0 2024-09-12T02:06:44.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.432058770843704907', time=2024-09-12T03:19:01.570907+0000, chain.objs.size()=1 2024-09-12T02:06:44.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.pzowxIrBJBIC-AMFkV_B2K3t0kdVk7J_0 2024-09-12T02:06:44.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.554+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11499282228041440154', time=2024-09-12T03:19:02.353004+0000, chain.objs.size()=1 2024-09-12T02:06:44.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.554+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Hg8HMQYWs3B0JaIZC3vo_9ExXTWIDK3_0 2024-09-12T02:06:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13985513601341622953', time=2024-09-12T03:19:05.326207+0000, chain.objs.size()=1 2024-09-12T02:06:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VCqAotGx1e6HfGh04TckxzXTWd4Xxe-_0 2024-09-12T02:06:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.807781430002744305', time=2024-09-12T03:19:06.996847+0000, chain.objs.size()=1 2024-09-12T02:06:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.j-AhEHIZ2wRZdmqE4qkwSoocfwRY1hj_0 2024-09-12T02:06:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15769234092014057193', time=2024-09-12T03:19:07.197460+0000, chain.objs.size()=1 2024-09-12T02:06:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vVL9oeQfddIKzHowrf6aPDxjOtQ9ohF_0 2024-09-12T02:06:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6239848630814045277', time=2024-09-12T03:20:56.488542+0000, chain.objs.size()=1 2024-09-12T02:06:44.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hV2YydCFwerFpW9-jAc3495UAV-8nJ2_0 2024-09-12T02:06:44.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15300836252665164949', time=2024-09-12T03:21:01.338916+0000, chain.objs.size()=1 2024-09-12T02:06:44.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Qf4AhiEsbDtIYcv0wxaMXJYmXRwPol7_0 2024-09-12T02:06:44.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3505555724194347557', time=2024-09-12T03:21:01.428244+0000, chain.objs.size()=1 2024-09-12T02:06:44.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.whOQ-QE7vOinCYHHTuX5KfN6hteLIfl_0 2024-09-12T02:06:44.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9210944758825190958', time=2024-09-12T03:21:01.892860+0000, chain.objs.size()=1 2024-09-12T02:06:44.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gWqFNtlaPJFZsNkGPIqgEnBC2rL1jFx_0 2024-09-12T02:06:44.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6303970842549103975', time=2024-09-12T03:21:03.692181+0000, chain.objs.size()=1 2024-09-12T02:06:44.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.m3ZE2ugZmUWrZbr4sKAQOk0woi7I0Cf_0 2024-09-12T02:06:44.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5752205472229312923', time=2024-09-12T03:21:03.779409+0000, chain.objs.size()=1 2024-09-12T02:06:44.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qb0zahHa5_4ApJomW8PQd0RbsmpX1iB_0 2024-09-12T02:06:44.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7774647905080586930', time=2024-09-12T03:21:04.791912+0000, chain.objs.size()=1 2024-09-12T02:06:44.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8rucPNe9revyHnm2Ol_-NrodcBBtuX__0 2024-09-12T02:06:44.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16268056890995244498', time=2024-09-12T03:21:05.825800+0000, chain.objs.size()=1 2024-09-12T02:06:44.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.A5QHE0t3VeuHPDCXKUWWNn3L-i8aFR1_0 2024-09-12T02:06:44.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2865598248385662195', time=2024-09-12T03:21:07.129888+0000, chain.objs.size()=1 2024-09-12T02:06:44.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bHpgkk_nk8YcOZZyr7llfZsuamGIA7h_0 2024-09-12T02:06:44.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5666766702841383409', time=2024-09-12T03:21:07.525961+0000, chain.objs.size()=1 2024-09-12T02:06:44.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZeW6YtoPUC8AV1igFAgJ3CrV7kzhezn_0 2024-09-12T02:06:44.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18240605874583790315', time=2024-09-12T03:21:07.928163+0000, chain.objs.size()=1 2024-09-12T02:06:44.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qO2hCuprgljgKV5j6gnitC6HkJbapw-_0 2024-09-12T02:06:44.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17557344251855246734', time=2024-09-12T03:21:08.285645+0000, chain.objs.size()=1 2024-09-12T02:06:44.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dwWEPodL8Zy71eRMPPO35SOwe6pW2lm_0 2024-09-12T02:06:44.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8661605295212278986', time=2024-09-12T03:21:08.418092+0000, chain.objs.size()=1 2024-09-12T02:06:44.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Qa1OcvAaHZ-u2acMG40EmvLDUxJ6Nq3_0 2024-09-12T02:06:44.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10832320140194659486', time=2024-09-12T03:21:09.627983+0000, chain.objs.size()=1 2024-09-12T02:06:44.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.87kttQsyPLfhHaRLL9ImlP16EUmwHat_0 2024-09-12T02:06:44.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13514018054866572867', time=2024-09-12T03:21:10.256468+0000, chain.objs.size()=1 2024-09-12T02:06:44.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ooDNFzGhrXy5VQwLjqhIN1DL-V8Qbmk_0 2024-09-12T02:06:44.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7903312607274375950', time=2024-09-12T03:21:10.323528+0000, chain.objs.size()=1 2024-09-12T02:06:44.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.UtjAuyXe3M24wKpuA0HZBKONHEN4AOr_0 2024-09-12T02:06:44.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6562294814526529417', time=2024-09-12T03:21:11.286328+0000, chain.objs.size()=1 2024-09-12T02:06:44.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rTFO1kHo8MU1Z4owQkYPstThALPf2az_0 2024-09-12T02:06:44.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16179781840448853516', time=2024-09-12T03:21:12.043680+0000, chain.objs.size()=1 2024-09-12T02:06:44.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MwV51KKkDyZzwX2N-nnkmWvYgHj_hP7_0 2024-09-12T02:06:44.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47860 2024-09-12T02:06:44.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T02:06:44.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4204985991652043701', time=2024-09-12T03:21:12.418595+0000, chain.objs.size()=1 2024-09-12T02:06:44.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kdo5G6jZIWb26lhB7BY58wWyq_Xmfcc_0 2024-09-12T02:06:44.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17403806570195666445', time=2024-09-12T03:21:14.239013+0000, chain.objs.size()=1 2024-09-12T02:06:44.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.sXo8t5cdcdAEDKDoIBKZzBwgmTpKKk__0 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4200818779907747829', time=2024-09-12T03:21:14.326568+0000, chain.objs.size()=1 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.SCRE6Mv4Vh9nGBo31NCLshv_kZlEj-G_0 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16637638489138500868', time=2024-09-12T03:21:15.530928+0000, chain.objs.size()=1 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dK9UqGkoUvp37s6Fb8oy876y9sJKJiL_0 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17481571832981953560', time=2024-09-12T03:21:15.641621+0000, chain.objs.size()=1 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.WD-BG6-7_4RaRIxl2cyHSIvUVEJAuKd_0 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13599349867994440716', time=2024-09-12T03:21:18.364375+0000, chain.objs.size()=1 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8KBTTuLQ8Jt_4Bwv3YUrkBagVnBBZlP_0 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.499116003660553560', time=2024-09-12T03:21:19.566912+0000, chain.objs.size()=1 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.sOxzWJUidJUShnTfJQcN4xcRdVGK7-f_0 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2647335923131410865', time=2024-09-12T03:21:20.010707+0000, chain.objs.size()=1 2024-09-12T02:06:44.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9qXglF5NQwq6ix56n6nFlVYJXwg9BGW_0 2024-09-12T02:06:44.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2281867709633595922', time=2024-09-12T03:21:20.853096+0000, chain.objs.size()=1 2024-09-12T02:06:44.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hX21mrpgy4Rm8TAaf_eiUBqdtOGBcqG_0 2024-09-12T02:06:44.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2952951581000072894', time=2024-09-12T03:21:21.890235+0000, chain.objs.size()=1 2024-09-12T02:06:44.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZwsW6JDIgU3PjlMqA52oXa70hA4RAs3_0 2024-09-12T02:06:44.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5475918386964086852', time=2024-09-12T03:21:22.018242+0000, chain.objs.size()=1 2024-09-12T02:06:44.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Hcr2pIwp6ZKiOwXMfdKS0C45xxgNblj_0 2024-09-12T02:06:44.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13318857532309394784', time=2024-09-12T03:21:24.136379+0000, chain.objs.size()=1 2024-09-12T02:06:44.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.QMpj9ENbt_3xGVulUqd8A3pN8e9khO5_0 2024-09-12T02:06:44.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10454635655619169279', time=2024-09-12T03:21:24.348896+0000, chain.objs.size()=1 2024-09-12T02:06:44.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tMP5tR8O2Dcy2MozdcrCUwX3kq4UFjT_0 2024-09-12T02:06:44.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4873661336032841335', time=2024-09-12T03:22:54.988158+0000, chain.objs.size()=1 2024-09-12T02:06:44.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.368__shadow_.4Bx1od5p8DzaBFXMxnOz42TDbO0ano8_0 2024-09-12T02:06:44.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2939178509533900786', time=2024-09-12T03:23:21.694025+0000, chain.objs.size()=1 2024-09-12T02:06:44.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.380__shadow_.UW-n5aF4RT1vmmbuneO9uIXSSet6RfG_0 2024-09-12T02:06:44.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3719409445768383097', time=2024-09-12T03:23:26.271876+0000, chain.objs.size()=1 2024-09-12T02:06:44.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.382__shadow_.nCYjN9CCJ5VpYfUoqHCQgsLAslgk_ew_0 2024-09-12T02:06:44.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3607681048848212803', time=2024-09-12T03:23:57.136003+0000, chain.objs.size()=1 2024-09-12T02:06:44.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.395__shadow:NMN9ck6x.aEhBwzT7PU.HX1yCb1OMzs_.cmI5r8p4qAYFDp1yPrwzQAfZGSt2xME_0 2024-09-12T02:06:44.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16953015943179466434', time=2024-09-12T03:25:32.971511+0000, chain.objs.size()=1 2024-09-12T02:06:44.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.438__shadow_.jILFX_VRu2m4umonfTKr5oiL31q2_sU_0 2024-09-12T02:06:44.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12285861057502852088', time=2024-09-12T03:26:33.945110+0000, chain.objs.size()=1 2024-09-12T02:06:44.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.461__shadow_.oSrT3DAu5k4gF1YE67D569r4LOGZeyB_0 2024-09-12T02:06:44.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2541039237762357745', time=2024-09-12T03:26:37.223751+0000, chain.objs.size()=1 2024-09-12T02:06:44.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.462__shadow_.DzbpjyXMgH5oI5G329pR0IfA0CousgB_0 2024-09-12T02:06:44.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15746778298255805371', time=2024-09-12T03:26:53.279675+0000, chain.objs.size()=1 2024-09-12T02:06:44.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.467__shadow_.J57Rj3mjC-hf9DNQxSw2FQ5pMRGIgT6_0 2024-09-12T02:06:44.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11745733962808778644', time=2024-09-12T03:28:15.520891+0000, chain.objs.size()=1 2024-09-12T02:06:44.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.504__shadow:xY.qSzc8-FZgL.PAZY7yve8r0PrFDvj_.feVFZUiV-D7oBnX7pKoH2iGI2T3glrn_0 2024-09-12T02:06:44.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18389968892672519628', time=2024-09-12T03:29:38.789830+0000, chain.objs.size()=1 2024-09-12T02:06:44.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.518__shadow_.FnFTuYFvj97eSzH4dvM5yI0edqDOK1J_0 2024-09-12T02:06:44.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4939866442817406429', time=2024-09-12T03:39:21.106556+0000, chain.objs.size()=1 2024-09-12T02:06:44.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.563__shadow_.217f6InGF4UFMkr8h0HEIryjUm5mIAU_0 2024-09-12T02:06:44.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12382822612089637323', time=2024-09-12T03:39:45.868498+0000, chain.objs.size()=1 2024-09-12T02:06:44.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:L62YoIjMJKs0RnR9UcDlnawndHYRXNf_.d5zJ8jpnTyPwgOK7fphbuKTKaaGbL9e_0 2024-09-12T02:06:44.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5339773979347053224', time=2024-09-12T03:39:54.466821+0000, chain.objs.size()=1 2024-09-12T02:06:44.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:Hvc5JH18AqFzLNaQxaPXZR07ZdBR3Ap_.DESl7ehe_DDmfnrLx4gDAnBAc7o4YGa_0 2024-09-12T02:06:44.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9957661495895556965', time=2024-09-12T03:42:36.858426+0000, chain.objs.size()=1 2024-09-12T02:06:44.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.580__shadow:XNmkNLpp6nt8pfM.5PmHGMt-yOPm8RM_.IT53G93vfF2F9S75aAkil89tWC5FSDH_0 2024-09-12T02:06:44.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10193453251016092868', time=2024-09-12T03:42:42.745857+0000, chain.objs.size()=1 2024-09-12T02:06:44.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.581__shadow:W1gw7KSJb0ym1nSssR.icJZD04Kf0JX_.cnCnDlyoTVbPSGJhhaFPkVWom_WMjuU_0 2024-09-12T02:06:44.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18082772792582856872', time=2024-09-12T03:50:53.649209+0000, chain.objs.size()=1 2024-09-12T02:06:44.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.641__shadow_.6oxtjLz2WZbGBJ6LLObLZE2192SsPYI_0 2024-09-12T02:06:44.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17090615020358436326', time=2024-09-12T03:53:11.481632+0000, chain.objs.size()=1 2024-09-12T02:06:44.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.666__shadow_.kB8n1cKmJT8ArxMkYw5x6slkC9VxVOd_0 2024-09-12T02:06:44.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12517636181463356026', time=2024-09-12T03:54:44.676457+0000, chain.objs.size()=1 2024-09-12T02:06:44.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.710__shadow_.5q_gbeEPOOpsjN-cR9KAq4zpGw9BYHO_0 2024-09-12T02:06:44.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18023345875838523076', time=2024-09-12T03:57:49.125944+0000, chain.objs.size()=1 2024-09-12T02:06:44.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.746__shadow_.HsKVlprddafJjOpTqN6qYHEjE_sxw5b_0 2024-09-12T02:06:44.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:44.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T02:06:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44430' 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_wQiSPMrET0yrDjBxPlwxtiJfTutSDPd', time=2024-09-12T03:03:38.189473+0000, chain.objs.size()=1 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.aiuxO521Er-V7NRCQjEOBP65dciZZlQ_0 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8991264947979347059', time=2024-09-12T03:04:06.899472+0000, chain.objs.size()=5 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__multipart_foo-STANDARD.2~Gx3XuFvcEdmL8LmXGvnQOCPVhtJT6k6.1 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_foo-STANDARD.2~Gx3XuFvcEdmL8LmXGvnQOCPVhtJT6k6.1_1 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__multipart_foo-STANDARD.2~Gx3XuFvcEdmL8LmXGvnQOCPVhtJT6k6.2 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_foo-STANDARD.2~Gx3XuFvcEdmL8LmXGvnQOCPVhtJT6k6.2_1 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__multipart_foo-STANDARD.2~Gx3XuFvcEdmL8LmXGvnQOCPVhtJT6k6.3 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8252181900704741185', time=2024-09-12T03:10:35.255264+0000, chain.objs.size()=1 2024-09-12T02:06:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.235__shadow_.xCRywWD3hm-FASWtgDi8xSc_37aqUuu_0 2024-09-12T02:06:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.279991828491950681', time=2024-09-12T03:11:12.057795+0000, chain.objs.size()=1 2024-09-12T02:06:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.247__shadow_.SCwuHL0hC5h05T7tPw5rs8nF1sYDuZF_0 2024-09-12T02:06:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10356717318712990371', time=2024-09-12T03:13:33.988197+0000, chain.objs.size()=1 2024-09-12T02:06:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mcGh3KpuM6DgQF5TLB5AKABcDW5VziD_0 2024-09-12T02:06:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3910152014428356222', time=2024-09-12T03:13:34.429388+0000, chain.objs.size()=1 2024-09-12T02:06:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vyqcWbewhyE0CkW8eq5kDvBY_nY8Hpu_0 2024-09-12T02:06:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14156365801759637034', time=2024-09-12T03:13:36.259698+0000, chain.objs.size()=1 2024-09-12T02:06:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ICx1Z_mnANCC5dON_-tUKBdV2NLQxgs_0 2024-09-12T02:06:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1726183627731928346', time=2024-09-12T03:13:36.639228+0000, chain.objs.size()=1 2024-09-12T02:06:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8wZgRS8ozYYeVLc_FYv9XKK69_jGiEh_0 2024-09-12T02:06:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3562269501751195811', time=2024-09-12T03:13:40.258160+0000, chain.objs.size()=1 2024-09-12T02:06:44.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.15LNmfvkCXa1SPtdgOOC2sgR_UH7Ys6_0 2024-09-12T02:06:44.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7310522464195678951', time=2024-09-12T03:13:40.784347+0000, chain.objs.size()=1 2024-09-12T02:06:44.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rUfXRTxwKYmrrbn3q79s0I5Spyz4cYH_0 2024-09-12T02:06:44.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12287361432316929551', time=2024-09-12T03:13:41.402468+0000, chain.objs.size()=1 2024-09-12T02:06:44.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.NKYUkluUcD6Z-R-d6wwAHkJokRkUeAL_0 2024-09-12T02:06:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16259859488773073225', time=2024-09-12T03:13:42.963911+0000, chain.objs.size()=1 2024-09-12T02:06:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.FzR3Aa9OtnrQvXovExv8Z7lL_SD70OH_0 2024-09-12T02:06:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14033236623436380467', time=2024-09-12T03:13:45.528295+0000, chain.objs.size()=1 2024-09-12T02:06:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Ppj_K33D7F368LvNud-Uh0WqB1fxE3d_0 2024-09-12T02:06:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2027875462967669323', time=2024-09-12T03:13:45.530474+0000, chain.objs.size()=1 2024-09-12T02:06:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cJ-81vmYj-tAYpFG71nRGgNOQrwwHny_0 2024-09-12T02:06:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15123475860996390707', time=2024-09-12T03:13:48.793159+0000, chain.objs.size()=1 2024-09-12T02:06:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vloqNsMF8h65kHWJuavqKvQzH1vgNTN_0 2024-09-12T02:06:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1461188149241792546', time=2024-09-12T03:13:49.636136+0000, chain.objs.size()=1 2024-09-12T02:06:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.WKN0WIkQkykLCcOGTgQTRzkxPIqdxYl_0 2024-09-12T02:06:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16036944092681987073', time=2024-09-12T03:13:49.841148+0000, chain.objs.size()=1 2024-09-12T02:06:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.R6RNdrP-_1RxyJZ1OOpBznk4LJOqXPG_0 2024-09-12T02:06:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10246258096708127560', time=2024-09-12T03:13:51.271797+0000, chain.objs.size()=1 2024-09-12T02:06:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cZrbBfcJb6jvV4IOJY52I7GRWJxMOC5_0 2024-09-12T02:06:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.807865837508066276', time=2024-09-12T03:13:55.218792+0000, chain.objs.size()=1 2024-09-12T02:06:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.XCA5ignT_0sq5qFp6fb3LvI3N-Vr-fW_0 2024-09-12T02:06:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3570433078693748687', time=2024-09-12T03:13:57.160150+0000, chain.objs.size()=1 2024-09-12T02:06:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.O0ilVatKqRz8246b92f3FEs8UGdLvsW_0 2024-09-12T02:06:44.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.614+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14289290234312254878', time=2024-09-12T03:13:57.724399+0000, chain.objs.size()=1 2024-09-12T02:06:44.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.614+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6GZpLxIcQ3oaxhX2Ks1XTkSMjo3jgA__0 2024-09-12T02:06:44.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.908684635771245010', time=2024-09-12T03:14:00.140192+0000, chain.objs.size()=1 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CzYnRjc9wtcZySanZ08lne6YWQhbOXl_0 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2944778913688119275', time=2024-09-12T03:14:00.173833+0000, chain.objs.size()=1 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.V6yz1IyIat8d5-ugDzscfVaMzRyd_E3_0 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15381518589871973104', time=2024-09-12T03:14:00.388740+0000, chain.objs.size()=1 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.b4j5Qspo0-MWqxcGsqrSOSevtcr-WA1_0 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13137848990493350647', time=2024-09-12T03:14:01.037490+0000, chain.objs.size()=1 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.s0ZtXflHLwy3opHrCMyVCDeF7AeM511_0 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.551608555541712086', time=2024-09-12T03:14:04.055013+0000, chain.objs.size()=1 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jyM-1-eifonuajZHUXXMxqrWcAn8Ec5_0 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18175112241141872704', time=2024-09-12T03:14:05.006428+0000, chain.objs.size()=1 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.08X4-dqbshOnX0j1u84haF5tbcM1DIz_0 2024-09-12T02:06:44.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14423207374719327826', time=2024-09-12T03:14:07.858043+0000, chain.objs.size()=1 2024-09-12T02:06:44.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.264__shadow_.sHA2IfrB9WO5crZxRaJwXeMvE17CUMv_0 2024-09-12T02:06:44.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.672135001970789553', time=2024-09-12T03:14:10.232823+0000, chain.objs.size()=1 2024-09-12T02:06:44.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.265__shadow_.7nt9HPT-PCUUNItb9XHMcKXE2Bo-zNE_0 2024-09-12T02:06:44.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18011108172706326872', time=2024-09-12T03:14:15.041401+0000, chain.objs.size()=1 2024-09-12T02:06:44.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.267__shadow_.LjGtwK68jYz4omf2gnxnsQWHPDcMp05_0 2024-09-12T02:06:44.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12999311859346437695', time=2024-09-12T03:14:56.852493+0000, chain.objs.size()=1 2024-09-12T02:06:44.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.284__shadow_.hnu-o9bH2TF9UPAgMZq0GJkf6CWoN_1_0 2024-09-12T02:06:44.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2329323035059367915', time=2024-09-12T03:15:09.597175+0000, chain.objs.size()=1 2024-09-12T02:06:44.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.289__shadow_.lgaZhKRodbQ6yaWbfTHQM9bRhf4MCnY_0 2024-09-12T02:06:44.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.622+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4800283244872265876', time=2024-09-12T03:15:14.614216+0000, chain.objs.size()=1 2024-09-12T02:06:44.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.622+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.291__shadow_.okk19x83w2GVY9suGsbQqldgbNR-ouK_0 2024-09-12T02:06:44.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.622+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1902135413723499980', time=2024-09-12T03:15:23.445208+0000, chain.objs.size()=1 2024-09-12T02:06:44.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.622+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.ucGdBeAdjZod6Ls5G3Gem2_5NIjQO52_0 2024-09-12T02:06:44.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.622+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17993116014474899418', time=2024-09-12T03:15:23.697754+0000, chain.objs.size()=1 2024-09-12T02:06:44.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.622+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.wuVemdGv9EtLCCQ5LGvbmx01eCenJI5_0 2024-09-12T02:06:44.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3703992821337897498', time=2024-09-12T03:15:47.641392+0000, chain.objs.size()=1 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.301__shadow_.cpC2SPmydw24_mOw4axXvhp0ln3rTeg_0 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10369448145931741218', time=2024-09-12T03:15:57.624370+0000, chain.objs.size()=1 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.305__shadow_.-yfkXfo9K0uAvUyuk3jTPPfy3WDEHS2_0 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18418854470292492128', time=2024-09-12T03:16:46.899076+0000, chain.objs.size()=1 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.322__shadow_.ANtPcayBWkWDCP9CcJuMol0RoEvBsyo_0 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16835016619448618843', time=2024-09-12T03:18:36.824138+0000, chain.objs.size()=1 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.0lycjPVK9vXIHGBKyLx9cFU5M2S2hdo_0 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14942227469149735100', time=2024-09-12T03:18:38.189658+0000, chain.objs.size()=1 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.g7FPLag15K9KCvqJvWAdw-BNk2Uip7n_0 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9400559741569757409', time=2024-09-12T03:18:40.722322+0000, chain.objs.size()=1 2024-09-12T02:06:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wc03PgpX4CFahIggcrI8ZEQXfuQehWp_0 2024-09-12T02:06:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12234935674142377490', time=2024-09-12T03:18:40.724813+0000, chain.objs.size()=1 2024-09-12T02:06:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.1owAwSrONRn_2FL4shbxsLTvB-qwZXv_0 2024-09-12T02:06:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15584852529218796515', time=2024-09-12T03:18:41.096424+0000, chain.objs.size()=1 2024-09-12T02:06:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.dDHkxft5vO4u-DwbNdgruxm8euIq7wy_0 2024-09-12T02:06:44.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6690119964303170387', time=2024-09-12T03:18:41.098157+0000, chain.objs.size()=1 2024-09-12T02:06:44.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2ArdYZDOcLHTEMOhPE0lKca3jxR3Gz3_0 2024-09-12T02:06:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6066147659374918274', time=2024-09-12T03:18:41.312102+0000, chain.objs.size()=1 2024-09-12T02:06:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.EFrM_bKxHq9RYG0nnRtmLGXCarImift_0 2024-09-12T02:06:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10490941347672316090', time=2024-09-12T03:18:46.018454+0000, chain.objs.size()=1 2024-09-12T02:06:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.lhVHwS6zxFG_VtHdF0XYYhshCGMJRcY_0 2024-09-12T02:06:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9658161824827371930', time=2024-09-12T03:18:48.006683+0000, chain.objs.size()=1 2024-09-12T02:06:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.N-77F9D8ZYqH8P-Pb6lf_hw1p9Jb0jn_0 2024-09-12T02:06:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12319210118177133599', time=2024-09-12T03:18:49.201827+0000, chain.objs.size()=1 2024-09-12T02:06:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hpoptxY4koCtCAG2wHzxFbOwcdVVgkW_0 2024-09-12T02:06:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14968370338648484701', time=2024-09-12T03:18:49.252213+0000, chain.objs.size()=1 2024-09-12T02:06:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qitMVkLx7IybOKdBSQxPnSDx_ocUAV-_0 2024-09-12T02:06:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7168884497014481749', time=2024-09-12T03:18:51.551500+0000, chain.objs.size()=1 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.630+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Mu9ApMztBNW6kc4w43Xu_xgUQL2CUzx_0 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16860570092415505811', time=2024-09-12T03:18:52.441010+0000, chain.objs.size()=1 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Ar3fXF2vQpG7W7Xv2eAoX6dhneIgdkm_0 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1537759040996068333', time=2024-09-12T03:18:53.434166+0000, chain.objs.size()=1 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._oxM1FhKtiboAudsVR3XpdkN-1Rio1D_0 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.789707471331578434', time=2024-09-12T03:18:54.943923+0000, chain.objs.size()=1 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.A74bT-CcJifQU7b0cXfApov95Agk7rr_0 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3220136178502139088', time=2024-09-12T03:18:55.072401+0000, chain.objs.size()=1 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6xqYFBPYBUCjeCeXuMUvitQBHEv20bt_0 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18032998654150313262', time=2024-09-12T03:18:55.565471+0000, chain.objs.size()=1 2024-09-12T02:06:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.N-2-MHjyiAtUk8kStLMtuHoWGHcWzpw_0 2024-09-12T02:06:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13166199765337976680', time=2024-09-12T03:18:56.278674+0000, chain.objs.size()=1 2024-09-12T02:06:44.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.kNK9cNMh4ckM_GmPitoDDNmUlyW8Z90_0 2024-09-12T02:06:44.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16418048323551567001', time=2024-09-12T03:18:57.390165+0000, chain.objs.size()=1 2024-09-12T02:06:44.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AwhtlPCN6wdWfrj50L_V3ptLYRrOyvD_0 2024-09-12T02:06:44.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6148209580937824001', time=2024-09-12T03:18:57.998910+0000, chain.objs.size()=1 2024-09-12T02:06:44.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.WhV-2w7JHD_D30It8_Q9R8fPrCWpkYk_0 2024-09-12T02:06:44.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15238329491703491784', time=2024-09-12T03:18:59.677685+0000, chain.objs.size()=1 2024-09-12T02:06:44.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.esTusDqvzJS3eqIY32PCuvZxg8YASJ1_0 2024-09-12T02:06:44.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7524020619824676763', time=2024-09-12T03:19:00.083755+0000, chain.objs.size()=1 2024-09-12T02:06:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OZ-tALD_YQdm7qNgt1uEgR94r5IicXj_0 2024-09-12T02:06:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12678383007111607906', time=2024-09-12T03:19:00.179781+0000, chain.objs.size()=1 2024-09-12T02:06:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6m5zUOB4JR0qygMUVHr1AvLIAnaHBgf_0 2024-09-12T02:06:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14207151271170597776', time=2024-09-12T03:19:00.286852+0000, chain.objs.size()=1 2024-09-12T02:06:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.r-nOQn5_JrV3vdy9_hbJzs1XbPlOQDr_0 2024-09-12T02:06:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11510730632414605767', time=2024-09-12T03:19:00.289161+0000, chain.objs.size()=1 2024-09-12T02:06:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yY7fPLdDBFohZHxVgVG8M-8xqRfOPjG_0 2024-09-12T02:06:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3572795634137247461', time=2024-09-12T03:19:01.373327+0000, chain.objs.size()=1 2024-09-12T02:06:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4DPYhy8RaZKGdl3yINdRqn4bLJ_Hz3K_0 2024-09-12T02:06:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11587607895173525152', time=2024-09-12T03:19:03.209551+0000, chain.objs.size()=1 2024-09-12T02:06:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.dpXWt2BZtBwsTsklrBh3qCPoCSpFsW1_0 2024-09-12T02:06:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17621703721587870131', time=2024-09-12T03:19:03.839916+0000, chain.objs.size()=1 2024-09-12T02:06:44.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-_gZucDAKP4vzvsm4QQ79vOxN420cz5_0 2024-09-12T02:06:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4647822126664829435', time=2024-09-12T03:19:03.933671+0000, chain.objs.size()=1 2024-09-12T02:06:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.R5rWu3iu6MFfErlfYSgEj_RC5nyn5Zs_0 2024-09-12T02:06:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14049119045010139478', time=2024-09-12T03:19:05.279358+0000, chain.objs.size()=1 2024-09-12T02:06:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.dbIIPCFYJzzxT5ScJOgc8bpaP9NjzdZ_0 2024-09-12T02:06:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1493947826269214142', time=2024-09-12T03:19:07.211567+0000, chain.objs.size()=1 2024-09-12T02:06:44.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.nopV-X1UNJsHiqDqEjzmQ3SaQ1nFBvm_0 2024-09-12T02:06:44.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8659714708828355546', time=2024-09-12T03:19:07.505925+0000, chain.objs.size()=1 2024-09-12T02:06:44.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.IUT5A3_fzSRX3gRCv6g2F9EbRdUfrXF_0 2024-09-12T02:06:44.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10133437154637442192', time=2024-09-12T03:20:54.340494+0000, chain.objs.size()=1 2024-09-12T02:06:44.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fvH7PkqpMPsXK6L7DeBJKpiDQcIe1CU_0 2024-09-12T02:06:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7671865020082963572', time=2024-09-12T03:20:54.947504+0000, chain.objs.size()=1 2024-09-12T02:06:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.t8VDtGb9kzQX-uddeO55hPyPaTSTzpr_0 2024-09-12T02:06:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8991223844820659833', time=2024-09-12T03:20:55.855035+0000, chain.objs.size()=1 2024-09-12T02:06:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.FWCvBRqG5nApR5KawYDsklY47ZADv9i_0 2024-09-12T02:06:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.964343215357939507', time=2024-09-12T03:20:56.694516+0000, chain.objs.size()=1 2024-09-12T02:06:44.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zmTR3ldRf2FnwmF5KapouzaXm5pmxZa_0 2024-09-12T02:06:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3086293369528245829', time=2024-09-12T03:20:58.881969+0000, chain.objs.size()=1 2024-09-12T02:06:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.LYCZfrgURE-A9DilSGJ3NjyNpMjsuD4_0 2024-09-12T02:06:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6239658048738843339', time=2024-09-12T03:21:00.058647+0000, chain.objs.size()=1 2024-09-12T02:06:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xN_SwzMPz85WCP0jBtcWgqaQ-_Sl0nO_0 2024-09-12T02:06:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15789585674633339753', time=2024-09-12T03:21:00.582989+0000, chain.objs.size()=1 2024-09-12T02:06:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.646+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.OEakbwAgwZxIQ_EVD6bX_XVl2jk8E9x_0 2024-09-12T02:06:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.643220377259689775', time=2024-09-12T03:21:01.060398+0000, chain.objs.size()=1 2024-09-12T02:06:44.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.KSbQjwyDmG3jtxMF2U6jI8EMpY8Oznc_0 2024-09-12T02:06:44.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14284616976971178662', time=2024-09-12T03:21:01.735350+0000, chain.objs.size()=1 2024-09-12T02:06:44.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4OFNzJZf04igIjBZLsBxY20caJNxY2M_0 2024-09-12T02:06:44.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6766688019209347761', time=2024-09-12T03:21:01.736771+0000, chain.objs.size()=1 2024-09-12T02:06:44.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YxL_EwGhqjJG-DV6ry6XD6xK9nQ4h9x_0 2024-09-12T02:06:44.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3009011498356460361', time=2024-09-12T03:21:05.090655+0000, chain.objs.size()=1 2024-09-12T02:06:44.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Y8IdcYCjRK_U11CSZk64lIuNUD09g6C_0 2024-09-12T02:06:44.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5980027578288220468', time=2024-09-12T03:21:05.178887+0000, chain.objs.size()=1 2024-09-12T02:06:44.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.uQmdfLQfo43ES4_XLZbidEmABtkqkHx_0 2024-09-12T02:06:44.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2771801430856640678', time=2024-09-12T03:21:05.983383+0000, chain.objs.size()=1 2024-09-12T02:06:44.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5dSUX21tTnJ780Vr86cq5e7w6iz2iKo_0 2024-09-12T02:06:44.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8842985122676676811', time=2024-09-12T03:21:06.056872+0000, chain.objs.size()=1 2024-09-12T02:06:44.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.TMTGtwUUdfqURhWLW_3SIGNtMH2FGSP_0 2024-09-12T02:06:44.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5292411911275953209', time=2024-09-12T03:21:07.082856+0000, chain.objs.size()=1 2024-09-12T02:06:44.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.B1u_OTCxhkoWLT2EDhjoJ023uvrpd39_0 2024-09-12T02:06:44.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4855836706459269670', time=2024-09-12T03:21:07.203723+0000, chain.objs.size()=1 2024-09-12T02:06:44.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yaLwwGj-uULMqz56vDy5Omi2I0n5Z0L_0 2024-09-12T02:06:44.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5471597422777341186', time=2024-09-12T03:21:07.884536+0000, chain.objs.size()=1 2024-09-12T02:06:44.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.HfJtW0J8r5tQh0cePIkvpW-dNbt6K8M_0 2024-09-12T02:06:44.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2903171794641337894', time=2024-09-12T03:21:08.180411+0000, chain.objs.size()=1 2024-09-12T02:06:44.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ajJOo0LSKIqO8hm_LUPXb5I2XgpOeGZ_0 2024-09-12T02:06:44.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7079248276928360864', time=2024-09-12T03:21:08.695395+0000, chain.objs.size()=1 2024-09-12T02:06:44.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.LQERypVSQ2BJyYBNNCYoGHwC9Tb5Pl7_0 2024-09-12T02:06:44.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6274310687285689393', time=2024-09-12T03:21:11.181587+0000, chain.objs.size()=1 2024-09-12T02:06:44.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.byV_49EVrCNvl1ru_s_ZcXefrX5PNpB_0 2024-09-12T02:06:44.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11333308130737713053', time=2024-09-12T03:21:11.561925+0000, chain.objs.size()=1 2024-09-12T02:06:44.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IrIPNQucQ1CRR5uCL2_9S3MybhzOdsw_0 2024-09-12T02:06:44.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7132853270551748315', time=2024-09-12T03:21:12.072976+0000, chain.objs.size()=1 2024-09-12T02:06:44.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pWzJ2HUW94czWW0XVIdAVDABFKua7Y7_0 2024-09-12T02:06:44.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14478737473648903433', time=2024-09-12T03:21:14.014510+0000, chain.objs.size()=1 2024-09-12T02:06:44.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.mot7EGEWr4_wIliqGVUj5dTSRxyroR7_0 2024-09-12T02:06:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11261546808915767657', time=2024-09-12T03:21:14.089002+0000, chain.objs.size()=1 2024-09-12T02:06:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.WR6cT1KL6nxnZXL4T413RIbiZiEi5GG_0 2024-09-12T02:06:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15610354994754907021', time=2024-09-12T03:21:16.612244+0000, chain.objs.size()=1 2024-09-12T02:06:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.R2VHMhPmLlkkIdf-t6hnITxyvKPqzI-_0 2024-09-12T02:06:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.922371034119134038', time=2024-09-12T03:21:17.892997+0000, chain.objs.size()=1 2024-09-12T02:06:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pcLqQ0Axlup1nWx6OdAKnF13OJHdkXg_0 2024-09-12T02:06:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17469696879183793563', time=2024-09-12T03:21:18.426198+0000, chain.objs.size()=1 2024-09-12T02:06:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Jmnrv_sBSB0zKMIjUHI5VdJNWDuz9Ij_0 2024-09-12T02:06:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3760505021617207648', time=2024-09-12T03:21:18.456748+0000, chain.objs.size()=1 2024-09-12T02:06:44.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CL71NJRR1Izt4APMyJtpN2YAy2j5HqX_0 2024-09-12T02:06:44.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10297280763986623511', time=2024-09-12T03:21:22.014167+0000, chain.objs.size()=1 2024-09-12T02:06:44.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Tmb31HTXypje-obQcU46JsxGMDRLp8t_0 2024-09-12T02:06:44.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5893926433860534022', time=2024-09-12T03:21:23.615279+0000, chain.objs.size()=1 2024-09-12T02:06:44.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lf15tnHjxvXkUFnVpGUGL5TtX1oB-yQ_0 2024-09-12T02:06:44.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44430 2024-09-12T02:06:44.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T02:06:44.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18060697389874862652', time=2024-09-12T03:21:24.041619+0000, chain.objs.size()=1 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kxYLXHPqFq3S0Y-DE3EmU36VLIL9zTt_0 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9701576993225649343', time=2024-09-12T03:21:31.949427+0000, chain.objs.size()=1 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.328__shadow_.pVvh_cTM2hMQBoY3ooPMZYoWS3ivumH_0 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10698980258646888815', time=2024-09-12T03:23:15.111175+0000, chain.objs.size()=1 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.377__shadow_.6K8V3B20IU8imSgez1EZEwTIUkxCqpL_0 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3914390052885092487', time=2024-09-12T03:26:27.529383+0000, chain.objs.size()=1 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.459__shadow_.IL7Ktgbzp94L10yytyr0TAY9xo_atil_0 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2343863086312379391', time=2024-09-12T03:26:43.674962+0000, chain.objs.size()=1 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.464__shadow_.-3RmkBfGlHqyMU2VSYkgIerdEYP2rmR_0 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4571777868594160096', time=2024-09-12T03:27:21.935376+0000, chain.objs.size()=1 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.TX6osToJok7krI5n-qeSuf0046pT4Tw_0 2024-09-12T02:06:44.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.755733595400446155', time=2024-09-12T03:27:21.937246+0000, chain.objs.size()=1 2024-09-12T02:06:44.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.cxFRpbYEA3cSFtzx7RIR2ykv2jfjdmj_0 2024-09-12T02:06:44.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5689228365718390086', time=2024-09-12T03:28:54.744917+0000, chain.objs.size()=6 2024-09-12T02:06:44.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.1 2024-09-12T02:06:44.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.2 2024-09-12T02:06:44.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.3 2024-09-12T02:06:44.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.4 2024-09-12T02:06:44.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.5 2024-09-12T02:06:44.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.6 2024-09-12T02:06:44.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12241776547573331405', time=2024-09-12T03:37:56.433733+0000, chain.objs.size()=1 2024-09-12T02:06:44.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.552__shadow_.BT51vn9hf0cbg02MBfQKJqVIrSjQT9W_0 2024-09-12T02:06:44.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6900194437269764935', time=2024-09-12T03:38:24.047289+0000, chain.objs.size()=2 2024-09-12T02:06:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.555__shadow_.anBaqtmBZrkJNvjCq2b6bvuaFGDvt73_0 2024-09-12T02:06:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.555__shadow_.anBaqtmBZrkJNvjCq2b6bvuaFGDvt73_1 2024-09-12T02:06:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4775756397381988694', time=2024-09-12T03:39:49.658659+0000, chain.objs.size()=1 2024-09-12T02:06:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:FjvjCe17usG3WqqHzF.kxb6k.vz0Rkl_.P2AKOJGgi42Blg2gk8FNdJ5Vdpq-O1C_0 2024-09-12T02:06:44.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16658052675690989284', time=2024-09-12T03:40:11.484513+0000, chain.objs.size()=1 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.571__shadow:s5U1u5r-3GRVUJG.o5xUJhy2fj6RWKK_.qZqBHs2LmXKHdCcrbHpjumet0VnDR1e_0 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17694555713792435132', time=2024-09-12T03:41:32.186624+0000, chain.objs.size()=1 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:qJnkB2LS1tQBMdLPWQADv6d2DnvXqRI_.uSEb5xzcT2tTvtVc_hGN-6cR4-9iHmM_0 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17189631354918797281', time=2024-09-12T03:42:42.611302+0000, chain.objs.size()=1 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.581__shadow:ahl-Sh7UMAZs6toUBVafFBTwISYwRLE_.JvzBXACETZuZtkAswF_SWrNig7M6aXr_0 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12009746794484081645', time=2024-09-12T03:42:48.960758+0000, chain.objs.size()=1 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.584__shadow:tLSRsgSe.Qw-la.PGqxT3.HtER8cSuM_.Wmj4i96kEcHKg47hiw3kV9inIpa_iHR_0 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13440019995357685867', time=2024-09-12T03:43:23.803259+0000, chain.objs.size()=1 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.597__shadow_.xVM1BkVAOawP7hTjLAOkB2kNLUlPBy0_0 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9408832656350374327', time=2024-09-12T03:50:19.970582+0000, chain.objs.size()=1 2024-09-12T02:06:44.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.627__shadow_.YIoZTm-8G6IHNCH4-S7Vyc0eqEjXIdZ_0 2024-09-12T02:06:44.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6953455940343161877', time=2024-09-12T03:51:38.214909+0000, chain.objs.size()=1 2024-09-12T02:06:44.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.650__shadow_.6WzBcQ1hStbB-xqKPfk9BgOfBEeC8Tx_0 2024-09-12T02:06:44.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:44.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T02:06:44.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:44.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45165' 2024-09-12T02:06:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10869653814944719185', time=2024-09-12T03:05:23.791905+0000, chain.objs.size()=1 2024-09-12T02:06:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.177__shadow_.2tYosm5jd7D9ckZuu-lJZ-8JUHfOxFv_0 2024-09-12T02:06:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14142279184489807855', time=2024-09-12T03:13:33.978160+0000, chain.objs.size()=1 2024-09-12T02:06:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-2N6AQQO46G--qpwEEXosJcgIF6zT7l_0 2024-09-12T02:06:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2534851129306650393', time=2024-09-12T03:13:34.346107+0000, chain.objs.size()=1 2024-09-12T02:06:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0jCID652Gp8qXjT56kRGq7EA7f79fYz_0 2024-09-12T02:06:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8328685212767261515', time=2024-09-12T03:13:34.831949+0000, chain.objs.size()=1 2024-09-12T02:06:44.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.YW1Zi2EJiClyu8Yz02cApq9quLnWlQc_0 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3558572912583691242', time=2024-09-12T03:13:35.143369+0000, chain.objs.size()=1 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.80yJua8VEyV85fGRjBf5GExNvvZffgD_0 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.337921802127914102', time=2024-09-12T03:13:36.643892+0000, chain.objs.size()=1 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3H_DI5Nhn1ycocK4-aY4ZZqqRDMexqF_0 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14078526377192706017', time=2024-09-12T03:13:36.821508+0000, chain.objs.size()=1 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5hhK2APaq3q8LKA4CGjY3QIpES0zJhr_0 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3148968584720486832', time=2024-09-12T03:13:38.669809+0000, chain.objs.size()=1 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.TG5iwLTHn-V39MayMlB2_V8bifcK5cK_0 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11757014327418980654', time=2024-09-12T03:13:41.080228+0000, chain.objs.size()=1 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xT3mA1PHHzzenfIBnMiqYkwCfWIcLHQ_0 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.448614126716948251', time=2024-09-12T03:13:41.500139+0000, chain.objs.size()=1 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.MCcFJ5TWWGTNRsKxUek-m6umkm_5DX2_0 2024-09-12T02:06:44.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14272918118210164665', time=2024-09-12T03:13:42.590155+0000, chain.objs.size()=1 2024-09-12T02:06:44.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.58hQ-WtWY2r27zhMrZUy8MuoLDHlNZB_0 2024-09-12T02:06:44.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3187101243456636958', time=2024-09-12T03:13:43.452248+0000, chain.objs.size()=1 2024-09-12T02:06:44.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rA1aOJtPpiPN3mY2yx5c_ehPRpmSfjv_0 2024-09-12T02:06:44.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15584142980036571726', time=2024-09-12T03:13:44.691683+0000, chain.objs.size()=1 2024-09-12T02:06:44.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-pZgf5uWvcXbV3s1OIXFUwNzdMbP3OP_0 2024-09-12T02:06:44.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4349090610066214752', time=2024-09-12T03:13:44.927775+0000, chain.objs.size()=1 2024-09-12T02:06:44.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.7AT8kIG9eEJNg0F37f0SkPcblaXzW4O_0 2024-09-12T02:06:44.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.927924794563496561', time=2024-09-12T03:13:45.127218+0000, chain.objs.size()=1 2024-09-12T02:06:44.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Z_9xNr4U3V7W-RqJusAx6pC_fhoUiis_0 2024-09-12T02:06:44.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12810389494890524582', time=2024-09-12T03:13:46.762464+0000, chain.objs.size()=1 2024-09-12T02:06:44.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0zxDdQgGAkwgTyMlp7QdPhzVZ1XzOtu_0 2024-09-12T02:06:44.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1872735655775031172', time=2024-09-12T03:13:46.764260+0000, chain.objs.size()=1 2024-09-12T02:06:44.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CSH_09CdaPM_tINFcB6aXBt0ZT6jp_K_0 2024-09-12T02:06:44.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13814985119436878191', time=2024-09-12T03:13:47.694507+0000, chain.objs.size()=1 2024-09-12T02:06:44.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.bDzUTplal8jIz7r-ZCOCAlYbRp9nv_s_0 2024-09-12T02:06:44.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6200428929958835514', time=2024-09-12T03:13:47.767114+0000, chain.objs.size()=1 2024-09-12T02:06:44.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9zaZP46O5SAFm0Wxhc5i0FA1xIXiInP_0 2024-09-12T02:06:44.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2945258250821748852', time=2024-09-12T03:13:48.141875+0000, chain.objs.size()=1 2024-09-12T02:06:44.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.J3eImDpebf385CVj3UePzNPQjMXcsek_0 2024-09-12T02:06:44.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4307477759340741120', time=2024-09-12T03:13:48.965305+0000, chain.objs.size()=1 2024-09-12T02:06:44.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4WdrKOWuzO7HDLzyUeZv-cXDOyKPy47_0 2024-09-12T02:06:44.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.110405467921023768', time=2024-09-12T03:13:49.057063+0000, chain.objs.size()=1 2024-09-12T02:06:44.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5iQfa3f9mgwhPqt_IYkUdK_NROPcgdd_0 2024-09-12T02:06:44.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2434750684977536942', time=2024-09-12T03:13:49.181753+0000, chain.objs.size()=1 2024-09-12T02:06:44.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JL0FfYDhkPseOs8NHWfTATD71h6RlnD_0 2024-09-12T02:06:44.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12906661744781872265', time=2024-09-12T03:13:50.927720+0000, chain.objs.size()=1 2024-09-12T02:06:44.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.BDEM21qk2OkqPLhnReuysMzlARptPw1_0 2024-09-12T02:06:44.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8800260798731661751', time=2024-09-12T03:13:51.291893+0000, chain.objs.size()=1 2024-09-12T02:06:44.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JZiYD4yqAQl0xKQ5RzAZJptpYQN3M-D_0 2024-09-12T02:06:44.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16974196845376221693', time=2024-09-12T03:13:52.541025+0000, chain.objs.size()=1 2024-09-12T02:06:44.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.StKA2LzGMWBcOEQBKDT70FpzBW1HwId_0 2024-09-12T02:06:44.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5496641755599311843', time=2024-09-12T03:13:52.917370+0000, chain.objs.size()=1 2024-09-12T02:06:44.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-vVMTrhC-Et5PjRmnFThSokslXXgT6N_0 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8789523889176131345', time=2024-09-12T03:13:53.804220+0000, chain.objs.size()=1 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1IQco3ZbbiyhvbGdpJOJhXXXvs7M1vP_0 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5830914033179649324', time=2024-09-12T03:13:53.885464+0000, chain.objs.size()=1 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hlALpYnRXlVfWdv4tVNitmtsxL0lYWh_0 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2918859233911449964', time=2024-09-12T03:13:56.059041+0000, chain.objs.size()=1 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.IFZSM1GAW1Xoeo2hv5q942iNFlHqCEg_0 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10530371375857221136', time=2024-09-12T03:13:56.160910+0000, chain.objs.size()=1 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Cd1AZ6sxzZP6AGRcGIOMrAUyZroLlTs_0 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18421599115459123633', time=2024-09-12T03:13:56.631549+0000, chain.objs.size()=1 2024-09-12T02:06:44.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.YPpTzAsKWBfeoaqw6bgwO7vuHqI2V1a_0 2024-09-12T02:06:44.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.714+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7053979264018995535', time=2024-09-12T03:13:57.049542+0000, chain.objs.size()=1 2024-09-12T02:06:44.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.714+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.yRMTfdoFQIQRZ3ZtfWiE78SZej73_Ei_0 2024-09-12T02:06:44.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.714+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10885300194006169895', time=2024-09-12T03:13:57.050937+0000, chain.objs.size()=1 2024-09-12T02:06:44.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.714+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DP8ZCvllrNBZNWEyLY36beaeEZ02Dxx_0 2024-09-12T02:06:44.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4835114177496738608', time=2024-09-12T03:13:57.052600+0000, chain.objs.size()=1 2024-09-12T02:06:44.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.lXX5TvpcRPY44VoMDLq6dUUqnBHMe8L_0 2024-09-12T02:06:44.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15614636505063330171', time=2024-09-12T03:13:59.288812+0000, chain.objs.size()=1 2024-09-12T02:06:44.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3d4d86EySOYe9jfagDgCtsnlbjfN2ZG_0 2024-09-12T02:06:44.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16533327326853414218', time=2024-09-12T03:13:59.444560+0000, chain.objs.size()=1 2024-09-12T02:06:44.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Omb6ziryAxG6GaAJrDalagPupt0RQvC_0 2024-09-12T02:06:44.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4496325472385890241', time=2024-09-12T03:13:59.760254+0000, chain.objs.size()=1 2024-09-12T02:06:44.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Nvf-rsahg-DZB9WAbRvR-Gqgg-M4jk5_0 2024-09-12T02:06:44.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7756057717365475783', time=2024-09-12T03:13:59.848725+0000, chain.objs.size()=1 2024-09-12T02:06:44.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.HvAASqsAUBOpQTmz6LZSi7ewzAUlx5C_0 2024-09-12T02:06:44.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6479902366873884748', time=2024-09-12T03:14:00.344071+0000, chain.objs.size()=1 2024-09-12T02:06:44.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DzP7T_7Kzk9tnA1S0YWewrockulIfHm_0 2024-09-12T02:06:44.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16434946547199669484', time=2024-09-12T03:14:01.224310+0000, chain.objs.size()=1 2024-09-12T02:06:44.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8kOhJ8qc4EAhPdX1jaRSfWKVSx9QSC5_0 2024-09-12T02:06:44.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18105036140235513552', time=2024-09-12T03:14:03.499770+0000, chain.objs.size()=1 2024-09-12T02:06:44.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.lIWqTtk4jsWbq9DtxR4NJB3pooOG4Li_0 2024-09-12T02:06:44.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11984620966167436897', time=2024-09-12T03:14:03.646450+0000, chain.objs.size()=1 2024-09-12T02:06:44.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KPrxuxcqgVh9Qv-OnAXZ0iTQ-6tmEjk_0 2024-09-12T02:06:44.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2702351622687443958', time=2024-09-12T03:14:04.030039+0000, chain.objs.size()=1 2024-09-12T02:06:44.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._fqqTAHXyLUW8Z9D0uPQiKU-rZ4jWMl_0 2024-09-12T02:06:44.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17242679967682269715', time=2024-09-12T03:14:05.439566+0000, chain.objs.size()=1 2024-09-12T02:06:44.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.WH_im_FArg1oqhCB4Ug5JJmZeVauUdn_0 2024-09-12T02:06:44.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.726+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16041217642206230952', time=2024-09-12T03:14:19.768543+0000, chain.objs.size()=1 2024-09-12T02:06:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.726+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.269__shadow_.-8yIJC8rfHej96zIDv7taeWX_dsKEYY_0 2024-09-12T02:06:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.726+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13280994110000054980', time=2024-09-12T03:14:22.215072+0000, chain.objs.size()=1 2024-09-12T02:06:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.726+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.270__shadow_.gd6DJr_FQiUJPoElVrhTyYwPfRATxUd_0 2024-09-12T02:06:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.726+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8154947817572951179', time=2024-09-12T03:14:49.206137+0000, chain.objs.size()=1 2024-09-12T02:06:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.726+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.281__shadow_.LQkS5x9Apj5AKeDDmEojcm-pUHf5cE2_0 2024-09-12T02:06:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.726+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15151709884831388942', time=2024-09-12T03:15:23.419558+0000, chain.objs.size()=1 2024-09-12T02:06:44.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.726+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.yq8Dq-yz9A89ljbwHWiUe3qD7y_DWzO_0 2024-09-12T02:06:44.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2016283672136757353', time=2024-09-12T03:15:23.769997+0000, chain.objs.size()=1 2024-09-12T02:06:44.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.ZIY27pF85I4cfVXyFKj7P1Btx0YGPiV_0 2024-09-12T02:06:44.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1547250900656380258', time=2024-09-12T03:15:23.785831+0000, chain.objs.size()=1 2024-09-12T02:06:44.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.TRBsATX2RETl9QBWZH5_vSKqBp34BT-_0 2024-09-12T02:06:44.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7863253554731749062', time=2024-09-12T03:15:52.672550+0000, chain.objs.size()=1 2024-09-12T02:06:44.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.303__shadow_.eTiJZ2X0_zdgwMCT5CjO2XZLxqoRBkX_0 2024-09-12T02:06:44.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12238492686517922518', time=2024-09-12T03:18:36.679602+0000, chain.objs.size()=1 2024-09-12T02:06:44.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.HK2R3yaS61TcEdGhlG9AbtbLJa0cGMQ_0 2024-09-12T02:06:44.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17312851698931301410', time=2024-09-12T03:18:37.756191+0000, chain.objs.size()=1 2024-09-12T02:06:44.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.dLE2MWwPovoEGwDSeAzreoKRiQYHyfi_0 2024-09-12T02:06:44.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6263483434533584924', time=2024-09-12T03:18:37.937760+0000, chain.objs.size()=1 2024-09-12T02:06:44.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.99yChzZyLUiBMWP1LVPsYAtH0JMq7i5_0 2024-09-12T02:06:44.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10299482186028632336', time=2024-09-12T03:18:40.662739+0000, chain.objs.size()=1 2024-09-12T02:06:44.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.WZavdO-Y3_3DADWPMyUWQG9ZhEC757J_0 2024-09-12T02:06:44.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1949099141935539413', time=2024-09-12T03:18:41.692717+0000, chain.objs.size()=1 2024-09-12T02:06:44.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oBbV_ba4e-KjFNZMaEhyg5KGkVeHKVl_0 2024-09-12T02:06:44.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1877143860020179510', time=2024-09-12T03:18:41.982532+0000, chain.objs.size()=1 2024-09-12T02:06:44.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.TLQuYiYDkXTqfX-3NnFB7QtskC71qMI_0 2024-09-12T02:06:44.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10002587555417630182', time=2024-09-12T03:18:42.647707+0000, chain.objs.size()=1 2024-09-12T02:06:44.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LmPzp-JEmQLYnt7ew7aqTkAeZnZXnqn_0 2024-09-12T02:06:44.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4693403495950186020', time=2024-09-12T03:18:43.084182+0000, chain.objs.size()=1 2024-09-12T02:06:44.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.lMQGQXsj40xRX6v8MxQkoh6c1a4MJ9p_0 2024-09-12T02:06:44.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7899749173872476452', time=2024-09-12T03:18:43.205405+0000, chain.objs.size()=1 2024-09-12T02:06:44.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wrItB0XE9KjFRWCAJvk0ARUzlgXlh6x_0 2024-09-12T02:06:44.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6791730176613359529', time=2024-09-12T03:18:45.108275+0000, chain.objs.size()=1 2024-09-12T02:06:44.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.sGCZ-xjc3kmzuRJmKeoWgpCnNTjFiiM_0 2024-09-12T02:06:44.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7898995527915949761', time=2024-09-12T03:18:45.519796+0000, chain.objs.size()=1 2024-09-12T02:06:44.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-2EIl9DVYjKhvlGdQplHYptQ9ZUY5cq_0 2024-09-12T02:06:44.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15229921694566905583', time=2024-09-12T03:18:47.035244+0000, chain.objs.size()=1 2024-09-12T02:06:44.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.sLvFNH8W-d1d-LKmqb8yyq8ObyAzj3s_0 2024-09-12T02:06:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8521541308423202628', time=2024-09-12T03:18:47.156507+0000, chain.objs.size()=1 2024-09-12T02:06:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ithZPaSijg1H71VZKACawdfStIxnrk-_0 2024-09-12T02:06:44.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18317979626562474194', time=2024-09-12T03:18:49.628301+0000, chain.objs.size()=1 2024-09-12T02:06:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.nEOK2KVCyDzZLxmibjc--0pOPOVjUJj_0 2024-09-12T02:06:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11394649142553429280', time=2024-09-12T03:18:51.084052+0000, chain.objs.size()=1 2024-09-12T02:06:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jkV-BI6PeZHV1t6lm1iFQYOFewHQwl1_0 2024-09-12T02:06:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.344821265813727216', time=2024-09-12T03:18:52.367501+0000, chain.objs.size()=1 2024-09-12T02:06:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.JBMl4k5PcQzcVVE9uKpdBl8DG3zh3ZA_0 2024-09-12T02:06:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1096581225160710919', time=2024-09-12T03:18:53.317016+0000, chain.objs.size()=1 2024-09-12T02:06:44.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ygursPEqHpw_Rh5pwk2GOi-TYtzn3rY_0 2024-09-12T02:06:44.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4563649611591557711', time=2024-09-12T03:18:53.860908+0000, chain.objs.size()=1 2024-09-12T02:06:44.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.mhMrrIgMzbsA7ifFEMGM_TisIaYP8l5_0 2024-09-12T02:06:44.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13039061860803855641', time=2024-09-12T03:18:53.986392+0000, chain.objs.size()=1 2024-09-12T02:06:44.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.YipOkvSXR1Szy8bt8CMFVoniHlWpnXu_0 2024-09-12T02:06:44.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11377245384413654267', time=2024-09-12T03:18:57.808267+0000, chain.objs.size()=1 2024-09-12T02:06:44.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.1co32kNPqHvlF6FfMP1hRKNpwtX5QAv_0 2024-09-12T02:06:44.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1197624235356202377', time=2024-09-12T03:18:58.557593+0000, chain.objs.size()=1 2024-09-12T02:06:44.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.EXxtyhaXHtCotfSLSLwFz34BFLLtNe7_0 2024-09-12T02:06:44.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10950190564505816658', time=2024-09-12T03:18:58.783962+0000, chain.objs.size()=1 2024-09-12T02:06:44.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.E-xBiCZUbtA4M1K66WgaAmcq4kDHYsI_0 2024-09-12T02:06:44.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14151729732683922225', time=2024-09-12T03:18:59.234337+0000, chain.objs.size()=1 2024-09-12T02:06:44.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Tr_eD-uYs8wWaPJtywgT4cquNO-oERo_0 2024-09-12T02:06:44.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15952664410893626097', time=2024-09-12T03:19:00.000046+0000, chain.objs.size()=1 2024-09-12T02:06:44.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.cT_QLdvmqq3MfSqRmrwsiv657nK7bvw_0 2024-09-12T02:06:44.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17328304087834314465', time=2024-09-12T03:19:00.200129+0000, chain.objs.size()=1 2024-09-12T02:06:44.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.NJXEUbEOnXNCsuwUxnGz2hKe1rhusSS_0 2024-09-12T02:06:44.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5626670640275949519', time=2024-09-12T03:19:01.981054+0000, chain.objs.size()=1 2024-09-12T02:06:44.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.D2BskpeGIwOSZU-C51XeO9ofGf5nmPy_0 2024-09-12T02:06:44.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6351947941864974084', time=2024-09-12T03:19:02.085008+0000, chain.objs.size()=1 2024-09-12T02:06:44.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.K_7zS0y0onBOlR-lPfPbKM0OLlH7_gk_0 2024-09-12T02:06:44.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2593250653916679070', time=2024-09-12T03:19:02.515862+0000, chain.objs.size()=1 2024-09-12T02:06:44.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.a1nFhdgxGDtETykrULKfwjn3zN_u_vd_0 2024-09-12T02:06:44.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.465137276525914760', time=2024-09-12T03:19:03.369441+0000, chain.objs.size()=1 2024-09-12T02:06:44.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.TV2nqZyuXi1ODyF9_su2D9Hrka3A04h_0 2024-09-12T02:06:44.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12526902725376139191', time=2024-09-12T03:19:03.664764+0000, chain.objs.size()=1 2024-09-12T02:06:44.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fgb8SG5aVXnfGA_eMWe6TdriB8sgodC_0 2024-09-12T02:06:44.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16991328326228528130', time=2024-09-12T03:19:05.322424+0000, chain.objs.size()=1 2024-09-12T02:06:44.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.P9AGXC9LJqgnSGX1avqgw8OTjHcBx0-_0 2024-09-12T02:06:44.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9389187871965253069', time=2024-09-12T03:19:05.324669+0000, chain.objs.size()=1 2024-09-12T02:06:44.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.shpmAbfM8fJeTHDrGhP91fwTCFbhmxL_0 2024-09-12T02:06:44.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14561069467016295699', time=2024-09-12T03:19:05.776631+0000, chain.objs.size()=1 2024-09-12T02:06:44.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5MSID1apnayL-oIXaguARBXXPxGi6oA_0 2024-09-12T02:06:44.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12177794391522833267', time=2024-09-12T03:19:06.143047+0000, chain.objs.size()=1 2024-09-12T02:06:44.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7kVUdoCa-AAy28MtHZtdkEurwIelZX5_0 2024-09-12T02:06:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17035532610848314435', time=2024-09-12T03:19:06.432778+0000, chain.objs.size()=1 2024-09-12T02:06:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.nzuVh0szZ41hNv0Mq3sA9ySosOHbk5g_0 2024-09-12T02:06:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1101126439934760657', time=2024-09-12T03:19:06.434780+0000, chain.objs.size()=1 2024-09-12T02:06:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7YZHZg4FMA4bRQic-MIhr75EPP3hwPg_0 2024-09-12T02:06:44.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1086039757473924396', time=2024-09-12T03:19:07.197538+0000, chain.objs.size()=1 2024-09-12T02:06:44.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.da9RTrATa2_kZ28rlHeczns3S_Q2lft_0 2024-09-12T02:06:44.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8069689386683062793', time=2024-09-12T03:20:54.268261+0000, chain.objs.size()=1 2024-09-12T02:06:44.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.eBIPCvWLvRzn10fS5eC-iAgaXeAYpuJ_0 2024-09-12T02:06:44.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.843941104910089834', time=2024-09-12T03:20:54.984341+0000, chain.objs.size()=1 2024-09-12T02:06:44.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.iz7Ia6wJSmtz59IxsJkBNIow0VJz9tA_0 2024-09-12T02:06:44.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9252391322148104248', time=2024-09-12T03:20:55.432460+0000, chain.objs.size()=1 2024-09-12T02:06:44.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.BScLF08zxor8QUlXsPx4pz9DZ54cyMN_0 2024-09-12T02:06:44.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9795754154559935302', time=2024-09-12T03:20:57.119309+0000, chain.objs.size()=1 2024-09-12T02:06:44.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XRfMkr5yb_HWpqPBQvakpZZ-U2RrEI6_0 2024-09-12T02:06:44.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8217760872229268440', time=2024-09-12T03:20:58.746526+0000, chain.objs.size()=1 2024-09-12T02:06:44.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.JNQuEPsfaoPHdjcviTS_Talr_1YBfCl_0 2024-09-12T02:06:44.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14419789870415727843', time=2024-09-12T03:20:59.142926+0000, chain.objs.size()=1 2024-09-12T02:06:44.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.TTJq8rkDgzZZ72mfLOvHbp2xF3Ho_F5_0 2024-09-12T02:06:44.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1898561152624316456', time=2024-09-12T03:21:03.006924+0000, chain.objs.size()=1 2024-09-12T02:06:44.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2E_XvwCD2-OlErzQ6WFLG0Iw35gvM8N_0 2024-09-12T02:06:44.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6780822366824262124', time=2024-09-12T03:21:03.397239+0000, chain.objs.size()=1 2024-09-12T02:06:44.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CDjVYjqZ3u3eTnCVmxuJEdxC_O9bTe__0 2024-09-12T02:06:44.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4705656343255593586', time=2024-09-12T03:21:03.484641+0000, chain.objs.size()=1 2024-09-12T02:06:44.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._N3ybleqNtoZhVewES7wjzySoDqbMqt_0 2024-09-12T02:06:44.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6277887585515429201', time=2024-09-12T03:21:03.779721+0000, chain.objs.size()=1 2024-09-12T02:06:44.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fWLmppv6e1x92U4rI7bAK0LU-9KDQJ3_0 2024-09-12T02:06:44.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10723900805247730840', time=2024-09-12T03:21:04.166950+0000, chain.objs.size()=1 2024-09-12T02:06:44.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.o0Nu4gXeLH0be9RXMDTKOJs3-QAHe6T_0 2024-09-12T02:06:44.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45165 2024-09-12T02:06:44.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T02:06:44.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14667114102404663856', time=2024-09-12T03:21:05.407439+0000, chain.objs.size()=1 2024-09-12T02:06:44.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.M91rn0ca-k4xET8Z4gO0hf7ftPkDBxL_0 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18058297639723501112', time=2024-09-12T03:21:07.926127+0000, chain.objs.size()=1 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.H7ArG33BKPpdYcJIC-x-_He8zAWEG6e_0 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5972977639245665644', time=2024-09-12T03:21:08.121810+0000, chain.objs.size()=1 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yvtVaYA-0lw0ttmTEf9gB002mPwBZ7y_0 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12893865442421793095', time=2024-09-12T03:21:10.215263+0000, chain.objs.size()=1 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.toJRYApDjiKKoyVt0BAfAdpYEAj3skS_0 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4640071520501923430', time=2024-09-12T03:21:11.680902+0000, chain.objs.size()=1 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-ZUt6GsXWKetxkRfdauu1eVDqykW1pW_0 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2471964737509846376', time=2024-09-12T03:21:13.288804+0000, chain.objs.size()=1 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.WTQpQZRObZ5E_I45PNZmWjQr0cSTAOw_0 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18314454985608757688', time=2024-09-12T03:21:13.469075+0000, chain.objs.size()=1 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.P58uc6ZrhJgdTrCX-ctX-tfp1i9aSvs_0 2024-09-12T02:06:44.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4310415559288134063', time=2024-09-12T03:21:13.902986+0000, chain.objs.size()=1 2024-09-12T02:06:44.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3AL-HEsf5mZwA5DKC6pV4dVI85sgyeg_0 2024-09-12T02:06:44.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7028114152228853760', time=2024-09-12T03:21:15.704700+0000, chain.objs.size()=1 2024-09-12T02:06:44.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.n02jRixGjWMGD8ghN1Zi7iEzkOeBtOf_0 2024-09-12T02:06:44.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12804558238732609499', time=2024-09-12T03:21:16.034318+0000, chain.objs.size()=1 2024-09-12T02:06:44.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.uobZQHxa0iXA-FKuIp774tczNEnnDzJ_0 2024-09-12T02:06:44.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5939123488612288568', time=2024-09-12T03:21:17.001417+0000, chain.objs.size()=1 2024-09-12T02:06:44.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8US6Q_yjmnbk9cdrpzYfPyKB-wpZoir_0 2024-09-12T02:06:44.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2245664485564564006', time=2024-09-12T03:21:17.816295+0000, chain.objs.size()=1 2024-09-12T02:06:44.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7pED8-WM0_xbiG9eFACyFQ2CWA2lXBt_0 2024-09-12T02:06:44.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15265361428537334256', time=2024-09-12T03:21:19.237758+0000, chain.objs.size()=1 2024-09-12T02:06:44.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6fIIdO-C97m2ukgTJaowG4sjFKCNppu_0 2024-09-12T02:06:44.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3137344997997850938', time=2024-09-12T03:21:20.038678+0000, chain.objs.size()=1 2024-09-12T02:06:44.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RwOFrv32_KIJdF_URWLeOKU9KFJQBrL_0 2024-09-12T02:06:44.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16090457501853538627', time=2024-09-12T03:21:21.124996+0000, chain.objs.size()=1 2024-09-12T02:06:44.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.VSSOuFI62KqhbGO3sy0zj-HODpLzzAI_0 2024-09-12T02:06:44.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4804163234873457551', time=2024-09-12T03:21:21.281077+0000, chain.objs.size()=1 2024-09-12T02:06:44.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ggyqwBjDxnhWk5xGomhj4fCb_95te8c_0 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10342449602729942896', time=2024-09-12T03:21:21.533994+0000, chain.objs.size()=1 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qO0BY8g5Wf1UeXZcdzjs3WEOch4uh1-_0 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2729332985885618280', time=2024-09-12T03:21:23.214228+0000, chain.objs.size()=1 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.WKLq740edXFBElzM5I82OWTGXPBBaCQ_0 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9624891744924750853', time=2024-09-12T03:21:24.133777+0000, chain.objs.size()=1 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IjjCN7DucYfCBGa9M48k92XZtS1PiqG_0 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5504703483037863482', time=2024-09-12T03:21:24.241017+0000, chain.objs.size()=1 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.BWTr0AUGwqx1VCDw9k5WePZiw6I7Oz-_0 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.678595411336470464', time=2024-09-12T03:21:24.916807+0000, chain.objs.size()=1 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9TCPm5r62Sg4R6sVvBfZ55lx85zXPeI_0 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9780041737712037583', time=2024-09-12T03:23:01.166439+0000, chain.objs.size()=1 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.371__shadow_.TLcrt9EWAtH-YR_Hx4HxxIkxbMSeDLb_0 2024-09-12T02:06:44.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10917670254321387801', time=2024-09-12T03:23:29.217664+0000, chain.objs.size()=1 2024-09-12T02:06:44.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.383__shadow_.uQj6WnOppsofYu3tQVX6C2SZ5hm1EwI_0 2024-09-12T02:06:44.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9468411680551810919', time=2024-09-12T03:25:27.597337+0000, chain.objs.size()=1 2024-09-12T02:06:44.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.436__shadow_.VWPr91REZb4ln4qaXda1AO1zWDiZ9_j_0 2024-09-12T02:06:44.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15636424101908096978', time=2024-09-12T03:38:22.800883+0000, chain.objs.size()=1 2024-09-12T02:06:44.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.555__shadow_.wQ9uw7al_vMf8JAirkkE6gnAMzfBzXx_0 2024-09-12T02:06:44.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12401952054348534006', time=2024-09-12T03:39:12.118755+0000, chain.objs.size()=1 2024-09-12T02:06:44.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.560__shadow_.3klAYjqxTeKLsKmIy5F_yzEV_6-UF7H_0 2024-09-12T02:06:44.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16749283429896049870', time=2024-09-12T03:39:50.518084+0000, chain.objs.size()=1 2024-09-12T02:06:44.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:CTryzkf6ZVnSAPqIzKQD6tu.GsEeG2n_.MUaLXTTV-LOmz-O7nsTZztwWmQ5ovx7_0 2024-09-12T02:06:44.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18199899582584599239', time=2024-09-12T03:40:10.827443+0000, chain.objs.size()=1 2024-09-12T02:06:44.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.571__shadow:MW0CyVdZDRcbUAa13M7EHZtKZywKeNy_.zFM7WaCQhgvLQX0gS9tlKpAwn8ofZU4_0 2024-09-12T02:06:44.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2838592392944821408', time=2024-09-12T03:54:12.089258+0000, chain.objs.size()=1 2024-09-12T02:06:44.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.696__shadow_.2_vRRIplibpIJ6C6rM2FpaCq2Hf_Qxc_0 2024-09-12T02:06:44.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9338209788943661851', time=2024-09-12T03:54:33.185374+0000, chain.objs.size()=1 2024-09-12T02:06:44.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.705__shadow:YqbV3zqNZ8pDTJulGPUc0-YFHvte6YN_.dJT3OgZHP5DmPkkDHc04hH0Bfq3zcHc_0 2024-09-12T02:06:44.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8999454153192289231', time=2024-09-12T03:55:23.599851+0000, chain.objs.size()=1 2024-09-12T02:06:44.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.719__shadow_.PHk5-NqXPB94VENKZet0ee3LfnGLpyV_0 2024-09-12T02:06:44.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:44.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.798+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T02:06:44.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.798+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:44.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51419' 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17455270529489766625', time=2024-09-12T03:03:12.684940+0000, chain.objs.size()=3 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.159__shadow_.JfcaiPxv5cEXHkYqmZumxgj0wNClXKR_0 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.159__shadow_.JfcaiPxv5cEXHkYqmZumxgj0wNClXKR_1 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.159__shadow_.JfcaiPxv5cEXHkYqmZumxgj0wNClXKR_2 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_h9MPo12eR1Ay7trva_FipTRpZLle2R0', time=2024-09-12T03:04:20.671518+0000, chain.objs.size()=3 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.9bl8BJB0do1t5YtO05t8Ok8_eo8f8-h_0 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.9bl8BJB0do1t5YtO05t8Ok8_eo8f8-h_1 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.9bl8BJB0do1t5YtO05t8Ok8_eo8f8-h_2 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6391022741262412523', time=2024-09-12T03:04:43.484972+0000, chain.objs.size()=1 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.163__shadow_.wJ1JOGIl6zjVHSdnYys-h60IKf5rgnx_0 2024-09-12T02:06:44.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1147986177584864018', time=2024-09-12T03:06:50.472482+0000, chain.objs.size()=1 2024-09-12T02:06:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.204__shadow_.TY_1Q7HZbouP3CMFstiUaN_Ub6ICuP__0 2024-09-12T02:06:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4608193907810600665', time=2024-09-12T03:11:19.560226+0000, chain.objs.size()=1 2024-09-12T02:06:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.250__shadow_.L0Deg6tWcO0mcS_SRuQffGKDtBMlSct_0 2024-09-12T02:06:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6801216856502578818', time=2024-09-12T03:11:34.686903+0000, chain.objs.size()=1 2024-09-12T02:06:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.256__shadow_.WVD2cx5qx0yOXGJE-EazwxF5blMxmh6_0 2024-09-12T02:06:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.689153859309338858', time=2024-09-12T03:11:39.517532+0000, chain.objs.size()=1 2024-09-12T02:06:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.258__shadow_.rxOkQTHbcmLoyaoBBzG8pypTrQmbUD2_0 2024-09-12T02:06:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10876967640990472714', time=2024-09-12T03:13:34.260727+0000, chain.objs.size()=1 2024-09-12T02:06:44.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.g1IVwbt6ZJPkTwuNFPNbozk9ujh4YH5_0 2024-09-12T02:06:44.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5155731330778284100', time=2024-09-12T03:13:34.621237+0000, chain.objs.size()=1 2024-09-12T02:06:44.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.LlyYKU-RR0OVuAouqjM3RbbXhfhiq5S_0 2024-09-12T02:06:44.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8297792755171317460', time=2024-09-12T03:13:35.500097+0000, chain.objs.size()=1 2024-09-12T02:06:44.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mTmhCMxz1yQiT34ieJqOoXfIY3rwOV2_0 2024-09-12T02:06:44.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1592602079368179773', time=2024-09-12T03:13:36.062692+0000, chain.objs.size()=1 2024-09-12T02:06:44.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.89F-BUnIg85EbZbn8IdrAfjaxSigm8r_0 2024-09-12T02:06:44.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3499263554309172378', time=2024-09-12T03:13:36.071892+0000, chain.objs.size()=1 2024-09-12T02:06:44.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Et2Ge6WQjv25fUWLUjr--WeoCQ68vrD_0 2024-09-12T02:06:44.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7661133303183528520', time=2024-09-12T03:13:36.543591+0000, chain.objs.size()=1 2024-09-12T02:06:44.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pDjnmhTFdlr9bBh508nvizS1zuQBwHj_0 2024-09-12T02:06:44.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11212689962416770697', time=2024-09-12T03:13:38.930269+0000, chain.objs.size()=1 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.M_jmZ0Qmwn9z_o9gvlD54LCnPDhnB5e_0 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18036284097913556010', time=2024-09-12T03:13:39.518719+0000, chain.objs.size()=1 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.k969zip9nQHW4WsOrd1BByj4SUGF38V_0 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.981649960164733439', time=2024-09-12T03:13:40.052117+0000, chain.objs.size()=1 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GPU__lGebm-eMjT__4Xpr__AA9YWmKQ_0 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9195225122080787059', time=2024-09-12T03:13:41.300044+0000, chain.objs.size()=1 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.IZBDv_I_l13Z2vwlo1yd9XZou5Hl_2X_0 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3196239588034860576', time=2024-09-12T03:13:41.373720+0000, chain.objs.size()=1 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.LtYXEFzttk7PS07VejSwWmrMYSaBehw_0 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17471111933804873336', time=2024-09-12T03:13:41.495144+0000, chain.objs.size()=1 2024-09-12T02:06:44.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.44NyG0FzSzRhG-RcUFgtWuUC1N3vWDq_0 2024-09-12T02:06:44.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1198095534395653181', time=2024-09-12T03:13:42.396540+0000, chain.objs.size()=1 2024-09-12T02:06:44.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6KjHnU6EJTwDSN8LN2GpyFd3ksUWGbo_0 2024-09-12T02:06:44.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12563498151747920209', time=2024-09-12T03:13:42.838204+0000, chain.objs.size()=1 2024-09-12T02:06:44.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ZPclZOORYszRAbqEL8tni9Kaigesy_C_0 2024-09-12T02:06:44.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7370293816390185770', time=2024-09-12T03:13:43.321945+0000, chain.objs.size()=1 2024-09-12T02:06:44.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.HNy6jxe6fjWPdhuzHYOK92Im7I6wMku_0 2024-09-12T02:06:44.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.818+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4396044249321142797', time=2024-09-12T03:13:44.063881+0000, chain.objs.size()=1 2024-09-12T02:06:44.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.818+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.G-nvnzshUmFi2XBcFaaBJPE2lhZ-S7T_0 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17113215381699717267', time=2024-09-12T03:13:44.709177+0000, chain.objs.size()=1 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Iio5QJmClR5GkJpFVjVqjFtA6gbVi7Y_0 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10036412957462442947', time=2024-09-12T03:13:45.129527+0000, chain.objs.size()=1 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.od7zxlhqBAPK9msMXUWc4yK8CdIleTG_0 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9015607003055609979', time=2024-09-12T03:13:46.633155+0000, chain.objs.size()=1 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hZJLyOj02kMi0vmQ8wFTVx15VnknlJR_0 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3572205614830253458', time=2024-09-12T03:13:49.580154+0000, chain.objs.size()=1 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.XLVSFWtfkEo4jAlJslpMoxeEtkJUust_0 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11535484305345230168', time=2024-09-12T03:13:49.832204+0000, chain.objs.size()=1 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.x3bNc-Lh1rdZGHAsXgpmcHBdEpNXyg6_0 2024-09-12T02:06:44.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5805026312504738365', time=2024-09-12T03:13:49.867074+0000, chain.objs.size()=1 2024-09-12T02:06:44.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pyYcy4y8BJH2MSLdyL2DE6Xr3xvFcGb_0 2024-09-12T02:06:44.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13498141465904061010', time=2024-09-12T03:13:52.251335+0000, chain.objs.size()=1 2024-09-12T02:06:44.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GWOqrbmZRjxjnoyDJT8X9Qdpbk3m7HO_0 2024-09-12T02:06:44.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7525052442252399615', time=2024-09-12T03:13:53.891321+0000, chain.objs.size()=1 2024-09-12T02:06:44.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.B9_UUzRyT8wL4_uCkfgVbL4Lw34Igsa_0 2024-09-12T02:06:44.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1319134243435322427', time=2024-09-12T03:13:59.162561+0000, chain.objs.size()=1 2024-09-12T02:06:44.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.B6QdSP6hHboZKu9cVuZR4kp_F33pkuH_0 2024-09-12T02:06:44.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4898860963202570234', time=2024-09-12T03:13:59.838009+0000, chain.objs.size()=1 2024-09-12T02:06:44.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.SFcSpPVxwld-AjZVqatSBlREh75R6af_0 2024-09-12T02:06:44.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11217245609748037915', time=2024-09-12T03:14:00.177327+0000, chain.objs.size()=1 2024-09-12T02:06:44.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.z76fm8diTQlkvvzKpSfrH_TGDMEUPTk_0 2024-09-12T02:06:44.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7367516531364169118', time=2024-09-12T03:14:01.004458+0000, chain.objs.size()=1 2024-09-12T02:06:44.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.dITF5DJ2V3E1yC3O0xc0ysxP35Kv0Wx_0 2024-09-12T02:06:44.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2430389588302325612', time=2024-09-12T03:14:01.197779+0000, chain.objs.size()=1 2024-09-12T02:06:44.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.AHCAM5gwIGMrxfAQQiCSBybNN7Mwinn_0 2024-09-12T02:06:44.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18358337338435617957', time=2024-09-12T03:14:01.893941+0000, chain.objs.size()=1 2024-09-12T02:06:44.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1RcJsGEMwwUV70pEswJakU7e6Ei8ZC0_0 2024-09-12T02:06:44.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8537853552212646395', time=2024-09-12T03:14:04.893636+0000, chain.objs.size()=1 2024-09-12T02:06:44.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.kY0K6-AjHPR7o2m-fa08LNHQ8mEcECE_0 2024-09-12T02:06:44.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2372612602598633911', time=2024-09-12T03:14:05.140084+0000, chain.objs.size()=1 2024-09-12T02:06:44.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.oCJ2l-goorhoFX94VLhON1nCV2jvGhX_0 2024-09-12T02:06:44.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6114696270838878432', time=2024-09-12T03:14:41.741927+0000, chain.objs.size()=1 2024-09-12T02:06:44.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.278__shadow_.Gd6hk2vcAtm8Pkh7Pi_ZpVsDLvEp2TD_0 2024-09-12T02:06:44.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9107114696771622604', time=2024-09-12T03:14:54.356132+0000, chain.objs.size()=1 2024-09-12T02:06:44.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.283__shadow_.AvpOMzKRs6shwLwoVShqxb3ADWRLF-U_0 2024-09-12T02:06:44.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7425931275309925012', time=2024-09-12T03:14:54.357756+0000, chain.objs.size()=1 2024-09-12T02:06:44.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.283__shadow_.yoTSwH7U6mqbqtTXa6OXJBdYp1CuyVP_0 2024-09-12T02:06:44.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8293824726241554597', time=2024-09-12T03:15:23.717802+0000, chain.objs.size()=1 2024-09-12T02:06:44.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.xR75-BlEEbMRGN9B0K2SwFajjqIn7e8_0 2024-09-12T02:06:44.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9857138960352372752', time=2024-09-12T03:15:29.364586+0000, chain.objs.size()=1 2024-09-12T02:06:44.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.q1cP0kCY0mFfCCf9XKp2weKMdfflHh-_0 2024-09-12T02:06:44.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570272207099819910', time=2024-09-12T03:15:29.577025+0000, chain.objs.size()=1 2024-09-12T02:06:44.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.Wty5mHI6hm7FqMdW9b74YtHey3ykQus_0 2024-09-12T02:06:44.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15712014627493021052', time=2024-09-12T03:15:34.840438+0000, chain.objs.size()=1 2024-09-12T02:06:44.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.296__shadow_.WgUlf2qr662SZTX9hA5xgiwvZx6CQAY_0 2024-09-12T02:06:44.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15091839573668507430', time=2024-09-12T03:15:37.388702+0000, chain.objs.size()=1 2024-09-12T02:06:44.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.297__shadow_.wnxvj1RSxO4Hv2k-ob3kGEEzqkmtpsR_0 2024-09-12T02:06:44.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15962116281948002709', time=2024-09-12T03:18:36.316642+0000, chain.objs.size()=1 2024-09-12T02:06:44.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jxtw0S6SlRSINeBKkC_wucu_6uLwB_e_0 2024-09-12T02:06:44.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4913466418729378278', time=2024-09-12T03:18:37.248480+0000, chain.objs.size()=1 2024-09-12T02:06:44.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fgdrfSxOpYHYhY5YPmq2hF2xMMttYj9_0 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1233122501598994824', time=2024-09-12T03:18:37.425032+0000, chain.objs.size()=1 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PfWAzF_QAe5PvGKJBT7If7XM19_VTGm_0 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2476927638974554579', time=2024-09-12T03:18:37.575296+0000, chain.objs.size()=1 2024-09-12T02:06:44.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.cfPI8AejzmMtF25WlgIsXxXahelsn21_0 2024-09-12T02:06:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.838+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3543816895800123368', time=2024-09-12T03:18:38.168070+0000, chain.objs.size()=1 2024-09-12T02:06:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.838+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VaQzIbmxazIMJurszW95b9_1ESD3r_g_0 2024-09-12T02:06:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.838+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3438184657808781131', time=2024-09-12T03:18:38.520210+0000, chain.objs.size()=1 2024-09-12T02:06:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.838+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7yIdIkKh_MFFHuLQJVbEGTf5tysA_LY_0 2024-09-12T02:06:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.838+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1929043680301255088', time=2024-09-12T03:18:38.666768+0000, chain.objs.size()=1 2024-09-12T02:06:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.838+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.z3kFYurTJlzV5X4_kMoSumWbK_co22k_0 2024-09-12T02:06:44.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.838+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5936743577070128648', time=2024-09-12T03:18:39.567841+0000, chain.objs.size()=1 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.838+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.TSRnWjmOTPY98eHDfNjWzaMevmngOkb_0 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.838+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3644020832471067795', time=2024-09-12T03:18:43.454334+0000, chain.objs.size()=1 2024-09-12T02:06:44.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.838+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8QrQeO2HwQhqWl2YyPHG_xUiShqCEaO_0 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.134918124728290720', time=2024-09-12T03:18:44.959441+0000, chain.objs.size()=1 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.YIItWy9Axb90N4T85z7o16iVIRAXXU-_0 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14043679273889822195', time=2024-09-12T03:18:45.018750+0000, chain.objs.size()=1 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jaLEsYAp6y7NxCwnVZGUmIc8UXk2dbZ_0 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7814208516325537547', time=2024-09-12T03:18:46.537936+0000, chain.objs.size()=1 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xY11IlfdFAwXXxlizz5AqTHoEjbNus8_0 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8555205929256566124', time=2024-09-12T03:18:47.289055+0000, chain.objs.size()=1 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.dAMYzihLcYaYAHTWFpiyLkEtAzC-jgv_0 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15061604951296379471', time=2024-09-12T03:18:47.665698+0000, chain.objs.size()=1 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.pTyWU8igyoEn7-lGfui7DNCPgGjgDnV_0 2024-09-12T02:06:44.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16193152133172528691', time=2024-09-12T03:18:48.128990+0000, chain.objs.size()=1 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.68ewNA3RtxFq-kKjPxVyTQOtq0YFGx3_0 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16943953270074705177', time=2024-09-12T03:18:48.170590+0000, chain.objs.size()=1 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._zJB9TN9PfO4PaD6FdNBWzuuavRYOyH_0 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1164179488504219739', time=2024-09-12T03:18:49.180631+0000, chain.objs.size()=1 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.uc33eH-svRiJsLHl4RmdAUV-bIQfRPf_0 2024-09-12T02:06:44.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6837545812428149784', time=2024-09-12T03:18:49.538229+0000, chain.objs.size()=1 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gfgxaXuvAm7g1fbbuFrABArKcjiZQeP_0 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1068532945082410819', time=2024-09-12T03:18:50.050584+0000, chain.objs.size()=1 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.X8OJMR6ocp1QBjuhvLnODI65OMBLEKg_0 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3836990661898500241', time=2024-09-12T03:18:50.343761+0000, chain.objs.size()=1 2024-09-12T02:06:44.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RYKbHpv3xvdTTJB24uri9Oyxx0bvy_Y_0 2024-09-12T02:06:44.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.846+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.837050211898584643', time=2024-09-12T03:18:50.525279+0000, chain.objs.size()=1 2024-09-12T02:06:44.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.846+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.rmdUX0uC4Ij2YxPTeuT-BaeCUCnKAwo_0 2024-09-12T02:06:44.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.846+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3332655276499135782', time=2024-09-12T03:18:51.712449+0000, chain.objs.size()=1 2024-09-12T02:06:44.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.846+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.dIb9LIqIzDeHPOsvwreFXhnp_fdpycs_0 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6021830620243847204', time=2024-09-12T03:18:52.051217+0000, chain.objs.size()=1 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.TKCPkwhxU3ZJwJV_LfoBQqt3E_wsxVe_0 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5822505095720322580', time=2024-09-12T03:18:54.459978+0000, chain.objs.size()=1 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.pb8bVIlL91Z350wFqNCd9KimzmaVxY2_0 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17178979847161281779', time=2024-09-12T03:18:55.108442+0000, chain.objs.size()=1 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.cF5qP_DaN07cN6fHMw_gTIaj5lED2ZU_0 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3675123813831420346', time=2024-09-12T03:18:56.115043+0000, chain.objs.size()=1 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xQP77ldg6ljF3fetTMI7K7I3yVgpcV7_0 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9514487827499054151', time=2024-09-12T03:18:57.392257+0000, chain.objs.size()=1 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LvaPRLZALpBKH7Gz3qNz2rjzDOPi4ZF_0 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15691297067846521426', time=2024-09-12T03:18:58.106058+0000, chain.objs.size()=1 2024-09-12T02:06:44.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ILCczAcQDF33Jn4bHVJi0FfHes9OpcL_0 2024-09-12T02:06:44.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3564505676793035535', time=2024-09-12T03:18:58.138296+0000, chain.objs.size()=1 2024-09-12T02:06:44.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.e_6AmyYyABIqbFD4UZNagwknDs5ml39_0 2024-09-12T02:06:44.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12887483088255094181', time=2024-09-12T03:18:59.320417+0000, chain.objs.size()=1 2024-09-12T02:06:44.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.v9-Yyg9R5KZ0UgKL-s6-qYvSm0ZIIPf_0 2024-09-12T02:06:44.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2791549505718567136', time=2024-09-12T03:18:59.880040+0000, chain.objs.size()=1 2024-09-12T02:06:44.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ozwoYwdS6pLQT27EJNQOzb2c5QxHs6Q_0 2024-09-12T02:06:44.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4976631927602576870', time=2024-09-12T03:19:01.380729+0000, chain.objs.size()=1 2024-09-12T02:06:44.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.In15Bxe8WB67SWkeVNLBJm1GrLAEVJI_0 2024-09-12T02:06:44.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3995374023710544922', time=2024-09-12T03:19:01.837205+0000, chain.objs.size()=1 2024-09-12T02:06:44.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AIXRQVkoXgv9oiWq91ttaLDfPXtKSgt_0 2024-09-12T02:06:44.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3125231718894401101', time=2024-09-12T03:19:02.518866+0000, chain.objs.size()=1 2024-09-12T02:06:44.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QZtd6xEIFaGRwLz8DfouZekEuxOffro_0 2024-09-12T02:06:44.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2727175428687879239', time=2024-09-12T03:19:02.703748+0000, chain.objs.size()=1 2024-09-12T02:06:44.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4ozkd3xVUeQud_HDYAXRgXuYDuSVYWm_0 2024-09-12T02:06:44.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14389532602651306193', time=2024-09-12T03:19:05.744517+0000, chain.objs.size()=1 2024-09-12T02:06:44.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.avtyV-WuxG0lObKbn7Y8s8aX52zcMsK_0 2024-09-12T02:06:44.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16053722019797197049', time=2024-09-12T03:19:05.774807+0000, chain.objs.size()=1 2024-09-12T02:06:44.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.T-9ZPq5zt0SJ0-g-_knWawbL8smNOLT_0 2024-09-12T02:06:44.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3363664901719795517', time=2024-09-12T03:19:06.703595+0000, chain.objs.size()=1 2024-09-12T02:06:44.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5Sih_0wRBgcpJ28KsSD2GQ3kCFFzkpi_0 2024-09-12T02:06:44.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1964293689049145764', time=2024-09-12T03:19:07.753894+0000, chain.objs.size()=1 2024-09-12T02:06:44.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.cgxBQIKAYLr2P6tnOzWznsQCDmVPIKd_0 2024-09-12T02:06:44.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1675045326144040157', time=2024-09-12T03:19:07.812285+0000, chain.objs.size()=1 2024-09-12T02:06:44.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.k4F3ZV966elah8xN40_8LCn_UI9aCVI_0 2024-09-12T02:06:44.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17267020248923175263', time=2024-09-12T03:20:55.680517+0000, chain.objs.size()=1 2024-09-12T02:06:44.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CWvsL3WwCwkYQvon5xHyUXgxFsGe2Ut_0 2024-09-12T02:06:44.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4019530126722582572', time=2024-09-12T03:20:57.372240+0000, chain.objs.size()=1 2024-09-12T02:06:44.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.uLXFY9pcDkVgnzGgu71uEyIuugPs5Hk_0 2024-09-12T02:06:44.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3558450981802970808', time=2024-09-12T03:20:59.988960+0000, chain.objs.size()=1 2024-09-12T02:06:44.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zCtE3Jql5P8imfggFJIPH43aZIujfhX_0 2024-09-12T02:06:44.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15090361809886682798', time=2024-09-12T03:21:00.168269+0000, chain.objs.size()=1 2024-09-12T02:06:44.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xFEHRQR8mAbTc-6QXn3qpEbG2t1qp7l_0 2024-09-12T02:06:44.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11900313946698292425', time=2024-09-12T03:21:01.464905+0000, chain.objs.size()=1 2024-09-12T02:06:44.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1XwxXPCS9BFPEUtlUWnBlDJOXk9xuQV_0 2024-09-12T02:06:44.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2507671201774073526', time=2024-09-12T03:21:01.860156+0000, chain.objs.size()=1 2024-09-12T02:06:44.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IC3ykCpTROKABxC04n14CuLxw6NFIX6_0 2024-09-12T02:06:44.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.411678985100989904', time=2024-09-12T03:21:02.992104+0000, chain.objs.size()=1 2024-09-12T02:06:44.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.G9TwfqDJeyrnVFLjf5kvcz74KbvUYm9_0 2024-09-12T02:06:44.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.986965021638727300', time=2024-09-12T03:21:03.302540+0000, chain.objs.size()=1 2024-09-12T02:06:44.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.WN8S99uPNgqnTe4Qo-1M0318o7hpbp5_0 2024-09-12T02:06:44.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18201252424117555602', time=2024-09-12T03:21:03.372895+0000, chain.objs.size()=1 2024-09-12T02:06:44.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.D8j304_rvgQnaLBCsPoX3gxo58abicU_0 2024-09-12T02:06:44.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14118111598792848014', time=2024-09-12T03:21:03.398466+0000, chain.objs.size()=1 2024-09-12T02:06:44.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rFDh17v5Wx6h5FpL9blZNh7KttxHZ-U_0 2024-09-12T02:06:44.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13567103443575319732', time=2024-09-12T03:21:03.689199+0000, chain.objs.size()=1 2024-09-12T02:06:44.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.roPOma7so1fLy9IqdrHuuJ2Gy14DaAh_0 2024-09-12T02:06:44.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.866+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14045888313115937811', time=2024-09-12T03:21:03.693912+0000, chain.objs.size()=1 2024-09-12T02:06:44.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.866+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EDm3VSNP_gwFKCGhn4QeZLzNK2CT-Fi_0 2024-09-12T02:06:44.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.866+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11704542052237116160', time=2024-09-12T03:21:03.824464+0000, chain.objs.size()=1 2024-09-12T02:06:44.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.866+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tQXC1S1_ZOCP2JZNbIQx9zXl1Pv55BC_0 2024-09-12T02:06:44.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51419 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=44, truncated=0, next_marker='' 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7301436608823527559', time=2024-09-12T03:21:07.655535+0000, chain.objs.size()=1 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DFQlGGi33GdYf9pbdmMOjnavH1r1sTH_0 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2288154631027663969', time=2024-09-12T03:21:08.238914+0000, chain.objs.size()=1 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kHbUhiSKjQ_FRf-cmcaFG8cWfI4deIb_0 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12287246384275160982', time=2024-09-12T03:21:09.000836+0000, chain.objs.size()=1 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qC7hgv-llrORRoxl0FQP7aAhZKiw8zV_0 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7671119721460697692', time=2024-09-12T03:21:09.025778+0000, chain.objs.size()=1 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Il5Xe2EIXBJgUszRS7-tTDjjwfYZkea_0 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.327091592267702658', time=2024-09-12T03:21:09.920253+0000, chain.objs.size()=1 2024-09-12T02:06:44.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.UQ50CGqT9eNaiBtgk6aKqW4KQQ65H_5_0 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9992670898692676715', time=2024-09-12T03:21:10.102323+0000, chain.objs.size()=1 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.uB3wDprEZOAiYGUta4ZknLKclR5l8y3_0 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17433108292600938544', time=2024-09-12T03:21:10.108930+0000, chain.objs.size()=1 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.QKqcZVK0rtWNBO8QQPN74WwFBaQHE6k_0 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15115916515518846594', time=2024-09-12T03:21:11.650231+0000, chain.objs.size()=1 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DOjoSJWNKGUYLtnr3OjvK1ROeMIN2K6_0 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5203642869052824572', time=2024-09-12T03:21:12.826323+0000, chain.objs.size()=1 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4QprcRFShfJJv1fxcMO5tx7bT-nsM5H_0 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16850205656076062796', time=2024-09-12T03:21:13.457061+0000, chain.objs.size()=1 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.QmhYDHGTGddBsGUG_Spm47QbmMd49g6_0 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6423040220658239177', time=2024-09-12T03:21:14.368082+0000, chain.objs.size()=1 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bLps4dXXhKHqUtARZJz8kATChBJ4rYt_0 2024-09-12T02:06:44.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18210341915207973923', time=2024-09-12T03:21:15.545811+0000, chain.objs.size()=1 2024-09-12T02:06:44.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.soUfohkKXW89SQn0hDyBd8_AwVhsKMk_0 2024-09-12T02:06:44.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4042347306152116558', time=2024-09-12T03:21:16.177067+0000, chain.objs.size()=1 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kxtZSKvsjNJ_aJvioLnEEI8p9LNPihr_0 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8262551984970375590', time=2024-09-12T03:21:16.355898+0000, chain.objs.size()=1 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DFpwuUrxHIxuxoPEpg7Jlp5RJ3Gxlka_0 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9377016548072042289', time=2024-09-12T03:21:17.544843+0000, chain.objs.size()=1 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ykQFgyL8da4Zbax9XDqpg0PnK1M02ls_0 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11793065405375918426', time=2024-09-12T03:21:23.271955+0000, chain.objs.size()=1 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kiE9-NTqGF374IdGiqQ8U6JhG5oZs--_0 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14891544791995474462', time=2024-09-12T03:21:23.285794+0000, chain.objs.size()=1 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EeZ_enRBDjQrizDkBCfF-Pr2lvj4nEs_0 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14077376152327507010', time=2024-09-12T03:21:23.686343+0000, chain.objs.size()=1 2024-09-12T02:06:44.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.TsUtkoGLLtuHwCHmZ6WXOCm6XIkz3vL_0 2024-09-12T02:06:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4677826290025843699', time=2024-09-12T03:21:24.533772+0000, chain.objs.size()=1 2024-09-12T02:06:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.z5bYzhXvKL24VKR_lfTG0kB2TADd6Ms_0 2024-09-12T02:06:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14333211916462411389', time=2024-09-12T03:21:24.901144+0000, chain.objs.size()=1 2024-09-12T02:06:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.HsDBnxSyTNKIeXgSyGJRzgsOKiF9_xg_0 2024-09-12T02:06:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.645352381349538569', time=2024-09-12T03:21:25.189899+0000, chain.objs.size()=1 2024-09-12T02:06:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.s0CMTAKzB8Z1FyR3kE68oSs_sp_51X__0 2024-09-12T02:06:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7088235510489708684', time=2024-09-12T03:21:25.300444+0000, chain.objs.size()=1 2024-09-12T02:06:44.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CNa5zm7bWMw9FfjA3lskh6eR1ThReVe_0 2024-09-12T02:06:44.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10662021492378447015', time=2024-09-12T03:21:25.576167+0000, chain.objs.size()=1 2024-09-12T02:06:44.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9t96onAqtTAIy-6sqCeSGweNXH_I9Pj_0 2024-09-12T02:06:44.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4147950739719865900', time=2024-09-12T03:21:38.485197+0000, chain.objs.size()=1 2024-09-12T02:06:44.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.331__shadow_.5iCFmmm1w1_6L-rHzVJ4u-VTOsQrWPL_0 2024-09-12T02:06:44.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5902925375594334792', time=2024-09-12T03:21:58.070315+0000, chain.objs.size()=1 2024-09-12T02:06:44.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.340__shadow_.59wQL7KRW0nzQE8_-zpHVLNFviKTPqr_0 2024-09-12T02:06:44.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5829573602051810848', time=2024-09-12T03:22:14.434976+0000, chain.objs.size()=1 2024-09-12T02:06:44.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.347__shadow_.7UuG28255Rk6JpjT0CrEAz6DOQau5-I_0 2024-09-12T02:06:44.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16677922088623511148', time=2024-09-12T03:25:30.527615+0000, chain.objs.size()=1 2024-09-12T02:06:44.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.437__shadow_.omFbZytg2FTsDul21DE3rVdMHQzP5Tg_0 2024-09-12T02:06:44.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4480968864150581439', time=2024-09-12T03:26:06.054362+0000, chain.objs.size()=1 2024-09-12T02:06:44.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.451__shadow_.NIV-gWDCo8qQZ38PlQqJakMYTZZjrar_0 2024-09-12T02:06:44.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13298885513952712227', time=2024-09-12T03:26:18.013373+0000, chain.objs.size()=1 2024-09-12T02:06:44.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.456__shadow_.eLLlI7WPGotQ5I_g9AHhPKhcUEKPoMn_0 2024-09-12T02:06:44.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.894859244751536463', time=2024-09-12T03:26:40.477648+0000, chain.objs.size()=1 2024-09-12T02:06:44.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.463__shadow_.12x41J0mxi7Jbj5SSLrCKUsm0O6ZrSd_0 2024-09-12T02:06:44.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11923652530647846611', time=2024-09-12T03:26:40.486247+0000, chain.objs.size()=1 2024-09-12T02:06:44.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.463__shadow_.TijCSlJTZt3phrR7V0h8kInNwPcfd0n_0 2024-09-12T02:06:44.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6898682493870730355', time=2024-09-12T03:27:21.925341+0000, chain.objs.size()=1 2024-09-12T02:06:44.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.HRaGugYwVSW7cHf4K_w-f6-mTja9Xpo_0 2024-09-12T02:06:44.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12826986265310020837', time=2024-09-12T03:27:56.974236+0000, chain.objs.size()=1 2024-09-12T02:06:44.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.497__shadow_.U1X9hqWOmRkbJySDFX5dikJ0KH9P33G_0 2024-09-12T02:06:44.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8758274517004881884', time=2024-09-12T03:28:05.404360+0000, chain.objs.size()=1 2024-09-12T02:06:44.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.501__shadow_.5v6GILHdYApfHbH__ZszrzY45voRkho_0 2024-09-12T02:06:44.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5600960298843455454', time=2024-09-12T03:34:13.460636+0000, chain.objs.size()=6 2024-09-12T02:06:44.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~mx_BZiysMXgNdfxx5vzfna-p7AzmjSL.1 2024-09-12T02:06:44.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.lIr1IlYN_aL61V6L3TPKNmZpsuDG3Br7.2 2024-09-12T02:06:44.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.WlsKOILUnxOlizlB64Pfmul8VYhLmV-g.3 2024-09-12T02:06:44.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~mx_BZiysMXgNdfxx5vzfna-p7AzmjSL.4 2024-09-12T02:06:44.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~mx_BZiysMXgNdfxx5vzfna-p7AzmjSL.5 2024-09-12T02:06:44.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~mx_BZiysMXgNdfxx5vzfna-p7AzmjSL.6 2024-09-12T02:06:44.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14389954668095371519', time=2024-09-12T03:38:44.678555+0000, chain.objs.size()=1 2024-09-12T02:06:44.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.557__shadow_.McyRdKh1yfAQlqFTyltsxrC5hpWYqIQ_0 2024-09-12T02:06:44.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10023406425545500536', time=2024-09-12T03:39:06.799303+0000, chain.objs.size()=1 2024-09-12T02:06:44.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.559__shadow_.RNUFmRU66u62EwauZjIXuStRB_SMz6G_0 2024-09-12T02:06:44.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.898+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6863808450174663648', time=2024-09-12T03:40:24.942063+0000, chain.objs.size()=1 2024-09-12T02:06:44.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.898+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow_.-_RvyMyZE2Z_j2I7lbtOLlpiZ-tdSdo_0 2024-09-12T02:06:44.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.898+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6754308228857162459', time=2024-09-12T03:40:44.049223+0000, chain.objs.size()=1 2024-09-12T02:06:44.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.898+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.577__shadow:YPlz1M7foWKHm4eu28lcZI6D47.HA9r_.L0TXoi4dw94uSPXzw0Vp0vFvbgQBx2C_0 2024-09-12T02:06:44.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.898+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4176121590534038234', time=2024-09-12T03:42:59.515404+0000, chain.objs.size()=1 2024-09-12T02:06:44.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.898+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.587__shadow:XNyMRHMz8TxmhxaHTmMA-PiogabjwYg_.l0IB4u5nmfMrNfB4ywA0mUA_RJ3je-n_0 2024-09-12T02:06:44.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16585162423618336829', time=2024-09-12T03:46:33.425694+0000, chain.objs.size()=12 2024-09-12T02:06:44.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__multipart_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.1 2024-09-12T02:06:44.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__shadow_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.1_1 2024-09-12T02:06:44.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__multipart_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.2 2024-09-12T02:06:44.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__shadow_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.2_1 2024-09-12T02:06:44.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__multipart_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.3 2024-09-12T02:06:44.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__shadow_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.3_1 2024-09-12T02:06:44.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__multipart_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.4 2024-09-12T02:06:44.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__shadow_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.4_1 2024-09-12T02:06:44.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.906+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__multipart_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.5 2024-09-12T02:06:44.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.906+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__shadow_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.5_1 2024-09-12T02:06:44.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.906+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__multipart_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.6 2024-09-12T02:06:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616__shadow_multipart_enc.2~RlCA7C1Z7mrHuwpnMoJuOZ4Iv-HMUZI.6_1 2024-09-12T02:06:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15719091195541209882', time=2024-09-12T03:51:55.846828+0000, chain.objs.size()=1 2024-09-12T02:06:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.655__shadow_.hMWthlOq8LGlFe4RwJ5wcTzPzu2AKQN_0 2024-09-12T02:06:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2762531944868236903', time=2024-09-12T03:54:09.775921+0000, chain.objs.size()=1 2024-09-12T02:06:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.695__shadow:GAJpA9Xs6sgaQ5FRlzG1FWWFs7bAAKv_.qArkFvoCBDmHwJ81gKBiWrGHZ0wyzQ9_0 2024-09-12T02:06:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1106006815104543717', time=2024-09-12T03:54:42.562152+0000, chain.objs.size()=1 2024-09-12T02:06:44.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.709__shadow:ogOHeOAvPz0iAbTcJ7k8BLMV0Ki0XUF_.jjlOwqPfY3izfjIuJV9ec0FXz3MPIii_0 2024-09-12T02:06:44.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.918+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:44.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T02:06:44.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:44.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:44.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51724' 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.121717649897937426', time=2024-09-12T03:02:41.174519+0000, chain.objs.size()=1 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.149__shadow_._2EGAcW-7Oftzag5NcoRI87ucmAZMds_0 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11677415777855857045', time=2024-09-12T03:05:49.270872+0000, chain.objs.size()=1 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.189__shadow_._YuWsIVMaDDe5QrM_g55HuaZ0rpcJ35_0 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14852145589032071778', time=2024-09-12T03:10:58.903330+0000, chain.objs.size()=1 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.243__shadow_.2_QlX8ZB-jIuEWZKvgs4kJrxWYWv7Nx_0 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3506035776445644789', time=2024-09-12T03:11:19.569716+0000, chain.objs.size()=1 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.250__shadow_.xKi3mJnGjtWGoZb_mQIby-_ouRo3Ica_0 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12108069804228157032', time=2024-09-12T03:11:27.135095+0000, chain.objs.size()=1 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.253__shadow_.opS5WYmSpLLStpVdAd4qnOmcF1l_ahO_0 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.431286896903333152', time=2024-09-12T03:11:32.150904+0000, chain.objs.size()=1 2024-09-12T02:06:44.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.255__shadow_.UpVfw2lTTpLftuJkhhA9ZWEX7eiQkj6_0 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7820927224898204845', time=2024-09-12T03:13:34.964140+0000, chain.objs.size()=1 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._jDz-jNDHhpZ-3ZEUlqLIFiCT9DtKBr_0 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5824775527689405366', time=2024-09-12T03:13:35.221694+0000, chain.objs.size()=1 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.nCO20npvgjmMSHS2O4DP3z0w4zrDhJP_0 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8053981419456120496', time=2024-09-12T03:13:36.138116+0000, chain.objs.size()=1 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.APUPTiBmU2ljTGoVPzZ11dfWknH2gCk_0 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12892065154136934205', time=2024-09-12T03:13:38.255995+0000, chain.objs.size()=1 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qkuuhqmTDja8XJrOK-1FV1-4pvK2MAS_0 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7934977701173335769', time=2024-09-12T03:13:38.347646+0000, chain.objs.size()=1 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.IfkTLcyG7t3T3OXugfnQHR9Fxdgv21d_0 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5752500592479083254', time=2024-09-12T03:13:38.666754+0000, chain.objs.size()=1 2024-09-12T02:06:44.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.89XwfxA3RblC8I5Mie3aAxA5eEBRS7F_0 2024-09-12T02:06:44.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5912840312171425406', time=2024-09-12T03:13:40.750253+0000, chain.objs.size()=1 2024-09-12T02:06:44.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Ua0DK_L8TfTLhvFMxSd7FyycYoCZAjJ_0 2024-09-12T02:06:44.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17800367746964220694', time=2024-09-12T03:13:41.395677+0000, chain.objs.size()=1 2024-09-12T02:06:44.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ok208XXFPTV10rqcHhZ1uAj4A9nx6rp_0 2024-09-12T02:06:44.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.938265331370398139', time=2024-09-12T03:13:43.419994+0000, chain.objs.size()=1 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RcHRUAncyneGgJd31K272zemE_OoWRL_0 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11125084959929255216', time=2024-09-12T03:13:43.684069+0000, chain.objs.size()=1 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.u4d0-lL4HJQlQEsMrVBzDgLKSBVylhu_0 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11089694702221763210', time=2024-09-12T03:13:44.619872+0000, chain.objs.size()=1 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QB3xYs7IQTsvBX_vGA580d4oRK524qg_0 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.888763938380405053', time=2024-09-12T03:13:49.145228+0000, chain.objs.size()=1 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4Iyn23_NPX0V0WUkpwwp2JOJQDvABUu_0 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9798939350854514751', time=2024-09-12T03:13:51.435180+0000, chain.objs.size()=1 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.krA3zOhl61tQl_JSjwGuAgOozYlJUTS_0 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11697459632250192905', time=2024-09-12T03:13:51.933203+0000, chain.objs.size()=1 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.t0E3pdeaauWAUjBHL3RDO78VwG-wTu4_0 2024-09-12T02:06:44.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8781891578075695651', time=2024-09-12T03:13:52.774505+0000, chain.objs.size()=1 2024-09-12T02:06:44.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2X_Bc3LMzz2bPcajiIzZSkK-1qkfnOz_0 2024-09-12T02:06:44.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13458778224983244264', time=2024-09-12T03:13:52.932630+0000, chain.objs.size()=1 2024-09-12T02:06:44.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cqTsd2Wke_7dN8b_FH1yyqAzB3vVPuK_0 2024-09-12T02:06:44.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17790424497741157728', time=2024-09-12T03:13:53.087609+0000, chain.objs.size()=1 2024-09-12T02:06:44.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._iRcN9JIXRuW8p5jqkU3xzlVYUSWQHh_0 2024-09-12T02:06:44.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7818039534726399010', time=2024-09-12T03:13:53.638480+0000, chain.objs.size()=1 2024-09-12T02:06:44.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Z7DdajYE977mUlxGqTNbkQn50zr1jaX_0 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1442826829239976227', time=2024-09-12T03:13:53.751430+0000, chain.objs.size()=1 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.gly97GHXH33-o6H04oQIRXE-F4ljk0g_0 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14789068464835034113', time=2024-09-12T03:13:53.861830+0000, chain.objs.size()=1 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GV5a7hN6SGcsmPHBvfYnpzBmgTGHePh_0 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11313571738278250915', time=2024-09-12T03:13:55.584587+0000, chain.objs.size()=1 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.y-27jx5AKQu9OMbBKFAPjextY5nN6uU_0 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12848494083648253545', time=2024-09-12T03:13:55.658609+0000, chain.objs.size()=1 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.j7dpttyLhiKnDCgBa3rQAF8uKfO9qsK_0 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8348175295514749559', time=2024-09-12T03:13:56.136343+0000, chain.objs.size()=1 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KPXEkMdwt-RsEuMSQ-NxfAjlT1EjuK3_0 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5687218648894320118', time=2024-09-12T03:13:56.807445+0000, chain.objs.size()=1 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.fbd3WKnB64CV61Fnf8zJmVq8OWm3lGb_0 2024-09-12T02:06:44.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12333743082678650175', time=2024-09-12T03:13:57.308078+0000, chain.objs.size()=1 2024-09-12T02:06:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.K8YKWBMVrPjHHe1GzqxzZ98WkC1Zc1P_0 2024-09-12T02:06:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7746901226408424315', time=2024-09-12T03:13:58.856912+0000, chain.objs.size()=1 2024-09-12T02:06:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JLGOMlmHT3RZ_hRqmotECKGKrT8HZIp_0 2024-09-12T02:06:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18309903555968396968', time=2024-09-12T03:14:00.627748+0000, chain.objs.size()=1 2024-09-12T02:06:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.47-PoYnb3zwCFmnN5156OyCmX1lDscg_0 2024-09-12T02:06:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18381709887252319985', time=2024-09-12T03:14:00.864636+0000, chain.objs.size()=1 2024-09-12T02:06:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Yq3eJrnP3zz7fEBECTRj8756sf4IZ03_0 2024-09-12T02:06:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.385596481839974133', time=2024-09-12T03:14:01.312325+0000, chain.objs.size()=1 2024-09-12T02:06:44.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.dSHrTthHAnAHy9o6F6t-PoDAZNSN4Y__0 2024-09-12T02:06:44.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14979552616175495936', time=2024-09-12T03:14:01.384555+0000, chain.objs.size()=1 2024-09-12T02:06:44.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.smIIiX4XbvH_WiyDOTRNjvozoYwODDA_0 2024-09-12T02:06:44.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.444715945239419213', time=2024-09-12T03:14:01.664169+0000, chain.objs.size()=1 2024-09-12T02:06:44.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aq056n9r_SPLHBr1JtgC0bOeEZDdhBO_0 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7918080662945483342', time=2024-09-12T03:14:01.825660+0000, chain.objs.size()=1 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.AHE_r7G8kQ4n7ZBIPgW-Nu0CEIw8Z5W_0 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17746735587460102793', time=2024-09-12T03:14:03.567097+0000, chain.objs.size()=1 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.zW9hGDY1W83by2TBtvWCOR12IOFMGKl_0 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3929567941837701723', time=2024-09-12T03:15:23.494703+0000, chain.objs.size()=1 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.YGfJ6R3BCZsl4LLjqNdREx1fUsY-Irs_0 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5190470227975842611', time=2024-09-12T03:18:38.261980+0000, chain.objs.size()=1 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.0UtRDNuJR-ZV3z-1-hrTU_uaIOs1VGq_0 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14413928918621531870', time=2024-09-12T03:18:40.709542+0000, chain.objs.size()=1 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zJxHQ3w2jifcVbdWsnksOFVWsrnszgt_0 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15466339933552144235', time=2024-09-12T03:18:40.711235+0000, chain.objs.size()=1 2024-09-12T02:06:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.mPV05m8BrJTks-NNOOba4K4j2CEHlPE_0 2024-09-12T02:06:44.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16099778104795225161', time=2024-09-12T03:18:46.314419+0000, chain.objs.size()=1 2024-09-12T02:06:44.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.osUzyvZcOWwiVoGaeYiv4V2whnm6aAV_0 2024-09-12T02:06:44.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3480630839642590472', time=2024-09-12T03:18:50.319965+0000, chain.objs.size()=1 2024-09-12T02:06:44.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MdDaMNqxBOBxROO4iv3ier4mg4IOnKJ_0 2024-09-12T02:06:44.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7953475589318960170', time=2024-09-12T03:18:50.501818+0000, chain.objs.size()=1 2024-09-12T02:06:44.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jo5ZITUrBNumtCEMir_lTwmj-HDZYzk_0 2024-09-12T02:06:44.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.954+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10582188745005904232', time=2024-09-12T03:18:51.095958+0000, chain.objs.size()=1 2024-09-12T02:06:44.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.954+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PNIK4icxda2cYXtVVBL3avaVUprskkl_0 2024-09-12T02:06:44.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4384093658409510881', time=2024-09-12T03:18:53.512721+0000, chain.objs.size()=1 2024-09-12T02:06:44.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UbKaTABkFkCNLMmrHDKZl-Rievxsvvp_0 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1222848041233531603', time=2024-09-12T03:18:53.863421+0000, chain.objs.size()=1 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.EiFGBC0w_O4UZAzvWvO2WhmMRxrYXjB_0 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.777836602079263237', time=2024-09-12T03:18:54.133775+0000, chain.objs.size()=1 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.E58idocc5obfHC9GAxfm6rq0vUggwiG_0 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2456832315436844862', time=2024-09-12T03:18:54.566091+0000, chain.objs.size()=1 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oM-og2nd-gZl_byqkduYi_LORwSNknA_0 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16500119359106395260', time=2024-09-12T03:18:56.549850+0000, chain.objs.size()=1 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.POfpgXa9MIU1bXqpXG96uXd1qRCe0KQ_0 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11795232076565579999', time=2024-09-12T03:18:58.662296+0000, chain.objs.size()=1 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BL0g9lHGB6dTr0JXTlSiJj5OU0lIZ5Y_0 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16228202993465910412', time=2024-09-12T03:18:59.045178+0000, chain.objs.size()=1 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Vim7n43kpVHrsxNbGobEdR0zeG_DI2w_0 2024-09-12T02:06:44.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.559327318567901007', time=2024-09-12T03:18:59.469470+0000, chain.objs.size()=1 2024-09-12T02:06:44.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eWLtZZjxVwoRp4YrCsKBMiXQIeo2wa6_0 2024-09-12T02:06:44.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8720684664778266556', time=2024-09-12T03:18:59.779095+0000, chain.objs.size()=1 2024-09-12T02:06:44.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.bZZMjS8s-zlugHs8o0Ck7xbMTxFbufW_0 2024-09-12T02:06:44.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5424737122482135945', time=2024-09-12T03:19:01.390579+0000, chain.objs.size()=1 2024-09-12T02:06:44.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oLg9MGLCi21l1JAEAE1x7H-7HhdZ1lY_0 2024-09-12T02:06:44.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2344167979836711325', time=2024-09-12T03:19:03.361490+0000, chain.objs.size()=1 2024-09-12T02:06:44.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VnJV4G23l2zfzMoMWT3rZ3LfVxu98xV_0 2024-09-12T02:06:44.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14968180132385845232', time=2024-09-12T03:19:03.981494+0000, chain.objs.size()=1 2024-09-12T02:06:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.f2LRl1lxny69Yd16gHaKNsWbFnZvoyN_0 2024-09-12T02:06:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16678003775245742362', time=2024-09-12T03:19:06.025914+0000, chain.objs.size()=1 2024-09-12T02:06:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3zhVfklLslphw0Czbg4knBAvCrX66eD_0 2024-09-12T02:06:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5467580841009836446', time=2024-09-12T03:19:06.189765+0000, chain.objs.size()=1 2024-09-12T02:06:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.s8biw2wFwSjKh8S6nJJlgpmLCA0OALI_0 2024-09-12T02:06:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17583890492806618296', time=2024-09-12T03:19:06.191876+0000, chain.objs.size()=1 2024-09-12T02:06:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MTyqrQxYWXuo4WZGni9KZevpG__sAEU_0 2024-09-12T02:06:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9329877341155486867', time=2024-09-12T03:19:07.185147+0000, chain.objs.size()=1 2024-09-12T02:06:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2pCMnqIq10xEEBrw3mlj21Nu6bKzvvG_0 2024-09-12T02:06:44.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14345235960479537717', time=2024-09-12T03:20:54.260545+0000, chain.objs.size()=1 2024-09-12T02:06:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.94Xr5EL-lNztwx9eq_4JYlr1YE4rdC8_0 2024-09-12T02:06:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7525560813592170558', time=2024-09-12T03:20:54.888558+0000, chain.objs.size()=1 2024-09-12T02:06:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pqI2w41UVR8qQnUuVbFJgPOrz9P8Avw_0 2024-09-12T02:06:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2365303288451348941', time=2024-09-12T03:20:55.066864+0000, chain.objs.size()=1 2024-09-12T02:06:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RSDYt8lIrn9YG4ZUUUuYXWVCAGCgLoJ_0 2024-09-12T02:06:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18094356068574472697', time=2024-09-12T03:20:57.210949+0000, chain.objs.size()=1 2024-09-12T02:06:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.t2VTrZVd3jkjmIRHuq6NqAvn_u_gbxT_0 2024-09-12T02:06:44.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6859632579708541280', time=2024-09-12T03:21:00.312853+0000, chain.objs.size()=1 2024-09-12T02:06:44.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.jSoKN04hCEXZKcgsgUuABEJALHYO8qJ_0 2024-09-12T02:06:44.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5860145528025107417', time=2024-09-12T03:21:03.010385+0000, chain.objs.size()=1 2024-09-12T02:06:44.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.BYeFzACWfBJ8wfKm2qpwb2nTLc7IqjS_0 2024-09-12T02:06:44.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12531218041636693467', time=2024-09-12T03:21:04.608583+0000, chain.objs.size()=1 2024-09-12T02:06:44.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IkJI8VcuBA89LZGfcO3ghTJz-wFSsXk_0 2024-09-12T02:06:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6977041478254809251', time=2024-09-12T03:21:05.019548+0000, chain.objs.size()=1 2024-09-12T02:06:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PdEDFmxMNpd4fqAgGPNRY8RpSaPtt_v_0 2024-09-12T02:06:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4443942108017780853', time=2024-09-12T03:21:05.177404+0000, chain.objs.size()=1 2024-09-12T02:06:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.UYzaqFu92qXuvfS1LWvp2dIV89usI5__0 2024-09-12T02:06:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11247203247511721128', time=2024-09-12T03:21:07.033444+0000, chain.objs.size()=1 2024-09-12T02:06:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wV4v7I36B93sOdYCwRlP0DRmerykEb4_0 2024-09-12T02:06:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18301164266366867975', time=2024-09-12T03:21:07.657894+0000, chain.objs.size()=1 2024-09-12T02:06:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pdDvrcbTF-rasN-AjIBkFPEqJZZ77O8_0 2024-09-12T02:06:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14950995692024850556', time=2024-09-12T03:21:09.137806+0000, chain.objs.size()=1 2024-09-12T02:06:44.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CZBLGFzgTsd2WbxhepV56WZQ5iWUwYk_0 2024-09-12T02:06:44.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10364016415053136773', time=2024-09-12T03:21:11.683281+0000, chain.objs.size()=1 2024-09-12T02:06:44.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.i57PhLnkB14WOovmSOWgnoEPkW2yj6U_0 2024-09-12T02:06:44.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18187024342402868695', time=2024-09-12T03:21:12.191574+0000, chain.objs.size()=1 2024-09-12T02:06:44.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6CA_rSADUlhC__MjEu7DGKIhfp-oWr-_0 2024-09-12T02:06:44.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5932169117634893150', time=2024-09-12T03:21:12.220870+0000, chain.objs.size()=1 2024-09-12T02:06:44.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Ul35iYNh6hEdAnrof7xVG-FFgXLywwi_0 2024-09-12T02:06:44.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6697292431131588385', time=2024-09-12T03:21:12.959765+0000, chain.objs.size()=1 2024-09-12T02:06:44.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fEiKgYx0P2EokLZOr-OBIDrurBRgpKS_0 2024-09-12T02:06:44.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13232353950591783432', time=2024-09-12T03:21:13.412939+0000, chain.objs.size()=1 2024-09-12T02:06:44.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.KeyWcieNhd9nLJqDfhujkJCbIvDhJm9_0 2024-09-12T02:06:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15698562289514522206', time=2024-09-12T03:21:14.333062+0000, chain.objs.size()=1 2024-09-12T02:06:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Q5hw8XzW1GE9Qm5E6ARleFt14kct-YB_0 2024-09-12T02:06:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8908023468842537992', time=2024-09-12T03:21:16.015233+0000, chain.objs.size()=1 2024-09-12T02:06:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-Dd-cFbayTiEZ01uqJRKEQB8athP8nP_0 2024-09-12T02:06:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15152295634907482381', time=2024-09-12T03:21:16.844413+0000, chain.objs.size()=1 2024-09-12T02:06:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.M0anJcfyEXkiQTbT0Yt4cwYoKL4hx26_0 2024-09-12T02:06:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7394460946817049575', time=2024-09-12T03:21:17.678906+0000, chain.objs.size()=1 2024-09-12T02:06:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.TorSOJy1lTyGM-Eh_WIAk5j-lNPBv6l_0 2024-09-12T02:06:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7897196139433763872', time=2024-09-12T03:21:17.799067+0000, chain.objs.size()=1 2024-09-12T02:06:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Nxz-fW1LQ6Ar-ZMbH91vcwQqnWuaIcj_0 2024-09-12T02:06:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17898894560943787140', time=2024-09-12T03:21:18.422131+0000, chain.objs.size()=1 2024-09-12T02:06:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Ws8PoBEMrI8r6WBVoz2QHCxeSFKvjhr_0 2024-09-12T02:06:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15333583147769907095', time=2024-09-12T03:21:19.705582+0000, chain.objs.size()=1 2024-09-12T02:06:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.U7ExRdJjFRA5gk0IZ3_iv9CtmD3FYZq_0 2024-09-12T02:06:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9857830985930901061', time=2024-09-12T03:21:19.707261+0000, chain.objs.size()=1 2024-09-12T02:06:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zvis-riUmsH_CsHEPiUUMMb61azRSq6_0 2024-09-12T02:06:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11238231763718712416', time=2024-09-12T03:21:20.010306+0000, chain.objs.size()=1 2024-09-12T02:06:44.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.m8849C6nURBHfI8FYfrlHSyClr8DW3__0 2024-09-12T02:06:44.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8358903634395972042', time=2024-09-12T03:21:21.017338+0000, chain.objs.size()=1 2024-09-12T02:06:44.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pI8lgD-aOVxNWvsn3bWJiV4bR7Lh045_0 2024-09-12T02:06:44.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2396871085547284689', time=2024-09-12T03:21:21.019155+0000, chain.objs.size()=1 2024-09-12T02:06:44.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dXYu4CSWlJ5TzeyPWpVWPobNhDLWUX2_0 2024-09-12T02:06:44.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1063859019868693720', time=2024-09-12T03:21:21.162574+0000, chain.objs.size()=1 2024-09-12T02:06:44.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MMgErsyyB_YKZx-dOykYSNE6reHd8Pc_0 2024-09-12T02:06:44.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9749562482825789323', time=2024-09-12T03:21:22.015481+0000, chain.objs.size()=1 2024-09-12T02:06:44.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.SWrOLQKyVjO8ENu0ZPek77t3DvOatn2_0 2024-09-12T02:06:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4676326471414366757', time=2024-09-12T03:21:23.599269+0000, chain.objs.size()=1 2024-09-12T02:06:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fQGTC5Pg3BeHtGzPz1rSAmMxhv2yNYz_0 2024-09-12T02:06:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5598690631384550742', time=2024-09-12T03:21:23.709819+0000, chain.objs.size()=1 2024-09-12T02:06:44.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tXO84mXqt3P7w_S2chBqfdyUAafYTHP_0 2024-09-12T02:06:44.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4918342836055826459', time=2024-09-12T03:21:23.980180+0000, chain.objs.size()=1 2024-09-12T02:06:44.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RGNYdW5lCfo2qTwqLsl9eeMGzWIbPNK_0 2024-09-12T02:06:44.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.271182178185579596', time=2024-09-12T03:21:25.293820+0000, chain.objs.size()=1 2024-09-12T02:06:44.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Xg3P248a5QfngbB-Wtyqh51yAET4CU9_0 2024-09-12T02:06:44.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3050134383968562519', time=2024-09-12T03:21:34.033163+0000, chain.objs.size()=1 2024-09-12T02:06:44.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.329__shadow_.dolC53oLYqYpovBjDImoh8dOeqoxW9w_0 2024-09-12T02:06:44.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16601323625110919294', time=2024-09-12T03:21:44.729871+0000, chain.objs.size()=1 2024-09-12T02:06:44.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.334__shadow_.i7yoK21-0-pCVRfBjgLeNRcNST_tL1S_0 2024-09-12T02:06:44.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9968042442218465838', time=2024-09-12T03:26:21.229209+0000, chain.objs.size()=1 2024-09-12T02:06:44.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.457__shadow_.jlqhUp0WqVNqZAK9rGHqBnLVU3GC6nm_0 2024-09-12T02:06:44.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51724 2024-09-12T02:06:45.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T02:06:45.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8587061918765827631', time=2024-09-12T03:26:37.215816+0000, chain.objs.size()=1 2024-09-12T02:06:45.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.462__shadow_.SXvZtJ3AgvkQCjn-ElLOyCWYQiXcQJp_0 2024-09-12T02:06:45.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.355923085088766353', time=2024-09-12T03:27:21.955879+0000, chain.objs.size()=1 2024-09-12T02:06:45.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.cvZG-dows0LR4SA5PxbFxo9WB85k5cG_0 2024-09-12T02:06:45.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7658229994240911210', time=2024-09-12T03:27:24.895075+0000, chain.objs.size()=1 2024-09-12T02:06:45.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.485__shadow_.fsPeHtAgzqRO2bB1gKpGbez65iY54a__0 2024-09-12T02:06:45.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10163967782029527118', time=2024-09-12T03:27:56.968140+0000, chain.objs.size()=1 2024-09-12T02:06:45.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.497__shadow_.U1X9hqWOmRkbJySDFX5dikJ0KH9P33G_0 2024-09-12T02:06:45.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7025773254327406685', time=2024-09-12T03:28:54.010489+0000, chain.objs.size()=6 2024-09-12T02:06:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.1 2024-09-12T02:06:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.2 2024-09-12T02:06:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.3 2024-09-12T02:06:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.4 2024-09-12T02:06:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.5 2024-09-12T02:06:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.6 2024-09-12T02:06:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7459805195832455600', time=2024-09-12T03:35:14.607306+0000, chain.objs.size()=2 2024-09-12T02:06:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~Zdb1beQjnvt_1HminGDDnMiu2iOywL7.1 2024-09-12T02:06:45.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:44.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~Zdb1beQjnvt_1HminGDDnMiu2iOywL7.2 2024-09-12T02:06:45.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.002+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11896769522970419689', time=2024-09-12T03:36:02.775720+0000, chain.objs.size()=2 2024-09-12T02:06:45.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.529__multipart_mymultipart.2~z-7uN1C6R1dtiCLsc_VH9kDDyoIBOkd.1 2024-09-12T02:06:45.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.529__multipart_mymultipart.2~z-7uN1C6R1dtiCLsc_VH9kDDyoIBOkd.2 2024-09-12T02:06:45.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.002+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12806554037606226768', time=2024-09-12T03:39:08.516587+0000, chain.objs.size()=1 2024-09-12T02:06:45.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.559__shadow_.H2tj2BFnxmnyJCicRRLiHGEELIzOtmc_0 2024-09-12T02:06:45.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14224667094473995335', time=2024-09-12T03:39:52.376508+0000, chain.objs.size()=1 2024-09-12T02:06:45.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:AHRE2UClQ22qgIWrd73zeAyTYdSkPoN_.U2M5Chr-pK_FZUtsSzZMw-bpF76c6h4_0 2024-09-12T02:06:45.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2307025247941929668', time=2024-09-12T03:40:32.323730+0000, chain.objs.size()=1 2024-09-12T02:06:45.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow:iochirXQB45XlnpPUDG7p9EhT5UgaAP_.38ov9GGPxOGQfZ6YxRL3i83G7WvyYTY_0 2024-09-12T02:06:45.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13018205993538181003', time=2024-09-12T03:41:03.468059+0000, chain.objs.size()=1 2024-09-12T02:06:45.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:FBQyRq7SP4gxecrAtt2QGlfyw.okw-u_.o5JBRG7aWt5OYPgOZOGG9R_JAQf_o9e_0 2024-09-12T02:06:45.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15727497467952457647', time=2024-09-12T03:41:09.529461+0000, chain.objs.size()=1 2024-09-12T02:06:45.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:12tEW-vnnlEk.merTbBk15R2xkl1SNy_.HxUfe_z4ykjyo6ssNi5GQDsqTNZ0Q9Q_0 2024-09-12T02:06:45.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12456339856984583082', time=2024-09-12T03:41:22.266361+0000, chain.objs.size()=1 2024-09-12T02:06:45.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:iWyj9xhu3Q5ZXnhUpNhEcGvZlWbg4pG_.mn-x6m27dRfR822UhA5W32zUbjYni3h_0 2024-09-12T02:06:45.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15929767812602356071', time=2024-09-12T03:42:30.540677+0000, chain.objs.size()=4 2024-09-12T02:06:45.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~ir2gcfjYRN5atak21RkgYS6Ud9rkin_.1 2024-09-12T02:06:45.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~ir2gcfjYRN5atak21RkgYS6Ud9rkin_.2 2024-09-12T02:06:45.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~ir2gcfjYRN5atak21RkgYS6Ud9rkin_.3 2024-09-12T02:06:45.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~ir2gcfjYRN5atak21RkgYS6Ud9rkin_.4 2024-09-12T02:06:45.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13588487391939922947', time=2024-09-12T03:42:36.918178+0000, chain.objs.size()=1 2024-09-12T02:06:45.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.580__shadow:djB3wD9hEPc6798hq13F7XPfKAT1LQ0_.Dl6Kju2jo5Iz4uhDxKqbd3MD3_IWOMJ_0 2024-09-12T02:06:45.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3779417134682743472', time=2024-09-12T03:53:15.105448+0000, chain.objs.size()=1 2024-09-12T02:06:45.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.667__shadow_.vPQ2JSNPkDlndT_oqxDJlUhgJFAFIWy_0 2024-09-12T02:06:45.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10093829672047604397', time=2024-09-12T03:54:05.689355+0000, chain.objs.size()=1 2024-09-12T02:06:45.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.693__shadow:YsHR-LHoa8o56NACeg1dbzYCoVvU-ZZ_.5msj3PuMwIISe4rs_OXXbjOeNyzGbJ6_0 2024-09-12T02:06:45.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18208431941189960799', time=2024-09-12T03:54:51.349430+0000, chain.objs.size()=1 2024-09-12T02:06:45.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.713__shadow:NDkQoZj8A8DIEwJsexsSduVyn7LS3BR_.fCo0hFNGap-1OUTcEl-Un5oqR1fXhYW_0 2024-09-12T02:06:45.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15521976984446780601', time=2024-09-12T03:54:56.020716+0000, chain.objs.size()=1 2024-09-12T02:06:45.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.010+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.715__shadow:18S1lpkIviUqsMdPcIayKwcnnQd5ZAI_.jPLaOLwvkK5V-vzneTQ7e-e-Rg1Tp4K_0 2024-09-12T02:06:45.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:45.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T02:06:45.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:45.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:45.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51291' 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_j125h0DM8_3C--MjbrNMYy8HdjnWsbf', time=2024-09-12T03:04:34.640356+0000, chain.objs.size()=3 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.haM5p-UNOtyj55AcZu0Cp9vtno1xfvZ_0 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.haM5p-UNOtyj55AcZu0Cp9vtno1xfvZ_1 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.haM5p-UNOtyj55AcZu0Cp9vtno1xfvZ_2 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3093423882787814019', time=2024-09-12T03:05:07.064580+0000, chain.objs.size()=1 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.171__shadow_.NDBBS2lg7bziXkqgyvlxX3IZ6iAMtnE_0 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7068205133808215852', time=2024-09-12T03:11:14.577529+0000, chain.objs.size()=1 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.248__shadow_.kKxFPIRcyAVHqMtz0XKS7-KuCB52v-i_0 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14451793824853684697', time=2024-09-12T03:11:49.338672+0000, chain.objs.size()=1 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.262__shadow_.VmuygkHl4RPW-VUbgP06kola-3KA3u1_0 2024-09-12T02:06:45.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16277318205744424608', time=2024-09-12T03:13:34.771928+0000, chain.objs.size()=1 2024-09-12T02:06:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.WdkQS2CrdG3BkxK8nUnhqYYLtp-QB0Y_0 2024-09-12T02:06:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5394513697177353122', time=2024-09-12T03:13:37.250543+0000, chain.objs.size()=1 2024-09-12T02:06:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GwP-efn2Kk790NjP3VgrR6y1vBD53mQ_0 2024-09-12T02:06:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12045846863368853706', time=2024-09-12T03:13:40.126391+0000, chain.objs.size()=1 2024-09-12T02:06:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.IV5TCf4jjp-FAlB0_H1K1n2x10yXuU8_0 2024-09-12T02:06:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4776642275678925666', time=2024-09-12T03:13:40.779948+0000, chain.objs.size()=1 2024-09-12T02:06:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cI-EvHX7MDnw6CbO2GzAaWWM3ATNquK_0 2024-09-12T02:06:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3407012945696413509', time=2024-09-12T03:13:41.496860+0000, chain.objs.size()=1 2024-09-12T02:06:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3h9YTj_o9_XKIX6h4ZMYZq-pnGgI04P_0 2024-09-12T02:06:45.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3078574505569535617', time=2024-09-12T03:13:42.386611+0000, chain.objs.size()=1 2024-09-12T02:06:45.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GvaTHbJvgM5XIZqMRgqdDzjJTiRD1H__0 2024-09-12T02:06:45.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8378777542046942035', time=2024-09-12T03:13:43.268075+0000, chain.objs.size()=1 2024-09-12T02:06:45.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mXNBaJsTlDaOvLVyj2Jv819e63RT1Dr_0 2024-09-12T02:06:45.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4452974902948739521', time=2024-09-12T03:13:43.398513+0000, chain.objs.size()=1 2024-09-12T02:06:45.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4d4s8OGH8r99ZhsG4jreNiTT9XIfOyj_0 2024-09-12T02:06:45.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10911170290144879889', time=2024-09-12T03:13:44.007840+0000, chain.objs.size()=1 2024-09-12T02:06:45.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.j5HblrnxpkGjqcuLnpr1sr5u6mmU62a_0 2024-09-12T02:06:45.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13054954008407149483', time=2024-09-12T03:13:44.145566+0000, chain.objs.size()=1 2024-09-12T02:06:45.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JNoE0-Y-lO4JWpHq14KPVxnZZWouo4X_0 2024-09-12T02:06:45.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14865402345554314102', time=2024-09-12T03:13:45.125468+0000, chain.objs.size()=1 2024-09-12T02:06:45.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.db6eDFXz9CiCi_9Wb_TEUovCk3ObD6C_0 2024-09-12T02:06:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14793071543119707195', time=2024-09-12T03:13:45.497717+0000, chain.objs.size()=1 2024-09-12T02:06:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mMKHKq4VUHW5I0cJ0nn4fydf1suUdHQ_0 2024-09-12T02:06:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17108278546595524384', time=2024-09-12T03:13:46.633571+0000, chain.objs.size()=1 2024-09-12T02:06:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Tl0_lk1zdvyZYl4e0N4NDcBaSpTxf5i_0 2024-09-12T02:06:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16088551867933941016', time=2024-09-12T03:13:47.456348+0000, chain.objs.size()=1 2024-09-12T02:06:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jkIbhx_ODrCpBVmxZBFQ1yAv7A3u2WP_0 2024-09-12T02:06:45.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17972550186472923313', time=2024-09-12T03:13:47.601312+0000, chain.objs.size()=1 2024-09-12T02:06:45.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xlKsjn5Wta49csZTu6Zdk8l_BDaxS6I_0 2024-09-12T02:06:45.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1347577579844490472', time=2024-09-12T03:13:47.849528+0000, chain.objs.size()=1 2024-09-12T02:06:45.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.s-HGmRUSHuoPqwVuvqDkD1hCiKJjMUL_0 2024-09-12T02:06:45.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3271954065198431357', time=2024-09-12T03:13:47.998945+0000, chain.objs.size()=1 2024-09-12T02:06:45.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.B_Eh_DiN1Bu5kWuaLgEneO7-dzpSAtC_0 2024-09-12T02:06:45.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.038+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3043118407645655084', time=2024-09-12T03:13:49.824725+0000, chain.objs.size()=1 2024-09-12T02:06:45.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.038+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vyvV9Nzo67pVosQsWaUd1BfjDh9Sesn_0 2024-09-12T02:06:45.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.038+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11301340125457339419', time=2024-09-12T03:13:50.876359+0000, chain.objs.size()=1 2024-09-12T02:06:45.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.038+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.SNicoxDvKyXkrrd9T7qhHXlZRfnfK3X_0 2024-09-12T02:06:45.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.038+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9355826501818358156', time=2024-09-12T03:13:53.233691+0000, chain.objs.size()=1 2024-09-12T02:06:45.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.038+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hr8pK-OaLGIGVXzvhnWp2mXrFh1IMwE_0 2024-09-12T02:06:45.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10548899777836782214', time=2024-09-12T03:13:53.478750+0000, chain.objs.size()=1 2024-09-12T02:06:45.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.EJOW_PK5vjvJq4MQfV_7mi9xgJxXuU__0 2024-09-12T02:06:45.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6813783762864251722', time=2024-09-12T03:13:54.738135+0000, chain.objs.size()=1 2024-09-12T02:06:45.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.dkqCtrAe3uJ3eToCp_Fknm0kiziJ9Lg_0 2024-09-12T02:06:45.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17986444557354699479', time=2024-09-12T03:13:55.199803+0000, chain.objs.size()=1 2024-09-12T02:06:45.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.fo83Mxj1cFySdQpqfHKcxGgYtOaAijd_0 2024-09-12T02:06:45.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10668258497271968724', time=2024-09-12T03:13:56.117656+0000, chain.objs.size()=1 2024-09-12T02:06:45.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tD3I4FOh16vblQft6JXv_weNqsEaC5Y_0 2024-09-12T02:06:45.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7642797527699600636', time=2024-09-12T03:13:56.383942+0000, chain.objs.size()=1 2024-09-12T02:06:45.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aQU9aMop_KU45aIbrak8WmtIMFF_qVQ_0 2024-09-12T02:06:45.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5924361836787515216', time=2024-09-12T03:13:56.643676+0000, chain.objs.size()=1 2024-09-12T02:06:45.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.XkyAVwg-bJYsj1CHG8l5YK8XKFqaS1K_0 2024-09-12T02:06:45.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3412400770928273175', time=2024-09-12T03:13:57.275911+0000, chain.objs.size()=1 2024-09-12T02:06:45.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.54DkOTvdowNkwE1OmZ9LNP2WZRt9QXR_0 2024-09-12T02:06:45.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11866559257548412850', time=2024-09-12T03:13:57.470641+0000, chain.objs.size()=1 2024-09-12T02:06:45.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ukjgqx9y6iuInKyC2CpYQgTCg2ZJxdK_0 2024-09-12T02:06:45.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.416961026608018437', time=2024-09-12T03:13:59.593562+0000, chain.objs.size()=1 2024-09-12T02:06:45.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.kmV3-FDHfEOg7WHzpqiz5v-w9MgzcNL_0 2024-09-12T02:06:45.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4923034072270695191', time=2024-09-12T03:14:00.264861+0000, chain.objs.size()=1 2024-09-12T02:06:45.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ks3rvwpYkDqwIKxLUQJ_beS-lsCWDGq_0 2024-09-12T02:06:45.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12073332919238522982', time=2024-09-12T03:14:00.873700+0000, chain.objs.size()=1 2024-09-12T02:06:45.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6aOMMmeEIyqDI7L_HB2XDj__U61yCVl_0 2024-09-12T02:06:45.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8131448665014526183', time=2024-09-12T03:14:03.250664+0000, chain.objs.size()=1 2024-09-12T02:06:45.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.OVzlC87ZZ2qmHOcrXHx_5_0sZpYpaLb_0 2024-09-12T02:06:45.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.468367037749894865', time=2024-09-12T03:14:03.261623+0000, chain.objs.size()=1 2024-09-12T02:06:45.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xMcCUc_wSBkkRcfAdRoPeBr5JXU8vkP_0 2024-09-12T02:06:45.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2274153683993406319', time=2024-09-12T03:14:04.412275+0000, chain.objs.size()=1 2024-09-12T02:06:45.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.yRPe3J6UBn5HOQshYqrHeP962f6K0WP_0 2024-09-12T02:06:45.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13424549114328255223', time=2024-09-12T03:14:04.613459+0000, chain.objs.size()=1 2024-09-12T02:06:45.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QUTmCWYxiNqW31Ty1VtAuDjKyeshYlS_0 2024-09-12T02:06:45.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4506477847350583606', time=2024-09-12T03:14:05.211466+0000, chain.objs.size()=1 2024-09-12T02:06:45.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.eeWo2s08kcuBnfSj5CMLij3EqRLjauV_0 2024-09-12T02:06:45.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15365870552940172678', time=2024-09-12T03:14:05.325769+0000, chain.objs.size()=1 2024-09-12T02:06:45.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3JSh0ZuHp52P0ltvIAoRT_DnnumZJiK_0 2024-09-12T02:06:45.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7847015212875377578', time=2024-09-12T03:14:41.758953+0000, chain.objs.size()=1 2024-09-12T02:06:45.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.278__shadow_.b5gYT6Ls4uSfWW-6FNkK9o5MWV_TtR-_0 2024-09-12T02:06:45.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17710870985557534435', time=2024-09-12T03:15:23.496002+0000, chain.objs.size()=1 2024-09-12T02:06:45.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.31u5c5XFnaF_mvymf1_Op9Yj-V-Fkps_0 2024-09-12T02:06:45.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6351394949760790707', time=2024-09-12T03:15:29.773610+0000, chain.objs.size()=1 2024-09-12T02:06:45.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.uD-atnjUQNxE1sln9hc2Gh5QBS1U5Ca_0 2024-09-12T02:06:45.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4770299332440540208', time=2024-09-12T03:15:37.376936+0000, chain.objs.size()=1 2024-09-12T02:06:45.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.297__shadow_.keraiuRzYb8TEjwGZc_lqRSA5LdBacS_0 2024-09-12T02:06:45.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3577867495479939978', time=2024-09-12T03:16:06.893485+0000, chain.objs.size()=1 2024-09-12T02:06:45.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.308__shadow:E-Gw4eZ1YuF6rSgTbN7rqyH3a4lHwlE_.XKgOJamZ9qE7EvzTtAFL9-ZAIuulZWu_0 2024-09-12T02:06:45.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18136447030210850855', time=2024-09-12T03:18:36.394955+0000, chain.objs.size()=1 2024-09-12T02:06:45.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CtNfW5QEnv1piczxRI_00GAhN1BZ3e9_0 2024-09-12T02:06:45.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.058+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1328741630030020746', time=2024-09-12T03:18:36.425902+0000, chain.objs.size()=1 2024-09-12T02:06:45.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PV38ZXCpiuuKuwanhMY4F_bHgS2fzTI_0 2024-09-12T02:06:45.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.058+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4542178640066097577', time=2024-09-12T03:18:37.061609+0000, chain.objs.size()=1 2024-09-12T02:06:45.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.rJM4UYKwAD255FpSDBaE4Pji71UELnE_0 2024-09-12T02:06:45.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.058+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3100457999047047945', time=2024-09-12T03:18:37.063849+0000, chain.objs.size()=1 2024-09-12T02:06:45.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MGfWWejx3nIfetM1EoQwWP-HMBTv98O_0 2024-09-12T02:06:45.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.058+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6045303032126614638', time=2024-09-12T03:18:38.170820+0000, chain.objs.size()=1 2024-09-12T02:06:45.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-LrUpE5O3WGnOpgSCyIKOAF9DEwQ5kA_0 2024-09-12T02:06:45.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15366749194160583040', time=2024-09-12T03:18:41.298099+0000, chain.objs.size()=1 2024-09-12T02:06:45.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fpeE1DZ2si5MYXsUjIySFoY-x2p6RGq_0 2024-09-12T02:06:45.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3970773733852292399', time=2024-09-12T03:18:41.301466+0000, chain.objs.size()=1 2024-09-12T02:06:45.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8VuGk_28t48COaaUG32vVwSU7sWJFju_0 2024-09-12T02:06:45.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1349349467435858437', time=2024-09-12T03:18:41.758715+0000, chain.objs.size()=1 2024-09-12T02:06:45.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yP9nRngTL_J16StjRQ0nFA-Lu1zosGg_0 2024-09-12T02:06:45.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11722864612003256282', time=2024-09-12T03:18:42.454395+0000, chain.objs.size()=1 2024-09-12T02:06:45.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.uXRHIMHFEe80_m7qHTPPv2o2RhsimFr_0 2024-09-12T02:06:45.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8626385108803179121', time=2024-09-12T03:18:45.452665+0000, chain.objs.size()=1 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.DhLnWwnBmL69ar7qo_p7q3HmWICjMCQ_0 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9327896231184951312', time=2024-09-12T03:18:46.475668+0000, chain.objs.size()=1 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.mO0pQyKs2lfCGn0u5ojXzwIvW8PhAdp_0 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3040475345692951838', time=2024-09-12T03:18:46.477464+0000, chain.objs.size()=1 2024-09-12T02:06:45.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.x0sY0zRHqUjxp-2do3uKVpCZFsM6TJx_0 2024-09-12T02:06:45.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4197137848166062889', time=2024-09-12T03:18:46.773565+0000, chain.objs.size()=1 2024-09-12T02:06:45.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6s1dYwX8x_-o0QlJs3rzDi95ELMOmvK_0 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17657880520663827882', time=2024-09-12T03:18:46.929235+0000, chain.objs.size()=1 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.r9FvyOPZoE29B5hWWNT2-x186AlZ0x6_0 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3784953369375925868', time=2024-09-12T03:18:48.177374+0000, chain.objs.size()=1 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eJgbXo4TzWzdcfKaXItDhZyxiLBCnSw_0 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3592355669564508333', time=2024-09-12T03:18:49.280963+0000, chain.objs.size()=1 2024-09-12T02:06:45.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OOFa6QMwKp3OAc18A5AyEgAfdEmYjFd_0 2024-09-12T02:06:45.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7793302812016850138', time=2024-09-12T03:18:49.667125+0000, chain.objs.size()=1 2024-09-12T02:06:45.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qp0K1pcC1RdHwhcK4r_tkej5LbuJxsO_0 2024-09-12T02:06:45.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11525816382860262232', time=2024-09-12T03:18:49.770428+0000, chain.objs.size()=1 2024-09-12T02:06:45.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PrDYhQnrmOxgwLS4UQIxfRchWyju6CD_0 2024-09-12T02:06:45.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15070376320259675378', time=2024-09-12T03:18:53.328736+0000, chain.objs.size()=1 2024-09-12T02:06:45.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.J57vnBSXZ8fVYW_OmOhmnvyCjl-PMPB_0 2024-09-12T02:06:45.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8805705736738068952', time=2024-09-12T03:18:54.802720+0000, chain.objs.size()=1 2024-09-12T02:06:45.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.XINROeqgeF3uSjHtdWa9YfppDvytRMK_0 2024-09-12T02:06:45.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13946738047542325058', time=2024-09-12T03:18:55.759201+0000, chain.objs.size()=1 2024-09-12T02:06:45.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.EkkHmsQP3dW9BISSmUUnFAL4F_48h76_0 2024-09-12T02:06:45.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13970120071131025722', time=2024-09-12T03:18:57.433039+0000, chain.objs.size()=1 2024-09-12T02:06:45.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xximlqUygSafo6X5gHfJoZ4Xe8Rv47e_0 2024-09-12T02:06:45.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12562188101309007130', time=2024-09-12T03:18:58.363306+0000, chain.objs.size()=1 2024-09-12T02:06:45.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qTaNaRYpfblfM1VExlbYTPUCE7QLxok_0 2024-09-12T02:06:45.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6456701746943466706', time=2024-09-12T03:18:59.229888+0000, chain.objs.size()=1 2024-09-12T02:06:45.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7LEXr4Fi7aEeIQ3Vp3svFELlkSEuuZb_0 2024-09-12T02:06:45.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8882553619543290844', time=2024-09-12T03:18:59.998696+0000, chain.objs.size()=1 2024-09-12T02:06:45.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.IHL1Z5ZkCz59uHyf9CtvcRvazpn9Ag-_0 2024-09-12T02:06:45.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1026483823197358460', time=2024-09-12T03:19:01.794800+0000, chain.objs.size()=1 2024-09-12T02:06:45.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.bFfZT22rH6gnRCKY_27K2NHMvYnHdGr_0 2024-09-12T02:06:45.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18086588271670440427', time=2024-09-12T03:19:02.204321+0000, chain.objs.size()=1 2024-09-12T02:06:45.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Lyvial6Mj9XxllkSFpreOjeu4NlP5Pt_0 2024-09-12T02:06:45.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7314188951849333819', time=2024-09-12T03:19:02.636454+0000, chain.objs.size()=1 2024-09-12T02:06:45.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.aFhmygY_3a14eXoKyYOs2iZCONSNY4l_0 2024-09-12T02:06:45.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1887664550640083258', time=2024-09-12T03:19:03.725576+0000, chain.objs.size()=1 2024-09-12T02:06:45.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hKCpbPcwqDKAsjOg0FdGzzrc_ZMYwag_0 2024-09-12T02:06:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12471674659500292122', time=2024-09-12T03:19:04.552203+0000, chain.objs.size()=1 2024-09-12T02:06:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UAA8Vz-yKpva4z-QYkMRp7ooIFINcY0_0 2024-09-12T02:06:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13451873362481292308', time=2024-09-12T03:19:05.914573+0000, chain.objs.size()=1 2024-09-12T02:06:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9Vm8-BluLIcFTPfE5gOolUWQCLn5Qd4_0 2024-09-12T02:06:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16323484470400694338', time=2024-09-12T03:19:06.161630+0000, chain.objs.size()=1 2024-09-12T02:06:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.27AbsJXNEtLkSgOtwuq1tpn_cUB-dam_0 2024-09-12T02:06:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4101435826217534361', time=2024-09-12T03:19:07.085472+0000, chain.objs.size()=1 2024-09-12T02:06:45.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BiI6J9dqWZDipd4tWKBOTah1IL7lbUp_0 2024-09-12T02:06:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3366639088914864092', time=2024-09-12T03:19:07.206025+0000, chain.objs.size()=1 2024-09-12T02:06:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5GTOtbZr5QBvcUumtYIG2OuhXt7xF40_0 2024-09-12T02:06:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9287975632291547046', time=2024-09-12T03:19:07.321232+0000, chain.objs.size()=1 2024-09-12T02:06:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.81cSeVfqqLtACK3yvsF4nouKqfO0iW9_0 2024-09-12T02:06:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3455245505223687945', time=2024-09-12T03:19:07.601664+0000, chain.objs.size()=1 2024-09-12T02:06:45.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.078+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Ud-70rU_IFxBUrPYlSzPevh_SSj8OF0_0 2024-09-12T02:06:45.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6482728279900159132', time=2024-09-12T03:20:55.283344+0000, chain.objs.size()=1 2024-09-12T02:06:45.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.KTJMdE88z5H0SE0FF03SLCMXaZ2Sz4f_0 2024-09-12T02:06:45.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16788889550970617269', time=2024-09-12T03:20:55.909431+0000, chain.objs.size()=1 2024-09-12T02:06:45.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.o1swl0ucrhwCJ5Dt7XYTmbuw35qYkpj_0 2024-09-12T02:06:45.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3471940044896307931', time=2024-09-12T03:20:57.320433+0000, chain.objs.size()=1 2024-09-12T02:06:45.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gii1h8ZHPzd-dubzghWc_OsrL5cb6hB_0 2024-09-12T02:06:45.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7986545150661783278', time=2024-09-12T03:20:58.877623+0000, chain.objs.size()=1 2024-09-12T02:06:45.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Cd6ad1s9qbhUv04YIxL3iQ0AYbN3ZhO_0 2024-09-12T02:06:45.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7669481578050042114', time=2024-09-12T03:20:59.475931+0000, chain.objs.size()=1 2024-09-12T02:06:45.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.T9DZ1Wj4yrEXc-pRikUsyBmA5-F6aEd_0 2024-09-12T02:06:45.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16245851523707318365', time=2024-09-12T03:21:00.533121+0000, chain.objs.size()=1 2024-09-12T02:06:45.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Mb7pTsae3wUUes7rmVbqc930lJKBUDz_0 2024-09-12T02:06:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6086257534375680713', time=2024-09-12T03:21:01.376225+0000, chain.objs.size()=1 2024-09-12T02:06:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fHoh0uYPtvMhPK92-Bz4jbIqim2UN4V_0 2024-09-12T02:06:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15273899828061470105', time=2024-09-12T03:21:01.811872+0000, chain.objs.size()=1 2024-09-12T02:06:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.64IylZDXS8Irfn8kMnSVxOEu4nzO4uL_0 2024-09-12T02:06:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10523462866899499986', time=2024-09-12T03:21:04.289336+0000, chain.objs.size()=1 2024-09-12T02:06:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.nwM7Z77kelR_G71TLfVnnQch3Akwevi_0 2024-09-12T02:06:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12782427656000458638', time=2024-09-12T03:21:05.088652+0000, chain.objs.size()=1 2024-09-12T02:06:45.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7N49BWpsHkvZRdDtZ2z-FBFucdeB9J1_0 2024-09-12T02:06:45.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7928368936033860259', time=2024-09-12T03:21:05.557843+0000, chain.objs.size()=1 2024-09-12T02:06:45.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.heLy3hTnFLcwxdYILHRgiTSfkYhSW87_0 2024-09-12T02:06:45.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13908849692752709118', time=2024-09-12T03:21:06.032556+0000, chain.objs.size()=1 2024-09-12T02:06:45.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XaVeN3EcxjldvxgM242pjYLDgUpP371_0 2024-09-12T02:06:45.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6928750360685182411', time=2024-09-12T03:21:07.284703+0000, chain.objs.size()=1 2024-09-12T02:06:45.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xgNCAhWRT4Jln41hBVieka00hfOnDrJ_0 2024-09-12T02:06:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4098382278143225171', time=2024-09-12T03:21:08.241767+0000, chain.objs.size()=1 2024-09-12T02:06:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bZGjoT4wBHnyKRUqwDp12cvtOwElmPE_0 2024-09-12T02:06:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8763568071261855756', time=2024-09-12T03:21:09.458741+0000, chain.objs.size()=1 2024-09-12T02:06:45.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NfxoR2vIykBuIiNqAarMiX-xCbHkdVt_0 2024-09-12T02:06:45.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6226009240238883623', time=2024-09-12T03:21:11.263686+0000, chain.objs.size()=1 2024-09-12T02:06:45.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bG3aV3QFlswzxV5CoZ1G8EUgQJHklnt_0 2024-09-12T02:06:45.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11636530156683820945', time=2024-09-12T03:21:12.220301+0000, chain.objs.size()=1 2024-09-12T02:06:45.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.k4b4EqX3Ya0ZAELEKWUreOjFraZRuxa_0 2024-09-12T02:06:45.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2672644334084086932', time=2024-09-12T03:21:13.096325+0000, chain.objs.size()=1 2024-09-12T02:06:45.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.nfHVa005j5nugl1_knqmougypEyMbc5_0 2024-09-12T02:06:45.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51291 2024-09-12T02:06:45.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-09-12T02:06:45.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15090891413563432552', time=2024-09-12T03:21:13.253128+0000, chain.objs.size()=1 2024-09-12T02:06:45.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CzG339j4Ad6xzSnvs3HzIFtwHFie8Z3_0 2024-09-12T02:06:45.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9997642025084103102', time=2024-09-12T03:21:13.478868+0000, chain.objs.size()=1 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zLJK_jgTXEVmZn7K1oxAEuZFnFAoesq_0 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15081329607665849158', time=2024-09-12T03:21:15.133586+0000, chain.objs.size()=1 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.u9ZDtkaQUMhHAhIXAFBSbZz01uNNjp7_0 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11093670863735758390', time=2024-09-12T03:21:15.188316+0000, chain.objs.size()=1 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.FWQT5gGTxS2g91zsktgavm3jyDu71eY_0 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17973204306520955719', time=2024-09-12T03:21:16.097735+0000, chain.objs.size()=1 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.22aDYAl-VWeC48UXFjcjKQ4D-je1Pw8_0 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8240799458955506726', time=2024-09-12T03:21:16.609280+0000, chain.objs.size()=1 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PMDCYP9eLxaAujgFhD45G16Eq4HzTKe_0 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16672867630624506549', time=2024-09-12T03:21:16.958583+0000, chain.objs.size()=1 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-x8OodrbTkI8--GiXn1dTzJdzmJAu1l_0 2024-09-12T02:06:45.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8819198342497578807', time=2024-09-12T03:21:18.325283+0000, chain.objs.size()=1 2024-09-12T02:06:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.oLZAkN68yuzVvhnHOfcCEKmjX8DUN-A_0 2024-09-12T02:06:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17005788698772231947', time=2024-09-12T03:21:21.126305+0000, chain.objs.size()=1 2024-09-12T02:06:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wbJ9a-dnutKFAEcrb7YGjKwhWYie19t_0 2024-09-12T02:06:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7567937109318737920', time=2024-09-12T03:21:21.660881+0000, chain.objs.size()=1 2024-09-12T02:06:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yzKshKkX5GR9DtuQmaPpsuJwV4QJ7UT_0 2024-09-12T02:06:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7873040541084332677', time=2024-09-12T03:21:22.314778+0000, chain.objs.size()=1 2024-09-12T02:06:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.mFi8wgxtu7NHFiuS3zMEvHThK4TKzxU_0 2024-09-12T02:06:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15291329450696701050', time=2024-09-12T03:21:23.189273+0000, chain.objs.size()=1 2024-09-12T02:06:45.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.uijs4W3eysa6Ug2eQeKt_DsBOnwSvNc_0 2024-09-12T02:06:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12388341239426588766', time=2024-09-12T03:21:23.612844+0000, chain.objs.size()=1 2024-09-12T02:06:45.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0RvyNVNZNUE7YWiWZGdetJAbUc_7eal_0 2024-09-12T02:06:45.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1232268732728831108', time=2024-09-12T03:21:24.552972+0000, chain.objs.size()=1 2024-09-12T02:06:45.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CAS6fqEftbJvTKYC8Xc_B4UruklMukY_0 2024-09-12T02:06:45.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2456475171078990985', time=2024-09-12T03:21:24.737733+0000, chain.objs.size()=1 2024-09-12T02:06:45.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ulikPz3rmux8hEOCXK6MPkshafB819Z_0 2024-09-12T02:06:45.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5701924158614750691', time=2024-09-12T03:22:59.066702+0000, chain.objs.size()=1 2024-09-12T02:06:45.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.370__shadow_.5gh6WcKhrOlM55Y4XLOWKXRViqnL-3r_0 2024-09-12T02:06:45.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8337615932706671381', time=2024-09-12T03:26:49.303606+0000, chain.objs.size()=1 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.466__shadow_.9kaP1f4r6NgUsjen1ps7Cka6ArZJWKA_0 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2511624082235640927', time=2024-09-12T03:27:21.999504+0000, chain.objs.size()=1 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.Lhogjjsm4jElYNjcWgzSd4DtJldq7Fu_0 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17714080287544698809', time=2024-09-12T03:27:42.957242+0000, chain.objs.size()=1 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.490__shadow_.6Pd1l1glz8bMHVoRS6GeRgYvwqO88Pn_0 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4049698292545691993', time=2024-09-12T03:29:31.420701+0000, chain.objs.size()=1 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.519__multipart_mymultipart.2~9Y1dxOilZlnlWVb97dahYaZZvtinvvE.1 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.790190399085965427', time=2024-09-12T03:31:11.834833+0000, chain.objs.size()=6 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__multipart_mymultipart.2~hI3zww2sS6Mx-E4rU_2IOH3QEhHNrmm.1 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__shadow_mymultipart.2~hI3zww2sS6Mx-E4rU_2IOH3QEhHNrmm.1_1 2024-09-12T02:06:45.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__multipart_mymultipart.2~hI3zww2sS6Mx-E4rU_2IOH3QEhHNrmm.2 2024-09-12T02:06:45.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__shadow_mymultipart.2~hI3zww2sS6Mx-E4rU_2IOH3QEhHNrmm.2_1 2024-09-12T02:06:45.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__multipart_mymultipart.2~hI3zww2sS6Mx-E4rU_2IOH3QEhHNrmm.3 2024-09-12T02:06:45.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__shadow_mymultipart.2~hI3zww2sS6Mx-E4rU_2IOH3QEhHNrmm.3_1 2024-09-12T02:06:45.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q', time=2024-09-12T03:34:13.362354+0000, chain.objs.size()=1 2024-09-12T02:06:45.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q.1 2024-09-12T02:06:45.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q', time=2024-09-12T03:34:13.372122+0000, chain.objs.size()=1 2024-09-12T02:06:45.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q.2 2024-09-12T02:06:45.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q', time=2024-09-12T03:34:13.381709+0000, chain.objs.size()=1 2024-09-12T02:06:45.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q.3 2024-09-12T02:06:45.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q', time=2024-09-12T03:34:13.391074+0000, chain.objs.size()=1 2024-09-12T02:06:45.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q.4 2024-09-12T02:06:45.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q', time=2024-09-12T03:34:13.400443+0000, chain.objs.size()=1 2024-09-12T02:06:45.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q.5 2024-09-12T02:06:45.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q', time=2024-09-12T03:34:13.409837+0000, chain.objs.size()=1 2024-09-12T02:06:45.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~tJTE3_LCOUUK1c2XuUuon0zbxw-q34Q.6 2024-09-12T02:06:45.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10491551334438522087', time=2024-09-12T03:35:11.005478+0000, chain.objs.size()=1 2024-09-12T02:06:45.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~f1rfwLb42LItwpZra0Fhv7cDP_bveTv.1 2024-09-12T02:06:45.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15878733557411415732', time=2024-09-12T03:36:00.959016+0000, chain.objs.size()=1 2024-09-12T02:06:45.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.529__shadow_.2qBang5vMjK4Zg7emTWF2lKlg8PD3vr_0 2024-09-12T02:06:45.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10182571204789930104', time=2024-09-12T03:39:48.495921+0000, chain.objs.size()=1 2024-09-12T02:06:45.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:zqEHiXb09bQpgJ7YxRxHj6bPbmwtFLO_.1imZNgUSGP_wwQY7lRFQf9ptOCuOmfV_0 2024-09-12T02:06:45.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14417441411165185755', time=2024-09-12T03:40:11.780660+0000, chain.objs.size()=1 2024-09-12T02:06:45.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.571__shadow:D3kzWxgILzxLGua7mkNQwjZeKsu-agO_.9eeZ2QiY44VUTLqaFxdXaQ0l2CfvlOm_0 2024-09-12T02:06:45.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12299930202708995659', time=2024-09-12T03:40:29.606550+0000, chain.objs.size()=1 2024-09-12T02:06:45.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow:6zz0AxwVzNPFiNLC7619PlBBiMctrio_.TPLPbTVRRWx5SZs2Iyzgk6mdP4sxHrj_0 2024-09-12T02:06:45.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10363234280355600584', time=2024-09-12T03:41:15.439093+0000, chain.objs.size()=1 2024-09-12T02:06:45.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:9975Q618qxK-8sy04r2Zo54oVZVdubG_.VsyAnBolei1AZ_YPhN7QN2JCEiGePP__0 2024-09-12T02:06:45.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12134970640454344760', time=2024-09-12T03:42:42.583455+0000, chain.objs.size()=1 2024-09-12T02:06:45.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.581__shadow:ahl-Sh7UMAZs6toUBVafFBTwISYwRLE_.JvzBXACETZuZtkAswF_SWrNig7M6aXr_0 2024-09-12T02:06:45.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10190752709066264624', time=2024-09-12T03:43:04.957413+0000, chain.objs.size()=1 2024-09-12T02:06:45.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.588__shadow:wJO2OX16hRm0.lgIgdAPS3kik.Qtfmm_.FTUIT9zoFcARyuVytlL6SGUicKsyLTK_0 2024-09-12T02:06:45.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12528612599596925875', time=2024-09-12T03:45:06.278855+0000, chain.objs.size()=12 2024-09-12T02:06:45.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__multipart_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.1 2024-09-12T02:06:45.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__shadow_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.1_1 2024-09-12T02:06:45.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__multipart_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.2 2024-09-12T02:06:45.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__shadow_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.2_1 2024-09-12T02:06:45.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__multipart_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.3 2024-09-12T02:06:45.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__shadow_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.3_1 2024-09-12T02:06:45.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__multipart_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.4 2024-09-12T02:06:45.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__shadow_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.4_1 2024-09-12T02:06:45.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__multipart_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.5 2024-09-12T02:06:45.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__shadow_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.5_1 2024-09-12T02:06:45.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.138+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__multipart_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.6 2024-09-12T02:06:45.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.138+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.614__shadow_multipart_enc.2~MLQqDRB-V3as5UWMzQc3JQZcQSZPlfS.6_1 2024-09-12T02:06:45.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.138+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7313347211129224162', time=2024-09-12T03:50:31.504222+0000, chain.objs.size()=1 2024-09-12T02:06:45.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.138+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.632__shadow_.bd1Kl7oA6slgvhgdYkAEtQEzXP-guYq_0 2024-09-12T02:06:45.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.138+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18288445495215660270', time=2024-09-12T03:51:45.738377+0000, chain.objs.size()=1 2024-09-12T02:06:45.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.138+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.652__shadow_.Gv0eY-yn9pu7WifqONOC5jlylbQ5YyH_0 2024-09-12T02:06:45.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.138+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15438224269204613095', time=2024-09-12T03:53:40.631535+0000, chain.objs.size()=1 2024-09-12T02:06:45.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.138+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.680__shadow_.xbhUyW-yIE4lUYMZPRy3MLgN1CeRr48_0 2024-09-12T02:06:45.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.138+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2434254661765370749', time=2024-09-12T03:55:25.995803+0000, chain.objs.size()=1 2024-09-12T02:06:45.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.138+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.720__shadow_.5rPDiA-nKOkNC_xOG0QAM4E9TzXQ8rW_0 2024-09-12T02:06:45.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:45.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T02:06:45.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:45.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:45.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48124' 2024-09-12T02:06:45.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3939986499483561244', time=2024-09-12T03:05:28.276156+0000, chain.objs.size()=1 2024-09-12T02:06:45.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.179__shadow_.NOYgWX-3DpFg08h3fzLSu1H6V25I0Rx_0 2024-09-12T02:06:45.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5301019857602276269', time=2024-09-12T03:10:32.796287+0000, chain.objs.size()=1 2024-09-12T02:06:45.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.234__shadow_.N8UnpoTh7sDaMUQwmFE6CiB2zM5k4m6_0 2024-09-12T02:06:45.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15621090375290131697', time=2024-09-12T03:10:40.768867+0000, chain.objs.size()=1 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.237__shadow_.PWIHykmcozkMZjepY9Mq99Qj1MERoTq_0 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11113292377805970940', time=2024-09-12T03:11:03.005231+0000, chain.objs.size()=1 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.244__shadow_.CxFI9joPecx09AS9BqtMxAEt4eVDCcL_0 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9595986889193194966', time=2024-09-12T03:11:09.500784+0000, chain.objs.size()=1 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.246__shadow_.TbujNtGOxutWIw8notEOhQarc1uKK0Y_0 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10538059663704481534', time=2024-09-12T03:11:49.340813+0000, chain.objs.size()=1 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.262__shadow_.HTdSWiOglcpb1V6q7C_mezPZh-SxfCE_0 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11659309243750302811', time=2024-09-12T03:13:33.988314+0000, chain.objs.size()=1 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3yrOru50v29I_VARPNwxIxOJO-2SwxF_0 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4140823666756023416', time=2024-09-12T03:13:34.294374+0000, chain.objs.size()=1 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KcG5j732UqojGS3I2W_V0UMfqAEBliu_0 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17726925636667624046', time=2024-09-12T03:13:34.429572+0000, chain.objs.size()=1 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vaRSEyDm9yga-40DPU7BVWnhXdqTPO5_0 2024-09-12T02:06:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14618046541013701277', time=2024-09-12T03:13:39.073375+0000, chain.objs.size()=1 2024-09-12T02:06:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ZRWOdD3w5oeZ55bwvK232kc4uOFlMCw_0 2024-09-12T02:06:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8683892181617400999', time=2024-09-12T03:13:39.858870+0000, chain.objs.size()=1 2024-09-12T02:06:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Nf5gBEc9wIyG_DdsZIGvcRSutpRBdZ5_0 2024-09-12T02:06:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7417698417855257903', time=2024-09-12T03:13:40.606545+0000, chain.objs.size()=1 2024-09-12T02:06:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.NKiPNsipMDCGayL8wDzElM3kBoj8d6P_0 2024-09-12T02:06:45.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6021722860818599311', time=2024-09-12T03:13:40.862088+0000, chain.objs.size()=1 2024-09-12T02:06:45.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.SFWHHZh6ID9-Uno83_5W8CJZijTw0bE_0 2024-09-12T02:06:45.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4534804647500152347', time=2024-09-12T03:13:43.271094+0000, chain.objs.size()=1 2024-09-12T02:06:45.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.bV_ogMCJ63FY4J60grnnjUewuARK5tB_0 2024-09-12T02:06:45.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1759421501570272588', time=2024-09-12T03:13:43.673615+0000, chain.objs.size()=1 2024-09-12T02:06:45.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tNBWp1pVPGtPxJdRJDdHUwnYWlIv79s_0 2024-09-12T02:06:45.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9924151591732313048', time=2024-09-12T03:13:44.100631+0000, chain.objs.size()=1 2024-09-12T02:06:45.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DlZPbrcI4plYJTEf-iF7fsF0lZY7Q5h_0 2024-09-12T02:06:45.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12260176417355779527', time=2024-09-12T03:13:44.711044+0000, chain.objs.size()=1 2024-09-12T02:06:45.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ZkN3PQzrU0cWEAUehVhN1dVdk0V6mRk_0 2024-09-12T02:06:45.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2335699011149721419', time=2024-09-12T03:13:44.713921+0000, chain.objs.size()=1 2024-09-12T02:06:45.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Wcou_BHwyE1PI4Trjf_diNAR4xAwDxj_0 2024-09-12T02:06:45.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8532348926578648512', time=2024-09-12T03:13:48.008889+0000, chain.objs.size()=1 2024-09-12T02:06:45.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qgD6Qrg-3GjQhB5dzhH6RLVDOrC1RGI_0 2024-09-12T02:06:45.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13788125418581867678', time=2024-09-12T03:13:48.123229+0000, chain.objs.size()=1 2024-09-12T02:06:45.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ECzCSUbkLUxNSDXw6CGHNWKNQ-JffNs_0 2024-09-12T02:06:45.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17141523698312887037', time=2024-09-12T03:13:48.124556+0000, chain.objs.size()=1 2024-09-12T02:06:45.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ieF8xYTnajEj4F9zfLK-7Lerr5rd2rd_0 2024-09-12T02:06:45.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4064748156111278375', time=2024-09-12T03:13:48.126450+0000, chain.objs.size()=1 2024-09-12T02:06:45.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.dV6UN6wVOOww_6Jg5d-H16ydYsAo9QX_0 2024-09-12T02:06:45.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14073038469849734739', time=2024-09-12T03:13:50.950486+0000, chain.objs.size()=1 2024-09-12T02:06:45.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Pyg9B4ZQgOzPTmDHeuKUvHWTd0lnEIh_0 2024-09-12T02:06:45.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8694066748851775666', time=2024-09-12T03:13:51.440740+0000, chain.objs.size()=1 2024-09-12T02:06:45.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tPIJ2Qd8jMw7Pf3j7asFnEUOzM4cxrm_0 2024-09-12T02:06:45.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9726369742074533338', time=2024-09-12T03:13:51.517190+0000, chain.objs.size()=1 2024-09-12T02:06:45.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jCf8Gq57pl6Vremsw1pSmvAkgIPeWKk_0 2024-09-12T02:06:45.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11817660509020576954', time=2024-09-12T03:13:51.766364+0000, chain.objs.size()=1 2024-09-12T02:06:45.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ORhKqXJdY4khNAGRp4DsFKPOdaO__fD_0 2024-09-12T02:06:45.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8681360980815810876', time=2024-09-12T03:13:55.673520+0000, chain.objs.size()=1 2024-09-12T02:06:45.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.UP_tPdbK-6cv56OBAPBkxxLb6KLD5Av_0 2024-09-12T02:06:45.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2753718978821166386', time=2024-09-12T03:13:57.944819+0000, chain.objs.size()=1 2024-09-12T02:06:45.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0bHc0fu3IpIa2dbvfI_DDVbHLVy0ufA_0 2024-09-12T02:06:45.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1989111653848348885', time=2024-09-12T03:13:58.867517+0000, chain.objs.size()=1 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6MzEVSxBM4reqdjDXDd-zkycPuLqavI_0 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6762290039213856156', time=2024-09-12T03:14:03.445053+0000, chain.objs.size()=1 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.NbsRUBeFVVm0mqtJhzys6BwTKnTMJc-_0 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10156210849330286575', time=2024-09-12T03:14:03.657632+0000, chain.objs.size()=1 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aMi7xU9Q2E3OyePXZYUKVznUOYRFHf9_0 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1021822609038822668', time=2024-09-12T03:14:03.906659+0000, chain.objs.size()=1 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.EB_apE4jwGoLlY60gEhT2bOzLT90SdM_0 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18411298829253212634', time=2024-09-12T03:14:04.126394+0000, chain.objs.size()=1 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QlkLf-b_4etXQ06TQrWJ6XofN4m59uZ_0 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6076854261256555491', time=2024-09-12T03:14:04.842097+0000, chain.objs.size()=1 2024-09-12T02:06:45.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.d4KjdaNx9pShpWYC8fb5444TUSC3yTF_0 2024-09-12T02:06:45.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4501032129801511966', time=2024-09-12T03:14:15.023624+0000, chain.objs.size()=1 2024-09-12T02:06:45.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.267__shadow_.DKtcCbzvEJPmuu-PXnY5LLv-BdvVeLX_0 2024-09-12T02:06:45.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.875745301003409081', time=2024-09-12T03:14:29.305375+0000, chain.objs.size()=1 2024-09-12T02:06:45.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.273__shadow_.Cdt6BTGz6foli2ETYexPoMxxlWnhSik_0 2024-09-12T02:06:45.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.179979489663922461', time=2024-09-12T03:14:51.704806+0000, chain.objs.size()=1 2024-09-12T02:06:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.282__shadow_.ZJXscOvypp0YdE0H9wyT4KaQzPw3qBt_0 2024-09-12T02:06:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4424412721717002003', time=2024-09-12T03:15:07.097392+0000, chain.objs.size()=1 2024-09-12T02:06:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.288__shadow_.mFaaAPUq6CxoAozFRDtGcNg7SNhbsb1_0 2024-09-12T02:06:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15294348905053818412', time=2024-09-12T03:15:29.489142+0000, chain.objs.size()=1 2024-09-12T02:06:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.4S4AwMrb2enuNnU178jHZ8Ij_RmbRSB_0 2024-09-12T02:06:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3944667157111198498', time=2024-09-12T03:15:29.789191+0000, chain.objs.size()=1 2024-09-12T02:06:45.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.a03vScIwlf4z-Lh_ibOCatg2QyebRkV_0 2024-09-12T02:06:45.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6296165513779637818', time=2024-09-12T03:15:32.292594+0000, chain.objs.size()=1 2024-09-12T02:06:45.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.295__shadow_.mLuFSLf0LN05Ui_oOl7uZGTxSfLYDa-_0 2024-09-12T02:06:45.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15489178639526202287', time=2024-09-12T03:18:36.823880+0000, chain.objs.size()=1 2024-09-12T02:06:45.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.IPCVbNsvb2Ny-XLDBtH4e4rdk-bO1m3_0 2024-09-12T02:06:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15841484498474205139', time=2024-09-12T03:18:38.057704+0000, chain.objs.size()=1 2024-09-12T02:06:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3QSqlRwxg7c6otpruJHOZjiRJ3LSCpg_0 2024-09-12T02:06:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.839143784320343355', time=2024-09-12T03:18:38.887512+0000, chain.objs.size()=1 2024-09-12T02:06:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.mJGNgBOSjBOD-Bddm6GqPfxSK81s3zu_0 2024-09-12T02:06:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8547916842416047961', time=2024-09-12T03:18:39.567528+0000, chain.objs.size()=1 2024-09-12T02:06:45.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UZ9HPMvVu_gxEiVa8Ox-mBSL3excqnB_0 2024-09-12T02:06:45.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18004676606419230204', time=2024-09-12T03:18:41.313667+0000, chain.objs.size()=1 2024-09-12T02:06:45.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.k2iDeezpOgo0-EXviGJx5HG92pNp-QX_0 2024-09-12T02:06:45.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10085418133965229070', time=2024-09-12T03:18:41.734991+0000, chain.objs.size()=1 2024-09-12T02:06:45.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vr-Yl4h0vTXIMETpGZlL4II2Wuoalln_0 2024-09-12T02:06:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.173075537702162577', time=2024-09-12T03:18:41.737250+0000, chain.objs.size()=1 2024-09-12T02:06:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eRlXXcnpms51547fstieYZ5G8X6j9al_0 2024-09-12T02:06:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7628651540632247819', time=2024-09-12T03:18:43.173592+0000, chain.objs.size()=1 2024-09-12T02:06:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Lv9tmUtPLM6IKQ7vgzX6UbKtzOzMjR3_0 2024-09-12T02:06:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8986250618173790412', time=2024-09-12T03:18:43.911906+0000, chain.objs.size()=1 2024-09-12T02:06:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._WujG0_ao9dKlOI9kx2yrMAETdi4Gjw_0 2024-09-12T02:06:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17688990689708196624', time=2024-09-12T03:18:43.955231+0000, chain.objs.size()=1 2024-09-12T02:06:45.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gECH4yR1T5bOMSPUMcMFe1VW7356zOV_0 2024-09-12T02:06:45.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11821463388723002758', time=2024-09-12T03:18:45.001454+0000, chain.objs.size()=1 2024-09-12T02:06:45.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.uOFnwUXczeoQK68mmZXHLU-Pm7P271l_0 2024-09-12T02:06:45.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12818546126816612456', time=2024-09-12T03:18:48.150247+0000, chain.objs.size()=1 2024-09-12T02:06:45.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gSHr4x_uvNmP-90GXH8NaV_-etbXo-0_0 2024-09-12T02:06:45.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8937445605893227513', time=2024-09-12T03:18:49.252453+0000, chain.objs.size()=1 2024-09-12T02:06:45.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.sClAKktbeRcCXYCVTx4eR8-eHyQ2aLK_0 2024-09-12T02:06:45.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13565356116946632728', time=2024-09-12T03:18:50.029680+0000, chain.objs.size()=1 2024-09-12T02:06:45.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8PuauT1VmaSo1cPa9uy5DJOgy-0UeoQ_0 2024-09-12T02:06:45.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1625719025308481520', time=2024-09-12T03:18:50.860401+0000, chain.objs.size()=1 2024-09-12T02:06:45.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.DUsroX0O2EixNDYms_4yvIequZ8GnOj_0 2024-09-12T02:06:45.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17794147170449147629', time=2024-09-12T03:18:51.503050+0000, chain.objs.size()=1 2024-09-12T02:06:45.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.o5_wR7bP3qiZFlqKMa66SWLyj3o3NZS_0 2024-09-12T02:06:45.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3499635819217732634', time=2024-09-12T03:18:52.076044+0000, chain.objs.size()=1 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UM60BsJDcYLgLhFqDawtNjfbjwc4_Rk_0 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2201781409030051076', time=2024-09-12T03:18:55.072397+0000, chain.objs.size()=1 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.rs04aZw2s0SqV5fYDZDF7-r7I9ndwRH_0 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13071893223543898830', time=2024-09-12T03:18:55.136584+0000, chain.objs.size()=1 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.FFUTtJsFVmI1dtrZgHEMZU9K2JTBZXs_0 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5110230039637319432', time=2024-09-12T03:18:56.025585+0000, chain.objs.size()=1 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9g9xI6kFOhRnbjb_Mwg_VzEpjqv-SiE_0 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10040891913257515823', time=2024-09-12T03:18:56.476219+0000, chain.objs.size()=1 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Jdd6HC3VwaYPyfOCC8E3q_41RKcuZua_0 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16032968495960627838', time=2024-09-12T03:18:56.477638+0000, chain.objs.size()=1 2024-09-12T02:06:45.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8ij32FGZF_e0s4rMwXinL8HNc1dS8Ma_0 2024-09-12T02:06:45.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17703337287677883695', time=2024-09-12T03:18:56.515264+0000, chain.objs.size()=1 2024-09-12T02:06:45.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qT4cOSqEwCKKzCR580TlJT7UaFN3qos_0 2024-09-12T02:06:45.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6218705805947822161', time=2024-09-12T03:18:57.391060+0000, chain.objs.size()=1 2024-09-12T02:06:45.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gzsJQj0k-YmO_a11zT7DMmWAFctGSZ3_0 2024-09-12T02:06:45.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10969620940298209943', time=2024-09-12T03:18:57.393506+0000, chain.objs.size()=1 2024-09-12T02:06:45.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.s0by1oZwhJjr4NWd5BJzvR9jjjfg4GP_0 2024-09-12T02:06:45.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1487936854388372495', time=2024-09-12T03:18:58.654761+0000, chain.objs.size()=1 2024-09-12T02:06:45.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.mkwjWpmYDVg6JOHPgSHw8q4dcpLOp4H_0 2024-09-12T02:06:45.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1937387741771879896', time=2024-09-12T03:18:59.346934+0000, chain.objs.size()=1 2024-09-12T02:06:45.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ourscAmjZewLKdUzbQxZ2gcX-PD1epK_0 2024-09-12T02:06:45.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3069208895313355109', time=2024-09-12T03:19:00.083867+0000, chain.objs.size()=1 2024-09-12T02:06:45.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-wYA7N3ApBdjE_qonuUWwwGGRxKTn0F_0 2024-09-12T02:06:45.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8668157956902419871', time=2024-09-12T03:19:00.179919+0000, chain.objs.size()=1 2024-09-12T02:06:45.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.F5tSqPmLP6UE4OKqIMuev_sGeW5Qt4F_0 2024-09-12T02:06:45.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13056022297540064728', time=2024-09-12T03:19:02.711512+0000, chain.objs.size()=1 2024-09-12T02:06:45.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ZX755-fNahVWnsn_NMSKhF0iTqTHhDH_0 2024-09-12T02:06:45.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13422896838217118452', time=2024-09-12T03:19:04.370433+0000, chain.objs.size()=1 2024-09-12T02:06:45.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.K8-XUBZs5o73RpuPo_Bt5wFerqqmGdv_0 2024-09-12T02:06:45.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9143472223043203476', time=2024-09-12T03:19:04.461475+0000, chain.objs.size()=1 2024-09-12T02:06:45.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.202+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.iqF0iGoekB9kHNnx--QrRaeiyjR6XDz_0 2024-09-12T02:06:45.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.22446795731370558', time=2024-09-12T03:19:05.279409+0000, chain.objs.size()=1 2024-09-12T02:06:45.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.S-A5GXwOqOceUJUQRjCDgsvsE1pGRGR_0 2024-09-12T02:06:45.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13882739381508327450', time=2024-09-12T03:19:05.618537+0000, chain.objs.size()=1 2024-09-12T02:06:45.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6dASFHrLXTYtCHMgr-xY4DeDxmbwK3w_0 2024-09-12T02:06:45.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17988338068634239905', time=2024-09-12T03:19:06.755438+0000, chain.objs.size()=1 2024-09-12T02:06:45.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qQy410amSIOibHksauSPQFds0xLZWKv_0 2024-09-12T02:06:45.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15212681737024199951', time=2024-09-12T03:19:06.757357+0000, chain.objs.size()=1 2024-09-12T02:06:45.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fG-uVLjN3FCysu13vxQmViGkAmb5gnr_0 2024-09-12T02:06:45.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1954194380968146482', time=2024-09-12T03:20:54.340343+0000, chain.objs.size()=1 2024-09-12T02:06:45.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.TshwrpgNV76d6n4gDGibUMmSYYL0oKY_0 2024-09-12T02:06:45.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13916071086083964621', time=2024-09-12T03:20:55.190567+0000, chain.objs.size()=1 2024-09-12T02:06:45.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.JjxCKRXiNg1p0jVw_8ieukQkkaq0wIC_0 2024-09-12T02:06:45.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6620429612460715878', time=2024-09-12T03:20:56.206619+0000, chain.objs.size()=1 2024-09-12T02:06:45.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.SMAT4rAG2oIJLDSE0Fd7B6p5z7Ml6t3_0 2024-09-12T02:06:45.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17791961800973024979', time=2024-09-12T03:20:56.208301+0000, chain.objs.size()=1 2024-09-12T02:06:45.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XbkIYZh0fD0gdw8z8yfxk5UjEUE9dxl_0 2024-09-12T02:06:45.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6913461250536611852', time=2024-09-12T03:20:56.779998+0000, chain.objs.size()=1 2024-09-12T02:06:45.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.GgASX4DiDcsYyPf_p5u5bYH6rf29CPm_0 2024-09-12T02:06:45.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7252340322466505652', time=2024-09-12T03:20:56.973978+0000, chain.objs.size()=1 2024-09-12T02:06:45.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.d_eKhQqQWWi4eiKzrIEe63okiqlsq4h_0 2024-09-12T02:06:45.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17001955803455974562', time=2024-09-12T03:20:57.035615+0000, chain.objs.size()=1 2024-09-12T02:06:45.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.N1cUwoIaa07XreMbefRr_UwYh6R8Ut4_0 2024-09-12T02:06:45.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17206753049611539397', time=2024-09-12T03:20:57.219441+0000, chain.objs.size()=1 2024-09-12T02:06:45.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.j1tMVCSdlAljy7hmxn9MhgUew-pAVPa_0 2024-09-12T02:06:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16678501636718296323', time=2024-09-12T03:20:59.333231+0000, chain.objs.size()=1 2024-09-12T02:06:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.KuUVLFmLEoAEYeb3TwNvp6dPW6jFgk0_0 2024-09-12T02:06:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10044854382308605869', time=2024-09-12T03:21:00.447743+0000, chain.objs.size()=1 2024-09-12T02:06:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EzfrbetNxDQ5F9NKZBWCsyVymo2qcCQ_0 2024-09-12T02:06:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.214+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.566006461592222233', time=2024-09-12T03:21:00.831891+0000, chain.objs.size()=1 2024-09-12T02:06:45.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tj1D6RcQEwQwcmPxT5qJQXqv9I-S9WU_0 2024-09-12T02:06:45.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.214+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3546789547532368048', time=2024-09-12T03:21:01.733782+0000, chain.objs.size()=1 2024-09-12T02:06:45.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Yhvhja-uZTZEoiYqu2r6CdsDKcC61Jc_0 2024-09-12T02:06:45.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.214+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7742568506804198927', time=2024-09-12T03:21:04.173200+0000, chain.objs.size()=1 2024-09-12T02:06:45.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.HPhDdbL4nD3PWamrf70Bae0x0947Vta_0 2024-09-12T02:06:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15443776650953684792', time=2024-09-12T03:21:05.042714+0000, chain.objs.size()=1 2024-09-12T02:06:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.iXQX5nUPW63sBMn3NNfDWmOXwiM3WT6_0 2024-09-12T02:06:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13206166758831184364', time=2024-09-12T03:21:05.414203+0000, chain.objs.size()=1 2024-09-12T02:06:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gHb1fn4bih00SvB1L4bwLytWxagEO7k_0 2024-09-12T02:06:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4599187960930305403', time=2024-09-12T03:21:05.461134+0000, chain.objs.size()=1 2024-09-12T02:06:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8UzObRR5JKKoxGuW19OqwMkJeaayrHn_0 2024-09-12T02:06:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9826435487091310409', time=2024-09-12T03:21:07.134021+0000, chain.objs.size()=1 2024-09-12T02:06:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._ohvl6aMtTlXwfuQAgG0Gf4hNp-Knua_0 2024-09-12T02:06:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7756650324410515651', time=2024-09-12T03:21:08.180389+0000, chain.objs.size()=1 2024-09-12T02:06:45.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MH442EW5FPXBFMTbDce6yETzIUXvVim_0 2024-09-12T02:06:45.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9955698974688942578', time=2024-09-12T03:21:08.440076+0000, chain.objs.size()=1 2024-09-12T02:06:45.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qMK3Y8WgTHzgdS1BhjEcBGcDn6OBVCq_0 2024-09-12T02:06:45.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15371788666901426605', time=2024-09-12T03:21:08.693721+0000, chain.objs.size()=1 2024-09-12T02:06:45.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.SBGkHzXaTd3P1qmcfhuX1UCm-SzdbAR_0 2024-09-12T02:06:45.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10614992991257727390', time=2024-09-12T03:21:09.123049+0000, chain.objs.size()=1 2024-09-12T02:06:45.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dXeSRf7cRzRr2GKEM3oM6fCwJQ5DiqK_0 2024-09-12T02:06:45.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5217812001880059823', time=2024-09-12T03:21:10.115279+0000, chain.objs.size()=1 2024-09-12T02:06:45.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xdu26sed1emhlyKILOBIcRpOgcp8GcA_0 2024-09-12T02:06:45.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.222+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6154265167140576723', time=2024-09-12T03:21:10.116957+0000, chain.objs.size()=1 2024-09-12T02:06:45.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.LKAO8F3loy6sFSgi0lCpw7ykCjjz5nx_0 2024-09-12T02:06:45.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48124 2024-09-12T02:06:45.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T02:06:45.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6628452957623671048', time=2024-09-12T03:21:10.242415+0000, chain.objs.size()=1 2024-09-12T02:06:45.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.AuoLq_7E67sGddvWXRsIHkIoevrHRPf_0 2024-09-12T02:06:45.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17646630483055023138', time=2024-09-12T03:21:12.037170+0000, chain.objs.size()=1 2024-09-12T02:06:45.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6bNt3lwoyX7G-dSI7fKKUxoiIUpGdKG_0 2024-09-12T02:06:45.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3152012307980223547', time=2024-09-12T03:21:12.350699+0000, chain.objs.size()=1 2024-09-12T02:06:45.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.llZP4VJ0RPif6O5ygplUTsOkMBVgisH_0 2024-09-12T02:06:45.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5506397991892908951', time=2024-09-12T03:21:12.783587+0000, chain.objs.size()=1 2024-09-12T02:06:45.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EcrVN4OSN-gVoHZaNv-3YiZ7CMkpXhS_0 2024-09-12T02:06:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10831438335706098661', time=2024-09-12T03:21:13.075419+0000, chain.objs.size()=1 2024-09-12T02:06:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.o_f3ckF5UDWKgGytlOCunzfUBdYQbhL_0 2024-09-12T02:06:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.423403364757387353', time=2024-09-12T03:21:13.077598+0000, chain.objs.size()=1 2024-09-12T02:06:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.b-jDOT9CPleeLv6l2GUScmqneNEUVUQ_0 2024-09-12T02:06:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14808019200696217142', time=2024-09-12T03:21:14.399658+0000, chain.objs.size()=1 2024-09-12T02:06:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0dML5BXa63wAhaWf60OCgo_uc2wh7YV_0 2024-09-12T02:06:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4431983878447054422', time=2024-09-12T03:21:16.162837+0000, chain.objs.size()=1 2024-09-12T02:06:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZlD0AebZ07iG5OAV-QOWXA7NBLHqrMI_0 2024-09-12T02:06:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3485598347495770360', time=2024-09-12T03:21:16.316407+0000, chain.objs.size()=1 2024-09-12T02:06:45.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6C_B9SD8NLngK2TvrghSm58Yogu8Xod_0 2024-09-12T02:06:45.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14468106322048198724', time=2024-09-12T03:21:17.376192+0000, chain.objs.size()=1 2024-09-12T02:06:45.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YGsYI9_f-TWAdYHYC5Ke-EnH7GUev8k_0 2024-09-12T02:06:45.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2037358395468614933', time=2024-09-12T03:21:20.134432+0000, chain.objs.size()=1 2024-09-12T02:06:45.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gIvRrKosAzmKGU5-vJufSZo_ddvoy0A_0 2024-09-12T02:06:45.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7972060498477957843', time=2024-09-12T03:21:20.174140+0000, chain.objs.size()=1 2024-09-12T02:06:45.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7oxXSAsu1ybQ30e9XCDwCHPkkSPvKZo_0 2024-09-12T02:06:45.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2045711250953594776', time=2024-09-12T03:21:20.716180+0000, chain.objs.size()=1 2024-09-12T02:06:45.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.GyOgj4H5Ap81bjVionhX6t40GzCTjDv_0 2024-09-12T02:06:45.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10075449819116878688', time=2024-09-12T03:21:21.884484+0000, chain.objs.size()=1 2024-09-12T02:06:45.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lPV2KptuPs1hJuxU_SasA0T82Toei8N_0 2024-09-12T02:06:45.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12633031783302315684', time=2024-09-12T03:21:23.977739+0000, chain.objs.size()=1 2024-09-12T02:06:45.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.L5s4N7ltVeZtUHiy66e4Z7zI7j4j6cm_0 2024-09-12T02:06:45.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8176607865775812504', time=2024-09-12T03:21:25.145106+0000, chain.objs.size()=1 2024-09-12T02:06:45.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wJgMhdspYP8uKT0-rKM_B7m7m_WJ5QO_0 2024-09-12T02:06:45.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1188809136841182031', time=2024-09-12T03:23:47.778930+0000, chain.objs.size()=1 2024-09-12T02:06:45.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.391__shadow_.5qM_3knm87BfEZzHyZCijb4LXn3eRvF_0 2024-09-12T02:06:45.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1865479341938909436', time=2024-09-12T03:23:47.782755+0000, chain.objs.size()=1 2024-09-12T02:06:45.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.391__shadow_.zwLuU8zLXv2Rf9TCDBRR0-enbGg_ILx_0 2024-09-12T02:06:45.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10176047628845924651', time=2024-09-12T03:23:47.784420+0000, chain.objs.size()=1 2024-09-12T02:06:45.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.391__shadow_.k02MBzhj9N54JrBGGpqP_TD4lSommZu_0 2024-09-12T02:06:45.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9452629066209105536', time=2024-09-12T03:26:50.089807+0000, chain.objs.size()=1 2024-09-12T02:06:45.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.466__shadow_.5Cu7xsPM74ow4GGaKbI_7EapIDPsCx2_0 2024-09-12T02:06:45.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16274106773436794052', time=2024-09-12T03:29:10.637400+0000, chain.objs.size()=1 2024-09-12T02:06:45.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.515__shadow_.T-aDaolCB4FRPEUHZMKOlRkGckbFK0Y_0 2024-09-12T02:06:45.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17349237692468904056', time=2024-09-12T03:38:08.016114+0000, chain.objs.size()=1 2024-09-12T02:06:45.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.553__shadow_.xTcCK6qtUlA1JihEwh7Y5rqacQ8n12o_0 2024-09-12T02:06:45.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2447648409489010396', time=2024-09-12T03:39:17.597277+0000, chain.objs.size()=1 2024-09-12T02:06:45.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.562__multipart_mymultipart.2~R0NuLQ__601xrfgaeiOJd_w2iiH54AN.1 2024-09-12T02:06:45.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8242092952165927175', time=2024-09-12T03:40:36.047783+0000, chain.objs.size()=1 2024-09-12T02:06:45.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.576__shadow:2.UQt45YLR8X5OWffKkBpo5Jt80MS.f_.RKcwVeuTYYSaoZzFF0TwYhPuvmcaQFk_0 2024-09-12T02:06:45.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13322276773940878050', time=2024-09-12T03:40:39.925843+0000, chain.objs.size()=1 2024-09-12T02:06:45.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.577__shadow:X7uNkGy1ztDkYLhpDriOROQ9Zg0ak2U_.FpUjUw0cH7pQGH-DJQ6pzUkShMPC_Of_0 2024-09-12T02:06:45.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7884670754993366529', time=2024-09-12T03:41:28.490052+0000, chain.objs.size()=1 2024-09-12T02:06:45.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:6s13ulExSX5UI.5A06-5B94rb9GfdQb_.euZPsRD0FXHeNt2nM4m4WCAs_uJv4_n_0 2024-09-12T02:06:45.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6867644985504188868', time=2024-09-12T03:42:36.604243+0000, chain.objs.size()=1 2024-09-12T02:06:45.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.580__shadow:.5SimrjZFykRRzZtl3kP0c8jeboUzwb_.Ns9Wyjjyj7ZCiAM-uXEGKrQM_JJf158_0 2024-09-12T02:06:45.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.434916804034271618', time=2024-09-12T03:50:49.892470+0000, chain.objs.size()=1 2024-09-12T02:06:45.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.639__shadow_.IgWTGuK1GxV3rB0tUYoeJltX-sllE8k_0 2024-09-12T02:06:45.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3026719847222986629', time=2024-09-12T03:53:15.088106+0000, chain.objs.size()=1 2024-09-12T02:06:45.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.246+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.667__shadow_.xi2X4ahk39Zh1DZrpcBWwGJ4UeicVCT_0 2024-09-12T02:06:45.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.250+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10657935685933823014', time=2024-09-12T03:55:21.238499+0000, chain.objs.size()=1 2024-09-12T02:06:45.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.250+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.718__shadow:uQzJ6W4IP1s4PTkHZ9iC4Ve1D4XN4Cd_.bb_LNJ9IhL7s3Hmkio-0RjazOdxSsG4_0 2024-09-12T02:06:45.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:45.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.262+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T02:06:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46543' 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5679253357111110897', time=2024-09-12T03:06:31.457026+0000, chain.objs.size()=1 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.198__shadow_.FzQCEhQwRdfswgbMCsGQ_N4c4Mg5fcv_0 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.264119025572720657', time=2024-09-12T03:10:27.794305+0000, chain.objs.size()=1 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.232__shadow_.CITUjssfrrvffLJxWmNq7LRqod1PJEE_0 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11198593071504774366', time=2024-09-12T03:10:40.745710+0000, chain.objs.size()=1 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.237__shadow_.QJKhnqRp2Xm7d9TI2QAnzYbthiHQ_cJ_0 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1359482368866443998', time=2024-09-12T03:11:02.981343+0000, chain.objs.size()=1 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.244__shadow_.IRf9f3_64Wv8xj-1jKhayFAdubsXLRe_0 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16573571760225162684', time=2024-09-12T03:11:17.105478+0000, chain.objs.size()=1 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.249__shadow_.3-Xl25G2WPFdnbzXBIIy4QUmVuzVERf_0 2024-09-12T02:06:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9498353465467150086', time=2024-09-12T03:11:27.138514+0000, chain.objs.size()=1 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.253__shadow_.PD_5VZULcDFkqlJNqA8QrqDSGJ9ZPq2_0 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7042805069683706198', time=2024-09-12T03:11:32.145232+0000, chain.objs.size()=1 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.255__shadow_.xncKwFfnHZCSDXaIdHpCkxbKai1EuwX_0 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14933099593636203051', time=2024-09-12T03:13:34.460844+0000, chain.objs.size()=1 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Hvoegrd0tzoKYpp8T8_eLnPRYTfV2xn_0 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10421667900830338348', time=2024-09-12T03:13:35.107709+0000, chain.objs.size()=1 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pz6uDxDMA6GPtkLIMUHMtqxFND_FgZs_0 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11704304089859402877', time=2024-09-12T03:13:35.920409+0000, chain.objs.size()=1 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.iORjTYeoTLFliEJgIqfGJDMTxyx309A_0 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17787847924549979815', time=2024-09-12T03:13:36.818142+0000, chain.objs.size()=1 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jwKHDs1k8vLvb_Q-xK9mNAe3pUwqll8_0 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6805682435517329957', time=2024-09-12T03:13:37.086245+0000, chain.objs.size()=1 2024-09-12T02:06:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pPCfyeiuzldaQ3rajEKK-U-vJNzYLpJ_0 2024-09-12T02:06:45.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15117760825415491531', time=2024-09-12T03:13:38.416737+0000, chain.objs.size()=1 2024-09-12T02:06:45.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.MLYCl27FYDsil2Hwtd4Ivfw_5pKpj0V_0 2024-09-12T02:06:45.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17940647031411229373', time=2024-09-12T03:13:41.385293+0000, chain.objs.size()=1 2024-09-12T02:06:45.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.PzvtVNSr_nJBlInV8XWrIvkk_nzuPrc_0 2024-09-12T02:06:45.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2202744700423300986', time=2024-09-12T03:13:43.392392+0000, chain.objs.size()=1 2024-09-12T02:06:45.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4vYvdCGAfcFu55hffe73HzgM3SZjoX0_0 2024-09-12T02:06:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17748304997971259653', time=2024-09-12T03:13:43.910663+0000, chain.objs.size()=1 2024-09-12T02:06:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._e7I8XITKNTTvBnRfyCkLrt2ed-0_3d_0 2024-09-12T02:06:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3133689554939042655', time=2024-09-12T03:13:47.027561+0000, chain.objs.size()=1 2024-09-12T02:06:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jYdRYVgEFMYcXXOpMuNMKm-KU4MaFXZ_0 2024-09-12T02:06:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16331136072497716137', time=2024-09-12T03:13:47.243920+0000, chain.objs.size()=1 2024-09-12T02:06:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.WpTh21-in_c8hJM_cUo5ig3oAIfMK3U_0 2024-09-12T02:06:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5256165101537727205', time=2024-09-12T03:13:48.277317+0000, chain.objs.size()=1 2024-09-12T02:06:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tioiJuM5JR6Zcqk6t_IDr6RSJ4cHDze_0 2024-09-12T02:06:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15304996923123097789', time=2024-09-12T03:13:48.279409+0000, chain.objs.size()=1 2024-09-12T02:06:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.NYHSV_78wytvzmJW0CmqPWeJUHvdj1W_0 2024-09-12T02:06:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15669764052885473669', time=2024-09-12T03:13:48.811587+0000, chain.objs.size()=1 2024-09-12T02:06:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.g-1b0lPIS65BJ87mOoxz8Cca7wcynsZ_0 2024-09-12T02:06:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2893153685699966995', time=2024-09-12T03:13:49.224850+0000, chain.objs.size()=1 2024-09-12T02:06:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.HtmjH0kbqM2PHjhgj2pwwvyY780po0__0 2024-09-12T02:06:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2490771257978108190', time=2024-09-12T03:13:49.864451+0000, chain.objs.size()=1 2024-09-12T02:06:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Pa3AY0blES8zp7pyIW3fE8YKWegoI0V_0 2024-09-12T02:06:45.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.755127635197589533', time=2024-09-12T03:13:49.866231+0000, chain.objs.size()=1 2024-09-12T02:06:45.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3OWwTbgGLJHwiCX6NOcaymtDVPGXSkW_0 2024-09-12T02:06:45.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6740525313248913799', time=2024-09-12T03:13:49.898525+0000, chain.objs.size()=1 2024-09-12T02:06:45.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9ALZklYUndP9Eb_jjHj19CVlxQ95Z4A_0 2024-09-12T02:06:45.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11174116254332567531', time=2024-09-12T03:13:50.883036+0000, chain.objs.size()=1 2024-09-12T02:06:45.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.y5njjrri2V-dwUO4k_t3Pb3Y-E9hEMU_0 2024-09-12T02:06:45.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6136829215821527593', time=2024-09-12T03:13:51.285162+0000, chain.objs.size()=1 2024-09-12T02:06:45.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3EWGt3pxzD1bMc1hQzsTExv_WYOI7K5_0 2024-09-12T02:06:45.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18023420396251759435', time=2024-09-12T03:13:52.398921+0000, chain.objs.size()=1 2024-09-12T02:06:45.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jVIaIMJGkSkQFXk2szWXu7KME8B7e3t_0 2024-09-12T02:06:45.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.282+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17280996860482299517', time=2024-09-12T03:13:55.088827+0000, chain.objs.size()=1 2024-09-12T02:06:45.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.282+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.frnqrJtQgOO3FM7FcwR1vRM611sEtug_0 2024-09-12T02:06:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.282+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6416180532975816529', time=2024-09-12T03:13:55.156039+0000, chain.objs.size()=1 2024-09-12T02:06:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.282+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-VxrPeG-PjMni7GXuLcAqymq1l1jpD9_0 2024-09-12T02:06:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9231696401451396954', time=2024-09-12T03:13:55.198719+0000, chain.objs.size()=1 2024-09-12T02:06:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.j2jgKI3JWA2DSMihe8mFfSNsDFTuMhn_0 2024-09-12T02:06:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4487253685289206452', time=2024-09-12T03:13:55.693970+0000, chain.objs.size()=1 2024-09-12T02:06:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uYlkS6-j6YuCSCTWH6cVpreNtyH0Jyv_0 2024-09-12T02:06:45.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13908158749514425927', time=2024-09-12T03:13:56.654651+0000, chain.objs.size()=1 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.abE90M_4GDLEb-1GOaJcnrkpSXXYHWU_0 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8310088653418306317', time=2024-09-12T03:13:57.837046+0000, chain.objs.size()=1 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5KueKDrSbZVMeMDi-04nYFebdA4jH5Y_0 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2177701531546592661', time=2024-09-12T03:13:57.839253+0000, chain.objs.size()=1 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.b6h1HNjki1Oi-dJZQTlsZtl7bGRaQMy_0 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12781381166144641796', time=2024-09-12T03:13:58.770632+0000, chain.objs.size()=1 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pu1sRt4Ezo6D3Hncfq_zij7lwIAwbgK_0 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4657933458600865064', time=2024-09-12T03:13:59.426098+0000, chain.objs.size()=1 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0QeQqlzmXroKlrWbGQmGzZniPRUpgJO_0 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1912517498221665749', time=2024-09-12T03:14:00.590288+0000, chain.objs.size()=1 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.s98pxj5LNZFQLGtaP1DoUGstf5F14h9_0 2024-09-12T02:06:45.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.49105368136437644', time=2024-09-12T03:14:02.664737+0000, chain.objs.size()=1 2024-09-12T02:06:45.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4MgZnqrmSdwLmnwIv3tk7ULSei_WTL2_0 2024-09-12T02:06:45.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14592747948433096326', time=2024-09-12T03:14:03.445894+0000, chain.objs.size()=1 2024-09-12T02:06:45.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.bq3Rhq1ALPpoxf8nWiOCqCm-0cFSV0a_0 2024-09-12T02:06:45.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5226924436865334802', time=2024-09-12T03:14:05.381813+0000, chain.objs.size()=1 2024-09-12T02:06:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.__QQVBNF61INVWPBVsyhKPicqHKY25-_0 2024-09-12T02:06:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11316517685842362540', time=2024-09-12T03:14:26.967371+0000, chain.objs.size()=1 2024-09-12T02:06:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.272__shadow_.BrzxZgUodqtUdoUbHvvba7-IKmcRxDa_0 2024-09-12T02:06:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2342709141976378982', time=2024-09-12T03:14:39.191063+0000, chain.objs.size()=1 2024-09-12T02:06:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.277__shadow_.AavN7Wsm5p0fW4xicHPZF0slhY07KNp_0 2024-09-12T02:06:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1900060623340703206', time=2024-09-12T03:14:39.214358+0000, chain.objs.size()=1 2024-09-12T02:06:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.277__shadow_.cmYDNLg5L3fMfYZ4IjzxoJsipPpLSiL_0 2024-09-12T02:06:45.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6526343230265595941', time=2024-09-12T03:14:56.862503+0000, chain.objs.size()=1 2024-09-12T02:06:45.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.284__shadow_.IrBNeVwGGrGZGKMsTVo3lBEvJ9OwIM1_0 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11629026416435506361', time=2024-09-12T03:15:23.427746+0000, chain.objs.size()=1 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.rni2fBRc9XP6vOSQfe8RqmmFM8Jq8Qw_0 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1957832143655742022', time=2024-09-12T03:15:23.601663+0000, chain.objs.size()=1 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.9qPhMXqYHuVVMPHAYK59MOx_gT5GGxe_0 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16305446699259661970', time=2024-09-12T03:15:29.414919+0000, chain.objs.size()=1 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.js8ZL0o6S-EPO_Dpyg_lVSdxI2xgdII_0 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10055112770780678838', time=2024-09-12T03:15:39.861991+0000, chain.objs.size()=1 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.298__shadow_.a8I1rn9P0zVQ2833VSiLdZpEfgrpWMM_0 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15019945480483554856', time=2024-09-12T03:15:47.667811+0000, chain.objs.size()=1 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.301__shadow_.7H5SeYUpgVFwffldegE0Iwms71SGyBc_0 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7173132738245887023', time=2024-09-12T03:16:00.169711+0000, chain.objs.size()=1 2024-09-12T02:06:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.306__shadow_.fXuBZmG_WxqgyITzQLrsyZyK3QapBfi_0 2024-09-12T02:06:45.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.298+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10347246474492094698', time=2024-09-12T03:16:49.694268+0000, chain.objs.size()=1 2024-09-12T02:06:45.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.298+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.323__shadow_.r3eKa8wzHd-tEMDNg42toohiQvYKTib_0 2024-09-12T02:06:45.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.298+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.763903979919435041', time=2024-09-12T03:18:37.374588+0000, chain.objs.size()=1 2024-09-12T02:06:45.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.298+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tWpfTJ6qwFobJHv4KKRcSCmMRNzuXFs_0 2024-09-12T02:06:45.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.298+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13208937841875892752', time=2024-09-12T03:18:37.468998+0000, chain.objs.size()=1 2024-09-12T02:06:45.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.298+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.0UZB8psaY9jzXTOrfm1sM_wjd_9KRR4_0 2024-09-12T02:06:45.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.298+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9996710076459964727', time=2024-09-12T03:18:38.175870+0000, chain.objs.size()=1 2024-09-12T02:06:45.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.298+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Gs1mrkzZZHhwPpGIjt8PB30MybKefTy_0 2024-09-12T02:06:45.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3748373143012334378', time=2024-09-12T03:18:38.710995+0000, chain.objs.size()=1 2024-09-12T02:06:45.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2aFTt1-i8gJ8R_2sludBF8xkd9yGiHT_0 2024-09-12T02:06:45.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.52951895785570673', time=2024-09-12T03:18:38.889606+0000, chain.objs.size()=1 2024-09-12T02:06:45.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9fPXv0-dR3ytJCC0MAKGthmeCwGMF4K_0 2024-09-12T02:06:45.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17187967005560113744', time=2024-09-12T03:18:42.327187+0000, chain.objs.size()=1 2024-09-12T02:06:45.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ddy5iavUEbRJC-jdF647Wb6UgbXBf8R_0 2024-09-12T02:06:45.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8829221420754981142', time=2024-09-12T03:18:42.853908+0000, chain.objs.size()=1 2024-09-12T02:06:45.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LMuN5ZqO_g7NrCmbaN-IgXDYmgeVo8-_0 2024-09-12T02:06:45.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7480441152609224873', time=2024-09-12T03:18:46.069914+0000, chain.objs.size()=1 2024-09-12T02:06:45.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.iIaxhf2hzF43fZDSleDLWjTbW_nbE0p_0 2024-09-12T02:06:45.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9398166721684832377', time=2024-09-12T03:18:46.672101+0000, chain.objs.size()=1 2024-09-12T02:06:45.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.JbS1mTxNdKWpNgTdakr0Yvb3aan4NRm_0 2024-09-12T02:06:45.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11376455065591891695', time=2024-09-12T03:18:46.785621+0000, chain.objs.size()=1 2024-09-12T02:06:45.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.36nTJHFKTfLCW_1eDsOdbzRRIPvCbP1_0 2024-09-12T02:06:45.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16505263518199338475', time=2024-09-12T03:18:47.052199+0000, chain.objs.size()=1 2024-09-12T02:06:45.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6eKYwIvnwT6XKSZy4YOCdu_Gv2PTjRn_0 2024-09-12T02:06:45.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2108291679770824459', time=2024-09-12T03:18:47.805554+0000, chain.objs.size()=1 2024-09-12T02:06:45.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UK6o7uwFuGViOfVpZMqgfi9t6dSDZVE_0 2024-09-12T02:06:45.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.971260962862609463', time=2024-09-12T03:18:47.906933+0000, chain.objs.size()=1 2024-09-12T02:06:45.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RlRI8H6CxFheNV6qhkEgTjq646KZqaB_0 2024-09-12T02:06:45.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3827774826913930571', time=2024-09-12T03:18:48.210920+0000, chain.objs.size()=1 2024-09-12T02:06:45.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BZmYxtNMxOsnBFzhTXZzG1a28ZQ_Mma_0 2024-09-12T02:06:45.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2019961307465246938', time=2024-09-12T03:18:48.212528+0000, chain.objs.size()=1 2024-09-12T02:06:45.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vJTZ7rMjLnzzPoCKrM1IoT6_GPMfuTu_0 2024-09-12T02:06:45.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1091024404528202871', time=2024-09-12T03:18:49.259935+0000, chain.objs.size()=1 2024-09-12T02:06:45.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Mhg6eniCGz_4lXzYxTAQVKekTDNaR7m_0 2024-09-12T02:06:45.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13754196773305293291', time=2024-09-12T03:18:49.967280+0000, chain.objs.size()=1 2024-09-12T02:06:45.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yOnisD1F-Yqg9d0z63YV1b6Oj3KMMiV_0 2024-09-12T02:06:45.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6704487180424723517', time=2024-09-12T03:18:50.739837+0000, chain.objs.size()=1 2024-09-12T02:06:45.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gTQPz6xTV1ooEMV4Khnqtjt9MVLoJv4_0 2024-09-12T02:06:45.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8163669031663150465', time=2024-09-12T03:18:53.751784+0000, chain.objs.size()=1 2024-09-12T02:06:45.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tOR-RAgdlemr_I7CnduM3uqsEW0YKQn_0 2024-09-12T02:06:45.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4277408466585988272', time=2024-09-12T03:18:54.449697+0000, chain.objs.size()=1 2024-09-12T02:06:45.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.18B_KC16qZJ309iZxD3ABykH76-FBF2_0 2024-09-12T02:06:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1233714865976483503', time=2024-09-12T03:18:55.513874+0000, chain.objs.size()=1 2024-09-12T02:06:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.iFj6XsyTrZxB9GADVHhAKjGA0K7nH17_0 2024-09-12T02:06:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10556921046366816139', time=2024-09-12T03:18:58.502680+0000, chain.objs.size()=1 2024-09-12T02:06:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8p0vI_Nsfl738WImyjw6TlJaC5YpzqF_0 2024-09-12T02:06:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12341021687569474051', time=2024-09-12T03:18:59.608904+0000, chain.objs.size()=1 2024-09-12T02:06:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.li9ac8WUoFt1Vmde5dZC1l0hglEpqx6_0 2024-09-12T02:06:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5650199716105669811', time=2024-09-12T03:18:59.722021+0000, chain.objs.size()=1 2024-09-12T02:06:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CgrM9ePnX30krRHQXlabAgmwASeweXc_0 2024-09-12T02:06:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1639378886993272827', time=2024-09-12T03:19:01.399638+0000, chain.objs.size()=1 2024-09-12T02:06:45.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.cmrQcwBgMWmB1SctAIcgapoLCEU8Vwm_0 2024-09-12T02:06:45.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1781381295738880006', time=2024-09-12T03:19:01.401139+0000, chain.objs.size()=1 2024-09-12T02:06:45.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.FY2QBAGv2g-N4Yqieo_bU5hsgAVGRLr_0 2024-09-12T02:06:45.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8161663826737549056', time=2024-09-12T03:19:01.403077+0000, chain.objs.size()=1 2024-09-12T02:06:45.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.P5mjSBVDrsvV9dxbTUXPaZjHSeo1n50_0 2024-09-12T02:06:45.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11724030988219362302', time=2024-09-12T03:19:01.721995+0000, chain.objs.size()=1 2024-09-12T02:06:45.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fAUDCnJH_TJkAXVq6YB8BjxW9gdniAS_0 2024-09-12T02:06:45.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4917542013809348264', time=2024-09-12T03:19:03.071465+0000, chain.objs.size()=1 2024-09-12T02:06:45.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ws_4FX9OssIIzRB8hXwClpF8fW_5Gxh_0 2024-09-12T02:06:45.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14700164546698437552', time=2024-09-12T03:19:03.431521+0000, chain.objs.size()=1 2024-09-12T02:06:45.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.EdyrRDJj2qwgDJ1dO2ck97V5ckaLh21_0 2024-09-12T02:06:45.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11635799488982141354', time=2024-09-12T03:19:04.163844+0000, chain.objs.size()=1 2024-09-12T02:06:45.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3tsbozoV8QDeDJDbDq6s5coGj5hOxk9_0 2024-09-12T02:06:45.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4972702119885859695', time=2024-09-12T03:19:07.515877+0000, chain.objs.size()=1 2024-09-12T02:06:45.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.svudORY1L_vd1uohOQ52xV4FCzl6uu8_0 2024-09-12T02:06:45.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17599820047720319751', time=2024-09-12T03:20:54.732274+0000, chain.objs.size()=1 2024-09-12T02:06:45.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.LmrSDVXCnW52K5N892fIjZ03EKL9AsA_0 2024-09-12T02:06:45.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17169669642416788671', time=2024-09-12T03:20:54.918011+0000, chain.objs.size()=1 2024-09-12T02:06:45.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3bTvItF6lDGMUIQC01HJIyjPiboTH87_0 2024-09-12T02:06:45.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12018568756410549779', time=2024-09-12T03:20:59.331323+0000, chain.objs.size()=1 2024-09-12T02:06:45.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.n9-iV1iWHnauXwXtwAf4I6Ql8vx8eO9_0 2024-09-12T02:06:45.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4839432029955327877', time=2024-09-12T03:21:00.171078+0000, chain.objs.size()=1 2024-09-12T02:06:45.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0MDJ_zGddgfVTKXLsqOBHmC2y_xGcMg_0 2024-09-12T02:06:45.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15811544738651793151', time=2024-09-12T03:21:00.387450+0000, chain.objs.size()=1 2024-09-12T02:06:45.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gq5NhoGdEJZ05WlviHNEAyY1SwIHNdY_0 2024-09-12T02:06:45.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12331593020257475298', time=2024-09-12T03:21:01.516043+0000, chain.objs.size()=1 2024-09-12T02:06:45.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2It1C9_mvsiLWRWl_IYEzBK_impFTTs_0 2024-09-12T02:06:45.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5067698788868048596', time=2024-09-12T03:21:01.833748+0000, chain.objs.size()=1 2024-09-12T02:06:45.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.mlUiioraAIWYiiP9Ic0Mo0EX-EtZv8B_0 2024-09-12T02:06:45.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12416630774000796598', time=2024-09-12T03:21:05.673553+0000, chain.objs.size()=1 2024-09-12T02:06:45.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.91AIpC_ZwHjDqivUrfS1MhmBoFjNBG9_0 2024-09-12T02:06:45.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12269466948848622702', time=2024-09-12T03:21:09.140807+0000, chain.objs.size()=1 2024-09-12T02:06:45.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._gXjKv2l3lTmdu_en6UF--TDq0PP1pY_0 2024-09-12T02:06:45.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.322+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2561794299209268110', time=2024-09-12T03:21:10.107248+0000, chain.objs.size()=1 2024-09-12T02:06:45.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.322+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lc7oF1HQhN99Qms-F6MewAe19yNRf-__0 2024-09-12T02:06:45.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17949349598755012066', time=2024-09-12T03:21:12.899173+0000, chain.objs.size()=1 2024-09-12T02:06:45.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pBpEsPeV8FmNtQC5G0W1DE1P-WVuo8x_0 2024-09-12T02:06:45.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3374042137161938412', time=2024-09-12T03:21:14.258504+0000, chain.objs.size()=1 2024-09-12T02:06:45.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tt60bJVf0dkNLUq0ka_lokOEa7XwnRV_0 2024-09-12T02:06:45.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.701031463123057857', time=2024-09-12T03:21:15.352309+0000, chain.objs.size()=1 2024-09-12T02:06:45.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YrJGacA0oG9AMa26CiG5fG-ynPOCb7W_0 2024-09-12T02:06:45.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10569224688500421708', time=2024-09-12T03:21:16.109736+0000, chain.objs.size()=1 2024-09-12T02:06:45.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yIQ8FyX8jllcQE6nlzJQKhRJ-8BlzaN_0 2024-09-12T02:06:45.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5140484912938735987', time=2024-09-12T03:21:16.758188+0000, chain.objs.size()=1 2024-09-12T02:06:45.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1btd-08CCkpahcUayzGPZvLv9qjB4u8_0 2024-09-12T02:06:45.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12655583149420744624', time=2024-09-12T03:21:17.141464+0000, chain.objs.size()=1 2024-09-12T02:06:45.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IBUznz58Yppq0a0VHy2QYBjWZURYQDg_0 2024-09-12T02:06:45.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.330+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46543 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5838619320640495670', time=2024-09-12T03:21:17.549087+0000, chain.objs.size()=1 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.w7kpGyPiuv9OKFQbMB8Ud8Pljnc7jSY_0 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4231795934921558204', time=2024-09-12T03:21:19.924196+0000, chain.objs.size()=1 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zmLVAiS6SeFXEaVUIXRP1VPKXS1Bcz7_0 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10017791538648243821', time=2024-09-12T03:21:20.769019+0000, chain.objs.size()=1 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.KsgXbbe6Z1FI76ri-0rdNigr8NP9BjG_0 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10109251547116680775', time=2024-09-12T03:21:21.184173+0000, chain.objs.size()=1 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Ov6P8-KqChcmpALU8tSRVR2AGJMLWa7_0 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11188112015153231186', time=2024-09-12T03:21:21.185634+0000, chain.objs.size()=1 2024-09-12T02:06:45.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.eKt-eEN_6RuAzAt_J7gwjBGBH3M3tl5_0 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3705357184210784206', time=2024-09-12T03:21:23.191593+0000, chain.objs.size()=1 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fMmuT681XqIvd2dCc8BmyIn3L4Gr3LW_0 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5324380530741473207', time=2024-09-12T03:21:23.575202+0000, chain.objs.size()=1 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ncQ7lE94L1DBAK2B0vcjVu2BgA9iu1G_0 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11944471583313238664', time=2024-09-12T03:21:24.462883+0000, chain.objs.size()=1 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.VLxPMh73mYORcpSdzvfbElB4VnLCf8s_0 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6526494257529970878', time=2024-09-12T03:21:47.393497+0000, chain.objs.size()=1 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.335__shadow_.AN1n_Sd3ro0p_TZI3vym1QXO_qp-CA-_0 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10784237585721544359', time=2024-09-12T03:22:27.913652+0000, chain.objs.size()=1 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.354__shadow_.kMynWoQOJ5OQwHkGUSSPdNJP8KCRoNa_0 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3054395486580164004', time=2024-09-12T03:23:12.915066+0000, chain.objs.size()=1 2024-09-12T02:06:45.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.376__shadow_.V4Pbm8YO1QknM4AeO9p1dsLTiVAgDcJ_0 2024-09-12T02:06:45.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12658331217703098211', time=2024-09-12T03:25:46.800205+0000, chain.objs.size()=1 2024-09-12T02:06:45.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.444__shadow_.PpF8rUsTbUf_hu0WHhND7-af2x4tioW_0 2024-09-12T02:06:45.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8634813695891650815', time=2024-09-12T03:26:18.009058+0000, chain.objs.size()=1 2024-09-12T02:06:45.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.456__shadow_.14PGgEhp1Lkm81G3zxU4wrdGxt1vqiM_0 2024-09-12T02:06:45.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11621616691609523664', time=2024-09-12T03:29:38.798995+0000, chain.objs.size()=1 2024-09-12T02:06:45.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.518__shadow_.Vaul1FfZB7L8mjyPSSzKtzY8_30KZYM_0 2024-09-12T02:06:45.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15181266094630376965', time=2024-09-12T03:30:54.038219+0000, chain.objs.size()=3 2024-09-12T02:06:45.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__multipart_mymultipart.2~nasJE8iVFWEZeLSdRLLJs-vHO_vokv_.1 2024-09-12T02:06:45.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__multipart_mymultipart.2~nasJE8iVFWEZeLSdRLLJs-vHO_vokv_.2 2024-09-12T02:06:45.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__multipart_mymultipart.2~nasJE8iVFWEZeLSdRLLJs-vHO_vokv_.3 2024-09-12T02:06:45.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8702847599029571568', time=2024-09-12T03:35:51.575752+0000, chain.objs.size()=7 2024-09-12T02:06:45.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.528__multipart_mymultipart.2~K7pJV95WfhEkIyXKDHqBRCmjR20eyFG.1 2024-09-12T02:06:45.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.528__shadow_mymultipart.2~K7pJV95WfhEkIyXKDHqBRCmjR20eyFG.1_1 2024-09-12T02:06:45.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.528__multipart_mymultipart.2~K7pJV95WfhEkIyXKDHqBRCmjR20eyFG.2 2024-09-12T02:06:45.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.528__shadow_mymultipart.2~K7pJV95WfhEkIyXKDHqBRCmjR20eyFG.2_1 2024-09-12T02:06:45.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.528__multipart_mymultipart.2~K7pJV95WfhEkIyXKDHqBRCmjR20eyFG.3 2024-09-12T02:06:45.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.528__shadow_mymultipart.2~K7pJV95WfhEkIyXKDHqBRCmjR20eyFG.3_1 2024-09-12T02:06:45.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.528__multipart_mymultipart.2~K7pJV95WfhEkIyXKDHqBRCmjR20eyFG.4 2024-09-12T02:06:45.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10513531325848889970', time=2024-09-12T03:40:05.173743+0000, chain.objs.size()=1 2024-09-12T02:06:45.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:vjUyYZ.gXbWGWa0P5DOe-fv5kAYtSac_.kfcOIh7hoJwgo_GQCWisAlgXT8tjUfu_0 2024-09-12T02:06:45.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6995921475451070460', time=2024-09-12T03:40:11.624361+0000, chain.objs.size()=1 2024-09-12T02:06:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.571__shadow:IcyjtWCxQCO1gdF23gQzXwYPosHZI25_.hiGSfC7drYkQBZ-fbfH_DZSAeBCttRU_0 2024-09-12T02:06:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1789897522320838630', time=2024-09-12T03:41:00.600601+0000, chain.objs.size()=1 2024-09-12T02:06:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:p3-ZeULprTJxBeK5zqlq9BTjOH2aL2h_.iTbgM_dg_A8KKD9570G-4_qUbAbNqe0_0 2024-09-12T02:06:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7692781371698896955', time=2024-09-12T03:42:36.385916+0000, chain.objs.size()=1 2024-09-12T02:06:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.580__shadow:QRIuyv2Bhf.qxxplD7i-VDNplTgJQd7_.M0S_Gb2Q4vqj85ORXt0hM0XPbygDtk__0 2024-09-12T02:06:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14844387820955155018', time=2024-09-12T03:42:55.849344+0000, chain.objs.size()=1 2024-09-12T02:06:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.586__shadow:4ICwe8.A7J5ZZUM1csIJOqu9T5IBPNx_.YMmClbr4WiBwayMfAMWjPgDHJ4x18Il_0 2024-09-12T02:06:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU', time=2024-09-12T03:49:59.307834+0000, chain.objs.size()=12 2024-09-12T02:06:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__multipart_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.1 2024-09-12T02:06:45.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__shadow_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.1_1 2024-09-12T02:06:45.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__multipart_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.2 2024-09-12T02:06:45.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__shadow_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.2_1 2024-09-12T02:06:45.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__multipart_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.3 2024-09-12T02:06:45.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__shadow_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.3_1 2024-09-12T02:06:45.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__multipart_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.4 2024-09-12T02:06:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__shadow_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.4_1 2024-09-12T02:06:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__multipart_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.5 2024-09-12T02:06:45.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__shadow_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.5_1 2024-09-12T02:06:45.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__multipart_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.6 2024-09-12T02:06:45.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.625__shadow_multipart_enc.2~n2Odv3BRrSFk145c6W7s77sdfJ2gwlU.6_1 2024-09-12T02:06:45.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10405724458031207342', time=2024-09-12T03:51:43.485130+0000, chain.objs.size()=1 2024-09-12T02:06:45.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.651__shadow_.4tMQKsLxIFMcltGACupeBoxf1Hb0uDk_0 2024-09-12T02:06:45.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7226298151411497674', time=2024-09-12T03:53:40.610235+0000, chain.objs.size()=1 2024-09-12T02:06:45.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.680__shadow_.ZYBqPyQPkeejtbLQZ1FtkE6AKk9_oMn_0 2024-09-12T02:06:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17442851272374256089', time=2024-09-12T03:54:19.050999+0000, chain.objs.size()=1 2024-09-12T02:06:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.699__shadow:f4Ly64D.488tjzYtcgOIZ1HS438PCUV_.T0dHV5kdtyC47EGmmCHppm751OuNdQM_0 2024-09-12T02:06:45.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11203345266667501956', time=2024-09-12T03:54:21.217284+0000, chain.objs.size()=1 2024-09-12T02:06:45.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.700__shadow:5jICbCQK4Ot0f1pMkZFqyLUsjyVSzdq_.xbX_mF305jzrni-VDTnqbruq18-C-La_0 2024-09-12T02:06:45.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2960750931128277899', time=2024-09-12T04:06:00.680227+0000, chain.objs.size()=1 2024-09-12T02:06:45.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.783__shadow_.DmHeHDtM4Ubv7_LzoZ1EVZRnIF5bEFb_0 2024-09-12T02:06:45.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.370+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:45.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T02:06:45.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:45.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:45.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46277' 2024-09-12T02:06:45.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5193222604144104916', time=2024-09-12T03:10:58.896540+0000, chain.objs.size()=1 2024-09-12T02:06:45.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.243__shadow_.B9zFvzFKgDa5fgCDEuYVhUYz_VYoh1Z_0 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9773104366348228113', time=2024-09-12T03:11:44.305036+0000, chain.objs.size()=1 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.260__shadow_.LFAJk4OsjhDOusc6IcHAIPs5z1ZDotQ_0 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14904312246981951677', time=2024-09-12T03:13:34.479389+0000, chain.objs.size()=1 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6fz9fjVJF3FTrJs5uFacKEc0TkPSSou_0 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13173215468928309778', time=2024-09-12T03:13:35.507312+0000, chain.objs.size()=1 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1gtYzSPVEhLjyGDRibh_h_kmO9sGQip_0 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17817233526175462447', time=2024-09-12T03:13:36.934211+0000, chain.objs.size()=1 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.7OVWWwh5I3eCyvbMmkXRmFj_O-Ddi2u_0 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3537446941301040076', time=2024-09-12T03:13:38.428005+0000, chain.objs.size()=1 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.fK-PQ1BIcMRaTM6YUY7I_W4QMcfHYot_0 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2798029083673291525', time=2024-09-12T03:13:39.297399+0000, chain.objs.size()=1 2024-09-12T02:06:45.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pEacwW0ESAHA4nFyWJP8NkYLTx-CRHj_0 2024-09-12T02:06:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2484036312154498953', time=2024-09-12T03:13:39.691161+0000, chain.objs.size()=1 2024-09-12T02:06:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.sHKDI7vWJIqRDbtBYXYEn__TAIxtkyt_0 2024-09-12T02:06:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11499567890699215473', time=2024-09-12T03:13:40.476563+0000, chain.objs.size()=1 2024-09-12T02:06:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KG_UrY4qQpV0c2TmrbgyzxL933bWW5q_0 2024-09-12T02:06:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16606491067403773935', time=2024-09-12T03:13:42.582259+0000, chain.objs.size()=1 2024-09-12T02:06:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4nxh8V4m9jsTg2Bh_Adiq62CQDS7yt__0 2024-09-12T02:06:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1071553808199825349', time=2024-09-12T03:13:43.793130+0000, chain.objs.size()=1 2024-09-12T02:06:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.OhJyz4OKRa2-nBDuMcYS4ezmlrkR14H_0 2024-09-12T02:06:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17119058910822721245', time=2024-09-12T03:13:47.456579+0000, chain.objs.size()=1 2024-09-12T02:06:45.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ggyFyDB1jE1QaEVrl5c3Daa1eN5krfx_0 2024-09-12T02:06:45.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3713327967152651748', time=2024-09-12T03:13:47.524428+0000, chain.objs.size()=1 2024-09-12T02:06:45.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6B-YX97LipkfWdq0PHLR2VteYN3_QRY_0 2024-09-12T02:06:45.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18248210517288406363', time=2024-09-12T03:13:48.622461+0000, chain.objs.size()=1 2024-09-12T02:06:45.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mGUBZeappRhJOvMMjWm3BuhuDq7O8TB_0 2024-09-12T02:06:45.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17171240405853230921', time=2024-09-12T03:13:48.860522+0000, chain.objs.size()=1 2024-09-12T02:06:45.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rceQsks8PXA9foUECwakrFKBnu33ejc_0 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7655287360270015370', time=2024-09-12T03:13:49.308825+0000, chain.objs.size()=1 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6wKgth1y_BgaRwnbjqajPtZ22hKUBcN_0 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18039245389368387514', time=2024-09-12T03:13:51.923656+0000, chain.objs.size()=1 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ia4ikYF8AjUTSeCT7dZFZHqZLeGpWM__0 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4435675794653556457', time=2024-09-12T03:13:52.182638+0000, chain.objs.size()=1 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Wf6iE_k7-fcMI92DG0phBJF-W2pW3KD_0 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12441468169384098463', time=2024-09-12T03:13:52.930203+0000, chain.objs.size()=1 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qyQZVglxQzGrPrXuy9-ypm1zTHQJzVo_0 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13837322049045090076', time=2024-09-12T03:13:53.139329+0000, chain.objs.size()=1 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.D-Qx5fi3iOd18XBHDko_oAeIoqPuBcT_0 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16529868448806086737', time=2024-09-12T03:13:54.734652+0000, chain.objs.size()=1 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vI_vT48eVX-vGd9gI8AfmIu3lKmeJZ__0 2024-09-12T02:06:45.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9027352307956421460', time=2024-09-12T03:13:54.842322+0000, chain.objs.size()=1 2024-09-12T02:06:45.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.r5_E2WwQO_n9lf03noGtAKYTbLg8QBP_0 2024-09-12T02:06:45.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10213394149943711002', time=2024-09-12T03:13:56.807262+0000, chain.objs.size()=1 2024-09-12T02:06:45.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.UpQTzi3bJzjKato6I-lKyrgJ3lUqpHi_0 2024-09-12T02:06:45.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8687388952310238471', time=2024-09-12T03:13:58.834656+0000, chain.objs.size()=1 2024-09-12T02:06:45.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RN_mmrsKAjQRgy1UOPLO2OXp5kWOQSy_0 2024-09-12T02:06:45.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11793994605199476961', time=2024-09-12T03:13:59.299587+0000, chain.objs.size()=1 2024-09-12T02:06:45.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8CJ_bruGz8RFXxBeRMClWWyEQ1A0S5o_0 2024-09-12T02:06:45.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13290817560910347341', time=2024-09-12T03:13:59.419034+0000, chain.objs.size()=1 2024-09-12T02:06:45.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.iWXrRiFBwez19MUzjiL2gu6l8593-9C_0 2024-09-12T02:06:45.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.506547338783611602', time=2024-09-12T03:13:59.420642+0000, chain.objs.size()=1 2024-09-12T02:06:45.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._RCwKUtGL4WtZ9HCdQwDDQpuaap-TLB_0 2024-09-12T02:06:45.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1402315145879336464', time=2024-09-12T03:14:01.518287+0000, chain.objs.size()=1 2024-09-12T02:06:45.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.epr2-yATyes8lS9jcl5L6RkKVJgSf8l_0 2024-09-12T02:06:45.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9380556019663887213', time=2024-09-12T03:14:03.252537+0000, chain.objs.size()=1 2024-09-12T02:06:45.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3VVN2ayDxm7UMIe8HXckhfTIozwPJC-_0 2024-09-12T02:06:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10027586820795077375', time=2024-09-12T03:14:03.261718+0000, chain.objs.size()=1 2024-09-12T02:06:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cScP0iWwTy-AufwqVlumWmwq2D4_7Ub_0 2024-09-12T02:06:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10054696340377802184', time=2024-09-12T03:14:03.443089+0000, chain.objs.size()=1 2024-09-12T02:06:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jlUOJmXAKWuBAVO5IyjNVZeNrJbBqJq_0 2024-09-12T02:06:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12146208136660503984', time=2024-09-12T03:14:04.443653+0000, chain.objs.size()=1 2024-09-12T02:06:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Og7_tLChAEHU2s_OxoXubX4ZLJ7rK1O_0 2024-09-12T02:06:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1185656498800970515', time=2024-09-12T03:14:05.312003+0000, chain.objs.size()=1 2024-09-12T02:06:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.wof2bDTATUU_dhR0Rvp9Hw8fPvWWutn_0 2024-09-12T02:06:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8936851426877856049', time=2024-09-12T03:14:36.605933+0000, chain.objs.size()=1 2024-09-12T02:06:45.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.276__shadow_.9BgpE47_XYLgj9cZ5JUu19-lps5aY9g_0 2024-09-12T02:06:45.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8448984399960883451', time=2024-09-12T03:15:07.098146+0000, chain.objs.size()=1 2024-09-12T02:06:45.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.288__shadow_.4emGAxqBfpwytQM2Ec_6fWMM8poEfpa_0 2024-09-12T02:06:45.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.402+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17155718719258083203', time=2024-09-12T03:16:03.157258+0000, chain.objs.size()=1 2024-09-12T02:06:45.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.402+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.307__shadow_.v2_5vbwDanbK-NbgQhDMXtSSWsGaWy7_0 2024-09-12T02:06:45.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.402+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12162100842613932412', time=2024-09-12T03:16:03.171889+0000, chain.objs.size()=1 2024-09-12T02:06:45.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.402+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.307__shadow_.ZO8XSyVHjSkr-X_14bcg9876ZAfrbzf_0 2024-09-12T02:06:45.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.402+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2503752127264620445', time=2024-09-12T03:18:37.765003+0000, chain.objs.size()=1 2024-09-12T02:06:45.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.402+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LzlUk7Rxjrpw3pvJQch3PGboWlOFc12_0 2024-09-12T02:06:45.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.402+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6561035904663404080', time=2024-09-12T03:18:40.754816+0000, chain.objs.size()=1 2024-09-12T02:06:45.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.402+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LYIkiiq4BZ5Ye69EOxsUEDEVMo_xZb1_0 2024-09-12T02:06:45.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7077924319276514157', time=2024-09-12T03:18:40.821820+0000, chain.objs.size()=1 2024-09-12T02:06:45.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zcmlH0t_Nbvp5PZhKINQopRdpKk9FyP_0 2024-09-12T02:06:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6167310210183142783', time=2024-09-12T03:18:40.902743+0000, chain.objs.size()=1 2024-09-12T02:06:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QPLCDC63atw57ftRyeALf_8kyzE3cEe_0 2024-09-12T02:06:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.890428768779190062', time=2024-09-12T03:18:42.180455+0000, chain.objs.size()=1 2024-09-12T02:06:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oSdKcZDILtuyEN2y6_CF_vVEmGDKVlj_0 2024-09-12T02:06:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6063314365389586929', time=2024-09-12T03:18:42.192256+0000, chain.objs.size()=1 2024-09-12T02:06:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BxbjGaxi_d5MjviXOoWhZvobM1_o37E_0 2024-09-12T02:06:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4926753345485484799', time=2024-09-12T03:18:42.259605+0000, chain.objs.size()=1 2024-09-12T02:06:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.SSRPiHWgomqonwkSTwfj5mKTRe-d_YT_0 2024-09-12T02:06:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4136703569024165911', time=2024-09-12T03:18:43.171398+0000, chain.objs.size()=1 2024-09-12T02:06:45.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AFwuWkBa6lcJGMVRLtu5-rpwcR_eVdU_0 2024-09-12T02:06:45.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5843368436287573658', time=2024-09-12T03:18:43.663212+0000, chain.objs.size()=1 2024-09-12T02:06:45.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ayEJaZvMUSoKVIIiz-MOTPGtxcodc03_0 2024-09-12T02:06:45.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6206106740766865582', time=2024-09-12T03:18:45.516873+0000, chain.objs.size()=1 2024-09-12T02:06:45.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.M-FtO7nJuQlIFrvF3MLBnMpPPKC5SU1_0 2024-09-12T02:06:45.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1970194449059238998', time=2024-09-12T03:18:47.249245+0000, chain.objs.size()=1 2024-09-12T02:06:45.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.kUNhA6cuocwSsqxiT-94UTNfTAJ_1xS_0 2024-09-12T02:06:45.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14024495051041869935', time=2024-09-12T03:18:49.954898+0000, chain.objs.size()=1 2024-09-12T02:06:45.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RLbjPFacak2yPNtqHV2xuGn_iwOrkEp_0 2024-09-12T02:06:45.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2270537733467911900', time=2024-09-12T03:18:50.215281+0000, chain.objs.size()=1 2024-09-12T02:06:45.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6glwcoi_K6-jPGHcz5N58q9TIB0wA5Q_0 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6817795388200727744', time=2024-09-12T03:18:51.100760+0000, chain.objs.size()=1 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8fomP4oUG5iCsd94pPzgPrkc42zbWqH_0 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5366439801713649638', time=2024-09-12T03:18:54.152655+0000, chain.objs.size()=1 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.y5FEaUUYxGfQy9bmxhhY6TrUQJzk9bE_0 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15465010143289050374', time=2024-09-12T03:18:54.232506+0000, chain.objs.size()=1 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7_mBMKHpVlSM2m_4gxROrj98sSymmh5_0 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5452327050801216378', time=2024-09-12T03:18:54.678947+0000, chain.objs.size()=1 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BiB97lgvR4dXhDYs293RYqDdrQ4W49N_0 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7630269506128647009', time=2024-09-12T03:18:55.330729+0000, chain.objs.size()=1 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2WyqguWKvMLoEn5VTjlyYEXla9xyGOo_0 2024-09-12T02:06:45.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.764799665850924058', time=2024-09-12T03:18:55.470818+0000, chain.objs.size()=1 2024-09-12T02:06:45.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jZfedmHllw2YQjrtsn95LataEyNxoEo_0 2024-09-12T02:06:45.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3151488234117140268', time=2024-09-12T03:18:56.017023+0000, chain.objs.size()=1 2024-09-12T02:06:45.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ACnLpCq1rY-wKuXMPg8T-r9N0ae-6sQ_0 2024-09-12T02:06:45.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14842378370421158028', time=2024-09-12T03:18:58.483557+0000, chain.objs.size()=1 2024-09-12T02:06:45.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.svr5Qgsg7_VqMXhZEV9TLHnIDOLBOG1_0 2024-09-12T02:06:45.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3735446661322294801', time=2024-09-12T03:18:58.687853+0000, chain.objs.size()=1 2024-09-12T02:06:45.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9LzqsQB8vkyqEfe3YKEuYR49STcu2E6_0 2024-09-12T02:06:45.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15644489815107506191', time=2024-09-12T03:19:00.413034+0000, chain.objs.size()=1 2024-09-12T02:06:45.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VdYqwg4nbQGju_WUi2mJaVdw8nyTu7W_0 2024-09-12T02:06:45.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.674523164209706705', time=2024-09-12T03:19:00.415390+0000, chain.objs.size()=1 2024-09-12T02:06:45.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.j7Z7cR2OP5nfDjUdn297lmtFBFFXjaR_0 2024-09-12T02:06:45.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3806424701681462106', time=2024-09-12T03:19:02.637130+0000, chain.objs.size()=1 2024-09-12T02:06:45.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.cnwYZA2UYRnUs5dqmLHAwPjoQ12wy9u_0 2024-09-12T02:06:45.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10595694100475586742', time=2024-09-12T03:19:06.162070+0000, chain.objs.size()=1 2024-09-12T02:06:45.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RXh9FuY-cFNqwcjwke53H2e0Pf_yQVf_0 2024-09-12T02:06:45.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1943350083504963358', time=2024-09-12T03:19:06.347453+0000, chain.objs.size()=1 2024-09-12T02:06:45.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ryjYoUxcd0EenaYDP6MRm1pNamK_kqS_0 2024-09-12T02:06:45.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10766840613683217632', time=2024-09-12T03:20:54.371947+0000, chain.objs.size()=1 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IIZwSZz3JjBDPGWFSuffPvl1kJhRL_3_0 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1589630791298722748', time=2024-09-12T03:20:55.014071+0000, chain.objs.size()=1 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-sjdFEhccncIXDHZ1nJVM3spoiqXeWn_0 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7570961713381941576', time=2024-09-12T03:20:55.205783+0000, chain.objs.size()=1 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.be6SgsaHj-_Nwd4TBiBRIl7xtThWMlm_0 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5374828711583751704', time=2024-09-12T03:20:55.439248+0000, chain.objs.size()=1 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bLj2EC7evoCDIKRtfQRx3qKs7C1Lc80_0 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14213618408655181130', time=2024-09-12T03:20:55.806814+0000, chain.objs.size()=1 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Q-QabhVUgHqQlxeGwJPy4NLdqrTfKlx_0 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4663338538998864585', time=2024-09-12T03:20:57.105594+0000, chain.objs.size()=1 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2tG5cKJfnC2KW-CtnLNhk92Mds0RMV7_0 2024-09-12T02:06:45.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1887300965928370834', time=2024-09-12T03:20:57.453741+0000, chain.objs.size()=1 2024-09-12T02:06:45.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZbywAyELDUmanvG6ho8tS-YlyiFSHmD_0 2024-09-12T02:06:45.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6169245312103956460', time=2024-09-12T03:20:59.888667+0000, chain.objs.size()=1 2024-09-12T02:06:45.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EQDtOIvynOgYgcWvz1cIB-GHeSXCGsf_0 2024-09-12T02:06:45.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2537506610254456532', time=2024-09-12T03:21:01.894977+0000, chain.objs.size()=1 2024-09-12T02:06:45.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tPGwQ4qca4R2DdMLxf_zvu05umVEclk_0 2024-09-12T02:06:45.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3058956756067617176', time=2024-09-12T03:21:03.338147+0000, chain.objs.size()=1 2024-09-12T02:06:45.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.B2auUxbRMBr9FyLB1Vg2ygVII-v-R1g_0 2024-09-12T02:06:45.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6227153561625337333', time=2024-09-12T03:21:04.817829+0000, chain.objs.size()=1 2024-09-12T02:06:45.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.C1AImj5eOrJJwi0KLuugJ4QSxlkLDU4_0 2024-09-12T02:06:45.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1971284206754182884', time=2024-09-12T03:21:07.999599+0000, chain.objs.size()=1 2024-09-12T02:06:45.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DnWp5CTgqYSx9aAj5E8i5zpL0qKLlzv_0 2024-09-12T02:06:45.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4520369319106748222', time=2024-09-12T03:21:08.126871+0000, chain.objs.size()=1 2024-09-12T02:06:45.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.UyRfNyVdNy5jCxbSwXRFtQQaKq0zau6_0 2024-09-12T02:06:45.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2748718691521088712', time=2024-09-12T03:21:11.668933+0000, chain.objs.size()=1 2024-09-12T02:06:45.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.c02riAF7EfCB3wJKJbPyCRWlnB7u0Ps_0 2024-09-12T02:06:45.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7692232245095528978', time=2024-09-12T03:21:12.815876+0000, chain.objs.size()=1 2024-09-12T02:06:45.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pM0juqiScmYA0ihUs8HyAuLZ6V1bEHh_0 2024-09-12T02:06:45.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13019454586809130128', time=2024-09-12T03:21:13.704211+0000, chain.objs.size()=1 2024-09-12T02:06:45.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7LSDn8QtGP1xu8EzEsDm60gpQqZuxmX_0 2024-09-12T02:06:45.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.588246289819917657', time=2024-09-12T03:21:13.922415+0000, chain.objs.size()=1 2024-09-12T02:06:45.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.c9aTFt_Omn-EzgQWD_5boJsDWfUlxGp_0 2024-09-12T02:06:45.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17826748224503108833', time=2024-09-12T03:21:15.658616+0000, chain.objs.size()=1 2024-09-12T02:06:45.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fQ_nlShM5ih0a7TUAWMMU1zv_HyJa-0_0 2024-09-12T02:06:45.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4599929363986749541', time=2024-09-12T03:21:15.989707+0000, chain.objs.size()=1 2024-09-12T02:06:45.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.d7opb1zSVdmcrE-AbCtte9Hb2rEDH3K_0 2024-09-12T02:06:45.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2666071019882089546', time=2024-09-12T03:21:16.020615+0000, chain.objs.size()=1 2024-09-12T02:06:45.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kWEBu33CrCZmr_cyruIW1ZUKllejvSN_0 2024-09-12T02:06:45.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8091094449272119904', time=2024-09-12T03:21:17.128244+0000, chain.objs.size()=1 2024-09-12T02:06:45.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kY42dw6-QY-gSgcuKMxOqZDnrCUodsx_0 2024-09-12T02:06:45.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1379601482414155243', time=2024-09-12T03:21:19.297513+0000, chain.objs.size()=1 2024-09-12T02:06:45.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6ZwJGdv40PU4HXSRH5pEN0_L6qv8bTo_0 2024-09-12T02:06:45.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2188505316413729940', time=2024-09-12T03:21:21.138326+0000, chain.objs.size()=1 2024-09-12T02:06:45.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Ts3I8JHuqK8lJxt0ESTCk10uRmBoc3l_0 2024-09-12T02:06:45.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8699603655712599851', time=2024-09-12T03:21:22.226046+0000, chain.objs.size()=1 2024-09-12T02:06:45.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.i80eXylzZROiEpZXva_EmuLRTXKUke6_0 2024-09-12T02:06:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10013621228060794270', time=2024-09-12T03:21:25.580670+0000, chain.objs.size()=1 2024-09-12T02:06:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IXrajILV3ly_t2TXHDCEOP1I2WjZ0wp_0 2024-09-12T02:06:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10314436167993993174', time=2024-09-12T03:21:25.582847+0000, chain.objs.size()=1 2024-09-12T02:06:45.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.v7rPPtiRuxheqLwzgeJvG4Had-FDCWU_0 2024-09-12T02:06:45.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17519014772555061899', time=2024-09-12T03:21:36.040413+0000, chain.objs.size()=1 2024-09-12T02:06:45.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.330__shadow_.8Jjsdj1FXpYfikVE8oUINJcPfeofxwi_0 2024-09-12T02:06:45.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14256556758937860335', time=2024-09-12T03:23:33.795649+0000, chain.objs.size()=1 2024-09-12T02:06:45.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.385__shadow_.TdBqIizXkJdJMGHMddcyHdnNUZTEq98_0 2024-09-12T02:06:45.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9444937232838597235', time=2024-09-12T03:25:39.690244+0000, chain.objs.size()=1 2024-09-12T02:06:45.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.441__shadow_.9opH_tfUvR2hRuanJq7dWy-W5Tiaw5n_0 2024-09-12T02:06:45.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14858306858027134342', time=2024-09-12T03:27:15.809262+0000, chain.objs.size()=1 2024-09-12T02:06:45.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.482__shadow_.-hKz-LeTTtQgvD75iEPt8ZZXUCH3aWA_0 2024-09-12T02:06:45.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4390826907707762248', time=2024-09-12T03:27:21.923012+0000, chain.objs.size()=1 2024-09-12T02:06:45.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.xDY_nWh2vRVrxwK68yHMf8mrNzFPcS__0 2024-09-12T02:06:45.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10921939223227165431', time=2024-09-12T03:29:07.600880+0000, chain.objs.size()=1 2024-09-12T02:06:45.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.513__shadow_.Wr9_DgtK-Tic6_QaNDkCHgbdmi8Os9__0 2024-09-12T02:06:45.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4407359890921286238', time=2024-09-12T03:29:26.758275+0000, chain.objs.size()=1 2024-09-12T02:06:45.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.519__multipart_mymultipart.2~mzS3EPjsOeTTLvYsHOEzzTPEhhcfjYJ.1 2024-09-12T02:06:45.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14658342016176216647', time=2024-09-12T03:40:31.190647+0000, chain.objs.size()=1 2024-09-12T02:06:45.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow:fLOL4XJxImJPDGX6g.-baaKw6fxAIFq_.LGFTKECT5wNpdckN5SimVphEQIWY5TX_0 2024-09-12T02:06:45.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5850894828370683292', time=2024-09-12T03:40:55.683206+0000, chain.objs.size()=1 2024-09-12T02:06:45.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:yXms32Ztc7e3LWIw1hDu9Kb5OYWTsx7_.fwUBTBOleORtAnUORPIB-0vnS5OGzcL_0 2024-09-12T02:06:45.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17704157914173539456', time=2024-09-12T03:50:27.229242+0000, chain.objs.size()=1 2024-09-12T02:06:45.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.630__shadow_.Y-N43uN0EPhN2idOihoSnNoL2YrP-aV_0 2024-09-12T02:06:45.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46277 2024-09-12T02:06:45.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.450+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T02:06:45.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.450+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13126892851206558477', time=2024-09-12T03:53:25.549647+0000, chain.objs.size()=1 2024-09-12T02:06:45.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.450+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.673__shadow_.NA3lgICFdtz5PvEhEzy7bnVXPsZW_SO_0 2024-09-12T02:06:45.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:45.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T02:06:45.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:45.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:45.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42254' 2024-09-12T02:06:45.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_896Krntqu60Tp8ewBNZWJ81nNyFQ4zh', time=2024-09-12T03:04:34.494420+0000, chain.objs.size()=3 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.T_kiFgOrPOjUnbhxIz6kZF_qMusdyes_0 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.T_kiFgOrPOjUnbhxIz6kZF_qMusdyes_1 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.T_kiFgOrPOjUnbhxIz6kZF_qMusdyes_2 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16342274266135428188', time=2024-09-12T03:10:25.207971+0000, chain.objs.size()=1 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.231__shadow_.As2T6ViqIa8RUtNKccCYSsL-emNqTDU_0 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9584580023921308538', time=2024-09-12T03:10:45.097880+0000, chain.objs.size()=1 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.238__shadow_.NjbEKFNuU5n0FYeqRUPI4VDmYBm-lz9_0 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1186704448957078591', time=2024-09-12T03:10:45.099669+0000, chain.objs.size()=1 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.238__shadow_.HllLDj0eqwkHaTEYS6CuGuYbZPF3s4m_0 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1133378389872564016', time=2024-09-12T03:11:14.545458+0000, chain.objs.size()=1 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.248__shadow_.WwKNRe1OLZNgxyKyk09FSx57OVcrDx6_0 2024-09-12T02:06:45.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12731552369530568430', time=2024-09-12T03:11:27.140935+0000, chain.objs.size()=1 2024-09-12T02:06:45.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.253__shadow_.W2VJ1D2A1G9daQyxOBcWXeE6rBuyIGL_0 2024-09-12T02:06:45.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12225646544967330124', time=2024-09-12T03:13:34.952841+0000, chain.objs.size()=1 2024-09-12T02:06:45.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.7tKXYN_C7iE3VK-3GIuBcP2AzWeuitF_0 2024-09-12T02:06:45.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1144195515012515331', time=2024-09-12T03:13:35.960833+0000, chain.objs.size()=1 2024-09-12T02:06:45.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1hJjGpWNK2aEN_UJrTf87utrWriGa8t_0 2024-09-12T02:06:45.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1457880176051297375', time=2024-09-12T03:13:36.938565+0000, chain.objs.size()=1 2024-09-12T02:06:45.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KGUlsJ-RUMP7IBtmmo1mhiRDMj1YTBq_0 2024-09-12T02:06:45.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2885278369890754374', time=2024-09-12T03:13:38.257322+0000, chain.objs.size()=1 2024-09-12T02:06:45.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Ve0ChHZTef3aOH-toQQdEHbKHsIJFPG_0 2024-09-12T02:06:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16034674929885688816', time=2024-09-12T03:13:39.433566+0000, chain.objs.size()=1 2024-09-12T02:06:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.fyK_ePyZHeAJwuJimJubOu9d-M12CtE_0 2024-09-12T02:06:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12216518100366194836', time=2024-09-12T03:13:39.533659+0000, chain.objs.size()=1 2024-09-12T02:06:45.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Xee7T5qqo2bwonWqqm3-bWr8Egqulqq_0 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.874665722460612415', time=2024-09-12T03:13:40.604109+0000, chain.objs.size()=1 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RvWqBpT1wmQtMXkLNLDYbPU_aSPsTto_0 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7812940382947949769', time=2024-09-12T03:13:42.601045+0000, chain.objs.size()=1 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.p0uGRZRldcu-tTaHnZiqzCjnClkJTUM_0 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3235290344017227227', time=2024-09-12T03:13:42.963903+0000, chain.objs.size()=1 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.wztU4jFXGADWUCZhn9kedcIMLuaVPZs_0 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11667294464337715872', time=2024-09-12T03:13:43.479804+0000, chain.objs.size()=1 2024-09-12T02:06:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.02ZkW3q8XdCqv9VfqnQOqjOyo26E0cj_0 2024-09-12T02:06:45.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11645963602184310817', time=2024-09-12T03:13:43.773236+0000, chain.objs.size()=1 2024-09-12T02:06:45.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.j_hvMxVYAcOVed3eRa38fT540DUe0mU_0 2024-09-12T02:06:45.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15173852012525975131', time=2024-09-12T03:13:45.238897+0000, chain.objs.size()=1 2024-09-12T02:06:45.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.iY4p3fCXbnMvnfy0qi2EoWNSNM3rK2D_0 2024-09-12T02:06:45.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9362368660083783418', time=2024-09-12T03:13:46.640006+0000, chain.objs.size()=1 2024-09-12T02:06:45.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.yCeurlM49NJ_-ey-xJuso1-pz68XbSt_0 2024-09-12T02:06:45.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16416971450859341115', time=2024-09-12T03:13:46.929804+0000, chain.objs.size()=1 2024-09-12T02:06:45.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.lP8vxP6vQDUtJ_9vaaLFqPRCEAQZICz_0 2024-09-12T02:06:45.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5260832032342468883', time=2024-09-12T03:13:49.017205+0000, chain.objs.size()=1 2024-09-12T02:06:45.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aWNFSKDpEUyGxfjd3KI4DcpMDxrFoTj_0 2024-09-12T02:06:45.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2048619971597353646', time=2024-09-12T03:13:51.701570+0000, chain.objs.size()=1 2024-09-12T02:06:45.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8bPxwP3ctioO1pGH49FF8zw-IpwQ9Q-_0 2024-09-12T02:06:45.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1561650825357333031', time=2024-09-12T03:13:51.840943+0000, chain.objs.size()=1 2024-09-12T02:06:45.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.MBwHQyrvDf95KgM7dpDQLBoYKFVJdjp_0 2024-09-12T02:06:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6476990298276919651', time=2024-09-12T03:13:52.029800+0000, chain.objs.size()=1 2024-09-12T02:06:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.YKuLLMtB-Em6XCoQemD4uckNCyGETRI_0 2024-09-12T02:06:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3918150699843609593', time=2024-09-12T03:13:52.488692+0000, chain.objs.size()=1 2024-09-12T02:06:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.azu5KnL4tU4Yg6zqbfsMWXBRmcsANwN_0 2024-09-12T02:06:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9056279542790198060', time=2024-09-12T03:13:54.753675+0000, chain.objs.size()=1 2024-09-12T02:06:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KoqNw8wyjjNR9dGHXo4UMOCTo09oUsg_0 2024-09-12T02:06:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11606140448271461879', time=2024-09-12T03:13:55.218617+0000, chain.objs.size()=1 2024-09-12T02:06:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DUncE-8obOG243o749Kc4H2g-7EIvDi_0 2024-09-12T02:06:45.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5661726708257912959', time=2024-09-12T03:13:55.673520+0000, chain.objs.size()=1 2024-09-12T02:06:45.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DrMpDC7exAPI8LPSBubCx0Gr-6PIWHS_0 2024-09-12T02:06:45.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4646279486894336479', time=2024-09-12T03:13:56.167902+0000, chain.objs.size()=1 2024-09-12T02:06:45.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.IxbzP8yf0UyNGkGygb5sni6OFtlQyNr_0 2024-09-12T02:06:45.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7137773967190036903', time=2024-09-12T03:13:57.724441+0000, chain.objs.size()=1 2024-09-12T02:06:45.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.dqLxxdw7AlxeT_NyOvuvY2718PypvYz_0 2024-09-12T02:06:45.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17717147347691875081', time=2024-09-12T03:13:57.912958+0000, chain.objs.size()=1 2024-09-12T02:06:45.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.M5y28LCKRbgWdzMmtiFxIM0Y3KENUT0_0 2024-09-12T02:06:45.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5692609871471896430', time=2024-09-12T03:13:57.914957+0000, chain.objs.size()=1 2024-09-12T02:06:45.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ir8rCG4Uc1dqKwm_tfhjlp8yuLEE_qD_0 2024-09-12T02:06:45.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2455059555960292979', time=2024-09-12T03:13:58.740021+0000, chain.objs.size()=1 2024-09-12T02:06:45.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.09yRNPL77xy9YQJD3hFjC4YPxTD6pRl_0 2024-09-12T02:06:45.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4654136563982201771', time=2024-09-12T03:13:59.577416+0000, chain.objs.size()=1 2024-09-12T02:06:45.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Jv-FV6Ko3vgKk_ES11xX5hl3Uvcic2b_0 2024-09-12T02:06:45.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15329994979457789943', time=2024-09-12T03:14:00.212717+0000, chain.objs.size()=1 2024-09-12T02:06:45.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.i8y-chV6c63VakqYIdtXrHKleOeDnzT_0 2024-09-12T02:06:45.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8934373973717603610', time=2024-09-12T03:14:01.171099+0000, chain.objs.size()=1 2024-09-12T02:06:45.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pE42rWZKJ14X9Ekr7sYu1ObtZ5W-1y9_0 2024-09-12T02:06:45.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7364665926377686140', time=2024-09-12T03:14:01.334059+0000, chain.objs.size()=1 2024-09-12T02:06:45.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uwHj2LarZBmBMltb-H-d1w9vjUP8Z8Z_0 2024-09-12T02:06:45.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1092158372814972668', time=2024-09-12T03:14:02.582385+0000, chain.objs.size()=1 2024-09-12T02:06:45.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.474+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RF5CgQm3REqum8G6TqqP-lqcepFX95c_0 2024-09-12T02:06:45.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.478+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1015204893117459054', time=2024-09-12T03:14:02.611674+0000, chain.objs.size()=1 2024-09-12T02:06:45.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.478+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.bm1K37UKUxveeUD9AhqOBRJbaRLW9zW_0 2024-09-12T02:06:45.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8085236289228529637', time=2024-09-12T03:14:02.732943+0000, chain.objs.size()=1 2024-09-12T02:06:45.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.d_6Gb5Xrq59e-REA-yqXD-gACt4C6zC_0 2024-09-12T02:06:45.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3960886250920992937', time=2024-09-12T03:14:02.856873+0000, chain.objs.size()=1 2024-09-12T02:06:45.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.wFnAwd-oDlInnGrpFIT1j3gvqnF7lFO_0 2024-09-12T02:06:45.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.576183485567115132', time=2024-09-12T03:14:04.055019+0000, chain.objs.size()=1 2024-09-12T02:06:45.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.UVm7V7kyEK0cRdn-52elJFb2wsrhPcl_0 2024-09-12T02:06:45.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5676108797967603567', time=2024-09-12T03:14:04.243613+0000, chain.objs.size()=1 2024-09-12T02:06:45.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.sIFh5tdZCpmqWlBKtegrgjNuikbR2op_0 2024-09-12T02:06:45.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3275497861856188623', time=2024-09-12T03:14:12.642537+0000, chain.objs.size()=1 2024-09-12T02:06:45.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.266__shadow_.q4A1ElCgX7gNG9b7kfbpacwfi8Jsfi8_0 2024-09-12T02:06:45.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4524340938657268501', time=2024-09-12T03:15:29.489201+0000, chain.objs.size()=1 2024-09-12T02:06:45.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.tr0yekjQ8X93HC03K4nNv8TSchC0wd-_0 2024-09-12T02:06:45.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9379740609446831789', time=2024-09-12T03:15:29.491269+0000, chain.objs.size()=1 2024-09-12T02:06:45.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.zbdJPUG5DxSWle7eoDa9NVvz2S6a-Na_0 2024-09-12T02:06:45.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16959000290349691787', time=2024-09-12T03:15:34.854925+0000, chain.objs.size()=1 2024-09-12T02:06:45.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.296__shadow_.mTwLIL79A8xiQpoUfrxq0IItlg69cq8_0 2024-09-12T02:06:45.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11136963268123122799', time=2024-09-12T03:15:45.131819+0000, chain.objs.size()=1 2024-09-12T02:06:45.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.300__shadow_.6OgsF3ViVRerqj4dLD3-uOPD4kOfo3S_0 2024-09-12T02:06:45.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12356626989242242971', time=2024-09-12T03:16:43.162314+0000, chain.objs.size()=1 2024-09-12T02:06:45.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.320__shadow:9I061JjpjUE9tG.4E-uI12ZsR9HktmF_.YCfeBhclD3u9V-i6vX4GiRaoiyAnRSK_0 2024-09-12T02:06:45.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15329708039037245089', time=2024-09-12T03:18:36.378291+0000, chain.objs.size()=1 2024-09-12T02:06:45.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.JG7PeJOKYpFQVQI6rvlwe08l_PAG3sT_0 2024-09-12T02:06:45.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4221263076564087758', time=2024-09-12T03:18:37.758107+0000, chain.objs.size()=1 2024-09-12T02:06:45.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Q7vQO3XgBh-ipJ2-bTxcLBtBgX3i4h2_0 2024-09-12T02:06:45.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2878941547028659966', time=2024-09-12T03:18:39.498635+0000, chain.objs.size()=1 2024-09-12T02:06:45.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CWJr6DL0R-55JpDGpKOAR_iHKOsUg5g_0 2024-09-12T02:06:45.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17215837706678454821', time=2024-09-12T03:18:41.734602+0000, chain.objs.size()=1 2024-09-12T02:06:45.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gdnMhXubKQw6DXAAXxf8Bu_AP50adjc_0 2024-09-12T02:06:45.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13939544425686927751', time=2024-09-12T03:18:41.885544+0000, chain.objs.size()=1 2024-09-12T02:06:45.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4O5HAI6g-MbviMWno1HCSfbl2yAsN87_0 2024-09-12T02:06:45.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10928591747983371722', time=2024-09-12T03:18:41.887126+0000, chain.objs.size()=1 2024-09-12T02:06:45.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ZiNtt3pVq7b_VJb2Gpm69gm7xNMBJSW_0 2024-09-12T02:06:45.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5095463330448996071', time=2024-09-12T03:18:42.355681+0000, chain.objs.size()=1 2024-09-12T02:06:45.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qY_DD8TsGi5meZY-CkKGv9BfWHSV-My_0 2024-09-12T02:06:45.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12351476550857991990', time=2024-09-12T03:18:42.589609+0000, chain.objs.size()=1 2024-09-12T02:06:45.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PS8sYAIABk-BlOQ6uASzvyhYZoySP45_0 2024-09-12T02:06:45.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16792718986663644871', time=2024-09-12T03:18:42.932676+0000, chain.objs.size()=1 2024-09-12T02:06:45.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.14ib1KxzC9Cd0znhBpJjY_JVymusUWT_0 2024-09-12T02:06:45.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1768884612642020202', time=2024-09-12T03:18:43.643511+0000, chain.objs.size()=1 2024-09-12T02:06:45.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RexNHU-g2LppED-PwAlqNGQvQYanzr-_0 2024-09-12T02:06:45.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1413751051799865617', time=2024-09-12T03:18:43.967832+0000, chain.objs.size()=1 2024-09-12T02:06:45.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Yqnrrnv0Fvx5S4m0xHHjWkPYhAlZe1r_0 2024-09-12T02:06:45.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9378158629615540326', time=2024-09-12T03:18:45.001326+0000, chain.objs.size()=1 2024-09-12T02:06:45.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oMzpkYAAlwenZj5kLVG9NMtz9qx5E9s_0 2024-09-12T02:06:45.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7254242080147785598', time=2024-09-12T03:18:46.534057+0000, chain.objs.size()=1 2024-09-12T02:06:45.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5gJT7JmNK-_AYqC9ipK9f2VOr4epMj4_0 2024-09-12T02:06:45.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6552207566808090989', time=2024-09-12T03:18:46.924632+0000, chain.objs.size()=1 2024-09-12T02:06:45.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.bUhhfjgGjI36-UMZANjn2r7u1iN1g5p_0 2024-09-12T02:06:45.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.494+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9957008387320237922', time=2024-09-12T03:18:47.510885+0000, chain.objs.size()=1 2024-09-12T02:06:45.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.494+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.SCse6XlSveaec5PzjvdKcds6vN1s2Jp_0 2024-09-12T02:06:45.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.494+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18421694198189180661', time=2024-09-12T03:18:51.091491+0000, chain.objs.size()=1 2024-09-12T02:06:45.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.494+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.SW2owXKZcMlzv_qscP5zncwHp7ZgqfM_0 2024-09-12T02:06:45.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5092511037021045831', time=2024-09-12T03:18:54.837557+0000, chain.objs.size()=1 2024-09-12T02:06:45.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-8_0daHkGz9-w5talXPVLmnd-4oGYMI_0 2024-09-12T02:06:45.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12511739340641606323', time=2024-09-12T03:18:57.263079+0000, chain.objs.size()=1 2024-09-12T02:06:45.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.WEio5tV_6TFLiJdDCqvtNoj5ttm1tnF_0 2024-09-12T02:06:45.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4214755203143394641', time=2024-09-12T03:18:58.996239+0000, chain.objs.size()=1 2024-09-12T02:06:45.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-MaTLC7bzwwcpQiKQDZmXC0d-qHkpdA_0 2024-09-12T02:06:45.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5215490843802793530', time=2024-09-12T03:18:59.191997+0000, chain.objs.size()=1 2024-09-12T02:06:45.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oOfsbcld5Vu0ztNtmAZUYN_N-e_GJcn_0 2024-09-12T02:06:45.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1348223653208308681', time=2024-09-12T03:19:00.464692+0000, chain.objs.size()=1 2024-09-12T02:06:45.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.A2cmZXaSKDRK5vW9w87-w0CeTHVymrK_0 2024-09-12T02:06:45.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18246153568339373113', time=2024-09-12T03:19:01.373327+0000, chain.objs.size()=1 2024-09-12T02:06:45.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Jb9yCIb4dV_VKHrocIyuy_xcCPo9Rqh_0 2024-09-12T02:06:45.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18232740256886623442', time=2024-09-12T03:19:01.721249+0000, chain.objs.size()=1 2024-09-12T02:06:45.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PPuecuX8aumYL-SrxiemNa2GUsfXDja_0 2024-09-12T02:06:45.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15690875043204981513', time=2024-09-12T03:19:01.829615+0000, chain.objs.size()=1 2024-09-12T02:06:45.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.T8eHiSmUNjx2J89J25leaaz9V4-04Ac_0 2024-09-12T02:06:45.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7088520805924906540', time=2024-09-12T03:19:05.279612+0000, chain.objs.size()=1 2024-09-12T02:06:45.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UuwWc0NIyiNWKaYN78aV0kNuaTrxag7_0 2024-09-12T02:06:45.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11998338028674294312', time=2024-09-12T03:19:05.281317+0000, chain.objs.size()=1 2024-09-12T02:06:45.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.1GQC5Vppnu-rDJzcrZsQ50Rz3aSPca4_0 2024-09-12T02:06:45.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5121598209098560059', time=2024-09-12T03:19:06.177510+0000, chain.objs.size()=1 2024-09-12T02:06:45.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.uYOmrU9tiLtbfmDdQHd_ZJrjhLfnWCu_0 2024-09-12T02:06:45.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7517273716718562028', time=2024-09-12T03:19:06.755604+0000, chain.objs.size()=1 2024-09-12T02:06:45.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tk2Mhn8NpaB9mvG2MjsfuucaXF8UvC-_0 2024-09-12T02:06:45.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13399688676265109474', time=2024-09-12T03:19:06.873478+0000, chain.objs.size()=1 2024-09-12T02:06:45.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-FPCR3DbGuruaehQRSZlJRdhRh9PL00_0 2024-09-12T02:06:45.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16571576161069087544', time=2024-09-12T03:20:54.340239+0000, chain.objs.size()=1 2024-09-12T02:06:45.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bfT2-npsY_urcCiKfpuqImMpYOfVAaR_0 2024-09-12T02:06:45.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4194735037826555824', time=2024-09-12T03:20:54.341941+0000, chain.objs.size()=1 2024-09-12T02:06:45.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MFWtyLsq8MzA7b3FYYV-Dcm_BTYMdPu_0 2024-09-12T02:06:45.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1136137086134659500', time=2024-09-12T03:20:54.978693+0000, chain.objs.size()=1 2024-09-12T02:06:45.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EdtlpledsF76wOv0Shr2mITJj9a851q_0 2024-09-12T02:06:45.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5181569182197675493', time=2024-09-12T03:20:55.072977+0000, chain.objs.size()=1 2024-09-12T02:06:45.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gXip08aY2_NWiQdsxS0oJzMVsrVWb7A_0 2024-09-12T02:06:45.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14594678332295414762', time=2024-09-12T03:20:56.055598+0000, chain.objs.size()=1 2024-09-12T02:06:45.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.TO0vn0Wj0MXje9hoCaMGhnPOcxiLvsM_0 2024-09-12T02:06:45.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2179587429937027202', time=2024-09-12T03:20:56.596787+0000, chain.objs.size()=1 2024-09-12T02:06:45.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2xgDaDyZcvBCZMjzb03KbNe_XeWNAeW_0 2024-09-12T02:06:45.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16596781592932524096', time=2024-09-12T03:20:57.035615+0000, chain.objs.size()=1 2024-09-12T02:06:45.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1tMAPwPDwcaw1jePZiJ6qyfZgFWL2gR_0 2024-09-12T02:06:45.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9858569917214306990', time=2024-09-12T03:20:58.783992+0000, chain.objs.size()=1 2024-09-12T02:06:45.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zwbXbC9GHJVLBdFOErzgC-RKgXjEYK1_0 2024-09-12T02:06:45.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16866105051493402319', time=2024-09-12T03:21:00.928941+0000, chain.objs.size()=1 2024-09-12T02:06:45.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pe4H1gLfG6M10o36Al4msvcsCxMlVd__0 2024-09-12T02:06:45.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17884651917028528440', time=2024-09-12T03:21:03.248433+0000, chain.objs.size()=1 2024-09-12T02:06:45.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.k-gKvUgL4oHcM2WdLD7sZSf7lMbcd69_0 2024-09-12T02:06:45.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6783210997218261224', time=2024-09-12T03:21:03.434561+0000, chain.objs.size()=1 2024-09-12T02:06:45.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.O2ce35glRT3YQ8AFI3WTc3GdlbKsc6k_0 2024-09-12T02:06:45.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14329659890582918227', time=2024-09-12T03:21:05.519829+0000, chain.objs.size()=1 2024-09-12T02:06:45.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.G_K49OPx-bdzA0mlC03LZLu-jGl1hVG_0 2024-09-12T02:06:45.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7575900144078971038', time=2024-09-12T03:21:07.660094+0000, chain.objs.size()=1 2024-09-12T02:06:45.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.INythykiCzEC2E24lqcHzUYznPucAws_0 2024-09-12T02:06:45.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7377743654377130054', time=2024-09-12T03:21:07.884495+0000, chain.objs.size()=1 2024-09-12T02:06:45.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6AjpZLsbwxfNE9enfHAgPSUk4M5rSEg_0 2024-09-12T02:06:45.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3594934869148723459', time=2024-09-12T03:21:08.441820+0000, chain.objs.size()=1 2024-09-12T02:06:45.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fq1DwR0XWmLUO-WLqXE94RTq_t-GmWn_0 2024-09-12T02:06:45.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3445882849928130765', time=2024-09-12T03:21:10.294938+0000, chain.objs.size()=1 2024-09-12T02:06:45.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.36ceopUZjqGjtjdZrkqBzomuTWHp27V_0 2024-09-12T02:06:45.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.382821503229444003', time=2024-09-12T03:21:11.165984+0000, chain.objs.size()=1 2024-09-12T02:06:45.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.e-1g6c_LkeowQ2qAsy7lrs7MHVgS7qo_0 2024-09-12T02:06:45.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14282596685854894928', time=2024-09-12T03:21:11.597084+0000, chain.objs.size()=1 2024-09-12T02:06:45.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lD9zmShYYzzjW7bY1J1fY_UHLZjp5Uv_0 2024-09-12T02:06:45.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6489297180988725603', time=2024-09-12T03:21:11.953557+0000, chain.objs.size()=1 2024-09-12T02:06:45.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.j-a2mw880y9tzaF0tMwuxMCiZ0-4HBy_0 2024-09-12T02:06:45.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17109596538491112657', time=2024-09-12T03:21:12.783341+0000, chain.objs.size()=1 2024-09-12T02:06:45.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.H8wBvmN_uawhbdb5hwjm-DM3Z0WWscd_0 2024-09-12T02:06:45.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8832462381193840448', time=2024-09-12T03:21:13.817354+0000, chain.objs.size()=1 2024-09-12T02:06:45.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.S2R_W1HoJ5fz6b2_02nG_3QA92Djlpi_0 2024-09-12T02:06:45.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1467677043053465243', time=2024-09-12T03:21:14.216709+0000, chain.objs.size()=1 2024-09-12T02:06:45.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.InGVFBHZ6AxzrgV_AfgL9rkivh5jdy__0 2024-09-12T02:06:45.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/42254 2024-09-12T02:06:45.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2036825525443676166', time=2024-09-12T03:21:14.365458+0000, chain.objs.size()=1 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kaSKkVkV2XOT0Ob_Z-rXin-dUeKvN-E_0 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17487259277477032592', time=2024-09-12T03:21:15.254809+0000, chain.objs.size()=1 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.g3xTncq7aMC_UZ3-uaRMt8lQNBA0ppM_0 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.122143898672885196', time=2024-09-12T03:21:15.651875+0000, chain.objs.size()=1 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dvoVieXQLmn_4ykbeDoiaA6vhCpOVHV_0 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16454704726051227307', time=2024-09-12T03:21:15.808386+0000, chain.objs.size()=1 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.VMjch6FzjPwek8GQv4XN98pEgm71YiY_0 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14768189327254450767', time=2024-09-12T03:21:16.109294+0000, chain.objs.size()=1 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.jwecGUt3chYcINVydLb_h1Q7desyXvb_0 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13881274700299279300', time=2024-09-12T03:21:17.376141+0000, chain.objs.size()=1 2024-09-12T02:06:45.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EYJv3nF9yT425WAOcGD6efoHDXyPFFB_0 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4521824643656322651', time=2024-09-12T03:21:17.410345+0000, chain.objs.size()=1 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4amZLTWdxZ0h3bWqLDsCCAJ0SNgPABH_0 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15009913303266716354', time=2024-09-12T03:21:19.845706+0000, chain.objs.size()=1 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kJxWmIXQVUBfSnRT5THMYadQL0TEuIu_0 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8450220486189211110', time=2024-09-12T03:21:20.716263+0000, chain.objs.size()=1 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.U6Qo4IJLWbGztVboWH1ffca71y4WrEs_0 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8582443615961343685', time=2024-09-12T03:21:21.308158+0000, chain.objs.size()=1 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RfER_0n2xKmPDlA-sljQD3ljFegFKXm_0 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2216502692141292128', time=2024-09-12T03:21:23.730800+0000, chain.objs.size()=1 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zIhLZO1wqWeRXv3n_lhlmxgCERvPqcD_0 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6563761675448554168', time=2024-09-12T03:21:24.551000+0000, chain.objs.size()=1 2024-09-12T02:06:45.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dRJ037Z4V8YT1jodqMIxWzkN2iaAvr0_0 2024-09-12T02:06:45.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.214868617403187846', time=2024-09-12T03:23:07.519090+0000, chain.objs.size()=1 2024-09-12T02:06:45.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.374__shadow_.nSbDnGMCNXKmdnyA_IqT32wN6OygGj8_0 2024-09-12T02:06:45.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2405258133534477198', time=2024-09-12T03:25:23.579109+0000, chain.objs.size()=1 2024-09-12T02:06:45.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.434__shadow_.9h657alz3ccLFzU6CNqKKjVbNg-d1_z_0 2024-09-12T02:06:45.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10154724817671734699', time=2024-09-12T03:26:46.853687+0000, chain.objs.size()=1 2024-09-12T02:06:45.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.465__shadow_.XYaWWL6HIPDkDMC_gNRRi_dahqE_j-h_0 2024-09-12T02:06:45.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5306211497930235314', time=2024-09-12T03:27:40.650270+0000, chain.objs.size()=1 2024-09-12T02:06:45.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.489__shadow_.iObn10CuQlv9zuvgJZYhkBsYlhNYO83_0 2024-09-12T02:06:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1585522500524355837', time=2024-09-12T03:29:38.822707+0000, chain.objs.size()=1 2024-09-12T02:06:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.518__shadow_.AX8EB8WCQv6lQEEbma7nEFBMP3HtFtw_0 2024-09-12T02:06:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15795537371206660888', time=2024-09-12T03:31:11.204290+0000, chain.objs.size()=4 2024-09-12T02:06:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.521__shadow:BkUpVgIsD51P9gsv6NwYzwFd9Qr.RXu_.76fXxdq53Ekdt00RIo57pLoRZ-uH1q9_0 2024-09-12T02:06:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.521__shadow:BkUpVgIsD51P9gsv6NwYzwFd9Qr.RXu_.76fXxdq53Ekdt00RIo57pLoRZ-uH1q9_1 2024-09-12T02:06:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.521__shadow:BkUpVgIsD51P9gsv6NwYzwFd9Qr.RXu_.76fXxdq53Ekdt00RIo57pLoRZ-uH1q9_2 2024-09-12T02:06:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.521__shadow:BkUpVgIsD51P9gsv6NwYzwFd9Qr.RXu_.76fXxdq53Ekdt00RIo57pLoRZ-uH1q9_3 2024-09-12T02:06:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8LIRzh6TTPqLz59H5J8MgQ5essLLf38', time=2024-09-12T03:36:09.233493+0000, chain.objs.size()=2 2024-09-12T02:06:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.530__multipart_mymultipart.2~8LIRzh6TTPqLz59H5J8MgQ5essLLf38.1 2024-09-12T02:06:45.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.530__multipart_mymultipart.2~8LIRzh6TTPqLz59H5J8MgQ5essLLf38.2 2024-09-12T02:06:45.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11675116393285683719', time=2024-09-12T03:40:41.398616+0000, chain.objs.size()=1 2024-09-12T02:06:45.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.577__shadow:absbFhuibEEYVjwZAHQdRagQgwbU6Sz_.ENHivlW2iGahtpi0r9mGWOawDYJN-R8_0 2024-09-12T02:06:45.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10563672905903976398', time=2024-09-12T03:41:29.581298+0000, chain.objs.size()=1 2024-09-12T02:06:45.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:xnCtS9oMkcMgwhlHe.fMxLz-KXGrQ.._.ynZSvi6jMFtSs8AtF_K8kQWub4aHERY_0 2024-09-12T02:06:45.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3484443350884547981', time=2024-09-12T03:41:32.802126+0000, chain.objs.size()=1 2024-09-12T02:06:45.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:4d0ApteGE-Yd1WOyOT2Ya749KskE9S._.S50CwOT_izNRnzjCvP1mxYFpvd0-f1h_0 2024-09-12T02:06:45.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1878848348309830070', time=2024-09-12T03:42:42.584158+0000, chain.objs.size()=1 2024-09-12T02:06:45.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.581__shadow:pkaXcuVSWpFR2Kc.EtBpXhVm9BbYGBg_.L6ObSf-kNEihuBoApHmeTjtk8BVwPfF_0 2024-09-12T02:06:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6332856151731519850', time=2024-09-12T03:43:04.404486+0000, chain.objs.size()=1 2024-09-12T02:06:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.588__shadow:PSnKyaLGFchzwfS6h-tLJUlfhxOK5Wu_.sTlIHcioQ0p__C1SMJc_yJ2mcwn-up7_0 2024-09-12T02:06:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6867168225371086085', time=2024-09-12T03:43:05.041371+0000, chain.objs.size()=1 2024-09-12T02:06:45.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.588__shadow:5Jro96qTYRIwG3kAFZCt5y06y3rbnhN_.g77L3Z8L_COm9KY7RjdPnWDJ9NKyt2j_0 2024-09-12T02:06:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17371304494437584011', time=2024-09-12T03:48:42.121632+0000, chain.objs.size()=1 2024-09-12T02:06:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.619__shadow_.jDZp6SvwRnVraeh_fFXyCASE5-M3c73_0 2024-09-12T02:06:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7903792904340708018', time=2024-09-12T03:51:20.853430+0000, chain.objs.size()=1 2024-09-12T02:06:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.647__shadow_.q2Qg-OUHFLFu8bU9q-ZHRdwI39MMx5W_0 2024-09-12T02:06:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18439017749334519771', time=2024-09-12T03:51:47.950736+0000, chain.objs.size()=1 2024-09-12T02:06:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.653__shadow_.aCmcrSPHaZz6E-I9X1c8V-Vfl3kp2lE_0 2024-09-12T02:06:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17027291537056914148', time=2024-09-12T03:54:03.393497+0000, chain.objs.size()=1 2024-09-12T02:06:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.692__shadow_.TRSGAGnY6aV1VFE5uqunJK6N8vsirdo_0 2024-09-12T02:06:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2987829614751981275', time=2024-09-12T03:54:16.586633+0000, chain.objs.size()=1 2024-09-12T02:06:45.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.698__shadow:pWrtjy9SLH7lHSR7ngU5BiYrlcJvIQ8_.jMDTAWe0WxKpD5NysGASWgc0Oo4yOsM_0 2024-09-12T02:06:45.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.554+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:45.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.554+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T02:06:45.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:45.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:45.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51853' 2024-09-12T02:06:45.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_5KEa-8dDNUcbaLNA73ceJV-YCPKyIbm', time=2024-09-12T03:04:08.994228+0000, chain.objs.size()=3 2024-09-12T02:06:45.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.0Lpm9koaLn_OEKxK6hBnVJnmyIPXEt1_0 2024-09-12T02:06:45.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.0Lpm9koaLn_OEKxK6hBnVJnmyIPXEt1_1 2024-09-12T02:06:45.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.0Lpm9koaLn_OEKxK6hBnVJnmyIPXEt1_2 2024-09-12T02:06:45.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15683375703185095126', time=2024-09-12T03:04:30.392133+0000, chain.objs.size()=5 2024-09-12T02:06:45.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__multipart_foo-FROZEN.2~9QpqwVUSIENhupxikLAUPiej51cK7q3.1 2024-09-12T02:06:45.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_foo-FROZEN.2~9QpqwVUSIENhupxikLAUPiej51cK7q3.1_1 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__multipart_foo-FROZEN.2~9QpqwVUSIENhupxikLAUPiej51cK7q3.2 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_foo-FROZEN.2~9QpqwVUSIENhupxikLAUPiej51cK7q3.2_1 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__multipart_foo-FROZEN.2~9QpqwVUSIENhupxikLAUPiej51cK7q3.3 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1042558259229138366', time=2024-09-12T03:05:30.495675+0000, chain.objs.size()=1 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.180__shadow_.lISS01EX9B597hb3zASPU1i0IxJKU9n_0 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3847776699821893928', time=2024-09-12T03:05:51.406519+0000, chain.objs.size()=1 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.190__shadow_.8JiY8IPMmQh5FP4lfdGPLImz_dMgR8j_0 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12336716651393588286', time=2024-09-12T03:10:22.233478+0000, chain.objs.size()=1 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.229__shadow_.Rr14s2TWZvHR-UEb6t4vccdk9tV4rmU_0 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2977020555623731428', time=2024-09-12T03:10:27.783399+0000, chain.objs.size()=1 2024-09-12T02:06:45.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.232__shadow_.35LCo5WfuFvXVWkYXCbm9leraZQbIB__0 2024-09-12T02:06:45.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15405161556240751410', time=2024-09-12T03:10:32.788394+0000, chain.objs.size()=1 2024-09-12T02:06:45.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.234__shadow_.qJKOghl4UxillftFGP5XQWbDpznX_cA_0 2024-09-12T02:06:45.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1978003190206908166', time=2024-09-12T03:10:35.263801+0000, chain.objs.size()=1 2024-09-12T02:06:45.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.235__shadow_.Nr7js68yAyQ5xNGCisLy3CCIzBn1T6G_0 2024-09-12T02:06:45.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3111988319824993243', time=2024-09-12T03:10:40.730325+0000, chain.objs.size()=1 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.237__shadow_.QrWryB07zVmU1M7PH9OYc4APFTMtyHE_0 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6321365078671853580', time=2024-09-12T03:10:45.074533+0000, chain.objs.size()=1 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.238__shadow_.sKlMY0AV9PXBCKBRjxn_tFXU7vNX71u_0 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5726960427572503527', time=2024-09-12T03:10:53.882120+0000, chain.objs.size()=1 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.241__shadow_.Rt2iFeoREs7YGkhDISiun-CJwLMHEh__0 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4908911230963224808', time=2024-09-12T03:13:34.921679+0000, chain.objs.size()=1 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.64b2qri0F76Q9-R7BIr65bkyggTyFzs_0 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.397802505045487681', time=2024-09-12T03:13:36.548093+0000, chain.objs.size()=1 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.thHL6jYnbq40BpxDL2UdzgTJod2Y09-_0 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2533149329687550183', time=2024-09-12T03:13:36.821308+0000, chain.objs.size()=1 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aQwGcufLcbN3kDDhUhpHbQ2M8uoFkKf_0 2024-09-12T02:06:45.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15670418205145996064', time=2024-09-12T03:13:36.927131+0000, chain.objs.size()=1 2024-09-12T02:06:45.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2bD63-jECCaROWK4v9Fb1kqJzdq28gJ_0 2024-09-12T02:06:45.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18077080909204341489', time=2024-09-12T03:13:40.592458+0000, chain.objs.size()=1 2024-09-12T02:06:45.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aNE1DOb_ogHp5zDO86fyRyKQk7Po_77_0 2024-09-12T02:06:45.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.605396239176136700', time=2024-09-12T03:13:40.674961+0000, chain.objs.size()=1 2024-09-12T02:06:45.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CbRp_TXrUkuUk_iBkyT75QiVpmOuVqx_0 2024-09-12T02:06:45.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.958726975535397402', time=2024-09-12T03:13:41.151550+0000, chain.objs.size()=1 2024-09-12T02:06:45.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uiJUJg02CzkFtqRx8QCYDpeK6-83V9p_0 2024-09-12T02:06:45.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9690885015822097056', time=2024-09-12T03:13:41.326096+0000, chain.objs.size()=1 2024-09-12T02:06:45.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.VbMADMAsHlkWYnTDhLB6xk_7_1jgNq4_0 2024-09-12T02:06:45.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2719692946546532096', time=2024-09-12T03:13:43.786901+0000, chain.objs.size()=1 2024-09-12T02:06:45.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2jWlNuCwNgsMHnf09J-VAwqWXY4nXDd_0 2024-09-12T02:06:45.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4251061182961602154', time=2024-09-12T03:13:46.966899+0000, chain.objs.size()=1 2024-09-12T02:06:45.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.NrvxBseIptM8-S8jX6L-psnX1XIvFQF_0 2024-09-12T02:06:45.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14824811245479421946', time=2024-09-12T03:13:47.008767+0000, chain.objs.size()=1 2024-09-12T02:06:45.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.boJ2dGU1MAOcomsvoKU0f6taj16g4vl_0 2024-09-12T02:06:45.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10727071924676857680', time=2024-09-12T03:13:47.874308+0000, chain.objs.size()=1 2024-09-12T02:06:45.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6iFM3_wCpFj70Ut9qLArwAEDya6BXWb_0 2024-09-12T02:06:45.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7804205811404916017', time=2024-09-12T03:13:48.616386+0000, chain.objs.size()=1 2024-09-12T02:06:45.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RAlWeSXy5vnGoCFqCbIWMiANx8XuqE3_0 2024-09-12T02:06:45.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2121884049811378882', time=2024-09-12T03:13:51.517941+0000, chain.objs.size()=1 2024-09-12T02:06:45.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.b22OB1aNSoMMGrFNx3gg0VM-ckw3MX1_0 2024-09-12T02:06:45.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12320201359288796110', time=2024-09-12T03:13:51.519918+0000, chain.objs.size()=1 2024-09-12T02:06:45.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CYe2t6tdu298tLn1T6fiVQVxIGCqVrh_0 2024-09-12T02:06:45.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4653740732403687099', time=2024-09-12T03:13:53.389042+0000, chain.objs.size()=1 2024-09-12T02:06:45.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xTomFA2CN37cZcxsk6N-wfU4yXrUkkl_0 2024-09-12T02:06:45.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7499844686793456111', time=2024-09-12T03:13:54.707211+0000, chain.objs.size()=1 2024-09-12T02:06:45.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-LvtCveGOG13GkT1NDBVT4U7HQyhZm6_0 2024-09-12T02:06:45.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.502991604170836109', time=2024-09-12T03:13:56.437700+0000, chain.objs.size()=1 2024-09-12T02:06:45.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.kbN0pJTAuPTohBmWtIR57-LFMWI_CqY_0 2024-09-12T02:06:45.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2606278156175545026', time=2024-09-12T03:13:57.826447+0000, chain.objs.size()=1 2024-09-12T02:06:45.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jeNH1yhOHoFNlP7G8TJrtkUfTzZB-yU_0 2024-09-12T02:06:45.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9669091073113491634', time=2024-09-12T03:13:59.158870+0000, chain.objs.size()=1 2024-09-12T02:06:45.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Zj35Pbrk7zpDJ9xBlWLjA8c_h5qZ2bp_0 2024-09-12T02:06:45.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12131838188918374638', time=2024-09-12T03:13:59.848725+0000, chain.objs.size()=1 2024-09-12T02:06:45.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.FUGbB3x0VOd7zu-Ncy0Uq7_5v8Zkopq_0 2024-09-12T02:06:45.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10991962109072282437', time=2024-09-12T03:14:01.174442+0000, chain.objs.size()=1 2024-09-12T02:06:45.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0BzPwvMy8n2AU_SuJsmyV34K5UCvNba_0 2024-09-12T02:06:45.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5005206907937014268', time=2024-09-12T03:14:01.824453+0000, chain.objs.size()=1 2024-09-12T02:06:45.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JFbdddIZaDp-Ga6EhRw0UA3TFEu4KfY_0 2024-09-12T02:06:45.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11995502784758534837', time=2024-09-12T03:14:04.336166+0000, chain.objs.size()=1 2024-09-12T02:06:45.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.XMJ9ByIr4tPZgAegLZ2p_KgKLAyCR8e_0 2024-09-12T02:06:45.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2334669314747447037', time=2024-09-12T03:14:04.744800+0000, chain.objs.size()=1 2024-09-12T02:06:45.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6SsVcz3XsaGow3KALYfw2xtOS9OCPG6_0 2024-09-12T02:06:45.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1293187348385412247', time=2024-09-12T03:14:04.912177+0000, chain.objs.size()=1 2024-09-12T02:06:45.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QMV6AUhqiAewnzHXqie26iFMskhmGAH_0 2024-09-12T02:06:45.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9419234613817732158', time=2024-09-12T03:14:51.685458+0000, chain.objs.size()=1 2024-09-12T02:06:45.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.282__shadow_.QdQ3fnIitmyMcImXp8EDUNi7ncRiXFJ_0 2024-09-12T02:06:45.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5403226014173192435', time=2024-09-12T03:15:23.739580+0000, chain.objs.size()=1 2024-09-12T02:06:45.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.a2fAch4TMb7d9mp0HSdigW7W9P20mOM_0 2024-09-12T02:06:45.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9833281566063362396', time=2024-09-12T03:15:29.679463+0000, chain.objs.size()=1 2024-09-12T02:06:45.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.VsNoguSWTr869kbETDlQZDtWSa2zJcw_0 2024-09-12T02:06:45.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9849391060040037527', time=2024-09-12T03:18:36.791825+0000, chain.objs.size()=1 2024-09-12T02:06:45.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oZbEv1nCDLK8NZ71AKZgdTb-WxQ-Zhu_0 2024-09-12T02:06:45.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2061520333239383384', time=2024-09-12T03:18:36.911914+0000, chain.objs.size()=1 2024-09-12T02:06:45.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GxUzIys2lj5Lw8AHWAxVBERvTTOzao0_0 2024-09-12T02:06:45.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.85900031010279802', time=2024-09-12T03:18:36.913879+0000, chain.objs.size()=1 2024-09-12T02:06:45.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5YLaEWeJNGtvtOiL6dSDBUTGdftyDtQ_0 2024-09-12T02:06:45.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.841636023021214699', time=2024-09-12T03:18:37.147587+0000, chain.objs.size()=1 2024-09-12T02:06:45.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.SK3D6Z1eiY9en1GvlrKlef43CRyzg9Q_0 2024-09-12T02:06:45.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9135304299559750534', time=2024-09-12T03:18:38.262219+0000, chain.objs.size()=1 2024-09-12T02:06:45.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.64pctswxWvgj99Ak4dqojQqbRrf4mfl_0 2024-09-12T02:06:45.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2252028169362324538', time=2024-09-12T03:18:38.530211+0000, chain.objs.size()=1 2024-09-12T02:06:45.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.24KsXe2R5raFdA6Sh2vr3_vsYxaMizA_0 2024-09-12T02:06:45.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.70558682913190018', time=2024-09-12T03:18:39.166437+0000, chain.objs.size()=1 2024-09-12T02:06:45.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.J4rjEWov7LfBYIBvz9JpWrtQ3QsGsQE_0 2024-09-12T02:06:45.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17106390932352227896', time=2024-09-12T03:18:39.571892+0000, chain.objs.size()=1 2024-09-12T02:06:45.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.1g3hxTfudD4yxY5NjQfQYUDyC8VwSZL_0 2024-09-12T02:06:45.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12660385557439064260', time=2024-09-12T03:18:41.297198+0000, chain.objs.size()=1 2024-09-12T02:06:45.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QCX-PV8sjBH-uic8nCfCQL5k1Zb3ynz_0 2024-09-12T02:06:45.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2041617771489852206', time=2024-09-12T03:18:41.686698+0000, chain.objs.size()=1 2024-09-12T02:06:45.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zAwsMsjtBVvPjvJZrd6NtyldBkI77L7_0 2024-09-12T02:06:45.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7568082769979480810', time=2024-09-12T03:18:42.018039+0000, chain.objs.size()=1 2024-09-12T02:06:45.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jLZX5QNg5WZCL50KKbV549WAi0gFVfR_0 2024-09-12T02:06:45.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5597447252244684695', time=2024-09-12T03:18:43.205487+0000, chain.objs.size()=1 2024-09-12T02:06:45.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Hfup0jD3ShaxOfawVdURmvo5grOKsyv_0 2024-09-12T02:06:45.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11210726479129970172', time=2024-09-12T03:18:43.922189+0000, chain.objs.size()=1 2024-09-12T02:06:45.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.R9PMY5_nM60J9WUzJG7gDewUoh6ui8t_0 2024-09-12T02:06:45.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10608823329830911308', time=2024-09-12T03:18:43.959865+0000, chain.objs.size()=1 2024-09-12T02:06:45.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MT0lNoOA19lM7qx0Rm9p3vbcs9sps3z_0 2024-09-12T02:06:45.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2975637069259310755', time=2024-09-12T03:18:46.926116+0000, chain.objs.size()=1 2024-09-12T02:06:45.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5RhU0gR0WtBIlRwYRgbX1XmmfwxI57a_0 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14514969242293956625', time=2024-09-12T03:18:47.035242+0000, chain.objs.size()=1 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.e1vzRZKs7-AkFcE9uAE6lxZcgEnvM-A_0 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8999275421024586947', time=2024-09-12T03:18:49.396937+0000, chain.objs.size()=1 2024-09-12T02:06:45.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.P4bg8fntwe3h5HIG1Akc_ctyn_7rtgW_0 2024-09-12T02:06:45.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2675020740905507556', time=2024-09-12T03:18:51.084245+0000, chain.objs.size()=1 2024-09-12T02:06:45.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.SFb3KOSYeGDRDA0t9uYs80u64vMAVzK_0 2024-09-12T02:06:45.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1882696097886720856', time=2024-09-12T03:18:53.862694+0000, chain.objs.size()=1 2024-09-12T02:06:45.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.d1PtW_hTNKXXTRk07AOQJr9BmyCkkl-_0 2024-09-12T02:06:45.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10857237033897230958', time=2024-09-12T03:18:54.688663+0000, chain.objs.size()=1 2024-09-12T02:06:45.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4-rtVcDtclmq-ubXjzNMCzB8WU1g9LQ_0 2024-09-12T02:06:45.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12185389413425403069', time=2024-09-12T03:18:54.726442+0000, chain.objs.size()=1 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.NSnxfqEbFBNfRYnQ4hH_gX_Usf6NBeL_0 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.552070519396676893', time=2024-09-12T03:18:57.808398+0000, chain.objs.size()=1 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zkPtpll2-EbX44G389leTcwTHhM6nS__0 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.531846841904408625', time=2024-09-12T03:18:58.988161+0000, chain.objs.size()=1 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GER1wA-Z5qo8VS2YXwmQyfirLW_w5au_0 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12987449324543380591', time=2024-09-12T03:18:59.188014+0000, chain.objs.size()=1 2024-09-12T02:06:45.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RvGk5ts97C_1jXrhbEqO96iKatkzutb_0 2024-09-12T02:06:45.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.594+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16581987986301026910', time=2024-09-12T03:19:00.458721+0000, chain.objs.size()=1 2024-09-12T02:06:45.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.594+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qGxQh6KJUcuLcmqS7K9elav0XfNK3XC_0 2024-09-12T02:06:45.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.594+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7985534043023430064', time=2024-09-12T03:19:02.192466+0000, chain.objs.size()=1 2024-09-12T02:06:45.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.594+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Z5FjdhZ6XJOat32JD-eAZ0k2Y4R5SaX_0 2024-09-12T02:06:45.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.594+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9654739108540172516', time=2024-09-12T03:19:02.823196+0000, chain.objs.size()=1 2024-09-12T02:06:45.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.594+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4tzeyogCEHhif2WeQf0d0N0981vnx4S_0 2024-09-12T02:06:45.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.594+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9375705874857997840', time=2024-09-12T03:19:04.549822+0000, chain.objs.size()=1 2024-09-12T02:06:45.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.594+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.S2j4J9R7UgtpGA2zulivBzTRus-VH1v_0 2024-09-12T02:06:45.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18374893235478992263', time=2024-09-12T03:19:06.667841+0000, chain.objs.size()=1 2024-09-12T02:06:45.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.T0glL87BQOlVYa9uG5mH1VgzSX8DXC3_0 2024-09-12T02:06:45.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16109864197158436681', time=2024-09-12T03:19:06.884905+0000, chain.objs.size()=1 2024-09-12T02:06:45.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._qK-Si_BlIlyZg4Ttn-mzD_sVpNmlnP_0 2024-09-12T02:06:45.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5131837581454104907', time=2024-09-12T03:19:07.088008+0000, chain.objs.size()=1 2024-09-12T02:06:45.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.K9NvqHMljTceb_PDlMfKbdUP6CB2xbe_0 2024-09-12T02:06:45.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14235081350676447497', time=2024-09-12T03:19:07.523058+0000, chain.objs.size()=1 2024-09-12T02:06:45.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.XO0M7ql_YnhbDYILeGWhnaknccs0W1Z_0 2024-09-12T02:06:45.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4721894375871883032', time=2024-09-12T03:20:54.638434+0000, chain.objs.size()=1 2024-09-12T02:06:45.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ur2Olo5Ip75O_I-6XKOAZ00t6t_oZBU_0 2024-09-12T02:06:45.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8722992748872791791', time=2024-09-12T03:20:55.432357+0000, chain.objs.size()=1 2024-09-12T02:06:45.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-wV4Vf-ed7_HQQWd9GDMRQvhHBDyn20_0 2024-09-12T02:06:45.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9794430778880694552', time=2024-09-12T03:20:56.208854+0000, chain.objs.size()=1 2024-09-12T02:06:45.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.iwfg4TEMBVL29fV8xRHMh74zQ0-6Sg5_0 2024-09-12T02:06:45.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16886424999283494930', time=2024-09-12T03:20:56.990730+0000, chain.objs.size()=1 2024-09-12T02:06:45.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0TiH8HWVGK9M85I_8HTCChYXU6absCl_0 2024-09-12T02:06:45.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.879547594438211216', time=2024-09-12T03:20:59.182830+0000, chain.objs.size()=1 2024-09-12T02:06:45.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tdb2c9RyUwKFvuVFtyS6oTJH9GIg5lO_0 2024-09-12T02:06:45.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10871339409525384251', time=2024-09-12T03:20:59.602523+0000, chain.objs.size()=1 2024-09-12T02:06:45.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.cQwWmrak7Jk9R655Kla1rZfO6l-cVT__0 2024-09-12T02:06:45.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.461942139451721568', time=2024-09-12T03:20:59.676039+0000, chain.objs.size()=1 2024-09-12T02:06:45.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tEad6SKK-XjZ3VRSZOi13EOyq-r9RH4_0 2024-09-12T02:06:45.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11111876943077310986', time=2024-09-12T03:21:00.349428+0000, chain.objs.size()=1 2024-09-12T02:06:45.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.J3wkx_7mAjR2UIj5nQS4NX_zY2leETd_0 2024-09-12T02:06:45.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2972813748266083142', time=2024-09-12T03:21:01.518702+0000, chain.objs.size()=1 2024-09-12T02:06:45.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.JJZ4047IrgvgaL5-bsiloyUAZSi2_v1_0 2024-09-12T02:06:45.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17453562038259271673', time=2024-09-12T03:21:03.006931+0000, chain.objs.size()=1 2024-09-12T02:06:45.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dEFshtox7r15DsvLIBYYC8wvO7N_56C_0 2024-09-12T02:06:45.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1913403866148689199', time=2024-09-12T03:21:04.572110+0000, chain.objs.size()=1 2024-09-12T02:06:45.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xCxGKTaQWkQgah1uhfaPnaBC4v_pyNx_0 2024-09-12T02:06:45.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10219214103806741946', time=2024-09-12T03:21:05.639623+0000, chain.objs.size()=1 2024-09-12T02:06:45.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4kwd--moc_X3hEpgSkr7FAvPyJLL7Mo_0 2024-09-12T02:06:45.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6870322181976592549', time=2024-09-12T03:21:05.641045+0000, chain.objs.size()=1 2024-09-12T02:06:45.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.oD9OGVlkfBqvh5HJo78YhEaalmSqHLI_0 2024-09-12T02:06:45.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17947720955886360560', time=2024-09-12T03:21:08.121754+0000, chain.objs.size()=1 2024-09-12T02:06:45.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dbqlFBqc5RS5fZIe32a9-Th7RrtXUce_0 2024-09-12T02:06:45.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15866307383196929277', time=2024-09-12T03:21:12.961895+0000, chain.objs.size()=1 2024-09-12T02:06:45.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dppCUhvvYjwNimybw3WtJEUnx0mRzz7_0 2024-09-12T02:06:45.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10901391865876585579', time=2024-09-12T03:21:13.784783+0000, chain.objs.size()=1 2024-09-12T02:06:45.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.VYAbkBtuawmfHR1mi--fyawTA3ows5W_0 2024-09-12T02:06:45.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10269002325547256330', time=2024-09-12T03:21:16.274788+0000, chain.objs.size()=1 2024-09-12T02:06:45.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yZBszXrCoLDwPU3tnBlh8eOfKnSgGlL_0 2024-09-12T02:06:45.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1885226532030649258', time=2024-09-12T03:21:16.356512+0000, chain.objs.size()=1 2024-09-12T02:06:45.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8xYZ3SrmhXpAXlQzCswPqEol1r-FS_y_0 2024-09-12T02:06:45.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3429117571590588959', time=2024-09-12T03:21:17.001271+0000, chain.objs.size()=1 2024-09-12T02:06:45.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.L2TyRD953S2zvdsFUMOr_H3fiwFXb9H_0 2024-09-12T02:06:45.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6897122051321482029', time=2024-09-12T03:21:17.002886+0000, chain.objs.size()=1 2024-09-12T02:06:45.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.anmXcUfj2SDu1VlyAMdrzHMH_sEHgUu_0 2024-09-12T02:06:45.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6019563766010519116', time=2024-09-12T03:21:17.301624+0000, chain.objs.size()=1 2024-09-12T02:06:45.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vpHFZQpZq2CT65IChaGbp-F5Dv4bDZJ_0 2024-09-12T02:06:45.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2250661132851373845', time=2024-09-12T03:21:19.237560+0000, chain.objs.size()=1 2024-09-12T02:06:45.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NjuAgLpOzp_BzqiQx5fBR9YXztGUSrf_0 2024-09-12T02:06:45.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7567949047273756147', time=2024-09-12T03:21:22.318673+0000, chain.objs.size()=1 2024-09-12T02:06:45.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RwXz42QXPHGc_Ed7pVkvNxzeYEu326d_0 2024-09-12T02:06:45.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18121604267293967693', time=2024-09-12T03:21:24.133323+0000, chain.objs.size()=1 2024-09-12T02:06:45.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.VzQEt--6NouH5zphjAWww9UZ8ap4UA4_0 2024-09-12T02:06:45.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9311790282731540890', time=2024-09-12T03:21:25.085834+0000, chain.objs.size()=1 2024-09-12T02:06:45.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8UDEop4gMY2gdCJwTxL3k-Y0KpBYpRQ_0 2024-09-12T02:06:45.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3409165707525657807', time=2024-09-12T03:21:25.143938+0000, chain.objs.size()=1 2024-09-12T02:06:45.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1jF8IOgI6W27cUpJB4utUz9ncchrewK_0 2024-09-12T02:06:45.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2384544312686283051', time=2024-09-12T03:21:25.456395+0000, chain.objs.size()=1 2024-09-12T02:06:45.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9yxsNjB9hxf075BuGWvf4IKWLkK3cMk_0 2024-09-12T02:06:45.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3443021206789302561', time=2024-09-12T03:21:25.619921+0000, chain.objs.size()=1 2024-09-12T02:06:45.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.614+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zELiDBmeS17HWY-5mZ0o5hUGUrMCmAl_0 2024-09-12T02:06:45.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.622+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51853 2024-09-12T02:06:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T02:06:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17223467088588272623', time=2024-09-12T03:21:40.595132+0000, chain.objs.size()=1 2024-09-12T02:06:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.332__shadow_.C6zLM-YefI_FddH9d3eiaOVaz7ZAmpI_0 2024-09-12T02:06:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13489579025112337020', time=2024-09-12T03:23:31.411503+0000, chain.objs.size()=1 2024-09-12T02:06:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.384__shadow_.PMqp5DEH5cIeebrfqmkOm6ZZ82W0QR2_0 2024-09-12T02:06:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10752200158194009788', time=2024-09-12T03:26:50.076982+0000, chain.objs.size()=1 2024-09-12T02:06:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.466__shadow_.SWpvsb8OogXo-Iceh_hkSO4Xo4cGUxy_0 2024-09-12T02:06:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15740407592131546723', time=2024-09-12T03:27:35.802552+0000, chain.objs.size()=1 2024-09-12T02:06:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.487__shadow_.sJRJhUQACR6BtNnIAWKSSq9OpzqrhPn_0 2024-09-12T02:06:45.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9828556837431428676', time=2024-09-12T03:27:48.456771+0000, chain.objs.size()=1 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.492__shadow_.qxLm7d67jeQRILpj90BrOSxEy-1FSbp_0 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3240427639698722654', time=2024-09-12T03:29:14.669049+0000, chain.objs.size()=1 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.517__multipart_mymultipartcopy.2~l4bXSyUiOzqElhjBZtk_5v3xfryiBnS.1 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~s5foRZplBbB1d93tk-68A0ZitI7Z6qj', time=2024-09-12T03:36:27.238521+0000, chain.objs.size()=1 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.534__multipart_mymultipart.2~s5foRZplBbB1d93tk-68A0ZitI7Z6qj.1 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9457485885446419639', time=2024-09-12T03:39:59.038884+0000, chain.objs.size()=1 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:E-1t3f3luNruNDmOcYfGsDkLVZNzi0Y_.vk9QvexpAHNR7IHXpv6ze50ISfFlsTz_0 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2684779118257073111', time=2024-09-12T03:40:00.199730+0000, chain.objs.size()=1 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:8duF8FbKQGeUbBBMd9jt.97hXO1ab7g_.zINk2i0g07Lnyne8brTWXR_h4nTBErf_0 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10099039802354463772', time=2024-09-12T03:41:07.494465+0000, chain.objs.size()=1 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:cpbEpOqtW78asNiv02uhTFaPiHx8k-7_.a4_6dRxJu5uZ26234u3ava3IzZXkJ0H_0 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9183253921607307702', time=2024-09-12T03:41:17.960823+0000, chain.objs.size()=1 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:bFxzUlSrSH2PPePpCNK-xApgumV7bSf_.4SUgqdeSHqg-qqDNC0adxlTOqaAvadc_0 2024-09-12T02:06:45.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5793434592541324538', time=2024-09-12T03:43:43.198573+0000, chain.objs.size()=1 2024-09-12T02:06:45.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.606__shadow_.XNlA0PBiIHb7jaNQPI3skOLJIiPqRkg_0 2024-09-12T02:06:45.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4722432045560334254', time=2024-09-12T03:53:04.996576+0000, chain.objs.size()=1 2024-09-12T02:06:45.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.664__shadow_.dqQVD9YInljA8zyuaxnK1xUg6Tgg5dB_0 2024-09-12T02:06:45.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9533197588039405144', time=2024-09-12T03:56:36.473022+0000, chain.objs.size()=2 2024-09-12T02:06:45.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.741__shadow_._pfdTD2idd21VWhkxN_gNFHwWv05bRU_0 2024-09-12T02:06:45.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.741__shadow_._pfdTD2idd21VWhkxN_gNFHwWv05bRU_1 2024-09-12T02:06:45.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:45.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T02:06:45.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:45.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:45.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45488' 2024-09-12T02:06:45.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14213828874437094201', time=2024-09-12T03:03:31.082697+0000, chain.objs.size()=5 2024-09-12T02:06:45.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__multipart_mymultipart-LUKEWARM.2~3PrclA8a34LJ1wxFF8-igX-DBg79xCS.1 2024-09-12T02:06:45.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__shadow_mymultipart-LUKEWARM.2~3PrclA8a34LJ1wxFF8-igX-DBg79xCS.1_1 2024-09-12T02:06:45.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__multipart_mymultipart-LUKEWARM.2~3PrclA8a34LJ1wxFF8-igX-DBg79xCS.2 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__shadow_mymultipart-LUKEWARM.2~3PrclA8a34LJ1wxFF8-igX-DBg79xCS.2_1 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__multipart_mymultipart-LUKEWARM.2~3PrclA8a34LJ1wxFF8-igX-DBg79xCS.3 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12103068926365437977', time=2024-09-12T03:03:54.421149+0000, chain.objs.size()=3 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.mnDPQnl1Etf6WeHzUUTTRVxi7IdX1b7_0 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.mnDPQnl1Etf6WeHzUUTTRVxi7IdX1b7_1 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.mnDPQnl1Etf6WeHzUUTTRVxi7IdX1b7_2 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_OUPzWRo5PyBB8_MoKV8YRxWyfVxXblI', time=2024-09-12T03:03:58.029476+0000, chain.objs.size()=1 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.x-_8NanPXBySbLmnweAmHWLIaXLHFoS_0 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_7jLTRNeo9dODCXnD9W3gGCJ8PfAWDpa', time=2024-09-12T03:04:54.493284+0000, chain.objs.size()=1 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.166__shadow_.D5VORPGxmoxSokcAK1acuNbzWXY-5PL_0 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16078504084831327369', time=2024-09-12T03:04:58.153486+0000, chain.objs.size()=1 2024-09-12T02:06:45.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.167__shadow_.va_m1PtBkeslrc05PpqmIegavNmGonD_0 2024-09-12T02:06:45.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15312044761910209579', time=2024-09-12T03:06:52.989070+0000, chain.objs.size()=1 2024-09-12T02:06:45.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.650+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.205__shadow_.oZzi6DlH1xTAQdK1OZJN-tLHZghR6n2_0 2024-09-12T02:06:45.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16793699825283096244', time=2024-09-12T03:10:25.219401+0000, chain.objs.size()=1 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.231__shadow_.E3c9q9Y_yB7dBtgdt09kpsW4NnTCVBW_0 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6155304138597307612', time=2024-09-12T03:10:49.511193+0000, chain.objs.size()=1 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.239__shadow_.1TTH8RCjhWm-F1Hr77M3eERK-t5bJBv_0 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1475673228778191322', time=2024-09-12T03:11:07.016553+0000, chain.objs.size()=1 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.245__shadow_.tPh7LKxiOwN7dEA72nhe_I-djn_khpw_0 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9925778733498147907', time=2024-09-12T03:11:17.112436+0000, chain.objs.size()=1 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.249__shadow_.6wGA7zrD7h1oRH5k0eThN2lqCD_yGd3_0 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3983478024407945525', time=2024-09-12T03:11:34.662811+0000, chain.objs.size()=1 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.256__shadow_.72ztzSYufXwdP2ZHdC_i9EyF4G7apds_0 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1576877756777770622', time=2024-09-12T03:11:41.861511+0000, chain.objs.size()=1 2024-09-12T02:06:45.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.259__shadow_.QVZhDIs1-uCH8TU0cJtA2wCooSjvMFC_0 2024-09-12T02:06:45.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18234392638225282410', time=2024-09-12T03:13:33.972205+0000, chain.objs.size()=1 2024-09-12T02:06:45.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._7zSB9bI78VG4inXJfgpes6bVFNT_WT_0 2024-09-12T02:06:45.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5217069194358336229', time=2024-09-12T03:13:33.974717+0000, chain.objs.size()=1 2024-09-12T02:06:45.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ZaykOhwaOjKxfLRrzNNs72rPM2yXElS_0 2024-09-12T02:06:45.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1831536005611719270', time=2024-09-12T03:13:33.976834+0000, chain.objs.size()=1 2024-09-12T02:06:45.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.HMDUFNKUm1bxRB8CSdbLqugTGaI5CRx_0 2024-09-12T02:06:45.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8032125373181897961', time=2024-09-12T03:13:34.305681+0000, chain.objs.size()=1 2024-09-12T02:06:45.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.imcZniGkHilQu_3ac1UMnjmYLCZToq5_0 2024-09-12T02:06:45.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.779559135815237162', time=2024-09-12T03:13:35.637112+0000, chain.objs.size()=1 2024-09-12T02:06:45.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GcBiCeHO17aulVX_jcMeqB_VpgoMh66_0 2024-09-12T02:06:45.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2944390091551066389', time=2024-09-12T03:13:36.591981+0000, chain.objs.size()=1 2024-09-12T02:06:45.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.MJ5cR0DNp6YsNy5UziPFixnNdpd_xyr_0 2024-09-12T02:06:45.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7677344792694218886', time=2024-09-12T03:13:36.749008+0000, chain.objs.size()=1 2024-09-12T02:06:45.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QwZ3iAnodraTlgRnbBbcejJjf4z9EF__0 2024-09-12T02:06:45.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.658+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9621483891488169846', time=2024-09-12T03:13:37.239013+0000, chain.objs.size()=1 2024-09-12T02:06:45.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.658+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.FUEJsOdHGPPcPYLC4Ej3voy-D_KqEiI_0 2024-09-12T02:06:45.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15901287055997794501', time=2024-09-12T03:13:38.347717+0000, chain.objs.size()=1 2024-09-12T02:06:45.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.AkbC-2_gynZgbV2efItZfZwGgU03SqO_0 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7653050961888128534', time=2024-09-12T03:13:38.767890+0000, chain.objs.size()=1 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.r90OU-QiwQq4M7y3Idnzubv96UBSqQv_0 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9740009022114966287', time=2024-09-12T03:13:39.390826+0000, chain.objs.size()=1 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vEv1_q86mRoR3EwPkMoon-MXNDftoD2_0 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9004731723603391424', time=2024-09-12T03:13:41.386177+0000, chain.objs.size()=1 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Y4q9hK8EPQl5OY-bxfhD3vMQ2iARgbR_0 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9453514860753508035', time=2024-09-12T03:13:42.413740+0000, chain.objs.size()=1 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.j6k0I-dw0YYOFJSBwlbk5_8WrllLfCy_0 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2190355845471703571', time=2024-09-12T03:13:43.012185+0000, chain.objs.size()=1 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.bhFA7eTqiix8hboohjaq3pSIZOqVbEu_0 2024-09-12T02:06:45.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1304913392354660771', time=2024-09-12T03:13:44.688918+0000, chain.objs.size()=1 2024-09-12T02:06:45.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.S03L3hJBZ6QW4UiptZeLWY04dBjMCtC_0 2024-09-12T02:06:45.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6373461015136815283', time=2024-09-12T03:13:44.999609+0000, chain.objs.size()=1 2024-09-12T02:06:45.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Qj5N9Nkeih2KATIw5itmduCRI1FLvF7_0 2024-09-12T02:06:45.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.666+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9405236016148970090', time=2024-09-12T03:13:45.124965+0000, chain.objs.size()=1 2024-09-12T02:06:45.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.666+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xPEuO0Bi3ud_QF_FnGWqZiGqPNUeH_T_0 2024-09-12T02:06:45.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.666+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18291212601089529702', time=2024-09-12T03:13:46.544121+0000, chain.objs.size()=1 2024-09-12T02:06:45.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.666+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5kjbEVjeagyGsMy-QMEchkdUD9sQ4Xh_0 2024-09-12T02:06:45.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.666+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1304188112731634563', time=2024-09-12T03:13:47.488852+0000, chain.objs.size()=1 2024-09-12T02:06:45.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.666+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.X-Tv-idddZARmQkmLRocwjbxHZKTK77_0 2024-09-12T02:06:45.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.666+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6231622961043394359', time=2024-09-12T03:13:49.653071+0000, chain.objs.size()=1 2024-09-12T02:06:45.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.666+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.XCL26pBwrDB8fad7zUI30SCbo5fFl4r_0 2024-09-12T02:06:45.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.772341519937278486', time=2024-09-12T03:13:51.390210+0000, chain.objs.size()=1 2024-09-12T02:06:45.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tpfIGM17bZTVrHNcu6msFZ9T4iuzyhS_0 2024-09-12T02:06:45.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11909801403982692506', time=2024-09-12T03:13:52.932780+0000, chain.objs.size()=1 2024-09-12T02:06:45.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1qORRjgiyrQq-fwW0BIuxiU2isn64RS_0 2024-09-12T02:06:45.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1685740507618268320', time=2024-09-12T03:13:54.748675+0000, chain.objs.size()=1 2024-09-12T02:06:45.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.lcdBUN5dTmNNRZwNRsdCc7orLuI_Omg_0 2024-09-12T02:06:45.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10535557774136574408', time=2024-09-12T03:13:55.205580+0000, chain.objs.size()=1 2024-09-12T02:06:45.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.nB4Y_o5Lf6srojzar1dpVD-S2Y-QaCL_0 2024-09-12T02:06:45.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13035012920499508291', time=2024-09-12T03:13:55.658709+0000, chain.objs.size()=1 2024-09-12T02:06:45.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RiQgryxb0SEY1Jrzb1yTDsIioOnPCrb_0 2024-09-12T02:06:45.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13462196358504493782', time=2024-09-12T03:13:56.918089+0000, chain.objs.size()=1 2024-09-12T02:06:45.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uGoSpzs2zKLl7l7YQbQtOo2thdlfP0B_0 2024-09-12T02:06:45.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13834234776623633361', time=2024-09-12T03:13:58.847322+0000, chain.objs.size()=1 2024-09-12T02:06:45.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5K5htYDda6ym3Z54Q88NHC6pU9ygFY3_0 2024-09-12T02:06:45.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13464829466792580567', time=2024-09-12T03:14:01.162442+0000, chain.objs.size()=1 2024-09-12T02:06:45.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.VHv7smN17Y8C4FdyoIY9gQagH2NC6Uf_0 2024-09-12T02:06:45.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5702529427322461447', time=2024-09-12T03:14:01.890835+0000, chain.objs.size()=1 2024-09-12T02:06:45.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8n4Ykoylmab0fWkKdth0SNflUW-oBMW_0 2024-09-12T02:06:45.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1801887756090816120', time=2024-09-12T03:14:03.079713+0000, chain.objs.size()=1 2024-09-12T02:06:45.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QH_TOsL0Mao5e1TNVtYrpH6QnxvDtNM_0 2024-09-12T02:06:45.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14680045521198244880', time=2024-09-12T03:14:03.364808+0000, chain.objs.size()=1 2024-09-12T02:06:45.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uJn-4jw0CpIGHpe6s359Hbn010EOXOd_0 2024-09-12T02:06:45.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18309756256764808439', time=2024-09-12T03:14:03.665773+0000, chain.objs.size()=1 2024-09-12T02:06:45.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xijyjfSR6tPdbtB-QRVB-xK51ehYC7P_0 2024-09-12T02:06:45.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14843121066272858066', time=2024-09-12T03:14:04.019409+0000, chain.objs.size()=1 2024-09-12T02:06:45.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.f-ypVaoBv4t6W752mz7dbdDVJrKVV-6_0 2024-09-12T02:06:45.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17004376611996778220', time=2024-09-12T03:14:04.150012+0000, chain.objs.size()=1 2024-09-12T02:06:45.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.SIT4QYsuUJj0e_5Ov_INpbjOvHK8-4s_0 2024-09-12T02:06:45.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17235978825663307957', time=2024-09-12T03:14:04.428944+0000, chain.objs.size()=1 2024-09-12T02:06:45.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.C4RzM41ejJM1SdZN7w2FeEbeFAyDalf_0 2024-09-12T02:06:45.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17553399063740301979', time=2024-09-12T03:14:05.064574+0000, chain.objs.size()=1 2024-09-12T02:06:45.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Znh8A_zlTWjzQzzclJqjkmDZiGTHLnJ_0 2024-09-12T02:06:45.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1807707684183858434', time=2024-09-12T03:14:07.847559+0000, chain.objs.size()=1 2024-09-12T02:06:45.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.264__shadow_.PxGucsUvctUEIrDz8HFcTR0Yg884mCx_0 2024-09-12T02:06:45.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5853460399917023680', time=2024-09-12T03:14:46.644275+0000, chain.objs.size()=1 2024-09-12T02:06:45.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.280__shadow_.1BzvQsldlXGy2yQ53kbIe8cVu3us58d_0 2024-09-12T02:06:45.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.678+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16814457910410644433', time=2024-09-12T03:15:29.744785+0000, chain.objs.size()=1 2024-09-12T02:06:45.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.eFW9hdy9wkTcy2-PIfsQcK1yHRQyFhb_0 2024-09-12T02:06:45.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.678+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13152942053178049577', time=2024-09-12T03:15:32.289341+0000, chain.objs.size()=1 2024-09-12T02:06:45.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.295__shadow_.RfzGFVnGtLp71A7MgCGaTmVEM3c198V_0 2024-09-12T02:06:45.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.678+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4621319836457745777', time=2024-09-12T03:16:43.132861+0000, chain.objs.size()=1 2024-09-12T02:06:45.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.320__shadow:H4eVgNPDpTXDlj7HlDX-BpDVjMef51z_.eSmVjJXKgmYHYFMXsmOl3zOywsH4k1Y_0 2024-09-12T02:06:45.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9602673486191605361', time=2024-09-12T03:18:36.358646+0000, chain.objs.size()=1 2024-09-12T02:06:45.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VpfHcdGr4clOYJWeN32ZHbHymWd6fKS_0 2024-09-12T02:06:45.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8161939147033142727', time=2024-09-12T03:18:36.624566+0000, chain.objs.size()=1 2024-09-12T02:06:45.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6kZgmXWUvOEvkisYJ7gNXAYIIjCAYMt_0 2024-09-12T02:06:45.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6719855788892563683', time=2024-09-12T03:18:37.192836+0000, chain.objs.size()=1 2024-09-12T02:06:45.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hUJWfSFx40x6sWDvHMotT8y7O2qWJBJ_0 2024-09-12T02:06:45.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3666489178369484208', time=2024-09-12T03:18:38.435563+0000, chain.objs.size()=1 2024-09-12T02:06:45.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.aez21brV6f06s1zghT_1sllP9b9v1XK_0 2024-09-12T02:06:45.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.101167730579317145', time=2024-09-12T03:18:38.962486+0000, chain.objs.size()=1 2024-09-12T02:06:45.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QIJFnSyfFMbnR39RO6vVpQtCsL6tP___0 2024-09-12T02:06:45.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11606137132530762447', time=2024-09-12T03:18:42.766969+0000, chain.objs.size()=1 2024-09-12T02:06:45.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.XmfNnb_P0g3R82hrP_0T27aCf3XTiF0_0 2024-09-12T02:06:45.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14937759018926861494', time=2024-09-12T03:18:43.917764+0000, chain.objs.size()=1 2024-09-12T02:06:45.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.G6BOQjkNk2Ag7kdgnxOTya6Q_EnNhe9_0 2024-09-12T02:06:45.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14365618026867733806', time=2024-09-12T03:18:45.418797+0000, chain.objs.size()=1 2024-09-12T02:06:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VgjDEaNSJdgZ3C8mOe84I0BWTv5YNKd_0 2024-09-12T02:06:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2135686138303671926', time=2024-09-12T03:18:45.889019+0000, chain.objs.size()=1 2024-09-12T02:06:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ucpG51t2P0tfzmfUnpnpKvDUu5SY6P-_0 2024-09-12T02:06:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2912252994232507182', time=2024-09-12T03:18:50.130027+0000, chain.objs.size()=1 2024-09-12T02:06:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.nl9rklkRO2PBnoFbc38KN9832VyQ6II_0 2024-09-12T02:06:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3717097122507963640', time=2024-09-12T03:18:50.414165+0000, chain.objs.size()=1 2024-09-12T02:06:45.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Uu76gnNif5k5AX6ADz2MgMNFY-hGAq6_0 2024-09-12T02:06:45.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.616835772224930970', time=2024-09-12T03:18:50.415909+0000, chain.objs.size()=1 2024-09-12T02:06:45.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.J9OiCuBOmIgQOqWX4Qc-ctPrwe0zQJd_0 2024-09-12T02:06:45.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13829890945852080957', time=2024-09-12T03:18:50.984881+0000, chain.objs.size()=1 2024-09-12T02:06:45.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zlgQC8rdGj3A6EHCwPXuugt6S15lA2J_0 2024-09-12T02:06:45.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8525714217486200309', time=2024-09-12T03:18:51.841367+0000, chain.objs.size()=1 2024-09-12T02:06:45.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Mvq8OBS-YI6mgaVAOEno1HPSlmvuNMV_0 2024-09-12T02:06:45.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3311864302402149898', time=2024-09-12T03:18:52.177875+0000, chain.objs.size()=1 2024-09-12T02:06:45.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-eS8-hBvFWKuseHluR69xCK2RphfMKx_0 2024-09-12T02:06:45.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18378237930927233734', time=2024-09-12T03:18:53.863198+0000, chain.objs.size()=1 2024-09-12T02:06:45.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tGbnOtbHuLvjgVBndQHvOrU-2nbVk9__0 2024-09-12T02:06:45.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6468120399845339651', time=2024-09-12T03:18:57.302228+0000, chain.objs.size()=1 2024-09-12T02:06:45.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MUMB8whtT1SclGOHbkAheDy4li1d1YP_0 2024-09-12T02:06:45.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17652303393267019460', time=2024-09-12T03:18:57.376121+0000, chain.objs.size()=1 2024-09-12T02:06:45.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oEM27IliEPRXzyNrZQfj-a1yfXPnJNS_0 2024-09-12T02:06:45.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9974974232228614767', time=2024-09-12T03:18:57.806809+0000, chain.objs.size()=1 2024-09-12T02:06:45.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-YMiEnE5QqM2zQzsu8mV-Gs_31E89Dt_0 2024-09-12T02:06:45.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11005223860680561633', time=2024-09-12T03:18:57.957014+0000, chain.objs.size()=1 2024-09-12T02:06:45.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.v8zmM_N1WlQE-E0lSz61ocG4Abp676W_0 2024-09-12T02:06:45.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2372299804125134484', time=2024-09-12T03:18:58.267345+0000, chain.objs.size()=1 2024-09-12T02:06:45.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.uoN9FXlEa7XwJjSbjw4brsnNS2W4Ryx_0 2024-09-12T02:06:45.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8137839888358095987', time=2024-09-12T03:18:58.865826+0000, chain.objs.size()=1 2024-09-12T02:06:45.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ItgmHJ63EbkJWWUjU0-Z0w086UXvx9Y_0 2024-09-12T02:06:45.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9913738027025006752', time=2024-09-12T03:18:59.618085+0000, chain.objs.size()=1 2024-09-12T02:06:45.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4T-Kcc6gpEcw0a6aLN92Oi26lLDcjgv_0 2024-09-12T02:06:45.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2352097434132360882', time=2024-09-12T03:18:59.778999+0000, chain.objs.size()=1 2024-09-12T02:06:45.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.IaVge32_ZdNZAgqlE6CH8fdqvZKBppv_0 2024-09-12T02:06:45.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8214183001181823423', time=2024-09-12T03:19:02.913755+0000, chain.objs.size()=1 2024-09-12T02:06:45.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UfWf7Lin2zOnknDO-taI-M_B27NvFvy_0 2024-09-12T02:06:45.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16446840246529283718', time=2024-09-12T03:19:03.142383+0000, chain.objs.size()=1 2024-09-12T02:06:45.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MaxoK3bO1DxT68Gz8nxCgxMnAKoQLCv_0 2024-09-12T02:06:45.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7747204331064878900', time=2024-09-12T03:19:03.981509+0000, chain.objs.size()=1 2024-09-12T02:06:45.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.sTFqRrkJW9G7V1d5KYAVNOMoU_WEzq2_0 2024-09-12T02:06:45.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14771648789421918270', time=2024-09-12T03:19:05.347858+0000, chain.objs.size()=1 2024-09-12T02:06:45.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ODhnPFGmp3SZPRWKHrEgb9Cd4FosWC5_0 2024-09-12T02:06:45.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16220785857615864412', time=2024-09-12T03:19:07.533931+0000, chain.objs.size()=1 2024-09-12T02:06:45.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CrWj4dZqh17N3iXABk59cA3geCEsapg_0 2024-09-12T02:06:45.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1604432088129358933', time=2024-09-12T03:20:55.332951+0000, chain.objs.size()=1 2024-09-12T02:06:45.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RZMYXS4d_rUb22_xaCnuYuzHT1daEzR_0 2024-09-12T02:06:45.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18357948209206017098', time=2024-09-12T03:20:56.713685+0000, chain.objs.size()=1 2024-09-12T02:06:45.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.03Y_OVRpRobPGz0KACb0eZ7cXhorath_0 2024-09-12T02:06:45.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4604339924039894820', time=2024-09-12T03:20:56.715606+0000, chain.objs.size()=1 2024-09-12T02:06:45.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EYy49sURWgw_8byXlqQXx9GrSFvytGF_0 2024-09-12T02:06:45.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16796658372232365620', time=2024-09-12T03:20:57.208613+0000, chain.objs.size()=1 2024-09-12T02:06:45.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.x2bYN9dRYIQbwmX6uqjtvsd9V3wygNt_0 2024-09-12T02:06:45.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14621004233257790359', time=2024-09-12T03:20:58.861745+0000, chain.objs.size()=1 2024-09-12T02:06:45.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5r3nzkLrLcY8CoLH2tK7LUIQkVbuVM5_0 2024-09-12T02:06:45.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16394613052689134202', time=2024-09-12T03:20:59.616671+0000, chain.objs.size()=1 2024-09-12T02:06:45.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.K_X4IHqEwYUJ7regLp77udo9_oiepSb_0 2024-09-12T02:06:45.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10858559318646241584', time=2024-09-12T03:21:00.575431+0000, chain.objs.size()=1 2024-09-12T02:06:45.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7wvZOoUauSoYVNlpCbPlkXRWZQWnUB2_0 2024-09-12T02:06:45.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10332277423516071965', time=2024-09-12T03:21:01.760513+0000, chain.objs.size()=1 2024-09-12T02:06:45.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4ekcDxHKxm6L_oHbgYN1Kz8nSAphJAH_0 2024-09-12T02:06:45.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4008541016861335493', time=2024-09-12T03:21:03.010464+0000, chain.objs.size()=1 2024-09-12T02:06:45.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.aNeMmWKDtXleOqF2KghP66Lw44c3BAu_0 2024-09-12T02:06:45.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7342383143845913004', time=2024-09-12T03:21:03.705635+0000, chain.objs.size()=1 2024-09-12T02:06:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ihizbThrzZkPQJCnI4RSCYg128Y56yy_0 2024-09-12T02:06:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12816662184799090598', time=2024-09-12T03:21:03.707822+0000, chain.objs.size()=1 2024-09-12T02:06:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qXBk6M1YNGR9kiDKuJ-o_OSJza-PcVR_0 2024-09-12T02:06:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18388458671568848354', time=2024-09-12T03:21:05.517252+0000, chain.objs.size()=1 2024-09-12T02:06:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hRXUGnyXAIZraT50phqmAhAMxAktd1K_0 2024-09-12T02:06:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11288239552348059685', time=2024-09-12T03:21:08.696959+0000, chain.objs.size()=1 2024-09-12T02:06:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ic1MNMK9bd6xJeKkuZ8RYI1H_0eZhRs_0 2024-09-12T02:06:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8842492093080142100', time=2024-09-12T03:21:08.789010+0000, chain.objs.size()=1 2024-09-12T02:06:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.O-PqeOUdaq-svznP_CW8_dDVLgRmqoH_0 2024-09-12T02:06:45.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7408006851390302437', time=2024-09-12T03:21:09.039868+0000, chain.objs.size()=1 2024-09-12T02:06:45.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZX_QCuMNLNDZAvvz7g3jSk9HFPv7YRd_0 2024-09-12T02:06:45.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11122406453481575205', time=2024-09-12T03:21:09.284585+0000, chain.objs.size()=1 2024-09-12T02:06:45.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9WHcYefvXH7QyE-qFfgeqNb0x8ouM3l_0 2024-09-12T02:06:45.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9512436760553778474', time=2024-09-12T03:21:09.581782+0000, chain.objs.size()=1 2024-09-12T02:06:45.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.A5VsSR-IoQ3uS6FhTeOaWzEPlWvs0WG_0 2024-09-12T02:06:45.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9038726039443835357', time=2024-09-12T03:21:10.001301+0000, chain.objs.size()=1 2024-09-12T02:06:45.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.sGsvdS-zqeq5ZixhxfjSHIJayuGRxg3_0 2024-09-12T02:06:45.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.714+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45488 2024-09-12T02:06:45.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T02:06:45.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8493141800350779860', time=2024-09-12T03:21:12.067453+0000, chain.objs.size()=1 2024-09-12T02:06:45.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kOg4x83b9482FQlHv59uaL7AVo9L5ix_0 2024-09-12T02:06:45.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11884954963327482605', time=2024-09-12T03:21:12.828851+0000, chain.objs.size()=1 2024-09-12T02:06:45.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._Qvc5dfK4Cs3bAOUpORro4lOyoXK2KW_0 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11064928275285948442', time=2024-09-12T03:21:15.548107+0000, chain.objs.size()=1 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RVcGWzSlAhVPX03EOi8VcNW-pvmZMWn_0 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2844640791463557939', time=2024-09-12T03:21:15.644377+0000, chain.objs.size()=1 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.OwSGmd87KHi_s5wcditPJ_RZ61VkF0Q_0 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17847690981784612304', time=2024-09-12T03:21:17.154784+0000, chain.objs.size()=1 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6euxr9gAjOqPIMobKCQkXmnLLz9-B64_0 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7144479627549951773', time=2024-09-12T03:21:17.880063+0000, chain.objs.size()=1 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5q0DHbX46I0YYFwaTmvxcyBCwwzaaX3_0 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4052439484531595074', time=2024-09-12T03:21:18.053289+0000, chain.objs.size()=1 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kc0Tt_EL980RYDrmwL1FThG97-OaWgn_0 2024-09-12T02:06:45.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16169565796390712801', time=2024-09-12T03:21:18.057651+0000, chain.objs.size()=1 2024-09-12T02:06:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZSeA-B-TWL5HoAzbacLxjlUsnJMVBve_0 2024-09-12T02:06:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1487568558060666189', time=2024-09-12T03:21:18.181669+0000, chain.objs.size()=1 2024-09-12T02:06:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.QJDBM2TFTYb4NveAqugddINqM26N4tG_0 2024-09-12T02:06:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5219578750502860565', time=2024-09-12T03:21:18.183626+0000, chain.objs.size()=1 2024-09-12T02:06:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hHZyRQlZSG9USIp6WUoF5St1Ut56uYX_0 2024-09-12T02:06:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3515368042462291566', time=2024-09-12T03:21:18.365833+0000, chain.objs.size()=1 2024-09-12T02:06:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PjRDeeFAfWDXPkmeRad70z9rZV9_ciN_0 2024-09-12T02:06:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10258325906784486028', time=2024-09-12T03:21:19.408373+0000, chain.objs.size()=1 2024-09-12T02:06:45.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.718+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gRwn9metqsDV7Eg1TTYAEQBzBNyD8_i_0 2024-09-12T02:06:45.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4952911893885041753', time=2024-09-12T03:21:21.657696+0000, chain.objs.size()=1 2024-09-12T02:06:45.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.TTUvOd2GsefrAmbH_C7-6VMVDZKjErd_0 2024-09-12T02:06:45.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13869518067333578244', time=2024-09-12T03:21:22.257495+0000, chain.objs.size()=1 2024-09-12T02:06:45.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0R2xtyQCbiekJz81FPyi0YFLapwdp2U_0 2024-09-12T02:06:45.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11382740784385706062', time=2024-09-12T03:21:22.286312+0000, chain.objs.size()=1 2024-09-12T02:06:45.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.iA_byOd9JHlptVhQ6SxT15AuFAl2Tf8_0 2024-09-12T02:06:45.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.390898533756223720', time=2024-09-12T03:21:23.222059+0000, chain.objs.size()=1 2024-09-12T02:06:45.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bdiN-xQ9RoW4itAVOmro3YDg5xNo-S4_0 2024-09-12T02:06:45.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5738713401197432671', time=2024-09-12T03:24:29.175329+0000, chain.objs.size()=1 2024-09-12T02:06:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.410__shadow_.sd5NirppIfy8HsfSOkvrzJiT8qZoJpw_0 2024-09-12T02:06:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13757399218323511236', time=2024-09-12T03:26:53.276772+0000, chain.objs.size()=1 2024-09-12T02:06:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.467__shadow_.Z-8M8m4KLsUdtAE0uSUP-OZNFog86ou_0 2024-09-12T02:06:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3156804448798877390', time=2024-09-12T03:29:37.149177+0000, chain.objs.size()=1 2024-09-12T02:06:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.519__multipart_mymultipart.2~OAwQsdaKmP9JRpqtg5guvAKjp2x6sYS.1 2024-09-12T02:06:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13140303635051291773', time=2024-09-12T03:31:03.630552+0000, chain.objs.size()=6 2024-09-12T02:06:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__multipart_mymultipart.2~xo3ONFwe6MUgUj4Plu5rWu-KTVa2FFR.1 2024-09-12T02:06:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__shadow_mymultipart.2~xo3ONFwe6MUgUj4Plu5rWu-KTVa2FFR.1_1 2024-09-12T02:06:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__multipart_mymultipart.2~xo3ONFwe6MUgUj4Plu5rWu-KTVa2FFR.2 2024-09-12T02:06:45.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__shadow_mymultipart.2~xo3ONFwe6MUgUj4Plu5rWu-KTVa2FFR.2_1 2024-09-12T02:06:45.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__multipart_mymultipart.2~xo3ONFwe6MUgUj4Plu5rWu-KTVa2FFR.3 2024-09-12T02:06:45.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.522__shadow_mymultipart.2~xo3ONFwe6MUgUj4Plu5rWu-KTVa2FFR.3_1 2024-09-12T02:06:45.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2756690820945740285', time=2024-09-12T03:38:13.803331+0000, chain.objs.size()=1 2024-09-12T02:06:45.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.554__shadow_.sjp2dU8OhbBhmRmSFxu5ycqhFcChYXK_0 2024-09-12T02:06:45.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11953942266471600362', time=2024-09-12T03:40:35.555132+0000, chain.objs.size()=1 2024-09-12T02:06:45.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.576__shadow_.vbbwj0kGY06zhJ0K0KHduGCuGS3cd4x_0 2024-09-12T02:06:45.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2500585015071355709', time=2024-09-12T03:40:42.793984+0000, chain.objs.size()=1 2024-09-12T02:06:45.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.577__shadow:itcdblAUd7dFf48d1RGX2GaxWPIqWr0_.MoMZrjlYg5aYxf6yfz0G-j5TNaZ6h6H_0 2024-09-12T02:06:45.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5534720035328974297', time=2024-09-12T03:41:12.261498+0000, chain.objs.size()=1 2024-09-12T02:06:45.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.730+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:iIqicp79sjAVHIfszipYHqbX41Q-r0B_.yAFNOlQ3zCjQSIidPq040HJVsP75P3i_0 2024-09-12T02:06:45.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1853385849904633541', time=2024-09-12T03:41:16.767059+0000, chain.objs.size()=1 2024-09-12T02:06:45.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:VNX7tP5vBgtOANSm5b-RTlOODrK.NHs_.aaOJTuUiTnd6VZQM6APMOJZiTKlLgv1_0 2024-09-12T02:06:45.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5683303500015711927', time=2024-09-12T03:42:36.293097+0000, chain.objs.size()=1 2024-09-12T02:06:45.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.580__shadow:RPE6lRc2bFFxInkz6E3bVJo2NwmX.Z0_.2yFRAGhLBOXY-HLWobO50paJNd_CemR_0 2024-09-12T02:06:45.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17216482596769523427', time=2024-09-12T03:42:43.403887+0000, chain.objs.size()=1 2024-09-12T02:06:45.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.581__shadow:pkaXcuVSWpFR2Kc.EtBpXhVm9BbYGBg_.L6ObSf-kNEihuBoApHmeTjtk8BVwPfF_0 2024-09-12T02:06:45.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6564598764682682627', time=2024-09-12T03:42:43.419450+0000, chain.objs.size()=1 2024-09-12T02:06:45.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.581__shadow:W1gw7KSJb0ym1nSssR.icJZD04Kf0JX_.cnCnDlyoTVbPSGJhhaFPkVWom_WMjuU_0 2024-09-12T02:06:45.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3289488668393307207', time=2024-09-12T03:52:01.493163+0000, chain.objs.size()=1 2024-09-12T02:06:45.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.656__shadow_.ajwfBTIIJ0Hw9krNNJRO5KjBTkFHE0u_0 2024-09-12T02:06:45.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13887334182067853764', time=2024-09-12T03:53:01.132053+0000, chain.objs.size()=6 2024-09-12T02:06:45.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.662__multipart_baz.2~IeTeIUYddxfwWCuwBj5DGZ1clGidSJv.1 2024-09-12T02:06:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.662__multipart_baz.2~IeTeIUYddxfwWCuwBj5DGZ1clGidSJv.2 2024-09-12T02:06:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.662__multipart_baz.2~IeTeIUYddxfwWCuwBj5DGZ1clGidSJv.3 2024-09-12T02:06:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.662__multipart_baz.2~IeTeIUYddxfwWCuwBj5DGZ1clGidSJv.4 2024-09-12T02:06:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.662__multipart_baz.2~IeTeIUYddxfwWCuwBj5DGZ1clGidSJv.5 2024-09-12T02:06:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.662__multipart_baz.2~IeTeIUYddxfwWCuwBj5DGZ1clGidSJv.6 2024-09-12T02:06:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2602151201474741092', time=2024-09-12T03:53:04.993986+0000, chain.objs.size()=1 2024-09-12T02:06:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.664__shadow_._pt2pp56WV8eQaiW6RMsVrTa85PXL01_0 2024-09-12T02:06:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1439946378292180649', time=2024-09-12T03:53:21.884690+0000, chain.objs.size()=1 2024-09-12T02:06:45.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.671__shadow_.JkefR9TsqkVjDyDfWuBcsVJyBZm7Zi__0 2024-09-12T02:06:45.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.621380325568841184', time=2024-09-12T03:54:23.579541+0000, chain.objs.size()=1 2024-09-12T02:06:45.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.701__shadow:jMqQm9ORxbo2qR2napKmyVfCaRoA66D_.EC1Yovt1U0eoCZiYqaH49p5_k6qgPsb_0 2024-09-12T02:06:45.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7481218088208164349', time=2024-09-12T03:54:37.962560+0000, chain.objs.size()=1 2024-09-12T02:06:45.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.707__shadow_.V2KcHgy46kVIp0TeRCB5koEFzeTnps__0 2024-09-12T02:06:45.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8192685950410845251', time=2024-09-12T03:55:07.982901+0000, chain.objs.size()=1 2024-09-12T02:06:45.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.716__shadow:y33epGGa7K0gSpt5ishrr3ckJ8EwZ.W_.80S6QMX93Zgq5vGsjmCgpsljlFMLcrN_0 2024-09-12T02:06:45.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:45.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T02:06:45.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:45.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:45.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51628' 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4974845462778117135', time=2024-09-12T03:03:12.605621+0000, chain.objs.size()=3 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.159__shadow_.d4Vdt9jAE8jZG0kgPgqrKBJtvWSAncf_0 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.159__shadow_.d4Vdt9jAE8jZG0kgPgqrKBJtvWSAncf_1 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.159__shadow_.d4Vdt9jAE8jZG0kgPgqrKBJtvWSAncf_2 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11539471352539004799', time=2024-09-12T03:10:37.861969+0000, chain.objs.size()=1 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.236__shadow_.YF6nDq8pqi-EZxWiQhG38wl2rOeu-Ar_0 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16192449831804349583', time=2024-09-12T03:11:06.992639+0000, chain.objs.size()=1 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.245__shadow_.plCajQZxtTWfNfeyMcsQ-qNw85gVYEm_0 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.962289747507157376', time=2024-09-12T03:11:22.062514+0000, chain.objs.size()=1 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.251__shadow_.VkQASpTZynq1OYEI8xLcX4viUQ3nurP_0 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4585130904004211769', time=2024-09-12T03:11:24.566071+0000, chain.objs.size()=1 2024-09-12T02:06:45.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.252__shadow_.G6i0GNUur743pHEWmwpewDbf4efhIqN_0 2024-09-12T02:06:45.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11412802142126285075', time=2024-09-12T03:13:36.333851+0000, chain.objs.size()=1 2024-09-12T02:06:45.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.IWZN_K1LIEHXEncFrO8YZEreC_80ZW3_0 2024-09-12T02:06:45.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17154086354771146648', time=2024-09-12T03:13:37.188107+0000, chain.objs.size()=1 2024-09-12T02:06:45.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5w6l8RXEQfkWLOrFTrpwl0Wn6KLGBiy_0 2024-09-12T02:06:45.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9923391292819399769', time=2024-09-12T03:13:38.334645+0000, chain.objs.size()=1 2024-09-12T02:06:45.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.69WawLTZDO2DDnlWrbTeuHurU9dPWtF_0 2024-09-12T02:06:45.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10980542056000097330', time=2024-09-12T03:13:38.669230+0000, chain.objs.size()=1 2024-09-12T02:06:45.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6bJiAY3DYw0lYVUpTK1XiYWTR_dbkkT_0 2024-09-12T02:06:45.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18329870287178964239', time=2024-09-12T03:13:39.723055+0000, chain.objs.size()=1 2024-09-12T02:06:45.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._ffwWeJr3JKYX6ZQnj5FCXW-d7jhC1y_0 2024-09-12T02:06:45.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1576407215805996533', time=2024-09-12T03:13:40.746865+0000, chain.objs.size()=1 2024-09-12T02:06:45.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5d_o2MOjzmfPS3Cnz4-qQe1DoyJwGnO_0 2024-09-12T02:06:45.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2745230523715065958', time=2024-09-12T03:13:41.103937+0000, chain.objs.size()=1 2024-09-12T02:06:45.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2oW_HxOLzB3TI0uL4aZ8thWuu8X0cIs_0 2024-09-12T02:06:45.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4422994980572855527', time=2024-09-12T03:13:41.492424+0000, chain.objs.size()=1 2024-09-12T02:06:45.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.N37CJYlaNXpyFmJ7-88TNUeg9f3VCiE_0 2024-09-12T02:06:45.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17589841010402207540', time=2024-09-12T03:13:41.494347+0000, chain.objs.size()=1 2024-09-12T02:06:45.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Rmp6WLo03VmYnWVdxAmRv6CVo83DoQN_0 2024-09-12T02:06:45.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4840346828640848594', time=2024-09-12T03:13:42.474028+0000, chain.objs.size()=1 2024-09-12T02:06:45.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vapdS-uhfgOKk_eO6rzY_9JhPSLGNJj_0 2024-09-12T02:06:45.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14823519412286834860', time=2024-09-12T03:13:43.094784+0000, chain.objs.size()=1 2024-09-12T02:06:45.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hpkZvXZ7KMKEngdj66es3C3bit39K5h_0 2024-09-12T02:06:45.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16601027602910958703', time=2024-09-12T03:13:43.316998+0000, chain.objs.size()=1 2024-09-12T02:06:45.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.o_-1Fz4P_RsDMg6TCJr6fLgOm7UdX7f_0 2024-09-12T02:06:45.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.164946368011884473', time=2024-09-12T03:13:43.687472+0000, chain.objs.size()=1 2024-09-12T02:06:45.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5HrtMRvbRy4A9ENlV2547JCQSdNS6KK_0 2024-09-12T02:06:45.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4879874327576314404', time=2024-09-12T03:13:45.142304+0000, chain.objs.size()=1 2024-09-12T02:06:45.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.szpG9sLTh90VegFsvdlV_QxTriM25D2_0 2024-09-12T02:06:45.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9668598447247042087', time=2024-09-12T03:13:45.524909+0000, chain.objs.size()=1 2024-09-12T02:06:45.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.iBdVJ3d3Lr7MmcgZpFc4x5uw9e1FULM_0 2024-09-12T02:06:45.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14219060679466025705', time=2024-09-12T03:13:46.643166+0000, chain.objs.size()=1 2024-09-12T02:06:45.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.766+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tperIgaAmlnz_0tow4GrHpjxxwA-cVd_0 2024-09-12T02:06:45.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5293818113900165716', time=2024-09-12T03:13:47.378928+0000, chain.objs.size()=1 2024-09-12T02:06:45.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.O3JoWHAvkglcDFpUJk9jeR5QvUny4Vx_0 2024-09-12T02:06:45.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18199759127464954421', time=2024-09-12T03:13:48.277243+0000, chain.objs.size()=1 2024-09-12T02:06:45.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tBZDEpzaQueHOTWEDms8jEkaVFT0A3A_0 2024-09-12T02:06:45.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17521670743132988128', time=2024-09-12T03:13:49.029389+0000, chain.objs.size()=1 2024-09-12T02:06:45.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.BJqIl0PvnRUIVAJI0BlMxQE0xDtlxI9_0 2024-09-12T02:06:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5430331245197512603', time=2024-09-12T03:13:49.581927+0000, chain.objs.size()=1 2024-09-12T02:06:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1ztj_eFthsC-cwhYJATOOxHu7tFx7Pk_0 2024-09-12T02:06:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15436762536513686914', time=2024-09-12T03:13:49.583862+0000, chain.objs.size()=1 2024-09-12T02:06:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ilhJXYRy8tKT9q7L5SwNrP0QckjsOD4_0 2024-09-12T02:06:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.770121335183811800', time=2024-09-12T03:13:51.703782+0000, chain.objs.size()=1 2024-09-12T02:06:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.bJd1fn_Mef4SO78M14ReuhVJtCtZSZP_0 2024-09-12T02:06:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13885977144319012239', time=2024-09-12T03:13:52.400916+0000, chain.objs.size()=1 2024-09-12T02:06:45.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.zQXPXTB-pL1MfTTBhkYxGrec-NUDP3V_0 2024-09-12T02:06:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5862163965848517018', time=2024-09-12T03:13:52.693753+0000, chain.objs.size()=1 2024-09-12T02:06:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5L8I__qHXVjOJXpoAvpk43-k66d44dQ_0 2024-09-12T02:06:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13215753134281433725', time=2024-09-12T03:13:52.793152+0000, chain.objs.size()=1 2024-09-12T02:06:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pX47LQCn9DIoWjQB-IImPUv8HRNqKso_0 2024-09-12T02:06:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16155669778376105990', time=2024-09-12T03:13:53.044843+0000, chain.objs.size()=1 2024-09-12T02:06:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.yRihvCfClyC0_zvTgRYs-VsTUvbqh25_0 2024-09-12T02:06:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11980510106982528198', time=2024-09-12T03:13:55.203844+0000, chain.objs.size()=1 2024-09-12T02:06:45.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.UsEM8i9x_DOAJlqoMwtp_FCAMUTSz_0_0 2024-09-12T02:06:45.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10446836447225994172', time=2024-09-12T03:13:57.546066+0000, chain.objs.size()=1 2024-09-12T02:06:45.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Lo5EeBuRcLiayfAz6Bp4PicN0Je_QPz_0 2024-09-12T02:06:45.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12437155483811599112', time=2024-09-12T03:13:57.711643+0000, chain.objs.size()=1 2024-09-12T02:06:45.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.u9V-b1wnW0XTYz7Jfk6oAPnITybV54N_0 2024-09-12T02:06:45.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.433447849299305192', time=2024-09-12T03:13:57.910629+0000, chain.objs.size()=1 2024-09-12T02:06:45.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.g1gY5eYfy_eKn82Pye_KCFTjGGU_7Uy_0 2024-09-12T02:06:45.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4067353727001073147', time=2024-09-12T03:13:59.297774+0000, chain.objs.size()=1 2024-09-12T02:06:45.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.b96T8EVMLU2tRxoB5woYziYol5R7KZd_0 2024-09-12T02:06:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3517755549713570553', time=2024-09-12T03:13:59.606229+0000, chain.objs.size()=1 2024-09-12T02:06:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ejhR2xPO95dDADr-X-54zvFBcMR11Zd_0 2024-09-12T02:06:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2440590917687345565', time=2024-09-12T03:14:00.864432+0000, chain.objs.size()=1 2024-09-12T02:06:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Q1CQVukbVqMRELI3o7g4TXv6KCZz5Cn_0 2024-09-12T02:06:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12726100823665267348', time=2024-09-12T03:14:01.184517+0000, chain.objs.size()=1 2024-09-12T02:06:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.TeeOcsP9v_fM0nYc3ky6jaAJAqqVfXR_0 2024-09-12T02:06:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9737377361242184824', time=2024-09-12T03:14:01.186461+0000, chain.objs.size()=1 2024-09-12T02:06:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Ds3KA3EHExPqxdxMmdOgkIC-900u2bQ_0 2024-09-12T02:06:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12304672510779637637', time=2024-09-12T03:14:01.386538+0000, chain.objs.size()=1 2024-09-12T02:06:45.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.O4uUDaUQiFx2_wRIc7m180Cfz70gBOr_0 2024-09-12T02:06:45.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1326599229890462173', time=2024-09-12T03:14:02.853787+0000, chain.objs.size()=1 2024-09-12T02:06:45.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Jkh8enTlFJsH3pxjPUlXSeh8Ee1BCJz_0 2024-09-12T02:06:45.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15877051961476577346', time=2024-09-12T03:14:03.273191+0000, chain.objs.size()=1 2024-09-12T02:06:45.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.u4w5zC4sWofyUBKar3Wu8fVvST6VSGg_0 2024-09-12T02:06:45.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14386294309408009513', time=2024-09-12T03:14:22.205481+0000, chain.objs.size()=1 2024-09-12T02:06:45.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.270__shadow_.ZLB4W9fgUT3teAPE4RJCM9yvGkX16FE_0 2024-09-12T02:06:45.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1836444102864850107', time=2024-09-12T03:14:34.109651+0000, chain.objs.size()=1 2024-09-12T02:06:45.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.275__shadow_.ORGnB9wqDLMQxdaZCRSSdNLrrk7EdFx_0 2024-09-12T02:06:45.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15912771209811001205', time=2024-09-12T03:14:44.179592+0000, chain.objs.size()=1 2024-09-12T02:06:45.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.279__shadow_.PbzMyn5kYS50kuiGcnq8bqYBZzBssLs_0 2024-09-12T02:06:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1790799287826110090', time=2024-09-12T03:15:14.632477+0000, chain.objs.size()=1 2024-09-12T02:06:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.291__shadow_.i3-xCZD-2tNoYPw7MFZCzx2VTJU9tFb_0 2024-09-12T02:06:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1176560470719156456', time=2024-09-12T03:15:23.321257+0000, chain.objs.size()=1 2024-09-12T02:06:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.SLSBqWXdlHLnM2UtlrQMXQDHjDxKTt7_0 2024-09-12T02:06:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6543546832773132736', time=2024-09-12T03:15:37.391605+0000, chain.objs.size()=1 2024-09-12T02:06:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.297__shadow_.CyynMn-AhmC5HuodqjLgprtfnnCJZ6d_0 2024-09-12T02:06:45.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13535185713428051281', time=2024-09-12T03:15:50.197111+0000, chain.objs.size()=1 2024-09-12T02:06:45.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.302__shadow_.PntvMrwW98RfO-7iOA1dMO5m3XgONmZ_0 2024-09-12T02:06:45.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3149234118856516182', time=2024-09-12T03:18:36.390922+0000, chain.objs.size()=1 2024-09-12T02:06:45.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.nB68eTKvbMyh8Z_97ulCkuA9o8TLglZ_0 2024-09-12T02:06:45.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3746581824836867669', time=2024-09-12T03:18:37.582247+0000, chain.objs.size()=1 2024-09-12T02:06:45.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yvH15CuqoNBrO_XgnDmFkWfaKahAxfR_0 2024-09-12T02:06:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16964350802761163772', time=2024-09-12T03:18:39.374953+0000, chain.objs.size()=1 2024-09-12T02:06:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.brnzqukeodxzenxK4sarZUF6lOGQbJ-_0 2024-09-12T02:06:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.654389690326449443', time=2024-09-12T03:18:39.606056+0000, chain.objs.size()=1 2024-09-12T02:06:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tO0jC_9Gsa0b6DF6bccExhM5BhqAIRd_0 2024-09-12T02:06:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10282101172074995', time=2024-09-12T03:18:42.547169+0000, chain.objs.size()=1 2024-09-12T02:06:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.i7fz7jTz6em4df8_FxcSMhxG4qj3rbN_0 2024-09-12T02:06:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.637295492229507539', time=2024-09-12T03:18:44.987307+0000, chain.objs.size()=1 2024-09-12T02:06:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.B7b-v_IRwRNl32VxNu9PvGBgbD1okfT_0 2024-09-12T02:06:45.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2343299004515856722', time=2024-09-12T03:18:46.318628+0000, chain.objs.size()=1 2024-09-12T02:06:45.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.786+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.FkfIHhtfafDl-1C3M-Ic0LZLW6HAG-Y_0 2024-09-12T02:06:45.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4439025863147931334', time=2024-09-12T03:18:46.669227+0000, chain.objs.size()=1 2024-09-12T02:06:45.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.FtbmyH9EK6ycUDlDCVsUCFUBTrBeNsq_0 2024-09-12T02:06:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17601784061439732167', time=2024-09-12T03:18:47.737479+0000, chain.objs.size()=1 2024-09-12T02:06:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.DsEG25sKJv0G6WwFpw0MBxjDBYLfmHL_0 2024-09-12T02:06:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9094108033857152560', time=2024-09-12T03:18:50.346243+0000, chain.objs.size()=1 2024-09-12T02:06:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.K2-cat3y0r81Vw_OC4TPe_EynOi47CR_0 2024-09-12T02:06:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7046293557467279643', time=2024-09-12T03:18:50.466906+0000, chain.objs.size()=1 2024-09-12T02:06:45.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Mk055bXSVZITG_3NdfHA_o_QOMJfmq7_0 2024-09-12T02:06:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2130840028651116934', time=2024-09-12T03:18:50.864279+0000, chain.objs.size()=1 2024-09-12T02:06:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.goGKH5xYWnG8Pzud1MIon9JyysrdYZf_0 2024-09-12T02:06:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9453547343845360113', time=2024-09-12T03:18:51.506486+0000, chain.objs.size()=1 2024-09-12T02:06:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.uu-VFpZOSA5JYhAbt_zNozbZp05LlV8_0 2024-09-12T02:06:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17812091752955539321', time=2024-09-12T03:18:51.624068+0000, chain.objs.size()=1 2024-09-12T02:06:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yMsRqxLK7fwwVJ_sDSUshU0txT-h3Bp_0 2024-09-12T02:06:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3545625443371724496', time=2024-09-12T03:18:52.289369+0000, chain.objs.size()=1 2024-09-12T02:06:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.0Anffcy22brzeUmOCXdBMr2U7mctJ6G_0 2024-09-12T02:06:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12322364450595219338', time=2024-09-12T03:18:54.027446+0000, chain.objs.size()=1 2024-09-12T02:06:45.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xaNxie805fi51U2wPSE4x_LeuyLHI6c_0 2024-09-12T02:06:45.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7822757058494312915', time=2024-09-12T03:18:54.799495+0000, chain.objs.size()=1 2024-09-12T02:06:45.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.W6ccc1AZkEJ0ktDpoEwrBaG5OBeExJu_0 2024-09-12T02:06:45.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11513097676134051311', time=2024-09-12T03:18:54.961473+0000, chain.objs.size()=1 2024-09-12T02:06:45.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._bMk88zFqwdrev3vcyLhtP8fOFDok42_0 2024-09-12T02:06:45.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11253925600392673973', time=2024-09-12T03:18:55.597537+0000, chain.objs.size()=1 2024-09-12T02:06:45.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Q3W4NflLKs64Rv8VxA1T2S26_G4MjAf_0 2024-09-12T02:06:45.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2520055368732182042', time=2024-09-12T03:18:57.822808+0000, chain.objs.size()=1 2024-09-12T02:06:45.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.cNm59znw8D7BlxlA6VkGWGXgVG-DEp6_0 2024-09-12T02:06:45.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11365593811465131683', time=2024-09-12T03:18:57.832453+0000, chain.objs.size()=1 2024-09-12T02:06:45.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2IZIZHQGZrj0HZJt0oiuCFNotG306xX_0 2024-09-12T02:06:45.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263382802287369155', time=2024-09-12T03:18:59.111134+0000, chain.objs.size()=1 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PzMLBrGW_u58-xDCVZcm6gS1N3r7IGn_0 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.950541904260810449', time=2024-09-12T03:19:01.882632+0000, chain.objs.size()=1 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.18JoQfQABVFvEr_rJZ4UXBMD5z2pw4h_0 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7767871456663223015', time=2024-09-12T03:19:02.159708+0000, chain.objs.size()=1 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vMYpWSmbU-S-y120QD1CRLUe5mJjlyj_0 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3592328484356273806', time=2024-09-12T03:19:03.863477+0000, chain.objs.size()=1 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.lWYcRqfTn1HI1dA0on-vQ1ueOt5PIxw_0 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5418596473786423087', time=2024-09-12T03:19:04.150872+0000, chain.objs.size()=1 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.M5Wiu9TmNQMUZ2KmlYOvElxE-QL_Ld9_0 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17093206952472854095', time=2024-09-12T03:19:04.352985+0000, chain.objs.size()=1 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Ou6U_dizNQ9v4pdFFZHyt17v56cEznE_0 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8536070456816414223', time=2024-09-12T03:19:04.501249+0000, chain.objs.size()=1 2024-09-12T02:06:45.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QI08RAA4cp4SE4Q4crUeCxYrR7lFAvb_0 2024-09-12T02:06:45.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15484059522436041505', time=2024-09-12T03:19:05.275927+0000, chain.objs.size()=1 2024-09-12T02:06:45.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.794+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.t9CBRS_eKw_q8EZIaWexjgx63SJUHu__0 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15527677107784534145', time=2024-09-12T03:19:05.694654+0000, chain.objs.size()=1 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GuDOCEq9zWbL975tuBj_sr18bjfQ2NR_0 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13038763564400898517', time=2024-09-12T03:19:06.089482+0000, chain.objs.size()=1 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CZavydkPF51G9xsmK7xGCozSQiRl4Au_0 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10822353257729111255', time=2024-09-12T03:19:06.354553+0000, chain.objs.size()=1 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qFMfrtZeJn3X5dXIiX0WPgdhDjXXixq_0 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8601552476575882010', time=2024-09-12T03:19:07.765949+0000, chain.objs.size()=1 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xwnAmJN0HBtih6AR1Jp5Pi-wZVJjwtV_0 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18224571562450491067', time=2024-09-12T03:20:55.206651+0000, chain.objs.size()=1 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.GXhtGsgxK2ubWupGDRGZCOxmPBveKSy_0 2024-09-12T02:06:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3515836455261133538', time=2024-09-12T03:20:55.362048+0000, chain.objs.size()=1 2024-09-12T02:06:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.u0IymN0bD5jl7MP7xHCiTguO8Xh7yue_0 2024-09-12T02:06:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2998731553274840178', time=2024-09-12T03:20:57.411976+0000, chain.objs.size()=1 2024-09-12T02:06:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.mbhO2k9-MoQT-qHAbe417UWfnA0W4HJ_0 2024-09-12T02:06:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13399964297210766565', time=2024-09-12T03:20:58.780878+0000, chain.objs.size()=1 2024-09-12T02:06:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IrFLJNyRp5AmOzU2uB1tEMhZweX6Qyc_0 2024-09-12T02:06:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9715192607811107038', time=2024-09-12T03:20:59.529738+0000, chain.objs.size()=1 2024-09-12T02:06:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.WVO5Pf3HDBcSJj8KDuezavsfboQiLri_0 2024-09-12T02:06:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14886617362943265719', time=2024-09-12T03:21:01.462984+0000, chain.objs.size()=1 2024-09-12T02:06:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.44inlXhFDnr9XpCkTx7JMll10V0dEB3_0 2024-09-12T02:06:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2049298534495525292', time=2024-09-12T03:21:01.852041+0000, chain.objs.size()=1 2024-09-12T02:06:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.806+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.O_jLOg9O8AdC4IponH1eyWLsVrfyQoq_0 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8674018144186437770', time=2024-09-12T03:21:04.091235+0000, chain.objs.size()=1 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MnjilJCQdXOQWB55L80h3GwcfWFZEN0_0 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7767148429768155198', time=2024-09-12T03:21:04.286162+0000, chain.objs.size()=1 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zTK3jBnHaztYi0vrvsfmAOHQQCNaGcK_0 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10050014847372488713', time=2024-09-12T03:21:06.031131+0000, chain.objs.size()=1 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pYYgAyn6dRYvohcoSWvJ9Bytu6j4bx3_0 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8338586714581518161', time=2024-09-12T03:21:07.283967+0000, chain.objs.size()=1 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hde8QXl1Ay2Cxh3ooNIkjZClDMP-PtM_0 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9340665636101856657', time=2024-09-12T03:21:08.618731+0000, chain.objs.size()=1 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Ycs-G929swteqjYNiDhwnsFwQ8uWSRS_0 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16960226324128382147', time=2024-09-12T03:21:10.298686+0000, chain.objs.size()=1 2024-09-12T02:06:45.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.HxERPuu86ahctcnnTEfR8m6dLm_a4VO_0 2024-09-12T02:06:45.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10366153450736546946', time=2024-09-12T03:21:12.534587+0000, chain.objs.size()=1 2024-09-12T02:06:45.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZDPDYV4vmXrwM_U7ORsDB_hV-bCu702_0 2024-09-12T02:06:45.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3344299185018558415', time=2024-09-12T03:21:14.166737+0000, chain.objs.size()=1 2024-09-12T02:06:45.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CkHPA3ObzgXTWp0vvaE0o9xU4YbAmcD_0 2024-09-12T02:06:45.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18092513760148249956', time=2024-09-12T03:21:16.504474+0000, chain.objs.size()=1 2024-09-12T02:06:45.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.BdZJbloGMFGlbC2VTG9q4dOqD9FEVGH_0 2024-09-12T02:06:45.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1631668295206307571', time=2024-09-12T03:21:17.435717+0000, chain.objs.size()=1 2024-09-12T02:06:45.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.814+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.QJz6WCxCD5oS-zcPa8h2Wx_zXdv0on4_0 2024-09-12T02:06:45.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.822+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51628 2024-09-12T02:06:45.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14042621975664225404', time=2024-09-12T03:21:19.618985+0000, chain.objs.size()=1 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dGYxgW5HsryyPhUfomnIwvafT5ijFeX_0 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14849437679008189291', time=2024-09-12T03:21:19.886386+0000, chain.objs.size()=1 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-cznjAKtwflBI39fewAByTp9jvMHuoy_0 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17775747487499238918', time=2024-09-12T03:21:21.661401+0000, chain.objs.size()=1 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1zLkg06zUKbXP1rDi7ToFz1EM3i63yr_0 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11367876389696759831', time=2024-09-12T03:21:22.058554+0000, chain.objs.size()=1 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.clyVrhWPx-c0_qCHol9_TuKh_w3tZBM_0 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14597386124206772334', time=2024-09-12T03:21:23.138046+0000, chain.objs.size()=1 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9t-B-s-8cAlJU80DrNNcj1dEVwPCPtC_0 2024-09-12T02:06:45.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10566341823762133764', time=2024-09-12T03:21:23.794164+0000, chain.objs.size()=1 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.u5lQasOn9py8K3KJa8gyEztjmKS8ZO4_0 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3418908296453876100', time=2024-09-12T03:21:25.083884+0000, chain.objs.size()=1 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.sxA2A_mI6hJL2MBLzDDwmKoABCAbITI_0 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14415917443911114828', time=2024-09-12T03:21:35.828154+0000, chain.objs.size()=1 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.330__shadow_.WtHJfvVRsbBs7zNE79wEgUbr5xpaBNt_0 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10550967255980536523', time=2024-09-12T03:21:54.176294+0000, chain.objs.size()=1 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.338__shadow_.WyeF3WnU0EOKS1jfUTPvo8YQY7JsuMK_0 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11489207087930538934', time=2024-09-12T03:22:10.100320+0000, chain.objs.size()=1 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.345__shadow_.mzW00rrvBoj-AU8MKPX8BoDzHQ2CQru_0 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12160083813550819979', time=2024-09-12T03:28:04.795111+0000, chain.objs.size()=1 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.500__shadow_.fjuNkRp75iyyC7un9rIr2KpTetl1JX3_0 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11509908453276122487', time=2024-09-12T03:34:33.969559+0000, chain.objs.size()=6 2024-09-12T02:06:45.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.826+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.YDCVq2fhMiLAuKsj8-NWKUeEa93arD4s.1 2024-09-12T02:06:45.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.3hN4eIRf6ySj0YtvUtiISKnVT4fdttBh.2 2024-09-12T02:06:45.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.ZE_AJtMcmXEzm7RSFEvObLg8spsY3HUx.3 2024-09-12T02:06:45.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.UrtcDXQXvF6_m6yy2dNdI-cx3qI0VK9U.4 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.nCLqdRpunaBQFSE8ObTZYJbNx9vVD90a.5 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.JusdxOnrLIL-be2Cafjx23cEMiQdkoO6.6 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15529274558209105826', time=2024-09-12T03:38:40.301723+0000, chain.objs.size()=1 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.556__shadow_.GTPw-zeZhT51qha-a83cYafs2VsFGJt_0 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5523263612189133988', time=2024-09-12T03:39:57.448716+0000, chain.objs.size()=1 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:ZyqZ0-fIi7eTN.1VvI.5dnkizB.lqMf_.jPKKYWvqE96839mfdkvI6hZKNFW-4ZI_0 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15361208883511540850', time=2024-09-12T03:40:07.867518+0000, chain.objs.size()=1 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:CFjgqwKArUf7N7j8IgqJPMj8-OzREfc_.4puMpoGGCEbYBn0lqRs5faVQCvIyhro_0 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2381113244769805114', time=2024-09-12T03:40:11.341229+0000, chain.objs.size()=1 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.571__shadow:HZVsZe9EIx.7mLRcwiBoSRgo2FmS8PG_.wVxo_R7IKP_omUIjbzIYUDQe0URt2hn_0 2024-09-12T02:06:45.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6985903765944783819', time=2024-09-12T03:40:59.870016+0000, chain.objs.size()=1 2024-09-12T02:06:45.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:-l6bXtCAqjrcV-wrSkKx6D.SB3yirVJ_.Uos5GNn-L3WbiAU8kp7ZXlOgMh8a0gV_0 2024-09-12T02:06:45.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4277371525283195766', time=2024-09-12T03:42:55.940381+0000, chain.objs.size()=1 2024-09-12T02:06:45.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.830+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.586__shadow:el9I7jdYz54BWaDYvhX7sjZnkUKqr75_.0WBNuwvSsQFgwn9DsbShv2P74u3e6wq_0 2024-09-12T02:06:45.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12391840765362507437', time=2024-09-12T03:42:56.061637+0000, chain.objs.size()=1 2024-09-12T02:06:45.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.586__shadow:05uPPgEWGW8hoHFZrw8HarHwyz0P5MM_.MEyVMqKRVAQ4mg8U44-C24BC78-HEM4_0 2024-09-12T02:06:45.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17239935054078081585', time=2024-09-12T03:43:04.884572+0000, chain.objs.size()=1 2024-09-12T02:06:45.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.588__shadow:m2Zs3vxW-.lxRUNnccWpnHAV87M6amj_.7MXdvCUgFm658wlWF9BFVc6BgpkQrTk_0 2024-09-12T02:06:45.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4190989176408657623', time=2024-09-12T03:48:41.675461+0000, chain.objs.size()=1 2024-09-12T02:06:45.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.619__shadow_.mS-jnLuKdoondK5Q3P6jgH_gxqV2qJo_0 2024-09-12T02:06:45.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.838+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8850406143355042288', time=2024-09-12T03:53:19.474293+0000, chain.objs.size()=1 2024-09-12T02:06:45.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.838+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.669__shadow_.1T9FQsgAynZt-otXEXAZEsJvb9ZXSCP_0 2024-09-12T02:06:45.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.838+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11909567985715937771', time=2024-09-12T03:54:07.563778+0000, chain.objs.size()=1 2024-09-12T02:06:45.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.838+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.694__shadow:sUUKI1XtG7W8NuptMCecCd.G75ww-KA_.n64Ioo0ibYwQNy9Xaf9zmHMvnRwU9pb_0 2024-09-12T02:06:45.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:45.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.846+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T02:06:45.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:45.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52202' 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_tyvjOPBXB-32O2CwlzJYlyoPfmjex-S', time=2024-09-12T03:04:44.022934+0000, chain.objs.size()=1 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.164__shadow_.jDJXy_fi6IyKZIWFcsjvPVg9UoKhAIh_0 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4264065028355477862', time=2024-09-12T03:04:56.433655+0000, chain.objs.size()=1 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.167__shadow_.War6-S7oO8rHnGeeC5J20Tqu4IZFBXH_0 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4513171683573004258', time=2024-09-12T03:11:03.005231+0000, chain.objs.size()=1 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.244__shadow_.5Qmrb5YiwVi2YLhJU9Vo_nkHaQaejwZ_0 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10185280592294124255', time=2024-09-12T03:11:14.576206+0000, chain.objs.size()=1 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.248__shadow_.aGxb-dsEC8z6DPJtixC-tYa-h8DKfj5_0 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5214639896748241862', time=2024-09-12T03:11:19.565832+0000, chain.objs.size()=1 2024-09-12T02:06:45.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.250__shadow_.1c6iZnPZ2DOiHwCuX-SCsXWc0J2GJsc_0 2024-09-12T02:06:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17775947967404045539', time=2024-09-12T03:11:29.651584+0000, chain.objs.size()=1 2024-09-12T02:06:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.254__shadow_.6uKQPR7I9d83-P2FfvrJz2B0rXRgVAt_0 2024-09-12T02:06:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5672541511949891387', time=2024-09-12T03:11:29.653521+0000, chain.objs.size()=1 2024-09-12T02:06:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.254__shadow_.T4OfG6Ns0ObVUIAKAzX_4VzDi7DbMPo_0 2024-09-12T02:06:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3591666953284178097', time=2024-09-12T03:11:37.107540+0000, chain.objs.size()=1 2024-09-12T02:06:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.257__shadow_.TGjEeMTBwwVnZ6tSWcaUar75tZWZ5rb_0 2024-09-12T02:06:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6251696831051561800', time=2024-09-12T03:13:34.431606+0000, chain.objs.size()=1 2024-09-12T02:06:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qIb4ROPx2BitghF3lqSvxGJUvOswQr__0 2024-09-12T02:06:45.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8974283212333628312', time=2024-09-12T03:13:36.143992+0000, chain.objs.size()=1 2024-09-12T02:06:45.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rctpmWH4cn03bEks2L8XR4Sj9Sok2Jr_0 2024-09-12T02:06:45.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12627123425435619736', time=2024-09-12T03:13:36.990080+0000, chain.objs.size()=1 2024-09-12T02:06:45.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hE6fDkuTBKM-u5LCDsTwZPi8hKy2haT_0 2024-09-12T02:06:45.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16339452478457524017', time=2024-09-12T03:13:37.086866+0000, chain.objs.size()=1 2024-09-12T02:06:45.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3cQ3mwP7azAdfFL0YGfrEgL0ZE7MMoZ_0 2024-09-12T02:06:45.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12868661406433650993', time=2024-09-12T03:13:37.252041+0000, chain.objs.size()=1 2024-09-12T02:06:45.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.b5fAkZ9i8meG6e9s4_n0vWfN0nnJSYq_0 2024-09-12T02:06:45.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3088355910568458691', time=2024-09-12T03:13:38.316350+0000, chain.objs.size()=1 2024-09-12T02:06:45.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.trK16JrEDoWNqk-lywt58yjqELGLIq2_0 2024-09-12T02:06:45.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.858+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10721543755995376752', time=2024-09-12T03:13:38.586577+0000, chain.objs.size()=1 2024-09-12T02:06:45.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.858+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RjEMoQz65lMmNJx72ISE7KNHmVNnn2h_0 2024-09-12T02:06:45.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11234506007200055201', time=2024-09-12T03:13:38.845256+0000, chain.objs.size()=1 2024-09-12T02:06:45.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tTNiAH1xYO_QmGbgYiQB6Xf2OefLmMI_0 2024-09-12T02:06:45.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5445023315860108302', time=2024-09-12T03:13:39.209492+0000, chain.objs.size()=1 2024-09-12T02:06:45.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ETomrkNehFO37ZP8DjqVkYS7LJHbBRU_0 2024-09-12T02:06:45.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13602464720764198503', time=2024-09-12T03:13:40.936250+0000, chain.objs.size()=1 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.n61frBrARF_anNOcnvCRiq5aXyT1tBu_0 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12061264237276980596', time=2024-09-12T03:13:40.988173+0000, chain.objs.size()=1 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ttPFq3KSgRufdfXDOvj2b1c3p9Rukf1_0 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13766715618606811249', time=2024-09-12T03:13:42.600970+0000, chain.objs.size()=1 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CREIsbwezw_pQeDKO_dmB3gAbaNKWns_0 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14035940874119491042', time=2024-09-12T03:13:43.226976+0000, chain.objs.size()=1 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.sxEcDAT2ohEHZg7l4JWCvlgJct-tZc6_0 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17469842329389475253', time=2024-09-12T03:13:43.479923+0000, chain.objs.size()=1 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vxWHZ6LSygi6Td0xBidyyLOZgAFy-lJ_0 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.816178985709670149', time=2024-09-12T03:13:44.265734+0000, chain.objs.size()=1 2024-09-12T02:06:45.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.BDLYUMopA0vy2gtXPC3AHIJHCI4G3m__0 2024-09-12T02:06:45.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.866+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2956434998535093612', time=2024-09-12T03:13:45.304061+0000, chain.objs.size()=1 2024-09-12T02:06:45.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.866+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ndI2SWyikMFvC51w4t-qWD5-AoV9kA-_0 2024-09-12T02:06:45.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.866+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3394507876610301546', time=2024-09-12T03:13:45.465228+0000, chain.objs.size()=1 2024-09-12T02:06:45.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.866+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.kYzupaq9dgesgPyBpy3MWQsf1FxopyT_0 2024-09-12T02:06:45.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.866+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1090029192688202763', time=2024-09-12T03:13:46.639981+0000, chain.objs.size()=1 2024-09-12T02:06:45.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.866+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.K13OfKyTkia01mCsHMzTGaWO1U3pr4d_0 2024-09-12T02:06:45.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.866+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.305953990122581238', time=2024-09-12T03:13:46.642050+0000, chain.objs.size()=1 2024-09-12T02:06:45.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.866+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.oI5jO6y4AxGQp-3gGQacYIjNRW0qDkh_0 2024-09-12T02:06:45.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.866+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3497108541899453336', time=2024-09-12T03:13:47.187766+0000, chain.objs.size()=1 2024-09-12T02:06:45.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.866+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hlWZZNUBRIzsK2EMI95WiGe65Lpgaxv_0 2024-09-12T02:06:45.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9704077854140839482', time=2024-09-12T03:13:47.503636+0000, chain.objs.size()=1 2024-09-12T02:06:45.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-VkW93miDo8IJdumMMw9N29GJeUMyOT_0 2024-09-12T02:06:45.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11464871404488120065', time=2024-09-12T03:13:48.660421+0000, chain.objs.size()=1 2024-09-12T02:06:45.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.B010bBbHZy-V--8j-kLCCvAm8At2sKD_0 2024-09-12T02:06:45.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4932590324732107127', time=2024-09-12T03:13:53.031023+0000, chain.objs.size()=1 2024-09-12T02:06:45.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.iEVFK30XvQ3qBGWBPgwupRwgHV3z0XR_0 2024-09-12T02:06:45.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8146920478059136623', time=2024-09-12T03:13:53.811868+0000, chain.objs.size()=1 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Dfz85KXDkOLx9VNMSsyTt808oSgpEY3_0 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12341936462632489785', time=2024-09-12T03:13:53.922517+0000, chain.objs.size()=1 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ymIcPS-iWjnmYH5bZ7PSzs_Jgjqc0-W_0 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7284745584609149134', time=2024-09-12T03:13:54.753747+0000, chain.objs.size()=1 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.MQsTQVzWn8u-6JTvw4xVMmqI96_EIJh_0 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10671656326176435127', time=2024-09-12T03:13:55.795414+0000, chain.objs.size()=1 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.dk31dwr0gDvJR0ZPFyPHuxH7fuB41bv_0 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13427909971864922778', time=2024-09-12T03:13:56.652744+0000, chain.objs.size()=1 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.X7-Klmq0d8ighqUDvkpoCsrmdGAJZhc_0 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13407639998557871930', time=2024-09-12T03:13:57.071892+0000, chain.objs.size()=1 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RTD9eohFozgz9SJkH6bxv807aCi-EpA_0 2024-09-12T02:06:45.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5402029822060796963', time=2024-09-12T03:13:57.602517+0000, chain.objs.size()=1 2024-09-12T02:06:45.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-6izmQSEqRs1JtfR848zpVYYupGUP-u_0 2024-09-12T02:06:45.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7833182548271634720', time=2024-09-12T03:13:58.867433+0000, chain.objs.size()=1 2024-09-12T02:06:45.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uP6cgI2UOTFuchdaojJr4islbT0pPg5_0 2024-09-12T02:06:45.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11060080638760571367', time=2024-09-12T03:13:59.646991+0000, chain.objs.size()=1 2024-09-12T02:06:45.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uoKn1eNVbVyVLUj5X7Cmx5CsYjEjYS4_0 2024-09-12T02:06:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6258619425464770983', time=2024-09-12T03:14:00.387340+0000, chain.objs.size()=1 2024-09-12T02:06:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.IpvmRVQ7YREF_tXexa52eYgtrGaASlF_0 2024-09-12T02:06:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3567807995614837957', time=2024-09-12T03:14:00.919692+0000, chain.objs.size()=1 2024-09-12T02:06:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.toyNX8O7xAn7h9H6zSZvsP8mEWnmZ2T_0 2024-09-12T02:06:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.89370185582485986', time=2024-09-12T03:14:01.170619+0000, chain.objs.size()=1 2024-09-12T02:06:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.TUMPgl7PqlMm9Dhl4JdMo20U81PCi6i_0 2024-09-12T02:06:45.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5948829645195338522', time=2024-09-12T03:14:01.637893+0000, chain.objs.size()=1 2024-09-12T02:06:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uWD0IclKpymErSGOVy8D8Uy_I9X3n7t_0 2024-09-12T02:06:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14522581721227725670', time=2024-09-12T03:14:01.758710+0000, chain.objs.size()=1 2024-09-12T02:06:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3-SxplxTOlimhZHwnoMGsNgJ4mXgr_o_0 2024-09-12T02:06:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7692357970509566669', time=2024-09-12T03:14:02.993097+0000, chain.objs.size()=1 2024-09-12T02:06:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pgjVuXg-qbbUjRYeVcJW8iZqZjEiD7f_0 2024-09-12T02:06:45.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3900137721595290304', time=2024-09-12T03:14:03.193356+0000, chain.objs.size()=1 2024-09-12T02:06:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.zJFda-LiManeMce1H1yvNNcYXhlqDA5_0 2024-09-12T02:06:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.549188290318523037', time=2024-09-12T03:14:04.238138+0000, chain.objs.size()=1 2024-09-12T02:06:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2SCQLtwEN_t2M1Ay4yIU_QoFNI0c5wF_0 2024-09-12T02:06:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17536978710483036480', time=2024-09-12T03:14:10.252491+0000, chain.objs.size()=1 2024-09-12T02:06:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.265__shadow_.3RhVA-IWzxHcWxElHqKV5pp_TpEMGGv_0 2024-09-12T02:06:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11947679824435196062', time=2024-09-12T03:14:29.319249+0000, chain.objs.size()=1 2024-09-12T02:06:45.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.273__shadow_.N0QUaezNuCDH-ezpwXvGJ1gtd0u_JJo_0 2024-09-12T02:06:45.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4095500270257601168', time=2024-09-12T03:14:56.850894+0000, chain.objs.size()=1 2024-09-12T02:06:45.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.284__shadow_.hF3c9LSXqhp5TELtwulfOun40kmH16K_0 2024-09-12T02:06:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7320012103340539280', time=2024-09-12T03:14:59.393831+0000, chain.objs.size()=1 2024-09-12T02:06:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.285__shadow_.j3wv68Yg5rLdN04CigJgT2o1Fm4pNOh_0 2024-09-12T02:06:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16871786605394738772', time=2024-09-12T03:15:07.097203+0000, chain.objs.size()=1 2024-09-12T02:06:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.288__shadow_.GZHPBi-qaiAFu8cZSkFn720N0o5lA0O_0 2024-09-12T02:06:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8707256535572391185', time=2024-09-12T03:15:09.625480+0000, chain.objs.size()=1 2024-09-12T02:06:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.289__shadow_.xEpVQV7d7TOi_toZkT_BCz8wmEhikDE_0 2024-09-12T02:06:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4835415549120327622', time=2024-09-12T03:15:23.449871+0000, chain.objs.size()=1 2024-09-12T02:06:45.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.usKMl7ihaYkd_NAM-nxN_MZL96eR1Uk_0 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10544986437153555449', time=2024-09-12T03:16:00.146628+0000, chain.objs.size()=1 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.306__shadow_.2TEJNt3LAyjGi7uFZSeKRWwFve2-Js__0 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14353198651639698355', time=2024-09-12T03:16:43.036431+0000, chain.objs.size()=1 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.320__shadow:y1gcnI3Jb9eP13LCtzfuRJt2.aqQZtm_.300cukTyKdG4xv1A4HhRZxyhCyRq7Ca_0 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18431394850728569576', time=2024-09-12T03:18:36.856231+0000, chain.objs.size()=1 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.nZDbuj2ZT3IDDP83hVVz_aAkTz2tcgA_0 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12738861385175290433', time=2024-09-12T03:18:37.464219+0000, chain.objs.size()=1 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5VXdP7BuxO8eoM1xdb0TGs8Rgh9Z2Hl_0 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3048486042078255644', time=2024-09-12T03:18:38.187735+0000, chain.objs.size()=1 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.kNo6jjePKnDrEbfJd8Rw0bNyQe99GGJ_0 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12716152008121030206', time=2024-09-12T03:18:38.705588+0000, chain.objs.size()=1 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BIcvvqaySKbDAYQmdm58hrxwu2ZRe9f_0 2024-09-12T02:06:45.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.558178596953019100', time=2024-09-12T03:18:41.176558+0000, chain.objs.size()=1 2024-09-12T02:06:45.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.890+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9kZ9SHccIEQcnbW9OZv-dbo8Bpm4gbs_0 2024-09-12T02:06:45.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4744738094111998386', time=2024-09-12T03:18:41.568090+0000, chain.objs.size()=1 2024-09-12T02:06:45.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2LM8AlBeDekeM8CdDXW-H2ODHuUypDj_0 2024-09-12T02:06:45.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11945532061987006348', time=2024-09-12T03:18:42.077084+0000, chain.objs.size()=1 2024-09-12T02:06:45.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GZKzBEBQeK1NLlQGGIsDX9NSHyw-ixs_0 2024-09-12T02:06:45.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9141382170374704037', time=2024-09-12T03:18:42.772669+0000, chain.objs.size()=1 2024-09-12T02:06:45.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.L1sJ_WoKJ_6zE9aZ8iKpwDwBSHEX5X9_0 2024-09-12T02:06:45.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.352453014269061030', time=2024-09-12T03:18:42.932640+0000, chain.objs.size()=1 2024-09-12T02:06:45.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vQJazYEX_a8HglvK1BBmONrfPveORfr_0 2024-09-12T02:06:45.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13311574424110137773', time=2024-09-12T03:18:43.860217+0000, chain.objs.size()=1 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.M5yjSddM1Wf0FkSrxfw4ORX6uvepUp6_0 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5319874840713244128', time=2024-09-12T03:18:45.526918+0000, chain.objs.size()=1 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8sVhPFUx1LZwL2qZs5EFAH9VSmEXuPz_0 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4402475637365685060', time=2024-09-12T03:18:46.016456+0000, chain.objs.size()=1 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.t-_B3VuUk2yAziZMbXd4Ygf0hRj9vX7_0 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10932439697277804637', time=2024-09-12T03:18:46.412046+0000, chain.objs.size()=1 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vjVroS-a1QrdPMKZlLyRUHwtBAKkhgv_0 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9623850939502633102', time=2024-09-12T03:18:47.302424+0000, chain.objs.size()=1 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.i_LL7l1YELwHjDN2oclNE3IBSAeC7cp_0 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18039785041199756855', time=2024-09-12T03:18:49.344390+0000, chain.objs.size()=1 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._uaEE4BsPA0d3DFnHRXfUmspHStxQCx_0 2024-09-12T02:06:45.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10870161943616938939', time=2024-09-12T03:18:50.195664+0000, chain.objs.size()=1 2024-09-12T02:06:45.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CUtRK8H0C0aOisS46MejCx7kJGV40Fs_0 2024-09-12T02:06:45.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.898+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3747305545374564999', time=2024-09-12T03:18:50.197654+0000, chain.objs.size()=1 2024-09-12T02:06:45.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.898+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fvL2q7fOxIGN_ed21bPhu21yzmJTJhJ_0 2024-09-12T02:06:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.898+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.111205156287262779', time=2024-09-12T03:18:51.091658+0000, chain.objs.size()=1 2024-09-12T02:06:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.898+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.HPbBNhVYy8r2dxAUP1anG0NkGMqd22S_0 2024-09-12T02:06:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2824349749029562708', time=2024-09-12T03:18:52.263571+0000, chain.objs.size()=1 2024-09-12T02:06:45.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gqR_AQ5sbAdHSLDcFYWYHzgpTDQK4Xm_0 2024-09-12T02:06:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5615017761647134705', time=2024-09-12T03:18:53.628358+0000, chain.objs.size()=1 2024-09-12T02:06:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.g_FTPfnuhlPUxKzdj8FZH5ptLZykLUg_0 2024-09-12T02:06:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17836978308919194456', time=2024-09-12T03:18:53.629959+0000, chain.objs.size()=1 2024-09-12T02:06:45.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qFvUjzE7j3yklr3vo5wkWom46ZZT5pf_0 2024-09-12T02:06:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12583123703119001205', time=2024-09-12T03:18:53.693109+0000, chain.objs.size()=1 2024-09-12T02:06:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.DraDTjFWwFtre1_LlyXCdSk4yRiW8Yr_0 2024-09-12T02:06:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11836951082533479939', time=2024-09-12T03:18:54.036070+0000, chain.objs.size()=1 2024-09-12T02:06:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.a73jYxvQgGnfSvEOkRmBuNrtd-zlgtq_0 2024-09-12T02:06:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8409144983027103944', time=2024-09-12T03:18:54.837551+0000, chain.objs.size()=1 2024-09-12T02:06:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Cql2Dngp9jJGwT0Nb2exa5ZAauJlgMz_0 2024-09-12T02:06:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10362344611720364067', time=2024-09-12T03:18:55.216157+0000, chain.objs.size()=1 2024-09-12T02:06:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Dw_n13ej4p5n0C010zukMjcAklLYIm2_0 2024-09-12T02:06:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1741556498988167717', time=2024-09-12T03:18:56.515279+0000, chain.objs.size()=1 2024-09-12T02:06:45.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.E048zaMiYqmYy_JQ64JPiWSp56v2vqy_0 2024-09-12T02:06:45.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2659135804608734888', time=2024-09-12T03:18:58.154134+0000, chain.objs.size()=1 2024-09-12T02:06:45.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PifL411Sdfimuq26rLRUiJzcq-vefMQ_0 2024-09-12T02:06:45.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9536072193490950850', time=2024-09-12T03:18:58.283000+0000, chain.objs.size()=1 2024-09-12T02:06:45.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.M9iq02whp4vbETEvBz1J17UJEtJYh6r_0 2024-09-12T02:06:45.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7193745368872735810', time=2024-09-12T03:18:59.347188+0000, chain.objs.size()=1 2024-09-12T02:06:45.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LmiNxQAmNcG1Wd_2lj5S36sFCvQiEXX_0 2024-09-12T02:06:45.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.906+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1789414547321424865', time=2024-09-12T03:19:01.278577+0000, chain.objs.size()=1 2024-09-12T02:06:45.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.906+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.z-hPQUPtB3ZRsKxpDhBxpMJZ0LiaEll_0 2024-09-12T02:06:45.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.906+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13521693756213678232', time=2024-09-12T03:19:01.829520+0000, chain.objs.size()=1 2024-09-12T02:06:45.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.906+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xVXhEcZ0XtHS3rgucrFDXjJitQiLb5d_0 2024-09-12T02:06:45.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.906+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2032651439550413435', time=2024-09-12T03:19:02.415366+0000, chain.objs.size()=1 2024-09-12T02:06:45.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.906+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.q3XQaNVsZoF1GzcGi-g7twkm4KCIhuG_0 2024-09-12T02:06:45.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.906+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2047015975591401221', time=2024-09-12T03:19:03.257126+0000, chain.objs.size()=1 2024-09-12T02:06:45.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.906+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.FrSCu5JrsJclgD52jvG3udXe4ZtA8Jd_0 2024-09-12T02:06:45.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.647492133621038593', time=2024-09-12T03:19:04.066338+0000, chain.objs.size()=1 2024-09-12T02:06:45.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.lwmYFkCV7H5lGCmoGX-t-c3rIAvelJt_0 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1923439019801138753', time=2024-09-12T03:19:05.281466+0000, chain.objs.size()=1 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.h4lVXfFK_GJOzIIS5TdxihmReqf89hZ_0 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7487166005180705010', time=2024-09-12T03:19:05.692037+0000, chain.objs.size()=1 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.r1BOO7EJRsG2jI2Yayc7srPQNljYQT5_0 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7036214506758070316', time=2024-09-12T03:19:05.786710+0000, chain.objs.size()=1 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Hfaqhj8s0cp2puvo61oDpl-9iAlV5xk_0 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2991384035094479532', time=2024-09-12T03:19:05.788589+0000, chain.objs.size()=1 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vT79VG0vx02Y2OQ8UkevKi_sxW2Y5Bm_0 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18247317255884928783', time=2024-09-12T03:19:05.790133+0000, chain.objs.size()=1 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jShPD8iKyPIHYIOHaEaVqrRJwaAGIA1_0 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17530994081990251784', time=2024-09-12T03:20:57.495912+0000, chain.objs.size()=1 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YsCvi_-xtt98GY9FZ0EYIDoPyHyvlfj_0 2024-09-12T02:06:45.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9534172424395090382', time=2024-09-12T03:20:59.236563+0000, chain.objs.size()=1 2024-09-12T02:06:45.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kBvaomUdeljw3XTG1LR4894njJ-_PsY_0 2024-09-12T02:06:45.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3017288117575358704', time=2024-09-12T03:21:00.584591+0000, chain.objs.size()=1 2024-09-12T02:06:45.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.AjVw0Wv6M7WCyv9aQpKHS_I-vKn65CS_0 2024-09-12T02:06:45.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.914+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14153826773318895726', time=2024-09-12T03:21:01.733414+0000, chain.objs.size()=1 2024-09-12T02:06:45.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.914+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.JvE-zr_GQgwnyUX9Aa8fL2yv3UcCX23_0 2024-09-12T02:06:45.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52202 2024-09-12T02:06:45.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T02:06:45.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16596005366008750916', time=2024-09-12T03:21:04.501201+0000, chain.objs.size()=1 2024-09-12T02:06:45.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.V_MmWtJske2f6OQhEIyfleYl9pU8H-j_0 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1454074865378358775', time=2024-09-12T03:21:04.698204+0000, chain.objs.size()=1 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.aYEMDhHwwnLvgM43E9Us6eAVhfx8aWE_0 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7402301359301416393', time=2024-09-12T03:21:05.774659+0000, chain.objs.size()=1 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.cjdDDAmVX-k-r_ruacceMxYOBdlg3rj_0 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7296676839426702238', time=2024-09-12T03:21:08.697463+0000, chain.objs.size()=1 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zr98PjfUuwwstsU5S4XMgrphUeKoy_0_0 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14008272435331332576', time=2024-09-12T03:21:08.985134+0000, chain.objs.size()=1 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.HfDZbozMl_aB43P0YmY6sOfFKiPwepX_0 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10270329367009770351', time=2024-09-12T03:21:11.165886+0000, chain.objs.size()=1 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.UZ5K0rF2S-zdW0bllvq9olj7gufOeBf_0 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15094909496433770745', time=2024-09-12T03:21:12.037148+0000, chain.objs.size()=1 2024-09-12T02:06:45.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ob3B14MwmegTuO3P6zy4k21X_u_iqXr_0 2024-09-12T02:06:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17279085608701516858', time=2024-09-12T03:21:13.736018+0000, chain.objs.size()=1 2024-09-12T02:06:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PmC0PRwLqVIpMr5YNGPN-N9IhL9NIOB_0 2024-09-12T02:06:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15102462397262455405', time=2024-09-12T03:21:14.398206+0000, chain.objs.size()=1 2024-09-12T02:06:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9dIWjh4WxbRslcT9g7Q_F75pDJv7nNp_0 2024-09-12T02:06:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6088237890573557265', time=2024-09-12T03:21:15.254790+0000, chain.objs.size()=1 2024-09-12T02:06:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2i8k274kASVn3KKEmyk249ZdeIlh3w2_0 2024-09-12T02:06:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5199339467124783540', time=2024-09-12T03:21:15.256551+0000, chain.objs.size()=1 2024-09-12T02:06:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wy4s2_zdXQ99yJb-PV4B-m4WOWP5Vwt_0 2024-09-12T02:06:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1504990651559292110', time=2024-09-12T03:21:15.670524+0000, chain.objs.size()=1 2024-09-12T02:06:45.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MPu9KQCPV16ZX_Ei56bKZKLbw7l-2ku_0 2024-09-12T02:06:45.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.926+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16171745973210740097', time=2024-09-12T03:21:17.557118+0000, chain.objs.size()=1 2024-09-12T02:06:45.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PiqjnDr-KJtyijAPyt4JOjBeN_GtGc7_0 2024-09-12T02:06:45.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7091426801390590553', time=2024-09-12T03:21:18.328934+0000, chain.objs.size()=1 2024-09-12T02:06:45.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ckWNkd6hCBx2cl3cTTBK9ua9G8OLvLv_0 2024-09-12T02:06:45.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7907180947085610100', time=2024-09-12T03:21:19.412805+0000, chain.objs.size()=1 2024-09-12T02:06:45.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MYjngzhJp-aQgd-MGzf5Wnh1pMbv4dO_0 2024-09-12T02:06:45.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4486968022631431133', time=2024-09-12T03:21:19.595313+0000, chain.objs.size()=1 2024-09-12T02:06:45.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0Y3tJDQ98HsvaiT4dy9-CrsynETYGhI_0 2024-09-12T02:06:45.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10695292096271178624', time=2024-09-12T03:21:19.710567+0000, chain.objs.size()=1 2024-09-12T02:06:45.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ypfL3HqjE99OGE0itCbZvNwzPOsiQmX_0 2024-09-12T02:06:45.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13109869492707059684', time=2024-09-12T03:21:20.134654+0000, chain.objs.size()=1 2024-09-12T02:06:45.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qRXa_sy1cbAFjFsgNdNoR1fCUuZzhck_0 2024-09-12T02:06:45.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16532820682104007487', time=2024-09-12T03:21:20.338681+0000, chain.objs.size()=1 2024-09-12T02:06:45.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kBYcaH4bFmqf-ZKgNLrg3nrZHfPrKtr_0 2024-09-12T02:06:45.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8368027079616052746', time=2024-09-12T03:21:21.203169+0000, chain.objs.size()=1 2024-09-12T02:06:45.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qi3-edbzoEt7YBFOdqoplIS5cScPRtk_0 2024-09-12T02:06:45.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7646831843525863056', time=2024-09-12T03:21:22.281359+0000, chain.objs.size()=1 2024-09-12T02:06:45.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6cVtEFDeqbfetjvlKLbW6U2L42o_ZSY_0 2024-09-12T02:06:45.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1504622990891719892', time=2024-09-12T03:21:23.014805+0000, chain.objs.size()=1 2024-09-12T02:06:45.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ptlSF81YF6ytVkWKCmh15GG8UoQRShk_0 2024-09-12T02:06:45.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12504489516551853553', time=2024-09-12T03:21:23.730619+0000, chain.objs.size()=1 2024-09-12T02:06:45.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.y03R3vDo_xHookj3gYXfwAI0DB9BYtV_0 2024-09-12T02:06:45.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9584830684469200410', time=2024-09-12T03:21:24.837657+0000, chain.objs.size()=1 2024-09-12T02:06:45.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bjo213w72yGMpwSmqVQxCl1DH9c9bsV_0 2024-09-12T02:06:45.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7822833513805440621', time=2024-09-12T03:21:25.579828+0000, chain.objs.size()=1 2024-09-12T02:06:45.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.sGNvmEp9d4t_j99qFqz-z-MhiXGd3zH_0 2024-09-12T02:06:45.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2275554225806424718', time=2024-09-12T03:22:00.079599+0000, chain.objs.size()=1 2024-09-12T02:06:45.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.341__shadow_.VGGcetdzaveH4s-m2veCBNbX11hPwj5_0 2024-09-12T02:06:45.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.670601927167297453', time=2024-09-12T03:25:44.398358+0000, chain.objs.size()=1 2024-09-12T02:06:45.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.443__shadow_.3oJWJ7QY9V1uSMPFMEq4JB4omh6fpXO_0 2024-09-12T02:06:45.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15055509365750172365', time=2024-09-12T03:26:52.577911+0000, chain.objs.size()=1 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.467__shadow_.refs5Duy0WWGf8Cn58TkZ5B4c9WZ29i_0 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5372090942713570705', time=2024-09-12T03:29:38.811625+0000, chain.objs.size()=1 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.518__shadow_.bFCzLB0NZDq59C80LJccQ3EjsLPVeH8_0 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9368501287865287515', time=2024-09-12T03:37:04.807230+0000, chain.objs.size()=1 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.538__shadow_.EMG0Ta_w57upuo2O21MpfkZYryhHjud_0 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6750962498313702642', time=2024-09-12T03:38:43.789031+0000, chain.objs.size()=1 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.557__shadow_.W8ueNNPFfb7CBuEbotGg4didHsQrIqJ_0 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12741683164263209598', time=2024-09-12T03:40:17.696306+0000, chain.objs.size()=1 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.573__shadow_.34GbSYBh0ifKHP9ZVYg9kCgOkiIxI1n_0 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6421051996018719639', time=2024-09-12T03:40:45.269309+0000, chain.objs.size()=1 2024-09-12T02:06:45.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.577__shadow:tSkWO.UVVxhbPJUzZEUeIhMqRpohPm-_.IeRufZBEG-IDsRdMDw7HqxPND3VXtyF_0 2024-09-12T02:06:45.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16000180128327137356', time=2024-09-12T03:41:13.942484+0000, chain.objs.size()=1 2024-09-12T02:06:45.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:gZNWeaYRNS4k1DzhADGKwrWwWHhl.xk_.4Ys3zb4jMBP4_28-JYYcgYEkrUR6c9i_0 2024-09-12T02:06:45.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17081611622561178775', time=2024-09-12T03:50:38.792042+0000, chain.objs.size()=1 2024-09-12T02:06:45.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.635__shadow_.mmbP2tmAlQYq1t6hxIMchsK8hYtMuyP_0 2024-09-12T02:06:45.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.258044650888504638', time=2024-09-12T03:50:41.298216+0000, chain.objs.size()=1 2024-09-12T02:06:45.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.636__shadow_.lCko_xPrbv5jWkxS-FPc3HyhmyxAZmF_0 2024-09-12T02:06:45.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16715630304632611283', time=2024-09-12T03:53:15.101443+0000, chain.objs.size()=1 2024-09-12T02:06:45.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.667__shadow_.UVvBwdciZipMtgo8UEg7YHVaB6t5xtt_0 2024-09-12T02:06:45.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.946+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:45.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T02:06:45.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:45.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:45.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53522' 2024-09-12T02:06:45.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6190448056527819182', time=2024-09-12T03:06:35.963043+0000, chain.objs.size()=1 2024-09-12T02:06:45.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.200__shadow_.gZbdtwGdWT9M_yWf5sW4i-WXs7Xq6Ti_0 2024-09-12T02:06:45.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2393214442035706373', time=2024-09-12T03:10:35.286456+0000, chain.objs.size()=1 2024-09-12T02:06:45.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.235__shadow_.vV7vExlYyeedQFOxgnt87D7Xbxjl7Cj_0 2024-09-12T02:06:45.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4827597240858123533', time=2024-09-12T03:11:22.064169+0000, chain.objs.size()=1 2024-09-12T02:06:45.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.251__shadow_.fw6E2fUPTHZDTNr0t0ASIKUUDx8sxk8_0 2024-09-12T02:06:45.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18414313060889228300', time=2024-09-12T03:11:46.826101+0000, chain.objs.size()=1 2024-09-12T02:06:45.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.261__shadow_.8cWz1llA--amJmdMiXqESKPfP_R2yzn_0 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13929459802214042889', time=2024-09-12T03:11:49.348150+0000, chain.objs.size()=1 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.262__shadow_.QWgwG3lKa-ehDfvd4WphryvCMheCyF7_0 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2275564735673641700', time=2024-09-12T03:13:34.260741+0000, chain.objs.size()=1 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.33HKTmjzCBgOnrmDt_7DyasG9qxBWUA_0 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16534731416337180973', time=2024-09-12T03:13:34.941459+0000, chain.objs.size()=1 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1hBazhzHu0y1ZufPuRBYL9eN4hfpn_N_0 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16251037597714103234', time=2024-09-12T03:13:35.200324+0000, chain.objs.size()=1 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4IoaEdNlOZMxR7CwzKNMMOfbLCswK_m_0 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3545916410355618725', time=2024-09-12T03:13:36.247062+0000, chain.objs.size()=1 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.NrkCpRNS0dvkL28bChnqtMw8WcRFMat_0 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13875859515911648414', time=2024-09-12T03:13:36.456448+0000, chain.objs.size()=1 2024-09-12T02:06:45.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.o9JE0ECQ9CWNXE47-awLBeWvSZf0IqJ_0 2024-09-12T02:06:45.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3818256220135459725', time=2024-09-12T03:13:36.934931+0000, chain.objs.size()=1 2024-09-12T02:06:45.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mTBft1e5j-CsZaPNRUTjdntO-l89AJo_0 2024-09-12T02:06:45.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5858575928533927499', time=2024-09-12T03:13:39.273337+0000, chain.objs.size()=1 2024-09-12T02:06:45.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9qHPKYC4WnkCAg_v2i09qhBYxq9pI3v_0 2024-09-12T02:06:45.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16008068009161517286', time=2024-09-12T03:13:39.799015+0000, chain.objs.size()=1 2024-09-12T02:06:45.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DdXig5DvB07iwiaK17v4JaOGL5M86ic_0 2024-09-12T02:06:45.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10012801892212910762', time=2024-09-12T03:13:39.800791+0000, chain.objs.size()=1 2024-09-12T02:06:45.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-USDpZqMMMdAwraV-Fmiq-DbZYxsasb_0 2024-09-12T02:06:45.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7322949679947885111', time=2024-09-12T03:13:40.875336+0000, chain.objs.size()=1 2024-09-12T02:06:45.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9CjR__NgVtdbHyaqh_gHfaeoq93mjKF_0 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8157371641204390849', time=2024-09-12T03:13:42.949470+0000, chain.objs.size()=1 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0fZac3tRkcy_AEdWfxyi5rQwH8yzRcB_0 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1887096989892826729', time=2024-09-12T03:13:43.682211+0000, chain.objs.size()=1 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.LvKePbls7gFiDWZ0vva4rGVU7fnumCQ_0 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17494801412885946363', time=2024-09-12T03:13:43.781986+0000, chain.objs.size()=1 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CNM1pxNp2MDJjl9KdYAqaONG07F5HtY_0 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2470164206557436297', time=2024-09-12T03:13:44.532010+0000, chain.objs.size()=1 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.W1I5CldypWMO_Y_JwFG9Ri5TO3ZLd3v_0 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14455470603329510341', time=2024-09-12T03:13:44.609220+0000, chain.objs.size()=1 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JZ17oIfmRLCjP0EJHgZ1UZ7wbs5a51n_0 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12397602266410708174', time=2024-09-12T03:13:46.953005+0000, chain.objs.size()=1 2024-09-12T02:06:45.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.W14rgzDwqRCKN_FXOs45iW4BszP0wbY_0 2024-09-12T02:06:45.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6614643724397370873', time=2024-09-12T03:13:48.380524+0000, chain.objs.size()=1 2024-09-12T02:06:45.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.FxorQRuCxwrFcge2Th8wvOqh5IC00Gt_0 2024-09-12T02:06:45.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7514099363153752970', time=2024-09-12T03:13:49.284237+0000, chain.objs.size()=1 2024-09-12T02:06:45.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.f31X4l0QgjcswsKcx0CjkIxBhd285sk_0 2024-09-12T02:06:45.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10930046361710296208', time=2024-09-12T03:13:52.256990+0000, chain.objs.size()=1 2024-09-12T02:06:45.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vZkGskj0Y0T7D95GtYrp-YUCXZSwpgC_0 2024-09-12T02:06:45.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2351566814687896859', time=2024-09-12T03:13:52.258355+0000, chain.objs.size()=1 2024-09-12T02:06:45.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DPrWJRq0S6RFygP1jg4B6yIIH9xbQl3_0 2024-09-12T02:06:45.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16646074749246091131', time=2024-09-12T03:13:52.586012+0000, chain.objs.size()=1 2024-09-12T02:06:45.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0Lk0nGWLaxTSSUOzO4Fg7Pub1ZV8xS1_0 2024-09-12T02:06:45.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15259909253454400445', time=2024-09-12T03:13:52.684187+0000, chain.objs.size()=1 2024-09-12T02:06:45.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jhMccgD8fVRjjy2C8-lnH20hr6LxBm__0 2024-09-12T02:06:45.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10300268327962013823', time=2024-09-12T03:13:53.227013+0000, chain.objs.size()=1 2024-09-12T02:06:45.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.g3fhdqKX12D0EHeUHd8YYlT1CbN_j-i_0 2024-09-12T02:06:45.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4286989378795102007', time=2024-09-12T03:13:53.382882+0000, chain.objs.size()=1 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.O7wGmo2xluxBcgMQFceU16dEobZaIzr_0 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13490141698148562521', time=2024-09-12T03:13:55.141790+0000, chain.objs.size()=1 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.MjfXaJARgUwcj1SZc7AYvEAPR3XLyy5_0 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17375556906114869011', time=2024-09-12T03:13:55.565299+0000, chain.objs.size()=1 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.l1xWPSHRgmaueeGenJq0pkOr5BUqFxz_0 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13224885442235900766', time=2024-09-12T03:13:57.313139+0000, chain.objs.size()=1 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ZIhFKFS-HLkwj6XulhHrQWjGSzKa9Xi_0 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10680634965440953235', time=2024-09-12T03:13:57.539637+0000, chain.objs.size()=1 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GIeeo_63KI_zExvxV0w925XH7L210j1_0 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2361935803728283428', time=2024-09-12T03:13:57.545575+0000, chain.objs.size()=1 2024-09-12T02:06:45.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.e0MCpSQb0p952ykOCpEOIY4gAkDWhjO_0 2024-09-12T02:06:45.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8927470762643500011', time=2024-09-12T03:13:58.767487+0000, chain.objs.size()=1 2024-09-12T02:06:45.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._cw_LIhKo_TsCy115NknU0Oww0P6ODL_0 2024-09-12T02:06:45.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10681735681830708780', time=2024-09-12T03:13:59.921444+0000, chain.objs.size()=1 2024-09-12T02:06:45.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qRS_1nIiYza2lfPx9YBmwVfnPXqv6_T_0 2024-09-12T02:06:45.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12293295025461448702', time=2024-09-12T03:14:00.216685+0000, chain.objs.size()=1 2024-09-12T02:06:45.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.yCBzU-VYjaV7BNB8mduNE6gMDTzjLDq_0 2024-09-12T02:06:45.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8028452357126882779', time=2024-09-12T03:14:00.283786+0000, chain.objs.size()=1 2024-09-12T02:06:45.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2mMsF5ZHrsZNeLAPtbKfyGQCmDcbFWv_0 2024-09-12T02:06:45.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4704350658685084650', time=2024-09-12T03:14:01.514515+0000, chain.objs.size()=1 2024-09-12T02:06:45.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._Id7a5_6R0_kNqheGhnyqcrPYx4J3m8_0 2024-09-12T02:06:45.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14907049524074528939', time=2024-09-12T03:14:01.702596+0000, chain.objs.size()=1 2024-09-12T02:06:45.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Y6NhPDtohlJl95Eb__1Vr9VQ8MfAdsV_0 2024-09-12T02:06:45.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6474115437272820038', time=2024-09-12T03:14:01.818880+0000, chain.objs.size()=1 2024-09-12T02:06:45.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.YpudlD07RjGBNfAC77XPGYKyVhlBvVT_0 2024-09-12T02:06:45.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7112900191001560765', time=2024-09-12T03:14:02.763839+0000, chain.objs.size()=1 2024-09-12T02:06:45.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.XN1-WhSj_e7mRmRA-9N_vH-VHMqaGzR_0 2024-09-12T02:06:45.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10780308735790046028', time=2024-09-12T03:14:03.098196+0000, chain.objs.size()=1 2024-09-12T02:06:45.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.X2hwV3nJ2UmtRFr1_jgeQGG-AOXNUqo_0 2024-09-12T02:06:45.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7874770629726900256', time=2024-09-12T03:14:03.670862+0000, chain.objs.size()=1 2024-09-12T02:06:45.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.W-M6z-x81_MVr8goywoqndUeu1lzWXn_0 2024-09-12T02:06:45.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14247684019363164210', time=2024-09-12T03:14:05.076388+0000, chain.objs.size()=1 2024-09-12T02:06:45.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.52tYYnEHl3cw_3FnhW1xQ37SM9NBbJl_0 2024-09-12T02:06:45.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6783747575976482322', time=2024-09-12T03:15:04.599717+0000, chain.objs.size()=1 2024-09-12T02:06:45.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.287__shadow_.fXqWihvWeR2azi0N1WdHrxYYW-rotuW_0 2024-09-12T02:06:45.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7621563721829185722', time=2024-09-12T03:15:42.522666+0000, chain.objs.size()=1 2024-09-12T02:06:45.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.299__shadow_.FHa7aDJqW8KiapAtufDfy4femSg2G8w_0 2024-09-12T02:06:45.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3562401781336599252', time=2024-09-12T03:15:45.129772+0000, chain.objs.size()=1 2024-09-12T02:06:45.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.300__shadow_.cJxM8fIHiBX4-ZiD6QDAGLZGv5Wev-L_0 2024-09-12T02:06:45.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12234023418097393125', time=2024-09-12T03:16:20.413897+0000, chain.objs.size()=1 2024-09-12T02:06:45.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.314__shadow_.kBNMf5QL4n-tlxt3zatX8FzN4BqnG7s_0 2024-09-12T02:06:45.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12658920227684879304', time=2024-09-12T03:18:37.026119+0000, chain.objs.size()=1 2024-09-12T02:06:45.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.KP81PCNTHStly65a18855t-lKAMt7Gs_0 2024-09-12T02:06:45.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5071258363211634053', time=2024-09-12T03:18:38.283846+0000, chain.objs.size()=1 2024-09-12T02:06:45.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.88arS20oHo-kVb432bC_x_Ph_JpC9ta_0 2024-09-12T02:06:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6370369424091981198', time=2024-09-12T03:18:39.481381+0000, chain.objs.size()=1 2024-09-12T02:06:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.74Qb5lreoYUF9Qft9QgzXMYcRaguwbG_0 2024-09-12T02:06:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15566265421019334970', time=2024-09-12T03:18:43.757587+0000, chain.objs.size()=1 2024-09-12T02:06:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.dSq5rzLx3xoCbsVzyX2P09_5HltDWSE_0 2024-09-12T02:06:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15352897219232750000', time=2024-09-12T03:18:45.296520+0000, chain.objs.size()=1 2024-09-12T02:06:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MnPgxHr6ZWngxrgcKgEPvVekrIvvmtZ_0 2024-09-12T02:06:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12761346045634648287', time=2024-09-12T03:18:46.200770+0000, chain.objs.size()=1 2024-09-12T02:06:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7uCNYXUmbuCWeR7HVxtfflJN9C8vmht_0 2024-09-12T02:06:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16143277706468829981', time=2024-09-12T03:18:46.350961+0000, chain.objs.size()=1 2024-09-12T02:06:45.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VQ0a70vMugp7tg3A9iS5AvJu8tCnVNJ_0 2024-09-12T02:06:45.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6751029590522855268', time=2024-09-12T03:18:47.092422+0000, chain.objs.size()=1 2024-09-12T02:06:45.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.o6gn8JMuXurmstPRPodV1y__097hGbT_0 2024-09-12T02:06:45.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8706329234139216296', time=2024-09-12T03:18:48.206040+0000, chain.objs.size()=1 2024-09-12T02:06:45.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oU01lwN54PusbYjGQnUtBhTruJucXQq_0 2024-09-12T02:06:45.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6118876154983347457', time=2024-09-12T03:18:50.637228+0000, chain.objs.size()=1 2024-09-12T02:06:45.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vRZPR_th4SrPMmDtPxD9350HRDV51iT_0 2024-09-12T02:06:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18111650521088673657', time=2024-09-12T03:18:51.831768+0000, chain.objs.size()=1 2024-09-12T02:06:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RqBtQresAyN8unGXgYVoHM4-AmGYoeA_0 2024-09-12T02:06:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5477012970092548629', time=2024-09-12T03:18:52.288292+0000, chain.objs.size()=1 2024-09-12T02:06:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AkbVnAUTbovQptif3gVSh6G1MkFGMxr_0 2024-09-12T02:06:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9879910866177339786', time=2024-09-12T03:18:53.242014+0000, chain.objs.size()=1 2024-09-12T02:06:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.0Fk9lPIFMW70zfNchJr3pbIlRuLbEKZ_0 2024-09-12T02:06:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12589881837652501936', time=2024-09-12T03:18:53.455030+0000, chain.objs.size()=1 2024-09-12T02:06:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.EwpRQezslKIwR1sTKvGOPE10R8lapva_0 2024-09-12T02:06:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11266464194108357719', time=2024-09-12T03:18:56.118828+0000, chain.objs.size()=1 2024-09-12T02:06:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GKKFF-L73bMUW67_YWp5yOcp3n93-gB_0 2024-09-12T02:06:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11752155987751345827', time=2024-09-12T03:18:57.809009+0000, chain.objs.size()=1 2024-09-12T02:06:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4GW6d3PzPoab3ZE2u3hkonUFwJZSVNI_0 2024-09-12T02:06:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5118984084714460988', time=2024-09-12T03:18:57.888976+0000, chain.objs.size()=1 2024-09-12T02:06:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.SVVufcJVx8BIDmWz921Alg8ClboivdH_0 2024-09-12T02:06:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.810357728313864234', time=2024-09-12T03:19:00.121151+0000, chain.objs.size()=1 2024-09-12T02:06:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AVF5UBkEaNVPVKc3nBAaQsG7VOmAJg4_0 2024-09-12T02:06:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2494666177402449121', time=2024-09-12T03:19:00.255238+0000, chain.objs.size()=1 2024-09-12T02:06:45.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qmwoz9mBu4q7mEXarBbi-Hl4wHNiP9y_0 2024-09-12T02:06:45.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5680048134143813897', time=2024-09-12T03:19:02.432431+0000, chain.objs.size()=1 2024-09-12T02:06:45.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.rP5FPSBwkeXHz8GoV5r7QBsmCyvY6M9_0 2024-09-12T02:06:46.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12996930566961469690', time=2024-09-12T03:19:03.721309+0000, chain.objs.size()=1 2024-09-12T02:06:46.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.DndX8pnzeibguLoQ_BaAGO5Sacq8swD_0 2024-09-12T02:06:46.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.992068356748058985', time=2024-09-12T03:19:06.973475+0000, chain.objs.size()=1 2024-09-12T02:06:46.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ce-8Dm3muNuBCOsctH-Iyb1TdBiPk20_0 2024-09-12T02:06:46.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14686888277987096076', time=2024-09-12T03:19:07.559271+0000, chain.objs.size()=1 2024-09-12T02:06:46.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3rWWoSWdYDD1ufCydxs9RlrSf04SjRf_0 2024-09-12T02:06:46.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11528966302164900250', time=2024-09-12T03:19:07.701193+0000, chain.objs.size()=1 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-aZI41RTQVyt99AqfcADvBkAXBtTabd_0 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16783537949776398807', time=2024-09-12T03:19:07.846872+0000, chain.objs.size()=1 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.uJDc327QiDArux5CDSsrHdviCM8PrPE_0 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9848916468882392274', time=2024-09-12T03:20:54.742302+0000, chain.objs.size()=1 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.KNo3Fl5IOXTL-QS6o-_zCEBxWPZ5C1L_0 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.186073136017220508', time=2024-09-12T03:20:55.679648+0000, chain.objs.size()=1 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZAx06HPBHkt8J8nLxUYEQSj8_Ltz-sG_0 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14577101719696677326', time=2024-09-12T03:20:55.904291+0000, chain.objs.size()=1 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.L7PkVDQbvRDzAtCoyphe4NmxvQFvq94_0 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14444049852319678009', time=2024-09-12T03:20:55.906875+0000, chain.objs.size()=1 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.niuhH8NY6gZC1E1ELRIgqp6lcWe2j2u_0 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14553116905615771862', time=2024-09-12T03:20:56.303321+0000, chain.objs.size()=1 2024-09-12T02:06:46.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.D1iOBopXSVe8c7Zw0mfgf1i2YIvvCCY_0 2024-09-12T02:06:46.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16881449603661167979', time=2024-09-12T03:20:56.334834+0000, chain.objs.size()=1 2024-09-12T02:06:46.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:45.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.LAUYswvSrtnx4aqt58Xcr0IxjFxBAlv_0 2024-09-12T02:06:46.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.002+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11804303101299619779', time=2024-09-12T03:20:57.244134+0000, chain.objs.size()=1 2024-09-12T02:06:46.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.GF_jdMc4oNTwGtH93Q8VgKjB8e3PMPL_0 2024-09-12T02:06:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8645620236001869293', time=2024-09-12T03:20:59.122464+0000, chain.objs.size()=1 2024-09-12T02:06:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.VAn-D1aUep_LFVI1RzzzxytgMSCC3U4_0 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11095787060074772651', time=2024-09-12T03:20:59.673239+0000, chain.objs.size()=1 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ytMecqylFw6S-MFKWpz90nNDwWjGglf_0 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14374422166687942493', time=2024-09-12T03:20:59.894631+0000, chain.objs.size()=1 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._Zf-gDHfSwr7BnqkM6SmmR6KSVy-tqg_0 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12961880329443219339', time=2024-09-12T03:21:00.778513+0000, chain.objs.size()=1 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lZknA7eRW7VcPws5wAr2WmjqIlu8_zu_0 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12994707813797461216', time=2024-09-12T03:21:00.780646+0000, chain.objs.size()=1 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.x1zc2whDGvCzgGBtFpTEV8hlyP_ZS23_0 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10303144913408994001', time=2024-09-12T03:21:00.792778+0000, chain.objs.size()=1 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.woijPf1gSK2zo8lhHZNLKC7QMvM75is_0 2024-09-12T02:06:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3662715453133208332', time=2024-09-12T03:21:01.636881+0000, chain.objs.size()=1 2024-09-12T02:06:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.k9G1lDNpOFDXv2eO26qeMJoaLIh_lSX_0 2024-09-12T02:06:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3894489421738485362', time=2024-09-12T03:21:05.525418+0000, chain.objs.size()=1 2024-09-12T02:06:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9Uf-m_yQ2ka29ghbI-skFO0OOE6y0z7_0 2024-09-12T02:06:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2446448461398305821', time=2024-09-12T03:21:05.992040+0000, chain.objs.size()=1 2024-09-12T02:06:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bsLzEDueGLGiai1VeplIKJ9vk0W7d7u_0 2024-09-12T02:06:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14274429537619088713', time=2024-09-12T03:21:06.989605+0000, chain.objs.size()=1 2024-09-12T02:06:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.006+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kFUIRppLLT3u9L12sSxmRT6gqEGQYRO_0 2024-09-12T02:06:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.010+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12487801320595588535', time=2024-09-12T03:21:07.061963+0000, chain.objs.size()=1 2024-09-12T02:06:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.010+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.e7yt5wKEmxUZ0neHmVJabtNiIWRbBM9_0 2024-09-12T02:06:46.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13997428071295618603', time=2024-09-12T03:21:07.657615+0000, chain.objs.size()=1 2024-09-12T02:06:46.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rEiWAoxLCZf8dWLOC1BNhHDLl3KO4Aa_0 2024-09-12T02:06:46.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14796274640978079658', time=2024-09-12T03:21:08.566973+0000, chain.objs.size()=1 2024-09-12T02:06:46.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RSNNeRp7Nkzfv9vPvH9UVJsW-i2XOST_0 2024-09-12T02:06:46.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4545769209283721183', time=2024-09-12T03:21:09.498763+0000, chain.objs.size()=1 2024-09-12T02:06:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Zy0jlZYo2_W82-g6FHQ3U_pkw-q9Lwx_0 2024-09-12T02:06:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10659532054018149577', time=2024-09-12T03:21:09.696565+0000, chain.objs.size()=1 2024-09-12T02:06:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.j5_9eJOtdnFZGeUeC6A6J9b03-IB5ls_0 2024-09-12T02:06:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1912874799347052695', time=2024-09-12T03:21:11.273368+0000, chain.objs.size()=1 2024-09-12T02:06:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.UKd_JFyruf_4FbBHxqOoQ8I1xNm56FJ_0 2024-09-12T02:06:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.950862719353500925', time=2024-09-12T03:21:12.443245+0000, chain.objs.size()=1 2024-09-12T02:06:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.SxMQATtJJ-_qUUqrMhhktk2Nrw5uU_L_0 2024-09-12T02:06:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7350725519528699013', time=2024-09-12T03:21:12.508151+0000, chain.objs.size()=1 2024-09-12T02:06:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6c2SZaQAF_77QotIWZQeoHiobwL2QVX_0 2024-09-12T02:06:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10448931310295525137', time=2024-09-12T03:21:13.747031+0000, chain.objs.size()=1 2024-09-12T02:06:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7aBv9-1JnpWKiXzlEovZCFoX8JZxvCj_0 2024-09-12T02:06:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.022+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53522 2024-09-12T02:06:46.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T02:06:46.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1213231304421860922', time=2024-09-12T03:21:13.963729+0000, chain.objs.size()=1 2024-09-12T02:06:46.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.JsMsekHh506uwl-xyGOWx7Pn-HdEwBT_0 2024-09-12T02:06:46.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8464293812578736672', time=2024-09-12T03:21:16.470539+0000, chain.objs.size()=1 2024-09-12T02:06:46.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xfKGH5XWjXAR_IyRaRQJef6bqqfJQZY_0 2024-09-12T02:06:46.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9967811459217241611', time=2024-09-12T03:21:16.954263+0000, chain.objs.size()=1 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5D667oQUcFrS6JFmTGImGF13TZwAp-9_0 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5474769613809194073', time=2024-09-12T03:21:17.659250+0000, chain.objs.size()=1 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.n4NNAO15s3zJ5cXko6TH8YCx6OruPU5_0 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10132900457766696179', time=2024-09-12T03:21:18.221454+0000, chain.objs.size()=1 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Zmxotuu-CRkbsn-va0zY1HftU5bHxYJ_0 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13764373073572533529', time=2024-09-12T03:21:19.694439+0000, chain.objs.size()=1 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.UhkAp1bU6qW8wZRRMxmc7KQyzWzS6p8_0 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16488767237916056708', time=2024-09-12T03:21:20.080408+0000, chain.objs.size()=1 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-PONoupEAQbfk0Hw9m0TltMoAT27BYm_0 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3881966644363621155', time=2024-09-12T03:21:20.237545+0000, chain.objs.size()=1 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PZH7AQO2TcNrvCzqppKp99QzJQSymJg_0 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12372616465861101291', time=2024-09-12T03:21:20.451262+0000, chain.objs.size()=1 2024-09-12T02:06:46.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZqJuhNvG2j8W5j-bAC46ilR7rH-8w8e_0 2024-09-12T02:06:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16841194067712077503', time=2024-09-12T03:21:20.615677+0000, chain.objs.size()=1 2024-09-12T02:06:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.cwxg2y322Qk9HlRXO0S81tG7qaRO_Ch_0 2024-09-12T02:06:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14973468277089161191', time=2024-09-12T03:21:20.774640+0000, chain.objs.size()=1 2024-09-12T02:06:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6Qbd5dDfTDIpPM4-7Hjj8Gs44bBj4M3_0 2024-09-12T02:06:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17031512524360070399', time=2024-09-12T03:21:21.148919+0000, chain.objs.size()=1 2024-09-12T02:06:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tFIqS92x-ZagkqBg6klNbZbgDQKB9bY_0 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5848338521141280340', time=2024-09-12T03:21:22.979974+0000, chain.objs.size()=1 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.d9CbBnfEOgpiErSQw93MEmJJU-25JDL_0 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10633184727443754399', time=2024-09-12T03:21:24.064317+0000, chain.objs.size()=1 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PUYV1eivWagpXGFeSPa1sSMZYwzpiR0_0 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3459583050261431224', time=2024-09-12T03:21:25.436379+0000, chain.objs.size()=1 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._9KnxAl0RThfTFmOZ0MfjkFw9T1UmVt_0 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8254635471512455811', time=2024-09-12T03:21:25.503533+0000, chain.objs.size()=1 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MByJB2If3tqFbFZ4-9A8JL6kx8oYmVZ_0 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11464094507544188743', time=2024-09-12T03:22:12.220739+0000, chain.objs.size()=1 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.346__shadow_.Q9Dg8QmZMQdI9rKjVDvlzWQ3KleQ6Kq_0 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16755276386395591300', time=2024-09-12T03:25:19.270928+0000, chain.objs.size()=1 2024-09-12T02:06:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.432__shadow_.XTCVkRmHIs9Zym6yeVKlUN1qmsHfNHB_0 2024-09-12T02:06:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16464207065513749872', time=2024-09-12T03:26:49.071876+0000, chain.objs.size()=1 2024-09-12T02:06:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.466__shadow_.83-TF_n3tnz-mYMRzw3BjMwICBsLRVl_0 2024-09-12T02:06:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3269552425246671177', time=2024-09-12T03:28:54.012635+0000, chain.objs.size()=6 2024-09-12T02:06:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.1 2024-09-12T02:06:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.2 2024-09-12T02:06:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.3 2024-09-12T02:06:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.4 2024-09-12T02:06:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.5 2024-09-12T02:06:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.6 2024-09-12T02:06:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk', time=2024-09-12T03:31:30.518160+0000, chain.objs.size()=2 2024-09-12T02:06:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.1 2024-09-12T02:06:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__shadow_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.1_1 2024-09-12T02:06:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3168268005935239371', time=2024-09-12T03:34:59.794328+0000, chain.objs.size()=2 2024-09-12T02:06:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~yatfCPzIKUDGuJRBI1VjsjRDsVAEKxj.1 2024-09-12T02:06:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~yatfCPzIKUDGuJRBI1VjsjRDsVAEKxj.2 2024-09-12T02:06:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~2V_XqTkVD9-WaOKbM6Ks2rBq5vYJi8A', time=2024-09-12T03:39:18.168153+0000, chain.objs.size()=1 2024-09-12T02:06:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.562__multipart_mymultipart.2~2V_XqTkVD9-WaOKbM6Ks2rBq5vYJi8A.1 2024-09-12T02:06:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15501913961463401263', time=2024-09-12T03:39:37.974688+0000, chain.objs.size()=1 2024-09-12T02:06:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.567__shadow_.bhVnXqay-y6jIalgSUylQyXT8nXsVUw_0 2024-09-12T02:06:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16087959733339000808', time=2024-09-12T03:40:21.089767+0000, chain.objs.size()=1 2024-09-12T02:06:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.574__shadow_.7j2d8q09sKpE6Al1vZJwG4JtMGMXjLg_0 2024-09-12T02:06:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17107605794833561750', time=2024-09-12T03:40:47.898287+0000, chain.objs.size()=1 2024-09-12T02:06:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.577__shadow:lPovOmmaqhx4-knLqRtC3LVDd.EBHmI_.wX_IQgZs7gr3n9GgI-8FBFAxnsRc8m0_0 2024-09-12T02:06:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8221715292448660642', time=2024-09-12T03:41:04.955292+0000, chain.objs.size()=1 2024-09-12T02:06:46.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:3fZ.7gUz2KB8-SDfXIxq.HSgCgiUvRw_.bvh5cTvE1Nqgs2aijObmHMiAXyZhXCo_0 2024-09-12T02:06:46.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14717475382493594449', time=2024-09-12T03:41:27.289237+0000, chain.objs.size()=1 2024-09-12T02:06:46.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:D-4IZBZ.YAq4JWRFl5C5bWqq1nhIsB8_.DK79N08HWTdKYtsHGbOGp-CR0he576F_0 2024-09-12T02:06:46.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17924464142311572061', time=2024-09-12T03:42:36.340813+0000, chain.objs.size()=1 2024-09-12T02:06:46.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.580__shadow:735ex.aQBsWOeovrZAvnbF817IpKfmJ_.RCikBdPeH4Czi5V15co0s0LHOEruov__0 2024-09-12T02:06:46.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5055573666299600464', time=2024-09-12T03:50:33.883374+0000, chain.objs.size()=1 2024-09-12T02:06:46.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.633__shadow_.C4sPxhCrk1n2wEJzZC7vXtc8H4hS2oD_0 2024-09-12T02:06:46.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.050+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4535689054759279014', time=2024-09-12T03:53:04.991244+0000, chain.objs.size()=1 2024-09-12T02:06:46.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.050+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.664__shadow_.FMxMz2xluCbm71FVAzM4EfaXsnIf_rT_0 2024-09-12T02:06:46.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.050+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15970521467724038062', time=2024-09-12T03:53:08.300535+0000, chain.objs.size()=1 2024-09-12T02:06:46.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.050+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.665__shadow_.L1PQUoN3M7GCwNzIdEvptI4GytDdp80_0 2024-09-12T02:06:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.050+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3289029249326362399', time=2024-09-12T03:53:15.732963+0000, chain.objs.size()=1 2024-09-12T02:06:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.050+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.667__shadow_.UVvBwdciZipMtgo8UEg7YHVaB6t5xtt_0 2024-09-12T02:06:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.050+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18433341199109255614', time=2024-09-12T03:53:24.889952+0000, chain.objs.size()=1 2024-09-12T02:06:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.050+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.672__shadow_.l13lJdzdryd6shGaGF2mJRKSCgAFHu9_0 2024-09-12T02:06:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.050+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6068167512401126402', time=2024-09-12T03:54:49.561267+0000, chain.objs.size()=1 2024-09-12T02:06:46.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.050+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.712__multipart_file1.2~iLsfl12S3DxDDhLXVrDJ8sUcVF8Lggy.1 2024-09-12T02:06:46.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:46.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T02:06:46.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:46.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:46.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50724' 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5600176300115526061', time=2024-09-12T03:03:45.207515+0000, chain.objs.size()=3 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.8vQS9MaYj2MYfdJlkzieDZmpitW1z2o_0 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.8vQS9MaYj2MYfdJlkzieDZmpitW1z2o_1 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.8vQS9MaYj2MYfdJlkzieDZmpitW1z2o_2 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4215478086155932107', time=2024-09-12T03:10:37.870100+0000, chain.objs.size()=1 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.236__shadow_.WzSCHS7QPtPFZYDM4Mpv0lO_TmD5SSA_0 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2371442311489202072', time=2024-09-12T03:11:09.497380+0000, chain.objs.size()=1 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.246__shadow_.foCTtAgQ7BBXu0Qjhf_FPZO2qA3JFq8_0 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6958141204359270816', time=2024-09-12T03:11:12.075742+0000, chain.objs.size()=1 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.247__shadow_.su2gxgjFJQs-ir5FhTCTwTE8V0sfKrj_0 2024-09-12T02:06:46.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10355161497584700095', time=2024-09-12T03:11:44.317195+0000, chain.objs.size()=1 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.260__shadow_.L2K-C45orXLNAeez55T_H5EXGz7lPoJ_0 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5129308214617901646', time=2024-09-12T03:13:33.865830+0000, chain.objs.size()=1 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.066+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.lIp1GTiJMtZ0vQpOk4lXwSJBHEqlqIS_0 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5842789130860339672', time=2024-09-12T03:13:33.972205+0000, chain.objs.size()=1 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.oggE7O3gkdkZWGkeMXb_UbzZRN2mPgt_0 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8039921291604362266', time=2024-09-12T03:13:35.448417+0000, chain.objs.size()=1 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.kCEjc-SF6ABCIc16fet4yf23Vn0qamR_0 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.544171707785007999', time=2024-09-12T03:13:36.136363+0000, chain.objs.size()=1 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.spEDAd6VgjZPUCFSkH8TEhOfJ4X_jDK_0 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11056858039450602017', time=2024-09-12T03:13:36.345782+0000, chain.objs.size()=1 2024-09-12T02:06:46.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.LEv7LPX2OnlZJxu9mpmge16MoEQOXZV_0 2024-09-12T02:06:46.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16620592745094280003', time=2024-09-12T03:13:37.187401+0000, chain.objs.size()=1 2024-09-12T02:06:46.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.X6F0yz7nt-IJDUmjk4QLoGL-FfPBK1e_0 2024-09-12T02:06:46.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13517547196981238861', time=2024-09-12T03:13:38.767702+0000, chain.objs.size()=1 2024-09-12T02:06:46.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.c80ocINE4VAuNBOo7H9flHd-dwPStO1_0 2024-09-12T02:06:46.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13851170910097249460', time=2024-09-12T03:13:39.511832+0000, chain.objs.size()=1 2024-09-12T02:06:46.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xt7fkQKsyTZNg19O3C_N4-2XAwlgEfZ_0 2024-09-12T02:06:46.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8526462284236550106', time=2024-09-12T03:13:39.700470+0000, chain.objs.size()=1 2024-09-12T02:06:46.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mhnUAPv_MXxJiSHQKEKFlMsOh6G27Ua_0 2024-09-12T02:06:46.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6658796967226390274', time=2024-09-12T03:13:40.234866+0000, chain.objs.size()=1 2024-09-12T02:06:46.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.WUBmLTOdY12ZRGpXr5PPtLRWtQKMH0m_0 2024-09-12T02:06:46.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14871392722905794673', time=2024-09-12T03:13:40.518423+0000, chain.objs.size()=1 2024-09-12T02:06:46.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pfKet9z6PLKWrLOQGbjqK6ALcWuCyS0_0 2024-09-12T02:06:46.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3775311294206393434', time=2024-09-12T03:13:43.002144+0000, chain.objs.size()=1 2024-09-12T02:06:46.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._5rXzPPz5SmvIP_3ue2FA6mnMOpAoNO_0 2024-09-12T02:06:46.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17819032302620019231', time=2024-09-12T03:13:43.637785+0000, chain.objs.size()=1 2024-09-12T02:06:46.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tc102sJM1uruMaX58pY19A_0OSt9jLA_0 2024-09-12T02:06:46.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17901557787925744056', time=2024-09-12T03:13:45.125239+0000, chain.objs.size()=1 2024-09-12T02:06:46.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Sq_Bw0ZABxtNW_ESbpfRad2pfEYakDa_0 2024-09-12T02:06:46.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3567325312675485800', time=2024-09-12T03:13:47.109503+0000, chain.objs.size()=1 2024-09-12T02:06:46.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6aiU9nod_AVlxuEseudMM-SDURrBSaL_0 2024-09-12T02:06:46.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5179184359321979562', time=2024-09-12T03:13:47.627069+0000, chain.objs.size()=1 2024-09-12T02:06:46.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.BbXsTj6vWOktaYlSmn-Ml7goOQm5nge_0 2024-09-12T02:06:46.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9290620751549684266', time=2024-09-12T03:13:49.268391+0000, chain.objs.size()=1 2024-09-12T02:06:46.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Ex17yGAkNr4UYQ9FTrxF7M0mvzyJLtA_0 2024-09-12T02:06:46.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15375079621150831751', time=2024-09-12T03:13:49.523960+0000, chain.objs.size()=1 2024-09-12T02:06:46.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.YGLI9VL0WFMkH3eziUrXgeXlSssGF7J_0 2024-09-12T02:06:46.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5042040719744097810', time=2024-09-12T03:13:51.167314+0000, chain.objs.size()=1 2024-09-12T02:06:46.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.XY_qMYV8gBbC6Pzhgux9o7o4bPY5mdL_0 2024-09-12T02:06:46.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7973904157681982327', time=2024-09-12T03:13:51.305369+0000, chain.objs.size()=1 2024-09-12T02:06:46.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mu-zonPFBX_cPiemJ3OsL4ko2KcdiL7_0 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17733582095644660233', time=2024-09-12T03:13:51.514638+0000, chain.objs.size()=1 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ngHq_dpLB0kXoFQNLGdJGuiarowHNzj_0 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13667357075554247032', time=2024-09-12T03:13:52.463181+0000, chain.objs.size()=1 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.T-bD53FWTeANAF7Z8M0vuxXIb_bSf6M_0 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14804351527622329024', time=2024-09-12T03:13:53.636181+0000, chain.objs.size()=1 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6yy6JMQTQ28U_F3AduVE2uJi5oMkCbX_0 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13510769524488633542', time=2024-09-12T03:13:54.748596+0000, chain.objs.size()=1 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aYg3dKZbIjHm6rmafgq7nuCmN7v7-si_0 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4873094754545791374', time=2024-09-12T03:13:54.845084+0000, chain.objs.size()=1 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6g2LCm2AVSS1H4esJSbvO9ANx4cPvgc_0 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8295602628981691415', time=2024-09-12T03:13:55.205697+0000, chain.objs.size()=1 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.66_tjEQTwn_6Q2yDu42kP_WL0rBO2kS_0 2024-09-12T02:06:46.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15117969790094587955', time=2024-09-12T03:13:55.660939+0000, chain.objs.size()=1 2024-09-12T02:06:46.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.082+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.W3N-HwJVOvIxVjqdAFGqKf0U_wQzkM0_0 2024-09-12T02:06:46.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1748692348786361612', time=2024-09-12T03:13:56.537401+0000, chain.objs.size()=1 2024-09-12T02:06:46.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.m15-2ypaX4owzF9lNzw_m0JFEL_ymST_0 2024-09-12T02:06:46.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6312802560570130088', time=2024-09-12T03:13:57.118324+0000, chain.objs.size()=1 2024-09-12T02:06:46.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2u4gB5-nIQ-cR2MD7K0QlUFcquFbawl_0 2024-09-12T02:06:46.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9792615687875196327', time=2024-09-12T03:13:57.258967+0000, chain.objs.size()=1 2024-09-12T02:06:46.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5ArGvy5sUDiFpEbo6TnKDv4CMHj0hOX_0 2024-09-12T02:06:46.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16699015630501838367', time=2024-09-12T03:13:57.805309+0000, chain.objs.size()=1 2024-09-12T02:06:46.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.AB3He-WFXq9__7TsG2zuNV84PgQKab6_0 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1882555393657023490', time=2024-09-12T03:14:00.487118+0000, chain.objs.size()=1 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.oEKVf31J__gUfFLbYv-Rvf9urQ50o7p_0 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1262588617311461332', time=2024-09-12T03:14:00.986639+0000, chain.objs.size()=1 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.478-SXJPMQVDdUUsTB5RF5FslV16EjV_0 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1994224341322136579', time=2024-09-12T03:14:01.386274+0000, chain.objs.size()=1 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Ec1IDei3b0GhLIR8TK8RpXq5sh_jStT_0 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8750566375515933501', time=2024-09-12T03:14:01.751620+0000, chain.objs.size()=1 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1dYqYqjXXgmQ97RJbZqY8EX9QAf598Q_0 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17093709130421301780', time=2024-09-12T03:14:02.600534+0000, chain.objs.size()=1 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.nNlJL72_wmb6ux6W7XKERwdZd9jtVQH_0 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7106353638950208665', time=2024-09-12T03:14:02.662918+0000, chain.objs.size()=1 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.gFTFhIschFzvHT95NfEiSKUkVI2_TFW_0 2024-09-12T02:06:46.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9874279346889074586', time=2024-09-12T03:14:03.665872+0000, chain.objs.size()=1 2024-09-12T02:06:46.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0bzPb3IMSaiWYJe5UofCJIXRU16fGlj_0 2024-09-12T02:06:46.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.098+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6486524583956197850', time=2024-09-12T03:14:04.473036+0000, chain.objs.size()=1 2024-09-12T02:06:46.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.098+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QC9NvxyZJ0hnxqAgdbpWEl_NblGHVAN_0 2024-09-12T02:06:46.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.098+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11926046074522882175', time=2024-09-12T03:14:04.704404+0000, chain.objs.size()=1 2024-09-12T02:06:46.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.098+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.eW7Zq9P86I_yNRD7rpU_oiivHuuUonf_0 2024-09-12T02:06:46.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.098+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.985412015883547713', time=2024-09-12T03:14:05.444630+0000, chain.objs.size()=1 2024-09-12T02:06:46.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.098+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mfXAlo_BD4Om6eDjfNxIWuWIxpkz-br_0 2024-09-12T02:06:46.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.098+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16536686659664743337', time=2024-09-12T03:14:41.764610+0000, chain.objs.size()=1 2024-09-12T02:06:46.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.098+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.278__shadow_.wWEe-0cZE9uccKRHNOiH6nSracbC5hy_0 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5291024621688230273', time=2024-09-12T03:15:29.584024+0000, chain.objs.size()=1 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.DN4jC4aH2UoenXTrqkccb50PfxbO8jC_0 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2888341697682126526', time=2024-09-12T03:15:50.177205+0000, chain.objs.size()=1 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.302__shadow_.4YB76-3dBngtiR6wFGR83edUGMlAzVc_0 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8150287157469532261', time=2024-09-12T03:18:38.061068+0000, chain.objs.size()=1 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3xApnp8SpWyn3dhrncQEnOmKMlBHL4t_0 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12446574865331622287', time=2024-09-12T03:18:38.260158+0000, chain.objs.size()=1 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.WHq8XP142YFY2QkAPGc-8-dwSWWds7J_0 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9473036679262690513', time=2024-09-12T03:18:42.155010+0000, chain.objs.size()=1 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.q2F8H3PP0k7vGz8-absi2bjRYeD_TfW_0 2024-09-12T02:06:46.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11842101963302824238', time=2024-09-12T03:18:42.212097+0000, chain.objs.size()=1 2024-09-12T02:06:46.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.20QUNzGcwKf2fQAiU_skvfOM-tu7LbJ_0 2024-09-12T02:06:46.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3115438792555564488', time=2024-09-12T03:18:42.484631+0000, chain.objs.size()=1 2024-09-12T02:06:46.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xwOkjUYzPk-EmVKB-X_t12c4jIzkt2F_0 2024-09-12T02:06:46.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11278158266090861979', time=2024-09-12T03:18:42.650186+0000, chain.objs.size()=1 2024-09-12T02:06:46.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ePMuDf3nL36nYPkHO6t68UJCyQEJC4J_0 2024-09-12T02:06:46.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7169538786715033136', time=2024-09-12T03:18:42.764960+0000, chain.objs.size()=1 2024-09-12T02:06:46.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.w8Nfais7mJbw8B_d2tGxcz1bWWbjkD0_0 2024-09-12T02:06:46.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12421204554825888948', time=2024-09-12T03:18:43.638596+0000, chain.objs.size()=1 2024-09-12T02:06:46.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.t0xk4Cc2YlRe3rVUmcbESKqbMmvvB8s_0 2024-09-12T02:06:46.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3949303438789458154', time=2024-09-12T03:18:45.041609+0000, chain.objs.size()=1 2024-09-12T02:06:46.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.761KxvwcbZ2IKveIH0M9AYfZQbV_QzC_0 2024-09-12T02:06:46.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15458468259903683096', time=2024-09-12T03:18:45.887593+0000, chain.objs.size()=1 2024-09-12T02:06:46.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OBnAtsTbqGtcXF1Wjv-Cm_HoffcWh1D_0 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14071759502332361576', time=2024-09-12T03:18:45.889986+0000, chain.objs.size()=1 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.F0frriQ8ebMpgEXdl0W0YIAR0GJTiK3_0 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7071620591543900932', time=2024-09-12T03:18:45.991759+0000, chain.objs.size()=1 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tQIzD5fYarImJhejwhzuX086FZzq5pI_0 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14160214453286734886', time=2024-09-12T03:18:45.994660+0000, chain.objs.size()=1 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4Dw3inC60orz39X2EtSHwPDC-nRzFUV_0 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8809007662567288475', time=2024-09-12T03:18:47.341175+0000, chain.objs.size()=1 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.cu6YuP80Zlg0ris-gqKNx5XiOfwlJ9p_0 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6239123583121067993', time=2024-09-12T03:18:47.445605+0000, chain.objs.size()=1 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.i5Scs0bpu-diHS5t6eTcHSS5gb_Oo39_0 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3639228494082355470', time=2024-09-12T03:18:49.440957+0000, chain.objs.size()=1 2024-09-12T02:06:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BY1d80EZafOGOUs9LiZVcB9GujO2zxP_0 2024-09-12T02:06:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3374799934236840752', time=2024-09-12T03:18:50.640056+0000, chain.objs.size()=1 2024-09-12T02:06:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hJ4UDYdeH2nPRX666KmkBFfZf09XoEo_0 2024-09-12T02:06:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9123161737140106783', time=2024-09-12T03:18:52.368232+0000, chain.objs.size()=1 2024-09-12T02:06:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vdapcDQK9aP7Yivl9b_wyaib2xMrPYM_0 2024-09-12T02:06:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12921122254765605074', time=2024-09-12T03:18:54.564559+0000, chain.objs.size()=1 2024-09-12T02:06:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AAvGWOUScRDfOtUW7sD8PFY8d-QHU9d_0 2024-09-12T02:06:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6748247967545923556', time=2024-09-12T03:18:55.587158+0000, chain.objs.size()=1 2024-09-12T02:06:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.kF-0RO77CY8XTNiejX0Hlt20VBDFOAE_0 2024-09-12T02:06:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18154666387547704350', time=2024-09-12T03:18:55.882406+0000, chain.objs.size()=1 2024-09-12T02:06:46.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2HLpURP8HT1CvwcPlqY9uAZ--xcnolF_0 2024-09-12T02:06:46.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2006568457396796645', time=2024-09-12T03:18:56.144908+0000, chain.objs.size()=1 2024-09-12T02:06:46.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Jdvdri38ndX7S0P_0UesB6rYx8X_Rzw_0 2024-09-12T02:06:46.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17581055858781004279', time=2024-09-12T03:18:56.379281+0000, chain.objs.size()=1 2024-09-12T02:06:46.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.kyy1yjFYRLMiavifpFBQ8lonodafGbP_0 2024-09-12T02:06:46.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4869469284150805612', time=2024-09-12T03:18:56.418309+0000, chain.objs.size()=1 2024-09-12T02:06:46.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Eh2h4j7rcxEHWSBDQbsLfQJ3SiF7kkl_0 2024-09-12T02:06:46.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2763192659890160472', time=2024-09-12T03:18:59.780851+0000, chain.objs.size()=1 2024-09-12T02:06:46.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VFk04VpyX6RGYprIk_0A74eqTrk5PJr_0 2024-09-12T02:06:46.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2847292701118110739', time=2024-09-12T03:19:01.949877+0000, chain.objs.size()=1 2024-09-12T02:06:46.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.w3LIIXnjPnD_BxgcZmtu_JlkUaXiqM5_0 2024-09-12T02:06:46.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4156806385190956145', time=2024-09-12T03:19:03.263352+0000, chain.objs.size()=1 2024-09-12T02:06:46.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Co8iP4Fu-aeZOslg-81Q3dYHS4225NR_0 2024-09-12T02:06:46.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12189486152794833293', time=2024-09-12T03:19:03.945351+0000, chain.objs.size()=1 2024-09-12T02:06:46.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.u5S54qvaRbygarVAaWj8Ro_RITP0-bZ_0 2024-09-12T02:06:46.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1861665110549089074', time=2024-09-12T03:19:06.870905+0000, chain.objs.size()=1 2024-09-12T02:06:46.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Q6HfYWdhSHOIBvhkz8VVqaBzaZ-Cf1A_0 2024-09-12T02:06:46.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13989869273430690005', time=2024-09-12T03:20:54.497184+0000, chain.objs.size()=1 2024-09-12T02:06:46.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Acp_WzzoLdmtT9qBdx9UU3tA7SyTg7g_0 2024-09-12T02:06:46.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4829218092595131555', time=2024-09-12T03:20:54.886654+0000, chain.objs.size()=1 2024-09-12T02:06:46.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ImCHbKNWDMnuKJfGveNk3KCYQGZsnIQ_0 2024-09-12T02:06:46.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9304591599217575862', time=2024-09-12T03:20:55.185979+0000, chain.objs.size()=1 2024-09-12T02:06:46.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MfVgXsgFoSO5vyuK1Qm-yiAENoYK01W_0 2024-09-12T02:06:46.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14289823248219723996', time=2024-09-12T03:20:57.208393+0000, chain.objs.size()=1 2024-09-12T02:06:46.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Ni2YI0DW8Kd9z5I6xoKGwfm9OCkngnD_0 2024-09-12T02:06:46.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.129750246492844120', time=2024-09-12T03:20:58.861486+0000, chain.objs.size()=1 2024-09-12T02:06:46.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8u7f4DxNEHH7mLtoBcc7aFUhEiJ154I_0 2024-09-12T02:06:46.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11163714588925271308', time=2024-09-12T03:20:59.261819+0000, chain.objs.size()=1 2024-09-12T02:06:46.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.GasOW-XY0FsjhohNk9VUwTueBqfedAI_0 2024-09-12T02:06:46.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2027411463282258266', time=2024-09-12T03:20:59.794119+0000, chain.objs.size()=1 2024-09-12T02:06:46.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NagZ4KCZwqZiDd0m5AlKJJYBQm30wE0_0 2024-09-12T02:06:46.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13853933439647653549', time=2024-09-12T03:21:00.777246+0000, chain.objs.size()=1 2024-09-12T02:06:46.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.oI6uANPZ0ahTvz19KiuDnfOLfS_ilVQ_0 2024-09-12T02:06:46.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9070179413420617553', time=2024-09-12T03:21:03.012534+0000, chain.objs.size()=1 2024-09-12T02:06:46.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.AxasOmKWROi37UUOWwqri3KXp9Rh1TZ_0 2024-09-12T02:06:46.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5560867715228755424', time=2024-09-12T03:21:04.694478+0000, chain.objs.size()=1 2024-09-12T02:06:46.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Thi6itVju7OOs3zTNH19dlvwph_DU64_0 2024-09-12T02:06:46.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3772214048792866600', time=2024-09-12T03:21:04.992676+0000, chain.objs.size()=1 2024-09-12T02:06:46.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pZfUccBs2nE8xioM5nukpKyZM7-riAX_0 2024-09-12T02:06:46.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6226214992257302359', time=2024-09-12T03:21:05.021342+0000, chain.objs.size()=1 2024-09-12T02:06:46.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.W1cdZ17up5q9qs44PRk35NCvLvSWZud_0 2024-09-12T02:06:46.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9013042365671966646', time=2024-09-12T03:21:05.402421+0000, chain.objs.size()=1 2024-09-12T02:06:46.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.GwKPekYN1CLljNA7XxEOF5q8Kl5OqZp_0 2024-09-12T02:06:46.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13792383327860312358', time=2024-09-12T03:21:06.980531+0000, chain.objs.size()=1 2024-09-12T02:06:46.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Sn4rjtjRWAPQmBFOZ2xwcuIgT0_tFWI_0 2024-09-12T02:06:46.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16953129608230943271', time=2024-09-12T03:21:09.594128+0000, chain.objs.size()=1 2024-09-12T02:06:46.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.z8pSdE55A0qOz15DyCU-L8RlYp7jc2J_0 2024-09-12T02:06:46.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2594282581571924119', time=2024-09-12T03:21:10.086930+0000, chain.objs.size()=1 2024-09-12T02:06:46.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4SpJ5MN9JFnOXLxs4Pc6v68JDp6ixtc_0 2024-09-12T02:06:46.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15848627192356342745', time=2024-09-12T03:21:11.305700+0000, chain.objs.size()=1 2024-09-12T02:06:46.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wWuWf2H9pKmgUmIsCA2INxpu0lfCRve_0 2024-09-12T02:06:46.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.840827757538166406', time=2024-09-12T03:21:11.861727+0000, chain.objs.size()=1 2024-09-12T02:06:46.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zzZkmMQbeaI8v6d3B4fGUbQo-VJ_Rhd_0 2024-09-12T02:06:46.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9703806908303668572', time=2024-09-12T03:21:12.682212+0000, chain.objs.size()=1 2024-09-12T02:06:46.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5rDFIdWuSk84CFv9M92cXB3DdV5W9Aw_0 2024-09-12T02:06:46.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.817780194260034580', time=2024-09-12T03:21:13.527635+0000, chain.objs.size()=1 2024-09-12T02:06:46.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PWSH4rI0R1jxkiv5L5U2w_IhswxJI7W_0 2024-09-12T02:06:46.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17940650484591957797', time=2024-09-12T03:21:16.235492+0000, chain.objs.size()=1 2024-09-12T02:06:46.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9V3SXAdDfF6Q0sf-iDJMVRMnmkOA3_G_0 2024-09-12T02:06:46.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17411933244490418163', time=2024-09-12T03:21:16.718000+0000, chain.objs.size()=1 2024-09-12T02:06:46.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.sWbuKEShy20-Y97rLPGVWNYl4IDQpf__0 2024-09-12T02:06:46.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50724 2024-09-12T02:06:46.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T02:06:46.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5731531534759531892', time=2024-09-12T03:21:19.231716+0000, chain.objs.size()=1 2024-09-12T02:06:46.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.jod_GSYPjz8pVkjs-1xwo0sColvwEW6_0 2024-09-12T02:06:46.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15594036254776592929', time=2024-09-12T03:21:19.234269+0000, chain.objs.size()=1 2024-09-12T02:06:46.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1d_KSqqO6SKOYGiLz_8sSrrgdH_bGhw_0 2024-09-12T02:06:46.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8556917970305326691', time=2024-09-12T03:21:20.008807+0000, chain.objs.size()=1 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Ij5cj2tu1jXGFuWdntN3eC-CvU0v-QA_0 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3523617064152868406', time=2024-09-12T03:21:20.354293+0000, chain.objs.size()=1 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-i_A0tb8Etc1xNRJ17PGFfOUN7X4pgm_0 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3977080678540584218', time=2024-09-12T03:21:21.472090+0000, chain.objs.size()=1 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Xm5lsop6BrgR1DYvG4TBiGZA-9AJXop_0 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14477372799388451040', time=2024-09-12T03:21:21.474248+0000, chain.objs.size()=1 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.O_HVJae6-D0cTWxTc_90TxPphMUQPKM_0 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14872421875990454446', time=2024-09-12T03:21:22.198784+0000, chain.objs.size()=1 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.oO_TWIBTeUui6mBAzdCXBJC4qCkypqF_0 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16343848214315042237', time=2024-09-12T03:21:24.079125+0000, chain.objs.size()=1 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zlk4OGW2FsUKDY7phLJUJojhwxBObil_0 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2242497581678826405', time=2024-09-12T03:21:24.101990+0000, chain.objs.size()=1 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kO9cdLNviwnEn8RLj_JzW_9ZAfcPxh0_0 2024-09-12T02:06:46.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12646813981645413042', time=2024-09-12T03:21:24.773243+0000, chain.objs.size()=1 2024-09-12T02:06:46.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YtiR3Tp1znXHa1lryqYf6cTsPx9u-aP_0 2024-09-12T02:06:46.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2847985263571752298', time=2024-09-12T03:21:25.295745+0000, chain.objs.size()=1 2024-09-12T02:06:46.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.i0qDnrHd5OZMF9Tgn6_4dPQ0wGQw7F9_0 2024-09-12T02:06:46.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17594542363491710355', time=2024-09-12T03:23:26.835134+0000, chain.objs.size()=1 2024-09-12T02:06:46.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.382__shadow_.3CiV829DIzcibDn2REUe5tLsql294rF_0 2024-09-12T02:06:46.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1581280100494182723', time=2024-09-12T03:26:52.353915+0000, chain.objs.size()=1 2024-09-12T02:06:46.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.467__shadow_.lzCQu_arUqiBrbMPcnvEE9iXCfWcwI__0 2024-09-12T02:06:46.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8726647779611513098', time=2024-09-12T03:27:21.908404+0000, chain.objs.size()=1 2024-09-12T02:06:46.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.1arvkn6S5RaLbWEAJlp65KGIyoUR4Z5_0 2024-09-12T02:06:46.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17670490372739543074', time=2024-09-12T03:28:14.210772+0000, chain.objs.size()=1 2024-09-12T02:06:46.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.504__shadow:xY.qSzc8-FZgL.PAZY7yve8r0PrFDvj_.feVFZUiV-D7oBnX7pKoH2iGI2T3glrn_0 2024-09-12T02:06:46.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5930623930928846130', time=2024-09-12T03:28:14.908761+0000, chain.objs.size()=1 2024-09-12T02:06:46.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.504__shadow:xY.qSzc8-FZgL.PAZY7yve8r0PrFDvj_.feVFZUiV-D7oBnX7pKoH2iGI2T3glrn_0 2024-09-12T02:06:46.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4327543593402213435', time=2024-09-12T03:35:19.342029+0000, chain.objs.size()=3 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~99tWXayt9XOAbrUDklCGji61tSYwgqC.1 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__shadow_mymultipart.2~99tWXayt9XOAbrUDklCGji61tSYwgqC.1_1 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~99tWXayt9XOAbrUDklCGji61tSYwgqC.2 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1490819330429095252', time=2024-09-12T03:35:30.342487+0000, chain.objs.size()=3 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~kx_qIUiI9vT8AyFN9xcdRZzcNknivB8.1 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~kx_qIUiI9vT8AyFN9xcdRZzcNknivB8.2 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~kx_qIUiI9vT8AyFN9xcdRZzcNknivB8.3 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11198173578766268540', time=2024-09-12T03:35:34.771920+0000, chain.objs.size()=4 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~iwbKWG9nf0P3eSS9k6xnNVQgUpMhUXS.1 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__shadow_mymultipart.2~iwbKWG9nf0P3eSS9k6xnNVQgUpMhUXS.1_1 2024-09-12T02:06:46.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~iwbKWG9nf0P3eSS9k6xnNVQgUpMhUXS.2 2024-09-12T02:06:46.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__shadow_mymultipart.2~iwbKWG9nf0P3eSS9k6xnNVQgUpMhUXS.2_1 2024-09-12T02:06:46.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KoWNP395goGdd1zjJ9CJsZ-LeHki3L-', time=2024-09-12T03:36:29.444207+0000, chain.objs.size()=1 2024-09-12T02:06:46.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.535__multipart_mymultipart.2~KoWNP395goGdd1zjJ9CJsZ-LeHki3L-.1 2024-09-12T02:06:46.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9797939002193431067', time=2024-09-12T03:40:06.752921+0000, chain.objs.size()=1 2024-09-12T02:06:46.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:iCCortl8n0oK4GOVmaBLkfmv.Aoajdh_.EGbPaiUa8Jw922CyzVGbttC9Vpv7Ajt_0 2024-09-12T02:06:46.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8753791291978908444', time=2024-09-12T03:40:17.440778+0000, chain.objs.size()=1 2024-09-12T02:06:46.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.573__shadow:r3IgAAcrMcHP2u3fgg8ai37yZOmUq7b_.GZyd9oV7xFkMntIbnCpkFlgIAqKIHWT_0 2024-09-12T02:06:46.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15712881184728365577', time=2024-09-12T03:40:20.720716+0000, chain.objs.size()=1 2024-09-12T02:06:46.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.574__shadow_.3bozmnKsEjPYGYBmzZzgBMnJOn1Tv_U_0 2024-09-12T02:06:46.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9855376029985394250', time=2024-09-12T03:41:11.138849+0000, chain.objs.size()=1 2024-09-12T02:06:46.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:.S6cwL6E7Te0K4IvIrkazXVMeWhM6Nq_.p8x17Upm-3Ui6bDD2bvgUxwxsYdlwmL_0 2024-09-12T02:06:46.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11554755774694086459', time=2024-09-12T03:43:35.776855+0000, chain.objs.size()=1 2024-09-12T02:06:46.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.603__shadow_.OEOLaVgEZlnadqwRnJcVK4pCTm0vJIA_0 2024-09-12T02:06:46.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11296249832118258803', time=2024-09-12T03:43:47.593126+0000, chain.objs.size()=1 2024-09-12T02:06:46.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.608__shadow_.ulripc8P6P4IahJjQ4twSL9CColGr6L_0 2024-09-12T02:06:46.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2950415088757366579', time=2024-09-12T03:53:08.290531+0000, chain.objs.size()=1 2024-09-12T02:06:46.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.665__shadow_.cpOjwesXI9kpfcQFgPBd6x1b67Xaas7_0 2024-09-12T02:06:46.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12655183621993950339', time=2024-09-12T03:55:23.587655+0000, chain.objs.size()=1 2024-09-12T02:06:46.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.719__shadow_.PHk5-NqXPB94VENKZet0ee3LfnGLpyV_0 2024-09-12T02:06:46.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.162+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:46.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T02:06:46.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:46.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:46.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/61516' 2024-09-12T02:06:46.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1956108538317042050', time=2024-09-12T03:03:31.155791+0000, chain.objs.size()=3 2024-09-12T02:06:46.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__multipart_mymultipart-STANDARD.2~xS-qMZAmYR8LavroUCXLDSUYbWc02qj.1 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__multipart_mymultipart-STANDARD.2~xS-qMZAmYR8LavroUCXLDSUYbWc02qj.2 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__multipart_mymultipart-STANDARD.2~xS-qMZAmYR8LavroUCXLDSUYbWc02qj.3 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6619567618663833978', time=2024-09-12T03:10:49.531744+0000, chain.objs.size()=1 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.239__shadow_.gKskUDu6NNDE1t3Mqhjgq8QhiDs0Mk6_0 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11051766867783836124', time=2024-09-12T03:11:22.062637+0000, chain.objs.size()=1 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.251__shadow_.hCXhqsDiPdCxMSjyz8-XCzYXpnSJEfP_0 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17910183852713372271', time=2024-09-12T03:11:34.687650+0000, chain.objs.size()=1 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.256__shadow_.ljDMkOkwBTkeZHT-Uid9-rMAaZlGzWr_0 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8260875373384105423', time=2024-09-12T03:11:37.140452+0000, chain.objs.size()=1 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.257__shadow_.xBMSY_WXl6MVd-BXTXXKS2sAK6ZjioP_0 2024-09-12T02:06:46.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14109436577437375952', time=2024-09-12T03:11:41.852237+0000, chain.objs.size()=1 2024-09-12T02:06:46.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.259__shadow_.03JCIqbms6o0seV9CN4CdpVpQdxCQIx_0 2024-09-12T02:06:46.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.61024953436529146', time=2024-09-12T03:13:33.842493+0000, chain.objs.size()=1 2024-09-12T02:06:46.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6U9QKXFtkmqP9t2rCrN0Xk-UIvF2NxJ_0 2024-09-12T02:06:46.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13759572351342052692', time=2024-09-12T03:13:34.687700+0000, chain.objs.size()=1 2024-09-12T02:06:46.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.gmaorMNcGTKK3FK5f-kmEl7IiL4wrN3_0 2024-09-12T02:06:46.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7647838001175672105', time=2024-09-12T03:13:34.941937+0000, chain.objs.size()=1 2024-09-12T02:06:46.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.UsxQN-YQpGtBCSEtOKdujQKGRL8uDIf_0 2024-09-12T02:06:46.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1619497218275665692', time=2024-09-12T03:13:36.852020+0000, chain.objs.size()=1 2024-09-12T02:06:46.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aACMhtLn-bx4bWojXi-UBUiTFEuA5it_0 2024-09-12T02:06:46.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4281227229201764464', time=2024-09-12T03:13:39.107487+0000, chain.objs.size()=1 2024-09-12T02:06:46.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2ThH1FyFG787dst9LnUriuYfTDBQdRx_0 2024-09-12T02:06:46.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17041427523214674150', time=2024-09-12T03:13:39.531250+0000, chain.objs.size()=1 2024-09-12T02:06:46.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.lYMiF3036kIwuv2hO8GZhl5JH1svr0u_0 2024-09-12T02:06:46.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16048638332169526667', time=2024-09-12T03:13:41.385809+0000, chain.objs.size()=1 2024-09-12T02:06:46.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.lpO8Ksz1efajOXCvs0HterkPI4eRcoT_0 2024-09-12T02:06:46.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6904861673019570939', time=2024-09-12T03:13:42.601228+0000, chain.objs.size()=1 2024-09-12T02:06:46.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qjSzKU-8td7HtfleEl9lYRivqIZEiSa_0 2024-09-12T02:06:46.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2781610152061325912', time=2024-09-12T03:13:42.905495+0000, chain.objs.size()=1 2024-09-12T02:06:46.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Xf_yJCjHOMIx0Rvfzm5DnybOhkjBXSk_0 2024-09-12T02:06:46.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5876720037454907874', time=2024-09-12T03:13:44.081235+0000, chain.objs.size()=1 2024-09-12T02:06:46.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Mp9xe-9LnUSeqlHrVctC81_1XtlBdr6_0 2024-09-12T02:06:46.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9395237436576735579', time=2024-09-12T03:13:45.003802+0000, chain.objs.size()=1 2024-09-12T02:06:46.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uu7vEgbTI_WjYU3bclU_2ySK2jAMcaT_0 2024-09-12T02:06:46.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5287396164120114388', time=2024-09-12T03:13:45.409425+0000, chain.objs.size()=1 2024-09-12T02:06:46.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jG7SFfJiLk3VX-SBT1UW7Rux58M2TtF_0 2024-09-12T02:06:46.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17709151400339682479', time=2024-09-12T03:13:48.772539+0000, chain.objs.size()=1 2024-09-12T02:06:46.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ZT99C-yrNh_JE46PqLnJ7bVQI8165-n_0 2024-09-12T02:06:46.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8259695016940033567', time=2024-09-12T03:13:49.452634+0000, chain.objs.size()=1 2024-09-12T02:06:46.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.M66b1ItHBjVEFuBGMI4hoBo6vp7--dx_0 2024-09-12T02:06:46.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5545964025576503393', time=2024-09-12T03:13:51.226037+0000, chain.objs.size()=1 2024-09-12T02:06:46.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vYYQjdMrP_XEsfoP0FO9FjoT5XABvip_0 2024-09-12T02:06:46.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9370267823885543410', time=2024-09-12T03:13:54.760377+0000, chain.objs.size()=1 2024-09-12T02:06:46.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.72hpOqLTuINQopgetiLiazL7arFiK_S_0 2024-09-12T02:06:46.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14482145844633093613', time=2024-09-12T03:13:55.475659+0000, chain.objs.size()=1 2024-09-12T02:06:46.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uErY6i-ChrM7Ml-uZhq5csd7JuL8Od8_0 2024-09-12T02:06:46.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4334819277692404425', time=2024-09-12T03:13:56.300205+0000, chain.objs.size()=1 2024-09-12T02:06:46.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Zrvx1c8Z-WzSgx6IS-X7y4nsziv3OTh_0 2024-09-12T02:06:46.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9162872690596787830', time=2024-09-12T03:13:56.646954+0000, chain.objs.size()=1 2024-09-12T02:06:46.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ZDMxvwT2yvjT-nlhviYoWOM_Tl0AuRq_0 2024-09-12T02:06:46.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2880934597101697395', time=2024-09-12T03:13:57.484905+0000, chain.objs.size()=1 2024-09-12T02:06:46.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.VdgPwqJvQqSbQmlgYHbeWvSLxxECkbH_0 2024-09-12T02:06:46.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12915286113044142610', time=2024-09-12T03:13:57.592432+0000, chain.objs.size()=1 2024-09-12T02:06:46.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qMip65-mijd_xqrKdjLcnpK7JCJt8-6_0 2024-09-12T02:06:46.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12087222919956877293', time=2024-09-12T03:14:01.708511+0000, chain.objs.size()=1 2024-09-12T02:06:46.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.IDCGYrb74PnaXXnA4HzTpJ2AJuyimRZ_0 2024-09-12T02:06:46.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17591321941747183541', time=2024-09-12T03:14:02.637284+0000, chain.objs.size()=1 2024-09-12T02:06:46.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.iTg6xSA0QbtWbfqOf2NaJKcFfKnQn1W_0 2024-09-12T02:06:46.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15326137286953801767', time=2024-09-12T03:14:03.177613+0000, chain.objs.size()=1 2024-09-12T02:06:46.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CEyFOzvWafl3dE_bV70615D5CNk_Irp_0 2024-09-12T02:06:46.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17461173602357847740', time=2024-09-12T03:14:04.064685+0000, chain.objs.size()=1 2024-09-12T02:06:46.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.iogZiGtLQ436BvkeXu-kO6DEBuN6N1l_0 2024-09-12T02:06:46.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4034493061617331967', time=2024-09-12T03:14:04.246806+0000, chain.objs.size()=1 2024-09-12T02:06:46.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.A08VqlB7WmXDEhyztwgdA3zKWa7KmNk_0 2024-09-12T02:06:46.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3406366672615053171', time=2024-09-12T03:14:04.453532+0000, chain.objs.size()=1 2024-09-12T02:06:46.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.186+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.VRCMwuj5T2WOkPnr2iBElRgXPUMJE8f_0 2024-09-12T02:06:46.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8064134249690909897', time=2024-09-12T03:14:04.853644+0000, chain.objs.size()=1 2024-09-12T02:06:46.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5Fz4EeecXz44K0lYWq0DEdskY9-E1bM_0 2024-09-12T02:06:46.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9597208469055962610', time=2024-09-12T03:14:04.969679+0000, chain.objs.size()=1 2024-09-12T02:06:46.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.VhT3OZerO4oi9B4z1gcd4sF4mwc7zAX_0 2024-09-12T02:06:46.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4938373549894890412', time=2024-09-12T03:14:24.604993+0000, chain.objs.size()=1 2024-09-12T02:06:46.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.271__shadow_.x9tZXrURREdrfbapkPEmPpboO2cJ9Fx_0 2024-09-12T02:06:46.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10574694574019591410', time=2024-09-12T03:15:23.379448+0000, chain.objs.size()=1 2024-09-12T02:06:46.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.EoAtYnmpl6ANTasBYNEaJI39eoz7ayR_0 2024-09-12T02:06:46.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9644418025939874665', time=2024-09-12T03:15:23.447934+0000, chain.objs.size()=1 2024-09-12T02:06:46.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.WrZoh1eiqcVboIjBxIehT_A7fSNWK2K_0 2024-09-12T02:06:46.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10622745897393618558', time=2024-09-12T03:15:23.763844+0000, chain.objs.size()=1 2024-09-12T02:06:46.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.cT_gTT474JN5T7-0QyvScEMXpfWSBcq_0 2024-09-12T02:06:46.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.639363238810818473', time=2024-09-12T03:15:55.189889+0000, chain.objs.size()=1 2024-09-12T02:06:46.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.304__shadow_.9zP_XB2ithZCVweXA_5HR4grlvsZMZk_0 2024-09-12T02:06:46.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11243913476535065585', time=2024-09-12T03:18:36.388185+0000, chain.objs.size()=1 2024-09-12T02:06:46.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.aGWKbaApWVALxSUtsv5p7yi_7S493MB_0 2024-09-12T02:06:46.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16060917436962973064', time=2024-09-12T03:18:36.787072+0000, chain.objs.size()=1 2024-09-12T02:06:46.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wsVCTaNONObqnpV-Oeo-JsofHQHLrkG_0 2024-09-12T02:06:46.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13506100317333411684', time=2024-09-12T03:18:37.423054+0000, chain.objs.size()=1 2024-09-12T02:06:46.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.A5xFCEoI_novw660ISHxlwrvl4z0YSw_0 2024-09-12T02:06:46.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12002318530286688199', time=2024-09-12T03:18:39.280855+0000, chain.objs.size()=1 2024-09-12T02:06:46.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UYmbzfiE-FUpP2bcXJZyx8nNn56tpCY_0 2024-09-12T02:06:46.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14109714790416079814', time=2024-09-12T03:18:39.578516+0000, chain.objs.size()=1 2024-09-12T02:06:46.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GpjIXdbnHQR1CVHRoaRGyC3pIOUFbFy_0 2024-09-12T02:06:46.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18376724037597787830', time=2024-09-12T03:18:39.580323+0000, chain.objs.size()=1 2024-09-12T02:06:46.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GuLf-sdV5Jc0gPwn3yfjQNpI_QHHrfu_0 2024-09-12T02:06:46.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1863696888645312711', time=2024-09-12T03:18:41.185375+0000, chain.objs.size()=1 2024-09-12T02:06:46.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yxzpSNHNK2mzT2uI5H0Va1pxn25siJd_0 2024-09-12T02:06:46.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10698200350907322387', time=2024-09-12T03:18:42.459065+0000, chain.objs.size()=1 2024-09-12T02:06:46.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.0Jv5SNkuOKAoxPY8LXHup3vKmyPJ4EP_0 2024-09-12T02:06:46.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4150701337757753121', time=2024-09-12T03:18:42.660881+0000, chain.objs.size()=1 2024-09-12T02:06:46.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UkRh2xuhkLXGMiLTtTz6uTTaFl6B4U8_0 2024-09-12T02:06:46.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.751245422533412197', time=2024-09-12T03:18:45.127759+0000, chain.objs.size()=1 2024-09-12T02:06:46.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.dTWlh5N6K5jTKoezcRsBMLQLxtb8KBt_0 2024-09-12T02:06:46.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2916488064843617401', time=2024-09-12T03:18:45.129436+0000, chain.objs.size()=1 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7XWNeQsLCAnE9j7y3CxOgq7_RAHPNLP_0 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4445108041848793555', time=2024-09-12T03:18:47.791251+0000, chain.objs.size()=1 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LYgvzQ2l_bdnwWRkdkwE_XjKKJk7BPO_0 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17999251345959490648', time=2024-09-12T03:18:49.777260+0000, chain.objs.size()=1 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.cfneuuhvRSM3uYpUL8infP3XWxy4v2h_0 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3937310449776399465', time=2024-09-12T03:18:50.466959+0000, chain.objs.size()=1 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xLpV_Fw9QO0rMWDG1iWPP2caIyT9oDI_0 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2308417238408144221', time=2024-09-12T03:18:51.845248+0000, chain.objs.size()=1 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hjRin95v_4AHJAl5yealafcbbTGoOzg_0 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9587406561870214745', time=2024-09-12T03:18:51.986519+0000, chain.objs.size()=1 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6_XLGY4tGnx6-p8ayr7bl9DCmqo-jwy_0 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15423541011883893314', time=2024-09-12T03:18:52.292631+0000, chain.objs.size()=1 2024-09-12T02:06:46.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2lfMzkvnmq7kVVnfemcy5lBS9HaBJd0_0 2024-09-12T02:06:46.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2936195508996973099', time=2024-09-12T03:18:52.294695+0000, chain.objs.size()=1 2024-09-12T02:06:46.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yEddH52Xk7Xi5wbxInSc7jRHCH5hdd5_0 2024-09-12T02:06:46.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7254957257928697700', time=2024-09-12T03:18:53.318267+0000, chain.objs.size()=1 2024-09-12T02:06:46.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GW6pD8_y_wd8NDXopv0vgrzrd1p4S37_0 2024-09-12T02:06:46.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14084199094129661569', time=2024-09-12T03:18:54.332863+0000, chain.objs.size()=1 2024-09-12T02:06:46.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3uKc-JQCGlwO5C6yYkR2ZNAaWo8xNHQ_0 2024-09-12T02:06:46.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7819030584710504398', time=2024-09-12T03:18:55.183611+0000, chain.objs.size()=1 2024-09-12T02:06:46.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.m0zD7FXXGszUZTvRh8SduBhz3gyrLv1_0 2024-09-12T02:06:46.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18014538967890230472', time=2024-09-12T03:18:55.185490+0000, chain.objs.size()=1 2024-09-12T02:06:46.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jGakWHbEFfkP30a6V48AEznOY_bEy_E_0 2024-09-12T02:06:46.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8881646057934296737', time=2024-09-12T03:18:57.621771+0000, chain.objs.size()=1 2024-09-12T02:06:46.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.bBVNg7fBHpFhu-quuv5ihKLqF99vegX_0 2024-09-12T02:06:46.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1702035771121630216', time=2024-09-12T03:18:59.541663+0000, chain.objs.size()=1 2024-09-12T02:06:46.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ZNUd-KRFB83Yfr1xSfz73RDxfyc30_g_0 2024-09-12T02:06:46.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17303619229408205996', time=2024-09-12T03:19:00.162222+0000, chain.objs.size()=1 2024-09-12T02:06:46.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.JFu8_63irzR8pi3Y7WBxvWYQ86zVzD0_0 2024-09-12T02:06:46.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16523453757577549743', time=2024-09-12T03:19:01.943348+0000, chain.objs.size()=1 2024-09-12T02:06:46.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UWVhRhPhDvAARDZH9mZGaMYJGOf2FaM_0 2024-09-12T02:06:46.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11113351796996004997', time=2024-09-12T03:19:02.806322+0000, chain.objs.size()=1 2024-09-12T02:06:46.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.JXDpNVh0rw0FhYy8yQWsM7jUBkcWpav_0 2024-09-12T02:06:46.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2829307328988131571', time=2024-09-12T03:19:03.036898+0000, chain.objs.size()=1 2024-09-12T02:06:46.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Cqh9Y5DAdb33GLQwnxZ8pOmLftAk0L4_0 2024-09-12T02:06:46.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.218+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7928874378183013310', time=2024-09-12T03:19:05.694430+0000, chain.objs.size()=1 2024-09-12T02:06:46.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.218+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yGUqop5N4VosRRcZKh3Mkk0Mo-qNn0n_0 2024-09-12T02:06:46.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12193201000011189268', time=2024-09-12T03:19:06.089482+0000, chain.objs.size()=1 2024-09-12T02:06:46.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Bbnhz1BDLLu5tzmWdgJuZrRvjldCmAb_0 2024-09-12T02:06:46.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.183727943114867433', time=2024-09-12T03:19:07.785776+0000, chain.objs.size()=1 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.XUojxzFuSd2l9xcEH9uE1Z_4d8GQHyw_0 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7375372309214277151', time=2024-09-12T03:20:55.394716+0000, chain.objs.size()=1 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Ht_0c1ZUkG9X41DrXq8fGuyLc81yk2n_0 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11504367586424462970', time=2024-09-12T03:20:55.640645+0000, chain.objs.size()=1 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.O5_-My2ns912fqEKqOXpQcOnzFYMCjv_0 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10603183360128346747', time=2024-09-12T03:20:55.937275+0000, chain.objs.size()=1 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DeLigwBzjev2ugiPQ_eO26WFTVAFxQY_0 2024-09-12T02:06:46.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7502974900633954207', time=2024-09-12T03:20:56.756733+0000, chain.objs.size()=1 2024-09-12T02:06:46.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YBpD6fvL3O-FG3Lw1iCIOEXSugHEwgj_0 2024-09-12T02:06:46.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13151940364476683221', time=2024-09-12T03:20:56.759515+0000, chain.objs.size()=1 2024-09-12T02:06:46.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XHmEgR4hGly9OfBMHtYKv6ahxckp5J7_0 2024-09-12T02:06:46.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.458272048292323372', time=2024-09-12T03:20:57.500549+0000, chain.objs.size()=1 2024-09-12T02:06:46.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4AVy0NS63KhPvH-8DVfYqmC_1zP0oUU_0 2024-09-12T02:06:46.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4986030145505635730', time=2024-09-12T03:21:01.562275+0000, chain.objs.size()=1 2024-09-12T02:06:46.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dsONFVDHUzjZZLFpKWiALtxu6bprqmk_0 2024-09-12T02:06:46.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3416422128736785387', time=2024-09-12T03:21:01.865124+0000, chain.objs.size()=1 2024-09-12T02:06:46.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hvV-Gs6eKKRKZgT4i3R90Ts5zV2SnxD_0 2024-09-12T02:06:46.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17715916535724659990', time=2024-09-12T03:21:04.286855+0000, chain.objs.size()=1 2024-09-12T02:06:46.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.q5ixTIcKK1RE8c8M9mGrh1sUVFrAB91_0 2024-09-12T02:06:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3784435123829072031', time=2024-09-12T03:21:05.145774+0000, chain.objs.size()=1 2024-09-12T02:06:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7XscRlFjtnzhVrHH-dfHD6eXv4Oj1Aq_0 2024-09-12T02:06:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14275610843258343989', time=2024-09-12T03:21:05.822451+0000, chain.objs.size()=1 2024-09-12T02:06:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vwAqyaGmRcXJ__8V5o-QiEDM7rgZgbZ_0 2024-09-12T02:06:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9551852688250709122', time=2024-09-12T03:21:07.933388+0000, chain.objs.size()=1 2024-09-12T02:06:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Ihl1KtbjHiVUcfjmRf2bPtqkVm2Hwtt_0 2024-09-12T02:06:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4059447500070323238', time=2024-09-12T03:21:08.346936+0000, chain.objs.size()=1 2024-09-12T02:06:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ehnL4hWrWwrMTgf2t7xwvWuxquVEvVO_0 2024-09-12T02:06:46.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8489681539313160647', time=2024-09-12T03:21:09.623160+0000, chain.objs.size()=1 2024-09-12T02:06:46.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lH7fFoGCo0XiOrpi6kIEQp1D8Rc-ypC_0 2024-09-12T02:06:46.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7764911563231169608', time=2024-09-12T03:21:09.933049+0000, chain.objs.size()=1 2024-09-12T02:06:46.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.N9_SYR08Xz3tZYPPFXyZ30UcPTt2kUB_0 2024-09-12T02:06:46.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3659244409495797800', time=2024-09-12T03:21:11.672464+0000, chain.objs.size()=1 2024-09-12T02:06:46.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3pk0yy8Ho_5K8vEXGnH18_08xDcgWCL_0 2024-09-12T02:06:46.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17561494090320877836', time=2024-09-12T03:21:12.183196+0000, chain.objs.size()=1 2024-09-12T02:06:46.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CdMKmlz0EnSnNg4VfAEkKGXA1j4VNu__0 2024-09-12T02:06:46.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10963884330927759929', time=2024-09-12T03:21:12.389104+0000, chain.objs.size()=1 2024-09-12T02:06:46.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rI-19MYx8EUfMulyKqC9seRjxYpfPfj_0 2024-09-12T02:06:46.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15470193618820287113', time=2024-09-12T03:21:12.443919+0000, chain.objs.size()=1 2024-09-12T02:06:46.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.meWODw3LsyWtcUgWb4Z6gqOZfdNyuxZ_0 2024-09-12T02:06:46.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7926939027152147085', time=2024-09-12T03:21:12.761071+0000, chain.objs.size()=1 2024-09-12T02:06:46.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fZmoN9JWSZY6kKBj1Ji49c-NdImOWEv_0 2024-09-12T02:06:46.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9698461064558181409', time=2024-09-12T03:21:12.762861+0000, chain.objs.size()=1 2024-09-12T02:06:46.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7TO4H71iUsxvMiSNmTn5-ibAp7ZXi9A_0 2024-09-12T02:06:46.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6036458697540427150', time=2024-09-12T03:21:13.282688+0000, chain.objs.size()=1 2024-09-12T02:06:46.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.nfCBnyD3BN7jX796Fj9ZxU59QuTLbce_0 2024-09-12T02:06:46.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11674055478669324076', time=2024-09-12T03:21:13.457742+0000, chain.objs.size()=1 2024-09-12T02:06:46.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.am1y2-THXoJI4mmoh_LlDrDCQ5CPhGZ_0 2024-09-12T02:06:46.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4624292696497517592', time=2024-09-12T03:21:13.816990+0000, chain.objs.size()=1 2024-09-12T02:06:46.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.iwWtwXhvPNfJE-eJT7Tw2ZMt8Zzfv_2_0 2024-09-12T02:06:46.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10844130668979229483', time=2024-09-12T03:21:14.215964+0000, chain.objs.size()=1 2024-09-12T02:06:46.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.uYGvn4EdNwCohDt6Q3xjdX8SauhnKbd_0 2024-09-12T02:06:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14750086222707119974', time=2024-09-12T03:21:14.242845+0000, chain.objs.size()=1 2024-09-12T02:06:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.R2VCKmiuN2v0G3YKeHcOmMl_OBVgg5F_0 2024-09-12T02:06:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4501045345519299728', time=2024-09-12T03:21:15.184703+0000, chain.objs.size()=1 2024-09-12T02:06:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hEUDcyJzhYtbfyzIxSoqq8cbkAaF-Qw_0 2024-09-12T02:06:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17970418867435719026', time=2024-09-12T03:21:17.150537+0000, chain.objs.size()=1 2024-09-12T02:06:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IVADJ0lHRGYmALHzKPSlR6K8edQdfSH_0 2024-09-12T02:06:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9415265332895205196', time=2024-09-12T03:21:18.073583+0000, chain.objs.size()=1 2024-09-12T02:06:46.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1j73pdnjEwz_8KLcPP0v9i-LcZOxxRt_0 2024-09-12T02:06:46.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.246+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/61516 2024-09-12T02:06:46.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T02:06:46.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13760883645183744864', time=2024-09-12T03:21:19.228929+0000, chain.objs.size()=1 2024-09-12T02:06:46.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rw4Pm7tZH4hmKxovRfQJJ7ZtRTtWwj-_0 2024-09-12T02:06:46.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16486500856132845086', time=2024-09-12T03:21:19.590405+0000, chain.objs.size()=1 2024-09-12T02:06:46.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qajpg6cGdUrH1ondC9MjK58u0LMN9ZY_0 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4914652148219583540', time=2024-09-12T03:21:19.730855+0000, chain.objs.size()=1 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.nWxWL52R7But6pF4Vzdv-YKtcf1w0JR_0 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4381225647931856338', time=2024-09-12T03:21:20.558156+0000, chain.objs.size()=1 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yUVU6z2vWhY2jwvo1bK2ZoBbal7Y3_y_0 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.688722185948263616', time=2024-09-12T03:21:21.537655+0000, chain.objs.size()=1 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xsqzYnyvCfwBW5DBkZG-t9PyqPqFLqq_0 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12329969819154971694', time=2024-09-12T03:21:22.062148+0000, chain.objs.size()=1 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.k2vOmYjIX6YnK1oJXV5DTKT6b2PKWXO_0 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1070015553625240613', time=2024-09-12T03:21:22.268070+0000, chain.objs.size()=1 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qoMQU7RqsU9RYOmlE9bNVLU9R7j-fcc_0 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.878485015509000498', time=2024-09-12T03:21:22.313740+0000, chain.objs.size()=1 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lRQXXjk8LuoxUXqt_xlrNQwKAce6mf7_0 2024-09-12T02:06:46.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16400203889728817770', time=2024-09-12T03:21:24.846985+0000, chain.objs.size()=1 2024-09-12T02:06:46.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9qZ7zT0WMf8y3xa7HV_0EJFWWSyzT7V_0 2024-09-12T02:06:46.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3035301003481141708', time=2024-09-12T03:21:25.365463+0000, chain.objs.size()=1 2024-09-12T02:06:46.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pA-JmW0MXCqXUqmv8yLZpyBrPWUB5EF_0 2024-09-12T02:06:46.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13705238195414820009', time=2024-09-12T03:21:42.480846+0000, chain.objs.size()=1 2024-09-12T02:06:46.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.333__shadow_.o3B9HYTj2N0g4VLkmm_nTy8VZQufMqY_0 2024-09-12T02:06:46.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6548302307169052057', time=2024-09-12T03:22:06.031783+0000, chain.objs.size()=1 2024-09-12T02:06:46.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.343__shadow_.e6MW5eIi-7xVL1FKkcOwxljdEae7KOq_0 2024-09-12T02:06:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3567519957821561620', time=2024-09-12T03:25:42.061706+0000, chain.objs.size()=1 2024-09-12T02:06:46.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.442__shadow_.ix4gzvAKULCe6PT7cRMXTWONNNJIAe8_0 2024-09-12T02:06:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.536634743557168246', time=2024-09-12T03:25:58.975086+0000, chain.objs.size()=1 2024-09-12T02:06:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.448__shadow_.2aUhH5nzTKTnKESCmM8R7FpvzUbvVXY_0 2024-09-12T02:06:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.970369483884507873', time=2024-09-12T03:26:14.823163+0000, chain.objs.size()=1 2024-09-12T02:06:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.455__shadow_.SYU0kD5IaGHhaXXH6Cplzv2WpOLx2wM_0 2024-09-12T02:06:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12009198041545792490', time=2024-09-12T03:27:50.679798+0000, chain.objs.size()=1 2024-09-12T02:06:46.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.494__shadow_.3p3m_02QFsjrNvQ8p1wYx8Ykha_u7nr_0 2024-09-12T02:06:46.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4749901664461536268', time=2024-09-12T03:28:55.425772+0000, chain.objs.size()=6 2024-09-12T02:06:46.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.1 2024-09-12T02:06:46.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.2 2024-09-12T02:06:46.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.3 2024-09-12T02:06:46.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.4 2024-09-12T02:06:46.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.5 2024-09-12T02:06:46.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.6 2024-09-12T02:06:46.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16609045456915255552', time=2024-09-12T03:32:46.077776+0000, chain.objs.size()=6 2024-09-12T02:06:46.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~S2XoaQfJ2ox2ARcZdR7bIEJFf_XtR-k.1 2024-09-12T02:06:46.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.L8eleu17e60uXXOvfFnkZ5iv9ZGaboVb.2 2024-09-12T02:06:46.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~S2XoaQfJ2ox2ARcZdR7bIEJFf_XtR-k.3 2024-09-12T02:06:46.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~S2XoaQfJ2ox2ARcZdR7bIEJFf_XtR-k.4 2024-09-12T02:06:46.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~S2XoaQfJ2ox2ARcZdR7bIEJFf_XtR-k.5 2024-09-12T02:06:46.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~S2XoaQfJ2ox2ARcZdR7bIEJFf_XtR-k.6 2024-09-12T02:06:46.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.994131058850805822', time=2024-09-12T03:39:51.234656+0000, chain.objs.size()=1 2024-09-12T02:06:46.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:6J7EonbNvjztM4d83w.hhk2lgsVaMQQ_.LLGmnNwWbRZwumGD3VAM3x-8dQdmAJF_0 2024-09-12T02:06:46.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4505777534567823976', time=2024-09-12T03:40:04.019189+0000, chain.objs.size()=1 2024-09-12T02:06:46.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:QMzyykvwiGelKGORiHAsR7JD.ulsDvS_.HcyDzZA50-qIVnKsKJ6IbTPRSlu6-yP_0 2024-09-12T02:06:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2697966370927137284', time=2024-09-12T03:41:20.010925+0000, chain.objs.size()=1 2024-09-12T02:06:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:tyWPNGAPaQZuD-eg8BC.D4VPZHFD4FV_.ZGPwm2odvz6LjcI3E3DKGW9niPTlgXq_0 2024-09-12T02:06:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.60620117388598239', time=2024-09-12T03:43:23.792397+0000, chain.objs.size()=1 2024-09-12T02:06:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.597__shadow_.1UcZdG688ItT_wyBLjI5Eo9Oz6dpTc6_0 2024-09-12T02:06:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7578566519296592052', time=2024-09-12T03:47:38.576458+0000, chain.objs.size()=1 2024-09-12T02:06:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.618__shadow_.EkAMPcxuroCBqZV6ifQB5oVmOakymgF_0 2024-09-12T02:06:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.874157462790865028', time=2024-09-12T03:54:01.014255+0000, chain.objs.size()=1 2024-09-12T02:06:46.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.691__shadow:3vUoNIEClJN8JTPCUuiKaPFloe-kVMQ_.m-GHBOP6vRN6aQ72GuAp6mQuJRG7EcA_0 2024-09-12T02:06:46.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9697536018000498976', time=2024-09-12T03:54:14.092710+0000, chain.objs.size()=1 2024-09-12T02:06:46.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.697__shadow:Qf4V9a8XN.1bkZPdEAQj8ZKgBax1vVe_.uDM7jr1DloIMZZ5YwZS7EKSYMY1bHUt_0 2024-09-12T02:06:46.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14368866174990609303', time=2024-09-12T03:54:40.142386+0000, chain.objs.size()=1 2024-09-12T02:06:46.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.708__shadow:7EiK-wSsF5QWboWaXt5Jx2RJ6FKEO.k_.sRmPm5J1URbLoIeK9PFcCNkdTHG4qqd_0 2024-09-12T02:06:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:46.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T02:06:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47287' 2024-09-12T02:06:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_hSQL7_SvtG0A3G2CWmxb0sMA9azZZFV', time=2024-09-12T03:03:47.056101+0000, chain.objs.size()=3 2024-09-12T02:06:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.MZVMhSdovxAQAJVQgfIQRPSoWZCvnYO_0 2024-09-12T02:06:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.MZVMhSdovxAQAJVQgfIQRPSoWZCvnYO_1 2024-09-12T02:06:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.MZVMhSdovxAQAJVQgfIQRPSoWZCvnYO_2 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_zw7-BchMI_a7B_VIKxAhxoLSZpJlx9d', time=2024-09-12T03:03:57.951907+0000, chain.objs.size()=3 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.taPil4BN7PTOHFFsnfDkmYgfenXacxC_0 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.taPil4BN7PTOHFFsnfDkmYgfenXacxC_1 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.taPil4BN7PTOHFFsnfDkmYgfenXacxC_2 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6064851930616509446', time=2024-09-12T03:05:38.700027+0000, chain.objs.size()=1 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.184__shadow_.mRhFM9FkKiJ589ZtytRCITwKX4iMAAy_0 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18007700637099812909', time=2024-09-12T03:13:36.733262+0000, chain.objs.size()=1 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ttCkYGAN5SaS3O4lAucxQWNG8JYqZGI_0 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8587010823287532596', time=2024-09-12T03:13:37.048656+0000, chain.objs.size()=1 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ZK2eqnVJFbNoIsy0ID8cKNlmcjCFfXN_0 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6803345755306789380', time=2024-09-12T03:13:41.146157+0000, chain.objs.size()=1 2024-09-12T02:06:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ssBItnBSO3i6WTqV-jUaUAeyh82e0Xk_0 2024-09-12T02:06:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3382292829607867686', time=2024-09-12T03:13:43.919009+0000, chain.objs.size()=1 2024-09-12T02:06:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2kg34YCz2o6oe7wKvwsWb3omrnTF5z6_0 2024-09-12T02:06:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16894387935258707210', time=2024-09-12T03:13:44.187134+0000, chain.objs.size()=1 2024-09-12T02:06:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.oDLa_vCt_EAvyXsmjT-5ac2PdYcWaZe_0 2024-09-12T02:06:46.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15691886812273474251', time=2024-09-12T03:13:44.275688+0000, chain.objs.size()=1 2024-09-12T02:06:46.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.sw9dK8Vr5BSnHSZDdZUkVhwWykVuql9_0 2024-09-12T02:06:46.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7309379390506988434', time=2024-09-12T03:13:47.020787+0000, chain.objs.size()=1 2024-09-12T02:06:46.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.i23FyM8HeMCTxvonf_Rn8O8bPgVjhiq_0 2024-09-12T02:06:46.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10584536315191241972', time=2024-09-12T03:13:47.408423+0000, chain.objs.size()=1 2024-09-12T02:06:46.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xDo8rfj0aIwYRbMVdb5SIUx__uWWeJt_0 2024-09-12T02:06:46.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9927669395044587202', time=2024-09-12T03:13:51.278892+0000, chain.objs.size()=1 2024-09-12T02:06:46.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.x-3_IZ0S-5Lrxjl0tlh4H4Acn1mDM9k_0 2024-09-12T02:06:46.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5086316479621461314', time=2024-09-12T03:13:51.845821+0000, chain.objs.size()=1 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.lhz5yNxREi5rdTf0m-bg9Eazm5qj3jM_0 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.229346322423031020', time=2024-09-12T03:13:53.216700+0000, chain.objs.size()=1 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Z0438WBThHcgZd6fvcarCrdpT8loG73_0 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10276360772357422293', time=2024-09-12T03:13:55.203975+0000, chain.objs.size()=1 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vmSWb1S8zKjGKm00YbBVvnZwtTx5xCs_0 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1851925332698963758', time=2024-09-12T03:13:56.125644+0000, chain.objs.size()=1 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.PnfceFF2V41SM-hwKHfS7hWQu0a26or_0 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10138651386670166797', time=2024-09-12T03:13:59.177012+0000, chain.objs.size()=1 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hTBg-hVFvoSYKW5fIMB-Qo7VMlb5red_0 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7743014093820709156', time=2024-09-12T03:14:00.041610+0000, chain.objs.size()=1 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3FRO3wbYHiKuKV7NgcPlUJ08LmHfTlF_0 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14702676123640888161', time=2024-09-12T03:14:00.473595+0000, chain.objs.size()=1 2024-09-12T02:06:46.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.wm3qyzfawt03rBEECWdCuObRDkhA7jH_0 2024-09-12T02:06:46.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11963478171366220123', time=2024-09-12T03:14:00.553678+0000, chain.objs.size()=1 2024-09-12T02:06:46.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qB7gcM-jzZmRp9EkNC6TBKF5S915mn__0 2024-09-12T02:06:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12231896638876129674', time=2024-09-12T03:14:03.005906+0000, chain.objs.size()=1 2024-09-12T02:06:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.upejGFubZU-Z8bFggtaxYljUcjg6EaW_0 2024-09-12T02:06:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15697176153134542531', time=2024-09-12T03:14:03.094667+0000, chain.objs.size()=1 2024-09-12T02:06:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Ja0Y1uHSidn4lQMr8PjcqN_-lVSCPk__0 2024-09-12T02:06:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6076843433559271465', time=2024-09-12T03:14:03.902900+0000, chain.objs.size()=1 2024-09-12T02:06:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GFhlavG-fA6N8pE1-yl-rtnSPqetyOL_0 2024-09-12T02:06:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12148909939193081333', time=2024-09-12T03:14:03.904394+0000, chain.objs.size()=1 2024-09-12T02:06:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._HQqmMu9CBpllh8myT3_LPMALkUc99-_0 2024-09-12T02:06:46.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5220768560243909721', time=2024-09-12T03:14:10.242611+0000, chain.objs.size()=1 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.265__shadow_.hXZzgxnj9CpuN4TCNWFrYr3T5wZNT3k_0 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18161716822662880623', time=2024-09-12T03:14:24.605345+0000, chain.objs.size()=1 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.271__shadow_.wkQaKgM9vAY-DG4ca2j7Ikr-z-nZSGh_0 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1063968308314247343', time=2024-09-12T03:14:46.682760+0000, chain.objs.size()=1 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.280__shadow_.zcwaqB7spOKJhlpL5cwA6Z3YSrnAnOp_0 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5813789666996326870', time=2024-09-12T03:15:01.964278+0000, chain.objs.size()=1 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.286__shadow_.SJ_aNvhPJ3PM7Wj5XmbdM4BdeYegSp1_0 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9881505149038743292', time=2024-09-12T03:15:29.815884+0000, chain.objs.size()=1 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.l-k24HMnyIQDUSsaktdkLP83ybI4keR_0 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17183508844011927267', time=2024-09-12T03:15:52.655116+0000, chain.objs.size()=1 2024-09-12T02:06:46.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.303__shadow_.IAQOoEIj5RmyEy28hkvlNnefxkqjKVE_0 2024-09-12T02:06:46.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5651090127776063066', time=2024-09-12T03:16:42.973954+0000, chain.objs.size()=1 2024-09-12T02:06:46.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.320__shadow:1MVHHX-eJgw4ZjSFQx93A2nAC6OxnZ4_.Wg1LxERRugpJik34J3vMYMOAmuq7mnb_0 2024-09-12T02:06:46.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16974778343401418192', time=2024-09-12T03:18:36.497436+0000, chain.objs.size()=1 2024-09-12T02:06:46.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hpGIgbtfF6o0ovJrlDCyC_d-C_JLur8_0 2024-09-12T02:06:46.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7520343770481352976', time=2024-09-12T03:18:37.327251+0000, chain.objs.size()=1 2024-09-12T02:06:46.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4R_G7g2BVpYDUZc2YaqiScPJ6QQqtj0_0 2024-09-12T02:06:46.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15387917129749603085', time=2024-09-12T03:18:38.981704+0000, chain.objs.size()=1 2024-09-12T02:06:46.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.iRnXRw1Ba1sET3tqLFyw0_x7VmMK8dt_0 2024-09-12T02:06:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7285709584677565340', time=2024-09-12T03:18:39.596280+0000, chain.objs.size()=1 2024-09-12T02:06:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.A3R4nzxDWpHKNc8BMshfLOV3iD9Tq9F_0 2024-09-12T02:06:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8250759963344709547', time=2024-09-12T03:18:39.643313+0000, chain.objs.size()=1 2024-09-12T02:06:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.d6z8HxGy0R4wIkLpCuEyhpCiMZBr7GK_0 2024-09-12T02:06:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15657611489556237103', time=2024-09-12T03:18:40.716116+0000, chain.objs.size()=1 2024-09-12T02:06:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MAJo7j23hZILDY_ftHB_e-X0IT-7V6O_0 2024-09-12T02:06:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4932564853229234094', time=2024-09-12T03:18:40.722503+0000, chain.objs.size()=1 2024-09-12T02:06:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.t51r_Ya-w8gFDPg4EdogCoNdde0nRk8_0 2024-09-12T02:06:46.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15522241165657524561', time=2024-09-12T03:18:41.586827+0000, chain.objs.size()=1 2024-09-12T02:06:46.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ku5Kv1Ymstvzjw0REfWUf-ZiZG1JAlk_0 2024-09-12T02:06:46.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18321262851957748993', time=2024-09-12T03:18:41.764564+0000, chain.objs.size()=1 2024-09-12T02:06:46.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vTYmtp3tZov1DmuiEGfLrnz3VsCc7dY_0 2024-09-12T02:06:46.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1625131971699613110', time=2024-09-12T03:18:42.586532+0000, chain.objs.size()=1 2024-09-12T02:06:46.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.kaWqeo5Z8M-3TP7_AEvEKKDlpTyCClm_0 2024-09-12T02:06:46.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15486762544748892964', time=2024-09-12T03:18:45.397898+0000, chain.objs.size()=1 2024-09-12T02:06:46.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.bO2_3Q8DWYAD1CTxWv9_YddzoUTQybs_0 2024-09-12T02:06:46.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3934776431454215006', time=2024-09-12T03:18:45.650368+0000, chain.objs.size()=1 2024-09-12T02:06:46.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.V5iEy7w7AbBVIjiOO1iZ9NUYcbnwXSs_0 2024-09-12T02:06:46.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2816662826992590418', time=2024-09-12T03:18:45.765811+0000, chain.objs.size()=1 2024-09-12T02:06:46.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.a0rqUfTHUN4V95ZIgpEoe95Curn6U2R_0 2024-09-12T02:06:46.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14119133553455989331', time=2024-09-12T03:18:45.898723+0000, chain.objs.size()=1 2024-09-12T02:06:46.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2LqNj5fK3YnYBEAel8gFIpAbBPxsHWb_0 2024-09-12T02:06:46.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16387703354016145284', time=2024-09-12T03:18:51.506608+0000, chain.objs.size()=1 2024-09-12T02:06:46.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yr2J0rDuhAwbfLv_jHEKJ-NYTqKgHCi_0 2024-09-12T02:06:46.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9598782960553191268', time=2024-09-12T03:18:51.917367+0000, chain.objs.size()=1 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9WY75QQ5nPq1zT2tlkDGdWE_RYMtVmh_0 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1245044644572109043', time=2024-09-12T03:18:52.407104+0000, chain.objs.size()=1 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eWDKO1Amjf4iDFK0ow-X63MDXOcyCLl_0 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10478638362673832333', time=2024-09-12T03:18:54.385190+0000, chain.objs.size()=1 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-WHl6cMVaOZg8qFVZA1nBJagb50qVXo_0 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6717910681767139479', time=2024-09-12T03:18:56.135603+0000, chain.objs.size()=1 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-AxEehXmt_pbXvHnNSZSSr5-4q32h-T_0 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4315104420367501777', time=2024-09-12T03:18:56.550923+0000, chain.objs.size()=1 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LyRqSo6T5P5Gs_PSzQeiY3pKvDzrlCv_0 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16628991771839016152', time=2024-09-12T03:18:57.262167+0000, chain.objs.size()=1 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.a8y9xT1S2DknDrpwvRjiPbsvAmqzPhd_0 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7719095815746355797', time=2024-09-12T03:18:58.720155+0000, chain.objs.size()=1 2024-09-12T02:06:46.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.FThPxxiE7IjrOney5faUX6xQ4UhL8lJ_0 2024-09-12T02:06:46.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.928181083710075746', time=2024-09-12T03:18:59.140714+0000, chain.objs.size()=1 2024-09-12T02:06:46.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2XCOIcnxcwQHwZ2eymLl03gm1llKOvo_0 2024-09-12T02:06:46.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.322+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1452621986831783507', time=2024-09-12T03:18:59.467883+0000, chain.objs.size()=1 2024-09-12T02:06:46.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.322+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.maRTqEytxjHI-yGfFkFV-tv51odRRTL_0 2024-09-12T02:06:46.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.322+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7809730121028082904', time=2024-09-12T03:18:59.974914+0000, chain.objs.size()=1 2024-09-12T02:06:46.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.322+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.e26v7YJVNB-OYYi9JFN87zpqgoTsdBb_0 2024-09-12T02:06:46.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10054725851329027310', time=2024-09-12T03:19:02.502466+0000, chain.objs.size()=1 2024-09-12T02:06:46.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.S-mwZepJ88E_Afxny1h-hlXByclirEp_0 2024-09-12T02:06:46.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9829515762956274443', time=2024-09-12T03:19:04.209264+0000, chain.objs.size()=1 2024-09-12T02:06:46.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OQ8-WozYRbrFxnHxD4SARtX2jVSJyaZ_0 2024-09-12T02:06:46.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12204674289619604245', time=2024-09-12T03:19:04.369904+0000, chain.objs.size()=1 2024-09-12T02:06:46.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.JlJuJG5iDm8rpGf2LAAHG3lOfrS3ZkL_0 2024-09-12T02:06:46.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6391200000244820855', time=2024-09-12T03:19:04.567403+0000, chain.objs.size()=1 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.h-lS4mhYWdPda6D1U1Sbva9HRkpLqO2_0 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16852806697887385385', time=2024-09-12T03:19:05.304574+0000, chain.objs.size()=1 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MfkF0XBtTiKRz2WUz9O3gaJRMe0Atu4_0 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9424839244252842151', time=2024-09-12T03:19:05.307299+0000, chain.objs.size()=1 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yYqqE66ljJVrLvUq4Soq8xHWvuo-ubX_0 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6080042298694251065', time=2024-09-12T03:19:06.336059+0000, chain.objs.size()=1 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.EG2L8BWZGhaoi2HuEc-FvWoO64PvLnQ_0 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11047815320920050036', time=2024-09-12T03:19:06.433639+0000, chain.objs.size()=1 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.XBbaqTnCa_I4Zz_xYu1hpy3HYCfnNHu_0 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14130008420588120910', time=2024-09-12T03:19:06.629746+0000, chain.objs.size()=1 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.neHzVP9EsvTHnka2tM5ji5eN7LK_ekU_0 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11527770303327545548', time=2024-09-12T03:20:55.097680+0000, chain.objs.size()=1 2024-09-12T02:06:46.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vMwouEUXc6-1yV_xCkz8mMQQsecmAhY_0 2024-09-12T02:06:46.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9651737575074335439', time=2024-09-12T03:20:56.421335+0000, chain.objs.size()=1 2024-09-12T02:06:46.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.LoDw0bo6htwR0l6tVoz7sw0w6ujaI1U_0 2024-09-12T02:06:46.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.330+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9666742070545334937', time=2024-09-12T03:20:56.759291+0000, chain.objs.size()=1 2024-09-12T02:06:46.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.330+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.T7ByAmmtBD-h7JcOZL8BbecpfeyI2uj_0 2024-09-12T02:06:46.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3007724939424985843', time=2024-09-12T03:20:57.306223+0000, chain.objs.size()=1 2024-09-12T02:06:46.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0i9gg6gui8aM3fy8HJQzirrZbTa06V3_0 2024-09-12T02:06:46.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9333289760178014146', time=2024-09-12T03:20:59.713364+0000, chain.objs.size()=1 2024-09-12T02:06:46.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gzG2p69EAECnv7EMg_Lem8u-p7dLKe__0 2024-09-12T02:06:46.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13026628760900408261', time=2024-09-12T03:21:00.290853+0000, chain.objs.size()=1 2024-09-12T02:06:46.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.nTQZunKdBbU_SeEWMNOJnfs44Y8-S2C_0 2024-09-12T02:06:46.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1562141088973284278', time=2024-09-12T03:21:00.450489+0000, chain.objs.size()=1 2024-09-12T02:06:46.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.C4tk1_QJOHJTbYAqZQVqCl_xBSvoS5K_0 2024-09-12T02:06:46.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18239891560098077125', time=2024-09-12T03:21:01.338662+0000, chain.objs.size()=1 2024-09-12T02:06:46.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hdGsrjZCtaw_dBgTSNuXHMRK-rWgIni_0 2024-09-12T02:06:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10067099066034825526', time=2024-09-12T03:21:01.774680+0000, chain.objs.size()=1 2024-09-12T02:06:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kVI2BinmKTKQ7qpqzhYIOs135pz-ne5_0 2024-09-12T02:06:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15427088287492384440', time=2024-09-12T03:21:03.315617+0000, chain.objs.size()=1 2024-09-12T02:06:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8_xxpn-S_0SeWP0k6YsckauwnxER41W_0 2024-09-12T02:06:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13352473134297434908', time=2024-09-12T03:21:04.450861+0000, chain.objs.size()=1 2024-09-12T02:06:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.uLfcXQYzALG-trCFlIgGRvSw4Drf2-v_0 2024-09-12T02:06:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2286799912579311684', time=2024-09-12T03:21:04.995866+0000, chain.objs.size()=1 2024-09-12T02:06:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.s_BBF89POXsdZ37MyozMI5oxttDyjIU_0 2024-09-12T02:06:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9770523508893663271', time=2024-09-12T03:21:07.288109+0000, chain.objs.size()=1 2024-09-12T02:06:46.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.l_n36KFByXsDuV8XMCRSIEWehe1vB-C_0 2024-09-12T02:06:46.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11025033452840481535', time=2024-09-12T03:21:07.499741+0000, chain.objs.size()=1 2024-09-12T02:06:46.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.l9yZD30VMLXWYn_SJ6NOHP4iJ31Z9Jl_0 2024-09-12T02:06:46.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7739613707243220036', time=2024-09-12T03:21:07.501616+0000, chain.objs.size()=1 2024-09-12T02:06:46.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-EjPWCRhzEG4oOIzj95HemTM0auoc1K_0 2024-09-12T02:06:46.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1299179168857214040', time=2024-09-12T03:21:07.773389+0000, chain.objs.size()=1 2024-09-12T02:06:46.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.y9J9ii3RIKFA5Pn2LcG6C9kq_f5o12o_0 2024-09-12T02:06:46.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1275423475894673664', time=2024-09-12T03:21:08.427486+0000, chain.objs.size()=1 2024-09-12T02:06:46.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.c53UZEquyCjvCKcRvatC0Z-49Dl8r0u_0 2024-09-12T02:06:46.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5717501574994154212', time=2024-09-12T03:21:09.626631+0000, chain.objs.size()=1 2024-09-12T02:06:46.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.neXQAsoZNO6Vw9Ueh4g9Ce1X24VpkYQ_0 2024-09-12T02:06:46.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10559009116892397459', time=2024-09-12T03:21:09.714724+0000, chain.objs.size()=1 2024-09-12T02:06:46.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.M-GSNvawCDMbQGUmi6qR8pgxUbru5-s_0 2024-09-12T02:06:46.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14381879722791514859', time=2024-09-12T03:21:11.184302+0000, chain.objs.size()=1 2024-09-12T02:06:46.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DiLR82wKuKz53g8HzJ3lFcwpvzDXHL__0 2024-09-12T02:06:46.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10297982676657237432', time=2024-09-12T03:21:13.075313+0000, chain.objs.size()=1 2024-09-12T02:06:46.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._5od5B3DdPT_ESfmcOj0qFl3Fy66RZ5_0 2024-09-12T02:06:46.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9423286571360215973', time=2024-09-12T03:21:13.744266+0000, chain.objs.size()=1 2024-09-12T02:06:46.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ot-DjiGpyRBjr2-JUwkFKy4sFFZK6ag_0 2024-09-12T02:06:46.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13461196976218613948', time=2024-09-12T03:21:14.301899+0000, chain.objs.size()=1 2024-09-12T02:06:46.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3k8zuymyyMw1i9ey0gqh0rF0JF117SM_0 2024-09-12T02:06:46.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11260472053659005235', time=2024-09-12T03:21:14.378779+0000, chain.objs.size()=1 2024-09-12T02:06:46.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.QQGSj6LjxEW5FtE029F2p--EVILEhTJ_0 2024-09-12T02:06:46.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13257815564226793325', time=2024-09-12T03:21:16.548201+0000, chain.objs.size()=1 2024-09-12T02:06:46.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.342+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.JDS8OvljWu-s62KcLqm98YsM-BGW9Rn_0 2024-09-12T02:06:46.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6737462883112731001', time=2024-09-12T03:21:16.651395+0000, chain.objs.size()=1 2024-09-12T02:06:46.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.WMUzs87wsSZTbFpT7Zy4E-nNSAAAjW6_0 2024-09-12T02:06:46.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14835544646019212150', time=2024-09-12T03:21:16.942283+0000, chain.objs.size()=1 2024-09-12T02:06:46.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.doxB31FeH3-Gs3QsO-EwxWXvwpj8hLT_0 2024-09-12T02:06:46.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8986364044852733772', time=2024-09-12T03:21:17.356226+0000, chain.objs.size()=1 2024-09-12T02:06:46.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pLgLQSbOMl1qZCbrpcAt7s2big3uXep_0 2024-09-12T02:06:46.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9388872101351126690', time=2024-09-12T03:21:18.173102+0000, chain.objs.size()=1 2024-09-12T02:06:46.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.HYClxdHUb3XHD2XOfle7mzr6nygimlA_0 2024-09-12T02:06:46.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13259179602827111630', time=2024-09-12T03:21:20.453339+0000, chain.objs.size()=1 2024-09-12T02:06:46.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.eeLY0hns39ULai4t-YfpZUnTIy2CMWx_0 2024-09-12T02:06:46.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17362454499040202415', time=2024-09-12T03:21:20.947069+0000, chain.objs.size()=1 2024-09-12T02:06:46.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2adU8AHTbUEw6G2MTpzwyS0fM17Ggq1_0 2024-09-12T02:06:46.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14131975180960629519', time=2024-09-12T03:21:22.032423+0000, chain.objs.size()=1 2024-09-12T02:06:46.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.phyHah5lZdp6veiF0V9wkK-QWwf6QZ1_0 2024-09-12T02:06:46.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11778747809399832314', time=2024-09-12T03:21:23.711730+0000, chain.objs.size()=1 2024-09-12T02:06:46.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.H6FO00R8ucrLQK1V02rkAVHAa-ah11M_0 2024-09-12T02:06:46.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14300669845655892283', time=2024-09-12T03:21:25.505601+0000, chain.objs.size()=1 2024-09-12T02:06:46.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Lq3Ald6sTisCfvowHVv5gBAaAIGVosX_0 2024-09-12T02:06:46.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3824783547762756569', time=2024-09-12T03:24:24.952000+0000, chain.objs.size()=1 2024-09-12T02:06:46.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.408__shadow_.Qz4rgES9VXyFFp_jogGUg2nbCkavw3u_0 2024-09-12T02:06:46.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47287 2024-09-12T02:06:46.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T02:06:46.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1339636793188950434', time=2024-09-12T03:25:37.289682+0000, chain.objs.size()=1 2024-09-12T02:06:46.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.440__shadow_.VchMMR88TWVsRdjnc_34TDTiC_bHUs3_0 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3518397888574100995', time=2024-09-12T03:26:08.200895+0000, chain.objs.size()=1 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.452__shadow_.sXbJKUZqX5KGWLeUUHxfD53NHiqeb2w_0 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8545592469530586721', time=2024-09-12T03:28:00.737798+0000, chain.objs.size()=1 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.498__shadow_._scEaAyWnlSluvXGdND4ahHkcrAOpPY_0 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16982221880622033374', time=2024-09-12T03:28:01.345922+0000, chain.objs.size()=1 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.499__shadow_.A6yl8x3ouUOs-8rH8Ag-pMGQbfnByDV_0 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10043444763011172639', time=2024-09-12T03:28:04.785053+0000, chain.objs.size()=1 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.500__shadow_.fjuNkRp75iyyC7un9rIr2KpTetl1JX3_0 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~mx_BZiysMXgNdfxx5vzfna-p7AzmjSL', time=2024-09-12T03:33:25.707905+0000, chain.objs.size()=1 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~mx_BZiysMXgNdfxx5vzfna-p7AzmjSL.2 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~mx_BZiysMXgNdfxx5vzfna-p7AzmjSL', time=2024-09-12T03:33:25.718849+0000, chain.objs.size()=1 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~mx_BZiysMXgNdfxx5vzfna-p7AzmjSL.3 2024-09-12T02:06:46.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3965592504606529498', time=2024-09-12T03:34:54.500617+0000, chain.objs.size()=3 2024-09-12T02:06:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~fRsF6XX6EzbW6_j8HUMBdhCw8FExTmB.1 2024-09-12T02:06:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~fRsF6XX6EzbW6_j8HUMBdhCw8FExTmB.2 2024-09-12T02:06:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~fRsF6XX6EzbW6_j8HUMBdhCw8FExTmB.3 2024-09-12T02:06:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17501647429580485213', time=2024-09-12T03:39:15.569511+0000, chain.objs.size()=1 2024-09-12T02:06:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.561__shadow_.i5UrHbEvPXum4r7E-dftlan8BSWk6-5_0 2024-09-12T02:06:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14770042624440508315', time=2024-09-12T03:40:54.316313+0000, chain.objs.size()=1 2024-09-12T02:06:46.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:x11aY68JJ58ZtHbaZgb6ITqYWxWvq8r_.CXOhBqzQwPXtqLjQzPgUf_CnIi-BJS__0 2024-09-12T02:06:46.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8045296418666043343', time=2024-09-12T03:40:56.954687+0000, chain.objs.size()=1 2024-09-12T02:06:46.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:Xh946nR..0N1tpJ.ADUaU029U5AVwDq_.7Lw0teFp8MctyImwVqqDcIRrTIgpxwg_0 2024-09-12T02:06:46.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.42384932973406134', time=2024-09-12T03:41:21.637850+0000, chain.objs.size()=1 2024-09-12T02:06:46.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:nZjveeiT5LQv4LSY4HxWk0EcmV9GcG3_.HteygOSkQBYVftLuItw4JEz8disr__v_0 2024-09-12T02:06:46.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14313737873395806802', time=2024-09-12T03:41:33.297352+0000, chain.objs.size()=1 2024-09-12T02:06:46.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:1YKoi.pPa14X2YjnpDL.s6GosWm2wpc_.usYa38MI_G-AF0OuAbZDHvqi9_h0DOe_0 2024-09-12T02:06:46.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12271716294510740675', time=2024-09-12T03:43:04.646247+0000, chain.objs.size()=1 2024-09-12T02:06:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.588__shadow:l.TYQyv8.eKqKHguGWvuwBDVp5A8q7A_.Iz6uZTRAtjlUB1lIceG7HuGFe3mvS_d_0 2024-09-12T02:06:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9857453073096149415', time=2024-09-12T03:43:05.081413+0000, chain.objs.size()=1 2024-09-12T02:06:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.588__shadow:mnIrfO00UTURS89Mq3MEm2bX1eFWfI3_.BI891FOzMbG9u158bZqQiXXd7j9q7RS_0 2024-09-12T02:06:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12620235779444799481', time=2024-09-12T03:53:18.864244+0000, chain.objs.size()=1 2024-09-12T02:06:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.669__shadow_.rY-cZKTCbYOBjnXPWaOY-xq1G5h68WJ_0 2024-09-12T02:06:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1490047413538714437', time=2024-09-12T03:56:57.589936+0000, chain.objs.size()=1 2024-09-12T02:06:46.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.745__shadow_.Wjwk3c3PCKEgJylc1IaK1FaqUN6DSNa_0 2024-09-12T02:06:46.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.374+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:46.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.374+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T02:06:46.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:46.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51679' 2024-09-12T02:06:46.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~NY8cWyMWVYXQLVKT9JA49N35vKchQuU', time=2024-09-12T03:06:43.188288+0000, chain.objs.size()=1 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.202__multipart_mymultipart.2~NY8cWyMWVYXQLVKT9JA49N35vKchQuU.1 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5754529278174654571', time=2024-09-12T03:10:27.781311+0000, chain.objs.size()=1 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.232__shadow_.C7v79cHzj_RKe-UiNAmHvdqbEgmTDdn_0 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13534420135959007722', time=2024-09-12T03:11:07.008535+0000, chain.objs.size()=1 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.245__shadow_.X5e6nXS2_kaicuTww9KQZqhuYPs3A5q_0 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8944282688985881883', time=2024-09-12T03:11:39.500944+0000, chain.objs.size()=1 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.258__shadow_.YVkd2CcyX8EQqwmlRAX8_-UvZneI8Hm_0 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8914838061162948093', time=2024-09-12T03:13:34.421423+0000, chain.objs.size()=1 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.I0m47m2oXnpg3QB4zmKM0K-lC4Uz088_0 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13976792108076347971', time=2024-09-12T03:13:35.041961+0000, chain.objs.size()=1 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1np-F9V-9b-SN6vv-m-nziAJ4nIhfA6_0 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1993876746898797193', time=2024-09-12T03:13:35.505934+0000, chain.objs.size()=1 2024-09-12T02:06:46.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.p3qFi0RjFxHob2sxwu0hhNgITBm0W0q_0 2024-09-12T02:06:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10565073323161968523', time=2024-09-12T03:13:35.815587+0000, chain.objs.size()=1 2024-09-12T02:06:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.P4I9e0JM-IgpHAdGyv6jeidorSlLJUR_0 2024-09-12T02:06:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17177043585590223482', time=2024-09-12T03:13:35.864694+0000, chain.objs.size()=1 2024-09-12T02:06:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uLkXlluIBel9lyEwpUlmxax-2xzL4MA_0 2024-09-12T02:06:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2307317138351018687', time=2024-09-12T03:13:36.576359+0000, chain.objs.size()=1 2024-09-12T02:06:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.VEOf6HiFpEyjQLGhlbJjqVkzgq2zLc__0 2024-09-12T02:06:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1337826626401990938', time=2024-09-12T03:13:42.510067+0000, chain.objs.size()=1 2024-09-12T02:06:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JO471XKQ34TP5awAkz5GeUA6V5BEv2Q_0 2024-09-12T02:06:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12513733868194955416', time=2024-09-12T03:13:42.977884+0000, chain.objs.size()=1 2024-09-12T02:06:46.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3dlDIdVXJIKDqmhcYg23jkdruOW18sM_0 2024-09-12T02:06:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5290417757387682938', time=2024-09-12T03:13:43.286440+0000, chain.objs.size()=1 2024-09-12T02:06:46.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.z_qn4kIj1tR6MUWa5OhX0iZq7HDG_GU_0 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10653600185316510991', time=2024-09-12T03:13:44.824051+0000, chain.objs.size()=1 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.AFQnTDqeyyOU4_npzmM8RpgtyxwFBVM_0 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3984326609211998893', time=2024-09-12T03:13:44.924283+0000, chain.objs.size()=1 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1SooQkj9VZqBkZ5oPx7LVbWoMSEhV8F_0 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11902221768920851643', time=2024-09-12T03:13:46.637354+0000, chain.objs.size()=1 2024-09-12T02:06:46.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.HS_XXNFO61HitallhkK83eyrhzKLBYz_0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13935485697075532433', time=2024-09-12T03:13:46.641213+0000, chain.objs.size()=1 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cPDboYj8eQq4qU_kmphadCFjsaSV0IH_0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.163010207373347467', time=2024-09-12T03:13:46.968855+0000, chain.objs.size()=1 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rJcHqrSNxw4Bkg-WznO6w_7F8e8yKkB_0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13415967309524963338', time=2024-09-12T03:13:48.294581+0000, chain.objs.size()=1 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hCknQaEda2sjo1fd--K97vaODbe6SbK_0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13336828831868922249', time=2024-09-12T03:13:48.634837+0000, chain.objs.size()=1 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.OHjJXiHlIOQBF53FdJ3R6RGkUP1Jxxd_0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17222278464267473523', time=2024-09-12T03:13:49.331164+0000, chain.objs.size()=1 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-txDy5IfbrhB5kk-KwGRusf64XX8qgz_0 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15308287834422493875', time=2024-09-12T03:13:51.279508+0000, chain.objs.size()=1 2024-09-12T02:06:46.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.w1reKD10c7PV5iZMLSxviLvJuFGwaXS_0 2024-09-12T02:06:46.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4176644412404357414', time=2024-09-12T03:13:52.240839+0000, chain.objs.size()=1 2024-09-12T02:06:46.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.brhDrU1UIzx8nSdvwWlxMmsR5D8wGHZ_0 2024-09-12T02:06:46.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6874894324258839260', time=2024-09-12T03:13:52.547100+0000, chain.objs.size()=1 2024-09-12T02:06:46.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jVT8BEcSNbTQzqt_WmDWtOod5v-nBlv_0 2024-09-12T02:06:46.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11526345406711889676', time=2024-09-12T03:13:52.695475+0000, chain.objs.size()=1 2024-09-12T02:06:46.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.P1zwETvHH_Kr6s0JHDBiHCUuaiCg87a_0 2024-09-12T02:06:46.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1585394406417318487', time=2024-09-12T03:13:53.683460+0000, chain.objs.size()=1 2024-09-12T02:06:46.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rE0fpxOxNU1xVH52sSM8tr2P4w3jyNU_0 2024-09-12T02:06:46.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.246746483499547258', time=2024-09-12T03:13:54.766661+0000, chain.objs.size()=1 2024-09-12T02:06:46.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JipCN9a2VpcDCIapBhySCq2_ST-rJTL_0 2024-09-12T02:06:46.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16306159323662518649', time=2024-09-12T03:13:56.505633+0000, chain.objs.size()=1 2024-09-12T02:06:46.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1pM8iy9ADknL8Czw55ISyYO2k5ssxjh_0 2024-09-12T02:06:46.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13451674379384301428', time=2024-09-12T03:13:57.076073+0000, chain.objs.size()=1 2024-09-12T02:06:46.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vDtKDJAKjzI_5JLbL1sHMfiSN8e-s0S_0 2024-09-12T02:06:46.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7175448117399434293', time=2024-09-12T03:13:58.766380+0000, chain.objs.size()=1 2024-09-12T02:06:46.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-dmuIcUW6Qr_h_Ex3egx76DQIDZ7Pad_0 2024-09-12T02:06:46.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8328528331416651700', time=2024-09-12T03:13:59.299529+0000, chain.objs.size()=1 2024-09-12T02:06:46.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Dhky9R9bSuAIXAYck_eXfIT48Ao9jfT_0 2024-09-12T02:06:46.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.445883107440691031', time=2024-09-12T03:13:59.607751+0000, chain.objs.size()=1 2024-09-12T02:06:46.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8QufaNYJ-NF5ECyBD1KrJ4sJztU7Y92_0 2024-09-12T02:06:46.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16626189060407635980', time=2024-09-12T03:14:00.088273+0000, chain.objs.size()=1 2024-09-12T02:06:46.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.S7f1euK8EMaGmOkV7YxFJCedHGz7IHc_0 2024-09-12T02:06:46.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7248209951092480995', time=2024-09-12T03:14:00.636386+0000, chain.objs.size()=1 2024-09-12T02:06:46.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.E_UKSz09vofmRTJ3VvJKqKkvPY7NqXk_0 2024-09-12T02:06:46.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9385831064614456678', time=2024-09-12T03:14:01.894710+0000, chain.objs.size()=1 2024-09-12T02:06:46.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.PgfwjzaJOEq3sExZ9NAYbmLJ6uWnZZc_0 2024-09-12T02:06:46.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10364456392798463766', time=2024-09-12T03:14:02.730848+0000, chain.objs.size()=1 2024-09-12T02:06:46.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.od1FifmnXoZSSenogvXbGVsZn8R_1qa_0 2024-09-12T02:06:46.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14495317250897315099', time=2024-09-12T03:14:03.005648+0000, chain.objs.size()=1 2024-09-12T02:06:46.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.t7_HA3Nxll4hDHC-DcRyUJu5YIz8qVB_0 2024-09-12T02:06:46.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14259260313830807332', time=2024-09-12T03:14:04.243437+0000, chain.objs.size()=1 2024-09-12T02:06:46.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.dA4FGoBeZlTo838GyFH1Y_8h94SJ2xh_0 2024-09-12T02:06:46.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11667329990437709851', time=2024-09-12T03:14:04.355594+0000, chain.objs.size()=1 2024-09-12T02:06:46.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.HgiWLZWGlXj-BeIS644Hkv8ThgrgY2a_0 2024-09-12T02:06:46.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15570852200664652523', time=2024-09-12T03:14:05.458191+0000, chain.objs.size()=1 2024-09-12T02:06:46.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ra6hJa49o3_oAk_A3qKNRHJ--k__N_O_0 2024-09-12T02:06:46.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15411108665753104937', time=2024-09-12T03:14:17.381827+0000, chain.objs.size()=1 2024-09-12T02:06:46.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.268__shadow_.BcF3Izl2QEQAbffhO-h-8S6cIhi2zdv_0 2024-09-12T02:06:46.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11778695895723881492', time=2024-09-12T03:14:19.741067+0000, chain.objs.size()=1 2024-09-12T02:06:46.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.269__shadow_.JtW0V44O_RgS48fz2KSbrD2kYsbqakG_0 2024-09-12T02:06:46.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16762522808844609712', time=2024-09-12T03:14:36.595956+0000, chain.objs.size()=1 2024-09-12T02:06:46.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.276__shadow_.r11X9UOkaJTJ-0F9Uv8msSPt6HFPOR6_0 2024-09-12T02:06:46.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17257061078131753755', time=2024-09-12T03:15:14.629996+0000, chain.objs.size()=1 2024-09-12T02:06:46.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.291__shadow_.Vc0iij4rq-Y7IIWWTU_ND7CWBxO0msB_0 2024-09-12T02:06:46.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10729247308275873880', time=2024-09-12T03:15:47.652362+0000, chain.objs.size()=1 2024-09-12T02:06:46.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.301__shadow_.TjkSkjpE2mQN9BfrS_F3V44gnf9XZr8_0 2024-09-12T02:06:46.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1125551590393585571', time=2024-09-12T03:15:52.648517+0000, chain.objs.size()=1 2024-09-12T02:06:46.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.303__shadow_.6Rox-B17fznGLwRY51lRtrMo0GMjBn6_0 2024-09-12T02:06:46.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14527669046721180240', time=2024-09-12T03:16:06.898981+0000, chain.objs.size()=1 2024-09-12T02:06:46.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.308__shadow:7konoVIV78hefet4aIxi2wluLeWb1I9_.oGZXXsxfSaEaTny8rJ9MzT1gEf8ouIy_0 2024-09-12T02:06:46.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9174865664577360154', time=2024-09-12T03:18:36.556911+0000, chain.objs.size()=1 2024-09-12T02:06:46.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ppW1TrSL0c6D2k9ylsO1OuvsEF_71L5_0 2024-09-12T02:06:46.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10791766430250154513', time=2024-09-12T03:18:38.563793+0000, chain.objs.size()=1 2024-09-12T02:06:46.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MJJQ9wc4hm-iOrULq7PTkQk3gL038eH_0 2024-09-12T02:06:46.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7658643613565694887', time=2024-09-12T03:18:40.950671+0000, chain.objs.size()=1 2024-09-12T02:06:46.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wgiIUpYZw19TAEcoXshO6IQrNqzeXLE_0 2024-09-12T02:06:46.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10535613372923302578', time=2024-09-12T03:18:43.038990+0000, chain.objs.size()=1 2024-09-12T02:06:46.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qtXXzTUwNhAZk14NpwpvEpgPaj0kC1P_0 2024-09-12T02:06:46.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12834197679206654443', time=2024-09-12T03:18:43.837550+0000, chain.objs.size()=1 2024-09-12T02:06:46.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zRUCImDrVOc43ndb05jLwP0T6oo3mW4_0 2024-09-12T02:06:46.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8060510754996340895', time=2024-09-12T03:18:45.382326+0000, chain.objs.size()=1 2024-09-12T02:06:46.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.KBsU-qoNMOk5BtpmDcyVbT9uCm4bgDg_0 2024-09-12T02:06:46.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5105758930808901818', time=2024-09-12T03:18:46.134445+0000, chain.objs.size()=1 2024-09-12T02:06:46.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.FKjwN99BX-T67P1OOiH4tnSbFTVM3_v_0 2024-09-12T02:06:46.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14556788036165406116', time=2024-09-12T03:18:47.038407+0000, chain.objs.size()=1 2024-09-12T02:06:46.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CvvQmG8V113ngb-my5SUZzrFdGvaZPL_0 2024-09-12T02:06:46.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17920717035343411120', time=2024-09-12T03:18:48.229071+0000, chain.objs.size()=1 2024-09-12T02:06:46.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Pseg6En8AiJjBunex4vKRgYUmgY390Y_0 2024-09-12T02:06:46.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10257951009040387200', time=2024-09-12T03:18:49.204870+0000, chain.objs.size()=1 2024-09-12T02:06:46.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5jOEBt6wCchUagNGZytF_-c-lqC95px_0 2024-09-12T02:06:46.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12913906155022966216', time=2024-09-12T03:18:51.673539+0000, chain.objs.size()=1 2024-09-12T02:06:46.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.410+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PU7Nya0eacsIQUQLEzTc4G0zRUtzHnQ_0 2024-09-12T02:06:46.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13182091661683734327', time=2024-09-12T03:18:52.407084+0000, chain.objs.size()=1 2024-09-12T02:06:46.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Tpjuyd1Y6axfx7jRLmdkPTIzNBsoYtQ_0 2024-09-12T02:06:46.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2895402200279426463', time=2024-09-12T03:18:52.436673+0000, chain.objs.size()=1 2024-09-12T02:06:46.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.NBIvdlVD9f6VXaugs3hjuxlmcwLHxES_0 2024-09-12T02:06:46.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13304072485614686450', time=2024-09-12T03:18:53.531282+0000, chain.objs.size()=1 2024-09-12T02:06:46.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.rvHF11OOSAhnQvFn8-BUnmdP0eoJkdW_0 2024-09-12T02:06:46.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7182577752331317206', time=2024-09-12T03:18:53.763247+0000, chain.objs.size()=1 2024-09-12T02:06:46.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QKmo4ywcafVctPYCfJcTuSPztdRrAKX_0 2024-09-12T02:06:46.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16770019447308943031', time=2024-09-12T03:18:54.057029+0000, chain.objs.size()=1 2024-09-12T02:06:46.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.j9lLKT4wIb2PF0c9BSlyfA6VgRdl5Ou_0 2024-09-12T02:06:46.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15874530641324571476', time=2024-09-12T03:18:54.192479+0000, chain.objs.size()=1 2024-09-12T02:06:46.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.f81zoluk2pT_YvXQ9ZEnubynA-0MrdN_0 2024-09-12T02:06:46.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2900704769743285223', time=2024-09-12T03:18:54.239704+0000, chain.objs.size()=1 2024-09-12T02:06:46.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.o8fbfvufVnXMZRmCpy7Vo1fxQcrOa3A_0 2024-09-12T02:06:46.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15932064298046917847', time=2024-09-12T03:18:55.471303+0000, chain.objs.size()=1 2024-09-12T02:06:46.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QHxZxY-ZIZaMmX3z6McENJJ8kczK87J_0 2024-09-12T02:06:46.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.219798664258448796', time=2024-09-12T03:18:56.124570+0000, chain.objs.size()=1 2024-09-12T02:06:46.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.B2EdpjSuK-_bFK8UJiUFjkC1GEfLl-j_0 2024-09-12T02:06:46.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5687051399411540025', time=2024-09-12T03:18:57.257857+0000, chain.objs.size()=1 2024-09-12T02:06:46.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zfWabGXlhnQOVIOsCx_4_hHfbk2r6HT_0 2024-09-12T02:06:46.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5313637599594672589', time=2024-09-12T03:18:57.373937+0000, chain.objs.size()=1 2024-09-12T02:06:46.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PJJN-BEtCYb9bdWkiAYWWBff6U0Fa-3_0 2024-09-12T02:06:46.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9588760575938418446', time=2024-09-12T03:18:58.498082+0000, chain.objs.size()=1 2024-09-12T02:06:46.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.EySIP9MsRjPBzLGR9Wma82GArH_X_Hs_0 2024-09-12T02:06:46.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1369801991166433809', time=2024-09-12T03:18:59.424043+0000, chain.objs.size()=1 2024-09-12T02:06:46.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qdO-zxBsslTTirnFOkqJ9NRTPOebG_X_0 2024-09-12T02:06:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6020504122098947792', time=2024-09-12T03:18:59.884627+0000, chain.objs.size()=1 2024-09-12T02:06:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2Y1Qf4tB0z-HelMit_GJLxApEuQVbXW_0 2024-09-12T02:06:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1306765248567914356', time=2024-09-12T03:19:00.434471+0000, chain.objs.size()=1 2024-09-12T02:06:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.IMC5cwHm1T6xw2OvMZy0q0DvcDr9bdp_0 2024-09-12T02:06:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10454963613298366433', time=2024-09-12T03:19:01.378378+0000, chain.objs.size()=1 2024-09-12T02:06:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.M9c5sqSrRzU6aR-o8eNFMS5ctQkyimv_0 2024-09-12T02:06:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6194993099501849486', time=2024-09-12T03:19:02.348054+0000, chain.objs.size()=1 2024-09-12T02:06:46.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.f5Vkz-6dVaJc6M8LQFOS8h_QBw64Y5N_0 2024-09-12T02:06:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17111261693162466069', time=2024-09-12T03:19:03.037427+0000, chain.objs.size()=1 2024-09-12T02:06:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.X4KMZ4HHdNMuHIyPPS3rKbE-T6yD02T_0 2024-09-12T02:06:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4728858887346434322', time=2024-09-12T03:19:04.154439+0000, chain.objs.size()=1 2024-09-12T02:06:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yc51x92oOj_S3fvT72QmoFMgFGog1e6_0 2024-09-12T02:06:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17253555176266990127', time=2024-09-12T03:19:04.292086+0000, chain.objs.size()=1 2024-09-12T02:06:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.HID-4vBesglJHMLPcONmQ81_GZR7wmy_0 2024-09-12T02:06:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3191464047394708423', time=2024-09-12T03:19:05.689894+0000, chain.objs.size()=1 2024-09-12T02:06:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MLXrVDGDt3B43mUpbut1eg8q3cV3uGU_0 2024-09-12T02:06:46.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14109122707361150478', time=2024-09-12T03:19:07.191905+0000, chain.objs.size()=1 2024-09-12T02:06:46.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Ufwhpkj_19uSEsItHulylAaPwsxL6xg_0 2024-09-12T02:06:46.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6416779960482295125', time=2024-09-12T03:19:07.401868+0000, chain.objs.size()=1 2024-09-12T02:06:46.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.j8gLqqNV-iaOmd2Gk7oAkIQwc-H0xDB_0 2024-09-12T02:06:46.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12821289998883080881', time=2024-09-12T03:20:54.532887+0000, chain.objs.size()=1 2024-09-12T02:06:46.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Q9oG13b9zVLjnv3N6L7fo6fFUv5Anb8_0 2024-09-12T02:06:46.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14302344481541745690', time=2024-09-12T03:20:55.712704+0000, chain.objs.size()=1 2024-09-12T02:06:46.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hCezvKGJvESd8vgmA6Zyy8DJY8ee-Xk_0 2024-09-12T02:06:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4033165165449637652', time=2024-09-12T03:20:58.858490+0000, chain.objs.size()=1 2024-09-12T02:06:46.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3K7ORDUaUY75PiKlL_V58TYr-AVojFy_0 2024-09-12T02:06:46.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18408448161989216519', time=2024-09-12T03:20:59.214941+0000, chain.objs.size()=1 2024-09-12T02:06:46.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.FFu4tllqHezOgcWytFzXhezzaiUf7MG_0 2024-09-12T02:06:46.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2208607696637928215', time=2024-09-12T03:21:00.055487+0000, chain.objs.size()=1 2024-09-12T02:06:46.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Jv7EGqFxS1BwdZkm5jgQb22MYePl9xW_0 2024-09-12T02:06:46.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16249230858337883532', time=2024-09-12T03:21:00.628948+0000, chain.objs.size()=1 2024-09-12T02:06:46.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dZwazHuYbemCm2kh4Ek-AObc94En3Xk_0 2024-09-12T02:06:46.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1868499857161250580', time=2024-09-12T03:21:00.863339+0000, chain.objs.size()=1 2024-09-12T02:06:46.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZzWmi0B5H987KL2l5gXt0r6Qm8_ZJt1_0 2024-09-12T02:06:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10370773441476386950', time=2024-09-12T03:21:01.558588+0000, chain.objs.size()=1 2024-09-12T02:06:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vH_Q9BQVv4dNza2Jve9655gvo8-pGX4_0 2024-09-12T02:06:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8785174839978478151', time=2024-09-12T03:21:01.816081+0000, chain.objs.size()=1 2024-09-12T02:06:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XD4QIDNX4BX-HugpRcwCD_cbMqsWKMu_0 2024-09-12T02:06:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12482163745356029069', time=2024-09-12T03:21:03.724064+0000, chain.objs.size()=1 2024-09-12T02:06:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.R6eKKMrIypvjtvSfD9CATQKBSdIfpV8_0 2024-09-12T02:06:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9707693080958681240', time=2024-09-12T03:21:03.951519+0000, chain.objs.size()=1 2024-09-12T02:06:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Tf2HswLMGw4iKCVO-g5dEJLggw7fGKz_0 2024-09-12T02:06:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7178045725357532535', time=2024-09-12T03:21:04.832954+0000, chain.objs.size()=1 2024-09-12T02:06:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.VUZ7uJvuh-tHMpGS5LwjIFfzGzsjlJj_0 2024-09-12T02:06:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13151802877202664449', time=2024-09-12T03:21:05.144296+0000, chain.objs.size()=1 2024-09-12T02:06:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.z4-pdmiZk623ksbgezIFc3SB_pelJJA_0 2024-09-12T02:06:46.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10757996163131988876', time=2024-09-12T03:21:05.296425+0000, chain.objs.size()=1 2024-09-12T02:06:46.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.P9HA-mb_mi2q3oTW9WulDBfKyR_loh8_0 2024-09-12T02:06:46.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11771926033690423734', time=2024-09-12T03:21:05.464128+0000, chain.objs.size()=1 2024-09-12T02:06:46.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tn-0FGS45xeiIqJm44sbzCnmmX3IU16_0 2024-09-12T02:06:46.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18406058797150045687', time=2024-09-12T03:21:05.504983+0000, chain.objs.size()=1 2024-09-12T02:06:46.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.w2Ior0BE8i2amsI0sMI90jWxFnE3OPn_0 2024-09-12T02:06:46.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6921543340574475643', time=2024-09-12T03:21:06.029175+0000, chain.objs.size()=1 2024-09-12T02:06:46.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tJIRvWxaw2Dpq13owiRbIkMd5jxqWF1_0 2024-09-12T02:06:46.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14271867569578491653', time=2024-09-12T03:21:07.402623+0000, chain.objs.size()=1 2024-09-12T02:06:46.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.A_ZlhRk62g8u-h9AOIJaCdkRd66tECb_0 2024-09-12T02:06:46.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17032957912425048797', time=2024-09-12T03:21:11.281400+0000, chain.objs.size()=1 2024-09-12T02:06:46.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.n97bnfzt_AR-2CUmlRXJ57DCe0KOL82_0 2024-09-12T02:06:46.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51679 2024-09-12T02:06:46.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T02:06:46.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6151071024359110076', time=2024-09-12T03:21:11.534599+0000, chain.objs.size()=1 2024-09-12T02:06:46.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.o7jhYBMHPn78vJOyN-2lAne-w0-Fsbf_0 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14516744417708534939', time=2024-09-12T03:21:11.758312+0000, chain.objs.size()=1 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kk75a_mdWMMC_Sl4G7b3aY0KFhJnwsn_0 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5050513154496818858', time=2024-09-12T03:21:12.888945+0000, chain.objs.size()=1 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gE_QnC4l98qQBt6brTSr3_YljvIckTf_0 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13260496763640041398', time=2024-09-12T03:21:13.233077+0000, chain.objs.size()=1 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xjaF-OpN_kuBT33z5-62XOIqqZBK8cH_0 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17904161466867622929', time=2024-09-12T03:21:13.541210+0000, chain.objs.size()=1 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.53huKIkNYShE_FgNhQLKCOOxRs0NDWv_0 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4360341165222628669', time=2024-09-12T03:21:16.498560+0000, chain.objs.size()=1 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wZ_vd9_Q0_-35ainuBsCTXm7Mamq5BM_0 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16581577820156971657', time=2024-09-12T03:21:16.500271+0000, chain.objs.size()=1 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hKC2VmZfZj2ba9uNdXli4F5JxbmCJNq_0 2024-09-12T02:06:46.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11654684109746877872', time=2024-09-12T03:21:16.502615+0000, chain.objs.size()=1 2024-09-12T02:06:46.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.QcX0s0SZiZ8HNTC35DB2ssiNO0VwueK_0 2024-09-12T02:06:46.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10831791801395676549', time=2024-09-12T03:21:19.432780+0000, chain.objs.size()=1 2024-09-12T02:06:46.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.j3vdk1B3rA30TfWH8acQ5z7ax68mlrl_0 2024-09-12T02:06:46.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8589641940842716256', time=2024-09-12T03:21:19.620963+0000, chain.objs.size()=1 2024-09-12T02:06:46.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zOAOx_2W-aN0Y7z2PjgZ7tu8Ju6Xb1z_0 2024-09-12T02:06:46.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6849468603946400809', time=2024-09-12T03:21:21.136942+0000, chain.objs.size()=1 2024-09-12T02:06:46.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RQKr8d47oHazKwEIohxTWvpUCedTxND_0 2024-09-12T02:06:46.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7034638924330611534', time=2024-09-12T03:21:22.062157+0000, chain.objs.size()=1 2024-09-12T02:06:46.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PlBFLFRb51dVKCngEoku6by4JDu8P81_0 2024-09-12T02:06:46.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1951253997577725386', time=2024-09-12T03:21:23.201875+0000, chain.objs.size()=1 2024-09-12T02:06:46.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.AWJkiQqF3FP50aWUUzS1mAL-JCtmAJb_0 2024-09-12T02:06:46.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6676909634593238276', time=2024-09-12T03:21:24.590504+0000, chain.objs.size()=1 2024-09-12T02:06:46.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.k7rFmdE-9B5alZj9kGm7v0SGqzZjova_0 2024-09-12T02:06:46.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5580418451979038000', time=2024-09-12T03:21:25.531737+0000, chain.objs.size()=1 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.eXhZ0ajunkxEzjVqOxHRMw8Fj6leQet_0 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7075851006374029047', time=2024-09-12T03:23:16.934692+0000, chain.objs.size()=1 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.378__shadow_.LGTYH5TnBcXRVffFkCLWRvNx5OGJQQm_0 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6784674598234598321', time=2024-09-12T03:25:25.342502+0000, chain.objs.size()=1 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.435__shadow_.VMMkvVZ9DqPep-8bD705RQUwZ4m65hJ_0 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7541812061926247766', time=2024-09-12T03:26:53.257583+0000, chain.objs.size()=1 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.467__shadow_.c-eQYB-E5r1uWgHUcJQy3t4ciZsSMgS_0 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9800865925051029565', time=2024-09-12T03:27:21.998088+0000, chain.objs.size()=1 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.GbK3ZHKGsJtSA_YapbMgtcwhwZDmR_z_0 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5152758198005937948', time=2024-09-12T03:27:47.881783+0000, chain.objs.size()=1 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.492__shadow_.qxLm7d67jeQRILpj90BrOSxEy-1FSbp_0 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10892660043134131667', time=2024-09-12T03:27:54.169463+0000, chain.objs.size()=1 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.496__shadow_.rJ3zqa8ahe3N0_7YOOoXQnaJGbVt4FD_0 2024-09-12T02:06:46.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9946557395975036742', time=2024-09-12T03:29:00.199336+0000, chain.objs.size()=1 2024-09-12T02:06:46.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.512__multipart_mymultipart.2~lqZoqtYSJj4h58ensG_qP0nzdYfQZsy.1 2024-09-12T02:06:46.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4470348617557160258', time=2024-09-12T03:29:14.101268+0000, chain.objs.size()=1 2024-09-12T02:06:46.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.516__shadow_.UlzIv1qh_gUXV8ME1B3IoGOOOxjGx6w_0 2024-09-12T02:06:46.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8985044994239405364', time=2024-09-12T03:34:41.160417+0000, chain.objs.size()=1 2024-09-12T02:06:46.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~6XDrAYqiz9obl8lO8dWMT_Udu7VAGfD.1 2024-09-12T02:06:46.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9906476331552766604', time=2024-09-12T03:39:06.455253+0000, chain.objs.size()=1 2024-09-12T02:06:46.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.559__shadow_.lKz_AjKo0HCe1SDhO9GUeHOk7Cxxfwn_0 2024-09-12T02:06:46.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17099339904526926595', time=2024-09-12T03:40:48.514497+0000, chain.objs.size()=1 2024-09-12T02:06:46.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.577__shadow:HCiH4Qthea1SULryIr-YZlAbV6djlRm_.erld6l3wUCF4kVqOOInPg7vnlzKyOkl_0 2024-09-12T02:06:46.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4717415606909349567', time=2024-09-12T03:41:06.275193+0000, chain.objs.size()=1 2024-09-12T02:06:46.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:6eMaXlyoZOyrZnZn9zAAv28EnXyq.2e_.pvPpJo2YjE-jhhm3XIxxlcl8wURut43_0 2024-09-12T02:06:46.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15691952066222239109', time=2024-09-12T03:41:19.044643+0000, chain.objs.size()=1 2024-09-12T02:06:46.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:xuEG.mD3NRVQ1o05y19.A7iwoPuSYPv_.GqtOIh9LeJvEfbu8-vn8-VDiCOPj92o_0 2024-09-12T02:06:46.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1001687170192667717', time=2024-09-12T03:42:45.678485+0000, chain.objs.size()=1 2024-09-12T02:06:46.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.583__shadow:NjNxI4ldEpjHubKI85H7K6KYbe1-Qa7_.w_aSOwv1e_Qhbrax2VbYc5QbexkQ5SL_0 2024-09-12T02:06:46.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14118609771652967660', time=2024-09-12T03:50:36.217953+0000, chain.objs.size()=1 2024-09-12T02:06:46.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.634__shadow_.W5tcB9EAkhegPwijS7HfS-c2R9l1dKn_0 2024-09-12T02:06:46.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17392295772344339370', time=2024-09-12T03:56:22.576664+0000, chain.objs.size()=10 2024-09-12T02:06:46.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.736__multipart_foo.2~A6_N2OyMM2iaRWcCTHjg8wSrhZLM4a5.1 2024-09-12T02:06:46.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.736__multipart_foo.2~A6_N2OyMM2iaRWcCTHjg8wSrhZLM4a5.2 2024-09-12T02:06:46.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.736__multipart_foo.2~A6_N2OyMM2iaRWcCTHjg8wSrhZLM4a5.3 2024-09-12T02:06:46.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.736__multipart_foo.2~A6_N2OyMM2iaRWcCTHjg8wSrhZLM4a5.4 2024-09-12T02:06:46.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.736__multipart_foo.2~A6_N2OyMM2iaRWcCTHjg8wSrhZLM4a5.5 2024-09-12T02:06:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.736__multipart_foo.2~A6_N2OyMM2iaRWcCTHjg8wSrhZLM4a5.6 2024-09-12T02:06:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.736__multipart_foo.2~A6_N2OyMM2iaRWcCTHjg8wSrhZLM4a5.7 2024-09-12T02:06:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.736__multipart_foo.2~A6_N2OyMM2iaRWcCTHjg8wSrhZLM4a5.8 2024-09-12T02:06:46.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.736__multipart_foo.2~A6_N2OyMM2iaRWcCTHjg8wSrhZLM4a5.9 2024-09-12T02:06:46.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.736__multipart_foo.2~A6_N2OyMM2iaRWcCTHjg8wSrhZLM4a5.10 2024-09-12T02:06:46.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.474+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:46.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.478+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T02:06:46.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:46.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58900' 2024-09-12T02:06:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5575478350526656104', time=2024-09-12T03:04:18.601294+0000, chain.objs.size()=5 2024-09-12T02:06:46.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__multipart_foo-LUKEWARM.2~9N6VahkTjDXVNvcdM-SRI9a6jQMO1N1.1 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_foo-LUKEWARM.2~9N6VahkTjDXVNvcdM-SRI9a6jQMO1N1.1_1 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__multipart_foo-LUKEWARM.2~9N6VahkTjDXVNvcdM-SRI9a6jQMO1N1.2 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_foo-LUKEWARM.2~9N6VahkTjDXVNvcdM-SRI9a6jQMO1N1.2_1 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__multipart_foo-LUKEWARM.2~9N6VahkTjDXVNvcdM-SRI9a6jQMO1N1.3 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16281481234157838036', time=2024-09-12T03:10:37.869275+0000, chain.objs.size()=1 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.236__shadow_.vGi-p5Rc58beMHAYEfV62jfqIJlTL20_0 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10646599245791775462', time=2024-09-12T03:11:44.296319+0000, chain.objs.size()=1 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.260__shadow_.uigW_2S9o8fw02HzTLV9OIYHTV_kWA2_0 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7469459017829449138', time=2024-09-12T03:13:33.977944+0000, chain.objs.size()=1 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.UNMhaqG02inFNBeP03Xyb4Na6jL_8v7_0 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6497569086444129611', time=2024-09-12T03:13:34.832145+0000, chain.objs.size()=1 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.XGdLvRXlsb5sAZNmUBWfGmQLs0L5R0S_0 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13077502623577514936', time=2024-09-12T03:13:34.921746+0000, chain.objs.size()=1 2024-09-12T02:06:46.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rbzXAefEFBZJ9UVHgJD9D_Dzl8zMhOh_0 2024-09-12T02:06:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11260202709857172263', time=2024-09-12T03:13:34.923427+0000, chain.objs.size()=1 2024-09-12T02:06:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.y-46UFap5q99_tqMykF-bkYriF2dp8z_0 2024-09-12T02:06:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8469399048225969262', time=2024-09-12T03:13:39.562830+0000, chain.objs.size()=1 2024-09-12T02:06:46.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Z2usr34NAIrkpf3qOl2dzXZgDLNdQQZ_0 2024-09-12T02:06:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8654192890305730945', time=2024-09-12T03:13:40.231440+0000, chain.objs.size()=1 2024-09-12T02:06:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.v_J3LTYiksu1nrY5MQYoX_ui9_lf9PS_0 2024-09-12T02:06:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2996795740531376558', time=2024-09-12T03:13:41.432413+0000, chain.objs.size()=1 2024-09-12T02:06:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.R-2dxYAqeryGYvMb52YA_cR-Z0cFFlf_0 2024-09-12T02:06:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8690420544339916189', time=2024-09-12T03:13:42.518242+0000, chain.objs.size()=1 2024-09-12T02:06:46.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cA0XTQNl_APVilWTXShpd4A-Pl6Fr5v_0 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15456565548732202018', time=2024-09-12T03:13:43.396723+0000, chain.objs.size()=1 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GlTFnGxQL-a7AjJgjUGmb1BLWrMpFtG_0 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5845648087476101173', time=2024-09-12T03:13:44.142882+0000, chain.objs.size()=1 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.n2Fggi2SptS1-k5YqYqRAcWjVQZu7C2_0 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7934261793242269647', time=2024-09-12T03:13:45.393946+0000, chain.objs.size()=1 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rGi7tihDvvjz-g5Toa1b9wFiVPNn_xj_0 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9045131071215317951', time=2024-09-12T03:13:46.514018+0000, chain.objs.size()=1 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.AAhd048rIcnt6B603_OjcbFNYB-uquQ_0 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4768325066553948364', time=2024-09-12T03:13:48.589973+0000, chain.objs.size()=1 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CAGW8MVnYFGxbjndwspdUR99vgpNpqZ_0 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15570303578723891001', time=2024-09-12T03:13:48.965338+0000, chain.objs.size()=1 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.a9YUIQSj9akqruXybex_L4v7r6d3pGf_0 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17560622284594426179', time=2024-09-12T03:13:52.124393+0000, chain.objs.size()=1 2024-09-12T02:06:46.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.M0nwyefA7-oft0mxJLdpNVvn5ntaPOD_0 2024-09-12T02:06:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9842920789352276440', time=2024-09-12T03:13:53.035641+0000, chain.objs.size()=1 2024-09-12T02:06:46.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.494+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.MokDAOLVa5p6uipnSKBU3egGeotPEQx_0 2024-09-12T02:06:46.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5946979590734965004', time=2024-09-12T03:13:53.388192+0000, chain.objs.size()=1 2024-09-12T02:06:46.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1TKq2YWdxCHyselfEO6QaY_pQrUCfk3_0 2024-09-12T02:06:46.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17830457451710762501', time=2024-09-12T03:13:56.246269+0000, chain.objs.size()=1 2024-09-12T02:06:46.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ahOZJdRDzC_2s_hwrjAPnOQB4tduKgb_0 2024-09-12T02:06:46.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6112096519675328096', time=2024-09-12T03:13:56.348075+0000, chain.objs.size()=1 2024-09-12T02:06:46.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.YDbPJDnR0vLUWcGW5BB0L2yKb60q1Rr_0 2024-09-12T02:06:46.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13735312025838030046', time=2024-09-12T03:13:56.848658+0000, chain.objs.size()=1 2024-09-12T02:06:46.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.sRkoB5qc9EvdhlwK4IA5P4eNx0lVbl8_0 2024-09-12T02:06:46.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11378633951764146738', time=2024-09-12T03:13:58.835131+0000, chain.objs.size()=1 2024-09-12T02:06:46.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.23pDxVil5qq9yVSXQZXjoOEbN8_jn2D_0 2024-09-12T02:06:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2180096524984450806', time=2024-09-12T03:13:59.206536+0000, chain.objs.size()=1 2024-09-12T02:06:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.LluVT6_5jNniK8DWcPbC14NaZrX4ZE7_0 2024-09-12T02:06:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12726456902862896537', time=2024-09-12T03:14:00.159786+0000, chain.objs.size()=1 2024-09-12T02:06:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.q8kpDf4rAfrOzK1VzdlWk9DkpP5kxyH_0 2024-09-12T02:06:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8551617541899402766', time=2024-09-12T03:14:00.540061+0000, chain.objs.size()=1 2024-09-12T02:06:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vFseA-YWuOw8VnaHWKpwhx6dGSiAANB_0 2024-09-12T02:06:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13503342731329050401', time=2024-09-12T03:14:00.745255+0000, chain.objs.size()=1 2024-09-12T02:06:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.bmXmTe4hxNQxsJVHyAiEMeTuiwY2_Xp_0 2024-09-12T02:06:46.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15614984990699357552', time=2024-09-12T03:14:01.650267+0000, chain.objs.size()=1 2024-09-12T02:06:46.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.S605J-AboeAcJJKdqTYK5N4aaU5qHc4_0 2024-09-12T02:06:46.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12916635583001387763', time=2024-09-12T03:14:01.861337+0000, chain.objs.size()=1 2024-09-12T02:06:46.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4ILVuapKTYs8BDigTKIZgYPbeXq7dZt_0 2024-09-12T02:06:46.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15926451333162549761', time=2024-09-12T03:14:04.667857+0000, chain.objs.size()=1 2024-09-12T02:06:46.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5J__FrbjsEsfoo0RvSFd6iNbO2iy-Kw_0 2024-09-12T02:06:46.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1386675980271907381', time=2024-09-12T03:14:04.861117+0000, chain.objs.size()=1 2024-09-12T02:06:46.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.67pyablrcn_69FnEBK4laYbTUfEdd_H_0 2024-09-12T02:06:46.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6627890097754906136', time=2024-09-12T03:14:05.274005+0000, chain.objs.size()=1 2024-09-12T02:06:46.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.PGdVml9Aj_qoJYIsg9Gh-Ae98OA8zGr_0 2024-09-12T02:06:46.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18296624839106522266', time=2024-09-12T03:14:05.358511+0000, chain.objs.size()=1 2024-09-12T02:06:46.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.p1w3nrp8T5JR6oUWrMB7fGcS1_2G88p_0 2024-09-12T02:06:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263666695404771202', time=2024-09-12T03:14:39.217747+0000, chain.objs.size()=1 2024-09-12T02:06:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.277__shadow_.O0mnS-LnMB7pP5v5nIqgqiFjvqzKTUx_0 2024-09-12T02:06:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8703544843034200667', time=2024-09-12T03:14:51.708757+0000, chain.objs.size()=1 2024-09-12T02:06:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.282__shadow_.BTPoCMQsznJRvs2R8KPJX9Yn9KZsh1K_0 2024-09-12T02:06:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.963767968706561691', time=2024-09-12T03:14:54.356667+0000, chain.objs.size()=1 2024-09-12T02:06:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.283__shadow_.o-hrhDHh9-AXSBC-XJhKUdfn6koCkbo_0 2024-09-12T02:06:46.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4771527421377164089', time=2024-09-12T03:15:23.578290+0000, chain.objs.size()=1 2024-09-12T02:06:46.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.oo8n6hx4jCvBm-9UvKA8Nba2elGu0mv_0 2024-09-12T02:06:46.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2890214687447338084', time=2024-09-12T03:15:29.510836+0000, chain.objs.size()=1 2024-09-12T02:06:46.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.ZsIXdKtu0M2WuoxuRfcQVOC1lKEUBJ-_0 2024-09-12T02:06:46.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5540369086810954595', time=2024-09-12T03:15:29.728104+0000, chain.objs.size()=1 2024-09-12T02:06:46.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.eu-XaDBmbxnA6onFVdALVjFX0OKFCP4_0 2024-09-12T02:06:46.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1072722696991461379', time=2024-09-12T03:15:39.835885+0000, chain.objs.size()=1 2024-09-12T02:06:46.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.506+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.298__shadow_.HCN3wLUb9lC9Ne9g2nxOrzI_yG_7ufz_0 2024-09-12T02:06:46.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10884055354566012614', time=2024-09-12T03:16:03.159369+0000, chain.objs.size()=1 2024-09-12T02:06:46.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.307__shadow_.2MzXa5d7rqv6gLJs3R8nmTuVZeNzD76_0 2024-09-12T02:06:46.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3590188321912187259', time=2024-09-12T03:18:36.913590+0000, chain.objs.size()=1 2024-09-12T02:06:46.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5kb5M00WGE_Yj8GTwZ5Vo7gLxJ8PFRh_0 2024-09-12T02:06:46.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5578377514793399124', time=2024-09-12T03:18:37.392040+0000, chain.objs.size()=1 2024-09-12T02:06:46.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.I7sYyEXcHvAw9j_sifrPDHBYgT-PM53_0 2024-09-12T02:06:46.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4446904007215257362', time=2024-09-12T03:18:37.937787+0000, chain.objs.size()=1 2024-09-12T02:06:46.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VyrWtpbpYq4g7qNcIxUVRZQQt1tecIP_0 2024-09-12T02:06:46.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6141993421831199563', time=2024-09-12T03:18:39.168443+0000, chain.objs.size()=1 2024-09-12T02:06:46.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.nXr3Z-jYZTGZKr9QLiLXmpq_mav2KS5_0 2024-09-12T02:06:46.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16429855736312979695', time=2024-09-12T03:18:39.299251+0000, chain.objs.size()=1 2024-09-12T02:06:46.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ZbaGeMR3jBQ0HGhUlwU0mfhMsVjXcEs_0 2024-09-12T02:06:46.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3216455109320425156', time=2024-09-12T03:18:41.425522+0000, chain.objs.size()=1 2024-09-12T02:06:46.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yu6X4y59sCi_J02gI2mdOXpF4V2EjH2_0 2024-09-12T02:06:46.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17042975845271382550', time=2024-09-12T03:18:42.245959+0000, chain.objs.size()=1 2024-09-12T02:06:46.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hXF9xB8jgnIpRj3WUd5F6PLyFV0SbSb_0 2024-09-12T02:06:46.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17118751861207934499', time=2024-09-12T03:18:45.381849+0000, chain.objs.size()=1 2024-09-12T02:06:46.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QcUk9ktdQUIwPZUojMffApnPQV8gPFU_0 2024-09-12T02:06:46.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8497747336265070721', time=2024-09-12T03:18:49.935817+0000, chain.objs.size()=1 2024-09-12T02:06:46.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.EkHvCqUgVnL0Q_bL7lxfF40RMtKwq3D_0 2024-09-12T02:06:46.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.53443093564218975', time=2024-09-12T03:18:51.404666+0000, chain.objs.size()=1 2024-09-12T02:06:46.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jTiSj_VY2qCMGYlkTqBDgyjsqZFuWHj_0 2024-09-12T02:06:46.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6215666551636528139', time=2024-09-12T03:18:51.407213+0000, chain.objs.size()=1 2024-09-12T02:06:46.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wHkZXF1YjDMgkBHAQ_CHDLr4BweFt6E_0 2024-09-12T02:06:46.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1152599367190769371', time=2024-09-12T03:18:51.799019+0000, chain.objs.size()=1 2024-09-12T02:06:46.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.b8WFnOHBg8wrUpwEccoEqgH7xeTbq-B_0 2024-09-12T02:06:46.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1150955064748814589', time=2024-09-12T03:18:55.591904+0000, chain.objs.size()=1 2024-09-12T02:06:46.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.mf8BIzpmbUUnmsShIH46BYLKJArAsfE_0 2024-09-12T02:06:46.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13286334277901861670', time=2024-09-12T03:18:56.472095+0000, chain.objs.size()=1 2024-09-12T02:06:46.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Rrp-dzmtNoSjMzkw-o3FMnqTS69is17_0 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6327538328571943431', time=2024-09-12T03:18:58.154933+0000, chain.objs.size()=1 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.D0KlXM-zZIoQyneR2u-_eYfNezfgnqq_0 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4205773643278243647', time=2024-09-12T03:18:58.157056+0000, chain.objs.size()=1 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.XEClEBL8P8yFxpzLmfPL4o15X8nHu1g_0 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9864258459082117505', time=2024-09-12T03:19:01.253579+0000, chain.objs.size()=1 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eKVFWy17ksJ0jwC_v0HiiNNw781r4dS_0 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18310580355768696701', time=2024-09-12T03:19:02.404597+0000, chain.objs.size()=1 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.uwMFay2jvQYtLMDYhH7-mp43WFLDA4L_0 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17114516885086827406', time=2024-09-12T03:19:04.248208+0000, chain.objs.size()=1 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ZwNUmafB7X8HIbVCqh-Q0HSNST73G3E_0 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18267732106015040370', time=2024-09-12T03:19:05.323599+0000, chain.objs.size()=1 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tfL70Yd0SNpgzqUFqzEpxMbtd9GauLq_0 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2766496767579840243', time=2024-09-12T03:20:54.193191+0000, chain.objs.size()=1 2024-09-12T02:06:46.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.cT6o_dJPFixI0bSg3fZd3OBUwzxGXhK_0 2024-09-12T02:06:46.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9574168666844467926', time=2024-09-12T03:20:54.933271+0000, chain.objs.size()=1 2024-09-12T02:06:46.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0F5w27NuxNa2zMFSVGIWf13Tm8JPs8T_0 2024-09-12T02:06:46.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14713792567394012228', time=2024-09-12T03:20:55.291443+0000, chain.objs.size()=1 2024-09-12T02:06:46.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rAeEy6ACFCJBwOrtt9bio4OMNi5e4Z2_0 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9754438719762199452', time=2024-09-12T03:20:56.490414+0000, chain.objs.size()=1 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.a-draus6Hc_oagCRN4_in0yZB9HQ0fU_0 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17542251083943025607', time=2024-09-12T03:20:58.980916+0000, chain.objs.size()=1 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1zVu13Js2wRUejC8bfJ59TyrLQjrsJU_0 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13845679218858479996', time=2024-09-12T03:20:59.883079+0000, chain.objs.size()=1 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.P5h5cdkkWJwHkTAAfrgUfnDDS0EUl6e_0 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15421377048692286168', time=2024-09-12T03:21:00.349433+0000, chain.objs.size()=1 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XXb6M7GcoWlAxIsZVyuWHJ8sYFuBRSt_0 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1960435504767553851', time=2024-09-12T03:21:01.257551+0000, chain.objs.size()=1 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.aFS9g1nVzkUmJbtKw6MP2asS9BfPCHv_0 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5963841311170350587', time=2024-09-12T03:21:04.543339+0000, chain.objs.size()=1 2024-09-12T02:06:46.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.mM6VyRBAm1OQNzPzDsksgUBsZmbajek_0 2024-09-12T02:06:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10939840059001812254', time=2024-09-12T03:21:06.027500+0000, chain.objs.size()=1 2024-09-12T02:06:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vpKeyshF2DvXOpgmmL2lgCmwUkD1Csh_0 2024-09-12T02:06:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17284652876923728751', time=2024-09-12T03:21:06.074103+0000, chain.objs.size()=1 2024-09-12T02:06:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MZ8T66WwTI9yxVntOa3vqRHdGvwrbrh_0 2024-09-12T02:06:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12685464063435743506', time=2024-09-12T03:21:07.026253+0000, chain.objs.size()=1 2024-09-12T02:06:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.98FPlvddG4TZktJcorcFqSIN-P9xDdZ_0 2024-09-12T02:06:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4453034554068822502', time=2024-09-12T03:21:09.097683+0000, chain.objs.size()=1 2024-09-12T02:06:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.00ssEHbwL6qU5JeI23tWJPemuYXgslP_0 2024-09-12T02:06:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18230325626704623065', time=2024-09-12T03:21:09.212326+0000, chain.objs.size()=1 2024-09-12T02:06:46.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RX_9RC5GwLD_ahjOwnNLF3XsvPEiquV_0 2024-09-12T02:06:46.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9997165269246018031', time=2024-09-12T03:21:09.304949+0000, chain.objs.size()=1 2024-09-12T02:06:46.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6sWdzfaV1Kzdy8915K-EYQH1i-qJcsG_0 2024-09-12T02:06:46.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16986108796312185974', time=2024-09-12T03:21:09.745552+0000, chain.objs.size()=1 2024-09-12T02:06:46.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lNbedY89cUYszO4eWZlPu_-4I_Yu_zP_0 2024-09-12T02:06:46.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14084929476213780911', time=2024-09-12T03:21:10.086598+0000, chain.objs.size()=1 2024-09-12T02:06:46.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.e8ir8A7bRTdpMZ1x2uSwTgUFdIaQLE7_0 2024-09-12T02:06:46.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18263889772434292050', time=2024-09-12T03:21:10.197465+0000, chain.objs.size()=1 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vaLxI9S1BDq8b8BuHNqCm8w_1rkyTRk_0 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1296290145087626892', time=2024-09-12T03:21:11.286460+0000, chain.objs.size()=1 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.BIV5OL6ZGEniDg7ZacAYEK4JJ5Ft-Om_0 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11688127795733636728', time=2024-09-12T03:21:11.647297+0000, chain.objs.size()=1 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9ExkMKk_ZJ-4BfYxlSWe25CvtyqwpjT_0 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2571966766188199743', time=2024-09-12T03:21:12.155528+0000, chain.objs.size()=1 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rfkgHyFnT4U-NnJwl8rEPp5amnKLVJG_0 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.694180371884948568', time=2024-09-12T03:21:13.896903+0000, chain.objs.size()=1 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Iaxi0q9cAql1ezCQhYFRS-7qDUIWcCF_0 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624425333033848793', time=2024-09-12T03:21:15.340430+0000, chain.objs.size()=1 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rLmc6QHFt6eJO8RiRFI-oRTpUcjsNG8_0 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15284749578028320202', time=2024-09-12T03:21:16.654490+0000, chain.objs.size()=1 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.g_PPCQr_LxGo4FmaXLVfB4kWkQkqLgH_0 2024-09-12T02:06:46.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5485687005745312764', time=2024-09-12T03:21:17.816342+0000, chain.objs.size()=1 2024-09-12T02:06:46.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4EwpugmaQZYTzz5RsOqpkr7kal00kvI_0 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3422872215067788727', time=2024-09-12T03:21:18.290664+0000, chain.objs.size()=1 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0kPBv54_wm5VmqLPRdKGB_SNiDQwBQI_0 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18103636738745235696', time=2024-09-12T03:21:20.579503+0000, chain.objs.size()=1 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.cbsrcA4aIiiPXssd4HUiW55PmJ8NMpo_0 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6284961945933152347', time=2024-09-12T03:21:20.777704+0000, chain.objs.size()=1 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tJEOYR3lNL59f-WDEYF-N6LIa1U1muV_0 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9482797575632287437', time=2024-09-12T03:21:24.459937+0000, chain.objs.size()=1 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Z5ffYrJTKA9_bZJ5Uowwqr04yBL0fEP_0 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6038636406882433949', time=2024-09-12T03:21:25.143962+0000, chain.objs.size()=1 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gAM3PvCM6A5GotSctVJaozL_Wryl9KT_0 2024-09-12T02:06:46.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16281782736778954683', time=2024-09-12T03:24:31.693251+0000, chain.objs.size()=1 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.411__shadow_.DFiiM2B6mtxviwB0FYUQWeAEXJylgRr_0 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-9j_4cU1rfOydPm8ApEjg9t4RagEXj8', time=2024-09-12T03:36:21.847828+0000, chain.objs.size()=1 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.532__multipart_mymultipart2.2~-9j_4cU1rfOydPm8ApEjg9t4RagEXj8.1 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15195544395643157277', time=2024-09-12T03:39:58.303680+0000, chain.objs.size()=1 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:LdGElMzy7kUyBPKEOCBZ87P8QPYjr3p_.ssxTf7VkXZ_EpHnpOxYbG0_6aMGu3E0_0 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1956941551595310715', time=2024-09-12T03:39:59.702055+0000, chain.objs.size()=1 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:5SEEdtAz9WX0x2xhZZjLJfsRzdFSkNF_.B9g72X-rPhpaWs73yYn8xU_14QjPm7M_0 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12091114618130538724', time=2024-09-12T03:40:25.386287+0000, chain.objs.size()=1 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow_.LkuVQbMA5TTXZYkr1X9nm3AGvmws5aC_0 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16643586481273557384', time=2024-09-12T03:40:58.007395+0000, chain.objs.size()=1 2024-09-12T02:06:46.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:lX9v2oqVNC3K3b-rij3Q0wQhembY.XW_.7x5HjEWO9-xuoL6Jx2R1sdXTNioHmaI_0 2024-09-12T02:06:46.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6363227870532584135', time=2024-09-12T03:42:36.644728+0000, chain.objs.size()=1 2024-09-12T02:06:46.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.580__shadow:grPH8lEVMGzbZvPKpqU0-HdGckZld.m_.dQbgv15qwcwRZW09CWCRPO80b2ZlI5R_0 2024-09-12T02:06:46.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY', time=2024-09-12T03:50:17.921087+0000, chain.objs.size()=12 2024-09-12T02:06:46.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__multipart_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.1 2024-09-12T02:06:46.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__shadow_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.1_1 2024-09-12T02:06:46.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__multipart_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.2 2024-09-12T02:06:46.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__shadow_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.2_1 2024-09-12T02:06:46.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__multipart_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.3 2024-09-12T02:06:46.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__shadow_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.3_1 2024-09-12T02:06:46.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__multipart_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.4 2024-09-12T02:06:46.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__shadow_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.4_1 2024-09-12T02:06:46.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__multipart_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.5 2024-09-12T02:06:46.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__shadow_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.5_1 2024-09-12T02:06:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.554+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__multipart_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.6 2024-09-12T02:06:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.554+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.626__shadow_multipart_enc.2~6bwnRWVWWRk0GuWECVn6aQhB4crPFqY.6_1 2024-09-12T02:06:46.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/58900 2024-09-12T02:06:46.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T02:06:46.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.562+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10260738174715988105', time=2024-09-12T03:56:38.773232+0000, chain.objs.size()=1 2024-09-12T02:06:46.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.562+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.742__shadow_.43vIsOyh36IEK4nMlMtHx48WwQasGsR_0 2024-09-12T02:06:46.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.566+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:46.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.566+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T02:06:46.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:46.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:46.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/61656' 2024-09-12T02:06:46.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13999003814785611360', time=2024-09-12T03:11:12.071116+0000, chain.objs.size()=1 2024-09-12T02:06:46.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.247__shadow_.MXP4wVUrypX0iN2cmNeeoZlPoU52smE_0 2024-09-12T02:06:46.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7377426131402634027', time=2024-09-12T03:11:14.556394+0000, chain.objs.size()=1 2024-09-12T02:06:46.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.248__shadow_.Lspkb5QoKb8sNMx7k0RaM0z378dx-ra_0 2024-09-12T02:06:46.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15456118660330400465', time=2024-09-12T03:11:39.493908+0000, chain.objs.size()=1 2024-09-12T02:06:46.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.258__shadow_.X_kbNt08IPikpSrKjtBdc81XIReEFoX_0 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6804213976854984980', time=2024-09-12T03:13:34.358611+0000, chain.objs.size()=1 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.LZGcvmqw2-YAwu9tvhEXHUr6INni_kM_0 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5291961971276024749', time=2024-09-12T03:13:38.334707+0000, chain.objs.size()=1 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xb1X5Zxd3Ng2lF0-mMuErnJENE6_B91_0 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2209797673884012705', time=2024-09-12T03:13:38.875997+0000, chain.objs.size()=1 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ssUdG2t84Uwzj_M96yk6MHLpJY_Tqnz_0 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11808077962563618486', time=2024-09-12T03:13:39.287614+0000, chain.objs.size()=1 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QVJG5qXpvdr2xADFyug9xkxNNjyU4bY_0 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1041356238800513452', time=2024-09-12T03:13:39.531304+0000, chain.objs.size()=1 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.43xcGt0gvx1k8uThn5f2dWfHSZejSC7_0 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13598161243673641616', time=2024-09-12T03:13:39.802870+0000, chain.objs.size()=1 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.n5-4aY8nszAquzLLSRjUke76O3yU2Yb_0 2024-09-12T02:06:46.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3195756482037919178', time=2024-09-12T03:13:39.890683+0000, chain.objs.size()=1 2024-09-12T02:06:46.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.LRAQR90ZESQkW6XqaI2_0BZ9y6p9spd_0 2024-09-12T02:06:46.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16175451863202706609', time=2024-09-12T03:13:41.327488+0000, chain.objs.size()=1 2024-09-12T02:06:46.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rbuL8vwIo4SnINlQw3xjS6dUBb1Cmu0_0 2024-09-12T02:06:46.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16856831332781605681', time=2024-09-12T03:13:45.408798+0000, chain.objs.size()=1 2024-09-12T02:06:46.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.570+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vDXHmfu9VSbKmU2lpVD-MfYuMX34zgM_0 2024-09-12T02:06:46.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4935224515360439030', time=2024-09-12T03:13:45.448378+0000, chain.objs.size()=1 2024-09-12T02:06:46.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vAEMEnPLDj3c5bFaklOw0LftZnc5PWo_0 2024-09-12T02:06:46.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3178564190415285140', time=2024-09-12T03:13:47.602439+0000, chain.objs.size()=1 2024-09-12T02:06:46.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.FK0R7cIurhWz46wBVose-xZ8Rl9mJeI_0 2024-09-12T02:06:46.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3570092854491947191', time=2024-09-12T03:13:48.553434+0000, chain.objs.size()=1 2024-09-12T02:06:46.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RiuLlhZbPnVWwMiPGLEaBYc--Xg7ipe_0 2024-09-12T02:06:46.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18365655485252282922', time=2024-09-12T03:13:48.632206+0000, chain.objs.size()=1 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cjnBc6T_Mv3QEzzq_QeUgOIkoYRV81s_0 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17752548770254222234', time=2024-09-12T03:13:49.290536+0000, chain.objs.size()=1 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pBtxSUmzjES0bE74aVumwVuBNSAWZ8A_0 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9126732882216133004', time=2024-09-12T03:13:51.279613+0000, chain.objs.size()=1 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.X6D1NmulfxNXr2aRmlLcADnU5G9DgsI_0 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14139020464222202239', time=2024-09-12T03:13:51.585514+0000, chain.objs.size()=1 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CFeRAhGcUyXNYOEgEPpmTWCI-u62r4B_0 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1972230593023866778', time=2024-09-12T03:13:51.703747+0000, chain.objs.size()=1 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xw7c2mn96lhgXJdXRgKayxHRI1KO_c1_0 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14637561571273951822', time=2024-09-12T03:13:51.945544+0000, chain.objs.size()=1 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.LxQK3Ygufp_5gC0iLSq7bpNGsZ562Gs_0 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2768100544540746462', time=2024-09-12T03:13:52.183027+0000, chain.objs.size()=1 2024-09-12T02:06:46.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.u2G5WLGLJTYXleOCLMmxNgRwBFfka0A_0 2024-09-12T02:06:46.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6003145729906259210', time=2024-09-12T03:13:52.185046+0000, chain.objs.size()=1 2024-09-12T02:06:46.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.574+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.nGIrLfR1fT8jms4GkGc20z2NXShwp2R_0 2024-09-12T02:06:46.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8196874443884630353', time=2024-09-12T03:13:52.238551+0000, chain.objs.size()=1 2024-09-12T02:06:46.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.wKm9TZyFJmGkx93ae033MDYFNswZoqg_0 2024-09-12T02:06:46.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17459290938103095417', time=2024-09-12T03:13:52.693444+0000, chain.objs.size()=1 2024-09-12T02:06:46.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hSxoVeBL-MC2EsPraH8qcIRtOGBXLRa_0 2024-09-12T02:06:46.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10248762604079086893', time=2024-09-12T03:13:53.661393+0000, chain.objs.size()=1 2024-09-12T02:06:46.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9TTBFlgq2xKbspo_KXAHySDXNaD3s6A_0 2024-09-12T02:06:46.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.578+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3912642814303924056', time=2024-09-12T03:13:55.673608+0000, chain.objs.size()=1 2024-09-12T02:06:46.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.578+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.VVTjlojP_iOw7zo1we1jnjkAr-kKkvl_0 2024-09-12T02:06:46.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11718755580341233086', time=2024-09-12T03:13:56.021132+0000, chain.objs.size()=1 2024-09-12T02:06:46.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xi-d21XcOBiDU2ieK9IPHvbUrcMuf1J_0 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5579470345561491253', time=2024-09-12T03:13:56.122344+0000, chain.objs.size()=1 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.32ZEgjUIBw_Eda26v84UQ5TZWq3lArX_0 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16283146549891725423', time=2024-09-12T03:13:56.129623+0000, chain.objs.size()=1 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.zrHvhdHjfn4SwkqsgonV4_vzu_WY3m2_0 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.659872211738284597', time=2024-09-12T03:13:58.845517+0000, chain.objs.size()=1 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.959eGRlWnq1lbGLOFnc_uejmENNM_tq_0 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14759106070357847505', time=2024-09-12T03:13:59.716994+0000, chain.objs.size()=1 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JYRw8ZpjzFrWFxM5YuTXplZ63FnmQe5_0 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8774352163549839025', time=2024-09-12T03:13:59.886208+0000, chain.objs.size()=1 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JvekDPRBbA81ChC1w4OpIg9IqDWmjm8_0 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9428476727765361995', time=2024-09-12T03:14:01.812004+0000, chain.objs.size()=1 2024-09-12T02:06:46.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cg-MLxV9TV4t5aRYqpI8eO2F1k7Wpmt_0 2024-09-12T02:06:46.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16993757325336059530', time=2024-09-12T03:14:22.207011+0000, chain.objs.size()=1 2024-09-12T02:06:46.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.582+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.270__shadow_.itEIYuI9TckVZLtLJBN8qFX0ux_CLKQ_0 2024-09-12T02:06:46.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12143587821032598914', time=2024-09-12T03:14:34.089003+0000, chain.objs.size()=1 2024-09-12T02:06:46.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.275__shadow_.Q-5HZLDT3L0tS9e0U3zzzd5l0vid3sS_0 2024-09-12T02:06:46.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.44196171363091677', time=2024-09-12T03:14:46.656386+0000, chain.objs.size()=1 2024-09-12T02:06:46.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.280__shadow_.nfOKY17uoKEqW-8v1qAyTfXRFwHMY5d_0 2024-09-12T02:06:46.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.586+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13747103867073658037', time=2024-09-12T03:15:01.990712+0000, chain.objs.size()=1 2024-09-12T02:06:46.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.586+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.286__shadow_.kzIh84Bly7X9tkzM9xtgieSAvE7Rx_o_0 2024-09-12T02:06:46.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5548069162288201510', time=2024-09-12T03:15:12.134046+0000, chain.objs.size()=1 2024-09-12T02:06:46.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.290__shadow_._xwPmrh8StgY1IpATBsHneS_dX-b8Br_0 2024-09-12T02:06:46.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7067230490727571384', time=2024-09-12T03:15:12.155700+0000, chain.objs.size()=1 2024-09-12T02:06:46.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.290__shadow_.NXUKtpYFW0DMeI-NqqDyVrGxaf5bJ3F_0 2024-09-12T02:06:46.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10349604515889658072', time=2024-09-12T03:15:34.840085+0000, chain.objs.size()=1 2024-09-12T02:06:46.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.296__shadow_.viYQjYNWwCoSyHuac6vtP5AAw81Rz71_0 2024-09-12T02:06:46.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7263163061172657915', time=2024-09-12T03:15:55.167476+0000, chain.objs.size()=1 2024-09-12T02:06:46.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.304__shadow_.q2Jm-otpI5ClYjOIZ6n0GvM6Hbh0Z8M_0 2024-09-12T02:06:46.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8152440728906447340', time=2024-09-12T03:16:00.156898+0000, chain.objs.size()=1 2024-09-12T02:06:46.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.306__shadow_.WaAT9K-q8TfvooRWJ0wLN8FuAGz0SwD_0 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16057153923091351203', time=2024-09-12T03:18:36.380748+0000, chain.objs.size()=1 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jAUjpZsyyrDI9kw1WVohL-PCPQgQhn-_0 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6101649423895948658', time=2024-09-12T03:18:37.327251+0000, chain.objs.size()=1 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oLfFtQiyh8apVYlVkj7j3gU_dPOXlZW_0 2024-09-12T02:06:46.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12662423524631593443', time=2024-09-12T03:18:37.870719+0000, chain.objs.size()=1 2024-09-12T02:06:46.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.590+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xTppTlQy1-Z05V0ZRbEHWi6qUUeRzT8_0 2024-09-12T02:06:46.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2152253861632024097', time=2024-09-12T03:18:38.661500+0000, chain.objs.size()=1 2024-09-12T02:06:46.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QqMbxGXvaslxAKbBFt2C_3XsRF2Fr7F_0 2024-09-12T02:06:46.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2058071007274054041', time=2024-09-12T03:18:39.119269+0000, chain.objs.size()=1 2024-09-12T02:06:46.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.N0zcbbZCnbcIwSRO4Z0MZgkg-cH4dYk_0 2024-09-12T02:06:46.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1457138062172203294', time=2024-09-12T03:18:39.613209+0000, chain.objs.size()=1 2024-09-12T02:06:46.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jR0vv6P9qmCTZ3oWyDr5rCe7ARK2YSS_0 2024-09-12T02:06:46.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7057022325848592726', time=2024-09-12T03:18:41.288382+0000, chain.objs.size()=1 2024-09-12T02:06:46.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.1qPgG8hbD8yjyTwcO4Arf15_O0w0s4R_0 2024-09-12T02:06:46.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5159425214095217889', time=2024-09-12T03:18:42.147074+0000, chain.objs.size()=1 2024-09-12T02:06:46.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.pzDpF1DVHRmayN8XfEjMSogIKv7SIx2_0 2024-09-12T02:06:46.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7493211959843926027', time=2024-09-12T03:18:45.382492+0000, chain.objs.size()=1 2024-09-12T02:06:46.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.594+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yklv8FQver8I0eyb4KSOjFZYf8RxT6J_0 2024-09-12T02:06:46.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4286484866513645105', time=2024-09-12T03:18:47.463028+0000, chain.objs.size()=1 2024-09-12T02:06:46.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._8BC-ku2Wf3pxIXULDgdQBAROi4AZGJ_0 2024-09-12T02:06:46.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9564898470033414208', time=2024-09-12T03:18:49.208154+0000, chain.objs.size()=1 2024-09-12T02:06:46.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3CJLXFmZhm1AyttLfEG8R-zh8To4LNI_0 2024-09-12T02:06:46.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4888170980826938784', time=2024-09-12T03:18:51.085540+0000, chain.objs.size()=1 2024-09-12T02:06:46.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.YrLTnkhIHO_DawxFpzWVWYTHgrRJ7Jr_0 2024-09-12T02:06:46.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11779724307920884980', time=2024-09-12T03:18:53.830196+0000, chain.objs.size()=1 2024-09-12T02:06:46.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qudl3lBSVlPrSIuT1sqkXDOIMJkMHl1_0 2024-09-12T02:06:46.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4456193404827861353', time=2024-09-12T03:18:56.153994+0000, chain.objs.size()=1 2024-09-12T02:06:46.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.adt74iQjithuLl72o6HjdeBrCrX2cWI_0 2024-09-12T02:06:46.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3396395647621114297', time=2024-09-12T03:18:56.295705+0000, chain.objs.size()=1 2024-09-12T02:06:46.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.598+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.HPrBGP6hCyZJsMPTy_9GjHKSYFi86UR_0 2024-09-12T02:06:46.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1475220877135254143', time=2024-09-12T03:18:58.265232+0000, chain.objs.size()=1 2024-09-12T02:06:46.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.lHiFQhJzhxCbQURJEkpuM0J2qLHzg62_0 2024-09-12T02:06:46.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7521473823874796954', time=2024-09-12T03:18:58.941760+0000, chain.objs.size()=1 2024-09-12T02:06:46.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.y5dZGEBqjjWD2Wz5tyklp34aKvRUzXX_0 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7316837251555625126', time=2024-09-12T03:19:00.354409+0000, chain.objs.size()=1 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.X3jkLs7l_Fq6BDIb-kPXk3IsY-GHf74_0 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11966058442553161296', time=2024-09-12T03:19:02.343586+0000, chain.objs.size()=1 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Cav63jcRY1fLOcgOfpCU5dBh2ilB-cK_0 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13278957635320357438', time=2024-09-12T03:19:02.894860+0000, chain.objs.size()=1 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CRSJuL_hLB-jAj3xR0Z94ZEr1SG-u4H_0 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11509826700081360424', time=2024-09-12T03:19:04.445501+0000, chain.objs.size()=1 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.j-KG8HolQer5qz4cSRz4cTrzo_92Q-Y_0 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5815517167900848584', time=2024-09-12T03:19:04.501114+0000, chain.objs.size()=1 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.o08XHCcwUrR6lA0_N_4DXYf2zvn3dOB_0 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7451166327647126599', time=2024-09-12T03:19:06.261320+0000, chain.objs.size()=1 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LVioBVGPTvg9M67bO2NpaZO9s1umHEi_0 2024-09-12T02:06:46.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10009848625967255313', time=2024-09-12T03:19:06.420460+0000, chain.objs.size()=1 2024-09-12T02:06:46.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AJbqNyGCCZcy6vOl33SfChnC8isUlqr_0 2024-09-12T02:06:46.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2326027042773900031', time=2024-09-12T03:19:06.628939+0000, chain.objs.size()=1 2024-09-12T02:06:46.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.602+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.imvMWBvGAqy6VvlbLRZ_z519xArCsYg_0 2024-09-12T02:06:46.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.547118872981859669', time=2024-09-12T03:19:07.083680+0000, chain.objs.size()=1 2024-09-12T02:06:46.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.r-ZTfPObLZCvjNese_5A7xDDPVOlpuD_0 2024-09-12T02:06:46.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.606+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15201696067458678578', time=2024-09-12T03:19:07.535804+0000, chain.objs.size()=1 2024-09-12T02:06:46.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.606+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fPoN7O911aH9l_c5BKh-R1UGLs-f2_-_0 2024-09-12T02:06:46.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11002220027241739393', time=2024-09-12T03:20:54.799717+0000, chain.objs.size()=1 2024-09-12T02:06:46.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.R7MReZnQ3VPQKyZXxFYMuxVEn1Lu1sa_0 2024-09-12T02:06:46.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6938142226281901297', time=2024-09-12T03:20:55.662465+0000, chain.objs.size()=1 2024-09-12T02:06:46.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.k5pnuSiY3t93SZh628eC9tGOtM_bxrr_0 2024-09-12T02:06:46.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16561326137111279010', time=2024-09-12T03:20:56.739167+0000, chain.objs.size()=1 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rabutDidays9IRRNBTIYR7Jn4O_ezSI_0 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14769995759538122496', time=2024-09-12T03:20:58.784309+0000, chain.objs.size()=1 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NlBbdgpzdRsOTIvjBKl1Z2_RWjINwym_0 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4441122265975287100', time=2024-09-12T03:21:00.541596+0000, chain.objs.size()=1 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YP059_qf4sYYp8vHvkOJgDEENqEZIN6_0 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4935103097832310057', time=2024-09-12T03:21:01.342107+0000, chain.objs.size()=1 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.eLbmAtmoMpxcuYH8x17IJlIIpMXZmFS_0 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14908048962195420551', time=2024-09-12T03:21:02.983712+0000, chain.objs.size()=1 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hmxHOr-jyTEix6ntiEIWBS7K_y5sLuU_0 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14499467357800502826', time=2024-09-12T03:21:03.954071+0000, chain.objs.size()=1 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1ewLhfrF8vyLaRwyBalbPTB-G79yLkN_0 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12038263158793654408', time=2024-09-12T03:21:04.105428+0000, chain.objs.size()=1 2024-09-12T02:06:46.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wLy7p3N1Sfj8xVRE9j6Q4MyoJL7pWtd_0 2024-09-12T02:06:46.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3826760440042385626', time=2024-09-12T03:21:05.417494+0000, chain.objs.size()=1 2024-09-12T02:06:46.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.610+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IWlNie7jbqGynwtyG5dWme83trHkNUk_0 2024-09-12T02:06:46.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.614+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.286718278803751044', time=2024-09-12T03:21:07.012301+0000, chain.objs.size()=1 2024-09-12T02:06:46.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.614+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.f3UidJU9rx-9bMvaaDKcjNcvyyAuyEF_0 2024-09-12T02:06:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.614+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11793214789802430012', time=2024-09-12T03:21:09.983284+0000, chain.objs.size()=1 2024-09-12T02:06:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.614+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.jkM3LY7YpavFko0vF8deR8QlH6uF8ij_0 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18294036295747836137', time=2024-09-12T03:21:12.615135+0000, chain.objs.size()=1 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.HDBla2bwQP4fHzKpSVrS-sn8QitZvE0_0 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16618165698064660380', time=2024-09-12T03:21:13.075797+0000, chain.objs.size()=1 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.cHD9OBdEfVEE3-J5mQAZkp8_UKFK4Ay_0 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2744993770380107714', time=2024-09-12T03:21:14.166799+0000, chain.objs.size()=1 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.LpNqhbgpSAJMiWfClaS7JBsWvGEArML_0 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16185603484394740971', time=2024-09-12T03:21:15.183380+0000, chain.objs.size()=1 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8ri6GHMRNFiD0WFPrlet1YxnAUt9hx__0 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5640012195148562648', time=2024-09-12T03:21:15.569759+0000, chain.objs.size()=1 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.csscpD439-aghyLu6CeSxt644LHlHkq_0 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.26777870350248948', time=2024-09-12T03:21:15.803127+0000, chain.objs.size()=1 2024-09-12T02:06:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.cOYuou9M2-z4MwyUkWwOp4rUwmSpGuL_0 2024-09-12T02:06:46.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3897758022655675231', time=2024-09-12T03:21:16.767309+0000, chain.objs.size()=1 2024-09-12T02:06:46.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RBsGvuuKf9zRvihuF2AzvYHaiSO2LMU_0 2024-09-12T02:06:46.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16936984040541658646', time=2024-09-12T03:21:16.942843+0000, chain.objs.size()=1 2024-09-12T02:06:46.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zkXaPtBJF1s4tUBzQtU0vH7SbC3TZ6Y_0 2024-09-12T02:06:46.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12954493101831982270', time=2024-09-12T03:21:16.944769+0000, chain.objs.size()=1 2024-09-12T02:06:46.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Hqgz_fPiZ0E2AJfYJNRBSieb37gxY_H_0 2024-09-12T02:06:46.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4597689626241641484', time=2024-09-12T03:21:17.353925+0000, chain.objs.size()=1 2024-09-12T02:06:46.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.618+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.VWYrx4-dU7rM6KO8--JSl9Q_SmDYDL9_0 2024-09-12T02:06:46.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.622+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8778392750077424205', time=2024-09-12T03:21:17.935443+0000, chain.objs.size()=1 2024-09-12T02:06:46.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.622+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8LGrPzpc-a1kjkFo45SwprdqoCpdO_k_0 2024-09-12T02:06:46.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.622+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15792784977858394959', time=2024-09-12T03:21:18.073270+0000, chain.objs.size()=1 2024-09-12T02:06:46.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.622+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._RP4UdWp2sHRAlOi0QH4xy_Qz-LZc03_0 2024-09-12T02:06:46.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.246036728157278981', time=2024-09-12T03:21:18.409938+0000, chain.objs.size()=1 2024-09-12T02:06:46.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6eqPJnm7k349WsA_JLnp5XEHzFI5OZA_0 2024-09-12T02:06:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6292227749573759084', time=2024-09-12T03:21:18.453240+0000, chain.objs.size()=1 2024-09-12T02:06:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.AlMC1SWxzTWRyM1An8oVFeepAMXG5BV_0 2024-09-12T02:06:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15156940910317656007', time=2024-09-12T03:21:20.110714+0000, chain.objs.size()=1 2024-09-12T02:06:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vPCJL7tII2wgJy43dzSv867_CYBitn1_0 2024-09-12T02:06:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3757813797671861777', time=2024-09-12T03:21:20.336480+0000, chain.objs.size()=1 2024-09-12T02:06:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3ESKRu7RLuUrMbUyK7J84RPB5QyUCxV_0 2024-09-12T02:06:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15477531346546065726', time=2024-09-12T03:21:21.583035+0000, chain.objs.size()=1 2024-09-12T02:06:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gqAWk-AmtVK3nvu9z9fwpOM_HxlIGqj_0 2024-09-12T02:06:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15788361470525018543', time=2024-09-12T03:21:22.028811+0000, chain.objs.size()=1 2024-09-12T02:06:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.626+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ggOtRpPo5wxSTWp35oR96fSHx9qPhHh_0 2024-09-12T02:06:46.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.630+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/61656 2024-09-12T02:06:46.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T02:06:46.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17671362094713493870', time=2024-09-12T03:21:22.102660+0000, chain.objs.size()=1 2024-09-12T02:06:46.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.QUgdQ0DVmQd36kGPa1Xj6R2u1UYxI4z_0 2024-09-12T02:06:46.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17722215332796233127', time=2024-09-12T03:21:23.578773+0000, chain.objs.size()=1 2024-09-12T02:06:46.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2P3-zpi2YQg9ZA25tECqqn2jL3rD12b_0 2024-09-12T02:06:46.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12124059295879501717', time=2024-09-12T03:21:24.480606+0000, chain.objs.size()=1 2024-09-12T02:06:46.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lFyqMTSBElP419roxq8321csjrBr-fi_0 2024-09-12T02:06:46.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.698066937532544135', time=2024-09-12T03:21:24.548247+0000, chain.objs.size()=1 2024-09-12T02:06:46.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4BKzWQM2hQDS7mfzOPHVh-O2RgmAo7u_0 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11515589816049901817', time=2024-09-12T03:21:24.846783+0000, chain.objs.size()=1 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DOtHPdI4oMnU8jJOx-71ug49hRWdeTQ_0 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9777544686462651066', time=2024-09-12T03:21:24.926079+0000, chain.objs.size()=1 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5l69pmN8dT0PPx9FXvoIiM4Vw8h8woi_0 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1471644097018039250', time=2024-09-12T03:21:25.082687+0000, chain.objs.size()=1 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.GwZrH_czTxrlj_rIoDRkrOtmTaZEvOb_0 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.237264274706254309', time=2024-09-12T03:21:29.885890+0000, chain.objs.size()=1 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.327__shadow_.HKjq4mGu-93Ej9EYlPoyvNzxocV6uov_0 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10154428464756704346', time=2024-09-12T03:26:43.664485+0000, chain.objs.size()=1 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.464__shadow_.BoEC3UEk2nUnr7jgvpl2fzSzW-4P-30_0 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.51798997282307681', time=2024-09-12T03:26:45.933589+0000, chain.objs.size()=1 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.465__shadow_.sNoAy0Pq47kAhkVNkE2jCymbmlaDqIB_0 2024-09-12T02:06:46.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13003675947489780054', time=2024-09-12T03:26:46.860299+0000, chain.objs.size()=1 2024-09-12T02:06:46.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.465__shadow_.O1xKvLsPXeWBOcVxWvafT4e611-wUhK_0 2024-09-12T02:06:46.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17080785534971871035', time=2024-09-12T03:27:24.867574+0000, chain.objs.size()=1 2024-09-12T02:06:46.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.634+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.485__shadow_.Ul6_2UAvJCTXCGgTZj-htppfmSOexgT_0 2024-09-12T02:06:46.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9182871861949198119', time=2024-09-12T03:28:14.230688+0000, chain.objs.size()=1 2024-09-12T02:06:46.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.504__shadow:xY.qSzc8-FZgL.PAZY7yve8r0PrFDvj_.feVFZUiV-D7oBnX7pKoH2iGI2T3glrn_0 2024-09-12T02:06:46.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.638+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12256838877379047452', time=2024-09-12T03:35:25.043797+0000, chain.objs.size()=3 2024-09-12T02:06:46.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~CWHoXgWAJrEzfs1J_n6CZFqq4RHzGjJ.1 2024-09-12T02:06:46.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.638+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~CWHoXgWAJrEzfs1J_n6CZFqq4RHzGjJ.2 2024-09-12T02:06:46.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.526__multipart_mymultipart.2~CWHoXgWAJrEzfs1J_n6CZFqq4RHzGjJ.3 2024-09-12T02:06:46.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.943816154034140958', time=2024-09-12T03:35:34.200995+0000, chain.objs.size()=1 2024-09-12T02:06:46.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.525__shadow_.rnSvxzhrycYSf0FPjC5-bkzs6yIYvVv_0 2024-09-12T02:06:46.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4206377995003260972', time=2024-09-12T03:39:31.494622+0000, chain.objs.size()=2 2024-09-12T02:06:46.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.564__shadow_.DlQ1snsOSG5NfEjF-lIp4MPxZCMBE3t_0 2024-09-12T02:06:46.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.564__shadow_.DlQ1snsOSG5NfEjF-lIp4MPxZCMBE3t_1 2024-09-12T02:06:46.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17620399495170168782', time=2024-09-12T03:40:46.295155+0000, chain.objs.size()=1 2024-09-12T02:06:46.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.577__shadow:89OGSso.w4IImm7Af8WhjXHTXU2iQYX_.CPSUgXeIE3luRLr7q_3Br7USBvMSG3o_0 2024-09-12T02:06:46.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15369643112083702575', time=2024-09-12T03:42:42.621900+0000, chain.objs.size()=1 2024-09-12T02:06:46.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.581__shadow:W1gw7KSJb0ym1nSssR.icJZD04Kf0JX_.cnCnDlyoTVbPSGJhhaFPkVWom_WMjuU_0 2024-09-12T02:06:46.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14337947187174068886', time=2024-09-12T03:42:45.720149+0000, chain.objs.size()=1 2024-09-12T02:06:46.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.583__shadow:lNIck4ByrdCFMfco7C1LPGqkQXdAYcr_.fE0qfWiDsrfSetmZoZUjoTXvhdWiGCB_0 2024-09-12T02:06:46.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9250368649453818137', time=2024-09-12T03:50:29.424039+0000, chain.objs.size()=1 2024-09-12T02:06:46.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.631__shadow_.2rsDE2puA_yzlqoOes7Y0F3iiTe4ZRb_0 2024-09-12T02:06:46.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6352870127952053121', time=2024-09-12T03:50:59.737939+0000, chain.objs.size()=1 2024-09-12T02:06:46.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.643__shadow_.MQCf-Q-TVhqQMs53Wt8jyKZcloMkIcm_0 2024-09-12T02:06:46.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.69305822558823976', time=2024-09-12T03:51:26.253048+0000, chain.objs.size()=2 2024-09-12T02:06:46.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.648__shadow_.zezgkvtOmemtQDHo3bXEh4xhr2aeXKu_0 2024-09-12T02:06:46.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.642+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.648__shadow_.zezgkvtOmemtQDHo3bXEh4xhr2aeXKu_1 2024-09-12T02:06:46.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16674504614384917507', time=2024-09-12T03:53:11.497319+0000, chain.objs.size()=1 2024-09-12T02:06:46.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.646+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.666__shadow_.oa_8DrO4-rnDY8yqRorVYcaoiI-nuCi_0 2024-09-12T02:06:46.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.646+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8145845441479814858', time=2024-09-12T03:54:28.316416+0000, chain.objs.size()=1 2024-09-12T02:06:46.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.646+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.703__multipart_file1.2~04Ycui0BTY9JoFMH3xHaHRcs4LL9lYn.1 2024-09-12T02:06:46.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.654+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:46.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.654+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T02:06:46.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:46.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:46.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44042' 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3814494918189304454', time=2024-09-12T03:05:34.659613+0000, chain.objs.size()=1 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.182__shadow_.uIP8SEYmypIVmPXz7hpk33MoB4kuIuE_0 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9253706880925696078', time=2024-09-12T03:10:32.798574+0000, chain.objs.size()=1 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.234__shadow_.Auw_0SlxGwnIJsDltS4Ik7H7iwRF39e_0 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14626294628541581062', time=2024-09-12T03:13:33.887578+0000, chain.objs.size()=1 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.B4RLimhETvA930zJHAo_S6WCGUhCskC_0 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1309724368899804683', time=2024-09-12T03:13:35.499397+0000, chain.objs.size()=1 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QxnymwBH47v4v6MwrOziuQtxNWtOJun_0 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15608355542983019199', time=2024-09-12T03:13:35.799947+0000, chain.objs.size()=1 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4rgfBqV56Fmn0KLH2QER7TXfVr5qprW_0 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1246467833924904780', time=2024-09-12T03:13:36.414038+0000, chain.objs.size()=1 2024-09-12T02:06:46.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.H_mOMUJUHML7Uz2jEtYCBzefknTNrgR_0 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9899108098583036320', time=2024-09-12T03:13:38.305200+0000, chain.objs.size()=1 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.AM8bypVoL-4Js337VQiYdcdtNN7IQS2_0 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14702603862398145164', time=2024-09-12T03:13:38.316199+0000, chain.objs.size()=1 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Cx4eR1AapWPYoj8mUR9WKFSuHKiucIP_0 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2468117567758077900', time=2024-09-12T03:13:38.745149+0000, chain.objs.size()=1 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.U0m0caR99QNKbNGY6NPI75D9nbjnPXJ_0 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12688828880963229587', time=2024-09-12T03:13:40.016845+0000, chain.objs.size()=1 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.e4KvI0oWJpKF7PEDddxBILsojC7vTid_0 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4194675131153918936', time=2024-09-12T03:13:40.381379+0000, chain.objs.size()=1 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Y6VBQQI-CcW-t89fg0oau1VaxA6BBK3_0 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18217395766996370919', time=2024-09-12T03:13:40.604539+0000, chain.objs.size()=1 2024-09-12T02:06:46.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.662+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aJqAvNtzqGXNIcQpXfCw6updACGXN2V_0 2024-09-12T02:06:46.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.666+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15137332674242744356', time=2024-09-12T03:13:41.499392+0000, chain.objs.size()=1 2024-09-12T02:06:46.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.666+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._EicPenctNEJriuysTL5jkl5UzuIz15_0 2024-09-12T02:06:46.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.666+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14497736382240264964', time=2024-09-12T03:13:42.893848+0000, chain.objs.size()=1 2024-09-12T02:06:46.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.666+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Ebv3GrYvRx1hE0HDpYmHtUhMhv2yf6m_0 2024-09-12T02:06:46.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.666+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12420911573486569805', time=2024-09-12T03:13:42.895690+0000, chain.objs.size()=1 2024-09-12T02:06:46.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.666+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4Mg-OgoVh5cmh1ImPboCHs1UQLl-HO5_0 2024-09-12T02:06:46.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5706053475566052925', time=2024-09-12T03:13:44.444788+0000, chain.objs.size()=1 2024-09-12T02:06:46.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8B5uWqf4IUT60E8gHG8N2iR9qjYG3Yt_0 2024-09-12T02:06:46.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14003631828587143772', time=2024-09-12T03:13:45.569482+0000, chain.objs.size()=1 2024-09-12T02:06:46.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.WL3hbQKWoa-UFt03kHoFRRFIFzXOClw_0 2024-09-12T02:06:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9737506584934443646', time=2024-09-12T03:13:48.660552+0000, chain.objs.size()=1 2024-09-12T02:06:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.fvmwhUsj_xDp-dtLAgxentoS226Fmai_0 2024-09-12T02:06:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13064419934852007786', time=2024-09-12T03:13:49.427723+0000, chain.objs.size()=1 2024-09-12T02:06:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6v4IYKigSsR1Id7ZM2mYGqDKJHV6aqO_0 2024-09-12T02:06:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6995737333729710263', time=2024-09-12T03:13:50.854221+0000, chain.objs.size()=1 2024-09-12T02:06:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.PNQAd8-ZFxhcgkZaK8PKVWeulT4ziMi_0 2024-09-12T02:06:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12614238242326791802', time=2024-09-12T03:13:50.855801+0000, chain.objs.size()=1 2024-09-12T02:06:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hNl0wrv5eDh6q0X5B2KnhYVyI6YIVqf_0 2024-09-12T02:06:46.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17654049963975563814', time=2024-09-12T03:13:50.948781+0000, chain.objs.size()=1 2024-09-12T02:06:46.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.my2R7iDB1_LVbh2OrtX4POyv5fn3U2F_0 2024-09-12T02:06:46.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13095667211062815119', time=2024-09-12T03:13:51.840945+0000, chain.objs.size()=1 2024-09-12T02:06:46.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.nOQ1lRRnrGwxvmy0ZmRMxGaL6eFUD2O_0 2024-09-12T02:06:46.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9603874733520067195', time=2024-09-12T03:13:52.126694+0000, chain.objs.size()=1 2024-09-12T02:06:46.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.670+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2yNB16eBwvz0AV9hkip62ILkYis6RtX_0 2024-09-12T02:06:46.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6865026364254158021', time=2024-09-12T03:13:52.476041+0000, chain.objs.size()=1 2024-09-12T02:06:46.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vAxoRf_nIAXS8QUoEDZbQ90JWe24bbe_0 2024-09-12T02:06:46.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2216459106472098040', time=2024-09-12T03:13:53.385289+0000, chain.objs.size()=1 2024-09-12T02:06:46.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pRUW20LHkoncpG9y1g8qFAEiyCTJ01z_0 2024-09-12T02:06:46.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.836303223193462252', time=2024-09-12T03:13:55.671364+0000, chain.objs.size()=1 2024-09-12T02:06:46.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Svu-IotxDXk0Khlqt6Bl546JDXpl_Bd_0 2024-09-12T02:06:46.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1833751564649210194', time=2024-09-12T03:13:56.935736+0000, chain.objs.size()=1 2024-09-12T02:06:46.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pHw6napOBQJ9YfoPFredxqJ_OzTEH-E_0 2024-09-12T02:06:46.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.674+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8288175039099440211', time=2024-09-12T03:13:57.160193+0000, chain.objs.size()=1 2024-09-12T02:06:46.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.674+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ZcToWb1OrcktLGlU4Pv5xhAZK1LKg2J_0 2024-09-12T02:06:46.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8833002681570346595', time=2024-09-12T03:13:58.869475+0000, chain.objs.size()=1 2024-09-12T02:06:46.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.c1qlIXBm70dgFGH1QVGEtEM4nW5Aims_0 2024-09-12T02:06:46.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15613418726276381143', time=2024-09-12T03:14:00.559732+0000, chain.objs.size()=1 2024-09-12T02:06:46.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GhmphSIQ8q5IFEG3S_UspbHZithKaGA_0 2024-09-12T02:06:46.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5592411937064718138', time=2024-09-12T03:14:00.640527+0000, chain.objs.size()=1 2024-09-12T02:06:46.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.97mKBHXTIwNviECdzJMU3IHi2bQFizO_0 2024-09-12T02:06:46.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2976805870003428212', time=2024-09-12T03:14:04.844372+0000, chain.objs.size()=1 2024-09-12T02:06:46.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.k636wSWb5ffe6rgROZxUcdtp0W0klG4_0 2024-09-12T02:06:46.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3841129522341815607', time=2024-09-12T03:14:12.616485+0000, chain.objs.size()=1 2024-09-12T02:06:46.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.266__shadow_.60_bMlXn4-TKPEsVPMVij2uens8Ut_N_0 2024-09-12T02:06:46.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5423781862740563449', time=2024-09-12T03:14:15.025442+0000, chain.objs.size()=1 2024-09-12T02:06:46.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.267__shadow_.ArNlaHzLzyXKlkuXU7uOMqcDiEcwwz2_0 2024-09-12T02:06:46.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10096688650138353622', time=2024-09-12T03:14:49.208614+0000, chain.objs.size()=1 2024-09-12T02:06:46.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.678+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.281__shadow_.X1i1qPqSeubANAAZ4n4UNI6eqRSGvyG_0 2024-09-12T02:06:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9038850201477526458', time=2024-09-12T03:14:59.393590+0000, chain.objs.size()=1 2024-09-12T02:06:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.285__shadow_.-ggtHSexkNpnAEWGe6ONPAMzyPl81ue_0 2024-09-12T02:06:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10490208098675091993', time=2024-09-12T03:15:07.099783+0000, chain.objs.size()=1 2024-09-12T02:06:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.288__shadow_.OEYfxRij7sfKz0eQaAGL8HaJC_g0RSg_0 2024-09-12T02:06:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9403805956942225206', time=2024-09-12T03:15:23.596210+0000, chain.objs.size()=1 2024-09-12T02:06:46.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.tJVVlYrhlWE2SKBN1n-fPd1-zqnnMj0_0 2024-09-12T02:06:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6342624609450211787', time=2024-09-12T03:15:29.367953+0000, chain.objs.size()=1 2024-09-12T02:06:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.F1aRDDSj9HnkfHbNcvmuMQn9k6gJ7kC_0 2024-09-12T02:06:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8273146656980885188', time=2024-09-12T03:15:42.538197+0000, chain.objs.size()=1 2024-09-12T02:06:46.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.299__shadow_.bv2pLskVg1Ahlr4cSKO73rHKnGTz9W6_0 2024-09-12T02:06:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4230237165275145959', time=2024-09-12T03:15:50.188426+0000, chain.objs.size()=1 2024-09-12T02:06:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.302__shadow_.T9tTY2W17_JW8DbAQnE4JUR2WyZxSHk_0 2024-09-12T02:06:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4469338349591500973', time=2024-09-12T03:16:46.910213+0000, chain.objs.size()=1 2024-09-12T02:06:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.682+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.322__shadow_.zaU5EG7E6EKzsl5UCB4RNCuYXZbPs-__0 2024-09-12T02:06:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13885937542263158466', time=2024-09-12T03:18:37.233793+0000, chain.objs.size()=1 2024-09-12T02:06:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qbfowjD7uCdQkrZfcEAApCLIbTKqY9m_0 2024-09-12T02:06:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7658053431048666456', time=2024-09-12T03:18:38.885680+0000, chain.objs.size()=1 2024-09-12T02:06:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GCV3jjdL4yU5oA1w6js8spAU7K6rxGD_0 2024-09-12T02:06:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5898963780575929117', time=2024-09-12T03:18:41.311826+0000, chain.objs.size()=1 2024-09-12T02:06:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.q4tG4LuTS-R8q-2W0YfibGIlBIf1Brh_0 2024-09-12T02:06:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7226609128804612957', time=2024-09-12T03:18:41.567922+0000, chain.objs.size()=1 2024-09-12T02:06:46.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OJ2RVrJYaDLZqbae0rZS1FiaFunLcbj_0 2024-09-12T02:06:46.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2553645140584756676', time=2024-09-12T03:18:41.732682+0000, chain.objs.size()=1 2024-09-12T02:06:46.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ANZKg_2QzXPE9uuBfXD-XK1BDdcSffB_0 2024-09-12T02:06:46.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1534466321501290821', time=2024-09-12T03:18:43.081099+0000, chain.objs.size()=1 2024-09-12T02:06:46.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hwn-TDyZFF7hVGqNfpWeTbnkU4gqVE__0 2024-09-12T02:06:46.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14193464174885061523', time=2024-09-12T03:18:43.480893+0000, chain.objs.size()=1 2024-09-12T02:06:46.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MIk-sEyzuI_QUOtva_b47bnqo3VOmHa_0 2024-09-12T02:06:46.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17258461596322267171', time=2024-09-12T03:18:46.353202+0000, chain.objs.size()=1 2024-09-12T02:06:46.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.686+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.lrxZUgsLGWljrvS25cvSF0X8vqGL42F_0 2024-09-12T02:06:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2377334599610008221', time=2024-09-12T03:18:50.984120+0000, chain.objs.size()=1 2024-09-12T02:06:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qAHryp9xTkE348URdfsNRESWNW4yP-2_0 2024-09-12T02:06:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18120966511199387147', time=2024-09-12T03:18:51.378014+0000, chain.objs.size()=1 2024-09-12T02:06:46.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.un3n0-ZrTweQcHdes5IS3bHUFnj4qCy_0 2024-09-12T02:06:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10742632386540167960', time=2024-09-12T03:18:52.074359+0000, chain.objs.size()=1 2024-09-12T02:06:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8wrk5fbNtNwQldSHiM4Yrg_ZzZerXCs_0 2024-09-12T02:06:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10628684906534280175', time=2024-09-12T03:18:52.154505+0000, chain.objs.size()=1 2024-09-12T02:06:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wCe7n9-5PkQOqHZxDXmaEkypZkndBNC_0 2024-09-12T02:06:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16483919221283099452', time=2024-09-12T03:18:53.341583+0000, chain.objs.size()=1 2024-09-12T02:06:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Nnw4QdFfQtCkA8_KJS6s-Hz02po8V9F_0 2024-09-12T02:06:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16208852337185350199', time=2024-09-12T03:18:55.365945+0000, chain.objs.size()=1 2024-09-12T02:06:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BxhlyG0WxHYvQp1X8NmZrzcVkI1D0PI_0 2024-09-12T02:06:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1481050842645396973', time=2024-09-12T03:18:55.398528+0000, chain.objs.size()=1 2024-09-12T02:06:46.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BipzMjkDdNO_CBMw3cIfgl8JCavxYuN_0 2024-09-12T02:06:46.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4683452964553086931', time=2024-09-12T03:18:57.389895+0000, chain.objs.size()=1 2024-09-12T02:06:46.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.690+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6MvA_QkjGNFJq0TeMtV2IJC4UMssU4T_0 2024-09-12T02:06:46.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1110161285728651940', time=2024-09-12T03:18:57.888843+0000, chain.objs.size()=1 2024-09-12T02:06:46.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Qxj46-9H82H4rXL2y9-xG4xv3XSSyn-_0 2024-09-12T02:06:46.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7605965672265429777', time=2024-09-12T03:19:02.942750+0000, chain.objs.size()=1 2024-09-12T02:06:46.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._Mt8FfVn_4BFDMn-rvM4if160WGM1sr_0 2024-09-12T02:06:46.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3035965109406280564', time=2024-09-12T03:19:03.653926+0000, chain.objs.size()=1 2024-09-12T02:06:46.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.XB_Pzxnf6Fu4UskLPZNOdnhpPbTHXVG_0 2024-09-12T02:06:46.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.694+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15791563002855560769', time=2024-09-12T03:19:06.404828+0000, chain.objs.size()=1 2024-09-12T02:06:46.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.694+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vyoRnch8tjRFE7z0TBWoHqJykZqRSpn_0 2024-09-12T02:06:46.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16609874224585128636', time=2024-09-12T03:20:54.204619+0000, chain.objs.size()=1 2024-09-12T02:06:46.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.KL57VvUW9Sv_rFxlE2L5yWkUMxO7a8K_0 2024-09-12T02:06:46.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8707041207849452522', time=2024-09-12T03:20:55.554166+0000, chain.objs.size()=1 2024-09-12T02:06:46.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9pZUesZk5O-0Je3YZmoqpLCmPyocsDS_0 2024-09-12T02:06:46.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2451616588743804969', time=2024-09-12T03:20:56.923302+0000, chain.objs.size()=1 2024-09-12T02:06:46.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YiEw1CU8Wt5Mg1kqst1s3BUPbouc59d_0 2024-09-12T02:06:46.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4458283837603940973', time=2024-09-12T03:20:56.976010+0000, chain.objs.size()=1 2024-09-12T02:06:46.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5dyJM4dPPhxZeWg0m6QB6n_NEdUw77q_0 2024-09-12T02:06:46.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12524303659265233362', time=2024-09-12T03:20:58.784116+0000, chain.objs.size()=1 2024-09-12T02:06:46.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gj3tcZ5wia27WH1OcQazBuGo5uWwKNq_0 2024-09-12T02:06:46.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2468220265524758072', time=2024-09-12T03:20:59.236690+0000, chain.objs.size()=1 2024-09-12T02:06:46.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.67cZZA4Mcvj7iWBo_gqEJRQC3JCFEi9_0 2024-09-12T02:06:46.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2504321558484771537', time=2024-09-12T03:21:00.928910+0000, chain.objs.size()=1 2024-09-12T02:06:46.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RMsJUC28X5u2GN8MIvo0cttrl69_uYR_0 2024-09-12T02:06:46.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7680004117667852701', time=2024-09-12T03:21:02.910967+0000, chain.objs.size()=1 2024-09-12T02:06:46.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9SX5IFzkzvet6tggTg-vtYR6Fv6lvQL_0 2024-09-12T02:06:46.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2166270706612135306', time=2024-09-12T03:21:04.998054+0000, chain.objs.size()=1 2024-09-12T02:06:46.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2g1J1woFt7p30MycOo0DhvCPUHBqWY6_0 2024-09-12T02:06:46.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13324220845971083908', time=2024-09-12T03:21:05.657837+0000, chain.objs.size()=1 2024-09-12T02:06:46.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6wnbMtrafIpTCScl8SNsn4tx56YNU_O_0 2024-09-12T02:06:46.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8346871986079741641', time=2024-09-12T03:21:05.774761+0000, chain.objs.size()=1 2024-09-12T02:06:46.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.LmJycY3SS9dFA9xzPqxo_ByKmTEQqLL_0 2024-09-12T02:06:46.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10892416694825282260', time=2024-09-12T03:21:08.318537+0000, chain.objs.size()=1 2024-09-12T02:06:46.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NnXhleosoGMTvYAVI_mtLXhg3bTJSnJ_0 2024-09-12T02:06:46.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10664490355536887454', time=2024-09-12T03:21:08.442108+0000, chain.objs.size()=1 2024-09-12T02:06:46.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.698+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3YGzhyZge68H_joRRoyWoWffcpSqRsI_0 2024-09-12T02:06:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.80068384007265467', time=2024-09-12T03:21:09.217953+0000, chain.objs.size()=1 2024-09-12T02:06:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-stBc2LrmyiJQF9V9Ry42fQUllSOViL_0 2024-09-12T02:06:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6697136838281267176', time=2024-09-12T03:21:09.219612+0000, chain.objs.size()=1 2024-09-12T02:06:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.K9Z0HNDgmav0T0Isr8lSKIbN72T7u9y_0 2024-09-12T02:06:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11150595414167067688', time=2024-09-12T03:21:11.653726+0000, chain.objs.size()=1 2024-09-12T02:06:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XzhA-ekVIcOOg-5FRkr5ObUakky3jH1_0 2024-09-12T02:06:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1523242253615464206', time=2024-09-12T03:21:11.953274+0000, chain.objs.size()=1 2024-09-12T02:06:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.KZgvWstXiQGtoLjyoBKCH13kTnN8cMH_0 2024-09-12T02:06:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.702+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4498878882637165290', time=2024-09-12T03:21:12.047819+0000, chain.objs.size()=1 2024-09-12T02:06:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.702+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5YQ0VT-lvMf6WnuyFhYRV3FduBejNLP_0 2024-09-12T02:06:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10666176716775214241', time=2024-09-12T03:21:13.322346+0000, chain.objs.size()=1 2024-09-12T02:06:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.-f33R__GeFWIernDlxXs5rjqrofh3Er_0 2024-09-12T02:06:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7983170514762226081', time=2024-09-12T03:21:13.573008+0000, chain.objs.size()=1 2024-09-12T02:06:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pZ6bSr4ghNMtv4I8h0IQScX0Mknp0M-_0 2024-09-12T02:06:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15958048969777296750', time=2024-09-12T03:21:14.014403+0000, chain.objs.size()=1 2024-09-12T02:06:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.o-WDKfSvVhhgvSF_mH9RqleDazSKrHQ_0 2024-09-12T02:06:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8703712676637120782', time=2024-09-12T03:21:14.397866+0000, chain.objs.size()=1 2024-09-12T02:06:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.V0-IZ7H-SKGqAISwtaS5k3FePUmfeZB_0 2024-09-12T02:06:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11841481584781926174', time=2024-09-12T03:21:15.736441+0000, chain.objs.size()=1 2024-09-12T02:06:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tjfJgLTKRx0dABz6hNTX2d4MfOQxGS9_0 2024-09-12T02:06:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5745131953631767353', time=2024-09-12T03:21:15.738024+0000, chain.objs.size()=1 2024-09-12T02:06:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ProJNg7zAhm4ZP40Tyd09jt9yDCpBYY_0 2024-09-12T02:06:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14826642732650862020', time=2024-09-12T03:21:16.160640+0000, chain.objs.size()=1 2024-09-12T02:06:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.706+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.t5Zncc1cvVPD1tek14d4CFURjf-jAkB_0 2024-09-12T02:06:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12461770862008051219', time=2024-09-12T03:21:18.405399+0000, chain.objs.size()=1 2024-09-12T02:06:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.d0-QDpZSouGn7OOJZ0Sh2mWZjTqcQVU_0 2024-09-12T02:06:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11377417064189885705', time=2024-09-12T03:21:19.412629+0000, chain.objs.size()=1 2024-09-12T02:06:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Txn5S_-Wgs7lBoYpouq0V1YuOtO0Vht_0 2024-09-12T02:06:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe14f69e640 0 -- 172.21.15.102:0/1109906186 >> [v2:172.21.15.102:6800/1464080842,v1:172.21.15.102:6801/1464080842] conn(0x7fe018081ee0 msgr2=0x7fe018084310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:06:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12999792998232947339', time=2024-09-12T03:21:24.036521+0000, chain.objs.size()=1 2024-09-12T02:06:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5QdOcfxJuN_rnM1wpM4alFQXxpuJ3ap_0 2024-09-12T02:06:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9045064120741195223', time=2024-09-12T03:21:24.060985+0000, chain.objs.size()=1 2024-09-12T02:06:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.jTPOePI5O1a1H0G5i4xKbRD6GMDOq32_0 2024-09-12T02:06:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18026254757544815921', time=2024-09-12T03:21:24.550938+0000, chain.objs.size()=1 2024-09-12T02:06:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.710+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dDsFXPQ_lslUqVWX4EUQ0d2YAswEAxF_0 2024-09-12T02:06:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.701526719677562329', time=2024-09-12T03:27:24.871379+0000, chain.objs.size()=1 2024-09-12T02:06:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.485__shadow_.HJno501irPvRf5xw55b_xR7CAt5L0p9_0 2024-09-12T02:06:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12504312504532014122', time=2024-09-12T03:27:38.235681+0000, chain.objs.size()=1 2024-09-12T02:06:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.488__shadow_.ncRIViP6cJgpD8j7-oWTq0aec7CP3VP_0 2024-09-12T02:06:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2754477617716246302', time=2024-09-12T03:31:11.137365+0000, chain.objs.size()=1 2024-09-12T02:06:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.521__shadow:WA2oIgXX1rEO6EWeyytmylaY8w.umfz_.tX67QYMvrpRC96QBLQGcYkLYOQ_srvU_0 2024-09-12T02:06:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~S2XoaQfJ2ox2ARcZdR7bIEJFf_XtR-k', time=2024-09-12T03:32:08.824038+0000, chain.objs.size()=1 2024-09-12T02:06:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~S2XoaQfJ2ox2ARcZdR7bIEJFf_XtR-k.2 2024-09-12T02:06:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10471979266566239862', time=2024-09-12T03:39:13.042203+0000, chain.objs.size()=1 2024-09-12T02:06:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.560__shadow_.FdoPpz8CGM1F0nBdNXIwFQv8cOoR73a_0 2024-09-12T02:06:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9676798628334816348', time=2024-09-12T03:39:46.702046+0000, chain.objs.size()=1 2024-09-12T02:06:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:HM4RCS6uDck.REzmS.zObj.rFQTgB0g_.HA5MXhoQD6Qq2OjaXPaZRS2zaQk92ZX_0 2024-09-12T02:06:46.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9575897211434192992', time=2024-09-12T03:39:51.878278+0000, chain.objs.size()=1 2024-09-12T02:06:46.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.714+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:wWgbGwO4K-W0TpIiKbtUBYmUyEBRueB_.j8wxQ9_4AdcXlA_rLvtBCOm85oUwrPt_0 2024-09-12T02:06:46.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44042 2024-09-12T02:06:46.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T02:06:46.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1131682560304739952', time=2024-09-12T03:39:53.607118+0000, chain.objs.size()=1 2024-09-12T02:06:46.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:KbBFieJiNBHsN3QGoArZTQVcRLwm1Sq_.i3pS8ElaF5yRXDdizfM9KX_I8znyApq_0 2024-09-12T02:06:46.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8851682385694340594', time=2024-09-12T03:39:55.833941+0000, chain.objs.size()=1 2024-09-12T02:06:46.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:wUrUsh4DhxqCwLPzhZ9wan4OGl52aer_.8ASFV7e4XH52ONq55nsZu73K2uH10lH_0 2024-09-12T02:06:46.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1259565602398592896', time=2024-09-12T03:40:30.443538+0000, chain.objs.size()=1 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow:xNdN6xIbF6L9r4qmnOBi-At5-WtZax-_.zZOuk9mNADpWpsfTpgIj6gtcPc8Ited_0 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16812247007154135613', time=2024-09-12T03:41:22.763660+0000, chain.objs.size()=1 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:6ZOSe0oe2VezXS9pIeGobBa1Nu0poa1_.E8srRQ0-xlBJsebtgtbg34A1PjrdVLy_0 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17283286364402888590', time=2024-09-12T03:43:04.769973+0000, chain.objs.size()=1 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.588__shadow:Q7Aqzik7kIoNfa54gl4yGBKnHAOX.H6_.4bV4dyOEwYGgidCgWxWHEG8qDkVV0-4_0 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12553247689700036069', time=2024-09-12T03:47:38.101478+0000, chain.objs.size()=1 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.618__shadow_.vGmEm67H4_N2bKQnu3zqEvne0Y6F-DO_0 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5710504711425278477', time=2024-09-12T03:48:44.443451+0000, chain.objs.size()=1 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.620__shadow_.KHZHUlItq-BhYbY3W8doXGTKZ-ek-27_0 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15938790892241248561', time=2024-09-12T03:50:46.897876+0000, chain.objs.size()=1 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.638__shadow_.s7AgwFznKsCFrLupjwDytg33IT_9oqH_0 2024-09-12T02:06:46.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8728419845445435468', time=2024-09-12T03:50:54.234553+0000, chain.objs.size()=1 2024-09-12T02:06:46.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.642__shadow_.9dWM-TFi6wKztid-aYkhimreB6NkemR_0 2024-09-12T02:06:46.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15639155606519456576', time=2024-09-12T03:51:32.146620+0000, chain.objs.size()=1 2024-09-12T02:06:46.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.722+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.649__shadow_._bG-poZi9aTagY1c3uxPAGJSLB4tOsy_0 2024-09-12T02:06:46.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.726+0000 7fe14ee9d640 0 -- 172.21.15.102:0/1109906186 >> [v2:172.21.15.102:6816/1118146796,v1:172.21.15.102:6817/1118146796] conn(0x7fe148068c20 msgr2=0x7fe148061ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:06:46.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.726+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:46.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T02:06:46.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:46.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.730+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe14f69e640 0 -- 172.21.15.102:0/1109906186 >> [v2:172.21.15.102:6824/1865676346,v1:172.21.15.102:6825/1865676346] conn(0x55d161f83ce0 msgr2=0x55d161f86170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T02:06:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/68803' 2024-09-12T02:06:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.147931681119214894', time=2024-09-12T03:03:36.763570+0000, chain.objs.size()=1 2024-09-12T02:06:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.vO-rKhxceasuDshH-N_SgxboX5nFhYx_0 2024-09-12T02:06:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_d1iso-fZb4dkN3aPrwtY26-r8vENxDU', time=2024-09-12T03:03:57.878135+0000, chain.objs.size()=3 2024-09-12T02:06:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.T3cOLIw94amDTqzab94g55kLOA0aPGl_0 2024-09-12T02:06:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.T3cOLIw94amDTqzab94g55kLOA0aPGl_1 2024-09-12T02:06:46.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.T3cOLIw94amDTqzab94g55kLOA0aPGl_2 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5395729871781480565', time=2024-09-12T03:05:36.669567+0000, chain.objs.size()=1 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.183__shadow_.zpAlSMCuufP_i0B0G7kzmnQ_NwgpKRr_0 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8884725350244036491', time=2024-09-12T03:06:39.074233+0000, chain.objs.size()=1 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.201__shadow_.MNb5-ur7nYPjIDxH0MSG-vdsDWqhMBZ_0 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17484108194227132242', time=2024-09-12T03:10:45.085144+0000, chain.objs.size()=1 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.238__shadow_.mBfbjn6n5iqrIkBp8yVLW23evOfS2Kx_0 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5653465787267326046', time=2024-09-12T03:11:17.083592+0000, chain.objs.size()=1 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.249__shadow_.7CzBBeAca2Uz6rL15EYlue9Va34SMzW_0 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9703630544828965947', time=2024-09-12T03:13:35.490098+0000, chain.objs.size()=1 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.zR_x6fFHrlJ68J_lTyax48zU9OkL5Ro_0 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13466028916663180046', time=2024-09-12T03:13:35.979121+0000, chain.objs.size()=1 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.us94zchcgK3I8a5WJEG6ezqgfBPtc0e_0 2024-09-12T02:06:46.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16285116926654996884', time=2024-09-12T03:13:37.018692+0000, chain.objs.size()=1 2024-09-12T02:06:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xGevxmwrObE4M-qmITUZTrFD5dU6sMx_0 2024-09-12T02:06:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7602182429307146205', time=2024-09-12T03:13:37.098525+0000, chain.objs.size()=1 2024-09-12T02:06:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KUIcG0Sae_mlq6F7d__zJkiPTin28h1_0 2024-09-12T02:06:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16853886787535289865', time=2024-09-12T03:13:39.638753+0000, chain.objs.size()=1 2024-09-12T02:06:46.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KHzMJWpt--PLjhcnHaxbjvpFFtisZyi_0 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4864454091050083665', time=2024-09-12T03:13:39.992125+0000, chain.objs.size()=1 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.a8sZ-aL961YStWI7-pHqis-jtC_mTEb_0 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1446949138897300322', time=2024-09-12T03:13:40.077653+0000, chain.objs.size()=1 2024-09-12T02:06:46.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.734+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8146GX8289Dif0LxLETf_JMVJWHbLbT_0 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2236326803551774763', time=2024-09-12T03:13:42.916227+0000, chain.objs.size()=1 2024-09-12T02:06:46.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rLafGB_Yzf8xxgERW6JOhUic6-gH5ww_0 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2604916050325634421', time=2024-09-12T03:13:46.774832+0000, chain.objs.size()=1 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1QiXBUWbOL-9WTIjxoLLXGnbEECpjBl_0 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14177785755116852053', time=2024-09-12T03:13:49.065635+0000, chain.objs.size()=1 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aReXNu0qen24ceKNNqvSD39VDyIERGW_0 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10490010247310856650', time=2024-09-12T03:13:49.145484+0000, chain.objs.size()=1 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DUZR1b3Q1Smypn4QeAlqb9kixn0WNs8_0 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6458960356922538921', time=2024-09-12T03:13:49.594993+0000, chain.objs.size()=1 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GtnYRD_BQCiSZSuuYz5zzrn73FAvwmT_0 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12963100257878138626', time=2024-09-12T03:13:50.781924+0000, chain.objs.size()=1 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rUv8K2EyoKVN46kL58nUxnIgjRk_zZZ_0 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15275932516697885814', time=2024-09-12T03:13:52.934651+0000, chain.objs.size()=1 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.wLKGtFTMkPsOAw_fjMUbNg4kHClvzzL_0 2024-09-12T02:06:46.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.33292650132398913', time=2024-09-12T03:13:53.471153+0000, chain.objs.size()=1 2024-09-12T02:06:46.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.738+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cdQAVD2t1j_lTNn8bwrPkvIb6G8KHNU_0 2024-09-12T02:06:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17541007122830553603', time=2024-09-12T03:13:55.995164+0000, chain.objs.size()=1 2024-09-12T02:06:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ntfqECqxPjXKo33b-XENKC6Vnoflq8H_0 2024-09-12T02:06:46.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7684965986184826205', time=2024-09-12T03:13:56.039909+0000, chain.objs.size()=1 2024-09-12T02:06:46.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1ky4WbVKoIvwOiVHAAggZ3cJ5vKDs-G_0 2024-09-12T02:06:46.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3680184304159214228', time=2024-09-12T03:13:56.291301+0000, chain.objs.size()=1 2024-09-12T02:06:46.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xuRx1ZJO6CXjbA9WDrezMESm6tbpqup_0 2024-09-12T02:06:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2454378158361506567', time=2024-09-12T03:13:56.643105+0000, chain.objs.size()=1 2024-09-12T02:06:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9z6s3u-OmSQclHoMHy-UmGAuy0RM5EB_0 2024-09-12T02:06:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16575293729168500664', time=2024-09-12T03:13:56.807349+0000, chain.objs.size()=1 2024-09-12T02:06:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tgE1tZInA8RNnpQIK5wyExZB5NsS75m_0 2024-09-12T02:06:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5778519355779153532', time=2024-09-12T03:13:57.640846+0000, chain.objs.size()=1 2024-09-12T02:06:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.742+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.YBdk7-WAnU0koxrOxy47TcF5mTAHMsu_0 2024-09-12T02:06:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14147378703490834559', time=2024-09-12T03:14:00.356485+0000, chain.objs.size()=1 2024-09-12T02:06:46.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JUbNXtCphi4__SkXwLXbDtG8G4MWcPu_0 2024-09-12T02:06:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10136934829427970377', time=2024-09-12T03:14:00.358154+0000, chain.objs.size()=1 2024-09-12T02:06:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.sD9m_kIj9ulrDskZlJB7H1twJfPmqq9_0 2024-09-12T02:06:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7288673908403053286', time=2024-09-12T03:14:00.654156+0000, chain.objs.size()=1 2024-09-12T02:06:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.d3BplbZaegdBIT_YKwhFRtVrnWcCfn6_0 2024-09-12T02:06:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3765046506182987331', time=2024-09-12T03:14:02.862338+0000, chain.objs.size()=1 2024-09-12T02:06:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Mc3TE9Eb03eVR97iZmo535FnQVlY10u_0 2024-09-12T02:06:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17195462293246645320', time=2024-09-12T03:14:05.308212+0000, chain.objs.size()=1 2024-09-12T02:06:46.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.T-O8s2sQhxqKNJGuV1YcpglTrHTjr6Z_0 2024-09-12T02:06:46.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1153844872356083888', time=2024-09-12T03:14:26.961218+0000, chain.objs.size()=1 2024-09-12T02:06:46.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.272__shadow_.wmKaZlqYtQC7y9aO_24ln7XGTrra_BW_0 2024-09-12T02:06:46.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11383204721793603982', time=2024-09-12T03:14:31.722356+0000, chain.objs.size()=1 2024-09-12T02:06:46.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.274__shadow_.znSrtLLRbtB2GAkA92nqJglCYel3dx2_0 2024-09-12T02:06:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.934355879810491757', time=2024-09-12T03:14:59.375685+0000, chain.objs.size()=1 2024-09-12T02:06:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.746+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.285__shadow_.M_KFUnkleIlP2nDfwJfvuxMurjYN0Hx_0 2024-09-12T02:06:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5673037155054477399', time=2024-09-12T03:15:23.494519+0000, chain.objs.size()=1 2024-09-12T02:06:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.zre1rEAM7yFc4WivVpT2LxIcEditvAj_0 2024-09-12T02:06:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18031726818481944512', time=2024-09-12T03:18:38.060997+0000, chain.objs.size()=1 2024-09-12T02:06:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yCILtiiKYwR60aZf0vp-fN5ivMnTQPs_0 2024-09-12T02:06:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16956594282382010205', time=2024-09-12T03:18:39.368199+0000, chain.objs.size()=1 2024-09-12T02:06:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zevN-aPxdWSA8mhkrxDC9xsw6y_ut15_0 2024-09-12T02:06:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3014540249010547246', time=2024-09-12T03:18:40.899192+0000, chain.objs.size()=1 2024-09-12T02:06:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ytUHA2zCYHYdIBR6xJ5ds2RICUvkSPB_0 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.848937408596827193', time=2024-09-12T03:18:41.552791+0000, chain.objs.size()=1 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.NRne7OJ27Dau38GsCVeWlccIrh1yo4B_0 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2783444411655867615', time=2024-09-12T03:18:41.911396+0000, chain.objs.size()=1 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.czMIG-ccTN4jsfopoPQ5OYtThsVJFgu_0 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6007344726804759935', time=2024-09-12T03:18:42.764959+0000, chain.objs.size()=1 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gmMZwlFQDzWblnOqEiAQoVHogQaQA0q_0 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13925232786877115067', time=2024-09-12T03:18:45.887468+0000, chain.objs.size()=1 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-MMjoZGtvMOzEit3kgKB2j3_qHwIOm0_0 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15448608211290670709', time=2024-09-12T03:18:46.812024+0000, chain.objs.size()=1 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oDjSI1wvwEeCj9TvFKRXoUSe-7k_rsV_0 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6661525854034697665', time=2024-09-12T03:18:46.813860+0000, chain.objs.size()=1 2024-09-12T02:06:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.I25Wo3Ol-lwfRRtWG0olvasW0nYdBkd_0 2024-09-12T02:06:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2167940173464398342', time=2024-09-12T03:18:47.170656+0000, chain.objs.size()=1 2024-09-12T02:06:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.750+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.b3mhrG-ZF178VaDTM_DWVzGBV4fwzr9_0 2024-09-12T02:06:46.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12921945655831846111', time=2024-09-12T03:18:49.631450+0000, chain.objs.size()=1 2024-09-12T02:06:46.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.rqS_TdC6iQQydUez2-KTXYAtuBnNBSz_0 2024-09-12T02:06:46.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.754+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17531592369173989837', time=2024-09-12T03:18:49.768439+0000, chain.objs.size()=1 2024-09-12T02:06:46.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.754+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.o31sShHBF6wf_D7Bk_Z2XhzUeRTXMhY_0 2024-09-12T02:06:46.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10446548572642752263', time=2024-09-12T03:18:51.095993+0000, chain.objs.size()=1 2024-09-12T02:06:46.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.nIlIiiclSKaY1xvtsP4Ke1LKctqwEUm_0 2024-09-12T02:06:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14512782376010018234', time=2024-09-12T03:18:52.176274+0000, chain.objs.size()=1 2024-09-12T02:06:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.WbtGLltGoCmEjjCPzpra3tfBvpzoQNa_0 2024-09-12T02:06:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8617809102251110336', time=2024-09-12T03:18:52.281880+0000, chain.objs.size()=1 2024-09-12T02:06:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3Xmkll_A8yTGW8rQysEnvznveim4Rm3_0 2024-09-12T02:06:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17677287037726171531', time=2024-09-12T03:18:55.226123+0000, chain.objs.size()=1 2024-09-12T02:06:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UtC906tDkmvbTW3GcHuRgc8h2N-9lRr_0 2024-09-12T02:06:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2192199186845661011', time=2024-09-12T03:18:55.521403+0000, chain.objs.size()=1 2024-09-12T02:06:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.j5SICMHVCawiZvnUD_yX3MM9Y8HJorl_0 2024-09-12T02:06:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4068315691239043103', time=2024-09-12T03:18:55.696176+0000, chain.objs.size()=1 2024-09-12T02:06:46.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zuDirqJNTIE2-JpZcRwKm4aU3svtpmk_0 2024-09-12T02:06:46.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7625979130938353875', time=2024-09-12T03:18:55.698256+0000, chain.objs.size()=1 2024-09-12T02:06:46.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.l64iq1gOpXTvEexVFIkF9HaOXqZyJ1S_0 2024-09-12T02:06:46.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5764425239437742477', time=2024-09-12T03:18:56.035907+0000, chain.objs.size()=1 2024-09-12T02:06:46.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._dVuuZciuXj33P4qUZHkkKtMPJqi1b1_0 2024-09-12T02:06:46.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16384429957730460672', time=2024-09-12T03:18:57.622203+0000, chain.objs.size()=1 2024-09-12T02:06:46.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.guCTJ4wOxF0lMKzH04TEu-DERmj1PCN_0 2024-09-12T02:06:46.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2462160384321099350', time=2024-09-12T03:18:58.368976+0000, chain.objs.size()=1 2024-09-12T02:06:46.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.758+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eoEiRc98_62_gPpgAwIjOcDnv2LGuCR_0 2024-09-12T02:06:46.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3715783814310846554', time=2024-09-12T03:18:59.045022+0000, chain.objs.size()=1 2024-09-12T02:06:46.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RQUtgOawYVhIthvdiOMcNkG5-59rHi5_0 2024-09-12T02:06:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11610763351021916151', time=2024-09-12T03:18:59.709833+0000, chain.objs.size()=1 2024-09-12T02:06:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9xem7FRLy0QpujxlHSwctHfI-O1XiTp_0 2024-09-12T02:06:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17664003018685695178', time=2024-09-12T03:19:00.486616+0000, chain.objs.size()=1 2024-09-12T02:06:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.0prIb2XcDkyF_FcaUZFDK5ydkFbIWMI_0 2024-09-12T02:06:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4715907735171173875', time=2024-09-12T03:19:01.770142+0000, chain.objs.size()=1 2024-09-12T02:06:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.f1aRH560xwtPye6WL9sFnuyEQKY7hPY_0 2024-09-12T02:06:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8546390250916423468', time=2024-09-12T03:19:02.325413+0000, chain.objs.size()=1 2024-09-12T02:06:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._MOZoXEPkBSLh_WtJW_hbmDDzjNcVrM_0 2024-09-12T02:06:46.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2382237892904608891', time=2024-09-12T03:19:02.701432+0000, chain.objs.size()=1 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.967IwMqHwRTUBmlmCWMsIdOlQk9GUXi_0 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7274171316000443489', time=2024-09-12T03:19:02.968994+0000, chain.objs.size()=1 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.c59AHuh9K1nvKKEoEkSG-eV_4hlR6Mg_0 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9627652741159831500', time=2024-09-12T03:19:03.053972+0000, chain.objs.size()=1 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.erkFmOVSRbJj3XDS1yIN42TK-hDAXRu_0 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14215889055374292410', time=2024-09-12T03:19:03.211759+0000, chain.objs.size()=1 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MMhY9FU3OBGlgxdbvZ4weNf8PqMe40I_0 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2809605614365984477', time=2024-09-12T03:19:03.717507+0000, chain.objs.size()=1 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Z5VYnsGcdFcOTgdCk-05pBICflgoNsd_0 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12873612322698314197', time=2024-09-12T03:19:05.689963+0000, chain.objs.size()=1 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.KwSvVoYWhZVtaU47SOrEVujRGOEb78k_0 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6834765263201427766', time=2024-09-12T03:19:06.870917+0000, chain.objs.size()=1 2024-09-12T02:06:46.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.762+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ZvUZYMhglnXjW6IyimV5vC51R9xGx-n_0 2024-09-12T02:06:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14383034987840293863', time=2024-09-12T03:19:07.398919+0000, chain.objs.size()=1 2024-09-12T02:06:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.NvZrSYS-4u7StOqzJKgUW8RfDUeng9-_0 2024-09-12T02:06:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18285976320669654146', time=2024-09-12T03:19:07.722571+0000, chain.objs.size()=1 2024-09-12T02:06:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OBVr7jAqSkWKVdisTi8Zl2UOGSQdCkw_0 2024-09-12T02:06:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14024640196302487299', time=2024-09-12T03:19:07.846335+0000, chain.objs.size()=1 2024-09-12T02:06:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CH5cMq82hCOrPgsJ62GUnfODlYmUk9g_0 2024-09-12T02:06:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1636707250399541963', time=2024-09-12T03:20:54.502705+0000, chain.objs.size()=1 2024-09-12T02:06:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Xey4dXQPe_FViWehPcLXokeUX4J_GpP_0 2024-09-12T02:06:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4157184456940724507', time=2024-09-12T03:20:54.887928+0000, chain.objs.size()=1 2024-09-12T02:06:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rMJvZ4r7QwYqbk54ZiXuXe-C9ZWv0vW_0 2024-09-12T02:06:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14917219023207834526', time=2024-09-12T03:20:56.098292+0000, chain.objs.size()=1 2024-09-12T02:06:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.AJuKLT1x1PEpFXJRcg357ssX9S19DDR_0 2024-09-12T02:06:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13140698143769527397', time=2024-09-12T03:20:57.456608+0000, chain.objs.size()=1 2024-09-12T02:06:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.b6iN7qOzpQLgaQC6YfE8dVwSmldHi_n_0 2024-09-12T02:06:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4163950146380818892', time=2024-09-12T03:20:57.458885+0000, chain.objs.size()=1 2024-09-12T02:06:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.R8p2KlKPfTUALp-E8T0rLLgBIqx8-HN_0 2024-09-12T02:06:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13027295484628599324', time=2024-09-12T03:21:01.058775+0000, chain.objs.size()=1 2024-09-12T02:06:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gGZiey_9NqReTcKFfBlCxSPVBB6z2Se_0 2024-09-12T02:06:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18169302281745933216', time=2024-09-12T03:21:03.284441+0000, chain.objs.size()=1 2024-09-12T02:06:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.uQJpSWRc0BQadAeTzllFrVUUrtP0SBJ_0 2024-09-12T02:06:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11701190748929980808', time=2024-09-12T03:21:03.710166+0000, chain.objs.size()=1 2024-09-12T02:06:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.770+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.04va6m-wwXwfv89yZuI_mgwiZ0J6dgj_0 2024-09-12T02:06:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2429749631019797547', time=2024-09-12T03:21:03.798635+0000, chain.objs.size()=1 2024-09-12T02:06:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Jjd1BinkE4i3tVK8rRXMDcMgmilHK1H_0 2024-09-12T02:06:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12224217245975745602', time=2024-09-12T03:21:07.033489+0000, chain.objs.size()=1 2024-09-12T02:06:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6B-l9vyNOMwihlhCKsiT8hdDRc2O192_0 2024-09-12T02:06:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8099354111827441359', time=2024-09-12T03:21:07.399987+0000, chain.objs.size()=1 2024-09-12T02:06:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Zo6AbqS7-KcSbTZy18iDQfzwwyYdhsS_0 2024-09-12T02:06:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10693978942694094154', time=2024-09-12T03:21:07.658346+0000, chain.objs.size()=1 2024-09-12T02:06:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.INEtzfUJeagi143fkLBcwc6j0mU-K76_0 2024-09-12T02:06:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10557017269419613710', time=2024-09-12T03:21:08.420570+0000, chain.objs.size()=1 2024-09-12T02:06:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DEGgmyrAgDHTcRHJrF_xbB7ns8rVZoS_0 2024-09-12T02:06:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15902443856509380594', time=2024-09-12T03:21:08.727325+0000, chain.objs.size()=1 2024-09-12T02:06:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.774+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.24tqsvIkwPob0ue6HlzfgvsWQvYI-w6_0 2024-09-12T02:06:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6778302055997469164', time=2024-09-12T03:21:12.417304+0000, chain.objs.size()=1 2024-09-12T02:06:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MMtIOSrwX0WsXsr3XGCzwayvj66BVHa_0 2024-09-12T02:06:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10564861710614813550', time=2024-09-12T03:21:13.250088+0000, chain.objs.size()=1 2024-09-12T02:06:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.geQOAo8DztnCP9cgVZ3WxZLzCyUAoAq_0 2024-09-12T02:06:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12282592119428091098', time=2024-09-12T03:21:13.715811+0000, chain.objs.size()=1 2024-09-12T02:06:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NlsQdMgfuf7taBb0Apxxg5awmB-TSZC_0 2024-09-12T02:06:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2500305966714975630', time=2024-09-12T03:21:16.748148+0000, chain.objs.size()=1 2024-09-12T02:06:46.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NYuP4orW7oM_lK8act4m2UqjxyTNN2g_0 2024-09-12T02:06:46.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5615262961101374598', time=2024-09-12T03:21:18.055408+0000, chain.objs.size()=1 2024-09-12T02:06:46.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vGpz__WLD4R7KXjLOCgz3R9xJqAffmo_0 2024-09-12T02:06:46.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9486301445961622527', time=2024-09-12T03:21:19.176092+0000, chain.objs.size()=1 2024-09-12T02:06:46.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XviJmbSmkHEeWzpgiQPupspmjrfzdtF_0 2024-09-12T02:06:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1896084528399238875', time=2024-09-12T03:21:19.231853+0000, chain.objs.size()=1 2024-09-12T02:06:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rmyKzGHQloUwaCiZQpKF-a7IE2SrhsJ_0 2024-09-12T02:06:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.945303648140518133', time=2024-09-12T03:21:19.234322+0000, chain.objs.size()=1 2024-09-12T02:06:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.WElYWerCvHwQn_N85IKbGFKKasScgRT_0 2024-09-12T02:06:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10816781389560929036', time=2024-09-12T03:21:19.705754+0000, chain.objs.size()=1 2024-09-12T02:06:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.VNKoa5bDKFzUoBLUV7Xtu47mb7Ds7Q5_0 2024-09-12T02:06:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11240581204376944719', time=2024-09-12T03:21:20.853902+0000, chain.objs.size()=1 2024-09-12T02:06:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6gWkSGmy4iSkGhspWDimKsBAq-B7AM3_0 2024-09-12T02:06:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1605620594337633118', time=2024-09-12T03:21:23.454059+0000, chain.objs.size()=1 2024-09-12T02:06:46.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.778+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.k2yhP0s2qAFnr099RsYrqS-TpoCgyPX_0 2024-09-12T02:06:46.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4168048756223143679', time=2024-09-12T03:21:24.463560+0000, chain.objs.size()=1 2024-09-12T02:06:46.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pQfOE9Le6qZ2b8K386Ezg0aBZ1c-edi_0 2024-09-12T02:06:46.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.782+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1689279130947434309', time=2024-09-12T03:21:25.547654+0000, chain.objs.size()=1 2024-09-12T02:06:46.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.782+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.E3cywiLSZ-NxO32tEKxDa_KJC9iCuTh_0 2024-09-12T02:06:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/68803 2024-09-12T02:06:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T02:06:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15316477245795479535', time=2024-09-12T03:25:14.771549+0000, chain.objs.size()=1 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.430__shadow_.m5dk0Oe8GTW5yJr7r37udlX6mh-aoYG_0 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10429093433407155578', time=2024-09-12T03:26:33.954267+0000, chain.objs.size()=1 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.461__shadow_.pMffeXVkVuDK6FMg5dap-w21OEiZN-t_0 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10351968297555932315', time=2024-09-12T03:26:46.153800+0000, chain.objs.size()=1 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.465__shadow_.KkulmfuE39qROuGPOo_ibIcYrmU5VsA_0 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9307860144299753953', time=2024-09-12T03:28:14.188293+0000, chain.objs.size()=1 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.504__shadow:xY.qSzc8-FZgL.PAZY7yve8r0PrFDvj_.feVFZUiV-D7oBnX7pKoH2iGI2T3glrn_0 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1294031885151128516', time=2024-09-12T03:28:53.974605+0000, chain.objs.size()=6 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.1 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.2 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.3 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.4 2024-09-12T02:06:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.5 2024-09-12T02:06:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.6 2024-09-12T02:06:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.235580544155982447', time=2024-09-12T03:32:08.886875+0000, chain.objs.size()=12 2024-09-12T02:06:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.KPNlSrOUYPD4COxI9mezNSWgzy67gzRz.1 2024-09-12T02:06:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.790+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__shadow_mymultipart.KPNlSrOUYPD4COxI9mezNSWgzy67gzRz.1_1 2024-09-12T02:06:46.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.798+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.2 2024-09-12T02:06:46.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__shadow_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.2_1 2024-09-12T02:06:46.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.3 2024-09-12T02:06:46.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__shadow_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.3_1 2024-09-12T02:06:46.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.4 2024-09-12T02:06:46.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__shadow_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.4_1 2024-09-12T02:06:46.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.5 2024-09-12T02:06:46.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__shadow_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.5_1 2024-09-12T02:06:46.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.6 2024-09-12T02:06:46.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__shadow_mymultipart.2~Nk112OaF19x1evVRTpHcDg5WQNn0QAk.6_1 2024-09-12T02:06:46.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4316482110628199803', time=2024-09-12T03:39:33.653954+0000, chain.objs.size()=1 2024-09-12T02:06:46.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.565__shadow_.L8WOainESY7iead22AAhFlUA3R0Rsf-_0 2024-09-12T02:06:46.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10683369687007991427', time=2024-09-12T03:40:07.367947+0000, chain.objs.size()=1 2024-09-12T02:06:46.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.802+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:uPEggGwOCAv6jQOsHwBzgvqhe1yKTae_.Jky7QFim_75uwaCM8bX9yJjknDcDOwM_0 2024-09-12T02:06:46.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1264536335797436384', time=2024-09-12T03:41:20.901069+0000, chain.objs.size()=1 2024-09-12T02:06:46.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:cqZEilms5zxQ-Z3uebhaNBzu3PZcsUn_.PpYboYkLY3LtSbBADlfHW01VknhaEC3_0 2024-09-12T02:06:46.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12629427369149271587', time=2024-09-12T03:42:59.570213+0000, chain.objs.size()=1 2024-09-12T02:06:46.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.587__shadow:VFxD4J6zxIw6ft6yAQZnyWGxZsyEh6S_.wU4ntvsGHF8A7nRV_Cgu8rwozaTUBsK_0 2024-09-12T02:06:46.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13233944206889837563', time=2024-09-12T03:50:22.162955+0000, chain.objs.size()=1 2024-09-12T02:06:46.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.628__shadow_.8xU1adXDJ_FLzg2BOSkcS3ELcNq2OGR_0 2024-09-12T02:06:46.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7426433824775967872', time=2024-09-12T03:50:24.356523+0000, chain.objs.size()=1 2024-09-12T02:06:46.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.629__shadow_.Clnul7nGy5F4k4VSzsvAATJn25awxFb_0 2024-09-12T02:06:46.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7719269864215586894', time=2024-09-12T03:53:08.290511+0000, chain.objs.size()=1 2024-09-12T02:06:46.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.665__shadow_.6OeOlLuLWNfDwpK7AJMZoKOnEJCOv93_0 2024-09-12T02:06:46.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17782471524020546915', time=2024-09-12T03:54:33.356257+0000, chain.objs.size()=1 2024-09-12T02:06:46.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.810+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.705__shadow:q4RC.KBT7fz.cGQx.LXoJv3R8PY9AsV_.j_bhFwvOLRC4aN3UGmOHJqVfBHO_ueP_0 2024-09-12T02:06:46.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.818+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:46.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T02:06:46.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:46.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:46.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50680' 2024-09-12T02:06:46.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3990973020034415493', time=2024-09-12T03:10:40.743899+0000, chain.objs.size()=1 2024-09-12T02:06:46.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.237__shadow_.HeX4qqhEwh1xcS_rmV7EuUjNK78ufbB_0 2024-09-12T02:06:46.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7392430145833548859', time=2024-09-12T03:10:45.089120+0000, chain.objs.size()=1 2024-09-12T02:06:46.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.238__shadow_.WqLevIjtE8d1vGMUb3nRJL7idVsOxFR_0 2024-09-12T02:06:46.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17930063008855449396', time=2024-09-12T03:10:56.377926+0000, chain.objs.size()=1 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.242__shadow_._IArgnM1Sbr_ABJVNl9m8FzLpWZdDtW_0 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6154239777242720904', time=2024-09-12T03:11:03.002830+0000, chain.objs.size()=1 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.244__shadow_.yr_ZfkWHlcoHNb4Ug9lpGR45hbCkvEy_0 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8980424118729378724', time=2024-09-12T03:11:24.596828+0000, chain.objs.size()=1 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.252__shadow_.urHKP8ZLpqa3BTGyN13TcRPfRN2Uvad_0 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11884735948346282947', time=2024-09-12T03:11:41.843712+0000, chain.objs.size()=1 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.259__shadow_.EAy8247R1DkYWel7drQfp3I7OshdFQx_0 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10556368191702661754', time=2024-09-12T03:13:35.315113+0000, chain.objs.size()=1 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.F40ZzwNwWgIie-UEMeH7VJ5fv655lJK_0 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12838277339504981958', time=2024-09-12T03:13:35.700615+0000, chain.objs.size()=1 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Rz7Vga3FNH3cAMANf8BLeZUr2Nw6JrP_0 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1399028342748306967', time=2024-09-12T03:13:35.971060+0000, chain.objs.size()=1 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RbFxtLAIB-R8c4WKrpoJI9cOaaxWK2D_0 2024-09-12T02:06:46.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12443083491307440010', time=2024-09-12T03:13:36.002814+0000, chain.objs.size()=1 2024-09-12T02:06:46.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KsG1iyBc--LC1s0UPGioapIdolGMhvD_0 2024-09-12T02:06:46.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15047579973732035945', time=2024-09-12T03:13:36.526604+0000, chain.objs.size()=1 2024-09-12T02:06:46.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.PBuUP78WfTNtjniFtcvDc7ReLWz50oc_0 2024-09-12T02:06:46.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1798313164276562834', time=2024-09-12T03:13:38.429011+0000, chain.objs.size()=1 2024-09-12T02:06:46.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.834+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.HaND7asBilBDy8DRWOTlvsYbYxftOK8_0 2024-09-12T02:06:46.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.838+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13936879089859542795', time=2024-09-12T03:13:38.430508+0000, chain.objs.size()=1 2024-09-12T02:06:46.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.838+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.d9IASPcmi0Em2tgBxXc4E6KN3OAxxhL_0 2024-09-12T02:06:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13544311739943676491', time=2024-09-12T03:13:38.435523+0000, chain.objs.size()=1 2024-09-12T02:06:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.64LdXmgjxhsVengHLIpu5w8y4ckDTag_0 2024-09-12T02:06:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17639050543048117949', time=2024-09-12T03:13:38.886355+0000, chain.objs.size()=1 2024-09-12T02:06:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.B_tbb7KFHkxEULltMMIKMZ7YRO2jpyL_0 2024-09-12T02:06:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9690425165107578001', time=2024-09-12T03:13:38.972020+0000, chain.objs.size()=1 2024-09-12T02:06:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8o7Ow_HMzxt632wp9BhUIGqCfSIbFGG_0 2024-09-12T02:06:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12903084915272146953', time=2024-09-12T03:13:39.690478+0000, chain.objs.size()=1 2024-09-12T02:06:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.R208SocTiMsoVGVR4M88UJfUmgIq4wq_0 2024-09-12T02:06:46.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8134136446516662701', time=2024-09-12T03:13:42.481008+0000, chain.objs.size()=1 2024-09-12T02:06:46.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.NFq_CTxziNdR6S7tSBLyJKNYo8GIiQ4_0 2024-09-12T02:06:46.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12076625183463204458', time=2024-09-12T03:13:43.031552+0000, chain.objs.size()=1 2024-09-12T02:06:46.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.03_Tx5xfrgcu5mGkWDFVGi7SSLM4Rte_0 2024-09-12T02:06:46.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11620032575015264660', time=2024-09-12T03:13:43.796310+0000, chain.objs.size()=1 2024-09-12T02:06:46.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.W0aGn5Y-Knf3bsqQB5dcqeIvUvBJmBq_0 2024-09-12T02:06:46.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10438814323990796759', time=2024-09-12T03:13:44.263855+0000, chain.objs.size()=1 2024-09-12T02:06:46.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.OQl5pxtdnAceP-KKLtURQSsAew7s0Wj_0 2024-09-12T02:06:46.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8570321849936086786', time=2024-09-12T03:13:44.265450+0000, chain.objs.size()=1 2024-09-12T02:06:46.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.HEXu51Z_QxRsejW2tiBpALi2lXkHUKp_0 2024-09-12T02:06:46.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14124407447346299182', time=2024-09-12T03:13:44.442217+0000, chain.objs.size()=1 2024-09-12T02:06:46.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.842+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Pb7kk3V5nFSP4AsCJrImbBbpU0qv5eK_0 2024-09-12T02:06:46.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.846+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18151380954521963867', time=2024-09-12T03:13:44.563992+0000, chain.objs.size()=1 2024-09-12T02:06:46.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.846+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.K2DivxEb8NKyGQTI8v2vVin_vgvAuFO_0 2024-09-12T02:06:46.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.846+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10422092032169822654', time=2024-09-12T03:13:45.127496+0000, chain.objs.size()=1 2024-09-12T02:06:46.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.846+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pqQJNfFyjDL-6p7Ouoeu-k2jFovDFXO_0 2024-09-12T02:06:46.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.846+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17993960385883064000', time=2024-09-12T03:13:46.624039+0000, chain.objs.size()=1 2024-09-12T02:06:46.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.846+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rOh2Co7DZdO8wIvhvkWBw7ss1JY9abv_0 2024-09-12T02:06:46.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3050532483307555559', time=2024-09-12T03:13:47.851989+0000, chain.objs.size()=1 2024-09-12T02:06:46.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.kzAV9QqezrftByLo75ej3FjgjQmBYSx_0 2024-09-12T02:06:46.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.563350095874229458', time=2024-09-12T03:13:49.308683+0000, chain.objs.size()=1 2024-09-12T02:06:46.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.e0xcxnQ6FDBaar5g6pNhQU9XpQUqhVB_0 2024-09-12T02:06:46.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4128989798936530215', time=2024-09-12T03:13:51.293999+0000, chain.objs.size()=1 2024-09-12T02:06:46.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.kU-lR9F7UCGxUnLyb64o11LmmkJ2tUR_0 2024-09-12T02:06:46.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15958379109316954152', time=2024-09-12T03:13:53.886119+0000, chain.objs.size()=1 2024-09-12T02:06:46.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QYLT163YyV3pE72fATOrNRDak3LAHqd_0 2024-09-12T02:06:46.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1154789892815479674', time=2024-09-12T03:13:57.279403+0000, chain.objs.size()=1 2024-09-12T02:06:46.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.HMxWWgS12WbgYIOhys85VNRJvBYII4d_0 2024-09-12T02:06:46.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1811966244154923567', time=2024-09-12T03:13:57.469254+0000, chain.objs.size()=1 2024-09-12T02:06:46.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qF82K5hMKL0u8y1sWLEW_wZhhZPp2ns_0 2024-09-12T02:06:46.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6487141945238959449', time=2024-09-12T03:13:57.917253+0000, chain.objs.size()=1 2024-09-12T02:06:46.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.d9IDIYZVhc7hOtG5HJOo_TVF5tB59cJ_0 2024-09-12T02:06:46.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9805853819125992976', time=2024-09-12T03:13:58.834520+0000, chain.objs.size()=1 2024-09-12T02:06:46.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.fIMiYfebxQHagAs4vv1QzqNeFhT3CJA_0 2024-09-12T02:06:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8553301951059817776', time=2024-09-12T03:14:00.045706+0000, chain.objs.size()=1 2024-09-12T02:06:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.RTgd86jMN9LjwzxHmaFM0iCE4T0Fzhl_0 2024-09-12T02:06:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9830073436611445360', time=2024-09-12T03:14:46.663551+0000, chain.objs.size()=1 2024-09-12T02:06:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.280__shadow_.cVgA2Fz6bWeP6LR4i88JZ2hMEa38zWa_0 2024-09-12T02:06:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13515233711923091137', time=2024-09-12T03:14:49.186037+0000, chain.objs.size()=1 2024-09-12T02:06:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.850+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.281__shadow_.RX1mH9rFbkriJ7CNPFaHGRhhmOAQw3h_0 2024-09-12T02:06:46.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12412895121800068765', time=2024-09-12T03:14:56.837868+0000, chain.objs.size()=1 2024-09-12T02:06:46.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.284__shadow_.lNLVCoQjewUA9OAkFjRge27rcmDLlf__0 2024-09-12T02:06:46.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6276648950204063831', time=2024-09-12T03:14:59.395726+0000, chain.objs.size()=1 2024-09-12T02:06:46.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.285__shadow_.PgJg6d5tz4HxhWv05vU3q8q-6llV_sR_0 2024-09-12T02:06:46.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.854+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2292503523457784094', time=2024-09-12T03:15:29.731000+0000, chain.objs.size()=1 2024-09-12T02:06:46.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.854+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.1ga0dDFZJCE6tDMqjtCVxRZXJrNm0B6_0 2024-09-12T02:06:46.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9034503037785254192', time=2024-09-12T03:15:50.216946+0000, chain.objs.size()=1 2024-09-12T02:06:46.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.302__shadow_.FCIKvPkRkkT6b1IBfT7LHCq49bc1Czg_0 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4809742185498133764', time=2024-09-12T03:18:36.391751+0000, chain.objs.size()=1 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.JK2JJ4RQ_8leajdgyQ8aXul7AjxnYWt_0 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2419608395139953893', time=2024-09-12T03:18:36.823390+0000, chain.objs.size()=1 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fdONnH-Cr39_0ipq4e08t7b6YZhDqka_0 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8129058222130127945', time=2024-09-12T03:18:36.904989+0000, chain.objs.size()=1 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LE2MLpyzT21o0O8lEj_ogcbqWyf_kIg_0 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9562171558925523577', time=2024-09-12T03:18:38.684658+0000, chain.objs.size()=1 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.HXdu4pz-avv5UfzcwyIuJiZzF6Khh86_0 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5867248819568933379', time=2024-09-12T03:18:39.124100+0000, chain.objs.size()=1 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.uUkTPT96TOXcB9Oc75dwzQKDioeiSca_0 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8537511942873069520', time=2024-09-12T03:18:43.313948+0000, chain.objs.size()=1 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hW3tZkXU4nFJwE2X_32ycYg78R-8SGK_0 2024-09-12T02:06:46.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6361127353094360421', time=2024-09-12T03:18:43.657313+0000, chain.objs.size()=1 2024-09-12T02:06:46.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hm1r6dFcPX9azGmQyZ3TpxswND9QlWj_0 2024-09-12T02:06:46.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11231349538019018727', time=2024-09-12T03:18:45.169058+0000, chain.objs.size()=1 2024-09-12T02:06:46.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.858+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Lo6bYHXCQ1afapbvytQDr9ZWxUBQ8jV_0 2024-09-12T02:06:46.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4859977312820453325', time=2024-09-12T03:18:45.874181+0000, chain.objs.size()=1 2024-09-12T02:06:46.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.SFh0VT8t8ywnrFeRxlGOl_l5cmRTNJ4_0 2024-09-12T02:06:46.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10550030136175290518', time=2024-09-12T03:18:46.313817+0000, chain.objs.size()=1 2024-09-12T02:06:46.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.i1UO439H3SC3IC7KJnVJEahgLg6HDEV_0 2024-09-12T02:06:46.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4626437559820095756', time=2024-09-12T03:18:46.930560+0000, chain.objs.size()=1 2024-09-12T02:06:46.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ybwaorxb7_M4JRfgJhUEYKwtTENtRnv_0 2024-09-12T02:06:46.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14510399230332176096', time=2024-09-12T03:18:47.369355+0000, chain.objs.size()=1 2024-09-12T02:06:46.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.H2H1Le8KHMPdni3lW7JEGhlnQBqP_Rn_0 2024-09-12T02:06:46.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2247063906382345939', time=2024-09-12T03:18:47.619216+0000, chain.objs.size()=1 2024-09-12T02:06:46.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9UMEDBszg_qby13O2xQ_qjBn002Y54T_0 2024-09-12T02:06:46.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7804949795756904661', time=2024-09-12T03:18:48.022654+0000, chain.objs.size()=1 2024-09-12T02:06:46.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.YgPNK1bVSe8dLr0udncZLm_u9-jnEP3_0 2024-09-12T02:06:46.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1464717428796487532', time=2024-09-12T03:18:48.142613+0000, chain.objs.size()=1 2024-09-12T02:06:46.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hfRhPn8ocFrsbn2bhwgT7pSColPeKjQ_0 2024-09-12T02:06:46.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15337573955236974929', time=2024-09-12T03:18:49.765882+0000, chain.objs.size()=1 2024-09-12T02:06:46.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wIUG-5hH9gJCMzd3iaCi6086euumj3r_0 2024-09-12T02:06:46.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14225990800868305847', time=2024-09-12T03:18:50.542425+0000, chain.objs.size()=1 2024-09-12T02:06:46.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RWcyifBlBHtjpU9F0ukkIpfRH0bf4wY_0 2024-09-12T02:06:46.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9108051357011754861', time=2024-09-12T03:18:50.544565+0000, chain.objs.size()=1 2024-09-12T02:06:46.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.862+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-hc7WmqJtub53KZPlakqehpsVOiHXgX_0 2024-09-12T02:06:46.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.866+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17717379408738326714', time=2024-09-12T03:18:52.375095+0000, chain.objs.size()=1 2024-09-12T02:06:46.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.866+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2EvETY_-PXCbQZ-c5EjpXmBjjwvbk74_0 2024-09-12T02:06:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8819627928488213733', time=2024-09-12T03:18:53.326302+0000, chain.objs.size()=1 2024-09-12T02:06:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.n8AW_8tB7r25SXqh6FHg6Wjc1PRXFA9_0 2024-09-12T02:06:46.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2914019433615225886', time=2024-09-12T03:18:54.231372+0000, chain.objs.size()=1 2024-09-12T02:06:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Nq3JRQzX2BbLCeGnVzFAyFgfb3CxXaX_0 2024-09-12T02:06:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.37502680888227152', time=2024-09-12T03:18:54.678722+0000, chain.objs.size()=1 2024-09-12T02:06:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.cXVNx844wFkX_PXFPz1rF9yA6r1IfEH_0 2024-09-12T02:06:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6040407371048607124', time=2024-09-12T03:18:54.813719+0000, chain.objs.size()=1 2024-09-12T02:06:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jtn9PE7D01qc8z2_kexIZ87sRBsnuij_0 2024-09-12T02:06:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5859859148102180796', time=2024-09-12T03:18:56.380000+0000, chain.objs.size()=1 2024-09-12T02:06:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-m3PdDi7N5okwiAko2Ok1MfKNAuupgM_0 2024-09-12T02:06:46.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3852713266488530186', time=2024-09-12T03:18:56.505100+0000, chain.objs.size()=1 2024-09-12T02:06:46.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LyLHpyJwCqt41ZsyUtCUY4b9FbE7DZq_0 2024-09-12T02:06:46.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1128914114390587848', time=2024-09-12T03:18:57.396424+0000, chain.objs.size()=1 2024-09-12T02:06:46.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AAWemclRsSqLq6N8-vwCbqAH381FnI4_0 2024-09-12T02:06:46.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17906760717663584522', time=2024-09-12T03:18:58.365596+0000, chain.objs.size()=1 2024-09-12T02:06:46.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.TErrHCscKU68G5asEIBm0Uo0mI-uv9K_0 2024-09-12T02:06:46.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16016682054389110060', time=2024-09-12T03:18:58.503219+0000, chain.objs.size()=1 2024-09-12T02:06:46.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eSIB-84JmebwFvWGK-kgw9F_xErHVry_0 2024-09-12T02:06:46.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5661194630660641349', time=2024-09-12T03:18:59.559254+0000, chain.objs.size()=1 2024-09-12T02:06:46.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.870+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.I0y4NlmRN0BeuuBttO7T1TqKgpG1-o5_0 2024-09-12T02:06:46.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18142784538125589770', time=2024-09-12T03:18:59.886138+0000, chain.objs.size()=1 2024-09-12T02:06:46.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gVXr7uGc8ExpkVVvIb0cSi68n1e3aFm_0 2024-09-12T02:06:46.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.874+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1643809998625753316', time=2024-09-12T03:19:00.227584+0000, chain.objs.size()=1 2024-09-12T02:06:46.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.874+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.f4La5c5FAgtVqVJh7cboS8LPrMQmZWi_0 2024-09-12T02:06:46.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14424609950215275216', time=2024-09-12T03:19:01.400404+0000, chain.objs.size()=1 2024-09-12T02:06:46.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3k8LkRb_8TBqs3PrtcF9gkgWMtzZslE_0 2024-09-12T02:06:46.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16539738564901222788', time=2024-09-12T03:19:02.810360+0000, chain.objs.size()=1 2024-09-12T02:06:46.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.59zy7X-kprGpknlnNjljgYbdHrCBaWl_0 2024-09-12T02:06:46.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12395756255693687655', time=2024-09-12T03:19:03.075309+0000, chain.objs.size()=1 2024-09-12T02:06:46.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QTXclovKzAUskiy6jSQ-ErdkWD1su2a_0 2024-09-12T02:06:46.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9522448182178721925', time=2024-09-12T03:19:03.254652+0000, chain.objs.size()=1 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.k-fcNFUT1FG3Q6YfNmODPt6FNSBrbj4_0 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.274115062504418816', time=2024-09-12T03:19:03.638068+0000, chain.objs.size()=1 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.h0TZJqoH1xMLa2-NPgKRTBDggc8GPJC_0 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17404321469936797702', time=2024-09-12T03:19:03.723651+0000, chain.objs.size()=1 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zDtA8qbRIGNAYz4TchDXDBC33S9RM9p_0 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.562434257798472683', time=2024-09-12T03:19:03.727413+0000, chain.objs.size()=1 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MWsC5oXEtFhfmghkIDA-pHhh5Dkm9DW_0 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8045179805096444537', time=2024-09-12T03:19:04.054879+0000, chain.objs.size()=1 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.csPfoxDXy2As77jgU8pOIK7b4SG9bVJ_0 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4250512941128420813', time=2024-09-12T03:19:07.200632+0000, chain.objs.size()=1 2024-09-12T02:06:46.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VVyZlPuklhzfEstlI95vo6foMpfPebQ_0 2024-09-12T02:06:46.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4785257044614171101', time=2024-09-12T03:19:07.853181+0000, chain.objs.size()=1 2024-09-12T02:06:46.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.go7STUTVeurYf7hUMfOo5WnWoprw0co_0 2024-09-12T02:06:46.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15878099086992528276', time=2024-09-12T03:20:54.214558+0000, chain.objs.size()=1 2024-09-12T02:06:46.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.878+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EafB62r9329P_e07CJ8QCfWsN70tG5X_0 2024-09-12T02:06:46.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5764618203090946792', time=2024-09-12T03:20:54.739484+0000, chain.objs.size()=1 2024-09-12T02:06:46.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dM2IeO5jydKHqhl3-VJvdFe0UVHIifc_0 2024-09-12T02:06:46.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12332909047190165882', time=2024-09-12T03:20:56.273308+0000, chain.objs.size()=1 2024-09-12T02:06:46.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IgljSPBfKvxDdosoftOEhO3TC-iZL0i_0 2024-09-12T02:06:46.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8446665486021590543', time=2024-09-12T03:20:57.026925+0000, chain.objs.size()=1 2024-09-12T02:06:46.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.eiF_ml39aq5ee6-qy3tJHEBT_JXSqGZ_0 2024-09-12T02:06:46.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6284064971501374724', time=2024-09-12T03:20:57.527644+0000, chain.objs.size()=1 2024-09-12T02:06:46.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7gnij9efdrRigubg5hODzAWR1tU008m_0 2024-09-12T02:06:46.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5260499023742206273', time=2024-09-12T03:20:58.676666+0000, chain.objs.size()=1 2024-09-12T02:06:46.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dRrp5tBH_ouxKmVYe11u2CTlMtzck91_0 2024-09-12T02:06:46.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5013535071461785517', time=2024-09-12T03:20:59.328369+0000, chain.objs.size()=1 2024-09-12T02:06:46.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.JjZPnqo_eCSjdINl9CRXWj_tqaiRLh1_0 2024-09-12T02:06:46.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7917475426450279381', time=2024-09-12T03:20:59.472161+0000, chain.objs.size()=1 2024-09-12T02:06:46.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wywl6R_YW_ph1DFM7D49DHduFC0r5b6_0 2024-09-12T02:06:46.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1422203600698391885', time=2024-09-12T03:21:00.162801+0000, chain.objs.size()=1 2024-09-12T02:06:46.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5nKVPuPMmoqcwRCwZRGMmgwRTW6da3z_0 2024-09-12T02:06:46.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15636892452429425813', time=2024-09-12T03:21:01.380147+0000, chain.objs.size()=1 2024-09-12T02:06:46.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XtXQ_hsTWP8UgDI7qqF8DCoKfNOQGgG_0 2024-09-12T02:06:46.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17962835929518181449', time=2024-09-12T03:21:01.761476+0000, chain.objs.size()=1 2024-09-12T02:06:46.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.882+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.APfCu9JehE2aRzWegU8a3MCDha7XeXo_0 2024-09-12T02:06:46.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14441260517668619574', time=2024-09-12T03:21:03.310028+0000, chain.objs.size()=1 2024-09-12T02:06:46.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EYtV2vqfZw28Kb_z5t8DHfk08KW7AH1_0 2024-09-12T02:06:46.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10501046198451984565', time=2024-09-12T03:21:03.949368+0000, chain.objs.size()=1 2024-09-12T02:06:46.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5zwHqsy3fr6KBzSavtXES1poKgmf81V_0 2024-09-12T02:06:46.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1504713634738340569', time=2024-09-12T03:21:04.180013+0000, chain.objs.size()=1 2024-09-12T02:06:46.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1XcT1JVFaFkaaRw5BfF-x05a-ZBr9B2_0 2024-09-12T02:06:46.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.886+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14240957543281358411', time=2024-09-12T03:21:04.290735+0000, chain.objs.size()=1 2024-09-12T02:06:46.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.886+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.A8hVOB-8S--DO1wqo-uIsHyJJY03TO0_0 2024-09-12T02:06:46.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16968926784774220447', time=2024-09-12T03:21:04.726253+0000, chain.objs.size()=1 2024-09-12T02:06:46.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lsa8uI-4zQSEO8Hrvrcueub6AWlomMR_0 2024-09-12T02:06:46.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10419583435958000809', time=2024-09-12T03:21:04.787337+0000, chain.objs.size()=1 2024-09-12T02:06:46.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xE1XAStOQMepwKMVHSlwvg8YxpZwSkN_0 2024-09-12T02:06:46.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.894+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18361422177739044616', time=2024-09-12T03:21:05.823328+0000, chain.objs.size()=1 2024-09-12T02:06:46.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.894+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pwtFtCIapRoqsya9sQWMBb5QqFuS2H-_0 2024-09-12T02:06:46.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.898+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50680 2024-09-12T02:06:46.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T02:06:46.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4401185094820870227', time=2024-09-12T03:21:08.818373+0000, chain.objs.size()=1 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.mGqXqPftwLirDIF26EoRDqvNd4bxm-R_0 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8374639504096300168', time=2024-09-12T03:21:09.261687+0000, chain.objs.size()=1 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7YCEGti2Eg3yJ-qPEr_TzY0lwYv_tk3_0 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.278737814929841378', time=2024-09-12T03:21:09.931967+0000, chain.objs.size()=1 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gH0AaW2-uFxl0uuKtSCtFe_xE5ik0Y3_0 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8315473212301976970', time=2024-09-12T03:21:10.083908+0000, chain.objs.size()=1 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5JUWMtMFIxeIIXIEMBXsgghHQO5vcta_0 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2020978922029972742', time=2024-09-12T03:21:10.305627+0000, chain.objs.size()=1 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qZmTY9GMZ9VGsHzt3ZkyCOYpG1nLGZa_0 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6884730511994301558', time=2024-09-12T03:21:11.154793+0000, chain.objs.size()=1 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2YBGeflYri4Kk6QksLBoFOkR9pOrkWI_0 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1297992172341758314', time=2024-09-12T03:21:11.272693+0000, chain.objs.size()=1 2024-09-12T02:06:46.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hjPc6oQG-lnPFHI_iKW1msgFLAaQZTG_0 2024-09-12T02:06:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1119241841069702134', time=2024-09-12T03:21:13.482179+0000, chain.objs.size()=1 2024-09-12T02:06:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pMBaqNeVbPhWItz_0kFjVblbWluF6bN_0 2024-09-12T02:06:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12005309062107704557', time=2024-09-12T03:21:15.190538+0000, chain.objs.size()=1 2024-09-12T02:06:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zWy9gMNgz19o3aii2WeQm8tYWxWJPDi_0 2024-09-12T02:06:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17537342436929778802', time=2024-09-12T03:21:15.376129+0000, chain.objs.size()=1 2024-09-12T02:06:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.902+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6LWLw2jZ9ZX5kzimS0ZIeVAQ5grlo3b_0 2024-09-12T02:06:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.906+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12871492967386116767', time=2024-09-12T03:21:17.129001+0000, chain.objs.size()=1 2024-09-12T02:06:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.906+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bN_lzfQAe1DqakQsqhXpFekQ5BLbtRH_0 2024-09-12T02:06:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.906+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11587802838822163939', time=2024-09-12T03:21:17.686182+0000, chain.objs.size()=1 2024-09-12T02:06:46.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.906+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ubAe-X5TVOSrGWk3Mzj0eiGDqNF2F1a_0 2024-09-12T02:06:46.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.906+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7140466101675574846', time=2024-09-12T03:21:18.242390+0000, chain.objs.size()=1 2024-09-12T02:06:46.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.906+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Ei7dUoKbbLNQAXiGukJmFyFEPl712ik_0 2024-09-12T02:06:46.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17520226907710837249', time=2024-09-12T03:21:19.404319+0000, chain.objs.size()=1 2024-09-12T02:06:46.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XCmBw_lSBtXzQ6C9pGk8RxH2Lz873rO_0 2024-09-12T02:06:46.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11271734645555458217', time=2024-09-12T03:21:20.722648+0000, chain.objs.size()=1 2024-09-12T02:06:46.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.aAuIeauCTeg0oYKvaaVodLIk5o91Apa_0 2024-09-12T02:06:46.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11166702271013186535', time=2024-09-12T03:21:20.726704+0000, chain.objs.size()=1 2024-09-12T02:06:46.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hm_6eOBD93Tecr52HrKIocdXt6g78eT_0 2024-09-12T02:06:46.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18324634034676577766', time=2024-09-12T03:21:22.001091+0000, chain.objs.size()=1 2024-09-12T02:06:46.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Nho_VXVptGQyU-hBGqNXBWNFzmzcKKC_0 2024-09-12T02:06:46.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8909216995906888097', time=2024-09-12T03:21:23.320317+0000, chain.objs.size()=1 2024-09-12T02:06:46.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.SlWyukv8VD_HVgcUSmP83zToMn15O4C_0 2024-09-12T02:06:46.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15483821396848293794', time=2024-09-12T03:21:25.616876+0000, chain.objs.size()=1 2024-09-12T02:06:46.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9oAUQwR5vn8D9nctVTmZ-65aI5Bc41Z_0 2024-09-12T02:06:46.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4733838577969667273', time=2024-09-12T03:25:50.044711+0000, chain.objs.size()=1 2024-09-12T02:06:46.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.445__shadow_.zZhHqWDxcNbX8nByJODlJvSdNJrirB9_0 2024-09-12T02:06:46.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1909740247555639539', time=2024-09-12T03:26:50.089400+0000, chain.objs.size()=1 2024-09-12T02:06:46.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.466__shadow_.yxr_0LnN2vF8ABiyUauJVWa31jADWF2_0 2024-09-12T02:06:46.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.558308406912901591', time=2024-09-12T03:27:24.868274+0000, chain.objs.size()=1 2024-09-12T02:06:46.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.485__shadow_.QdJoKKDhUvtEP6bo0fAXenLquzvBLNr_0 2024-09-12T02:06:46.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8177100032077148303', time=2024-09-12T03:29:08.245591+0000, chain.objs.size()=1 2024-09-12T02:06:46.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.910+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.514__multipart_mymultipart.2~fYqkYTBhez8ylK8e3otE2ZkPlq6rW0v.1 2024-09-12T02:06:46.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14061506297926398955', time=2024-09-12T03:36:56.059440+0000, chain.objs.size()=4 2024-09-12T02:06:46.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.536__multipart_mymultipart.2~R_Wp8lyMr2mJgstWtzR9mHPFJN89Csu.1 2024-09-12T02:06:46.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.536__multipart_mymultipart.2~R_Wp8lyMr2mJgstWtzR9mHPFJN89Csu.2 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.536__multipart_mymultipart.d1ayWzqWTMqGIhPj6NU29YuIsUOvsVoT.3 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.536__multipart_mymultipart.2~R_Wp8lyMr2mJgstWtzR9mHPFJN89Csu.4 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15512963255024860473', time=2024-09-12T03:37:50.109243+0000, chain.objs.size()=1 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.551__shadow_.8RtwclQH7aOd_r4bATdlW8cLuKhQ2zy_0 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12286865578757299145', time=2024-09-12T03:40:47.157316+0000, chain.objs.size()=1 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.577__shadow:hu061VONq.bkowrpc94PIGZx-jP0dBS_.jL1XRIqvYZkncn3j7uq-I5v6mO08R6i_0 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17192775845342290115', time=2024-09-12T03:41:08.562348+0000, chain.objs.size()=1 2024-09-12T02:06:46.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.914+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:jBQPlcm0rKn7d8m-Dd0-9D1AGc0o2yD_.evgUVG9TNqjZWbB7_lpE1bUSxdsg4TT_0 2024-09-12T02:06:46.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.918+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6441583571388453588', time=2024-09-12T03:42:25.599533+0000, chain.objs.size()=7 2024-09-12T02:06:46.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.918+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~mxIxkyfI7JxJjsM7MvKDCDP-pUWAdot.1 2024-09-12T02:06:46.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.918+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__shadow_testobj.2~mxIxkyfI7JxJjsM7MvKDCDP-pUWAdot.1_1 2024-09-12T02:06:46.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.918+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~mxIxkyfI7JxJjsM7MvKDCDP-pUWAdot.2 2024-09-12T02:06:46.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.918+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__shadow_testobj.2~mxIxkyfI7JxJjsM7MvKDCDP-pUWAdot.2_1 2024-09-12T02:06:46.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.918+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~mxIxkyfI7JxJjsM7MvKDCDP-pUWAdot.3 2024-09-12T02:06:46.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__shadow_testobj.2~mxIxkyfI7JxJjsM7MvKDCDP-pUWAdot.3_1 2024-09-12T02:06:46.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~mxIxkyfI7JxJjsM7MvKDCDP-pUWAdot.4 2024-09-12T02:06:46.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1079644110279404606', time=2024-09-12T03:43:03.645697+0000, chain.objs.size()=1 2024-09-12T02:06:46.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.588__shadow:Nf8c3ccP.d57V-pjJBiTh-9-VU-KK9r_.87b2k_q_J_LOEUXWBdYQY8WMLvOVKIA_0 2024-09-12T02:06:46.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4835526551271242739', time=2024-09-12T03:43:41.020600+0000, chain.objs.size()=1 2024-09-12T02:06:46.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.605__shadow_.KXLwcZw_wtum44CWUyeOy2q1aBkhtyT_0 2024-09-12T02:06:46.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.922+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3774775512170840399', time=2024-09-12T03:53:18.858795+0000, chain.objs.size()=1 2024-09-12T02:06:46.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.922+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.669__shadow_.1T9FQsgAynZt-otXEXAZEsJvb9ZXSCP_0 2024-09-12T02:06:46.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.926+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:46.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T02:06:46.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:46.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:46.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43494' 2024-09-12T02:06:46.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_c-zrg_7tlO2pbhuBoEqqtv09YTZVbKn', time=2024-09-12T03:03:56.196468+0000, chain.objs.size()=3 2024-09-12T02:06:46.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.xA7dNaNaeIgAyMRu-UGF4E6yCCwENx__0 2024-09-12T02:06:46.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.xA7dNaNaeIgAyMRu-UGF4E6yCCwENx__1 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.161__shadow_.xA7dNaNaeIgAyMRu-UGF4E6yCCwENx__2 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18070056622054697750', time=2024-09-12T03:04:53.904038+0000, chain.objs.size()=2 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.165__multipart_foo.2~b3o_fcPcQN-Xo8jsOMfATaJIEbMuPAQ.1 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.165__multipart_foo.2~b3o_fcPcQN-Xo8jsOMfATaJIEbMuPAQ.2 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14288087453668469602', time=2024-09-12T03:10:51.737722+0000, chain.objs.size()=1 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.240__shadow_.e_gOYGqbAIKURk07-_aYh9sT1iDbrxr_0 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3403160969838631219', time=2024-09-12T03:11:07.029200+0000, chain.objs.size()=1 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.245__shadow_.2OhHFNMLYOSQj9tnl1K2VKHYSZSiYTW_0 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2187371380339466938', time=2024-09-12T03:11:19.560768+0000, chain.objs.size()=1 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.250__shadow_.ztdyXXsVUa1Y4X8D-jYJYxTj15WMq0V_0 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5056009278176523314', time=2024-09-12T03:13:33.850667+0000, chain.objs.size()=1 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.nYSVpLJTQlfjTT4iJQa3VKflCVfixSq_0 2024-09-12T02:06:46.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8794374474219630389', time=2024-09-12T03:13:34.423579+0000, chain.objs.size()=1 2024-09-12T02:06:46.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.7XsRlVEpdA3TLJQxLO-jhwIBnmacHnR_0 2024-09-12T02:06:46.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13829516816913127497', time=2024-09-12T03:13:35.226096+0000, chain.objs.size()=1 2024-09-12T02:06:46.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.THGkWlbFbU6SQSpQmLIPysaf0I0dj_X_0 2024-09-12T02:06:46.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17126180237075351501', time=2024-09-12T03:13:39.206567+0000, chain.objs.size()=1 2024-09-12T02:06:46.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.930+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.S5VtQFHfw38UX2yeHcVMRynHzHtv2DG_0 2024-09-12T02:06:46.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14590768071127837599', time=2024-09-12T03:13:46.645251+0000, chain.objs.size()=1 2024-09-12T02:06:46.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.MCJku64eEuKGqoi13ZAbHoc4eYEQZ2j_0 2024-09-12T02:06:46.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16199143386704210892', time=2024-09-12T03:13:46.970665+0000, chain.objs.size()=1 2024-09-12T02:06:46.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4VWGELHtqzLNiKfaOSqlDPRJnr03PER_0 2024-09-12T02:06:46.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15142166461537683228', time=2024-09-12T03:13:47.096366+0000, chain.objs.size()=1 2024-09-12T02:06:46.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.fM9TBnDwM2lwsSPwI12CLLlKqI0WyWm_0 2024-09-12T02:06:46.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.934+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15466887994995287524', time=2024-09-12T03:13:47.098123+0000, chain.objs.size()=1 2024-09-12T02:06:46.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.934+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4NRJcxuYD0exLgcsAjXJdQZ-39kFKwx_0 2024-09-12T02:06:46.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7481142822612287605', time=2024-09-12T03:13:48.633150+0000, chain.objs.size()=1 2024-09-12T02:06:46.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.FwndpGtXf0hC3KwbkPERfB_PIo0CJAO_0 2024-09-12T02:06:46.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12893807487827067984', time=2024-09-12T03:13:52.238923+0000, chain.objs.size()=1 2024-09-12T02:06:46.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.V3zEm7KvOFJGPcil9Z7_uCH1DBmGla9_0 2024-09-12T02:06:46.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18441192664778437217', time=2024-09-12T03:13:53.389552+0000, chain.objs.size()=1 2024-09-12T02:06:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vlcjHpvxesF9syLAAbY5CaWOUdvlg6k_0 2024-09-12T02:06:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16022048273618912093', time=2024-09-12T03:13:53.530089+0000, chain.objs.size()=1 2024-09-12T02:06:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QYu0XdEBgPEQCIPNgmhcCq03H_Ldrs7_0 2024-09-12T02:06:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15496087685359036687', time=2024-09-12T03:13:53.661299+0000, chain.objs.size()=1 2024-09-12T02:06:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.MT8x2-i-oJRaaShLgUSGYeUrffXKZhk_0 2024-09-12T02:06:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15153841820201240046', time=2024-09-12T03:13:55.437477+0000, chain.objs.size()=1 2024-09-12T02:06:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.i_58ahWC6QWgdFGbUkejtn_B7d5F6Rk_0 2024-09-12T02:06:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9896729316626114678', time=2024-09-12T03:13:55.676669+0000, chain.objs.size()=1 2024-09-12T02:06:46.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.938+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.lC7HJUiNcHUkTiCEQAWAU4K7hCDQdjS_0 2024-09-12T02:06:46.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9078179651478698443', time=2024-09-12T03:13:57.030327+0000, chain.objs.size()=1 2024-09-12T02:06:46.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.yANgb0Q1XKj4lvAFLrG6gPCnJATE1cL_0 2024-09-12T02:06:46.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12931676195135022621', time=2024-09-12T03:13:57.111658+0000, chain.objs.size()=1 2024-09-12T02:06:46.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xQawkbysZthABwZypiYo0_NCPN4PiU-_0 2024-09-12T02:06:46.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15766760409864600222', time=2024-09-12T03:13:59.921089+0000, chain.objs.size()=1 2024-09-12T02:06:46.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ggMGdNpsKGQzx7iXkmOsLH8lFIj8GuP_0 2024-09-12T02:06:46.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.942+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5156487862975419623', time=2024-09-12T03:14:01.384406+0000, chain.objs.size()=1 2024-09-12T02:06:46.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.942+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.D2XJ_kdEvcI3OkuVfqGPbsUBFkSrg2F_0 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16121879681238757351', time=2024-09-12T03:14:02.637274+0000, chain.objs.size()=1 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.CUmcYtYBUoRnmGN14ZPh6DbNK-arnE8_0 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7044989846449703820', time=2024-09-12T03:14:04.014932+0000, chain.objs.size()=1 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.p3P_z2z0zeK6vqE6toceXGTBuoZz40g_0 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2167008886270399491', time=2024-09-12T03:14:04.747613+0000, chain.objs.size()=1 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hQ-CCUqEFe9gTqe_PZUL0B7BqE7n6Ey_0 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17836441386560900878', time=2024-09-12T03:14:04.749633+0000, chain.objs.size()=1 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.mDHRqgVL6yVXqnH9XYe00vMiPmzl3f7_0 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7855141818450131606', time=2024-09-12T03:14:05.087430+0000, chain.objs.size()=1 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vj-lDNtarSwOpPjCDkJ8bYNbGJ3NJG1_0 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8019018447766278253', time=2024-09-12T03:14:05.133484+0000, chain.objs.size()=1 2024-09-12T02:06:46.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vjBWaCwgeqNmwFZJV7aYQuIkfxzcx8f_0 2024-09-12T02:06:46.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1797454112555301544', time=2024-09-12T03:14:05.193352+0000, chain.objs.size()=1 2024-09-12T02:06:46.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Wk7aEXnRoYKoT_f6ssbe42I0h0y21Cu_0 2024-09-12T02:06:46.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13325654377686061293', time=2024-09-12T03:14:05.353924+0000, chain.objs.size()=1 2024-09-12T02:06:46.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Y42ILIc3yjnll_HJYhoWRgdgDlHNHIb_0 2024-09-12T02:06:46.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14292254265977681216', time=2024-09-12T03:14:12.641157+0000, chain.objs.size()=1 2024-09-12T02:06:46.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.946+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.266__shadow_.HAQ-mnDot95a78GTCUcT1SgHzN9F67r_0 2024-09-12T02:06:46.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4830878421832967076', time=2024-09-12T03:14:41.767428+0000, chain.objs.size()=1 2024-09-12T02:06:46.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.278__shadow_.p78HC0NPbJKdO3vtnbLmrr70ih8IKcR_0 2024-09-12T02:06:46.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2483329554722879870', time=2024-09-12T03:15:12.155701+0000, chain.objs.size()=1 2024-09-12T02:06:46.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.290__shadow_.3TpwJMtex4QRUJHM4C4igqad73Ce9HR_0 2024-09-12T02:06:46.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.249720258374528857', time=2024-09-12T03:15:23.763750+0000, chain.objs.size()=1 2024-09-12T02:06:46.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.Pjitx9Xu6EVmsAq2hMeqklsRVUiWEtS_0 2024-09-12T02:06:46.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.950+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7037723465131458420', time=2024-09-12T03:15:29.726393+0000, chain.objs.size()=1 2024-09-12T02:06:46.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.950+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.GqLEZ8RUTP8MZs-qpeyycvvLytm94bu_0 2024-09-12T02:06:46.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3544068447560703235', time=2024-09-12T03:15:32.313280+0000, chain.objs.size()=1 2024-09-12T02:06:46.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.295__shadow_.7Rq800mdyZWJqtmtq4dNaspkEwMYMwb_0 2024-09-12T02:06:46.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1747506761031203054', time=2024-09-12T03:15:57.630745+0000, chain.objs.size()=1 2024-09-12T02:06:46.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.305__shadow_.OvkQsy0ytcvWuKCIcWqux1JuP5Us5ez_0 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10282473052572134215', time=2024-09-12T03:18:36.388825+0000, chain.objs.size()=1 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LaKM5r18rU_V6NwiIX3w8XMNwTgOP3i_0 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9231421746880943713', time=2024-09-12T03:18:37.089179+0000, chain.objs.size()=1 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2G0TmrOxhqQ3sRcRl_RL8nG63y4hvlF_0 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15655776869181619296', time=2024-09-12T03:18:38.981561+0000, chain.objs.size()=1 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BkAYgeQaaS2ywj8PejfOYfwj_ps_Pym_0 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10755353717511932447', time=2024-09-12T03:18:39.148329+0000, chain.objs.size()=1 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5pZ9yvQSh8s0n3evp_tN2brcVA7m3_C_0 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9887906777022007881', time=2024-09-12T03:18:39.475597+0000, chain.objs.size()=1 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9R1q0WgxV41Tx5cAi_VezfxuXl1Z_fD_0 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6308952747245303969', time=2024-09-12T03:18:42.323485+0000, chain.objs.size()=1 2024-09-12T02:06:46.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.npEkoxnxVbetHAJu_oWFpRYU6VViLRa_0 2024-09-12T02:06:46.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5996684478720400723', time=2024-09-12T03:18:42.324929+0000, chain.objs.size()=1 2024-09-12T02:06:46.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.954+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.0HunDQtVMbFDX4tZ32woPRhzFyQF0g4_0 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7990572590191595192', time=2024-09-12T03:18:42.956361+0000, chain.objs.size()=1 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.w-WbeeyOrAww0ge8h2uA_Ao1j_AYrt8_0 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15459002276693863765', time=2024-09-12T03:18:42.988379+0000, chain.objs.size()=1 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.i06VRZXgh_6CtIYncokoVY9oCvUzgrF_0 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe14fe9f640 0 -- 172.21.15.102:0/1109906186 >> [v2:172.21.15.121:6818/3404057850,v1:172.21.15.121:6819/3404057850] conn(0x55d161f8b840 msgr2=0x7fe018086c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3680246658982367536', time=2024-09-12T03:18:43.392258+0000, chain.objs.size()=1 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RJNu4f4vJhUrkNi_4VFoFHXr59wrIHf_0 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12459586645739671830', time=2024-09-12T03:18:43.645204+0000, chain.objs.size()=1 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.bFNhEnpsfbvWpR1pbBONuFRkUo5QbuX_0 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18068863367722905176', time=2024-09-12T03:18:43.956969+0000, chain.objs.size()=1 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CPtCgz7UbhZ_-6zeBIqk_BS6Q5BfSBP_0 2024-09-12T02:06:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14341731428720063103', time=2024-09-12T03:18:44.972188+0000, chain.objs.size()=1 2024-09-12T02:06:46.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.F6JTQhg0E2FT9YmqPIsLuFIDJM9WBX-_0 2024-09-12T02:06:46.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.350670026247834702', time=2024-09-12T03:18:45.129291+0000, chain.objs.size()=1 2024-09-12T02:06:46.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.958+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.nfTQwK2ip8eGJuyaU7p42fBPDSWuV71_0 2024-09-12T02:06:46.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5147571260703987779', time=2024-09-12T03:18:45.520293+0000, chain.objs.size()=1 2024-09-12T02:06:46.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GDXDLBdrWqf3bfDLwrTkT8xbV1CmGQk_0 2024-09-12T02:06:46.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4344543226316707484', time=2024-09-12T03:18:45.702687+0000, chain.objs.size()=1 2024-09-12T02:06:46.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MxX-s4QZobmhZziaK-sjukeUqe2XNEm_0 2024-09-12T02:06:46.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1062490162277358883', time=2024-09-12T03:18:46.313755+0000, chain.objs.size()=1 2024-09-12T02:06:46.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gOFb5-Z0OIwYa-lEgVQuhyyxKNGwwE5_0 2024-09-12T02:06:46.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.962+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4359895545993611645', time=2024-09-12T03:18:46.406555+0000, chain.objs.size()=1 2024-09-12T02:06:46.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.962+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OeMqGqbBWZshYT2-0tBrFt1fGU3r7oS_0 2024-09-12T02:06:46.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8295561841505587586', time=2024-09-12T03:18:47.252345+0000, chain.objs.size()=1 2024-09-12T02:06:46.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ioScNqK0bJBE5oyyEyHKAMouBCuy7Qn_0 2024-09-12T02:06:46.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5243284668699901307', time=2024-09-12T03:18:47.805000+0000, chain.objs.size()=1 2024-09-12T02:06:46.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.rf1H67rwuWrgjhi8NJ2lXBt4fcBPbfE_0 2024-09-12T02:06:46.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10126056734602641133', time=2024-09-12T03:18:48.004261+0000, chain.objs.size()=1 2024-09-12T02:06:46.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yAqa3h6Qn8bjNPwBz8Me0u4Ye7Pk7VQ_0 2024-09-12T02:06:46.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10154573459692290000', time=2024-09-12T03:18:49.623125+0000, chain.objs.size()=1 2024-09-12T02:06:46.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xf6Tw5d1vzawRM5ue6raZHRNOmHMNUD_0 2024-09-12T02:06:46.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1927265910706129550', time=2024-09-12T03:18:49.953193+0000, chain.objs.size()=1 2024-09-12T02:06:46.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.rpJr5Xd7UXv4vkoWQJunX6x-K5rrDRs_0 2024-09-12T02:06:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6469217115441751257', time=2024-09-12T03:18:50.148458+0000, chain.objs.size()=1 2024-09-12T02:06:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RQ0Xyv8o4oqQG3EqMaRFwx5YqISGByc_0 2024-09-12T02:06:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1659278942609775354', time=2024-09-12T03:18:50.646769+0000, chain.objs.size()=1 2024-09-12T02:06:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.DgjN3_nCOfcUFDpuWfgMU18oK1QVv2T_0 2024-09-12T02:06:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14042492528631902664', time=2024-09-12T03:18:51.890708+0000, chain.objs.size()=1 2024-09-12T02:06:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.WJjX6ZVL3PFkPGrlPZHSIo0uT2zNuAx_0 2024-09-12T02:06:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7263800868807232527', time=2024-09-12T03:18:54.141317+0000, chain.objs.size()=1 2024-09-12T02:06:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9TeV-Q23v2xpQ8-L1Z_aFU3q5HwWDPl_0 2024-09-12T02:06:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2403863151600131616', time=2024-09-12T03:18:55.363994+0000, chain.objs.size()=1 2024-09-12T02:06:46.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.HSOpvGlf-ioQDCJfg0zYy6L1folYA6x_0 2024-09-12T02:06:46.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5496454317464756291', time=2024-09-12T03:18:55.599498+0000, chain.objs.size()=1 2024-09-12T02:06:46.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.966+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OcsL-9sh4cwFsYalQDBBkLN0N1gWiuc_0 2024-09-12T02:06:46.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1134388488185704320', time=2024-09-12T03:18:57.714881+0000, chain.objs.size()=1 2024-09-12T02:06:46.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7FQn56bhZKLd2dZAd4JxdTFuQWsSFd6_0 2024-09-12T02:06:46.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7455463093798751055', time=2024-09-12T03:18:58.264645+0000, chain.objs.size()=1 2024-09-12T02:06:46.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Eof88hj9bXTGQa0KPpR8F-GJAJvrFIK_0 2024-09-12T02:06:46.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17240095650604475090', time=2024-09-12T03:18:58.630969+0000, chain.objs.size()=1 2024-09-12T02:06:46.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8auua4kdZvqDSwhWmNZiUwYd3zMCyGQ_0 2024-09-12T02:06:46.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11433301713296767965', time=2024-09-12T03:18:59.609118+0000, chain.objs.size()=1 2024-09-12T02:06:46.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.M9L0YnKVcwiQ1SaPJ_8NbpqrZbtcv9R_0 2024-09-12T02:06:46.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4745106021069643582', time=2024-09-12T03:19:01.262815+0000, chain.objs.size()=1 2024-09-12T02:06:46.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LES3VJtetUsagmdvoKeoTn-HCmm_L45_0 2024-09-12T02:06:46.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10714121807596815579', time=2024-09-12T03:19:01.727773+0000, chain.objs.size()=1 2024-09-12T02:06:46.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.twLJdOoQfJeWtio8onCXUU050Nubrg__0 2024-09-12T02:06:46.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8337766474635943940', time=2024-09-12T03:19:02.095260+0000, chain.objs.size()=1 2024-09-12T02:06:46.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.59iMNtve83pjwUoLu_qBaCA6AzKKI2P_0 2024-09-12T02:06:46.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9848819279454390853', time=2024-09-12T03:19:02.811011+0000, chain.objs.size()=1 2024-09-12T02:06:46.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.iw63U1qTNlg88R6wSIvxwKQN3IFJboA_0 2024-09-12T02:06:46.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18445733887349161634', time=2024-09-12T03:19:03.364952+0000, chain.objs.size()=1 2024-09-12T02:06:46.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.HBQtm8ymu50Ny5zK4EM_FU0nX1el5KE_0 2024-09-12T02:06:46.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7861724669701640765', time=2024-09-12T03:19:05.274311+0000, chain.objs.size()=1 2024-09-12T02:06:46.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5BAdGi6uWdfzv2rX1VdJvB4l3TZoLQd_0 2024-09-12T02:06:46.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11721000356122387075', time=2024-09-12T03:19:05.307200+0000, chain.objs.size()=1 2024-09-12T02:06:46.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.970+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ZuO3EvSRKNBRTXwGOiWYFkQu0B4sgHD_0 2024-09-12T02:06:46.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11413118705168078611', time=2024-09-12T03:19:06.861122+0000, chain.objs.size()=1 2024-09-12T02:06:46.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.juH9z7pLaSGdBgSkwk4mvJDuDCS5KUJ_0 2024-09-12T02:06:46.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9012945880624113809', time=2024-09-12T03:20:56.198016+0000, chain.objs.size()=1 2024-09-12T02:06:46.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qSOZ1bvPozvx7u3H78D772M91xBEwpz_0 2024-09-12T02:06:46.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16292681769733700677', time=2024-09-12T03:21:00.116622+0000, chain.objs.size()=1 2024-09-12T02:06:46.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ca58Eex75e9tmhZyDZHCoXaH_ftA4zC_0 2024-09-12T02:06:46.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6284823118618850903', time=2024-09-12T03:21:00.118863+0000, chain.objs.size()=1 2024-09-12T02:06:46.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._poz9a5sZ_YnljxlPxGsdrQz19XYlKz_0 2024-09-12T02:06:46.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11593841268643797644', time=2024-09-12T03:21:00.859761+0000, chain.objs.size()=1 2024-09-12T02:06:46.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4yKZyzAqryg4i3D8o1TB4_XVx_df1Aq_0 2024-09-12T02:06:46.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1699883462414998307', time=2024-09-12T03:21:01.123052+0000, chain.objs.size()=1 2024-09-12T02:06:46.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.974+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.1uS7m0do_zYiCPVqHFOZ_Xoch-kM2Jn_0 2024-09-12T02:06:46.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11391984736593723667', time=2024-09-12T03:21:01.239869+0000, chain.objs.size()=1 2024-09-12T02:06:46.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.VixtjSCEW0ZHNddXU9n9zJNphs5W2_g_0 2024-09-12T02:06:46.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10102951702064886574', time=2024-09-12T03:21:02.890427+0000, chain.objs.size()=1 2024-09-12T02:06:46.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zY-gk5znJEDr64U9pKhzPizwMMgyHvl_0 2024-09-12T02:06:46.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4437702500353693302', time=2024-09-12T03:21:02.984833+0000, chain.objs.size()=1 2024-09-12T02:06:46.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pUDdKowYO2HepatDBSZoatzKs1N0Lo9_0 2024-09-12T02:06:46.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17420247172234686475', time=2024-09-12T03:21:04.416953+0000, chain.objs.size()=1 2024-09-12T02:06:46.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wQ9PeI1IZF_CBskqmzZVcNHzM0bJUxA_0 2024-09-12T02:06:46.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16698603037682288030', time=2024-09-12T03:21:07.433500+0000, chain.objs.size()=1 2024-09-12T02:06:46.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zsjiJzefkck1p0VKropcyn8TaqFbkek_0 2024-09-12T02:06:46.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9314820246955875234', time=2024-09-12T03:21:07.773626+0000, chain.objs.size()=1 2024-09-12T02:06:46.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.978+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.M0Qfv70MSEXsKMpYZjtbCf9pTYwFaK4_0 2024-09-12T02:06:46.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10770200375994637351', time=2024-09-12T03:21:07.933373+0000, chain.objs.size()=1 2024-09-12T02:06:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Gqcpl6HaDws31CfF50DXaCh6t5iCg_n_0 2024-09-12T02:06:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9376042877809103030', time=2024-09-12T03:21:08.722484+0000, chain.objs.size()=1 2024-09-12T02:06:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.KLHizP7SLnl8rIDQW59xdmG3g0fhIo1_0 2024-09-12T02:06:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9887761569483877380', time=2024-09-12T03:21:09.134220+0000, chain.objs.size()=1 2024-09-12T02:06:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.b1Xv1LLaVtxd8fyBLkzFXDYnJNKoUc__0 2024-09-12T02:06:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18167784782763243531', time=2024-09-12T03:21:09.416837+0000, chain.objs.size()=1 2024-09-12T02:06:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.atlL3GRvUzJf8_8z3qyZ9mn7rnAWRbF_0 2024-09-12T02:06:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18245723415408618595', time=2024-09-12T03:21:09.707136+0000, chain.objs.size()=1 2024-09-12T02:06:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.iv57u4RKlZEaVyKDqiM82H7ImOpxFsQ_0 2024-09-12T02:06:46.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1278137089679759319', time=2024-09-12T03:21:09.730510+0000, chain.objs.size()=1 2024-09-12T02:06:46.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PVOFFzYcD6wrNFpAXdd78YaQR_l11aS_0 2024-09-12T02:06:46.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10133927074653320959', time=2024-09-12T03:21:10.219463+0000, chain.objs.size()=1 2024-09-12T02:06:46.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.982+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.UeUZJUybhFSLtt1ZjoOZ5FgEv_cMIAD_0 2024-09-12T02:06:46.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17181171985558832285', time=2024-09-12T03:21:11.184388+0000, chain.objs.size()=1 2024-09-12T02:06:46.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4VpRNLnG_m4ofvTjhULnLO3MZySBjmj_0 2024-09-12T02:06:46.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.986+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14009534398940102079', time=2024-09-12T03:21:15.152804+0000, chain.objs.size()=1 2024-09-12T02:06:46.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.986+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hrGLMjGv1JNIVufAQT5xtQdZH-TzYiE_0 2024-09-12T02:06:46.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43494 2024-09-12T02:06:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T02:06:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8749791147179870966', time=2024-09-12T03:21:15.807593+0000, chain.objs.size()=1 2024-09-12T02:06:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.aP5d6ouszuJq_p-ZvbvmsGwSiRY7d1N_0 2024-09-12T02:06:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8387808984052615313', time=2024-09-12T03:21:15.905357+0000, chain.objs.size()=1 2024-09-12T02:06:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.O_HXsMvy9To2C0fgu2GriUHMBY9E0nk_0 2024-09-12T02:06:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6250452464061504179', time=2024-09-12T03:21:16.877909+0000, chain.objs.size()=1 2024-09-12T02:06:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Nnp7En5bdLejvfh2Xdt5GQoY8iz1rYD_0 2024-09-12T02:06:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6134459187076435573', time=2024-09-12T03:21:17.140861+0000, chain.objs.size()=1 2024-09-12T02:06:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6vrFeNbFuN7EAnYtT799oKxZke2UPkZ_0 2024-09-12T02:06:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16586155840147958229', time=2024-09-12T03:21:17.353892+0000, chain.objs.size()=1 2024-09-12T02:06:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.awW9bxuI5bcsTRdayQMqTdzqG7_BM1c_0 2024-09-12T02:06:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16239389254606261962', time=2024-09-12T03:21:17.687281+0000, chain.objs.size()=1 2024-09-12T02:06:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ECP8Ztj4mTRxxW0-hRZt826TahVDsq2_0 2024-09-12T02:06:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14872907943390520531', time=2024-09-12T03:21:18.324792+0000, chain.objs.size()=1 2024-09-12T02:06:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Vi6hg4WpSnSv7m_nX2GYAygTPbEQ4Bb_0 2024-09-12T02:06:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5882298221421922366', time=2024-09-12T03:21:19.226403+0000, chain.objs.size()=1 2024-09-12T02:06:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2nU75Zd5wal8vhV_vQUbeGtQmU0ka2I_0 2024-09-12T02:06:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14148367515779467921', time=2024-09-12T03:21:19.229054+0000, chain.objs.size()=1 2024-09-12T02:06:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5ILbVT2-v4AyUZj73cWrbyoSM-83I4U_0 2024-09-12T02:06:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17852707319503092506', time=2024-09-12T03:21:19.734197+0000, chain.objs.size()=1 2024-09-12T02:06:46.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.OFzBHjKh9_X354z4vTGnWoQRG9m1FBl_0 2024-09-12T02:06:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8117154337205865132', time=2024-09-12T03:21:20.247723+0000, chain.objs.size()=1 2024-09-12T02:06:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._602ziAHHDYRLi76hQDHrN9ozA3I7It_0 2024-09-12T02:06:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14202625046743037111', time=2024-09-12T03:21:20.338910+0000, chain.objs.size()=1 2024-09-12T02:06:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.990+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CiNE3guKuZq6iMBIi51EnFR8ANlV32V_0 2024-09-12T02:06:46.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11499630477452417705', time=2024-09-12T03:21:21.513957+0000, chain.objs.size()=1 2024-09-12T02:06:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.SctJ47cty0WePCRanLYzoCI_sNrxh8C_0 2024-09-12T02:06:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10598055197766277929', time=2024-09-12T03:21:21.517577+0000, chain.objs.size()=1 2024-09-12T02:06:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.rrpVBCzYSOC5cVyXBXfi_aa1cyeWG_0_0 2024-09-12T02:06:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.994+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15101283964978806243', time=2024-09-12T03:21:21.907983+0000, chain.objs.size()=1 2024-09-12T02:06:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.994+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.waj9hLsMaZoSfKZ6UhN3WHoiUFI76cK_0 2024-09-12T02:06:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9129561492502993162', time=2024-09-12T03:21:22.198346+0000, chain.objs.size()=1 2024-09-12T02:06:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ziqMIiVkNpe-2lRxDcs6-Ho5UX6_NTU_0 2024-09-12T02:06:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6623626793955340326', time=2024-09-12T03:21:24.428355+0000, chain.objs.size()=1 2024-09-12T02:06:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.phGjoNIv1OAzMH2l9Ycdcv8wQjQEReG_0 2024-09-12T02:06:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12361525461398343462', time=2024-09-12T03:21:24.548553+0000, chain.objs.size()=1 2024-09-12T02:06:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fqjPZYVqNljZVsQrqmsd32DW51oMq9I_0 2024-09-12T02:06:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18362210952507964675', time=2024-09-12T03:21:24.841853+0000, chain.objs.size()=1 2024-09-12T02:06:47.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.hUGzmeLz4aUQmJZ5kLdD8IwQFgYX4QX_0 2024-09-12T02:06:47.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14243110236390588213', time=2024-09-12T03:23:22.244666+0000, chain.objs.size()=1 2024-09-12T02:06:47.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.380__shadow_.YMGucGJdeTCXxFrLaCVxARZvIg3Bn7z_0 2024-09-12T02:06:47.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8402207087673183942', time=2024-09-12T03:25:21.385292+0000, chain.objs.size()=1 2024-09-12T02:06:47.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.433__shadow_.oiQxfdmn-tEeU0c7qRr9hX8meCjT5wH_0 2024-09-12T02:06:47.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6813519450655980129', time=2024-09-12T03:27:21.996665+0000, chain.objs.size()=1 2024-09-12T02:06:47.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.zVwEPFpSAY3l5HEm2A8DJR0crpTwpan_0 2024-09-12T02:06:47.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16511982020611962285', time=2024-09-12T03:28:01.357289+0000, chain.objs.size()=1 2024-09-12T02:06:47.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:46.998+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.499__shadow_.A6yl8x3ouUOs-8rH8Ag-pMGQbfnByDV_0 2024-09-12T02:06:47.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6528777533699246251', time=2024-09-12T03:31:11.077297+0000, chain.objs.size()=4 2024-09-12T02:06:47.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.521__shadow:R53MpZSz3s93pJa2H9ICpFCD0z19nDt_.XoeYDgMlhvgy4e5JBb-zStDxEEIw5W6_0 2024-09-12T02:06:47.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.521__shadow:R53MpZSz3s93pJa2H9ICpFCD0z19nDt_.XoeYDgMlhvgy4e5JBb-zStDxEEIw5W6_1 2024-09-12T02:06:47.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.521__shadow:R53MpZSz3s93pJa2H9ICpFCD0z19nDt_.XoeYDgMlhvgy4e5JBb-zStDxEEIw5W6_2 2024-09-12T02:06:47.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.521__shadow:R53MpZSz3s93pJa2H9ICpFCD0z19nDt_.XoeYDgMlhvgy4e5JBb-zStDxEEIw5W6_3 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11629440660682905055', time=2024-09-12T03:40:01.310576+0000, chain.objs.size()=1 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:OixAQpSeqK6Mepl95h1NZb9TH4RKycr_.HOPojeQX-wA_-1FMgXFVr3q2fQsWINn_0 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11774064147419061313', time=2024-09-12T03:40:02.906291+0000, chain.objs.size()=1 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:7NnYX15w6BSkQEfmc13VpH59x5.ts8-_.z-_CeySs_l0jMznnivnWhrzQHnfThbb_0 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18112734538514906674', time=2024-09-12T03:41:11.756873+0000, chain.objs.size()=1 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:FzHSgXGQBYn1ItZWUgS88G6puk1E1MX_.srrXA6UIQ9j3IlH0d3k59W7AEvXXK2h_0 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17045709263305645771', time=2024-09-12T03:41:25.975257+0000, chain.objs.size()=1 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:O20dGma2KW0bRmBFvFmxxl3TSJYvDrq_.o_RU-xdYM82h4p-TAYssq_CcvT96lKn_0 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17658473514258949290', time=2024-09-12T03:42:36.961603+0000, chain.objs.size()=1 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.580__shadow:nmbKGOOVOLTvxDZ3vgdb3XLMkGxtz.G_.2RmbfCVQmJR03oi6jOiNMjnWLtcrxYO_0 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.360681308285265514', time=2024-09-12T03:42:42.687737+0000, chain.objs.size()=1 2024-09-12T02:06:47.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.002+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.581__shadow:pkaXcuVSWpFR2Kc.EtBpXhVm9BbYGBg_.L6ObSf-kNEihuBoApHmeTjtk8BVwPfF_0 2024-09-12T02:06:47.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.010+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:47.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.010+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T02:06:47.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:47.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:47.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47464' 2024-09-12T02:06:47.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_O0gLQPIRsryssWzFOW9Jyf1KqQTG5im', time=2024-09-12T03:04:54.418116+0000, chain.objs.size()=1 2024-09-12T02:06:47.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.166__shadow_.VECnGbZ4OvFb6CEc8nnsG268x_ZOGo7_0 2024-09-12T02:06:47.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9007335726817838700', time=2024-09-12T03:10:58.886320+0000, chain.objs.size()=1 2024-09-12T02:06:47.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.243__shadow_.jsroETouT9Dt5a0bJ5KztEV-h59COhN_0 2024-09-12T02:06:47.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6691689213751793272', time=2024-09-12T03:11:06.995759+0000, chain.objs.size()=1 2024-09-12T02:06:47.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.245__shadow_._vwnTj8boZ1uXaeuLbBac7usz5LOE90_0 2024-09-12T02:06:47.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3108217162999259155', time=2024-09-12T03:11:37.113900+0000, chain.objs.size()=1 2024-09-12T02:06:47.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.257__shadow_.hgPeInmcqAN1MI_F5c0CAyhYwY4_VFZ_0 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18077596399508114127', time=2024-09-12T03:11:46.847996+0000, chain.objs.size()=1 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.261__shadow_.M9eoRIacfFLaL_RYvCfXIrqH8zp3ORK_0 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15021424287950582840', time=2024-09-12T03:13:33.988003+0000, chain.objs.size()=1 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QHMwaMRB38EGF3DWBtxOz4xYl3nCdwC_0 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3052764324693481129', time=2024-09-12T03:13:35.303556+0000, chain.objs.size()=1 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.zlBAONDxK_QwbZXWAAt5Y4zH8wlyW9M_0 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9409345833796159084', time=2024-09-12T03:13:35.960498+0000, chain.objs.size()=1 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.dwOFb5sL03cprNZm8W7u6KJYhVC-p2S_0 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3719224786499413727', time=2024-09-12T03:13:36.354938+0000, chain.objs.size()=1 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.fZ8PZ9CzXe6hVuOYi2BJGAeU0SPL6Cl_0 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6908779439701231337', time=2024-09-12T03:13:36.414032+0000, chain.objs.size()=1 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9ab7NMvF4wpgD_lDoWihft7VlNQnSyj_0 2024-09-12T02:06:47.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8792080183520531579', time=2024-09-12T03:13:37.251839+0000, chain.objs.size()=1 2024-09-12T02:06:47.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._rwAK3z3SxnRddLK0lc5wOhLdeHnFdW_0 2024-09-12T02:06:47.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5256861091402091752', time=2024-09-12T03:13:37.254138+0000, chain.objs.size()=1 2024-09-12T02:06:47.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.014+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5eZ998pIWm-BVspp53MGL5wrJeyRnVH_0 2024-09-12T02:06:47.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12381047329300036359', time=2024-09-12T03:13:39.209503+0000, chain.objs.size()=1 2024-09-12T02:06:47.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.OMea2I74l-PiY1RUi0Gp2fcg07LuGOl_0 2024-09-12T02:06:47.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17319357197216493509', time=2024-09-12T03:13:39.982158+0000, chain.objs.size()=1 2024-09-12T02:06:47.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Rg1moj52ChobgDCWFwFN5p4d0asYOBI_0 2024-09-12T02:06:47.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9786387910791104353', time=2024-09-12T03:13:40.861917+0000, chain.objs.size()=1 2024-09-12T02:06:47.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.av-NMSedZ6vlPxbWfY9_szIBD7XcTMh_0 2024-09-12T02:06:47.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11944607874429505115', time=2024-09-12T03:13:40.988052+0000, chain.objs.size()=1 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.nr50-Ylj1350vHwWvnPSHHLiKIVaFuc_0 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5523385081257257027', time=2024-09-12T03:13:40.989455+0000, chain.objs.size()=1 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hl4Rg4WNAm8e1gl_PJQfBypYBk6E53h_0 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16348156083044008703', time=2024-09-12T03:13:43.319435+0000, chain.objs.size()=1 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ggx-lCxj1J1_NYye-aausz4U65x_RRo_0 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8330599344346151647', time=2024-09-12T03:13:43.773251+0000, chain.objs.size()=1 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4kA7HF58-sxC3Yw8aU-tmUITCiCl-QU_0 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9535119038299839100', time=2024-09-12T03:13:44.826649+0000, chain.objs.size()=1 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.i8IrauNxRjFpSwMciCRQYBfQrpGHAyC_0 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3724213810159615416', time=2024-09-12T03:13:47.420159+0000, chain.objs.size()=1 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.PNrrirdHYViq2vno2RhU6b27IhN3ZmG_0 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10564681350641767892', time=2024-09-12T03:13:49.841327+0000, chain.objs.size()=1 2024-09-12T02:06:47.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aYWroq8yqFAQMUhN4mVIYOKCv34rtw1_0 2024-09-12T02:06:47.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18004722758351482433', time=2024-09-12T03:13:50.853972+0000, chain.objs.size()=1 2024-09-12T02:06:47.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.018+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.n0c9wH-7wk2C4kbhepq1anzvOgaQGvO_0 2024-09-12T02:06:47.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.022+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1749315113180279765', time=2024-09-12T03:13:52.030110+0000, chain.objs.size()=1 2024-09-12T02:06:47.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.022+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.i1VrNI4kjPk8hxHRGaHXpnGNqi8HPZs_0 2024-09-12T02:06:47.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.022+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10820665356732959667', time=2024-09-12T03:13:55.441342+0000, chain.objs.size()=1 2024-09-12T02:06:47.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.022+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.v_uSn7imCkKdAvnOmfPnaC3mOfgwQkW_0 2024-09-12T02:06:47.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.022+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.438801875021535091', time=2024-09-12T03:13:55.671284+0000, chain.objs.size()=1 2024-09-12T02:06:47.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.022+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.XyzUX9pKuT19OsWIf5ty2aE2_QZqxbg_0 2024-09-12T02:06:47.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.022+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11406129383620793812', time=2024-09-12T03:13:57.913246+0000, chain.objs.size()=1 2024-09-12T02:06:47.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.022+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2h9a8aiaTBEOQ13k6VLx6-DoWcJT43j_0 2024-09-12T02:06:47.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3644886292333680837', time=2024-09-12T03:13:59.205046+0000, chain.objs.size()=1 2024-09-12T02:06:47.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3RCUPnSSik6ivY6zvB7_-I-I3SPeBN5_0 2024-09-12T02:06:47.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3921194927765952763', time=2024-09-12T03:14:00.561071+0000, chain.objs.size()=1 2024-09-12T02:06:47.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.K73wS0-fud_QGQdChhfzoHuNUn2YpDO_0 2024-09-12T02:06:47.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9839224365542323558', time=2024-09-12T03:14:05.263271+0000, chain.objs.size()=1 2024-09-12T02:06:47.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.wsGJYjXruqF_HEzyTIbfkLlwPYbI8KH_0 2024-09-12T02:06:47.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14084267543559117297', time=2024-09-12T03:14:05.433359+0000, chain.objs.size()=1 2024-09-12T02:06:47.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Ypr-t4oH0F9mWQqCZLPGhDqWso4fLt3_0 2024-09-12T02:06:47.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17538159187187116898', time=2024-09-12T03:14:34.112740+0000, chain.objs.size()=1 2024-09-12T02:06:47.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.275__shadow_.e6mI0agc49jQFzCGnzK_pRHpTZTC4pO_0 2024-09-12T02:06:47.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.442821368799654099', time=2024-09-12T03:15:09.625421+0000, chain.objs.size()=1 2024-09-12T02:06:47.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.289__shadow_.a0ZsQw70BNMSS8hWMSm0lk49QgH-aM6_0 2024-09-12T02:06:47.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6010899701202375066', time=2024-09-12T03:15:14.600444+0000, chain.objs.size()=1 2024-09-12T02:06:47.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.026+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.291__shadow_.9mMf7I26OVF2NqOepeoIpny-n93RHwg_0 2024-09-12T02:06:47.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13603178062432206484', time=2024-09-12T03:15:23.697759+0000, chain.objs.size()=1 2024-09-12T02:06:47.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_._i5z3PiJe7J_ss_LwI4Lv6EoKnuDCgK_0 2024-09-12T02:06:47.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8679605289672859437', time=2024-09-12T03:15:32.292706+0000, chain.objs.size()=1 2024-09-12T02:06:47.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.295__shadow_.K_XhgpuUCzU0Lf1MS7ftpIArc52pK4I_0 2024-09-12T02:06:47.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17587871806174183417', time=2024-09-12T03:15:45.131783+0000, chain.objs.size()=1 2024-09-12T02:06:47.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.300__shadow_.zhu-KK00aNQqbxSqX64xwsm3w-8WUCH_0 2024-09-12T02:06:47.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12143141630568444586', time=2024-09-12T03:18:36.682344+0000, chain.objs.size()=1 2024-09-12T02:06:47.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.c2Copu1o5cJYbDDl17N5TgjY5pnxqDh_0 2024-09-12T02:06:47.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14984967566485560639', time=2024-09-12T03:18:37.535482+0000, chain.objs.size()=1 2024-09-12T02:06:47.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.sy_S7lt-dC4crGrJk0BFGR2v-w7KaGC_0 2024-09-12T02:06:47.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12436188112167471696', time=2024-09-12T03:18:37.872151+0000, chain.objs.size()=1 2024-09-12T02:06:47.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Y4vCNtNMvejDWXeUT-CPBNFvSujOZqN_0 2024-09-12T02:06:47.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18169811812735948779', time=2024-09-12T03:18:38.187793+0000, chain.objs.size()=1 2024-09-12T02:06:47.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2rlNBPoPHg0-jNeBwP-aEzerSBPPtxi_0 2024-09-12T02:06:47.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5434503960985469514', time=2024-09-12T03:18:38.705663+0000, chain.objs.size()=1 2024-09-12T02:06:47.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.030+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.YTnXDwUX6Yyuq_DAUGeNvVpv9SKtk2g_0 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11814102055672227963', time=2024-09-12T03:18:39.385454+0000, chain.objs.size()=1 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.butcze_gLuwQ4YX8aXTJPb8TLUYPmOJ_0 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18435999111027574549', time=2024-09-12T03:18:41.618169+0000, chain.objs.size()=1 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.H3NhSacR1NSgdb6Bx8A-Opd660JoGHy_0 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13512417404666343022', time=2024-09-12T03:18:43.610714+0000, chain.objs.size()=1 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MzNbDkEOk2N5Ac5CJ3qEw4EjtNqIq9z_0 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2648445504403036394', time=2024-09-12T03:18:43.612198+0000, chain.objs.size()=1 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gVYdqPf6gGIe55zwCxB5O0ZmdF27eya_0 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10401210800776297633', time=2024-09-12T03:18:45.001528+0000, chain.objs.size()=1 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PJww-PcWHMtY6UVarOoimMbT7_TtmOa_0 2024-09-12T02:06:47.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18236215417282385569', time=2024-09-12T03:18:46.810334+0000, chain.objs.size()=1 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.sYUb695a4RVD9an2o3IFuGATkQ9S7Kp_0 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1459666501288210859', time=2024-09-12T03:18:47.302424+0000, chain.objs.size()=1 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.lEg18_lTG7P8iEuEC7Brnj7NWSs_KME_0 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13793541893617270817', time=2024-09-12T03:18:47.840993+0000, chain.objs.size()=1 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Do6-fixlH8zDW2PVuSgNmJAM1uUVydW_0 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7832071090084613269', time=2024-09-12T03:18:47.843065+0000, chain.objs.size()=1 2024-09-12T02:06:47.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.034+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7I23pI9oHtYpA5fsJTPp6EXhFXEjdKH_0 2024-09-12T02:06:47.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.038+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4675818748619732620', time=2024-09-12T03:18:48.081556+0000, chain.objs.size()=1 2024-09-12T02:06:47.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.038+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PyLVbYC1wgVFvEhowtaHwhlbrsP6k6k_0 2024-09-12T02:06:47.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.038+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16088181357533267667', time=2024-09-12T03:18:49.669440+0000, chain.objs.size()=1 2024-09-12T02:06:47.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.038+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VHjb5BmbfBZp9yOx_MStfmv2DpxT1g5_0 2024-09-12T02:06:47.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17523035348673426025', time=2024-09-12T03:18:50.696986+0000, chain.objs.size()=1 2024-09-12T02:06:47.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6fPeQ3kFWsDqRBg3VcFBE9C5LYgLGaq_0 2024-09-12T02:06:47.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16348795254341387776', time=2024-09-12T03:18:50.860236+0000, chain.objs.size()=1 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Iij-vMi_a-7AwsnhVBbN0AD0291-6vU_0 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6536311667521488950', time=2024-09-12T03:18:51.692809+0000, chain.objs.size()=1 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.kyIGi4L7ZoFfpjrGmbXzDvJ3aRPw4SS_0 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1431196428498402964', time=2024-09-12T03:18:51.929035+0000, chain.objs.size()=1 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ORz7DcceINFUDDn0O3zcINYO4FtA2Vd_0 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11717514002954247106', time=2024-09-12T03:18:52.263567+0000, chain.objs.size()=1 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gen6h5VQ_bXjP4Pk2ad2__DXl3WkOku_0 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1544372680961572153', time=2024-09-12T03:18:54.301073+0000, chain.objs.size()=1 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.a2EELwx2ksY_IuuV5ssLntfrEhH-SJe_0 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12648398209909695602', time=2024-09-12T03:18:56.278747+0000, chain.objs.size()=1 2024-09-12T02:06:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-VRWFTCRVVpSNYBvfXRZwlnbPqTc-2f_0 2024-09-12T02:06:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16364665677830099070', time=2024-09-12T03:18:59.979660+0000, chain.objs.size()=1 2024-09-12T02:06:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.K2ZAQcUL9-1qQilp9lF_ai0-UqRCJtS_0 2024-09-12T02:06:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3457506602008284734', time=2024-09-12T03:19:01.721733+0000, chain.objs.size()=1 2024-09-12T02:06:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.g1GLYSvCJYpJyNW8P4-yzPkb5nnzUxX_0 2024-09-12T02:06:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3065482958404659842', time=2024-09-12T03:19:02.711738+0000, chain.objs.size()=1 2024-09-12T02:06:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2luwpat4HaBJMKfnBzdXXD0fFTaFLsx_0 2024-09-12T02:06:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12297334149541208583', time=2024-09-12T03:19:04.288484+0000, chain.objs.size()=1 2024-09-12T02:06:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.042+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jiWLNEpR9WMxU8zn8S1aRnigdV9FYMq_0 2024-09-12T02:06:47.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18277509140850541589', time=2024-09-12T03:19:05.691787+0000, chain.objs.size()=1 2024-09-12T02:06:47.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UV9og3uMdNxUS3wuebbmGR7MW5fQ9WD_0 2024-09-12T02:06:47.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15463666664858069091', time=2024-09-12T03:19:06.404827+0000, chain.objs.size()=1 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6ZmWYhN0MDf1lQ-gtNGkLpScJpifSz9_0 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16567963489776784856', time=2024-09-12T03:19:06.963866+0000, chain.objs.size()=1 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.W4qwWxP1I07kPSiw5ZhFjhyKfcyeebY_0 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10613613668896685084', time=2024-09-12T03:19:07.211526+0000, chain.objs.size()=1 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.EJUKdKnjiQfOxnRGcNk-JMSOsEYfbID_0 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2633872946435651051', time=2024-09-12T03:19:07.301056+0000, chain.objs.size()=1 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CAlSBU7x7hbfZSINnI2r3Ngr53u2rxU_0 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7170442188615666588', time=2024-09-12T03:19:07.869495+0000, chain.objs.size()=1 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vaUgqI9sHBOzZfasTkTpMGlgS-j2S-j_0 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10984434162198861637', time=2024-09-12T03:20:55.897117+0000, chain.objs.size()=1 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.boylryTd-4vDPXWiZdrc0t0ITPlbauP_0 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4050372590507980787', time=2024-09-12T03:20:56.596558+0000, chain.objs.size()=1 2024-09-12T02:06:47.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Wy8J3Nbv5vggqkbCS0UpwBtYmIetmQc_0 2024-09-12T02:06:47.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17033404008399183193', time=2024-09-12T03:20:57.543438+0000, chain.objs.size()=1 2024-09-12T02:06:47.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.HKmcpxxAajayJ1EB_Z84qoJOa9Divfx_0 2024-09-12T02:06:47.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.360717918872988258', time=2024-09-12T03:20:58.882195+0000, chain.objs.size()=1 2024-09-12T02:06:47.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.046+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ynLg8BJr0z2E6NNJpJjiKHROqAQZVUA_0 2024-09-12T02:06:47.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.050+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7148058190092542656', time=2024-09-12T03:20:59.112324+0000, chain.objs.size()=1 2024-09-12T02:06:47.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.050+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.FwQszj9NaIhM4umerReKYhusYpvffZv_0 2024-09-12T02:06:47.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.050+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.90342968927754962', time=2024-09-12T03:20:59.582217+0000, chain.objs.size()=1 2024-09-12T02:06:47.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.050+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.v2YJ-Pv3EpAD5RMfmWcWh7Z3puUbOzJ_0 2024-09-12T02:06:47.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.050+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5990401229552107306', time=2024-09-12T03:20:59.995049+0000, chain.objs.size()=1 2024-09-12T02:06:47.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.050+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yRbx8yi1r5r5sXxLDLq-E_kQc3D77xk_0 2024-09-12T02:06:47.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12396664023462725250', time=2024-09-12T03:21:00.206758+0000, chain.objs.size()=1 2024-09-12T02:06:47.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.AHzRD4l8-p34cLmxICcK1WfxjKD44-v_0 2024-09-12T02:06:47.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7518415918522068627', time=2024-09-12T03:21:01.060562+0000, chain.objs.size()=1 2024-09-12T02:06:47.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.izTJD4-kE6UbgqH-j4MClWvOfGxjGej_0 2024-09-12T02:06:47.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14345177943607299469', time=2024-09-12T03:21:03.434394+0000, chain.objs.size()=1 2024-09-12T02:06:47.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YVgMmP7rY7AFjP-43Sl0MZg3RViyzFX_0 2024-09-12T02:06:47.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.466700250978197173', time=2024-09-12T03:21:04.086390+0000, chain.objs.size()=1 2024-09-12T02:06:47.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.JinTP5j97ANaKCsuq3nF14iacjyrGp1_0 2024-09-12T02:06:47.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6982845486926976670', time=2024-09-12T03:21:07.203908+0000, chain.objs.size()=1 2024-09-12T02:06:47.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vb-sP1OZfkgCBnNExQZ9PAxjfgYvDPj_0 2024-09-12T02:06:47.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3027800136588433238', time=2024-09-12T03:21:09.700277+0000, chain.objs.size()=1 2024-09-12T02:06:47.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.TVGZtr-4NuNHsV2oIcI_qG9HeC4Ihqd_0 2024-09-12T02:06:47.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7443935023601280501', time=2024-09-12T03:21:12.145986+0000, chain.objs.size()=1 2024-09-12T02:06:47.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IymwcYXPOXi1rsf6yqmTjsuRcWeRNKi_0 2024-09-12T02:06:47.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12510490320018050245', time=2024-09-12T03:21:12.248260+0000, chain.objs.size()=1 2024-09-12T02:06:47.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.t39kjvZ4nTpJ3GQ6j3763jau5EmVqpK_0 2024-09-12T02:06:47.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5262335933352306978', time=2024-09-12T03:21:12.655195+0000, chain.objs.size()=1 2024-09-12T02:06:47.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.W8ZJtGcFhmkc7RxoirVhzPO_JWf7_A8_0 2024-09-12T02:06:47.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10385567819060563569', time=2024-09-12T03:21:14.282845+0000, chain.objs.size()=1 2024-09-12T02:06:47.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NJCQf74OHz18cAVKNML62h28uBXrqhJ_0 2024-09-12T02:06:47.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11557999391591006126', time=2024-09-12T03:21:16.024232+0000, chain.objs.size()=1 2024-09-12T02:06:47.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.054+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.R4EUiJqS6g4W1feQzlM2-R0yM1J9uV1_0 2024-09-12T02:06:47.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7008686699184577008', time=2024-09-12T03:21:16.612052+0000, chain.objs.size()=1 2024-09-12T02:06:47.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.peeDACMCS5inxaPQ60mzJDf81vSlqL6_0 2024-09-12T02:06:47.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14051551761440938215', time=2024-09-12T03:21:20.135627+0000, chain.objs.size()=1 2024-09-12T02:06:47.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.cVbGK3DJWVddUsSANqJ1BkFqeRIwDw2_0 2024-09-12T02:06:47.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9775927238513861049', time=2024-09-12T03:21:20.868109+0000, chain.objs.size()=1 2024-09-12T02:06:47.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.w2VAUomsnZPyi-j31JGJtViMSzL-lqf_0 2024-09-12T02:06:47.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14266177311857835997', time=2024-09-12T03:21:21.508738+0000, chain.objs.size()=1 2024-09-12T02:06:47.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Le_z8z5zmm-9hL6b2530Z6jDjKYqTCA_0 2024-09-12T02:06:47.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2657751545144151135', time=2024-09-12T03:21:22.320663+0000, chain.objs.size()=1 2024-09-12T02:06:47.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bCCJhSEsDTODhfc_PTAGTt1m0ryI-vu_0 2024-09-12T02:06:47.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6188695537243036824', time=2024-09-12T03:21:23.191321+0000, chain.objs.size()=1 2024-09-12T02:06:47.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.058+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pLSZ3qEUrqQrjYxm33SCN1tX3ocs_CI_0 2024-09-12T02:06:47.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15649470903753534045', time=2024-09-12T03:21:24.397238+0000, chain.objs.size()=1 2024-09-12T02:06:47.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XLF69lZa7maNPoUMn27AfASb1wavsgZ_0 2024-09-12T02:06:47.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14346113568752213380', time=2024-09-12T03:21:24.551060+0000, chain.objs.size()=1 2024-09-12T02:06:47.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pAl3gkCNMySNQlnSM5r_2ifajf391GM_0 2024-09-12T02:06:47.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5462175036904184264', time=2024-09-12T03:21:25.579883+0000, chain.objs.size()=1 2024-09-12T02:06:47.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.j7xY1hut1Ze7UXLulYgm1mD4LUKCrAR_0 2024-09-12T02:06:47.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9001472865895756816', time=2024-09-12T03:21:45.296299+0000, chain.objs.size()=1 2024-09-12T02:06:47.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.334__shadow_.VZH2JLJBFWIlXMEUFPnF2eu7CFOCcWb_0 2024-09-12T02:06:47.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6454788326187226517', time=2024-09-12T03:27:26.589456+0000, chain.objs.size()=1 2024-09-12T02:06:47.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.486__shadow_.C20VnDj1agCqptUWjo0n_0x1O9fSpBF_0 2024-09-12T02:06:47.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15033289298821645447', time=2024-09-12T03:27:38.224012+0000, chain.objs.size()=1 2024-09-12T02:06:47.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.062+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.488__shadow_.ncRIViP6cJgpD8j7-oWTq0aec7CP3VP_0 2024-09-12T02:06:47.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47464 2024-09-12T02:06:47.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T02:06:47.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10948331344513509736', time=2024-09-12T03:27:40.641444+0000, chain.objs.size()=1 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.489__shadow_.iObn10CuQlv9zuvgJZYhkBsYlhNYO83_0 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16339460282474170219', time=2024-09-12T03:28:14.222210+0000, chain.objs.size()=1 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.504__shadow:xY.qSzc8-FZgL.PAZY7yve8r0PrFDvj_.feVFZUiV-D7oBnX7pKoH2iGI2T3glrn_0 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7ETbUSdm5FSmaalzBAb4gW14Cau8PFj', time=2024-09-12T03:32:46.026184+0000, chain.objs.size()=1 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~7ETbUSdm5FSmaalzBAb4gW14Cau8PFj.3 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.913049228577193824', time=2024-09-12T03:34:59.260309+0000, chain.objs.size()=3 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~3HCnjSNHRaVtMZF9ydSTIylC_sQUj8S.1 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~3HCnjSNHRaVtMZF9ydSTIylC_sQUj8S.2 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~3HCnjSNHRaVtMZF9ydSTIylC_sQUj8S.3 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~iQJgLp3vvQX2IbKyH5VO5FrXfuA9tHY', time=2024-09-12T03:36:21.752223+0000, chain.objs.size()=2 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.532__multipart_mymultipart.2~iQJgLp3vvQX2IbKyH5VO5FrXfuA9tHY.1 2024-09-12T02:06:47.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.532__multipart_mymultipart.2~iQJgLp3vvQX2IbKyH5VO5FrXfuA9tHY.2 2024-09-12T02:06:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.298441679199941925', time=2024-09-12T03:38:14.726027+0000, chain.objs.size()=1 2024-09-12T02:06:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.554__shadow_.f6Vfgyt3RNt5fngv3bx_2_NDfON7iYa_0 2024-09-12T02:06:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14498651511640855443', time=2024-09-12T03:39:55.207265+0000, chain.objs.size()=1 2024-09-12T02:06:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:7RPr.o5xhhWUNGbeFMtGZHvvlnUoU0P_.u4TGgLHGLMRWyR3NIsR4lsJqDoHWtEn_0 2024-09-12T02:06:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13911497099098828783', time=2024-09-12T03:40:27.560944+0000, chain.objs.size()=1 2024-09-12T02:06:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow:3JUwNe-hVbiA3ZnT6LQHdlJcsfoFH35_.4_Qdq9EnqoVCH9oKFrg0mhrM9GjnshC_0 2024-09-12T02:06:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15833906403170189077', time=2024-09-12T03:40:58.974881+0000, chain.objs.size()=1 2024-09-12T02:06:47.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.070+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:eimndbhsV4rW7qoX5IUYfQ6Wf3m95pC_.nUhJWGPnXPF2Ry2daXhCGKasjCadDnu_0 2024-09-12T02:06:47.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.074+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5323404730158067766', time=2024-09-12T03:56:42.144052+0000, chain.objs.size()=1 2024-09-12T02:06:47.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.074+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.743__multipart_mymultipart3.2~7qSR3Jhr6nhopwN65wqLREtXmJjSqpo.1 2024-09-12T02:06:47.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.078+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:47.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.082+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T02:06:47.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:47.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54476' 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18023479585659245021', time=2024-09-12T03:03:12.759146+0000, chain.objs.size()=3 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.159__shadow_.wY6uCJWtax10Nx-8rSwQwmYgOqkyFtS_0 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.159__shadow_.wY6uCJWtax10Nx-8rSwQwmYgOqkyFtS_1 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.159__shadow_.wY6uCJWtax10Nx-8rSwQwmYgOqkyFtS_2 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18305025592441622627', time=2024-09-12T03:10:49.487472+0000, chain.objs.size()=1 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.239__shadow_.ZBlbfaQQ4OnAUQxuABxAWneDQk3qCHj_0 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3798139000683148026', time=2024-09-12T03:10:56.351012+0000, chain.objs.size()=1 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.242__shadow_.iu4U_T2KmtFIKzjI59dnFJohIaR3VIf_0 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6086587946647912452', time=2024-09-12T03:11:22.040570+0000, chain.objs.size()=1 2024-09-12T02:06:47.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.251__shadow_.J1RXrCJoET9IrbdPwBdqVAJ9sD20xMn_0 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6138649570350619315', time=2024-09-12T03:11:24.596794+0000, chain.objs.size()=1 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.252__shadow_.api-egP7z2v9XeP2TkHMTB85Hs1q_Zf_0 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6771985344477117101', time=2024-09-12T03:11:29.660046+0000, chain.objs.size()=1 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.254__shadow_.dZ0XZkobhUyBQfUVXEpN2XMLrrE2Mzx_0 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18439545987200981417', time=2024-09-12T03:11:46.845251+0000, chain.objs.size()=1 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.261__shadow_.5KSw9CNlJXnRrA9dsoCqmCxZvVMRz5G_0 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.836689706702521821', time=2024-09-12T03:11:49.332384+0000, chain.objs.size()=1 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.262__shadow_.DIHVM3fybWIEeKhQ6nC6rB_ZwI08cQ7_0 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8094527707639043095', time=2024-09-12T03:13:34.480517+0000, chain.objs.size()=1 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.VNtN88C13e8nKjwuk056LplavMvUySG_0 2024-09-12T02:06:47.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8738833871865339159', time=2024-09-12T03:13:36.440017+0000, chain.objs.size()=1 2024-09-12T02:06:47.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.086+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.LUbHXWXbfOIfa8rRETzNv4fDB91xQqt_0 2024-09-12T02:06:47.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14844173004337324169', time=2024-09-12T03:13:38.762766+0000, chain.objs.size()=1 2024-09-12T02:06:47.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jUT9UA-VIRYwpJIFXmqZTd5J90v-hyg_0 2024-09-12T02:06:47.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10392599884456864880', time=2024-09-12T03:13:38.966336+0000, chain.objs.size()=1 2024-09-12T02:06:47.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.lyr9iuvsRJlRBTU0BCMK4jl0TIRDt1l_0 2024-09-12T02:06:47.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12014877551026697687', time=2024-09-12T03:13:39.292114+0000, chain.objs.size()=1 2024-09-12T02:06:47.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Kpl8UqR-CW5dytMeJ9GMz2bdolXQV_E_0 2024-09-12T02:06:47.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3887802264242456734', time=2024-09-12T03:13:42.920775+0000, chain.objs.size()=1 2024-09-12T02:06:47.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pTVpjLgXXSuzKH5chcPohADYcvqxxJI_0 2024-09-12T02:06:47.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.447555683873626817', time=2024-09-12T03:13:43.398476+0000, chain.objs.size()=1 2024-09-12T02:06:47.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.LltzfSMovTLS6s2hfyfwD_Ma0CHR-4V_0 2024-09-12T02:06:47.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14458558885076146353', time=2024-09-12T03:13:44.256535+0000, chain.objs.size()=1 2024-09-12T02:06:47.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.7g2e4MwnbKDlGCYBW1EOr40msZLBhRw_0 2024-09-12T02:06:47.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16174989950887735868', time=2024-09-12T03:13:44.562624+0000, chain.objs.size()=1 2024-09-12T02:06:47.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.yUGzIKJPN8pRzSMpMCg3Owhg5CeM9Q0_0 2024-09-12T02:06:47.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6144793590622043383', time=2024-09-12T03:13:44.787222+0000, chain.objs.size()=1 2024-09-12T02:06:47.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.SdEk-g-FjJHblZKdLPXOplzzBdZD8To_0 2024-09-12T02:06:47.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17037875117227600807', time=2024-09-12T03:13:45.009761+0000, chain.objs.size()=1 2024-09-12T02:06:47.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9ZKR_vhRgg4u_q1WeameagM5nM58SzV_0 2024-09-12T02:06:47.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9441106500055296021', time=2024-09-12T03:13:45.534363+0000, chain.objs.size()=1 2024-09-12T02:06:47.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uEclOwDW-_4TVuFxP9qqVBbMsV3OFMm_0 2024-09-12T02:06:47.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.842192506961134654', time=2024-09-12T03:13:47.482643+0000, chain.objs.size()=1 2024-09-12T02:06:47.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.090+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.T8fhP0Per_yClt3XJma9E16qj8EBMnt_0 2024-09-12T02:06:47.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8713788310673109386', time=2024-09-12T03:13:49.828087+0000, chain.objs.size()=1 2024-09-12T02:06:47.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.k0nGrEVBLwHvlJ1E6i7GAWmrChICzqp_0 2024-09-12T02:06:47.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13680542352523894445', time=2024-09-12T03:13:50.874256+0000, chain.objs.size()=1 2024-09-12T02:06:47.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1q7Rf23CYTuHb_XJybH3LrrW8B6GF31_0 2024-09-12T02:06:47.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6262763255224134591', time=2024-09-12T03:13:50.876190+0000, chain.objs.size()=1 2024-09-12T02:06:47.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.WSY6ziW0HATfntu8II1nHxfj1ZEFTgh_0 2024-09-12T02:06:47.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17838906528101056268', time=2024-09-12T03:13:54.842384+0000, chain.objs.size()=1 2024-09-12T02:06:47.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._DM4TUPj29saurXW9m53yk6i-8_Rfbm_0 2024-09-12T02:06:47.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9877106202668047837', time=2024-09-12T03:13:58.859850+0000, chain.objs.size()=1 2024-09-12T02:06:47.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.PyC2oDHT7hkh6tAJ4TPqmDJXRA4KmfL_0 2024-09-12T02:06:47.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6678361984854685300', time=2024-09-12T03:14:01.001283+0000, chain.objs.size()=1 2024-09-12T02:06:47.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Rdg6QYHXX5iPcbci1wzgn0v2rvMtYn9_0 2024-09-12T02:06:47.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14776343098709935245', time=2024-09-12T03:14:01.625587+0000, chain.objs.size()=1 2024-09-12T02:06:47.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jGXwY_Dzsi54khcVvusXbwE_bWXdUZL_0 2024-09-12T02:06:47.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.61318295555924393', time=2024-09-12T03:14:03.137682+0000, chain.objs.size()=1 2024-09-12T02:06:47.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.094+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.OJOLbEFVEiefWX6a7SU8z54L1SOCqe6_0 2024-09-12T02:06:47.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.098+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4019757136847985555', time=2024-09-12T03:14:03.443002+0000, chain.objs.size()=1 2024-09-12T02:06:47.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.098+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.12p0C3sPI3Pfd7nmOB1oL8Itc9koqss_0 2024-09-12T02:06:47.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.098+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12230991531860153346', time=2024-09-12T03:14:04.328687+0000, chain.objs.size()=1 2024-09-12T02:06:47.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.098+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.eGC4e2jlBqrD930Pw7_UzHQnXuHZRKB_0 2024-09-12T02:06:47.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.098+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12895548902387024685', time=2024-09-12T03:14:04.484678+0000, chain.objs.size()=1 2024-09-12T02:06:47.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.098+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tdI09HsrfEa3Xt9ITiNHdQ-EztKVxLW_0 2024-09-12T02:06:47.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.098+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13311553784483283990', time=2024-09-12T03:14:19.745526+0000, chain.objs.size()=1 2024-09-12T02:06:47.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.098+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.269__shadow_.ODg0oSsLU3Kb5ADqlGI6ITDJGSIUo0d_0 2024-09-12T02:06:47.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.098+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8753757410864261463', time=2024-09-12T03:14:36.605169+0000, chain.objs.size()=1 2024-09-12T02:06:47.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.098+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.276__shadow_.yhrX32FZIZadU0ebfh-LTkcwiQHhDwU_0 2024-09-12T02:06:47.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7946346534212855', time=2024-09-12T03:15:23.498700+0000, chain.objs.size()=1 2024-09-12T02:06:47.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.y4lId-GWX4wPDiJtCito57hFjzhqStP_0 2024-09-12T02:06:47.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.869009012992033525', time=2024-09-12T03:15:29.489014+0000, chain.objs.size()=1 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.Rn-LhrdcN_2qzdbRTNXW2lbuWcGVAjz_0 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8316237741790799465', time=2024-09-12T03:15:45.101862+0000, chain.objs.size()=1 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.300__shadow_.RWkR1cW-WbLLmwbZSA35nSLEIgmDxbm_0 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9465746694766982996', time=2024-09-12T03:16:49.701269+0000, chain.objs.size()=1 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.323__shadow_.yUrqPGkUxKSDuYql81-Hc3X01tStODL_0 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2167259609095804500', time=2024-09-12T03:18:37.764726+0000, chain.objs.size()=1 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eYMM5TtcFoMNdDKmkN-fDHYk55QrC4o_0 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2568875716313479814', time=2024-09-12T03:18:37.794103+0000, chain.objs.size()=1 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.yStOgj9NbngKyDuczcYWx-_PykX26KH_0 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15100089673404311676', time=2024-09-12T03:18:40.657970+0000, chain.objs.size()=1 2024-09-12T02:06:47.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2ZpSFjr0zA_i8J6dNvxz3-zebb9hG_N_0 2024-09-12T02:06:47.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9671481024220286135', time=2024-09-12T03:18:45.379463+0000, chain.objs.size()=1 2024-09-12T02:06:47.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.d7ltXokSJBZvp0l_oSFIfAWE3GuGg2l_0 2024-09-12T02:06:47.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8143510777772182842', time=2024-09-12T03:18:45.743196+0000, chain.objs.size()=1 2024-09-12T02:06:47.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.102+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BYMsS6THTlqp-wYOP-8NMmv0rkAq1If_0 2024-09-12T02:06:47.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11668013127511863193', time=2024-09-12T03:18:46.186623+0000, chain.objs.size()=1 2024-09-12T02:06:47.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8dUdJvzNZCXnQwR83Eza0l-A_BnSOfh_0 2024-09-12T02:06:47.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3795583223886356965', time=2024-09-12T03:18:46.665792+0000, chain.objs.size()=1 2024-09-12T02:06:47.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8e8U_63uI4CasJQtrClqQnZhLQIZRq8_0 2024-09-12T02:06:47.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14652071170970539758', time=2024-09-12T03:18:49.775644+0000, chain.objs.size()=1 2024-09-12T02:06:47.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ZF1zORtD26qRhifm2-fWIRB5Q-1nAO9_0 2024-09-12T02:06:47.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3828928455567347583', time=2024-09-12T03:18:50.403751+0000, chain.objs.size()=1 2024-09-12T02:06:47.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Ya90hrp29BlqI8TSO3ErtYjCJmWlgU2_0 2024-09-12T02:06:47.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15495604330252042741', time=2024-09-12T03:18:50.641737+0000, chain.objs.size()=1 2024-09-12T02:06:47.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-LZLwUDg1j_Jg0VRLAmReVgkBHtTlcN_0 2024-09-12T02:06:47.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1044723382070990132', time=2024-09-12T03:18:50.688079+0000, chain.objs.size()=1 2024-09-12T02:06:47.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.KSpSG0BrmJH6BVtTlBbac9N2-prQn_a_0 2024-09-12T02:06:47.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9223985704436909501', time=2024-09-12T03:18:51.379342+0000, chain.objs.size()=1 2024-09-12T02:06:47.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7-qeLYkp3gduWjeQX3Dxjzdfl9ywEcX_0 2024-09-12T02:06:47.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10645414890701876926', time=2024-09-12T03:18:53.768196+0000, chain.objs.size()=1 2024-09-12T02:06:47.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xO0Tc9PP0c_zlyMK0JBAMyeostMzO-g_0 2024-09-12T02:06:47.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10614998072243799188', time=2024-09-12T03:18:54.450175+0000, chain.objs.size()=1 2024-09-12T02:06:47.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.TvWAoW8lIvnOmXAatRlXQfB4MkoUuiX_0 2024-09-12T02:06:47.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14162674030653199747', time=2024-09-12T03:18:55.759142+0000, chain.objs.size()=1 2024-09-12T02:06:47.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.106+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.sdvXVYM8LUo3nM1fd3DfxN5jla_ZUd4_0 2024-09-12T02:06:47.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3623409410886974047', time=2024-09-12T03:18:56.249248+0000, chain.objs.size()=1 2024-09-12T02:06:47.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.e8m13vCkbNTflYa-0LREOrx9o3ugpQJ_0 2024-09-12T02:06:47.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14417547882090145042', time=2024-09-12T03:18:57.267933+0000, chain.objs.size()=1 2024-09-12T02:06:47.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.nJR-LN8wTXaJy7zLH8h1m7J6LZR_INp_0 2024-09-12T02:06:47.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8267783701951788521', time=2024-09-12T03:18:57.285098+0000, chain.objs.size()=1 2024-09-12T02:06:47.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RuCFlSC-OqNqcYl0AeEbqrHTFBpdjrM_0 2024-09-12T02:06:47.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9143720259345541782', time=2024-09-12T03:18:57.811167+0000, chain.objs.size()=1 2024-09-12T02:06:47.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wHbBXprGDsRahoZ-m0Kf8GFs3YaPKYr_0 2024-09-12T02:06:47.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14343618712248289829', time=2024-09-12T03:18:58.654920+0000, chain.objs.size()=1 2024-09-12T02:06:47.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5SMN7FuEnb-gRHUX6bOyWztG1VxXo1O_0 2024-09-12T02:06:47.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16202559492985032778', time=2024-09-12T03:18:59.095329+0000, chain.objs.size()=1 2024-09-12T02:06:47.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.DJSogKLkMjsIwNXXvYvS2dRGV9ayWhO_0 2024-09-12T02:06:47.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11251610403776648402', time=2024-09-12T03:19:00.183786+0000, chain.objs.size()=1 2024-09-12T02:06:47.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.110+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5l-5UOTgUbzehbAaJn3QmI35tK3e8Hl_0 2024-09-12T02:06:47.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4577636159635277996', time=2024-09-12T03:19:00.411264+0000, chain.objs.size()=1 2024-09-12T02:06:47.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8MgcPaujXXnPbNbQtE-SmfxhoZpyBsg_0 2024-09-12T02:06:47.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4396484675894064467', time=2024-09-12T03:19:02.243858+0000, chain.objs.size()=1 2024-09-12T02:06:47.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.WNJgxtdjyGtJwGwEjuzJj7YGimeiFPL_0 2024-09-12T02:06:47.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5381017056264508886', time=2024-09-12T03:19:04.513042+0000, chain.objs.size()=1 2024-09-12T02:06:47.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6x6K1O738Y6r9UaZm2rPsqPf4Vt0zlQ_0 2024-09-12T02:06:47.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5100757254076031053', time=2024-09-12T03:19:07.710055+0000, chain.objs.size()=1 2024-09-12T02:06:47.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.SfOm1HmeomBcdN_3chuoxB-Z8-6B78O_0 2024-09-12T02:06:47.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1708116276919656356', time=2024-09-12T03:20:54.369594+0000, chain.objs.size()=1 2024-09-12T02:06:47.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.E3dMCBc02EtMBMR1EQqtsuP-Lb-arpO_0 2024-09-12T02:06:47.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5546573312257578518', time=2024-09-12T03:20:54.371333+0000, chain.objs.size()=1 2024-09-12T02:06:47.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.114+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.szava_qAKKMeEcwekIiW8fu19yyCt-R_0 2024-09-12T02:06:47.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2716405668817902486', time=2024-09-12T03:20:54.372807+0000, chain.objs.size()=1 2024-09-12T02:06:47.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3vXpFYXS9v0IpKqEhre5J5BZW4vapLb_0 2024-09-12T02:06:47.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15111693146637687966', time=2024-09-12T03:20:54.815646+0000, chain.objs.size()=1 2024-09-12T02:06:47.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4XK629hGG9IAVCWJa10QniDb4m2OpB3_0 2024-09-12T02:06:47.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4802869481815465483', time=2024-09-12T03:20:56.084343+0000, chain.objs.size()=1 2024-09-12T02:06:47.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pfvaWJYuHNPj7FxN5puarvM8jUEvQma_0 2024-09-12T02:06:47.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5754939689133744660', time=2024-09-12T03:20:57.527728+0000, chain.objs.size()=1 2024-09-12T02:06:47.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xmg9g3VZx8kwnqC57aEPZl3a26AaFAc_0 2024-09-12T02:06:47.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13476328631633953741', time=2024-09-12T03:20:58.743826+0000, chain.objs.size()=1 2024-09-12T02:06:47.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EBcxRFIFN9Jz7vZWWZe6mnYcTE3C11e_0 2024-09-12T02:06:47.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5471539917010210752', time=2024-09-12T03:21:02.997007+0000, chain.objs.size()=1 2024-09-12T02:06:47.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.zCI1jQB8KkUsTVhvqVqDnZ-fuOXGGcA_0 2024-09-12T02:06:47.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.994301213901698824', time=2024-09-12T03:21:03.347440+0000, chain.objs.size()=1 2024-09-12T02:06:47.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vq1Ht0T3Bv_l9vKZl3fGS3nh2vRTu3d_0 2024-09-12T02:06:47.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6329847194356616752', time=2024-09-12T03:21:03.724792+0000, chain.objs.size()=1 2024-09-12T02:06:47.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4RTTOF9u1QgTunJG5MWBdR7BF839tln_0 2024-09-12T02:06:47.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10481656283715626253', time=2024-09-12T03:21:04.037081+0000, chain.objs.size()=1 2024-09-12T02:06:47.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NB89SRWpsz7E5jZAESbIlYz5QvzReXx_0 2024-09-12T02:06:47.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2878000656212618493', time=2024-09-12T03:21:04.143107+0000, chain.objs.size()=1 2024-09-12T02:06:47.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.118+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DADeUIqK61wA8DzGVY91CDpYF2y56Lk_0 2024-09-12T02:06:47.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.122+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9733195531462305381', time=2024-09-12T03:21:05.921548+0000, chain.objs.size()=1 2024-09-12T02:06:47.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.122+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.FlMnnmx_UaNnXKv4HK8zSi6-v_pHBvV_0 2024-09-12T02:06:47.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4656442951551369136', time=2024-09-12T03:21:09.249619+0000, chain.objs.size()=1 2024-09-12T02:06:47.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YdufeDP6potDjy3YZMf776KPwwbnFC5_0 2024-09-12T02:06:47.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18435242632517967157', time=2024-09-12T03:21:17.680144+0000, chain.objs.size()=1 2024-09-12T02:06:47.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZP8g4TmJiC_K-bGaD4xwdcxuQTBE3YQ_0 2024-09-12T02:06:47.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12486250797350915810', time=2024-09-12T03:21:20.621447+0000, chain.objs.size()=1 2024-09-12T02:06:47.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.fzt1ymhK_GPitTavAjzg17-FEXAhVZV_0 2024-09-12T02:06:47.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11888796865260639872', time=2024-09-12T03:21:21.574439+0000, chain.objs.size()=1 2024-09-12T02:06:47.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Iyee9p_gqc-NQxw5EwgLvch-D0pGhlN_0 2024-09-12T02:06:47.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5055787909534810362', time=2024-09-12T03:21:23.188513+0000, chain.objs.size()=1 2024-09-12T02:06:47.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.xZPpWCt5KHIjtHYbjVHpcTX8PLGgVU2_0 2024-09-12T02:06:47.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12073035806108332267', time=2024-09-12T03:21:23.456082+0000, chain.objs.size()=1 2024-09-12T02:06:47.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3P_eQelc6uETyq50FKDKSRR3dew_36o_0 2024-09-12T02:06:47.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14009462013142332808', time=2024-09-12T03:21:43.007177+0000, chain.objs.size()=1 2024-09-12T02:06:47.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.333__shadow_.ZpckUFsy38gDEjU838OIE7yNmFPJAvB_0 2024-09-12T02:06:47.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17619866893582786640', time=2024-09-12T03:23:19.873142+0000, chain.objs.size()=1 2024-09-12T02:06:47.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.379__shadow_.FpMowJaqXZTOoB3T4MrlBma3otVWAAC_0 2024-09-12T02:06:47.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4529748194473226911', time=2024-09-12T03:24:26.943927+0000, chain.objs.size()=1 2024-09-12T02:06:47.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.409__shadow_.alKZ9nG8LQ1yzj8KCoZYfoQduoMmbas_0 2024-09-12T02:06:47.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6393546803772496874', time=2024-09-12T03:26:21.229112+0000, chain.objs.size()=1 2024-09-12T02:06:47.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.457__shadow_.HyFWa8TG7jzxt14Nw05dT7UoooW8i2M_0 2024-09-12T02:06:47.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1755387666784111640', time=2024-09-12T03:26:24.327973+0000, chain.objs.size()=1 2024-09-12T02:06:47.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.126+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.458__shadow_.BPVsVdruWH4etlxVBNokwyQbuRZ0HJ3_0 2024-09-12T02:06:47.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15652427803569955970', time=2024-09-12T03:26:30.691303+0000, chain.objs.size()=1 2024-09-12T02:06:47.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.460__shadow_.t1jOGBAXysBidrhQ4NsKx0lNg0d-o0r_0 2024-09-12T02:06:47.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10164613853245861680', time=2024-09-12T03:27:21.963825+0000, chain.objs.size()=1 2024-09-12T02:06:47.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.IYS3-hef8N4D7rVH3ktD6LpXlUDtG2I_0 2024-09-12T02:06:47.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16731657029646810082', time=2024-09-12T03:27:35.803234+0000, chain.objs.size()=1 2024-09-12T02:06:47.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.487__shadow_.sJRJhUQACR6BtNnIAWKSSq9OpzqrhPn_0 2024-09-12T02:06:47.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3455395512425330901', time=2024-09-12T03:37:49.217603+0000, chain.objs.size()=1 2024-09-12T02:06:47.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.551__shadow_.Fcsrd2H5d0iZFe8qVfUKGW-1p_I_biw_0 2024-09-12T02:06:47.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10351889991099397317', time=2024-09-12T03:38:09.611890+0000, chain.objs.size()=1 2024-09-12T02:06:47.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.553__shadow_.Y8o-YB7eW-uHEbWObK9dVWzLgtC7j9s_0 2024-09-12T02:06:47.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14808872222236223214', time=2024-09-12T03:38:38.534120+0000, chain.objs.size()=1 2024-09-12T02:06:47.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.130+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.556__shadow_.px4QVsCzBrlScZwywu8uDU1cgopxZna_0 2024-09-12T02:06:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16973819241781552085', time=2024-09-12T03:38:43.639901+0000, chain.objs.size()=1 2024-09-12T02:06:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.557__shadow_.L5qGu9hZXfqMx0rLUtlcQoeORXEBe3D_0 2024-09-12T02:06:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14718585455542823715', time=2024-09-12T03:39:35.868252+0000, chain.objs.size()=1 2024-09-12T02:06:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.566__shadow_.l6oaosUarFVAKe29jam3HHao7omc7Ps_0 2024-09-12T02:06:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5032311142521107438', time=2024-09-12T03:40:25.085995+0000, chain.objs.size()=1 2024-09-12T02:06:47.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow_.t15DGgaaU3dLvP1CDC1gN0kKtYx4StN_0 2024-09-12T02:06:47.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7941454579719990737', time=2024-09-12T03:41:10.413014+0000, chain.objs.size()=1 2024-09-12T02:06:47.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:kuOTQM4VF8YMgZbN5BV3FpLlrnH3Z4b_.sa19aaZm93a1iBDAAMubrOBCGFneHwA_0 2024-09-12T02:06:47.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13886920416713056089', time=2024-09-12T03:42:36.252200+0000, chain.objs.size()=1 2024-09-12T02:06:47.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.580__shadow:i9qrih1lk2GMIBtFvrm4fdtQs.GVVZ2_.6VRHY_-u9chSNCmGzGUA41JzjdhU6YB_0 2024-09-12T02:06:47.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13410960345645977287', time=2024-09-12T03:42:36.758402+0000, chain.objs.size()=1 2024-09-12T02:06:47.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.134+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.580__shadow:Y0dUs0vULmmuaSQ4wX7WR1R43JxomZ8_.3K3THqi2fXsfC6c-p0GdEsu6_p3bUNu_0 2024-09-12T02:06:47.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54476 2024-09-12T02:06:47.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T02:06:47.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7706482413852374990', time=2024-09-12T03:42:49.021557+0000, chain.objs.size()=1 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.584__shadow:EOn8Wj0TNJ1dt9mcUbO5F0Gun3cYIcd_.vZ0VYOrrxbJ8u-Dr_nY5xyYpy14cFRZ_0 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1170843345620333317', time=2024-09-12T03:42:59.449304+0000, chain.objs.size()=1 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.587__shadow:Se8hbXRcy6fCCndgSAwW2n.gW9HGFf7_.XdHDliM_pNFLKwXTy_5VHLT_0nbtQXv_0 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6666004753994758763', time=2024-09-12T03:50:43.994359+0000, chain.objs.size()=1 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.637__shadow_.E-aKI8-NXbupSEY9qE3knNw_b3MuwN4_0 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17570398746047306447', time=2024-09-12T03:51:10.272947+0000, chain.objs.size()=2 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.645__shadow_.JPzrQ4DiCm7O2l1KHXbbPRJ0CNCG1n9_0 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.645__shadow_.JPzrQ4DiCm7O2l1KHXbbPRJ0CNCG1n9_1 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11044252641290809541', time=2024-09-12T03:54:30.906680+0000, chain.objs.size()=1 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.704__shadow:ncXj-M32c7B4u4df1eI4OrxRHDRME11_.T8aFMhdbPN6zn3mIuyAkG6fv5xvZdv-_0 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4734519030668237559', time=2024-09-12T03:54:46.966079+0000, chain.objs.size()=1 2024-09-12T02:06:47.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.142+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.711__shadow:Pt1jVo7zU.xDdaMJdSS5MbbFWDn8Lp8_.j7ZOJvEZTPJ7VhXrfGlqaBXzFE18ejl_0 2024-09-12T02:06:47.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.146+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:47.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T02:06:47.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:47.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:47.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46870' 2024-09-12T02:06:47.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4918200134650724609', time=2024-09-12T03:10:35.289456+0000, chain.objs.size()=1 2024-09-12T02:06:47.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.235__shadow_.eV9a63QOiNK3Prv_e11jwHcDNjClMpq_0 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14801292350949332521', time=2024-09-12T03:10:58.876284+0000, chain.objs.size()=1 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.243__shadow_._IrSazLVRFFggW8BpbRG3KttgmD9uS__0 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6996844110365744174', time=2024-09-12T03:11:12.081521+0000, chain.objs.size()=1 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.247__shadow_.VuamILGjYIEOC26dzjJa6LnVxCe5FKH_0 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9033542216017525232', time=2024-09-12T03:11:32.150754+0000, chain.objs.size()=1 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.255__shadow_.KxA71Q36JEVw6WT3OxZjb_chrKQtCN9_0 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17686093022249269345', time=2024-09-12T03:13:34.267313+0000, chain.objs.size()=1 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.t0l5TJdtm32iyoLYoWyfWKvgZIJ571M_0 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6906826777669213479', time=2024-09-12T03:13:35.639587+0000, chain.objs.size()=1 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.m3H506liTTYLFrdtTjELk2M1Kn8CMlo_0 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4427274884550923027', time=2024-09-12T03:13:35.692247+0000, chain.objs.size()=1 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.vUM_eJqTJWj7yBwUXJykREiLPz9ofOj_0 2024-09-12T02:06:47.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4270364866964770704', time=2024-09-12T03:13:40.152216+0000, chain.objs.size()=1 2024-09-12T02:06:47.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Z7U_1k5cKRtya-Djqp2l38LkCH_uacd_0 2024-09-12T02:06:47.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5268747796322730565', time=2024-09-12T03:13:42.519590+0000, chain.objs.size()=1 2024-09-12T02:06:47.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.yMSFk2ZyCPUwSf2dn_BjavNLk37nrpm_0 2024-09-12T02:06:47.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11166415455147667955', time=2024-09-12T03:13:42.914477+0000, chain.objs.size()=1 2024-09-12T02:06:47.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.UsSj2OW88IZes6rehUhaFw95gTWey5b_0 2024-09-12T02:06:47.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17319718063192632435', time=2024-09-12T03:13:43.921805+0000, chain.objs.size()=1 2024-09-12T02:06:47.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.S32V9xYm5_dwFMyGopDz2Xo9n9TozSo_0 2024-09-12T02:06:47.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5043752346325254142', time=2024-09-12T03:13:44.259402+0000, chain.objs.size()=1 2024-09-12T02:06:47.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.150+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Ix2uERUYKkwEluDvDDQ3_Dd4GSuG-h2_0 2024-09-12T02:06:47.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2032469404527014437', time=2024-09-12T03:13:44.333058+0000, chain.objs.size()=1 2024-09-12T02:06:47.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.srjjlrbuHCn9vhMTIblZ6Bdoi2YK-Pt_0 2024-09-12T02:06:47.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14423727310349038174', time=2024-09-12T03:13:44.691382+0000, chain.objs.size()=1 2024-09-12T02:06:47.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.swDHr6NA41digILyKujkgWzs-ZwAtU2_0 2024-09-12T02:06:47.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5837947195948682118', time=2024-09-12T03:13:46.963539+0000, chain.objs.size()=1 2024-09-12T02:06:47.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.oCjyPMCAT-2n4PEGdvAoIVErMcVroxi_0 2024-09-12T02:06:47.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14294500102624058987', time=2024-09-12T03:13:47.910111+0000, chain.objs.size()=1 2024-09-12T02:06:47.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.sveO9QchI9wfyW8iuMQ-8Bvpkk2d-4c_0 2024-09-12T02:06:47.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7145965027843387273', time=2024-09-12T03:13:48.157730+0000, chain.objs.size()=1 2024-09-12T02:06:47.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.j5uTC3RAi9Lj4rrEqoPaJZDthis4ven_0 2024-09-12T02:06:47.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6044907438920650249', time=2024-09-12T03:13:48.717515+0000, chain.objs.size()=1 2024-09-12T02:06:47.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.154+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.TZTm7EtfoiFlGfwdCNzKkvH-Vd63EvI_0 2024-09-12T02:06:47.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9749779655251617113', time=2024-09-12T03:13:49.454769+0000, chain.objs.size()=1 2024-09-12T02:06:47.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.sxI7Gn7XaAhU2Cm7osl-9M_vS6p6fGS_0 2024-09-12T02:06:47.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17285598911003355159', time=2024-09-12T03:13:50.860196+0000, chain.objs.size()=1 2024-09-12T02:06:47.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0o8yJ_eb8qgFqAlEAsDJOQkjighU93h_0 2024-09-12T02:06:47.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4870486544377956671', time=2024-09-12T03:13:51.691794+0000, chain.objs.size()=1 2024-09-12T02:06:47.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.obeiFbaa2wVvFbzqI8SGirTKqCWIhez_0 2024-09-12T02:06:47.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16668835228221147752', time=2024-09-12T03:13:51.874588+0000, chain.objs.size()=1 2024-09-12T02:06:47.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.VOaLLA7MoJU2kalHIOKvTduJ3RfC2iB_0 2024-09-12T02:06:47.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12216432393623115606', time=2024-09-12T03:13:52.547476+0000, chain.objs.size()=1 2024-09-12T02:06:47.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jZhqtm9KD7QRHxEzw7aJ4C9F4JmYrfJ_0 2024-09-12T02:06:47.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.706883225762815443', time=2024-09-12T03:13:54.708378+0000, chain.objs.size()=1 2024-09-12T02:06:47.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Iwpe3ZaUhml6LdOEXmbRimUcHRsHhFs_0 2024-09-12T02:06:47.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9210519467835462032', time=2024-09-12T03:13:54.844921+0000, chain.objs.size()=1 2024-09-12T02:06:47.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.EUOQCDAYfK9LcqFrDUKIXd6pf-HJXGd_0 2024-09-12T02:06:47.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10204543521033678965', time=2024-09-12T03:13:55.207565+0000, chain.objs.size()=1 2024-09-12T02:06:47.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.158+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.FoIMOkFpwQ1P79n0H7AAMnd-orDzi6g_0 2024-09-12T02:06:47.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.162+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12167571958650844877', time=2024-09-12T03:13:55.913662+0000, chain.objs.size()=1 2024-09-12T02:06:47.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.162+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9aFeuSBXcPinSe4SGjdaPLmdaze-Ut6_0 2024-09-12T02:06:47.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.162+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10787853096009429107', time=2024-09-12T03:13:55.915531+0000, chain.objs.size()=1 2024-09-12T02:06:47.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.162+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.o2xS7xfKb7lLLs_BjYmhekdGHXZuOaz_0 2024-09-12T02:06:47.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.162+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10855432259483908945', time=2024-09-12T03:13:56.559513+0000, chain.objs.size()=1 2024-09-12T02:06:47.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.162+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KXeDAcZz9RDWFbsEJTOFeLUWzW8iGSr_0 2024-09-12T02:06:47.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.162+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2006801482670968481', time=2024-09-12T03:13:56.644749+0000, chain.objs.size()=1 2024-09-12T02:06:47.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.162+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3Zy3VRv4ObViQXAESFRUPYv0zY6hGVa_0 2024-09-12T02:06:47.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.162+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11372510480924574233', time=2024-09-12T03:13:59.765521+0000, chain.objs.size()=1 2024-09-12T02:06:47.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.162+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xnoBE2NuNERlpj1B8AVJhN5EMTfY5Z1_0 2024-09-12T02:06:47.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16966278300382873376', time=2024-09-12T03:13:59.767285+0000, chain.objs.size()=1 2024-09-12T02:06:47.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.PCgnErDgypdibkJpQYqazCYePt5nkjq_0 2024-09-12T02:06:47.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10467353758897736101', time=2024-09-12T03:14:02.633909+0000, chain.objs.size()=1 2024-09-12T02:06:47.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.7Dab17vQVLeBiaff6F_IVCS9tquAJCj_0 2024-09-12T02:06:47.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10602203363329072950', time=2024-09-12T03:14:02.731163+0000, chain.objs.size()=1 2024-09-12T02:06:47.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DymEzzwKA4U86JBwgE623e8HJTb_uKG_0 2024-09-12T02:06:47.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.909809483623590916', time=2024-09-12T03:14:05.444883+0000, chain.objs.size()=1 2024-09-12T02:06:47.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.24tCqHKm1P4oU2xn7XMgeIJVwy0udc9_0 2024-09-12T02:06:47.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6696693894837797784', time=2024-09-12T03:14:29.330794+0000, chain.objs.size()=1 2024-09-12T02:06:47.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.273__shadow_.MchG9KUtXMBuAuvam105BVjiNaOI0V-_0 2024-09-12T02:06:47.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1862401677434513056', time=2024-09-12T03:14:51.706851+0000, chain.objs.size()=1 2024-09-12T02:06:47.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.282__shadow_.yGi_z56gcQ4FJZvttoaeg4FnaFz4jPk_0 2024-09-12T02:06:47.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7882774675303284315', time=2024-09-12T03:15:29.496084+0000, chain.objs.size()=1 2024-09-12T02:06:47.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.jVUULlE-vqc4CfTbDE38n91o8_VHTwJ_0 2024-09-12T02:06:47.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6587777067788393093', time=2024-09-12T03:15:29.497327+0000, chain.objs.size()=1 2024-09-12T02:06:47.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.WgOVigETSxEfMtv1IHB6Ywfpb18fQW__0 2024-09-12T02:06:47.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4524396773669046501', time=2024-09-12T03:15:29.584061+0000, chain.objs.size()=1 2024-09-12T02:06:47.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.166+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.wRXgJKCvX2NCsVrFTxJugMldwSgtXlB_0 2024-09-12T02:06:47.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6841864364971869925', time=2024-09-12T03:15:55.188229+0000, chain.objs.size()=1 2024-09-12T02:06:47.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.304__shadow_.ZKs8k5a_ui8mDkbPll6CXWf8tsVu0uX_0 2024-09-12T02:06:47.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17200353796763775826', time=2024-09-12T03:15:57.644863+0000, chain.objs.size()=1 2024-09-12T02:06:47.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.305__shadow_.JzX8k_0dyX7-Kus8p64pmlqNc6QQ3AD_0 2024-09-12T02:06:47.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8908103886292018289', time=2024-09-12T03:16:00.150447+0000, chain.objs.size()=1 2024-09-12T02:06:47.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.306__shadow_.zx8uTYalZJLf7Ic2bEZwvDAFKsMh1W4_0 2024-09-12T02:06:47.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11345371701648177299', time=2024-09-12T03:16:33.053500+0000, chain.objs.size()=1 2024-09-12T02:06:47.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.316__shadow_._9WaeoRiFC6khbMh1If9Kw6eS-rqtYS_0 2024-09-12T02:06:47.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11128976114785302038', time=2024-09-12T03:18:36.622484+0000, chain.objs.size()=1 2024-09-12T02:06:47.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.NbHLK-_x2BhdWLPenowkandStqVBYaF_0 2024-09-12T02:06:47.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5425671957346883152', time=2024-09-12T03:18:37.789248+0000, chain.objs.size()=1 2024-09-12T02:06:47.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.170+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hdbCJDMaERbGWuCxC322QMmmX8aatRe_0 2024-09-12T02:06:47.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7995663147673214721', time=2024-09-12T03:18:38.960353+0000, chain.objs.size()=1 2024-09-12T02:06:47.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-y9sgBKFhFqjyUn5kRHDGiLgesrzTgl_0 2024-09-12T02:06:47.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10514601927839793096', time=2024-09-12T03:18:39.006965+0000, chain.objs.size()=1 2024-09-12T02:06:47.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xlU-MMqaIQlH7zjJJmwks6yR-OrFT8y_0 2024-09-12T02:06:47.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4914993521334110585', time=2024-09-12T03:18:39.503949+0000, chain.objs.size()=1 2024-09-12T02:06:47.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.j0iro_OEMIkFzVKT8geyXp0OWl8pTFg_0 2024-09-12T02:06:47.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16409866108452582538', time=2024-09-12T03:18:42.154905+0000, chain.objs.size()=1 2024-09-12T02:06:47.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.bJKgTk9H7f8EmQ_abaIrHtq1jIF8TSQ_0 2024-09-12T02:06:47.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4343779886543135951', time=2024-09-12T03:18:43.382697+0000, chain.objs.size()=1 2024-09-12T02:06:47.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wDJLXgut1Ne6Z9GljCMxMWjw6ASolfw_0 2024-09-12T02:06:47.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2052751008696518733', time=2024-09-12T03:18:43.920258+0000, chain.objs.size()=1 2024-09-12T02:06:47.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.mW7mcj4XCWdBiGec4kZ9UwMRZYLDhet_0 2024-09-12T02:06:47.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2010838285302755475', time=2024-09-12T03:18:45.427997+0000, chain.objs.size()=1 2024-09-12T02:06:47.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.X1PqBZ5np1vWJyNV1MBjS4DM9Dl_TKn_0 2024-09-12T02:06:47.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11152808250173984208', time=2024-09-12T03:18:46.542509+0000, chain.objs.size()=1 2024-09-12T02:06:47.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.1Lp9Au3Rx4B1lGLsBC3h2Mb5_IibLkA_0 2024-09-12T02:06:47.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16698360849023683243', time=2024-09-12T03:18:47.445761+0000, chain.objs.size()=1 2024-09-12T02:06:47.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AxX9kMxBzyhxzwsgkcL2BE3xXW-eQRM_0 2024-09-12T02:06:47.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15350152093026017023', time=2024-09-12T03:18:47.516952+0000, chain.objs.size()=1 2024-09-12T02:06:47.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.174+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2Yg0RpgrWFRGECAq-yya5sNWfdRng1n_0 2024-09-12T02:06:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5134257597567241408', time=2024-09-12T03:18:47.595608+0000, chain.objs.size()=1 2024-09-12T02:06:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VvWk_mdmZKGUTZTV3sefYqCzp4ZuaIS_0 2024-09-12T02:06:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9129912552992063690', time=2024-09-12T03:18:49.440840+0000, chain.objs.size()=1 2024-09-12T02:06:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tUOe19mCuQrYRCNX4icK_4rLxCqvC1B_0 2024-09-12T02:06:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8915218102170631856', time=2024-09-12T03:18:51.627007+0000, chain.objs.size()=1 2024-09-12T02:06:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.HKuCMF7uD5DFAVL_ociysR6Gg2o8i71_0 2024-09-12T02:06:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1552487941291416176', time=2024-09-12T03:18:53.228566+0000, chain.objs.size()=1 2024-09-12T02:06:47.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.sq3HXiJCb9VlpC2fFJPuAH7q_2EScWN_0 2024-09-12T02:06:47.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.151055607078369800', time=2024-09-12T03:18:55.134844+0000, chain.objs.size()=1 2024-09-12T02:06:47.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.g1jksiLJVZr-CDEEKJa8Pf1ZvrWbSii_0 2024-09-12T02:06:47.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7382637981857356255', time=2024-09-12T03:18:55.882545+0000, chain.objs.size()=1 2024-09-12T02:06:47.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.178+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.kppVIn4pVc1sP_fE-ErXW_SphGPwhVQ_0 2024-09-12T02:06:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1903863073543038410', time=2024-09-12T03:18:58.510665+0000, chain.objs.size()=1 2024-09-12T02:06:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.0dc7AkzDNeNLewYo6-LGtT7RCdmDcnK_0 2024-09-12T02:06:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12164944635728978474', time=2024-09-12T03:18:58.779299+0000, chain.objs.size()=1 2024-09-12T02:06:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6Y2XCzJs1yJOiM_Q8PLEfXw5ynQRi7l_0 2024-09-12T02:06:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15139253662790580917', time=2024-09-12T03:18:58.943798+0000, chain.objs.size()=1 2024-09-12T02:06:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.e2e8_C37wDcv8X82LhCqb-wbvTsjIqr_0 2024-09-12T02:06:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13718690638620841052', time=2024-09-12T03:19:01.229872+0000, chain.objs.size()=1 2024-09-12T02:06:47.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.FFDigljAEXZnACsVvsEesL5S0dZLP8l_0 2024-09-12T02:06:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12237347985023888627', time=2024-09-12T03:19:02.238999+0000, chain.objs.size()=1 2024-09-12T02:06:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.SdRGTLOTcpAifY7Gme2MzxCDxSsknQ__0 2024-09-12T02:06:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13541760754220412879', time=2024-09-12T03:19:02.684445+0000, chain.objs.size()=1 2024-09-12T02:06:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fyE6DSc9k65zDQfKVf4k9cxA1x08y-Z_0 2024-09-12T02:06:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6515871436083506550', time=2024-09-12T03:19:03.361587+0000, chain.objs.size()=1 2024-09-12T02:06:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PfCyo8y4jQFmbQvdtLOCJQKZyv4GEAt_0 2024-09-12T02:06:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8337219242127975509', time=2024-09-12T03:19:03.431110+0000, chain.objs.size()=1 2024-09-12T02:06:47.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.y77EgKpvmk0RRe7wc-u6hSwnSQpa3wQ_0 2024-09-12T02:06:47.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15436020635237137680', time=2024-09-12T03:19:03.945429+0000, chain.objs.size()=1 2024-09-12T02:06:47.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4z3lrIYQrxfsL2pdVsphLdfXpyPrboH_0 2024-09-12T02:06:47.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14917739158555087003', time=2024-09-12T03:19:04.241465+0000, chain.objs.size()=1 2024-09-12T02:06:47.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.5hCAftEDjyhQgXNadqyB8AI4t36bmZ5_0 2024-09-12T02:06:47.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3890604032921154845', time=2024-09-12T03:19:07.609877+0000, chain.objs.size()=1 2024-09-12T02:06:47.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.182+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3JMIL9YKqgjMlPhC-wPT1Gc0ICDHplV_0 2024-09-12T02:06:47.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17136604249372361642', time=2024-09-12T03:20:55.906901+0000, chain.objs.size()=1 2024-09-12T02:06:47.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.a1J_1hCEZi7bFEilPdlVoPPPzvaSKIb_0 2024-09-12T02:06:47.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17983105647272678390', time=2024-09-12T03:20:58.667007+0000, chain.objs.size()=1 2024-09-12T02:06:47.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.WDz3I-73vIk-Xf8Dr4t5-0wEYtF2Wk9_0 2024-09-12T02:06:47.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13897269296559200766', time=2024-09-12T03:20:59.425376+0000, chain.objs.size()=1 2024-09-12T02:06:47.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.OfaG8TM1cuhbQul_vmd_9mrCG4H2BbE_0 2024-09-12T02:06:47.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8133514285570388647', time=2024-09-12T03:20:59.715251+0000, chain.objs.size()=1 2024-09-12T02:06:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.v_VaCOtA7DE3nY2-xADAlh7GDMb5a3P_0 2024-09-12T02:06:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7506002534820297046', time=2024-09-12T03:20:59.968750+0000, chain.objs.size()=1 2024-09-12T02:06:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ThVf9B0L10TRugdCtL7687baUyWPECw_0 2024-09-12T02:06:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18174054255716130953', time=2024-09-12T03:21:00.805783+0000, chain.objs.size()=1 2024-09-12T02:06:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.znWz-N4AHSG7CKf3sykAC5WXz1f5ww3_0 2024-09-12T02:06:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12343514649977998056', time=2024-09-12T03:21:01.039357+0000, chain.objs.size()=1 2024-09-12T02:06:47.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.jBrIEEYe9oohw6O7oXDvSnFGO057C65_0 2024-09-12T02:06:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11410183529466239234', time=2024-09-12T03:21:04.434321+0000, chain.objs.size()=1 2024-09-12T02:06:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kRlANsqdQsnFsHAnPGasAB15NFVc16l_0 2024-09-12T02:06:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.512119750269408430', time=2024-09-12T03:21:05.788996+0000, chain.objs.size()=1 2024-09-12T02:06:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.a3HHInfVP2mrjxbMfiYDPsQwRFq1X9c_0 2024-09-12T02:06:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15720514303288988405', time=2024-09-12T03:21:07.881974+0000, chain.objs.size()=1 2024-09-12T02:06:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.BFD3oljXxVHL0EZn6wyEtCo1AeqsKWT_0 2024-09-12T02:06:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11934929317522293923', time=2024-09-12T03:21:08.692934+0000, chain.objs.size()=1 2024-09-12T02:06:47.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.190+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IMcf1cgaL8mlqLnXbUqiv-eBGqjNgrf_0 2024-09-12T02:06:47.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4796178774501204852', time=2024-09-12T03:21:08.877371+0000, chain.objs.size()=1 2024-09-12T02:06:47.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wbEsnceUBU9FzfsQFain4bSwISVjCZ__0 2024-09-12T02:06:47.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10154419108097230625', time=2024-09-12T03:21:09.440039+0000, chain.objs.size()=1 2024-09-12T02:06:47.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.pR6Mr6aTSjG9SOIeE7597Bdz1AYLnZM_0 2024-09-12T02:06:47.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18055696836284712000', time=2024-09-12T03:21:09.698475+0000, chain.objs.size()=1 2024-09-12T02:06:47.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ZtGMbLVOa58JTCO8PVmFvgEb2nCOVrD_0 2024-09-12T02:06:47.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6976963676460897514', time=2024-09-12T03:21:11.555134+0000, chain.objs.size()=1 2024-09-12T02:06:47.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9xNMkMERb-LBP0nRXoOJBWezIcBpbEI_0 2024-09-12T02:06:47.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2075751286162159146', time=2024-09-12T03:21:11.586488+0000, chain.objs.size()=1 2024-09-12T02:06:47.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.clzHTQj019YbgH53QX3sPUEKLMvJWNy_0 2024-09-12T02:06:47.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6635399771546989165', time=2024-09-12T03:21:11.747543+0000, chain.objs.size()=1 2024-09-12T02:06:47.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4nBA3Rk-E3YItbGJ9mvveg-pbXss37E_0 2024-09-12T02:06:47.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10730628226229752765', time=2024-09-12T03:21:12.191653+0000, chain.objs.size()=1 2024-09-12T02:06:47.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.194+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.voYnRqt4y_MRJJpdbRHv_JvYlOUogxJ_0 2024-09-12T02:06:47.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16478122082464881180', time=2024-09-12T03:21:13.412940+0000, chain.objs.size()=1 2024-09-12T02:06:47.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lnDt_-e_mkv6D-PImzAhzJuUDi5vRfu_0 2024-09-12T02:06:47.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9865167760166478542', time=2024-09-12T03:21:13.893765+0000, chain.objs.size()=1 2024-09-12T02:06:47.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.FUh8P0ESxWR6ofPxXQEzXoXVae3YHjt_0 2024-09-12T02:06:47.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5280221347926200808', time=2024-09-12T03:21:15.264512+0000, chain.objs.size()=1 2024-09-12T02:06:47.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yTV3mlmUEGWGIXnu5un0ZwvKQMdR6z6_0 2024-09-12T02:06:47.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.343620729307915325', time=2024-09-12T03:21:15.266513+0000, chain.objs.size()=1 2024-09-12T02:06:47.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.aDFCVRDTte3rkrl4RBDjJ06Oq3k6exY_0 2024-09-12T02:06:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13024360246649246810', time=2024-09-12T03:21:16.488844+0000, chain.objs.size()=1 2024-09-12T02:06:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.gSDE1p2Dg4B8lI2OQFU0UaxHXmiZpAV_0 2024-09-12T02:06:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6208082709621299849', time=2024-09-12T03:21:17.678895+0000, chain.objs.size()=1 2024-09-12T02:06:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yvhVgFhBxbWUj6x8UKDBNmGBEtpJ7qQ_0 2024-09-12T02:06:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9509581766076369564', time=2024-09-12T03:21:21.537244+0000, chain.objs.size()=1 2024-09-12T02:06:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.198+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.a_TH1CaQaOgIY-4RD-YKHfp87_q5qLm_0 2024-09-12T02:06:47.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.202+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5228094603419740367', time=2024-09-12T03:21:21.757076+0000, chain.objs.size()=1 2024-09-12T02:06:47.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.202+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.U1RM72IQBgoSKjBy30AXpZ94If2DhsC_0 2024-09-12T02:06:47.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.202+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4240462615385270814', time=2024-09-12T03:21:22.015241+0000, chain.objs.size()=1 2024-09-12T02:06:47.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.202+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.6cxnH5Z-Q_Z8wWqeyAnTZUakSvMniqU_0 2024-09-12T02:06:47.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.206+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46870 2024-09-12T02:06:47.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T02:06:47.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.619753720678119575', time=2024-09-12T03:21:25.293709+0000, chain.objs.size()=1 2024-09-12T02:06:47.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.k3WX3YYgeiUCqraa60xjI3tUNNA_mx2_0 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12201380747632153234', time=2024-09-12T03:22:03.774737+0000, chain.objs.size()=1 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.342__shadow_.bvoVzzP9JBSJZxbzTJGI7qi80CedSkg_0 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17638278688435250271', time=2024-09-12T03:23:17.485584+0000, chain.objs.size()=1 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.378__shadow_.OsoISXgxhsjCpHitjfhmlAbrFYHJjBh_0 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15406923320514983933', time=2024-09-12T03:26:30.706639+0000, chain.objs.size()=1 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.460__shadow_.Afq-40FmNP9VRb4b_BufFTrsxc3sdrR_0 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14015270890198027178', time=2024-09-12T03:27:15.806367+0000, chain.objs.size()=1 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.482__shadow_.-FAV7zuHSa1SL5lmOJG92LB17Vyn9oR_0 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7770492182463714608', time=2024-09-12T03:27:24.874879+0000, chain.objs.size()=1 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.485__shadow_.wm3KgKOgsTp6e1LvUDyTKoCgyd8rkdW_0 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5549966942798642500', time=2024-09-12T03:27:54.186672+0000, chain.objs.size()=1 2024-09-12T02:06:47.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.496__shadow_.rJ3zqa8ahe3N0_7YOOoXQnaJGbVt4FD_0 2024-09-12T02:06:47.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13661928591696327523', time=2024-09-12T03:27:56.267642+0000, chain.objs.size()=1 2024-09-12T02:06:47.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.497__shadow_.U1X9hqWOmRkbJySDFX5dikJ0KH9P33G_0 2024-09-12T02:06:47.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7013049683512686525', time=2024-09-12T03:28:55.409770+0000, chain.objs.size()=6 2024-09-12T02:06:47.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.1 2024-09-12T02:06:47.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.2 2024-09-12T02:06:47.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.3 2024-09-12T02:06:47.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.210+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.4 2024-09-12T02:06:47.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.5 2024-09-12T02:06:47.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.508__multipart_srcmultipart.2~dwalHS2YQvhRhvIslAmT6nFSpI8HLAs.6 2024-09-12T02:06:47.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7', time=2024-09-12T03:35:38.336724+0000, chain.objs.size()=10 2024-09-12T02:06:47.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.527__multipart_mymultipart.2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7.1 2024-09-12T02:06:47.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.527__multipart_mymultipart.2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7.2 2024-09-12T02:06:47.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.527__multipart_mymultipart.2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7.3 2024-09-12T02:06:47.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.527__multipart_mymultipart.2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7.4 2024-09-12T02:06:47.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.527__multipart_mymultipart.2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7.5 2024-09-12T02:06:47.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.527__multipart_mymultipart.2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7.6 2024-09-12T02:06:47.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.527__multipart_mymultipart.2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7.7 2024-09-12T02:06:47.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.527__multipart_mymultipart.2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7.8 2024-09-12T02:06:47.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.214+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.527__multipart_mymultipart.2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7.9 2024-09-12T02:06:47.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.527__multipart_mymultipart.2~jBkMGwAhau9BADtPrLcuMsMDkt0y1Z7.10 2024-09-12T02:06:47.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~R_Wp8lyMr2mJgstWtzR9mHPFJN89Csu', time=2024-09-12T03:36:40.983203+0000, chain.objs.size()=1 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.536__multipart_mymultipart.2~R_Wp8lyMr2mJgstWtzR9mHPFJN89Csu.3 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12324775528811453647', time=2024-09-12T03:37:02.569708+0000, chain.objs.size()=1 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.537__multipart_mymultipart.2~uGzfWBmhtS1VgPwhL2cje7KRo_2MUUr.1 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16909726371345182726', time=2024-09-12T03:38:51.854772+0000, chain.objs.size()=1 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.558__shadow_.sFgiY9b6aRfc06BEv9CeG4W8-HLe1c6_0 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7035254297027953655', time=2024-09-12T03:38:52.503221+0000, chain.objs.size()=2 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.558__shadow_.D7TBo3qZFVpUtvPyQBJWOloyK4Tpwkt_0 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.558__shadow_.D7TBo3qZFVpUtvPyQBJWOloyK4Tpwkt_1 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17807172042019958660', time=2024-09-12T03:39:18.991421+0000, chain.objs.size()=1 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.562__multipart_mymultipart.bb7A5ki7zBuXfAXcFaZsYvSj3u5zP8lE.1 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4378894899117550141', time=2024-09-12T03:40:02.175845+0000, chain.objs.size()=1 2024-09-12T02:06:47.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:JKHlJM9vKUuO3B0fqtks6x2CZt2JgM6_.KurJcv4CF7EbKhB6joN2eJLA2deTvVi_0 2024-09-12T02:06:47.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13609052154781674364', time=2024-09-12T03:40:14.404876+0000, chain.objs.size()=1 2024-09-12T02:06:47.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.572__shadow_.zg5q7o1kBwTbtYb6rLu-GuXkMNwYzla_0 2024-09-12T02:06:47.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11329303542760221512', time=2024-09-12T03:40:28.619376+0000, chain.objs.size()=1 2024-09-12T02:06:47.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow:4rLuyRli9TFXg6ah.ltCSWzs57pzR1y_.hwvSp598JZdLdvPmjxj4ZLNwXhS82pl_0 2024-09-12T02:06:47.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9913619500032504323', time=2024-09-12T03:41:01.737427+0000, chain.objs.size()=1 2024-09-12T02:06:47.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.222+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:xdfG0-8Nc3r3rIPgH7wOH-M98l6.b1W_.l9YGM89lLRmSOm9K_A22QbxKo-ZE6d9_0 2024-09-12T02:06:47.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.898036070089350118', time=2024-09-12T03:41:24.490374+0000, chain.objs.size()=1 2024-09-12T02:06:47.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:Iq8irX8ePBDtKJogln.YY6abzGBJde7_.KT8b29UbeZgJCvfRPUFLyx7ryO444aw_0 2024-09-12T02:06:47.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.834500484610586489', time=2024-09-12T03:41:31.458004+0000, chain.objs.size()=1 2024-09-12T02:06:47.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:6nYgxZKqk3iHTzDJATExaezxt372VP._.laMD9UTogD5qU6RY64cJs0j3ZfS1Z9Q_0 2024-09-12T02:06:47.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2443662068822867996', time=2024-09-12T03:42:18.871289+0000, chain.objs.size()=4 2024-09-12T02:06:47.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~0_PqyaIyhBCq_Yn3dV6mlwKtx4zSf7M.1 2024-09-12T02:06:47.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~0_PqyaIyhBCq_Yn3dV6mlwKtx4zSf7M.2 2024-09-12T02:06:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~0_PqyaIyhBCq_Yn3dV6mlwKtx4zSf7M.3 2024-09-12T02:06:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.579__multipart_testobj.2~0_PqyaIyhBCq_Yn3dV6mlwKtx4zSf7M.4 2024-09-12T02:06:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13608998282585310406', time=2024-09-12T03:43:04.499197+0000, chain.objs.size()=1 2024-09-12T02:06:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.588__shadow:kreFq9FvNeNkhndx9DWjk3fMNXtuJHT_.5INOtKOLk-vpCfxYUbeDcR6aFlVKWSF_0 2024-09-12T02:06:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9937089596909800229', time=2024-09-12T03:48:46.607566+0000, chain.objs.size()=1 2024-09-12T02:06:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.621__shadow_.JDN_m3pZdABjSL13dR3tL-hgTftWiO8_0 2024-09-12T02:06:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1773316218199604881', time=2024-09-12T03:49:40.708816+0000, chain.objs.size()=12 2024-09-12T02:06:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__multipart_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.1 2024-09-12T02:06:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__shadow_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.1_1 2024-09-12T02:06:47.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.226+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__multipart_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.2 2024-09-12T02:06:47.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.230+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__shadow_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.2_1 2024-09-12T02:06:47.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__multipart_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.3 2024-09-12T02:06:47.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__shadow_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.3_1 2024-09-12T02:06:47.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__multipart_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.4 2024-09-12T02:06:47.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__shadow_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.4_1 2024-09-12T02:06:47.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__multipart_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.5 2024-09-12T02:06:47.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__shadow_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.5_1 2024-09-12T02:06:47.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__multipart_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.6 2024-09-12T02:06:47.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.624__shadow_multipart_enc.2~WKLtcmcsyUdVB5Cb-hgrXJlCI6MT5JD.6_1 2024-09-12T02:06:47.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3248379391491575710', time=2024-09-12T03:53:00.511272+0000, chain.objs.size()=6 2024-09-12T02:06:47.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.661__multipart_bar.2~AB2XmdYEANYF17hhJJNnbLGXZmZ_UGF.1 2024-09-12T02:06:47.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.234+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.661__multipart_bar.2~AB2XmdYEANYF17hhJJNnbLGXZmZ_UGF.2 2024-09-12T02:06:47.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.238+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.661__multipart_bar.2~AB2XmdYEANYF17hhJJNnbLGXZmZ_UGF.3 2024-09-12T02:06:47.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.661__multipart_bar.2~AB2XmdYEANYF17hhJJNnbLGXZmZ_UGF.4 2024-09-12T02:06:47.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.661__multipart_bar.2~AB2XmdYEANYF17hhJJNnbLGXZmZ_UGF.5 2024-09-12T02:06:47.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.661__multipart_bar.2~AB2XmdYEANYF17hhJJNnbLGXZmZ_UGF.6 2024-09-12T02:06:47.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16133883199446537099', time=2024-09-12T03:54:14.583408+0000, chain.objs.size()=1 2024-09-12T02:06:47.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.697__shadow:qEuD0rK2oRDpCYAp56f2HW0W2P8A4rx_.kPhWin3uj8QZqCZ0_BuQVU-BvYpw3f6_0 2024-09-12T02:06:47.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13347055499611787149', time=2024-09-12T03:54:53.733394+0000, chain.objs.size()=1 2024-09-12T02:06:47.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.714__shadow:e-xLaTRlXRepnQF.aFNmUbQEADJFTpq_.TPcaO4m99aIYM235t8DQTQTa9FtWMfL_0 2024-09-12T02:06:47.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.242+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~D8dMamZ0vPVUJuZq1Y8CpU1va-PsGim', time=2024-09-12T03:56:42.416871+0000, chain.objs.size()=1 2024-09-12T02:06:47.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.242+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.743__multipart_mymultipart2.2~D8dMamZ0vPVUJuZq1Y8CpU1va-PsGim.1 2024-09-12T02:06:47.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.246+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:47.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.250+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T02:06:47.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.250+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.250+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54220' 2024-09-12T02:06:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3613492262384416843', time=2024-09-12T03:03:30.963230+0000, chain.objs.size()=5 2024-09-12T02:06:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__multipart_mymultipart-FROZEN.2~OzXJBFF-qqeDUh4aom9cTn4DrXjajY0.1 2024-09-12T02:06:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__shadow_mymultipart-FROZEN.2~OzXJBFF-qqeDUh4aom9cTn4DrXjajY0.1_1 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__multipart_mymultipart-FROZEN.2~OzXJBFF-qqeDUh4aom9cTn4DrXjajY0.2 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__shadow_mymultipart-FROZEN.2~OzXJBFF-qqeDUh4aom9cTn4DrXjajY0.2_1 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.160__multipart_mymultipart-FROZEN.2~OzXJBFF-qqeDUh4aom9cTn4DrXjajY0.3 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_p9S9E4tYaEEfIZt3vGugFftg3Djbdkv', time=2024-09-12T03:04:32.534455+0000, chain.objs.size()=3 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.xkfnPtKPTjMzVZZ70JP9EnPf876m3IL_0 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.xkfnPtKPTjMzVZZ70JP9EnPf876m3IL_1 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.xkfnPtKPTjMzVZZ70JP9EnPf876m3IL_2 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_lzbneuyQRbctup_YYKe6F_dJATdEVMt', time=2024-09-12T03:04:34.567203+0000, chain.objs.size()=3 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.Zh1PYcOkoechQJPJN5hxGsHHOWBghWd_0 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.Zh1PYcOkoechQJPJN5hxGsHHOWBghWd_1 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.162__shadow_.Zh1PYcOkoechQJPJN5hxGsHHOWBghWd_2 2024-09-12T02:06:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3402048951153991535', time=2024-09-12T03:10:37.862885+0000, chain.objs.size()=1 2024-09-12T02:06:47.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.254+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.236__shadow_.DkDLPFPhgMQCW0EgQYnBhAQ2fd7DeL4_0 2024-09-12T02:06:47.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3699733288549127156', time=2024-09-12T03:13:36.444064+0000, chain.objs.size()=1 2024-09-12T02:06:47.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.TJ9y4ERVa8tCYjS9bT2FF8cnRwWNZyI_0 2024-09-12T02:06:47.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7723593832755466307', time=2024-09-12T03:13:39.086561+0000, chain.objs.size()=1 2024-09-12T02:06:47.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Aj4cRR6pt_ePozR_rUVwhAj6Fi1OTVO_0 2024-09-12T02:06:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12105532940467855542', time=2024-09-12T03:13:39.292183+0000, chain.objs.size()=1 2024-09-12T02:06:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9dQAweqdYArlV89nSym5F_3fnmnZcqJ_0 2024-09-12T02:06:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.209473361819760800', time=2024-09-12T03:13:40.258805+0000, chain.objs.size()=1 2024-09-12T02:06:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.1tVm5R1eDZfUd01ULBd7Dyf1kCXyoI7_0 2024-09-12T02:06:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.429779632907802465', time=2024-09-12T03:13:40.476263+0000, chain.objs.size()=1 2024-09-12T02:06:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uUqBQdgaRRYHcM7D-fWmGnVTo2ZEiJ5_0 2024-09-12T02:06:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17066154839872238882', time=2024-09-12T03:13:42.581805+0000, chain.objs.size()=1 2024-09-12T02:06:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.elrMqI6oVPMTm8FuU_iMgHZv8IhbKA9_0 2024-09-12T02:06:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2251756613635024976', time=2024-09-12T03:13:42.583770+0000, chain.objs.size()=1 2024-09-12T02:06:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2OgWj2UQUWSU6fEHDTE7eL5Iz1b_44P_0 2024-09-12T02:06:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4199431952032622288', time=2024-09-12T03:13:44.253211+0000, chain.objs.size()=1 2024-09-12T02:06:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ifcBiDSVkUgZFmQ0zJRTIqjZWQ0JrLr_0 2024-09-12T02:06:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13109457200537555961', time=2024-09-12T03:13:45.462708+0000, chain.objs.size()=1 2024-09-12T02:06:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.E2eI9fc6DUC75uUgcv1s5Kg9hRi8M6t_0 2024-09-12T02:06:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11734090756522020948', time=2024-09-12T03:13:45.464784+0000, chain.objs.size()=1 2024-09-12T02:06:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.m_tVSAj0pELkrjFtvtDI6YSlFgK1hlA_0 2024-09-12T02:06:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2388082019032755609', time=2024-09-12T03:13:46.620641+0000, chain.objs.size()=1 2024-09-12T02:06:47.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.258+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.rhwcXxxubv2nuRDUN77s4MixjxRFRB7_0 2024-09-12T02:06:47.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.262+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15572749145797417296', time=2024-09-12T03:13:47.603105+0000, chain.objs.size()=1 2024-09-12T02:06:47.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.262+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.FMR2HGBocmyg_JqOp5otP6aSLadhxUh_0 2024-09-12T02:06:47.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14220243069593009746', time=2024-09-12T03:13:47.723109+0000, chain.objs.size()=1 2024-09-12T02:06:47.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hcW2UbhP5NiqTfWshzpQc6kNaGkys1S_0 2024-09-12T02:06:47.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4492704314171814103', time=2024-09-12T03:13:48.125185+0000, chain.objs.size()=1 2024-09-12T02:06:47.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.2pRgjii24ML6M79D74azBlBTC2eHX5__0 2024-09-12T02:06:47.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.520727636465702000', time=2024-09-12T03:13:48.433064+0000, chain.objs.size()=1 2024-09-12T02:06:47.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.fWxgcbIbgEFl_kobtv4NcKH_kxMiHII_0 2024-09-12T02:06:47.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6929936983535559315', time=2024-09-12T03:13:50.874229+0000, chain.objs.size()=1 2024-09-12T02:06:47.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.PMVKEvb2cYbEbd2Yd-oFaquwqGVOa3-_0 2024-09-12T02:06:47.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11129363895384635219', time=2024-09-12T03:13:52.785088+0000, chain.objs.size()=1 2024-09-12T02:06:47.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Y2zOCWbvA2MqYs7ph3Zo3oQKLoZk7Vl_0 2024-09-12T02:06:47.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15458452288942814135', time=2024-09-12T03:13:53.139481+0000, chain.objs.size()=1 2024-09-12T02:06:47.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.BpJSkM9blUHcax2hc8cEklKhFLkDsCG_0 2024-09-12T02:06:47.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14387818781324686895', time=2024-09-12T03:13:53.230141+0000, chain.objs.size()=1 2024-09-12T02:06:47.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.dHxwnve-1rqzjWmWaJYozfqRzaeKIRo_0 2024-09-12T02:06:47.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2528807487501417257', time=2024-09-12T03:13:53.282978+0000, chain.objs.size()=1 2024-09-12T02:06:47.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.tQ1wJXHZ4DpBe2SXMO_0dEsYUy8K-WG_0 2024-09-12T02:06:47.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9633864197240480674', time=2024-09-12T03:13:55.202173+0000, chain.objs.size()=1 2024-09-12T02:06:47.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.hrK3BJciZvt3YwxOEPBf3lZKVBzwf6q_0 2024-09-12T02:06:47.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11313889703637840260', time=2024-09-12T03:13:57.870950+0000, chain.objs.size()=1 2024-09-12T02:06:47.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.266+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.149WtA7iAHwIPKgTVn3ZiQRtowkWdRN_0 2024-09-12T02:06:47.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4404061018837710881', time=2024-09-12T03:13:58.835930+0000, chain.objs.size()=1 2024-09-12T02:06:47.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.V3NDOvYERwcZkKDeF0pgFK3norsZv7N_0 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6383420198813239509', time=2024-09-12T03:13:59.288631+0000, chain.objs.size()=1 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.x6AzVhJHCQXsuB9IGyVwlqcekxU9ux-_0 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6652591015189402139', time=2024-09-12T03:14:00.622433+0000, chain.objs.size()=1 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cCD7HTB0WhGCYlIyMYi4FpEmyhnxhWq_0 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.487517942128318830', time=2024-09-12T03:14:01.397845+0000, chain.objs.size()=1 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QZXmlFu-e_YrxsnOpWAC9uZIhe3t9Im_0 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6575038760825564447', time=2024-09-12T03:14:04.631703+0000, chain.objs.size()=1 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9oWU4wmxpzH3QGJy3tSSw-pcw8Vw2k3_0 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2308745711487466901', time=2024-09-12T03:14:31.749772+0000, chain.objs.size()=1 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.274__shadow_.2RyQtO7kkTaYJHbfocWF-2JS90HgT8u_0 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11726820715863003636', time=2024-09-12T03:14:49.206848+0000, chain.objs.size()=1 2024-09-12T02:06:47.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.270+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.281__shadow_.uu2vFgbWVpTtO5tR76wFeC9G0ozP2Gl_0 2024-09-12T02:06:47.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18333311169172495580', time=2024-09-12T03:14:54.338743+0000, chain.objs.size()=1 2024-09-12T02:06:47.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.283__shadow_.2AtYq3dvTOKXr2DXo87VUGxWuEVPO72_0 2024-09-12T02:06:47.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12388470903356457259', time=2024-09-12T03:15:23.320153+0000, chain.objs.size()=1 2024-09-12T02:06:47.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.fAj_82K-cjeayGIUcRCAWxW1HLsSJxf_0 2024-09-12T02:06:47.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5691176234529396848', time=2024-09-12T03:15:23.736987+0000, chain.objs.size()=1 2024-09-12T02:06:47.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.iCph5fNMTlO_YFsQ6HzBJ_X8F2mRrIf_0 2024-09-12T02:06:47.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13143090208016767650', time=2024-09-12T03:15:23.738525+0000, chain.objs.size()=1 2024-09-12T02:06:47.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.293__shadow_.5zDWM0u0aOwH9WxnIeIOcvo51nKwubq_0 2024-09-12T02:06:47.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4684520955183439209', time=2024-09-12T03:15:29.775023+0000, chain.objs.size()=1 2024-09-12T02:06:47.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.TpjhQL01Vzsr2LfZ-lSOhkN3kOJ5t9R_0 2024-09-12T02:06:47.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6313309641262128778', time=2024-09-12T03:15:39.848101+0000, chain.objs.size()=1 2024-09-12T02:06:47.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.298__shadow_.SUOh_nIS1DjpxJb_wckqifu6e67py0g_0 2024-09-12T02:06:47.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1521875584327090976', time=2024-09-12T03:15:52.678512+0000, chain.objs.size()=1 2024-09-12T02:06:47.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.303__shadow_.nCw_plgIadbcEFyJCXUNuS0xe9eWqnx_0 2024-09-12T02:06:47.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6494932181375241922', time=2024-09-12T03:15:57.632908+0000, chain.objs.size()=1 2024-09-12T02:06:47.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.305__shadow_.-TF6DYbCkDGGnEAG93fIJVHdHT02mt-_0 2024-09-12T02:06:47.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9892052307601730265', time=2024-09-12T03:16:46.918870+0000, chain.objs.size()=1 2024-09-12T02:06:47.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.322__shadow_.TelODg6ONoP84kv54zxni0QKaqPsziu_0 2024-09-12T02:06:47.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8008661289305887261', time=2024-09-12T03:18:38.450566+0000, chain.objs.size()=1 2024-09-12T02:06:47.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.274+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AkQIsmseDA1s_W8usop_0nCn2Q2SwsO_0 2024-09-12T02:06:47.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6458844512158085483', time=2024-09-12T03:18:38.532774+0000, chain.objs.size()=1 2024-09-12T02:06:47.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.TqQmDIa2qmuIJrNzpeXlqEc86iqVdaD_0 2024-09-12T02:06:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7171668720614462044', time=2024-09-12T03:18:38.536467+0000, chain.objs.size()=1 2024-09-12T02:06:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.IR1gKQ9Aj8x5bKmoCrfkiaHaS6IOG7d_0 2024-09-12T02:06:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18325444986682692762', time=2024-09-12T03:18:39.054323+0000, chain.objs.size()=1 2024-09-12T02:06:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.A4_h_TJZ1UnAIOH9ZlFwouWZlOrjkdZ_0 2024-09-12T02:06:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1409824072341261849', time=2024-09-12T03:18:39.122170+0000, chain.objs.size()=1 2024-09-12T02:06:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.6VLAHiPxSgLb4qDXbV4uJyOYp8mFepB_0 2024-09-12T02:06:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11637825936982240645', time=2024-09-12T03:18:39.147100+0000, chain.objs.size()=1 2024-09-12T02:06:47.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.oAVUanOdnxEUqFyA-PMt-9XUcs9vjBV_0 2024-09-12T02:06:47.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16575333131506812308', time=2024-09-12T03:18:42.258769+0000, chain.objs.size()=1 2024-09-12T02:06:47.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.278+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.GYAWiA3ZT2rDUBk5Kgy9x5DaK7obD5U_0 2024-09-12T02:06:47.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1314158068270331037', time=2024-09-12T03:18:43.100440+0000, chain.objs.size()=1 2024-09-12T02:06:47.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BMmrSE9_MlfPRX9oPs4MKhPnVXMzfdY_0 2024-09-12T02:06:47.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14454645132072832612', time=2024-09-12T03:18:43.548173+0000, chain.objs.size()=1 2024-09-12T02:06:47.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.JAcU-jxhlpDYmPCNK8vcD1QJXO9nMHX_0 2024-09-12T02:06:47.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8185568745211584302', time=2024-09-12T03:18:43.884740+0000, chain.objs.size()=1 2024-09-12T02:06:47.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OVqoE3XzGkHCZ8BAJB_5L8XoRajp8Mo_0 2024-09-12T02:06:47.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3734897627061446303', time=2024-09-12T03:18:47.603376+0000, chain.objs.size()=1 2024-09-12T02:06:47.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Fw9RDZQNOzwIHEgXidtTsrBYlktR1ZQ_0 2024-09-12T02:06:47.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.492720629198608107', time=2024-09-12T03:18:47.832162+0000, chain.objs.size()=1 2024-09-12T02:06:47.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.xQMeiXKzbOIcMr7Nlcjb7HrbWhQcyEG_0 2024-09-12T02:06:47.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3434298764328844159', time=2024-09-12T03:18:49.178076+0000, chain.objs.size()=1 2024-09-12T02:06:47.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.bvkbLsih6g1464zOZnxHj4NJjQ8ziKv_0 2024-09-12T02:06:47.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2035869292884398461', time=2024-09-12T03:18:51.790161+0000, chain.objs.size()=1 2024-09-12T02:06:47.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4-g-PSMBbdJGaj3z7DXaWDmaGyXzvMU_0 2024-09-12T02:06:47.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2651122784627940936', time=2024-09-12T03:18:54.007076+0000, chain.objs.size()=1 2024-09-12T02:06:47.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.282+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.V_z5uFBU7v0V0xB2uqJ_pFiTDgcTzAu_0 2024-09-12T02:06:47.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16674606030093810432', time=2024-09-12T03:18:54.962532+0000, chain.objs.size()=1 2024-09-12T02:06:47.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.bAC0qc_vbxoORVcuv0RxGfJYiRJoPA4_0 2024-09-12T02:06:47.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6572981867711542975', time=2024-09-12T03:18:55.223592+0000, chain.objs.size()=1 2024-09-12T02:06:47.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.TzhTS29rVxckhVd-vh_J5WpEu-BhJbU_0 2024-09-12T02:06:47.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5590769822925724963', time=2024-09-12T03:18:58.880565+0000, chain.objs.size()=1 2024-09-12T02:06:47.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tYorbKphB2JZwTHod_3mzdabqUafxTt_0 2024-09-12T02:06:47.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17107003231976421774', time=2024-09-12T03:19:01.714347+0000, chain.objs.size()=1 2024-09-12T02:06:47.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.CTjErAHt12VWtuzE5dxbEN0MXgVStkK_0 2024-09-12T02:06:47.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3823903409734530466', time=2024-09-12T03:19:03.587825+0000, chain.objs.size()=1 2024-09-12T02:06:47.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.RYyUvdkGFPinpUV4C27ch86r54RYPKR_0 2024-09-12T02:06:47.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13593582207914940775', time=2024-09-12T03:20:54.212652+0000, chain.objs.size()=1 2024-09-12T02:06:47.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.5Fj9TUaG-SauVgV4-VBwCwB1F4K5rid_0 2024-09-12T02:06:47.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15392197282837723133', time=2024-09-12T03:20:54.492764+0000, chain.objs.size()=1 2024-09-12T02:06:47.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XweIGHKwZiirpL6tUwkmGJbLWPFcHYm_0 2024-09-12T02:06:47.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2715445207830249630', time=2024-09-12T03:20:55.565446+0000, chain.objs.size()=1 2024-09-12T02:06:47.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vl15N4lJH0NRC8ZzoJ-ud4YxTBGi3A1_0 2024-09-12T02:06:47.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17803629821627533896', time=2024-09-12T03:20:56.085884+0000, chain.objs.size()=1 2024-09-12T02:06:47.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.BznJjMax3JdRcoSjQnzDZkAdgl-34q2_0 2024-09-12T02:06:47.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8292854311589285280', time=2024-09-12T03:20:56.360890+0000, chain.objs.size()=1 2024-09-12T02:06:47.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.286+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.iJm-neCIUQyS9Gca-y-zVsb2NBHSy99_0 2024-09-12T02:06:47.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16750617826547615416', time=2024-09-12T03:20:56.428476+0000, chain.objs.size()=1 2024-09-12T02:06:47.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.t-CE3xCBBmzUbr35h-qrnkUzh_G6wXA_0 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5687756947800404069', time=2024-09-12T03:20:56.854316+0000, chain.objs.size()=1 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.z2YI2O-F9BtK_-04U4cYnH8zSBahvmi_0 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7154808707441936596', time=2024-09-12T03:20:59.184342+0000, chain.objs.size()=1 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Rl8E6PYM0Tcjjn9tNR5qP8ytA9u-eO0_0 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2294411783770435724', time=2024-09-12T03:21:00.564425+0000, chain.objs.size()=1 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PocgxyDNYOG6cmdzCA1P_sjbm2Ky7UK_0 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14686611877498774546', time=2024-09-12T03:21:01.070064+0000, chain.objs.size()=1 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Uvz5JgdaTSmRNjGaZyIKK-3sj1-0DaO_0 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5906560163993802927', time=2024-09-12T03:21:01.516508+0000, chain.objs.size()=1 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NQM9nlH_YWIc9caJES2_WcKoJ2Hitop_0 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13219920730428327490', time=2024-09-12T03:21:02.995617+0000, chain.objs.size()=1 2024-09-12T02:06:47.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MA-bNPaF4B_p8CT_X7hu69nA3VgY6Lg_0 2024-09-12T02:06:47.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12993208420391073968', time=2024-09-12T03:21:04.967797+0000, chain.objs.size()=1 2024-09-12T02:06:47.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.nbFq3Cjm9-BxYYW72LxDwXh6jRWrdJr_0 2024-09-12T02:06:47.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17008017355414985718', time=2024-09-12T03:21:05.825604+0000, chain.objs.size()=1 2024-09-12T02:06:47.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.290+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YEb4260fOpXyXjgDeiDXO7_GcpKO1sp_0 2024-09-12T02:06:47.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9602415867742245769', time=2024-09-12T03:21:05.965396+0000, chain.objs.size()=1 2024-09-12T02:06:47.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3SB569f8HHgOusBBMCC1sXMGSqMtSY8_0 2024-09-12T02:06:47.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2533762662259478760', time=2024-09-12T03:21:09.246112+0000, chain.objs.size()=1 2024-09-12T02:06:47.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.uk09zkGnYEwe9Ryi8fBjlf__2EjvxSx_0 2024-09-12T02:06:47.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4966912362026698384', time=2024-09-12T03:21:09.734587+0000, chain.objs.size()=1 2024-09-12T02:06:47.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.X_95hx9qGmqm5liPFpwVpvTk5uyDlTi_0 2024-09-12T02:06:47.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5989031244523034644', time=2024-09-12T03:21:11.261814+0000, chain.objs.size()=1 2024-09-12T02:06:47.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.kLKS5LQWNNLEEnqj8k3sLbbgypF0GSV_0 2024-09-12T02:06:47.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.294+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8743118408001883780', time=2024-09-12T03:21:15.321041+0000, chain.objs.size()=1 2024-09-12T02:06:47.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.294+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.dRG_6PnTC6veH_6RVMzq_mSmyjZasnq_0 2024-09-12T02:06:47.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5331249300203311592', time=2024-09-12T03:21:19.832008+0000, chain.objs.size()=1 2024-09-12T02:06:47.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.K-m1A2SdmmBmZ2dSvfaOzqmle5Q3sf4_0 2024-09-12T02:06:47.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15691864426728752179', time=2024-09-12T03:21:19.884567+0000, chain.objs.size()=1 2024-09-12T02:06:47.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bffoOcAjSXf5dpwQgkzXFQNZCQxhMeM_0 2024-09-12T02:06:47.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13891432349525085233', time=2024-09-12T03:21:20.623469+0000, chain.objs.size()=1 2024-09-12T02:06:47.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MIjb_1D-uSLaBOEPmeESNIriDjfB_vW_0 2024-09-12T02:06:47.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3716558087009224310', time=2024-09-12T03:21:21.059421+0000, chain.objs.size()=1 2024-09-12T02:06:47.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.R4RrKgCYh27yzPaLP8KQ2C63kA2JD4n_0 2024-09-12T02:06:47.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1658335313730656306', time=2024-09-12T03:21:21.666001+0000, chain.objs.size()=1 2024-09-12T02:06:47.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7LgJVCHG3aj4YTHv6SWZ-gmVXoHI7-Y_0 2024-09-12T02:06:47.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7433658093610313136', time=2024-09-12T03:21:22.907751+0000, chain.objs.size()=1 2024-09-12T02:06:47.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.298+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.E1NqcPNWQW5xpymJuutaoCHlgT-zp8Q_0 2024-09-12T02:06:47.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8534362485281012091', time=2024-09-12T03:21:24.966204+0000, chain.objs.size()=1 2024-09-12T02:06:47.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RXGaJk4vrqOUvHRCtWZaX90H6zbENft_0 2024-09-12T02:06:47.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15911464932530367241', time=2024-09-12T03:21:25.137510+0000, chain.objs.size()=1 2024-09-12T02:06:47.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IVnDQyQOY9qRA5E7GMXSc7dHQnssMiG_0 2024-09-12T02:06:47.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.322965135787003820', time=2024-09-12T03:21:52.024803+0000, chain.objs.size()=1 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.337__shadow_.mf50jSaIpFrdstM4p8B5OOnvBcSfPLA_0 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3191773248804949075', time=2024-09-12T03:23:10.768444+0000, chain.objs.size()=1 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.375__shadow_.u7sRqIRzkugA7P2FqiZuE-3zSXYGy6Q_0 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12658274845816206961', time=2024-09-12T03:27:21.963931+0000, chain.objs.size()=1 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.F7ag8TCaJj0w0tX1vrBgoJsNNWvRfXO_0 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~cMjJS2WRP9r7UeGDzUIIh-WvYINR-Hq', time=2024-09-12T03:36:21.650532+0000, chain.objs.size()=1 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.532__multipart_mymultipart.2~cMjJS2WRP9r7UeGDzUIIh-WvYINR-Hq.1 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3508327200231638844', time=2024-09-12T03:40:03.518538+0000, chain.objs.size()=1 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:OApES7gGFbKtowdkfw7oxOH-pY6lAon_.p6Qv99QOm73nNPdrKt4I9Pi48LHq_0M_0 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14641209564653688648', time=2024-09-12T03:41:01.234622+0000, chain.objs.size()=1 2024-09-12T02:06:47.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.302+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:A5ZKmmizAMZCr1-ca7nJ1JdKpMCAE30_.6qAsIugNDLpaBUlVKnxpxWZvzJ_Y42g_0 2024-09-12T02:06:47.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.306+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5093620437902633308', time=2024-09-12T03:46:13.363699+0000, chain.objs.size()=12 2024-09-12T02:06:47.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__multipart_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.1 2024-09-12T02:06:47.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__shadow_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.1_1 2024-09-12T02:06:47.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.306+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__multipart_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.2 2024-09-12T02:06:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__shadow_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.2_1 2024-09-12T02:06:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__multipart_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.3 2024-09-12T02:06:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__shadow_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.3_1 2024-09-12T02:06:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__multipart_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.4 2024-09-12T02:06:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__shadow_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.4_1 2024-09-12T02:06:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__multipart_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.5 2024-09-12T02:06:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__shadow_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.5_1 2024-09-12T02:06:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__multipart_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.6 2024-09-12T02:06:47.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.615__shadow_multipart_enc.2~4dFNKu_ssZhBqMtozUIDcZaSMmtOFxu.6_1 2024-09-12T02:06:47.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3666236254356114874', time=2024-09-12T03:46:35.629062+0000, chain.objs.size()=1 2024-09-12T02:06:47.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.617__shadow_.67mYdDQHXZ1dwh_AA-KdFeLAAOuXMWe_0 2024-09-12T02:06:47.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15187296838547889383', time=2024-09-12T03:50:50.482478+0000, chain.objs.size()=1 2024-09-12T02:06:47.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.310+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.640__shadow_.men1rBPokEbTMtCInu1VMbqiEpFpzya_0 2024-09-12T02:06:47.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16838228820561394767', time=2024-09-12T03:51:15.540569+0000, chain.objs.size()=1 2024-09-12T02:06:47.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.646__shadow_.KU3dwx0bsuytonuFRMPwniE8kGwqt1J_0 2024-09-12T02:06:47.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.314+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16170693826838746859', time=2024-09-12T03:52:07.197968+0000, chain.objs.size()=1 2024-09-12T02:06:47.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.314+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.657__shadow_.qIfqH1dwYnK5_JYvqK0g6iRw2EEqqgj_0 2024-09-12T02:06:47.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.318+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54220 2024-09-12T02:06:47.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.322+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T02:06:47.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.322+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4259745337636500825', time=2024-09-12T03:55:57.498771+0000, chain.objs.size()=1 2024-09-12T02:06:47.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.322+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.735__shadow_.KQtMOnaU1pd3Vrmet5qVbLCNnfFxymo_0 2024-09-12T02:06:47.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.322+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:47.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T02:06:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:47.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:47.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46961' 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2396348302331973663', time=2024-09-12T03:10:32.773075+0000, chain.objs.size()=1 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.234__shadow_.kThQQk_N_xNldinN02TT_7pWvXcohxS_0 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13600077488392977500', time=2024-09-12T03:10:49.503602+0000, chain.objs.size()=1 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.239__shadow_.ENscArjMK5Y1iE4GgE6yKrrrG5e6J_S_0 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11795722769681621846', time=2024-09-12T03:11:03.002957+0000, chain.objs.size()=1 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.244__shadow_.qdg5_TXN02E7nmx_6dZYGs6J1l77qO8_0 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4750312908650818927', time=2024-09-12T03:11:09.500104+0000, chain.objs.size()=1 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.246__shadow_.fMr712jk9gboM4O9b-821-NJ5r2J-uI_0 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14832546179184021957', time=2024-09-12T03:11:27.119645+0000, chain.objs.size()=1 2024-09-12T02:06:47.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.253__shadow_.S7n2nQ0pgSiyaK2yp2GZlyNI3IcQVvj_0 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6433888128069683794', time=2024-09-12T03:11:34.684707+0000, chain.objs.size()=1 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.256__shadow_.iWI4LqZUK5r4DRtTsQQn_o4DCkJ3YnZ_0 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.791074999620132864', time=2024-09-12T03:13:34.480573+0000, chain.objs.size()=1 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.FahsEpbzliOGTQ_bKdA6t8zd6vht2Hi_0 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1867816331389532051', time=2024-09-12T03:13:35.000859+0000, chain.objs.size()=1 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3ba5ZZzvIlwfRmHRfItl5IbML2-A6Xs_0 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5478885940530256110', time=2024-09-12T03:13:35.311564+0000, chain.objs.size()=1 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.TcBz3qobx26wOPkqXF_TZYtipEvr7Li_0 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7670890389887321822', time=2024-09-12T03:13:38.431944+0000, chain.objs.size()=1 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.j0M41KPdQDgyB3qxg8CELQDyZpnqziu_0 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13808371354916348097', time=2024-09-12T03:13:39.149002+0000, chain.objs.size()=1 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.y7FGwQqupjFJv7oICSzVMwTJQD_x21W_0 2024-09-12T02:06:47.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8989581082136529852', time=2024-09-12T03:13:39.377401+0000, chain.objs.size()=1 2024-09-12T02:06:47.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.326+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.To3yBewDTBRJWhUeJqMCPhPo9ENwsg6_0 2024-09-12T02:06:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.330+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16834278626622894069', time=2024-09-12T03:13:42.582918+0000, chain.objs.size()=1 2024-09-12T02:06:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.330+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._8qehYlis9iZd2ZqvcRdnhe-xOurKKF_0 2024-09-12T02:06:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13712202343961794742', time=2024-09-12T03:13:43.302168+0000, chain.objs.size()=1 2024-09-12T02:06:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ukVGBV7vHCOFl-GnqfYefHKpvYUf_y7_0 2024-09-12T02:06:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8269977749477241744', time=2024-09-12T03:13:43.516595+0000, chain.objs.size()=1 2024-09-12T02:06:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jQI8_c8ZBwFHqZdXaPXuz3SKpbAR2G4_0 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4384818923000050724', time=2024-09-12T03:13:43.801900+0000, chain.objs.size()=1 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.BikriaKneFa7LgoZlW4-GrycwKdfx-8_0 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16182195817790699375', time=2024-09-12T03:13:45.123244+0000, chain.objs.size()=1 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.L1N7Yt9zlGMy8RcKxdUqG3MGdHgTOiI_0 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16526103844004234752', time=2024-09-12T03:13:47.097860+0000, chain.objs.size()=1 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pTTcaWhF73l88vbe-wVQFW5yMzW4NsI_0 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9324557563770481412', time=2024-09-12T03:13:48.620340+0000, chain.objs.size()=1 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.P2Q56caMkO2zUyyz5qNM_o2FyB1V_2a_0 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8305523829817603430', time=2024-09-12T03:13:48.902893+0000, chain.objs.size()=1 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.dP4JM5EJAxY82q9OYGvmjp7lOHdVtJm_0 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4283688488061100830', time=2024-09-12T03:13:49.879634+0000, chain.objs.size()=1 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.eaqOaMffJDMMFb0YdMsrCwoayUm4tQT_0 2024-09-12T02:06:47.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15715979845344690938', time=2024-09-12T03:13:50.870995+0000, chain.objs.size()=1 2024-09-12T02:06:47.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pbGU1Fcgd1fjSi34Wkl_GOt7DysOo2F_0 2024-09-12T02:06:47.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11760000849856651261', time=2024-09-12T03:13:50.933932+0000, chain.objs.size()=1 2024-09-12T02:06:47.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.334+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.6VPSpx0JAsEmEZJmeGW2o_dFUFUXywV_0 2024-09-12T02:06:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16355317909007682086', time=2024-09-12T03:13:52.036589+0000, chain.objs.size()=1 2024-09-12T02:06:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.n5YoqleYtRrO9GW-zZIJnnC_5UGE1Qy_0 2024-09-12T02:06:47.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17024426911039973533', time=2024-09-12T03:13:53.688388+0000, chain.objs.size()=1 2024-09-12T02:06:47.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.gOZRfEPmm9oCM5LON6yce_BtkoEspOs_0 2024-09-12T02:06:47.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3255784497044084004', time=2024-09-12T03:13:53.788898+0000, chain.objs.size()=1 2024-09-12T02:06:47.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xJLqXiQ7uyteSyLLVyoMYd8K0odREUG_0 2024-09-12T02:06:47.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12760474295743208408', time=2024-09-12T03:13:54.733819+0000, chain.objs.size()=1 2024-09-12T02:06:47.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ADcdTyd_x08mBYx02dI-wp0R9EPL_jN_0 2024-09-12T02:06:47.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12204497777967353557', time=2024-09-12T03:13:55.199966+0000, chain.objs.size()=1 2024-09-12T02:06:47.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jp6bWKOfIGLEeSpNAC9Jp8L1mZS149O_0 2024-09-12T02:06:47.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8638763093107483450', time=2024-09-12T03:13:59.288694+0000, chain.objs.size()=1 2024-09-12T02:06:47.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.W6pcyl-rLB32liKTPOWkVWBGpfZgR4v_0 2024-09-12T02:06:47.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14423412486782611568', time=2024-09-12T03:13:59.819627+0000, chain.objs.size()=1 2024-09-12T02:06:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.EET83H0R69d4aGcOQy4YckWBetoDWWy_0 2024-09-12T02:06:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15656301915862407784', time=2024-09-12T03:14:00.767606+0000, chain.objs.size()=1 2024-09-12T02:06:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qbG1z_2VVciXclzHgukOzZwd6IoBpPG_0 2024-09-12T02:06:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11234158281779188182', time=2024-09-12T03:14:05.134755+0000, chain.objs.size()=1 2024-09-12T02:06:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.roD1QNJxv0d3su-sRDQbs2OtZVuB8Fz_0 2024-09-12T02:06:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8777104065120501217', time=2024-09-12T03:14:17.364853+0000, chain.objs.size()=1 2024-09-12T02:06:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.268__shadow_.8J03kMUBpT2PHa69DQpmLAxr8zj1zMK_0 2024-09-12T02:06:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5308560987980978036', time=2024-09-12T03:14:17.376591+0000, chain.objs.size()=1 2024-09-12T02:06:47.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.338+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.268__shadow_.rCl_LzCwbCUeE7Yg9wjGpl0zFVKqHcw_0 2024-09-12T02:06:47.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17901372924644231651', time=2024-09-12T03:14:26.949646+0000, chain.objs.size()=1 2024-09-12T02:06:47.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.272__shadow_.Au7_nTTllRSqejtj3DYfd3_91_r7h5w_0 2024-09-12T02:06:47.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1189041245132660436', time=2024-09-12T03:14:36.581109+0000, chain.objs.size()=1 2024-09-12T02:06:47.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.276__shadow_.YDWg4P6jwPLXT5tyvehkggt4YBP7dDV_0 2024-09-12T02:06:47.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17255929399080466856', time=2024-09-12T03:14:44.167621+0000, chain.objs.size()=1 2024-09-12T02:06:47.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.279__shadow_.NCQYT5zg7HBdCuk7RA2glXoRm0s_d-O_0 2024-09-12T02:06:47.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13669325564664603500', time=2024-09-12T03:14:44.183005+0000, chain.objs.size()=1 2024-09-12T02:06:47.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.279__shadow_.g8EyZKCG3P4zYrZ7hAznrBevqKgvRpI_0 2024-09-12T02:06:47.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14263219787118782249', time=2024-09-12T03:15:12.147442+0000, chain.objs.size()=1 2024-09-12T02:06:47.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.290__shadow_.TlUI_f-_5nqlpzKnM6jX-d17hNRAMNj_0 2024-09-12T02:06:47.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9229184152341304556', time=2024-09-12T03:15:37.380905+0000, chain.objs.size()=1 2024-09-12T02:06:47.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.297__shadow_.iPsWXMaZsUlKmnb-mURQbI_UJEFUfya_0 2024-09-12T02:06:47.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2677613085340012301', time=2024-09-12T03:15:39.847270+0000, chain.objs.size()=1 2024-09-12T02:06:47.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.298__shadow_.xJ8dispWkIPD9cDvPZe-woJBEo8N00K_0 2024-09-12T02:06:47.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5474222518741254634', time=2024-09-12T03:15:47.657405+0000, chain.objs.size()=1 2024-09-12T02:06:47.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.301__shadow_.A14Ga-W-OE1E2ZptIdKMnqjZ_KGOgsz_0 2024-09-12T02:06:47.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5353932114824485468', time=2024-09-12T03:15:55.175509+0000, chain.objs.size()=1 2024-09-12T02:06:47.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.304__shadow_.0DVRAuIP7EQmmyZ8OxBP9FFmArX7vHd_0 2024-09-12T02:06:47.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4048347800378231212', time=2024-09-12T03:18:37.144966+0000, chain.objs.size()=1 2024-09-12T02:06:47.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.p4TwrQ5LjeWetO1zGOoj92im6XzxZfB_0 2024-09-12T02:06:47.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18084025347992158588', time=2024-09-12T03:18:37.766356+0000, chain.objs.size()=1 2024-09-12T02:06:47.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.346+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tV6k_OIQ6LhwaF4EyLvJk2ThYQwB4Ni_0 2024-09-12T02:06:47.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13954944782801465069', time=2024-09-12T03:18:38.582122+0000, chain.objs.size()=1 2024-09-12T02:06:47.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.PvjBzxOuMM8228_pJOTf94jdw5oGoKe_0 2024-09-12T02:06:47.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.817373376069185554', time=2024-09-12T03:18:41.293249+0000, chain.objs.size()=1 2024-09-12T02:06:47.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Vi2pvulMnh3acrqgYtuX39-fRLHI9Xf_0 2024-09-12T02:06:47.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17566579459441419723', time=2024-09-12T03:18:41.297126+0000, chain.objs.size()=1 2024-09-12T02:06:47.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.msDAAZt1ub1nmRb-WSjUlsCcIkeyDEe_0 2024-09-12T02:06:47.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.350+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2672142626438221648', time=2024-09-12T03:18:41.807277+0000, chain.objs.size()=1 2024-09-12T02:06:47.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.350+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.NdkKybjtK3wPRPJIMbzfLhaHIIzk8tV_0 2024-09-12T02:06:47.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12898187396606247594', time=2024-09-12T03:18:42.807427+0000, chain.objs.size()=1 2024-09-12T02:06:47.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.207oBiG9F-WoNvTG5kHWKlguAiCPcOb_0 2024-09-12T02:06:47.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12873946845286396172', time=2024-09-12T03:18:43.272522+0000, chain.objs.size()=1 2024-09-12T02:06:47.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.UnvKKLdK8fnLm6JkSlsNQTt5wHFxQfp_0 2024-09-12T02:06:47.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8474742149613377944', time=2024-09-12T03:18:43.533621+0000, chain.objs.size()=1 2024-09-12T02:06:47.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.lqlFpvRTauDCOrFSNG-czB9UVFPKPWI_0 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6502057091806128235', time=2024-09-12T03:18:43.660553+0000, chain.objs.size()=1 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.f3L_JY1qpSU08kvb17uAl7dowbJYINw_0 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2499683932471211497', time=2024-09-12T03:18:43.818696+0000, chain.objs.size()=1 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Dp7vmcHoyIXifrL1Z3FuXa89RwdbGAx_0 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17469770766084379481', time=2024-09-12T03:18:47.295905+0000, chain.objs.size()=1 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8VHuS3c7cU6m4LWXai8s4fLLsxc5Ov__0 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6802479354838977924', time=2024-09-12T03:18:47.706029+0000, chain.objs.size()=1 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.AE_hkK-cSXBwUMOzar44tXn64dHcINv_0 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7924782051927014001', time=2024-09-12T03:18:48.146723+0000, chain.objs.size()=1 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.lrMUI87-TrlVpZH0J_ZacfXX17ITt1__0 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15490264589702843004', time=2024-09-12T03:18:50.039771+0000, chain.objs.size()=1 2024-09-12T02:06:47.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.354+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QtmWxY-Bze_tJkDNvG3NqCu_VDRE4k8_0 2024-09-12T02:06:47.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1441508800836863447', time=2024-09-12T03:18:50.215290+0000, chain.objs.size()=1 2024-09-12T02:06:47.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.b6X-erAxaMsBi9i0BmevLLyM4zsBjN0_0 2024-09-12T02:06:47.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.358+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6337313956794631129', time=2024-09-12T03:18:50.974695+0000, chain.objs.size()=1 2024-09-12T02:06:47.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.358+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.x0tueyqK38Mm76AGN_Y-mYmyoFa_oIC_0 2024-09-12T02:06:47.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11765154709209140677', time=2024-09-12T03:18:50.976423+0000, chain.objs.size()=1 2024-09-12T02:06:47.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wI5NQxrJjeX0Wfe8RoxuihdJh4g7AW6_0 2024-09-12T02:06:47.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.439156863288934156', time=2024-09-12T03:18:51.264130+0000, chain.objs.size()=1 2024-09-12T02:06:47.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.LOsrOns_BIDXbJ9c-bpsD7UTUOxZrAQ_0 2024-09-12T02:06:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12847727851191571821', time=2024-09-12T03:18:51.266364+0000, chain.objs.size()=1 2024-09-12T02:06:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Je0XYCgHj_OX_NJw2CsXrsUucrhNHk8_0 2024-09-12T02:06:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8621384759225588310', time=2024-09-12T03:18:51.428789+0000, chain.objs.size()=1 2024-09-12T02:06:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9nTco8DxAFSp2_UQrhAGDPBInc8bh_q_0 2024-09-12T02:06:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7153652510377977796', time=2024-09-12T03:18:53.328813+0000, chain.objs.size()=1 2024-09-12T02:06:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.uYl2bnxIwhuscsjmjNhN7s_Y5RU9NrZ_0 2024-09-12T02:06:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1734216900789494541', time=2024-09-12T03:18:53.437987+0000, chain.objs.size()=1 2024-09-12T02:06:47.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.KgU756cLPX_95TU5z7BmDJI4wZL-Lqt_0 2024-09-12T02:06:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15184366836174641283', time=2024-09-12T03:18:53.439942+0000, chain.objs.size()=1 2024-09-12T02:06:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.jGri4ZoMSsHWQ2HWJlLNIdwo-WRGFUp_0 2024-09-12T02:06:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.341474656942582122', time=2024-09-12T03:18:53.513424+0000, chain.objs.size()=1 2024-09-12T02:06:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.DZ6NH7HjHuXvlkiJkV9LEHpKtOJeIZd_0 2024-09-12T02:06:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.133276895359484181', time=2024-09-12T03:18:54.451095+0000, chain.objs.size()=1 2024-09-12T02:06:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.T2JwgBWsryv9wNE1Kql7_lHrd4DO9IP_0 2024-09-12T02:06:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14086298245757597175', time=2024-09-12T03:18:54.814328+0000, chain.objs.size()=1 2024-09-12T02:06:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.0tuJI2zaKDIr0UA1b8T8-FAjxInJQrh_0 2024-09-12T02:06:47.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14248902906260363792', time=2024-09-12T03:18:56.479608+0000, chain.objs.size()=1 2024-09-12T02:06:47.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.362+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.R4aPStWrqwA0fDKz0yBuWEy9OXSaDzv_0 2024-09-12T02:06:47.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3846930414990825723', time=2024-09-12T03:19:00.411077+0000, chain.objs.size()=1 2024-09-12T02:06:47.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.OYM-kLjRX4PTCaBllEVS6j6wY_7X3wj_0 2024-09-12T02:06:47.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8207335975162071663', time=2024-09-12T03:19:00.470093+0000, chain.objs.size()=1 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.pBmpABaQLdtNQv3ZqxBGd6g7_9Ik_dC_0 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12486223874137736549', time=2024-09-12T03:19:01.404448+0000, chain.objs.size()=1 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zVXeo06sqQEp3YlSrbnv7srwkgXQD6B_0 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16842362226353559513', time=2024-09-12T03:19:01.716685+0000, chain.objs.size()=1 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fJT-PGoCKszjqnur7e27R6R6TAdcrhC_0 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18044502992320277713', time=2024-09-12T03:19:02.189703+0000, chain.objs.size()=1 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.wT9XbKUV7Tr8bw4c_Hyc5xiCCd3UlZp_0 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11514094902329476333', time=2024-09-12T03:19:03.436858+0000, chain.objs.size()=1 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.VLDy8zvBRWCWOWqkwX3cmxvv_CumSk6_0 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15149525301340432090', time=2024-09-12T03:19:05.695053+0000, chain.objs.size()=1 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7yjug5CClnMvkXLWWWc09tOlIlMk7TI_0 2024-09-12T02:06:47.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17196038100395641369', time=2024-09-12T03:19:07.598084+0000, chain.objs.size()=1 2024-09-12T02:06:47.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.sXga1zugy0IW_8hTzXOTiRLtB2v5H4G_0 2024-09-12T02:06:47.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4885742555102028335', time=2024-09-12T03:19:07.818882+0000, chain.objs.size()=1 2024-09-12T02:06:47.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.j83qVxVblEbzJ9BDxaMCoB3znK0soNe_0 2024-09-12T02:06:47.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12508625359757032454', time=2024-09-12T03:20:54.367742+0000, chain.objs.size()=1 2024-09-12T02:06:47.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.366+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qnC6AV8_18Pg6nJ5wWMmAJj1KulX6mI_0 2024-09-12T02:06:47.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15348171704615650482', time=2024-09-12T03:20:55.703359+0000, chain.objs.size()=1 2024-09-12T02:06:47.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0sq_1BhANaFLLjNyou3dbkAGZY-TEN8_0 2024-09-12T02:06:47.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8967011831634328328', time=2024-09-12T03:20:56.706153+0000, chain.objs.size()=1 2024-09-12T02:06:47.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.46xLLS0M85VlrTrIOus0_9XQzdkZP0p_0 2024-09-12T02:06:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4822133726972797882', time=2024-09-12T03:20:57.320100+0000, chain.objs.size()=1 2024-09-12T02:06:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.JZMxFLvUB4p26I--QQDTZVA6px8wrO7_0 2024-09-12T02:06:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5576043418025886700', time=2024-09-12T03:20:58.673861+0000, chain.objs.size()=1 2024-09-12T02:06:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.e3gLMZzqilLrJTC_XfgZ7_pq6jXHIXu_0 2024-09-12T02:06:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16813601364822411794', time=2024-09-12T03:20:58.759286+0000, chain.objs.size()=1 2024-09-12T02:06:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.AjIEdwIciOSJQcrrmwDMF-icYGku04n_0 2024-09-12T02:06:47.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.648230450719331770', time=2024-09-12T03:20:59.504591+0000, chain.objs.size()=1 2024-09-12T02:06:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.8W2-7USuxryh4B0qNrhgcImXlnWjgOZ_0 2024-09-12T02:06:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16260332909542954787', time=2024-09-12T03:20:59.662275+0000, chain.objs.size()=1 2024-09-12T02:06:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XIIYWHOzcbp11mq0dqVO8oIFE_piPVF_0 2024-09-12T02:06:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1851140081978270266', time=2024-09-12T03:21:00.167723+0000, chain.objs.size()=1 2024-09-12T02:06:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0VrqwM7JWln0-xmbvn9QCkLAQzU-Ilz_0 2024-09-12T02:06:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1105417736402748128', time=2024-09-12T03:21:00.226963+0000, chain.objs.size()=1 2024-09-12T02:06:47.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.370+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.jJQmnW5kcPoy2hUs8BQOEGAKTHmgWOS_0 2024-09-12T02:06:47.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.374+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4028239501642801275', time=2024-09-12T03:21:01.742825+0000, chain.objs.size()=1 2024-09-12T02:06:47.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.374+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.oVFFQaXX-hBC0HoOAjaxULpuU2X8Ir__0 2024-09-12T02:06:47.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.374+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6253588403138193167', time=2024-09-12T03:21:02.987521+0000, chain.objs.size()=1 2024-09-12T02:06:47.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.374+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._OmuspOehWBcexAFGiq_voZHQdqqtAP_0 2024-09-12T02:06:47.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17714738601661115924', time=2024-09-12T03:21:02.990968+0000, chain.objs.size()=1 2024-09-12T02:06:47.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.OeyUaZgLHwg7jaGJsoTp0OAEcUHZS9v_0 2024-09-12T02:06:47.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17846243356024161880', time=2024-09-12T03:21:03.302140+0000, chain.objs.size()=1 2024-09-12T02:06:47.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.A9wDw05RWrPQLt1dsjNp2eE7f2GuQ4a_0 2024-09-12T02:06:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16090723261477115542', time=2024-09-12T03:21:03.948758+0000, chain.objs.size()=1 2024-09-12T02:06:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.UUlR4v8AN8FLihoboAkR_EbLdrjfHy4_0 2024-09-12T02:06:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6383902862425087589', time=2024-09-12T03:21:04.725229+0000, chain.objs.size()=1 2024-09-12T02:06:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.RhkHa6Bj62cMO2D93caC4Pzj4oP9Okj_0 2024-09-12T02:06:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4355410916502341943', time=2024-09-12T03:21:05.882476+0000, chain.objs.size()=1 2024-09-12T02:06:47.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.qZBOMNRtTbV2eWny6IRnBhQAQO8zMw0_0 2024-09-12T02:06:47.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12231304081223600225', time=2024-09-12T03:21:07.399473+0000, chain.objs.size()=1 2024-09-12T02:06:47.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.OZZ4DEEuny3iFi0S-kM7DCRhgxMzPe-_0 2024-09-12T02:06:47.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4326631088247176522', time=2024-09-12T03:21:08.714244+0000, chain.objs.size()=1 2024-09-12T02:06:47.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.bkSFh_f-g9KtNpPn2gEswpiBQkGvlsJ_0 2024-09-12T02:06:47.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4823110848268981918', time=2024-09-12T03:21:11.261732+0000, chain.objs.size()=1 2024-09-12T02:06:47.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.378+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7PixCrcJpjUaY7edOupbdj0sGUwinnc_0 2024-09-12T02:06:47.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.386+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46961 2024-09-12T02:06:47.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T02:06:47.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10542826994450401868', time=2024-09-12T03:21:11.272678+0000, chain.objs.size()=1 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wyikCG5kWWp-x3NM-up0a6HpGPc4iM__0 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12295536423224390122', time=2024-09-12T03:21:11.668446+0000, chain.objs.size()=1 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XXe_TqM38AzdjKlJQ9TuojoDpX9DbNE_0 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16889210962358842155', time=2024-09-12T03:21:12.503240+0000, chain.objs.size()=1 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.EQeypQuieN_nHbAgL_RQX232XZLeUsO_0 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8271801778379625355', time=2024-09-12T03:21:13.279671+0000, chain.objs.size()=1 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.cVA474cj505BYYDTYhF7F0SX7T68XSh_0 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16259684667203679048', time=2024-09-12T03:21:23.116722+0000, chain.objs.size()=1 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.o7wLT9H2HQt4309e8fYPNnVcZ8GJqV3_0 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14465354514967556464', time=2024-09-12T03:21:23.793274+0000, chain.objs.size()=1 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MH3po6OSbqdPeyquQmgO8YFkGD3XYs-_0 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4972672578869628227', time=2024-09-12T03:21:23.989581+0000, chain.objs.size()=1 2024-09-12T02:06:47.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.GtuRTTpJnfsLNmNRa9m0KGi0p0-fZCs_0 2024-09-12T02:06:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13022648688788104974', time=2024-09-12T03:21:24.121157+0000, chain.objs.size()=1 2024-09-12T02:06:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.axtiBRY8aYXXFC-qjtp34TJyftCnuLQ_0 2024-09-12T02:06:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7813017467476727010', time=2024-09-12T03:21:24.583465+0000, chain.objs.size()=1 2024-09-12T02:06:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Y-yfZK7GniYtG5lUW9pAFq_WCbWlniR_0 2024-09-12T02:06:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15226635003105899642', time=2024-09-12T03:21:25.616786+0000, chain.objs.size()=1 2024-09-12T02:06:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.lFRlk7s5boYdsrwQ8JLPvg_82hM-WcM_0 2024-09-12T02:06:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3915185577247953131', time=2024-09-12T03:22:08.053689+0000, chain.objs.size()=1 2024-09-12T02:06:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.344__shadow_.XXIFfocYcmFZbCDypRG9Xk3CXm4VMc3_0 2024-09-12T02:06:47.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18375381922829594202', time=2024-09-12T03:23:03.195357+0000, chain.objs.size()=1 2024-09-12T02:06:47.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.390+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.372__shadow_.xjLTmpOTO3GGO0h1YnXmZQIOwC1cTrS_0 2024-09-12T02:06:47.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14764310185515938027', time=2024-09-12T03:23:05.413393+0000, chain.objs.size()=1 2024-09-12T02:06:47.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.373__shadow_.r6biGYo0-eLTcx-cXG03yvAVsM5h3Q9_0 2024-09-12T02:06:47.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7945860146834582791', time=2024-09-12T03:26:24.327447+0000, chain.objs.size()=1 2024-09-12T02:06:47.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.458__shadow_.luZJYqxuXT6uPWOFeSRwdAk3uumd_zg_0 2024-09-12T02:06:47.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4757272148011741296', time=2024-09-12T03:28:05.393720+0000, chain.objs.size()=1 2024-09-12T02:06:47.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.501__shadow_.5v6GILHdYApfHbH__ZszrzY45voRkho_0 2024-09-12T02:06:47.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18274719144769343630', time=2024-09-12T03:29:39.411403+0000, chain.objs.size()=1 2024-09-12T02:06:47.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.519__multipart_mymultipart.2~IeMY7xDk_OxNFg_cDKFdx9T7nIknatE.1 2024-09-12T02:06:47.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14378540662384462060', time=2024-09-12T03:34:49.182794+0000, chain.objs.size()=2 2024-09-12T02:06:47.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~ZLlFSS3pz6XRTURE5-fn7ihhl0yAOas.1 2024-09-12T02:06:47.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~ZLlFSS3pz6XRTURE5-fn7ihhl0yAOas.2 2024-09-12T02:06:47.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8618095443519028803', time=2024-09-12T03:37:57.674996+0000, chain.objs.size()=1 2024-09-12T02:06:47.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.552__shadow_.WvIp5Bo3ad4ivnHi_SNPxB8e4eQF_IK_0 2024-09-12T02:06:47.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2814561611616719479', time=2024-09-12T03:39:47.422528+0000, chain.objs.size()=1 2024-09-12T02:06:47.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:MtcVsg6MbwVeEQ3-jGblvYNRBns91vf_.GNAk5Jt81O1eEZvR601Izfd3df4gazM_0 2024-09-12T02:06:47.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.471122012393705300', time=2024-09-12T03:39:48.006139+0000, chain.objs.size()=1 2024-09-12T02:06:47.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:fpHmHeiu.fk.-JdEBKVCsSP8uJ6Pnsr_.Pu-lOdc_YybpbR4V7-5Bidmh8D3Wl7k_0 2024-09-12T02:06:47.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12714790744091297177', time=2024-09-12T03:39:56.318490+0000, chain.objs.size()=1 2024-09-12T02:06:47.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:D1vpBHqqIll.sADVH3IJE7K68mUn6RO_.BI4cI8JcmnA0rIj0MB6tqnCIsWJtaFJ_0 2024-09-12T02:06:47.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16036220443011787886', time=2024-09-12T03:40:06.016127+0000, chain.objs.size()=1 2024-09-12T02:06:47.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.394+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.570__shadow:oUTYpM3JOf62LfItgSN2cqSdzQgoxgB_.FwqDxQXgWwOJthtFgIx1u4sYsrVawB3_0 2024-09-12T02:06:47.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1494616194982752203', time=2024-09-12T03:40:49.016659+0000, chain.objs.size()=1 2024-09-12T02:06:47.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.577__shadow:1ZMlV0ZRrieqYVhAdXbDGb4fDC0GPkR_.bwYCye8E7SiiM4OPPO5Eo7z_zfH-ihU_0 2024-09-12T02:06:47.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15734403251732120746', time=2024-09-12T03:40:52.876616+0000, chain.objs.size()=1 2024-09-12T02:06:47.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:sV292xCzgQjL.4geJjrk4BWpP-bLVLU_.CIONCS3h_9RMmxj-t5IOi8bSoBdB6J6_0 2024-09-12T02:06:47.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11752113591797402701', time=2024-09-12T03:41:30.604984+0000, chain.objs.size()=1 2024-09-12T02:06:47.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.578__shadow:yQ3XPBOQeQBWhsR3maBBm9p.r4WDPq6_.V6X5GNPK-qfxHeCA-KUpDdU1Ty0orMY_0 2024-09-12T02:06:47.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14360521087014767961', time=2024-09-12T03:42:43.406560+0000, chain.objs.size()=1 2024-09-12T02:06:47.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.581__shadow:ahl-Sh7UMAZs6toUBVafFBTwISYwRLE_.JvzBXACETZuZtkAswF_SWrNig7M6aXr_0 2024-09-12T02:06:47.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18049016452005128940', time=2024-09-12T03:43:45.488703+0000, chain.objs.size()=1 2024-09-12T02:06:47.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.607__shadow_.9NFY1FzOZQlfGVdF_q5S57qut4nFwYy_0 2024-09-12T02:06:47.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12021128173220608675', time=2024-09-12T03:51:05.128621+0000, chain.objs.size()=2 2024-09-12T02:06:47.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.644__shadow_.6zjOkt-AZeyIxrBrKezVFX8D9g9_f-7_0 2024-09-12T02:06:47.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.398+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.644__shadow_.6zjOkt-AZeyIxrBrKezVFX8D9g9_f-7_1 2024-09-12T02:06:47.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.402+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12875454899562093563', time=2024-09-12T03:53:01.758915+0000, chain.objs.size()=12 2024-09-12T02:06:47.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.402+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__multipart_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.1 2024-09-12T02:06:47.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.402+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__shadow_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.1_1 2024-09-12T02:06:47.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.402+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__multipart_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.2 2024-09-12T02:06:47.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.402+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__shadow_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.2_1 2024-09-12T02:06:47.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.402+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__multipart_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.3 2024-09-12T02:06:47.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.402+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__shadow_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.3_1 2024-09-12T02:06:47.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__multipart_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.4 2024-09-12T02:06:47.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__shadow_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.4_1 2024-09-12T02:06:47.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__multipart_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.5 2024-09-12T02:06:47.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__shadow_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.5_1 2024-09-12T02:06:47.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__multipart_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.6 2024-09-12T02:06:47.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.663__shadow_foo.2~p_VgDX-1MnOxZBpUFIWix1lDtvGTYht.6_1 2024-09-12T02:06:47.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5541702910079899190', time=2024-09-12T03:53:11.473353+0000, chain.objs.size()=1 2024-09-12T02:06:47.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.666__shadow_.FFbuE_JBAHbS4f7IxZYdrDSjxRC3YWs_0 2024-09-12T02:06:47.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.406+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8782345643423994324', time=2024-09-12T03:53:15.743505+0000, chain.objs.size()=1 2024-09-12T02:06:47.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.406+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.667__shadow_.vPQ2JSNPkDlndT_oqxDJlUhgJFAFIWy_0 2024-09-12T02:06:47.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.410+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5113761213287413964', time=2024-09-12T03:54:35.945734+0000, chain.objs.size()=1 2024-09-12T02:06:47.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.410+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.706__shadow:tQVMztgqE9rEb5hCLWhThpoY2xw67eu_.u3o9Qmlv53IPA9P4xKbw0Q8pNeXYES0_0 2024-09-12T02:06:47.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.410+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13772824668980858665', time=2024-09-12T03:55:10.205907+0000, chain.objs.size()=1 2024-09-12T02:06:47.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.410+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.717__shadow:qs2vHJLWgs-Kz-1.LSo4.oH2pI-mKbf_.VAWG60LaGXmX1615ADTNuj5YUmdplJT_0 2024-09-12T02:06:47.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.414+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:47.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T02:06:47.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:47.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=0, next_marker='' 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10978398294345268361', time=2024-09-12T03:02:40.274934+0000, chain.objs.size()=1 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.148__shadow_.E5mJ987OBvrlhSJm57utsbBR_bRYjFq_0 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KIPEVGPudszoC_QpKoGY_Mj-WHJT-wX', time=2024-09-12T03:06:47.899741+0000, chain.objs.size()=1 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.203__multipart_mymultipart.2~KIPEVGPudszoC_QpKoGY_Mj-WHJT-wX.1 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7464045308774646269', time=2024-09-12T03:10:49.520924+0000, chain.objs.size()=1 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.239__shadow_.DaYIxLB6Y6TlIiMRQDkOIdmSoVjiQB7_0 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14812165334723583625', time=2024-09-12T03:11:09.508823+0000, chain.objs.size()=1 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.246__shadow_.vsJoOShc4QLZFkOVW_rn50uGS_KdLjL_0 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8391425245965675417', time=2024-09-12T03:11:24.575118+0000, chain.objs.size()=1 2024-09-12T02:06:47.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.252__shadow_.myooC4EGSp0UjtrDk9U94a89kzRYyUy_0 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1358701380934149711', time=2024-09-12T03:11:32.125411+0000, chain.objs.size()=1 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.418+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.255__shadow_.xFaWgdyXOQwd6rZFizAcMoM_es4vXB9_0 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6291164354594376226', time=2024-09-12T03:11:37.123855+0000, chain.objs.size()=1 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.257__shadow_.A4H-BZ3TjpSJKSjj9HfZBj5-DApjtrQ_0 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4080692676955636787', time=2024-09-12T03:13:33.978213+0000, chain.objs.size()=1 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.TLe5AlTG4eR_UONQKU57qxwBD7oRrT8_0 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13449727227838445968', time=2024-09-12T03:13:36.089385+0000, chain.objs.size()=1 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-PSWdIOs3_GKbbToWKbLaLltpE78HY8_0 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4850063604613621827', time=2024-09-12T03:13:36.927368+0000, chain.objs.size()=1 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Nn6Ay9-GcBxpmiod7-aUFIQ7qT1nDxL_0 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17674863231274735485', time=2024-09-12T03:13:38.746601+0000, chain.objs.size()=1 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.o93AHDs0CJ9loIzAJ5e46f6fTfzKOLr_0 2024-09-12T02:06:47.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9817855808313466994', time=2024-09-12T03:13:40.066317+0000, chain.objs.size()=1 2024-09-12T02:06:47.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.422+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-QkxgP8mxWg-k7_1fvRErh3DvWnviAg_0 2024-09-12T02:06:47.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1568839119264089639', time=2024-09-12T03:13:40.374748+0000, chain.objs.size()=1 2024-09-12T02:06:47.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.38gSu-s2k5Hsg321SWN5GhaLVxWXSf4_0 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13952417952163296801', time=2024-09-12T03:13:41.430863+0000, chain.objs.size()=1 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_._sKyvn3STdGmBZJs-2wk_6yfxxRuSHb_0 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6344353353757478982', time=2024-09-12T03:13:45.014689+0000, chain.objs.size()=1 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.QSPM3G_F8rhcS2o3uiPTsnLb1bvxm0n_0 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15531011555360613900', time=2024-09-12T03:13:45.551465+0000, chain.objs.size()=1 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Zb91B2Y2hal3HSyxIjuERFYKxaCaPzm_0 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9468864936292438811', time=2024-09-12T03:13:48.395346+0000, chain.objs.size()=1 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.3JhmRKH4U5Dqsesa0Fmn2dp29xOsA4W_0 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4061602692870080332', time=2024-09-12T03:13:48.794896+0000, chain.objs.size()=1 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.bp6s7w6aGm4SMydqU9ga7Lcrl0o6QTd_0 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3880575688992624948', time=2024-09-12T03:13:49.932894+0000, chain.objs.size()=1 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8e-SXZTyOPN658Rk1V1a8c4JrPRyoFI_0 2024-09-12T02:06:47.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3028189987378203111', time=2024-09-12T03:13:51.871725+0000, chain.objs.size()=1 2024-09-12T02:06:47.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.leNYENAmYvS9NfBxOY1aaWuuVo_79Gr_0 2024-09-12T02:06:47.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12460941445793041329', time=2024-09-12T03:13:52.732871+0000, chain.objs.size()=1 2024-09-12T02:06:47.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.OcXnvoqKZattQ8kBsa7h53Zt-JZwkyU_0 2024-09-12T02:06:47.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.543952190288685533', time=2024-09-12T03:13:53.792326+0000, chain.objs.size()=1 2024-09-12T02:06:47.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ikH8sA0Add3qeU0aKOMrAtrn8Rxsfok_0 2024-09-12T02:06:47.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12454213140040832768', time=2024-09-12T03:13:56.437466+0000, chain.objs.size()=1 2024-09-12T02:06:47.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.426+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.jnu5WFWZ9bqmakwbINTfA2tzO7gkRgn_0 2024-09-12T02:06:47.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8049211342057103969', time=2024-09-12T03:13:56.772703+0000, chain.objs.size()=1 2024-09-12T02:06:47.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xRoj8Dpo0lYwzesqlfmGgaUzmCU40gM_0 2024-09-12T02:06:47.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1396566100333763127', time=2024-09-12T03:13:57.354956+0000, chain.objs.size()=1 2024-09-12T02:06:47.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.8s6k1hU-ZTqD9fW3vkSSnFimO7EeLD__0 2024-09-12T02:06:47.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15195287625456476620', time=2024-09-12T03:13:57.826574+0000, chain.objs.size()=1 2024-09-12T02:06:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qQwMlU8mqAzIr2o5pZhtbpg5QhcP0fk_0 2024-09-12T02:06:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3587789014145919037', time=2024-09-12T03:13:58.929585+0000, chain.objs.size()=1 2024-09-12T02:06:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DnLxpZBETJB2jN-HronTPk52Gxfs6mA_0 2024-09-12T02:06:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16998348348442289017', time=2024-09-12T03:14:01.036618+0000, chain.objs.size()=1 2024-09-12T02:06:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.o9ugx00-o_bHH-n6F1w8woOFeAoRyE3_0 2024-09-12T02:06:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9772141476537546108', time=2024-09-12T03:14:01.649756+0000, chain.objs.size()=1 2024-09-12T02:06:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.430+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Fqdelo_Agq-Ki31gM50tPO7PDbeV0TB_0 2024-09-12T02:06:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12241432563098253512', time=2024-09-12T03:14:01.732546+0000, chain.objs.size()=1 2024-09-12T02:06:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.uoMjJrDPAPV7PKBC3UepHDS0vlSphDS_0 2024-09-12T02:06:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1942358835950799488', time=2024-09-12T03:14:02.855960+0000, chain.objs.size()=1 2024-09-12T02:06:47.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.bzFOZ7Z1uZgGiMycwOPyxATJkiShl35_0 2024-09-12T02:06:47.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17946065095596967732', time=2024-09-12T03:14:05.395696+0000, chain.objs.size()=1 2024-09-12T02:06:47.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.AvgibDywQxP3sstmsOjP-8-7AhwBK6z_0 2024-09-12T02:06:47.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5605840201563138854', time=2024-09-12T03:15:04.593560+0000, chain.objs.size()=1 2024-09-12T02:06:47.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.287__shadow_.eQv7ZTbFsUv85wekcEqj8bOiwzP5aAt_0 2024-09-12T02:06:47.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2752147128749511724', time=2024-09-12T03:15:34.869455+0000, chain.objs.size()=1 2024-09-12T02:06:47.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.296__shadow_.usqu8UjF4OAVVCI7rkSZ-FgU2XPjVO-_0 2024-09-12T02:06:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15995055855088388921', time=2024-09-12T03:18:37.542673+0000, chain.objs.size()=1 2024-09-12T02:06:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.aceePxICkbZlHNO1cHpMV31BR4sEr_g_0 2024-09-12T02:06:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11584069452234397215', time=2024-09-12T03:18:39.570822+0000, chain.objs.size()=1 2024-09-12T02:06:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.BUBCpDUIE3-utZFHU2h0ErEtbWtaAxh_0 2024-09-12T02:06:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5736968518424261181', time=2024-09-12T03:18:41.180696+0000, chain.objs.size()=1 2024-09-12T02:06:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3zE-b5TJf6UyIdpqCw32uv4GSF1HWwz_0 2024-09-12T02:06:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13070386784188542095', time=2024-09-12T03:18:42.647872+0000, chain.objs.size()=1 2024-09-12T02:06:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Ap4LSiqiJWxmj88ZNkM_f5kdwfHxLRt_0 2024-09-12T02:06:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9185558863908670198', time=2024-09-12T03:18:44.967119+0000, chain.objs.size()=1 2024-09-12T02:06:47.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.434+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7Hd7xzkWXzNcaJAvQzuYAWAUisLtENR_0 2024-09-12T02:06:47.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1184705072347706624', time=2024-09-12T03:18:46.486776+0000, chain.objs.size()=1 2024-09-12T02:06:47.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Fj0sp9mT7me7da84FreE5b-AKwSTFrM_0 2024-09-12T02:06:47.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2779388116162468740', time=2024-09-12T03:18:47.910251+0000, chain.objs.size()=1 2024-09-12T02:06:47.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.318DY2OK_Mg3cWzHx_YA1w7K0zHR39T_0 2024-09-12T02:06:47.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9156531317181233515', time=2024-09-12T03:18:49.176512+0000, chain.objs.size()=1 2024-09-12T02:06:47.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2_nxyh_ZcS37e6CGTEDvMi-ZgurW4H9_0 2024-09-12T02:06:47.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2094999601161147997', time=2024-09-12T03:18:49.193292+0000, chain.objs.size()=1 2024-09-12T02:06:47.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8U2NMZ7TpSl0oGCmd2XMzvSBapvxXUV_0 2024-09-12T02:06:47.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7719982121395866110', time=2024-09-12T03:18:50.168124+0000, chain.objs.size()=1 2024-09-12T02:06:47.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.kqr2sT60YJ7zkGN7xbrX9kGFZCeRTia_0 2024-09-12T02:06:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5171765919939158591', time=2024-09-12T03:18:51.543813+0000, chain.objs.size()=1 2024-09-12T02:06:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.438+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hOaBZ5djbrc1d4bJdxGJWowGFtG2WyN_0 2024-09-12T02:06:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7367638350474865996', time=2024-09-12T03:18:52.274731+0000, chain.objs.size()=1 2024-09-12T02:06:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_._CgCwrf9FD2w9R9LBr4kEOIpbVG3e7g_0 2024-09-12T02:06:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8865801717986070775', time=2024-09-12T03:18:53.676281+0000, chain.objs.size()=1 2024-09-12T02:06:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.FML8kKn7FW-ONnrDkkfsVQFAtoexGC3_0 2024-09-12T02:06:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4711132007698482311', time=2024-09-12T03:18:53.986619+0000, chain.objs.size()=1 2024-09-12T02:06:47.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eX0QBO8WMJCRw3q5oa9L01DMJlSQN0f_0 2024-09-12T02:06:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15094098688310186100', time=2024-09-12T03:18:54.862134+0000, chain.objs.size()=1 2024-09-12T02:06:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-xT30CsVeUXfzvb-naV2__ATJfwT8LJ_0 2024-09-12T02:06:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11641559886215109249', time=2024-09-12T03:18:55.156333+0000, chain.objs.size()=1 2024-09-12T02:06:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.8bf9FjXTSY1-N-XOl1DsujJnpO5vyEk_0 2024-09-12T02:06:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17403325600961675782', time=2024-09-12T03:18:57.372598+0000, chain.objs.size()=1 2024-09-12T02:06:47.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.442+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QDvxBk8ljVba9dRBLPlQlbdFMv22aqz_0 2024-09-12T02:06:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4772899227486620895', time=2024-09-12T03:18:57.734233+0000, chain.objs.size()=1 2024-09-12T02:06:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.g1xUX9TMu_EfRlwYWWetXafGe3JAPb-_0 2024-09-12T02:06:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15142315083601550805', time=2024-09-12T03:18:58.505827+0000, chain.objs.size()=1 2024-09-12T02:06:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.bnGn9ECet2tP2QZGzUginhFMmU7W_Vd_0 2024-09-12T02:06:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6713221174290118606', time=2024-09-12T03:19:00.384373+0000, chain.objs.size()=1 2024-09-12T02:06:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.p_USZusWxql6uhT0EppMM1tjsux13OW_0 2024-09-12T02:06:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17718692598822918885', time=2024-09-12T03:19:01.981049+0000, chain.objs.size()=1 2024-09-12T02:06:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.7XZVEOPycpPZjc2cn9Mo7guK7gnunpE_0 2024-09-12T02:06:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17898981365059597853', time=2024-09-12T03:19:03.369503+0000, chain.objs.size()=1 2024-09-12T02:06:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.QP5fenbIvnvB_3OOC8vpRKXy6_sr_-c_0 2024-09-12T02:06:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12478979642139163391', time=2024-09-12T03:19:03.664593+0000, chain.objs.size()=1 2024-09-12T02:06:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.1okABjUZQyGOPy-9F6XHZUH5roe6Wi__0 2024-09-12T02:06:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3155974764146310875', time=2024-09-12T03:19:04.100082+0000, chain.objs.size()=1 2024-09-12T02:06:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.whT9BPS0q3F7egT3ROXrJ5KWLcYnNy4_0 2024-09-12T02:06:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8286914127765892678', time=2024-09-12T03:19:04.462383+0000, chain.objs.size()=1 2024-09-12T02:06:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.MtB5D2xckcSZR8og_1ATDWPKsdUeySK_0 2024-09-12T02:06:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4865324638341269864', time=2024-09-12T03:19:05.322268+0000, chain.objs.size()=1 2024-09-12T02:06:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.c67-9xb8k8T2mCa0O_7fUYuUKHhnxlc_0 2024-09-12T02:06:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1546307108567243588', time=2024-09-12T03:19:06.772125+0000, chain.objs.size()=1 2024-09-12T02:06:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.446+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.gPIsxTINpt3VbdoBjxkf_6shGmCe0-X_0 2024-09-12T02:06:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.450+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1006156320500672195', time=2024-09-12T03:20:56.319078+0000, chain.objs.size()=1 2024-09-12T02:06:47.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.450+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.FXsdflK6I9maDBB6APQH5lkONWSdD7m_0 2024-09-12T02:06:47.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.450+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4583039930058001187', time=2024-09-12T03:20:56.703188+0000, chain.objs.size()=1 2024-09-12T02:06:47.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.450+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DOI16CDDtZgHARcg-VznYe7tTfiI9wf_0 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15564266257012491044', time=2024-09-12T03:20:57.304958+0000, chain.objs.size()=1 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Qt3-6CAj6IWxK7mJfv4sd_T0LXct2dm_0 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1230058533852470872', time=2024-09-12T03:20:57.496631+0000, chain.objs.size()=1 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.9HSfFgZWWsukGbToJmhe5OarYf-c5-2_0 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.784994886814689623', time=2024-09-12T03:21:00.507890+0000, chain.objs.size()=1 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.w54zANxNWLOgd3kac0S2665RKP5IZh-_0 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16603280165528755270', time=2024-09-12T03:21:01.115922+0000, chain.objs.size()=1 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7MNNS82pT9XBII3nF3iJ6x6WYC0qChd_0 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8279223428275623561', time=2024-09-12T03:21:01.338946+0000, chain.objs.size()=1 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.axCtWWCsPDhCuz21fribdmckyObk8zg_0 2024-09-12T02:06:47.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8199230159539203128', time=2024-09-12T03:21:03.006763+0000, chain.objs.size()=1 2024-09-12T02:06:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.a2ZH_JHLgbpDZEK5YhSkeg-rsauTrFD_0 2024-09-12T02:06:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14327237830049350470', time=2024-09-12T03:21:03.397250+0000, chain.objs.size()=1 2024-09-12T02:06:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.4w4lJchDK5oOH9xXt3EC5C-mQFF2gt4_0 2024-09-12T02:06:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12426856357255932733', time=2024-09-12T03:21:04.167045+0000, chain.objs.size()=1 2024-09-12T02:06:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.67H3d37AQ8Fs5kARtrc2X8sXoKOYbkv_0 2024-09-12T02:06:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7074596818864383051', time=2024-09-12T03:21:04.426948+0000, chain.objs.size()=1 2024-09-12T02:06:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.SWd1akPnctjXIvlTq6YnpBAiauYBz12_0 2024-09-12T02:06:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14197105160970820210', time=2024-09-12T03:21:04.429828+0000, chain.objs.size()=1 2024-09-12T02:06:47.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.454+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.7QTVyq0gswwTGq9k1ZTlzCq2mmZub-g_0 2024-09-12T02:06:47.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3688140793338066602', time=2024-09-12T03:21:04.543323+0000, chain.objs.size()=1 2024-09-12T02:06:47.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.ASKeUUZOx0ArOstdwq01YnhYapSbUMB_0 2024-09-12T02:06:47.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11831654461645859183', time=2024-09-12T03:21:05.969086+0000, chain.objs.size()=1 2024-09-12T02:06:47.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.TQpeeseX8RqokEO-Ou9YdUpZJgzOqOD_0 2024-09-12T02:06:47.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3319750463088666975', time=2024-09-12T03:21:07.291094+0000, chain.objs.size()=1 2024-09-12T02:06:47.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.824uuWiX5ss5zpi-j8ZsemarhGq9qlq_0 2024-09-12T02:06:47.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16625257051653468115', time=2024-09-12T03:21:07.925982+0000, chain.objs.size()=1 2024-09-12T02:06:47.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.YslmYbjtUb4L-zSZBPDQrx867aB03i4_0 2024-09-12T02:06:47.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.458+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10318501577479314581', time=2024-09-12T03:21:10.303781+0000, chain.objs.size()=1 2024-09-12T02:06:47.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.458+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3GLGGzjzCN3bIgl9pItffirWQXfwFmm_0 2024-09-12T02:06:47.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14136454654303311568', time=2024-09-12T03:21:12.535345+0000, chain.objs.size()=1 2024-09-12T02:06:47.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.H43tJT2kwXaF7L4Ic982LcaclC81a18_0 2024-09-12T02:06:47.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17595707255785003352', time=2024-09-12T03:21:13.959049+0000, chain.objs.size()=1 2024-09-12T02:06:47.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3tPw92ZL5u5mVYHRgPk5seES_FDzQm6_0 2024-09-12T02:06:47.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11111634148823578453', time=2024-09-12T03:21:18.056748+0000, chain.objs.size()=1 2024-09-12T02:06:47.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Cv21PhurB1up569DhUHYBadEuZ2DrtN_0 2024-09-12T02:06:47.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5402428526994917749', time=2024-09-12T03:21:20.172324+0000, chain.objs.size()=1 2024-09-12T02:06:47.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.IZ33F8KqhBbbylhs1GxwZv5kMS_W9C9_0 2024-09-12T02:06:47.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18373895848221033266', time=2024-09-12T03:21:21.058825+0000, chain.objs.size()=1 2024-09-12T02:06:47.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_._Xf9HnTsyEVw7Qv5FwFIfyz99FW_4Nq_0 2024-09-12T02:06:47.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8299500252109119479', time=2024-09-12T03:21:21.534057+0000, chain.objs.size()=1 2024-09-12T02:06:47.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vialAELuiVz8mnZ1jvD1Qxqb_UYWTPz_0 2024-09-12T02:06:47.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.424673381492855606', time=2024-09-12T03:21:22.018234+0000, chain.objs.size()=1 2024-09-12T02:06:47.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.98gQN_IHPiHMAkCHszhXlLA-a1hLJe0_0 2024-09-12T02:06:47.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17731333952582795940', time=2024-09-12T03:21:23.214390+0000, chain.objs.size()=1 2024-09-12T02:06:47.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.GOyst9LAmRgJfV8bgS8Hjy0PVX6p8Vi_0 2024-09-12T02:06:47.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14472537976998293822', time=2024-09-12T03:21:23.216187+0000, chain.objs.size()=1 2024-09-12T02:06:47.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.XnaED-Pb9J92Dg0oRt_M-ttCG6NfC6C_0 2024-09-12T02:06:47.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15991983469140106015', time=2024-09-12T03:21:24.783988+0000, chain.objs.size()=1 2024-09-12T02:06:47.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.sOoQIsSsr3SMMfy879PO367jAVx75Bt_0 2024-09-12T02:06:47.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8684987711793562549', time=2024-09-12T03:21:25.381910+0000, chain.objs.size()=1 2024-09-12T02:06:47.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.462+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.wyY59M4qelA4IuW-PT7SNt_tN7L32f__0 2024-09-12T02:06:47.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8690577206645479798', time=2024-09-12T03:21:49.637718+0000, chain.objs.size()=1 2024-09-12T02:06:47.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.336__shadow_.XPntYaO2W_gscU-6uzL34SV9BBfQr5s_0 2024-09-12T02:06:47.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3534780802308468892', time=2024-09-12T03:26:46.852919+0000, chain.objs.size()=1 2024-09-12T02:06:47.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.465__shadow_.WGj1npzuKdEdVgeimoQLl9MB35pclcY_0 2024-09-12T02:06:47.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1473896092695716225', time=2024-09-12T03:28:00.729130+0000, chain.objs.size()=1 2024-09-12T02:06:47.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.498__shadow_._scEaAyWnlSluvXGdND4ahHkcrAOpPY_0 2024-09-12T02:06:47.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.466+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15968611912468613273', time=2024-09-12T03:38:53.792622+0000, chain.objs.size()=1 2024-09-12T02:06:47.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.466+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.558__shadow_.2xbJcN9THcpRJlbz0h5vTpIgmfn_f1Q_0 2024-09-12T02:06:47.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10907241642078407334', time=2024-09-12T03:40:26.354722+0000, chain.objs.size()=1 2024-09-12T02:06:47.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow:B59hdX16mG723mSoLxHnLiXlxVRBoy5_.gyhNb72_oUaxH6bS37ArQOaOc_TSJhw_0 2024-09-12T02:06:47.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3723108854603965649', time=2024-09-12T03:40:31.826595+0000, chain.objs.size()=1 2024-09-12T02:06:47.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.575__shadow:UXyhNJI3L1hlbmciITr-GPpGdMyFYYy_.k1tCDC8zTkC8iA-Ti-W60aIQW2DoUEJ_0 2024-09-12T02:06:47.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14086482099713896670', time=2024-09-12T03:43:38.011991+0000, chain.objs.size()=1 2024-09-12T02:06:47.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.604__shadow_.Q4rKXOBNqT6IHhB0yplldJofw8rEZ3x_0 2024-09-12T02:06:47.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1215748061135404167', time=2024-09-12T03:54:25.855581+0000, chain.objs.size()=1 2024-09-12T02:06:47.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.702__shadow:TYn8jZJ0JhmOuzER15JabcrqqtfT4qb_.JJsMSUQ7hHyDEL1G6CIiQjrYHtrYeyR_0 2024-09-12T02:06:47.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2912563640910552703', time=2024-09-12T03:55:26.003069+0000, chain.objs.size()=1 2024-09-12T02:06:47.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.720__shadow_.5rPDiA-nKOkNC_xOG0QAM4E9TzXQ8rW_0 2024-09-12T02:06:47.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7884731022446079521', time=2024-09-12T03:56:31.248679+0000, chain.objs.size()=1 2024-09-12T02:06:47.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.740__shadow_.2ZgufWNOveORsg0LfiD1L1EWt0Zv3IB_0 2024-09-12T02:06:47.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='2~iA53m5AdYGDqYPJbYX3cWWPjM3pzgge', time=2024-09-12T03:56:42.378363+0000, chain.objs.size()=1 2024-09-12T02:06:47.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.470+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.743__multipart_mymultipart.2~iA53m5AdYGDqYPJbYX3cWWPjM3pzgge.1 2024-09-12T02:06:47.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.474+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:47.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.478+0000 7fe151b989c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T02:06:47.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.478+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T02:06:47.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T02:06:47.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44989' 2024-09-12T02:06:47.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1406206395225403218', time=2024-09-12T03:02:43.808593+0000, chain.objs.size()=1 2024-09-12T02:06:47.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.152__shadow_.GLtfb0M79MVc7Qo2HTtKEGJA7-4FElN_0 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='_yn_aFdzpyOsDr7Xqms3IPlT2ajLfy3M', time=2024-09-12T03:04:44.095388+0000, chain.objs.size()=1 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.164__shadow_.zYBijTcngxoSpgsts2tbSS-ebQbk3qQ_0 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6339723456598049289', time=2024-09-12T03:05:08.387779+0000, chain.objs.size()=1 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.172__shadow_.Rs7fyZ8qJZIcgBqyYWJOGgogvYGcPps_0 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14286696307169916272', time=2024-09-12T03:05:26.027086+0000, chain.objs.size()=1 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.178__shadow_.QOxPr8ox2DgIlFzm9Su1dcFeD9uRgW3_0 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5572384702176388045', time=2024-09-12T03:10:25.229089+0000, chain.objs.size()=1 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.231__shadow_.6diOrBJ-ulB-WBjl8XOD7FaE0PZUW5-_0 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16086321098150741493', time=2024-09-12T03:10:56.395268+0000, chain.objs.size()=1 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.242__shadow_.Qt4rEFSfj9z8TvkFsL0xcyoFtZyo0wd_0 2024-09-12T02:06:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17689973074527974157', time=2024-09-12T03:13:33.994465+0000, chain.objs.size()=1 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.aVjNikL3hCDOT2LGxOCFyAo9RLwQeJw_0 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10222315581943661643', time=2024-09-12T03:13:34.687888+0000, chain.objs.size()=1 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.pU2-BlIRiVo3c2vNtBGLlbygbN16KTl_0 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12601903689071648945', time=2024-09-12T03:13:34.746245+0000, chain.objs.size()=1 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JDTz5zYcbMOFIuXi2Y1MrIBrXb6tzWd_0 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4874129020829029740', time=2024-09-12T03:13:35.505932+0000, chain.objs.size()=1 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.r-QTgOGhH9N1Enm9QqqMiLdNQnswAWF_0 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5674570805388074097', time=2024-09-12T03:13:36.579520+0000, chain.objs.size()=1 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.x0ceSIAjMeh4pzvXVrbZHzBeAY7YXLY_0 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16214585325870036455', time=2024-09-12T03:13:38.765902+0000, chain.objs.size()=1 2024-09-12T02:06:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.O6LNBnt3HOo5rdOwa34xgdTxSwyiX_c_0 2024-09-12T02:06:47.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.482+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1541559788230544308', time=2024-09-12T03:13:39.111540+0000, chain.objs.size()=1 2024-09-12T02:06:47.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.5rkAyQgH2TswQzV7eQPQz5mVuNya6pG_0 2024-09-12T02:06:47.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3936062539410577588', time=2024-09-12T03:13:39.594102+0000, chain.objs.size()=1 2024-09-12T02:06:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.nMNWZD_rNeqtomRvH5Jh25O7td2ZYmW_0 2024-09-12T02:06:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11768928939108023008', time=2024-09-12T03:13:40.071124+0000, chain.objs.size()=1 2024-09-12T02:06:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.-6RKdKcvFLJU-d6aXKQ9hQwu8hxSa85_0 2024-09-12T02:06:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3784669422570995690', time=2024-09-12T03:13:40.166747+0000, chain.objs.size()=1 2024-09-12T02:06:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9w0VVykyCMv98wwu1OSqB1eRWMAXcG-_0 2024-09-12T02:06:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1306815573093529958', time=2024-09-12T03:13:40.480175+0000, chain.objs.size()=1 2024-09-12T02:06:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.0GEcM6mxdDSOYVaC37JZbhRB7s0Sdvm_0 2024-09-12T02:06:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8315399557331423170', time=2024-09-12T03:13:40.586618+0000, chain.objs.size()=1 2024-09-12T02:06:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.peXdxrvpaoosmQgsC-91Sj9xQr3hPTu_0 2024-09-12T02:06:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15163250721919052581', time=2024-09-12T03:13:44.742910+0000, chain.objs.size()=1 2024-09-12T02:06:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.XnlhE0eweZOoFBZK97gs5kO4J4BcuRf_0 2024-09-12T02:06:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4285016906071405224', time=2024-09-12T03:13:45.142155+0000, chain.objs.size()=1 2024-09-12T02:06:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.cFuzycEqhyWd5152lC1Z0K-JH2xeH85_0 2024-09-12T02:06:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5046135240745560085', time=2024-09-12T03:13:47.689401+0000, chain.objs.size()=1 2024-09-12T02:06:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.9cZztPkRAPDfZNa5Je19ATIgC9GVo7Y_0 2024-09-12T02:06:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.750427768178383388', time=2024-09-12T03:13:48.276409+0000, chain.objs.size()=1 2024-09-12T02:06:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Erdt4YLoPISPFX-agFEAg2OmIO7SAAL_0 2024-09-12T02:06:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1513483021558718357', time=2024-09-12T03:13:48.294563+0000, chain.objs.size()=1 2024-09-12T02:06:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.486+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.q8rEppcGEBsrlpEE59_2s7p84sG0R16_0 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16249695240278358417', time=2024-09-12T03:13:49.912462+0000, chain.objs.size()=1 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.Vxq8hlMOHliS8Pzzm6Ou1sC1CIMlUAs_0 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5698913841872060844', time=2024-09-12T03:13:50.775021+0000, chain.objs.size()=1 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.93oXonlk9JQt1aVk7G9ESar6uOkj45w_0 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6860000869593746227', time=2024-09-12T03:13:52.264022+0000, chain.objs.size()=1 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.YF8IB8OdfRuwlzyccRfIVDAbhV3KlMS_0 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13124163240690598425', time=2024-09-12T03:13:52.310289+0000, chain.objs.size()=1 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xVyGwJLh8CoGaJUcF78HYf3fGXd21Yl_0 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15967044009502774419', time=2024-09-12T03:13:53.642504+0000, chain.objs.size()=1 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4wDjy7aW_uRP_3ricAnb9dW5Xga2SlB_0 2024-09-12T02:06:47.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11369755538493270593', time=2024-09-12T03:13:53.920235+0000, chain.objs.size()=1 2024-09-12T02:06:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.KK21bX2M5PTIJ8xoAkom6p1IuXx4HmZ_0 2024-09-12T02:06:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8120676285194013576', time=2024-09-12T03:13:54.763543+0000, chain.objs.size()=1 2024-09-12T02:06:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.xkWrGdYp6118NBpJT8taxDkIQKtRSMt_0 2024-09-12T02:06:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10747684355586164338', time=2024-09-12T03:13:55.921700+0000, chain.objs.size()=1 2024-09-12T02:06:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.4NRs6v07pAwsMYSsJqDOrDqscs1zJ-m_0 2024-09-12T02:06:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10016979426991884205', time=2024-09-12T03:13:56.128740+0000, chain.objs.size()=1 2024-09-12T02:06:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.GjLq_x55mv_P6Zh4NiQ9Wosj50LY577_0 2024-09-12T02:06:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9555477873028134635', time=2024-09-12T03:14:01.050765+0000, chain.objs.size()=1 2024-09-12T02:06:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.DDf2Oixsu9uwcslxfydDp-3ppAniv8q_0 2024-09-12T02:06:47.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12869046889207482658', time=2024-09-12T03:14:03.094811+0000, chain.objs.size()=1 2024-09-12T02:06:47.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.490+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.ro2qThELAusROzjmfREZqTid3Fjj2g3_0 2024-09-12T02:06:47.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16801329136325415903', time=2024-09-12T03:14:03.419718+0000, chain.objs.size()=1 2024-09-12T02:06:47.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.VjfdDSzza_-MWVq7PCTlKiYKBbymujg_0 2024-09-12T02:06:47.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3764841170779656477', time=2024-09-12T03:14:04.453589+0000, chain.objs.size()=1 2024-09-12T02:06:47.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.qiN-eX8OJwjgkUqFR6dFrIRA1rYOdKP_0 2024-09-12T02:06:47.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17592804133674925453', time=2024-09-12T03:14:04.745092+0000, chain.objs.size()=1 2024-09-12T02:06:47.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.263__shadow_.JY89V8XUb5PBy7bNMUg0m-nRPc_8qj2_0 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11060182812537141007', time=2024-09-12T03:14:24.601377+0000, chain.objs.size()=1 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.271__shadow_.IQfcMASr-xQDENm7TKNpKrJSbYXqOFi_0 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5345939390870472819', time=2024-09-12T03:14:44.170528+0000, chain.objs.size()=1 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.279__shadow_.HhwqYkS2NxPvinHK7_Wtbd11AUIn-SS_0 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17460995308280221062', time=2024-09-12T03:15:04.570973+0000, chain.objs.size()=1 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.287__shadow_.dhqxy52JiesDl_ZMMhEI9ZenBJj1fOz_0 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1527347726869236781', time=2024-09-12T03:15:04.593587+0000, chain.objs.size()=1 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.287__shadow_.e5yc6GrstUq7Sdt4KCtJZ4aNLs4w6nc_0 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.15377772633964071777', time=2024-09-12T03:15:29.495505+0000, chain.objs.size()=1 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.ahgDm6wMcKBrCXBU0tzUUIO1PnG1zuz_0 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8036094858116984764', time=2024-09-12T03:15:29.776574+0000, chain.objs.size()=1 2024-09-12T02:06:47.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.294__shadow_.iKDddsITcbavSS75YQEHDlhdWH6BosQ_0 2024-09-12T02:06:47.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7703804753519890267', time=2024-09-12T03:15:42.512577+0000, chain.objs.size()=1 2024-09-12T02:06:47.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.299__shadow_.EL6fWj52ZSA7oWKHbHRRaJkKnAdQv9w_0 2024-09-12T02:06:47.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12408448153024226518', time=2024-09-12T03:16:43.300471+0000, chain.objs.size()=1 2024-09-12T02:06:47.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.498+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.320__shadow:TDaxXyDZJZxjzFDEv4vtBWo4-63oyvA_.ePEF2DrrF5l_daxruNz3OwO8LTITcm-_0 2024-09-12T02:06:47.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3997925106071345725', time=2024-09-12T03:16:49.716137+0000, chain.objs.size()=1 2024-09-12T02:06:47.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.323__shadow_.kRs1z3QOf-6gPowTt04oJHCKgJZi1BY_0 2024-09-12T02:06:47.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5441303774207762069', time=2024-09-12T03:18:36.376157+0000, chain.objs.size()=1 2024-09-12T02:06:47.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.3uIjct4u78AOTyq9zDImmdHKprVJzfd_0 2024-09-12T02:06:47.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12064311712220008702', time=2024-09-12T03:18:36.557080+0000, chain.objs.size()=1 2024-09-12T02:06:47.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.4Zz-e760jVBReV4uOxL4-gxvgxAQBmH_0 2024-09-12T02:06:47.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10088803372074539534', time=2024-09-12T03:18:38.005483+0000, chain.objs.size()=1 2024-09-12T02:06:47.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.lX_ozYYd8UIaGmA6d8pY14BT0gvtT3W_0 2024-09-12T02:06:47.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12502548517594795938', time=2024-09-12T03:18:38.563859+0000, chain.objs.size()=1 2024-09-12T02:06:47.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ppN2q6Sx6GGIE-FFMVNSocdZ8YVymb3_0 2024-09-12T02:06:47.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3555954042223607847', time=2024-09-12T03:18:38.712744+0000, chain.objs.size()=1 2024-09-12T02:06:47.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.dGOUleHwQBj6s33PUN848Q4Ytk9U68u_0 2024-09-12T02:06:47.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18059552864475849101', time=2024-09-12T03:18:40.951032+0000, chain.objs.size()=1 2024-09-12T02:06:47.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.N0O3_QBxz-BdAD1lRL1c0dJ4gj7Racr_0 2024-09-12T02:06:47.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17033509102776352107', time=2024-09-12T03:18:42.862443+0000, chain.objs.size()=1 2024-09-12T02:06:47.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.DL9VCudYoZzB2-zKqfqoxgRFkwuYoSM_0 2024-09-12T02:06:47.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2466262093006577816', time=2024-09-12T03:18:43.068304+0000, chain.objs.size()=1 2024-09-12T02:06:47.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.hvn2cIeoWjs2BJwPvYZHwu4tANs-TXd_0 2024-09-12T02:06:47.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7978785655994502306', time=2024-09-12T03:18:43.355600+0000, chain.objs.size()=1 2024-09-12T02:06:47.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.ECoVpchP6Ykx9J5Ro1ephplC9UsygGb_0 2024-09-12T02:06:47.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11662510919963375388', time=2024-09-12T03:18:43.701701+0000, chain.objs.size()=1 2024-09-12T02:06:47.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.502+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.tVuZkhQnPnBRCPtncvEvFm2h4Liaqtl_0 2024-09-12T02:06:47.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1116514002241615807', time=2024-09-12T03:18:45.336250+0000, chain.objs.size()=1 2024-09-12T02:06:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.SoVcvZ_us38_dvSCZ1zBaj21S23DG_V_0 2024-09-12T02:06:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4069780855635709984', time=2024-09-12T03:18:48.183547+0000, chain.objs.size()=1 2024-09-12T02:06:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vWJrIApT-lwtu-hyH3SbBCS6h2ZN0A8_0 2024-09-12T02:06:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10098427303012727765', time=2024-09-12T03:18:49.623081+0000, chain.objs.size()=1 2024-09-12T02:06:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.COHcNFM3bZp2woJDg6OizGi__pUo6hY_0 2024-09-12T02:06:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7850616882522859547', time=2024-09-12T03:18:49.780587+0000, chain.objs.size()=1 2024-09-12T02:06:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.B_XNgMEF5txvjWBmKZU3tRC6oCeZL84_0 2024-09-12T02:06:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14836366183055059983', time=2024-09-12T03:18:51.087941+0000, chain.objs.size()=1 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.KyxrAmBbL2LxNB4-mwNVPuUQ-05HWJG_0 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16015150573030970892', time=2024-09-12T03:18:54.530490+0000, chain.objs.size()=1 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.di9sGksnqBWDYi41GKYwl4_IJ8qpVdU_0 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9463085518647958695', time=2024-09-12T03:18:54.531938+0000, chain.objs.size()=1 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zO9ouMtOm2mB-qvx4ibchnEuzsx9_oM_0 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10802339114003542650', time=2024-09-12T03:18:55.880535+0000, chain.objs.size()=1 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.vujBsTTOzaieFUmNCwXrjF2GDqBAKSc_0 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.3807477930393700462', time=2024-09-12T03:18:56.465697+0000, chain.objs.size()=1 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.okBeDCDvK2sw84rzXQVXC1OplqF_F-v_0 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5143761019370009091', time=2024-09-12T03:18:56.506148+0000, chain.objs.size()=1 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.-jE5lUFyhOVnfz4t8SBQp21TOvsoQEz_0 2024-09-12T02:06:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13558080185693872837', time=2024-09-12T03:18:58.094330+0000, chain.objs.size()=1 2024-09-12T02:06:47.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.510+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.qUobEuGNLrLfAkOjZEXFs02YCDEfDNC_0 2024-09-12T02:06:47.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6832748874093467133', time=2024-09-12T03:18:58.938334+0000, chain.objs.size()=1 2024-09-12T02:06:47.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.eopOdXfCb7abNQRmfugR_p4ADf_Ryhz_0 2024-09-12T02:06:47.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.2375768560674562571', time=2024-09-12T03:18:59.467961+0000, chain.objs.size()=1 2024-09-12T02:06:47.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.WcFYHx7ZWQSiQexcKcRiDYWZmC1VlMg_0 2024-09-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.567319982391884166', time=2024-09-12T03:18:59.541855+0000, chain.objs.size()=1 2024-09-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.zzIZGwi0thrq5UbLOX0Vfado76w-rcy_0 2024-09-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12723836286584944853', time=2024-09-12T03:18:59.773842+0000, chain.objs.size()=1 2024-09-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.W8UKgAfFxOJE2yw-Jg3VAYtHb5x2MTA_0 2024-09-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.18007454282290346108', time=2024-09-12T03:19:01.378509+0000, chain.objs.size()=1 2024-09-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.fH7QJI0F5MCXwAWZjvfAsJtE6r8Nqj7_0 2024-09-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5399524485754662772', time=2024-09-12T03:19:02.340224+0000, chain.objs.size()=1 2024-09-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.Id1Or1UQaHjLGqn6ukJI3t8pyFmZRXs_0 2024-09-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11295366251646823347', time=2024-09-12T03:19:04.062084+0000, chain.objs.size()=1 2024-09-12T02:06:47.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.514+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.YiMuEwTkaS0rRdFI3hcWKydBY0ZtWu0_0 2024-09-12T02:06:47.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6915252822117148821', time=2024-09-12T03:19:04.497635+0000, chain.objs.size()=1 2024-09-12T02:06:47.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.9BWj6VHGM3AoFUKcNFaef_mCFQ60Jm6_0 2024-09-12T02:06:47.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12047877926347409688', time=2024-09-12T03:19:04.501244+0000, chain.objs.size()=1 2024-09-12T02:06:47.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.2cU-Nnfxyuc_kSwIAtv4lg8Vt_kaTJN_0 2024-09-12T02:06:47.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.17885335603862780944', time=2024-09-12T03:19:05.838217+0000, chain.objs.size()=1 2024-09-12T02:06:47.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.y9A2uziFs-mC19fFKh_yxjJZyTh8IYa_0 2024-09-12T02:06:47.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10578932754211374379', time=2024-09-12T03:19:06.629696+0000, chain.objs.size()=1 2024-09-12T02:06:47.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.pCgiJO8LJ5Zla0i-Z4mLqqbaSckEOWf_0 2024-09-12T02:06:47.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8087375736554948529', time=2024-09-12T03:19:07.709000+0000, chain.objs.size()=1 2024-09-12T02:06:47.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.324__shadow_.TjSjPbo04yfor0cV6oV5RepBjzwfdle_0 2024-09-12T02:06:47.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9541578889315385425', time=2024-09-12T03:20:54.729569+0000, chain.objs.size()=1 2024-09-12T02:06:47.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.518+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.e_9TRPXOnHiRiCiU8oJklrM0fad6tOO_0 2024-09-12T02:06:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7559758626575557577', time=2024-09-12T03:20:55.362067+0000, chain.objs.size()=1 2024-09-12T02:06:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.WbvPkVF-W7AuBYYUBR8zlVyLmvZhQ0P_0 2024-09-12T02:06:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.16438155256476708830', time=2024-09-12T03:20:55.779447+0000, chain.objs.size()=1 2024-09-12T02:06:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.CcjrBSpAiTf7M80sxLr2--MWQ7zujdK_0 2024-09-12T02:06:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.14314162395580390360', time=2024-09-12T03:20:56.113723+0000, chain.objs.size()=1 2024-09-12T02:06:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.nlikTCX9t8ivxYbFm_LKS6g2aQ_ICeB_0 2024-09-12T02:06:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7621652258977862006', time=2024-09-12T03:20:59.257676+0000, chain.objs.size()=1 2024-09-12T02:06:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.NsVIdTp5lMk5Bc-PrXFsxB1F_flQtj2_0 2024-09-12T02:06:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1251975109574461665', time=2024-09-12T03:20:59.811742+0000, chain.objs.size()=1 2024-09-12T02:06:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.0aPKXROi73E0Uma87zgR1l-RcjqwWLj_0 2024-09-12T02:06:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10325104501417557931', time=2024-09-12T03:20:59.813346+0000, chain.objs.size()=1 2024-09-12T02:06:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yXZSmGNfwlOdlzXOWAzFlCK52MG4HgA_0 2024-09-12T02:06:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12404076336026753812', time=2024-09-12T03:21:00.696289+0000, chain.objs.size()=1 2024-09-12T02:06:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.2jwXY24pODORzKkaVgVQpdP05ExIJWk_0 2024-09-12T02:06:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10800279308878906910', time=2024-09-12T03:21:03.378319+0000, chain.objs.size()=1 2024-09-12T02:06:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MBsxgw4UNUfzC7_8ZmgiWMYvStWCxjC_0 2024-09-12T02:06:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.9204533013967292286', time=2024-09-12T03:21:04.576683+0000, chain.objs.size()=1 2024-09-12T02:06:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.522+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.PU2a3E-plxh70BcVHhPpPSrWqZVGicC_0 2024-09-12T02:06:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7071573597791471127', time=2024-09-12T03:21:05.143742+0000, chain.objs.size()=1 2024-09-12T02:06:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.f3ZbyHMxSMe_yAO3TCkrb9dTTi1z0re_0 2024-09-12T02:06:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10893775832829566819', time=2024-09-12T03:21:07.402403+0000, chain.objs.size()=1 2024-09-12T02:06:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.DWB8cRxibBikLPX5MlGOdRE1LeKpO4c_0 2024-09-12T02:06:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7850226701018019912', time=2024-09-12T03:21:08.618793+0000, chain.objs.size()=1 2024-09-12T02:06:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.vGzSVTX3q1j9ARbRTum-TS_EgfX9NMH_0 2024-09-12T02:06:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12182856112368369912', time=2024-09-12T03:21:10.113099+0000, chain.objs.size()=1 2024-09-12T02:06:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.C8bBWf_68VmvqCq-AL3nr4aHkv9Nyco_0 2024-09-12T02:06:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.10726261720000900328', time=2024-09-12T03:21:15.455460+0000, chain.objs.size()=1 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.tE-TTTJc1T9H_PkoRLg4zwxHX2z8zbC_0 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.1273469604819900767', time=2024-09-12T03:21:16.026925+0000, chain.objs.size()=1 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.SZ-Nkjmnri6bYaFnrBzDB92BXbuhaXF_0 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.11878174578541805147', time=2024-09-12T03:21:17.569333+0000, chain.objs.size()=1 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.MHvJO_PycJm4Hr8R6k7tKmf0_SZBvBR_0 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8858691520080787965', time=2024-09-12T03:21:20.456207+0000, chain.objs.size()=1 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.h5fMNVQA3z6rkyVN__2abAjc9Zt6cfC_0 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4396942997588277792', time=2024-09-12T03:21:20.457692+0000, chain.objs.size()=1 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.Wvb7rdLH8ESUaVJfzN1Oalq5MYxGJWv_0 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.304614381487416261', time=2024-09-12T03:21:21.137118+0000, chain.objs.size()=1 2024-09-12T02:06:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.526+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.e3quLQa7_50UlWcZwsJAIVIq1lSi_eZ_0 2024-09-12T02:06:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.530+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8546709805426348033', time=2024-09-12T03:21:23.500124+0000, chain.objs.size()=1 2024-09-12T02:06:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.530+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.G5vo0V52snnIOLBIk5s93lJ1WNi3yjb_0 2024-09-12T02:06:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.534+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44989 2024-09-12T02:06:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T02:06:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7287167071760095940', time=2024-09-12T03:21:23.574474+0000, chain.objs.size()=1 2024-09-12T02:06:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.3w1oEZTpt9Qr2mNhL_jLvFwQGNtgpXU_0 2024-09-12T02:06:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6032444679888446486', time=2024-09-12T03:21:23.858740+0000, chain.objs.size()=1 2024-09-12T02:06:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.yLtXiDxBJJ__9Vv3IsUBt2blanNlenG_0 2024-09-12T02:06:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7199881829942548512', time=2024-09-12T03:21:24.251244+0000, chain.objs.size()=1 2024-09-12T02:06:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.k1YzcKw3yTYE7weEazeXHQHp-UKXcbu_0 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8893795866020452104', time=2024-09-12T03:21:25.190685+0000, chain.objs.size()=1 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.325__shadow_.m3H96bOPNRaG5mZvfMw-hXCiviAmqr9_0 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.4928484638875789705', time=2024-09-12T03:25:16.905144+0000, chain.objs.size()=1 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.431__shadow_.61hvIMLvK-Vbrp1osGYhPHnSwX_reiQ_0 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6324871691359267151', time=2024-09-12T03:26:27.520425+0000, chain.objs.size()=1 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.459__shadow_.3ibRtogqvD-D95HRlTUtLBZ9XVy6zPn_0 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8580385850962138295', time=2024-09-12T03:27:21.975890+0000, chain.objs.size()=1 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.484__shadow_.CH7Tqj62pX-jjDTDVLRzxBV1mhqehnx_0 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7764396534639994365', time=2024-09-12T03:27:44.711788+0000, chain.objs.size()=1 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.491__shadow_.K6wiJWDhcs_qRzC0A8bk6k2JSlZ1A6l_0 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7764396534639994365', time=2024-09-12T03:27:45.251351+0000, chain.objs.size()=1 2024-09-12T02:06:47.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.491__shadow_.K6wiJWDhcs_qRzC0A8bk6k2JSlZ1A6l_0 2024-09-12T02:06:47.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8860610084100613089', time=2024-09-12T03:30:18.594482+0000, chain.objs.size()=6 2024-09-12T02:06:47.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.520__multipart_mymultipart.2~di29Glx_4liGEtmhHygBqM47s1i_qm9.1 2024-09-12T02:06:47.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.520__multipart_mymultipart.2~di29Glx_4liGEtmhHygBqM47s1i_qm9.2 2024-09-12T02:06:47.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.538+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.520__multipart_mymultipart.2~di29Glx_4liGEtmhHygBqM47s1i_qm9.3 2024-09-12T02:06:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.520__multipart_mymultipart.2~di29Glx_4liGEtmhHygBqM47s1i_qm9.4 2024-09-12T02:06:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.542+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.520__multipart_mymultipart.2~di29Glx_4liGEtmhHygBqM47s1i_qm9.5 2024-09-12T02:06:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.520__multipart_mymultipart.2~di29Glx_4liGEtmhHygBqM47s1i_qm9.6 2024-09-12T02:06:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13673884665176599142', time=2024-09-12T03:33:25.771139+0000, chain.objs.size()=6 2024-09-12T02:06:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~7ETbUSdm5FSmaalzBAb4gW14Cau8PFj.1 2024-09-12T02:06:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~7ETbUSdm5FSmaalzBAb4gW14Cau8PFj.2 2024-09-12T02:06:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.LWG7JLvZOKhudgPvQr4ElEgxS-bOeVjK.3 2024-09-12T02:06:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~7ETbUSdm5FSmaalzBAb4gW14Cau8PFj.4 2024-09-12T02:06:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~7ETbUSdm5FSmaalzBAb4gW14Cau8PFj.5 2024-09-12T02:06:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.523__multipart_mymultipart.2~7ETbUSdm5FSmaalzBAb4gW14Cau8PFj.6 2024-09-12T02:06:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7899661100583881210', time=2024-09-12T03:34:44.093262+0000, chain.objs.size()=2 2024-09-12T02:06:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~Bar4njkgpxZBybuX2a5H8nVlD-wJ98K.1 2024-09-12T02:06:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.546+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.524__multipart_mymultipart.2~Bar4njkgpxZBybuX2a5H8nVlD-wJ98K.2 2024-09-12T02:06:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.12534613330048107165', time=2024-09-12T03:40:35.788210+0000, chain.objs.size()=1 2024-09-12T02:06:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.576__shadow_.vbbwj0kGY06zhJ0K0KHduGCuGS3cd4x_0 2024-09-12T02:06:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.7018599846893790273', time=2024-09-12T03:42:43.406926+0000, chain.objs.size()=1 2024-09-12T02:06:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.581__shadow:ahl-Sh7UMAZs6toUBVafFBTwISYwRLE_.JvzBXACETZuZtkAswF_SWrNig7M6aXr_0 2024-09-12T02:06:47.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.13723602139662189894', time=2024-09-12T03:43:49.821859+0000, chain.objs.size()=1 2024-09-12T02:06:47.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.609__shadow_.gv8IDxcVK-xr39fkC1pGvC5JEDx1FxJ_0 2024-09-12T02:06:47.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.5578827822015905047', time=2024-09-12T03:51:50.209084+0000, chain.objs.size()=1 2024-09-12T02:06:47.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.654__shadow_.6-gmlr1YSPbVIUNyCUATPRqoOfTrfBb_0 2024-09-12T02:06:47.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.6433835022530981557', time=2024-09-12T03:53:40.624766+0000, chain.objs.size()=1 2024-09-12T02:06:47.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.680__shadow_.alEJePkPTuDYxYc7uG9PeSzeolpV_6d_0 2024-09-12T02:06:47.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 20 garbage collection: RGWGC::process iterating over entry tag='19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.8291779171929924965', time=2024-09-12T03:56:53.484584+0000, chain.objs.size()=3 2024-09-12T02:06:47.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.744__multipart_mymultipart3.2~_d3LqUPXAjMqdhRJGL5SxEREDJtP-lR.1 2024-09-12T02:06:47.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.744__multipart_mymultipart3.2~_d3LqUPXAjMqdhRJGL5SxEREDJtP-lR.2 2024-09-12T02:06:47.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.550+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:19f4f3c1-461e-436c-9c0f-f6c5a929bad9.4489.744__multipart_mymultipart3.2~_d3LqUPXAjMqdhRJGL5SxEREDJtP-lR.3 2024-09-12T02:06:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.558+0000 7fe151b989c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T02:06:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.562+0000 7fe005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T02:06:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.566+0000 7fe151b989c0 20 remove_watcher() i=0 2024-09-12T02:06:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.566+0000 7fe151b989c0 2 removed watcher, disabling cache 2024-09-12T02:06:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.566+0000 7fe151b989c0 20 remove_watcher() i=1 2024-09-12T02:06:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.566+0000 7fe151b989c0 20 remove_watcher() i=2 2024-09-12T02:06:47.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.566+0000 7fe151b989c0 20 remove_watcher() i=3 2024-09-12T02:06:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.570+0000 7fe151b989c0 20 remove_watcher() i=4 2024-09-12T02:06:47.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.570+0000 7fe151b989c0 20 remove_watcher() i=5 2024-09-12T02:06:47.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.570+0000 7fe151b989c0 20 remove_watcher() i=6 2024-09-12T02:06:47.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-12T02:06:47.570+0000 7fe151b989c0 20 remove_watcher() i=7 2024-09-12T02:06:47.587 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T02:06:47.597 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T02:06:47.637 DEBUG:teuthology.orchestra.run.smithi102:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T02:06:47.688 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T02:06:47.743 DEBUG:teuthology.orchestra.run.smithi102:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T02:06:47.792 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-12T02:06:47.852 DEBUG:teuthology.orchestra.run.smithi102:> sudo update-ca-certificates 2024-09-12T02:06:47.911 INFO:teuthology.orchestra.run.smithi102.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T02:06:48.300 INFO:teuthology.orchestra.run.smithi102.stdout:0 added, 0 removed; done. 2024-09-12T02:06:48.300 INFO:teuthology.orchestra.run.smithi102.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T02:06:48.302 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:06:48.504 INFO:teuthology.orchestra.run.smithi102.stdout:done. 2024-09-12T02:06:48.504 INFO:teuthology.orchestra.run.smithi102.stdout:done. 2024-09-12T02:06:48.507 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T02:06:48.517 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:06:48.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:06:48.905 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:06:48.918 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-12T02:06:48.920 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":3771,"stamp":"2024-09-12T02:06:46.878985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":718603322,"num_objects":4984,"num_object_clones":0,"num_object_copies":18820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4984,"num_whiteouts":0,"num_read":290153,"num_read_kb":2559169,"num_write":160063,"num_write_kb":2404851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13225,"ondisk_log_size":13225,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2904952,"kb_used_data":1138284,"kb_used_omap":12,"kb_used_meta":1766515,"kb_avail":752069768,"statfs":{"total":773094113280,"available":770119442432,"internally_reserved":0,"allocated":1165602816,"data_stored":1149483596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1808911920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5243736,"num_objects":-57,"num_object_clones":0,"num_object_copies":-228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-57,"num_whiteouts":0,"num_read":62,"num_read_kb":5,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008243"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:54.728675+0000","last_change":"2024-09-12T01:00:24.087308+0000","last_active":"2024-09-12T02:02:54.728675+0000","last_peered":"2024-09-12T02:02:54.728675+0000","last_clean":"2024-09-12T02:02:54.728675+0000","last_became_active":"2024-09-12T01:00:24.086540+0000","last_became_peered":"2024-09-12T01:00:24.086540+0000","last_unstale":"2024-09-12T02:02:54.728675+0000","last_undegraded":"2024-09-12T02:02:54.728675+0000","last_fullsized":"2024-09-12T02:02:54.728675+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:55.672405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"266'2","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:24.721564+0000","last_change":"2024-09-12T00:32:21.646660+0000","last_active":"2024-09-12T02:02:24.721564+0000","last_peered":"2024-09-12T02:02:24.721564+0000","last_clean":"2024-09-12T02:02:24.721564+0000","last_became_active":"2024-09-12T00:32:21.645757+0000","last_became_peered":"2024-09-12T00:32:21.645757+0000","last_unstale":"2024-09-12T02:02:24.721564+0000","last_undegraded":"2024-09-12T02:02:24.721564+0000","last_fullsized":"2024-09-12T02:02:24.721564+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"266'4","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.939619+0000","last_change":"2024-09-12T00:32:14.592938+0000","last_active":"2024-09-12T02:02:13.939619+0000","last_peered":"2024-09-12T02:02:13.939619+0000","last_clean":"2024-09-12T02:02:13.939619+0000","last_became_active":"2024-09-12T00:32:14.592177+0000","last_became_peered":"2024-09-12T00:32:14.592177+0000","last_unstale":"2024-09-12T02:02:13.939619+0000","last_undegraded":"2024-09-12T02:02:13.939619+0000","last_fullsized":"2024-09-12T02:02:13.939619+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:54.401327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4193419,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8188,"num_write":4,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"266'29","reported_seq":164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.531382+0000","last_change":"2024-09-12T00:26:23.355721+0000","last_active":"2024-09-12T02:04:18.531382+0000","last_peered":"2024-09-12T02:04:18.531382+0000","last_clean":"2024-09-12T02:04:18.531382+0000","last_became_active":"2024-09-12T00:26:23.353338+0000","last_became_peered":"2024-09-12T00:26:23.353338+0000","last_unstale":"2024-09-12T02:04:18.531382+0000","last_undegraded":"2024-09-12T02:04:18.531382+0000","last_fullsized":"2024-09-12T02:04:18.531382+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.176865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.694256+0000","last_change":"2024-09-12T01:00:24.074808+0000","last_active":"2024-09-12T02:02:53.694256+0000","last_peered":"2024-09-12T02:02:53.694256+0000","last_clean":"2024-09-12T02:02:53.694256+0000","last_became_active":"2024-09-12T01:00:24.074048+0000","last_became_peered":"2024-09-12T01:00:24.074048+0000","last_unstale":"2024-09-12T02:02:53.694256+0000","last_undegraded":"2024-09-12T02:02:53.694256+0000","last_fullsized":"2024-09-12T02:02:53.694256+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:33.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"266'9","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.731019+0000","last_change":"2024-09-12T00:32:21.643734+0000","last_active":"2024-09-12T02:02:23.731019+0000","last_peered":"2024-09-12T02:02:23.731019+0000","last_clean":"2024-09-12T02:02:23.731019+0000","last_became_active":"2024-09-12T00:32:21.642967+0000","last_became_peered":"2024-09-12T00:32:21.642967+0000","last_unstale":"2024-09-12T02:02:23.731019+0000","last_undegraded":"2024-09-12T02:02:23.731019+0000","last_fullsized":"2024-09-12T02:02:23.731019+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:09.883461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8395915,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":24594,"num_write":14,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.674367+0000","last_change":"2024-09-12T00:32:14.603921+0000","last_active":"2024-09-12T02:02:13.674367+0000","last_peered":"2024-09-12T02:02:13.674367+0000","last_clean":"2024-09-12T02:02:13.674367+0000","last_became_active":"2024-09-12T00:32:14.602766+0000","last_became_peered":"2024-09-12T00:32:14.602766+0000","last_unstale":"2024-09-12T02:02:13.674367+0000","last_undegraded":"2024-09-12T02:02:13.674367+0000","last_fullsized":"2024-09-12T02:02:13.674367+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.170421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"266'26","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.693108+0000","last_change":"2024-09-12T00:26:23.322380+0000","last_active":"2024-09-12T02:02:48.693108+0000","last_peered":"2024-09-12T02:02:48.693108+0000","last_clean":"2024-09-12T02:02:48.693108+0000","last_became_active":"2024-09-12T00:26:23.321682+0000","last_became_peered":"2024-09-12T00:26:23.321682+0000","last_unstale":"2024-09-12T02:02:48.693108+0000","last_undegraded":"2024-09-12T02:02:48.693108+0000","last_fullsized":"2024-09-12T02:02:48.693108+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:28.612956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.710738+0000","last_change":"2024-09-12T01:00:24.076714+0000","last_active":"2024-09-12T02:03:13.710738+0000","last_peered":"2024-09-12T02:03:13.710738+0000","last_clean":"2024-09-12T02:03:13.710738+0000","last_became_active":"2024-09-12T01:00:24.075719+0000","last_became_peered":"2024-09-12T01:00:24.075719+0000","last_unstale":"2024-09-12T02:03:13.710738+0000","last_undegraded":"2024-09-12T02:03:13.710738+0000","last_fullsized":"2024-09-12T02:03:13.710738+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:33.848488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"266'1","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.527846+0000","last_change":"2024-09-12T00:32:21.664584+0000","last_active":"2024-09-12T02:04:03.527846+0000","last_peered":"2024-09-12T02:04:03.527846+0000","last_clean":"2024-09-12T02:04:03.527846+0000","last_became_active":"2024-09-12T00:32:21.663938+0000","last_became_peered":"2024-09-12T00:32:21.663938+0000","last_unstale":"2024-09-12T02:04:03.527846+0000","last_undegraded":"2024-09-12T02:04:03.527846+0000","last_fullsized":"2024-09-12T02:04:03.527846+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:56.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"266'9","reported_seq":94,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.717245+0000","last_change":"2024-09-12T00:32:14.598635+0000","last_active":"2024-09-12T02:04:38.717245+0000","last_peered":"2024-09-12T02:04:38.717245+0000","last_clean":"2024-09-12T02:04:38.717245+0000","last_became_active":"2024-09-12T00:32:14.597094+0000","last_became_peered":"2024-09-12T00:32:14.597094+0000","last_unstale":"2024-09-12T02:04:38.717245+0000","last_undegraded":"2024-09-12T02:04:38.717245+0000","last_fullsized":"2024-09-12T02:04:38.717245+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:37.960853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":24574,"num_write":19,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"266'4","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525390+0000","last_change":"2024-09-12T00:26:23.350775+0000","last_active":"2024-09-12T02:03:53.525390+0000","last_peered":"2024-09-12T02:03:53.525390+0000","last_clean":"2024-09-12T02:03:53.525390+0000","last_became_active":"2024-09-12T00:26:23.349476+0000","last_became_peered":"2024-09-12T00:26:23.349476+0000","last_unstale":"2024-09-12T02:03:53.525390+0000","last_undegraded":"2024-09-12T02:03:53.525390+0000","last_fullsized":"2024-09-12T02:03:53.525390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:55.207200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959089+0000","last_change":"2024-09-12T01:00:24.070271+0000","last_active":"2024-09-12T02:03:23.959089+0000","last_peered":"2024-09-12T02:03:23.959089+0000","last_clean":"2024-09-12T02:03:23.959089+0000","last_became_active":"2024-09-12T01:00:24.069555+0000","last_became_peered":"2024-09-12T01:00:24.069555+0000","last_unstale":"2024-09-12T02:03:23.959089+0000","last_undegraded":"2024-09-12T02:03:23.959089+0000","last_fullsized":"2024-09-12T02:03:23.959089+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:30.440481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"266'1","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.979004+0000","last_change":"2024-09-12T00:32:21.658088+0000","last_active":"2024-09-12T02:04:38.979004+0000","last_peered":"2024-09-12T02:04:38.979004+0000","last_clean":"2024-09-12T02:04:38.979004+0000","last_became_active":"2024-09-12T00:32:21.654241+0000","last_became_peered":"2024-09-12T00:32:21.654241+0000","last_unstale":"2024-09-12T02:04:38.979004+0000","last_undegraded":"2024-09-12T02:04:38.979004+0000","last_fullsized":"2024-09-12T02:04:38.979004+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:08.083982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"266'10","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.752004+0000","last_change":"2024-09-12T00:32:14.586986+0000","last_active":"2024-09-12T02:03:58.752004+0000","last_peered":"2024-09-12T02:03:58.752004+0000","last_clean":"2024-09-12T02:03:58.752004+0000","last_became_active":"2024-09-12T00:32:14.586250+0000","last_became_peered":"2024-09-12T00:32:14.586250+0000","last_unstale":"2024-09-12T02:03:58.752004+0000","last_undegraded":"2024-09-12T02:03:58.752004+0000","last_fullsized":"2024-09-12T02:03:58.752004+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.871370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12574720,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":31734,"num_write":15,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"266'26","reported_seq":142,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967298+0000","last_change":"2024-09-12T00:26:23.334469+0000","last_active":"2024-09-12T02:03:53.967298+0000","last_peered":"2024-09-12T02:03:53.967298+0000","last_clean":"2024-09-12T02:03:53.967298+0000","last_became_active":"2024-09-12T00:26:23.327186+0000","last_became_peered":"2024-09-12T00:26:23.327186+0000","last_unstale":"2024-09-12T02:03:53.967298+0000","last_undegraded":"2024-09-12T02:03:53.967298+0000","last_fullsized":"2024-09-12T02:03:53.967298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:43.603716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.977562+0000","last_change":"2024-09-12T01:00:24.078700+0000","last_active":"2024-09-12T02:04:33.977562+0000","last_peered":"2024-09-12T02:04:33.977562+0000","last_clean":"2024-09-12T02:04:33.977562+0000","last_became_active":"2024-09-12T01:00:24.077651+0000","last_became_peered":"2024-09-12T01:00:24.077651+0000","last_unstale":"2024-09-12T02:04:33.977562+0000","last_undegraded":"2024-09-12T02:04:33.977562+0000","last_fullsized":"2024-09-12T02:04:33.977562+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"266'4","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:01:59.712373+0000","last_change":"2024-09-12T00:32:21.651210+0000","last_active":"2024-09-12T02:01:59.712373+0000","last_peered":"2024-09-12T02:01:59.712373+0000","last_clean":"2024-09-12T02:01:59.712373+0000","last_became_active":"2024-09-12T00:32:21.649921+0000","last_became_peered":"2024-09-12T00:32:21.649921+0000","last_unstale":"2024-09-12T02:01:59.712373+0000","last_undegraded":"2024-09-12T02:01:59.712373+0000","last_fullsized":"2024-09-12T02:01:59.712373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:54.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.528825+0000","last_change":"2024-09-12T00:32:14.608528+0000","last_active":"2024-09-12T02:04:08.528825+0000","last_peered":"2024-09-12T02:04:08.528825+0000","last_clean":"2024-09-12T02:04:08.528825+0000","last_became_active":"2024-09-12T00:32:14.607652+0000","last_became_peered":"2024-09-12T00:32:14.607652+0000","last_unstale":"2024-09-12T02:04:08.528825+0000","last_undegraded":"2024-09-12T02:04:08.528825+0000","last_fullsized":"2024-09-12T02:04:08.528825+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:12.098399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"266'15","reported_seq":114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967169+0000","last_change":"2024-09-12T00:26:23.343440+0000","last_active":"2024-09-12T02:03:53.967169+0000","last_peered":"2024-09-12T02:03:53.967169+0000","last_clean":"2024-09-12T02:03:53.967169+0000","last_became_active":"2024-09-12T00:26:23.339416+0000","last_became_peered":"2024-09-12T00:26:23.339416+0000","last_unstale":"2024-09-12T02:03:53.967169+0000","last_undegraded":"2024-09-12T02:03:53.967169+0000","last_fullsized":"2024-09-12T02:03:53.967169+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:20.570031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.683894+0000","last_change":"2024-09-12T01:00:24.065435+0000","last_active":"2024-09-12T02:02:53.683894+0000","last_peered":"2024-09-12T02:02:53.683894+0000","last_clean":"2024-09-12T02:02:53.683894+0000","last_became_active":"2024-09-12T01:00:24.064732+0000","last_became_peered":"2024-09-12T01:00:24.064732+0000","last_unstale":"2024-09-12T02:02:53.683894+0000","last_undegraded":"2024-09-12T02:02:53.683894+0000","last_fullsized":"2024-09-12T02:02:53.683894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:36.186270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"266'1","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.723686+0000","last_change":"2024-09-12T00:32:21.650109+0000","last_active":"2024-09-12T02:04:13.723686+0000","last_peered":"2024-09-12T02:04:13.723686+0000","last_clean":"2024-09-12T02:04:13.723686+0000","last_became_active":"2024-09-12T00:32:21.649260+0000","last_became_peered":"2024-09-12T00:32:21.649260+0000","last_unstale":"2024-09-12T02:04:13.723686+0000","last_undegraded":"2024-09-12T02:04:13.723686+0000","last_fullsized":"2024-09-12T02:04:13.723686+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:56.433116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'3","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:03.726329+0000","last_change":"2024-09-12T00:32:14.582866+0000","last_active":"2024-09-12T02:02:03.726329+0000","last_peered":"2024-09-12T02:02:03.726329+0000","last_clean":"2024-09-12T02:02:03.726329+0000","last_became_active":"2024-09-12T00:32:14.582112+0000","last_became_peered":"2024-09-12T00:32:14.582112+0000","last_unstale":"2024-09-12T02:02:03.726329+0000","last_undegraded":"2024-09-12T02:02:03.726329+0000","last_fullsized":"2024-09-12T02:02:03.726329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:42.072877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"266'88","reported_seq":399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719464+0000","last_change":"2024-09-12T00:26:23.329328+0000","last_active":"2024-09-12T02:03:53.719464+0000","last_peered":"2024-09-12T02:03:53.719464+0000","last_clean":"2024-09-12T02:03:53.719464+0000","last_became_active":"2024-09-12T00:26:23.328597+0000","last_became_peered":"2024-09-12T00:26:23.328597+0000","last_unstale":"2024-09-12T02:03:53.719464+0000","last_undegraded":"2024-09-12T02:03:53.719464+0000","last_fullsized":"2024-09-12T02:03:53.719464+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:22.412755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":416,"num_write":108,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731863+0000","last_change":"2024-09-12T01:00:24.071788+0000","last_active":"2024-09-12T02:02:53.731863+0000","last_peered":"2024-09-12T02:02:53.731863+0000","last_clean":"2024-09-12T02:02:53.731863+0000","last_became_active":"2024-09-12T01:00:24.071095+0000","last_became_peered":"2024-09-12T01:00:24.071095+0000","last_unstale":"2024-09-12T02:02:53.731863+0000","last_undegraded":"2024-09-12T02:02:53.731863+0000","last_fullsized":"2024-09-12T02:02:53.731863+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:52.669721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"266'7","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.699913+0000","last_change":"2024-09-12T00:32:21.644665+0000","last_active":"2024-09-12T02:02:23.699913+0000","last_peered":"2024-09-12T02:02:23.699913+0000","last_clean":"2024-09-12T02:02:23.699913+0000","last_became_active":"2024-09-12T00:32:21.643876+0000","last_became_peered":"2024-09-12T00:32:21.643876+0000","last_unstale":"2024-09-12T02:02:23.699913+0000","last_undegraded":"2024-09-12T02:02:23.699913+0000","last_fullsized":"2024-09-12T02:02:23.699913+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.090050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":12,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.729779+0000","last_change":"2024-09-12T00:32:14.589458+0000","last_active":"2024-09-12T02:02:18.729779+0000","last_peered":"2024-09-12T02:02:18.729779+0000","last_clean":"2024-09-12T02:02:18.729779+0000","last_became_active":"2024-09-12T00:32:14.588375+0000","last_became_peered":"2024-09-12T00:32:14.588375+0000","last_unstale":"2024-09-12T02:02:18.729779+0000","last_undegraded":"2024-09-12T02:02:18.729779+0000","last_fullsized":"2024-09-12T02:02:18.729779+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:13.114682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7178,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"266'62","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.520452+0000","last_change":"2024-09-12T00:26:23.337872+0000","last_active":"2024-09-12T02:03:33.520452+0000","last_peered":"2024-09-12T02:03:33.520452+0000","last_clean":"2024-09-12T02:03:33.520452+0000","last_became_active":"2024-09-12T00:26:23.336278+0000","last_became_peered":"2024-09-12T00:26:23.336278+0000","last_unstale":"2024-09-12T02:03:33.520452+0000","last_undegraded":"2024-09-12T02:03:33.520452+0000","last_fullsized":"2024-09-12T02:03:33.520452+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:03.462066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":248,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731956+0000","last_change":"2024-09-12T01:00:24.078804+0000","last_active":"2024-09-12T02:02:53.731956+0000","last_peered":"2024-09-12T02:02:53.731956+0000","last_clean":"2024-09-12T02:02:53.731956+0000","last_became_active":"2024-09-12T01:00:24.078120+0000","last_became_peered":"2024-09-12T01:00:24.078120+0000","last_unstale":"2024-09-12T02:02:53.731956+0000","last_undegraded":"2024-09-12T02:02:53.731956+0000","last_fullsized":"2024-09-12T02:02:53.731956+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.036331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942038+0000","last_change":"2024-09-12T00:32:21.654093+0000","last_active":"2024-09-12T02:02:23.942038+0000","last_peered":"2024-09-12T02:02:23.942038+0000","last_clean":"2024-09-12T02:02:23.942038+0000","last_became_active":"2024-09-12T00:32:21.650564+0000","last_became_peered":"2024-09-12T00:32:21.650564+0000","last_unstale":"2024-09-12T02:02:23.942038+0000","last_undegraded":"2024-09-12T02:02:23.942038+0000","last_fullsized":"2024-09-12T02:02:23.942038+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:58.696714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.713920+0000","last_change":"2024-09-12T00:32:14.600836+0000","last_active":"2024-09-12T02:02:18.713920+0000","last_peered":"2024-09-12T02:02:18.713920+0000","last_clean":"2024-09-12T02:02:18.713920+0000","last_became_active":"2024-09-12T00:32:14.600188+0000","last_became_peered":"2024-09-12T00:32:14.600188+0000","last_unstale":"2024-09-12T02:02:18.713920+0000","last_undegraded":"2024-09-12T02:02:18.713920+0000","last_fullsized":"2024-09-12T02:02:18.713920+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:48.215097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"266'14","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.686029+0000","last_change":"2024-09-12T00:26:23.325628+0000","last_active":"2024-09-12T02:03:03.686029+0000","last_peered":"2024-09-12T02:03:03.686029+0000","last_clean":"2024-09-12T02:03:03.686029+0000","last_became_active":"2024-09-12T00:26:23.325067+0000","last_became_peered":"2024-09-12T00:26:23.325067+0000","last_unstale":"2024-09-12T02:03:03.686029+0000","last_undegraded":"2024-09-12T02:03:03.686029+0000","last_fullsized":"2024-09-12T02:03:03.686029+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.348834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690730+0000","last_change":"2024-09-12T01:00:24.075536+0000","last_active":"2024-09-12T02:03:23.690730+0000","last_peered":"2024-09-12T02:03:23.690730+0000","last_clean":"2024-09-12T02:03:23.690730+0000","last_became_active":"2024-09-12T01:00:24.075148+0000","last_became_peered":"2024-09-12T01:00:24.075148+0000","last_unstale":"2024-09-12T02:03:23.690730+0000","last_undegraded":"2024-09-12T02:03:23.690730+0000","last_fullsized":"2024-09-12T02:03:23.690730+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:59.023799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"266'1","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.972316+0000","last_change":"2024-09-12T00:32:21.658733+0000","last_active":"2024-09-12T02:04:13.972316+0000","last_peered":"2024-09-12T02:04:13.972316+0000","last_clean":"2024-09-12T02:04:13.972316+0000","last_became_active":"2024-09-12T00:32:21.654214+0000","last_became_peered":"2024-09-12T00:32:21.654214+0000","last_unstale":"2024-09-12T02:04:13.972316+0000","last_undegraded":"2024-09-12T02:04:13.972316+0000","last_fullsized":"2024-09-12T02:04:13.972316+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.587733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'5","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735335+0000","last_change":"2024-09-12T00:32:14.586921+0000","last_active":"2024-09-12T02:03:24.735335+0000","last_peered":"2024-09-12T02:03:24.735335+0000","last_clean":"2024-09-12T02:03:24.735335+0000","last_became_active":"2024-09-12T00:32:14.586101+0000","last_became_peered":"2024-09-12T00:32:14.586101+0000","last_unstale":"2024-09-12T02:03:24.735335+0000","last_undegraded":"2024-09-12T02:03:24.735335+0000","last_fullsized":"2024-09-12T02:03:24.735335+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:16.213342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"266'18","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.724550+0000","last_change":"2024-09-12T00:26:23.351546+0000","last_active":"2024-09-12T02:03:03.724550+0000","last_peered":"2024-09-12T02:03:03.724550+0000","last_clean":"2024-09-12T02:03:03.724550+0000","last_became_active":"2024-09-12T00:26:23.338890+0000","last_became_peered":"2024-09-12T00:26:23.338890+0000","last_unstale":"2024-09-12T02:03:03.724550+0000","last_undegraded":"2024-09-12T02:03:03.724550+0000","last_fullsized":"2024-09-12T02:03:03.724550+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:29.634760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.701374+0000","last_change":"2024-09-12T01:00:24.076901+0000","last_active":"2024-09-12T02:03:23.701374+0000","last_peered":"2024-09-12T02:03:23.701374+0000","last_clean":"2024-09-12T02:03:23.701374+0000","last_became_active":"2024-09-12T01:00:24.076081+0000","last_became_peered":"2024-09-12T01:00:24.076081+0000","last_unstale":"2024-09-12T02:03:23.701374+0000","last_undegraded":"2024-09-12T02:03:23.701374+0000","last_fullsized":"2024-09-12T02:03:23.701374+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:03.511093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'5","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.962875+0000","last_change":"2024-09-12T00:32:21.665472+0000","last_active":"2024-09-12T02:03:38.962875+0000","last_peered":"2024-09-12T02:03:38.962875+0000","last_clean":"2024-09-12T02:03:38.962875+0000","last_became_active":"2024-09-12T00:32:21.659460+0000","last_became_peered":"2024-09-12T00:32:21.659460+0000","last_unstale":"2024-09-12T02:03:38.962875+0000","last_undegraded":"2024-09-12T02:03:38.962875+0000","last_fullsized":"2024-09-12T02:03:38.962875+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:34.362543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"266'1","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.749843+0000","last_change":"2024-09-12T00:32:14.595556+0000","last_active":"2024-09-12T02:04:08.749843+0000","last_peered":"2024-09-12T02:04:08.749843+0000","last_clean":"2024-09-12T02:04:08.749843+0000","last_became_active":"2024-09-12T00:32:14.594973+0000","last_became_peered":"2024-09-12T00:32:14.594973+0000","last_unstale":"2024-09-12T02:04:08.749843+0000","last_undegraded":"2024-09-12T02:04:08.749843+0000","last_fullsized":"2024-09-12T02:04:08.749843+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":200,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.953162+0000","last_change":"2024-09-12T00:26:23.344345+0000","last_active":"2024-09-12T02:03:03.953162+0000","last_peered":"2024-09-12T02:03:03.953162+0000","last_clean":"2024-09-12T02:03:03.953162+0000","last_became_active":"2024-09-12T00:26:23.338462+0000","last_became_peered":"2024-09-12T00:26:23.338462+0000","last_unstale":"2024-09-12T02:03:03.953162+0000","last_undegraded":"2024-09-12T02:03:03.953162+0000","last_fullsized":"2024-09-12T02:03:03.953162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:51.275824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":170,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738756+0000","last_change":"2024-09-12T01:00:24.077452+0000","last_active":"2024-09-12T02:03:23.738756+0000","last_peered":"2024-09-12T02:03:23.738756+0000","last_clean":"2024-09-12T02:03:23.738756+0000","last_became_active":"2024-09-12T01:00:24.070957+0000","last_became_peered":"2024-09-12T01:00:24.070957+0000","last_unstale":"2024-09-12T02:03:23.738756+0000","last_undegraded":"2024-09-12T02:03:23.738756+0000","last_fullsized":"2024-09-12T02:03:23.738756+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:02.724541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"266'1","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.972451+0000","last_change":"2024-09-12T00:32:21.665635+0000","last_active":"2024-09-12T02:04:13.972451+0000","last_peered":"2024-09-12T02:04:13.972451+0000","last_clean":"2024-09-12T02:04:13.972451+0000","last_became_active":"2024-09-12T00:32:21.665036+0000","last_became_peered":"2024-09-12T00:32:21.665036+0000","last_unstale":"2024-09-12T02:04:13.972451+0000","last_undegraded":"2024-09-12T02:04:13.972451+0000","last_fullsized":"2024-09-12T02:04:13.972451+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.207114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2064,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"266'1","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.709930+0000","last_change":"2024-09-12T00:32:14.599371+0000","last_active":"2024-09-12T02:04:03.709930+0000","last_peered":"2024-09-12T02:04:03.709930+0000","last_clean":"2024-09-12T02:04:03.709930+0000","last_became_active":"2024-09-12T00:32:14.597944+0000","last_became_peered":"2024-09-12T00:32:14.597944+0000","last_unstale":"2024-09-12T02:04:03.709930+0000","last_undegraded":"2024-09-12T02:04:03.709930+0000","last_fullsized":"2024-09-12T02:04:03.709930+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:39.404510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2064,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"266'38","reported_seq":167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.696938+0000","last_change":"2024-09-12T00:26:23.318556+0000","last_active":"2024-09-12T02:03:03.696938+0000","last_peered":"2024-09-12T02:03:03.696938+0000","last_clean":"2024-09-12T02:03:03.696938+0000","last_became_active":"2024-09-12T00:26:23.317790+0000","last_became_peered":"2024-09-12T00:26:23.317790+0000","last_unstale":"2024-09-12T02:03:03.696938+0000","last_undegraded":"2024-09-12T02:03:03.696938+0000","last_fullsized":"2024-09-12T02:03:03.696938+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":107,"num_write":80,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735210+0000","last_change":"2024-09-12T01:00:24.078191+0000","last_active":"2024-09-12T02:03:24.735210+0000","last_peered":"2024-09-12T02:03:24.735210+0000","last_clean":"2024-09-12T02:03:24.735210+0000","last_became_active":"2024-09-12T01:00:24.077509+0000","last_became_peered":"2024-09-12T01:00:24.077509+0000","last_unstale":"2024-09-12T02:03:24.735210+0000","last_undegraded":"2024-09-12T02:03:24.735210+0000","last_fullsized":"2024-09-12T02:03:24.735210+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.532459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"266'1","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.755227+0000","last_change":"2024-09-12T00:32:21.652772+0000","last_active":"2024-09-12T02:04:13.755227+0000","last_peered":"2024-09-12T02:04:13.755227+0000","last_clean":"2024-09-12T02:04:13.755227+0000","last_became_active":"2024-09-12T00:32:21.644753+0000","last_became_peered":"2024-09-12T00:32:21.644753+0000","last_unstale":"2024-09-12T02:04:13.755227+0000","last_undegraded":"2024-09-12T02:04:13.755227+0000","last_fullsized":"2024-09-12T02:04:13.755227+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:09.209891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3080,"num_write":1,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"266'1","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.529066+0000","last_change":"2024-09-12T00:32:14.600221+0000","last_active":"2024-09-12T02:04:08.529066+0000","last_peered":"2024-09-12T02:04:08.529066+0000","last_clean":"2024-09-12T02:04:08.529066+0000","last_became_active":"2024-09-12T00:32:14.599452+0000","last_became_peered":"2024-09-12T00:32:14.599452+0000","last_unstale":"2024-09-12T02:04:08.529066+0000","last_undegraded":"2024-09-12T02:04:08.529066+0000","last_fullsized":"2024-09-12T02:04:08.529066+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:29.978923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"266'136","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.724784+0000","last_change":"2024-09-12T00:26:23.321368+0000","last_active":"2024-09-12T02:02:23.724784+0000","last_peered":"2024-09-12T02:02:23.724784+0000","last_clean":"2024-09-12T02:02:23.724784+0000","last_became_active":"2024-09-12T00:26:23.320613+0000","last_became_peered":"2024-09-12T00:26:23.320613+0000","last_unstale":"2024-09-12T02:02:23.724784+0000","last_undegraded":"2024-09-12T02:02:23.724784+0000","last_fullsized":"2024-09-12T02:02:23.724784+0000","mapping_epoch":253,"log_start":"263'100","ondisk_log_start":"263'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:54.209079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":872,"num_read_kb":592,"num_write":184,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956392+0000","last_change":"2024-09-12T01:00:24.061484+0000","last_active":"2024-09-12T02:03:13.956392+0000","last_peered":"2024-09-12T02:03:13.956392+0000","last_clean":"2024-09-12T02:03:13.956392+0000","last_became_active":"2024-09-12T01:00:24.060699+0000","last_became_peered":"2024-09-12T01:00:24.060699+0000","last_unstale":"2024-09-12T02:03:13.956392+0000","last_undegraded":"2024-09-12T02:03:13.956392+0000","last_fullsized":"2024-09-12T02:03:13.956392+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:39.025638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690685+0000","last_change":"2024-09-12T00:32:21.652868+0000","last_active":"2024-09-12T02:03:23.690685+0000","last_peered":"2024-09-12T02:03:23.690685+0000","last_clean":"2024-09-12T02:03:23.690685+0000","last_became_active":"2024-09-12T00:32:21.652122+0000","last_became_peered":"2024-09-12T00:32:21.652122+0000","last_unstale":"2024-09-12T02:03:23.690685+0000","last_undegraded":"2024-09-12T02:03:23.690685+0000","last_fullsized":"2024-09-12T02:03:23.690685+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:49.993050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"266'6","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.743127+0000","last_change":"2024-09-12T00:32:14.592680+0000","last_active":"2024-09-12T02:03:18.743127+0000","last_peered":"2024-09-12T02:03:18.743127+0000","last_clean":"2024-09-12T02:03:18.743127+0000","last_became_active":"2024-09-12T00:32:14.591921+0000","last_became_peered":"2024-09-12T00:32:14.591921+0000","last_unstale":"2024-09-12T02:03:18.743127+0000","last_undegraded":"2024-09-12T02:03:18.743127+0000","last_fullsized":"2024-09-12T02:03:18.743127+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:15.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":3114,"num_write":11,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"266'28","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753409+0000","last_change":"2024-09-12T00:26:23.323596+0000","last_active":"2024-09-12T02:04:23.753409+0000","last_peered":"2024-09-12T02:04:23.753409+0000","last_clean":"2024-09-12T02:04:23.753409+0000","last_became_active":"2024-09-12T00:26:23.322866+0000","last_became_peered":"2024-09-12T00:26:23.322866+0000","last_unstale":"2024-09-12T02:04:23.753409+0000","last_undegraded":"2024-09-12T02:04:23.753409+0000","last_fullsized":"2024-09-12T02:04:23.753409+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:51.001961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727306+0000","last_change":"2024-09-12T01:00:24.064920+0000","last_active":"2024-09-12T02:03:13.727306+0000","last_peered":"2024-09-12T02:03:13.727306+0000","last_clean":"2024-09-12T02:03:13.727306+0000","last_became_active":"2024-09-12T01:00:24.064203+0000","last_became_peered":"2024-09-12T01:00:24.064203+0000","last_unstale":"2024-09-12T02:03:13.727306+0000","last_undegraded":"2024-09-12T02:03:13.727306+0000","last_fullsized":"2024-09-12T02:03:13.727306+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:14.355731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"266'4","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690613+0000","last_change":"2024-09-12T00:32:21.660277+0000","last_active":"2024-09-12T02:03:23.690613+0000","last_peered":"2024-09-12T02:03:23.690613+0000","last_clean":"2024-09-12T02:03:23.690613+0000","last_became_active":"2024-09-12T00:32:21.659437+0000","last_became_peered":"2024-09-12T00:32:21.659437+0000","last_unstale":"2024-09-12T02:03:23.690613+0000","last_undegraded":"2024-09-12T02:03:23.690613+0000","last_fullsized":"2024-09-12T02:03:23.690613+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:42.910621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9428992,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12276,"num_write":9,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"266'8","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956092+0000","last_change":"2024-09-12T00:32:14.599370+0000","last_active":"2024-09-12T02:03:13.956092+0000","last_peered":"2024-09-12T02:03:13.956092+0000","last_clean":"2024-09-12T02:03:13.956092+0000","last_became_active":"2024-09-12T00:32:14.597986+0000","last_became_peered":"2024-09-12T00:32:14.597986+0000","last_unstale":"2024-09-12T02:03:13.956092+0000","last_undegraded":"2024-09-12T02:03:13.956092+0000","last_fullsized":"2024-09-12T02:03:13.956092+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:36.841276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":11262,"num_write":13,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"266'46","reported_seq":199,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.532349+0000","last_change":"2024-09-12T00:26:23.336761+0000","last_active":"2024-09-12T02:04:23.532349+0000","last_peered":"2024-09-12T02:04:23.532349+0000","last_clean":"2024-09-12T02:04:23.532349+0000","last_became_active":"2024-09-12T00:26:23.336010+0000","last_became_peered":"2024-09-12T00:26:23.336010+0000","last_unstale":"2024-09-12T02:04:23.532349+0000","last_undegraded":"2024-09-12T02:04:23.532349+0000","last_fullsized":"2024-09-12T02:04:23.532349+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:52.664889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.523057+0000","last_change":"2024-09-12T01:00:24.074232+0000","last_active":"2024-09-12T02:03:43.523057+0000","last_peered":"2024-09-12T02:03:43.523057+0000","last_clean":"2024-09-12T02:03:43.523057+0000","last_became_active":"2024-09-12T01:00:24.061624+0000","last_became_peered":"2024-09-12T01:00:24.061624+0000","last_unstale":"2024-09-12T02:03:43.523057+0000","last_undegraded":"2024-09-12T02:03:43.523057+0000","last_fullsized":"2024-09-12T02:03:43.523057+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:30.381075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'7","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959211+0000","last_change":"2024-09-12T00:32:21.667593+0000","last_active":"2024-09-12T02:03:23.959211+0000","last_peered":"2024-09-12T02:03:23.959211+0000","last_clean":"2024-09-12T02:03:23.959211+0000","last_became_active":"2024-09-12T00:32:21.666101+0000","last_became_peered":"2024-09-12T00:32:21.666101+0000","last_unstale":"2024-09-12T02:03:23.959211+0000","last_undegraded":"2024-09-12T02:03:23.959211+0000","last_fullsized":"2024-09-12T02:03:23.959211+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:18.302518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3603,"num_write":12,"num_write_kb":1553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"266'2","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.711894+0000","last_change":"2024-09-12T00:32:14.580110+0000","last_active":"2024-09-12T02:03:18.711894+0000","last_peered":"2024-09-12T02:03:18.711894+0000","last_clean":"2024-09-12T02:03:18.711894+0000","last_became_active":"2024-09-12T00:32:14.579366+0000","last_became_peered":"2024-09-12T00:32:14.579366+0000","last_unstale":"2024-09-12T02:03:18.711894+0000","last_undegraded":"2024-09-12T02:03:18.711894+0000","last_fullsized":"2024-09-12T02:03:18.711894+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.632825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'8","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.757917+0000","last_change":"2024-09-12T00:26:23.323680+0000","last_active":"2024-09-12T02:04:23.757917+0000","last_peered":"2024-09-12T02:04:23.757917+0000","last_clean":"2024-09-12T02:04:23.757917+0000","last_became_active":"2024-09-12T00:26:23.322841+0000","last_became_peered":"2024-09-12T00:26:23.322841+0000","last_unstale":"2024-09-12T02:04:23.757917+0000","last_undegraded":"2024-09-12T02:04:23.757917+0000","last_fullsized":"2024-09-12T02:04:23.757917+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956312+0000","last_change":"2024-09-12T01:00:24.060507+0000","last_active":"2024-09-12T02:03:13.956312+0000","last_peered":"2024-09-12T02:03:13.956312+0000","last_clean":"2024-09-12T02:03:13.956312+0000","last_became_active":"2024-09-12T01:00:24.057061+0000","last_became_peered":"2024-09-12T01:00:24.057061+0000","last_unstale":"2024-09-12T02:03:13.956312+0000","last_undegraded":"2024-09-12T02:03:13.956312+0000","last_fullsized":"2024-09-12T02:03:13.956312+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:07.370347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"266'3","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.712976+0000","last_change":"2024-09-12T00:32:21.647911+0000","last_active":"2024-09-12T02:03:23.712976+0000","last_peered":"2024-09-12T02:03:23.712976+0000","last_clean":"2024-09-12T02:03:23.712976+0000","last_became_active":"2024-09-12T00:32:21.646690+0000","last_became_peered":"2024-09-12T00:32:21.646690+0000","last_unstale":"2024-09-12T02:03:23.712976+0000","last_undegraded":"2024-09-12T02:03:23.712976+0000","last_fullsized":"2024-09-12T02:03:23.712976+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:03.430085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1091931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":2096,"num_write":3,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:14.733091+0000","last_change":"2024-09-12T00:32:14.577083+0000","last_active":"2024-09-12T02:03:14.733091+0000","last_peered":"2024-09-12T02:03:14.733091+0000","last_clean":"2024-09-12T02:03:14.733091+0000","last_became_active":"2024-09-12T00:32:14.576353+0000","last_became_peered":"2024-09-12T00:32:14.576353+0000","last_unstale":"2024-09-12T02:03:14.733091+0000","last_undegraded":"2024-09-12T02:03:14.733091+0000","last_fullsized":"2024-09-12T02:03:14.733091+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:17.483406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"266'19","reported_seq":129,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974634+0000","last_change":"2024-09-12T00:26:23.342320+0000","last_active":"2024-09-12T02:04:23.974634+0000","last_peered":"2024-09-12T02:04:23.974634+0000","last_clean":"2024-09-12T02:04:23.974634+0000","last_became_active":"2024-09-12T00:26:23.334078+0000","last_became_peered":"2024-09-12T00:26:23.334078+0000","last_unstale":"2024-09-12T02:04:23.974634+0000","last_undegraded":"2024-09-12T02:04:23.974634+0000","last_fullsized":"2024-09-12T02:04:23.974634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.869261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":39,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:28.702468+0000","last_change":"2024-09-12T01:00:24.076331+0000","last_active":"2024-09-12T02:03:28.702468+0000","last_peered":"2024-09-12T02:03:28.702468+0000","last_clean":"2024-09-12T02:03:28.702468+0000","last_became_active":"2024-09-12T01:00:24.075944+0000","last_became_peered":"2024-09-12T01:00:24.075944+0000","last_unstale":"2024-09-12T02:03:28.702468+0000","last_undegraded":"2024-09-12T02:03:28.702468+0000","last_fullsized":"2024-09-12T02:03:28.702468+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.174854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"266'3","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942289+0000","last_change":"2024-09-12T00:32:21.653900+0000","last_active":"2024-09-12T02:02:23.942289+0000","last_peered":"2024-09-12T02:02:23.942289+0000","last_clean":"2024-09-12T02:02:23.942289+0000","last_became_active":"2024-09-12T00:32:21.653054+0000","last_became_peered":"2024-09-12T00:32:21.653054+0000","last_unstale":"2024-09-12T02:02:23.942289+0000","last_undegraded":"2024-09-12T02:02:23.942289+0000","last_fullsized":"2024-09-12T02:02:23.942289+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:26.095259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8207,"num_write":3,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"266'9","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.723717+0000","last_change":"2024-09-12T00:32:14.597055+0000","last_active":"2024-09-12T02:02:18.723717+0000","last_peered":"2024-09-12T02:02:18.723717+0000","last_clean":"2024-09-12T02:02:18.723717+0000","last_became_active":"2024-09-12T00:32:14.596393+0000","last_became_peered":"2024-09-12T00:32:14.596393+0000","last_unstale":"2024-09-12T02:02:18.723717+0000","last_undegraded":"2024-09-12T02:02:18.723717+0000","last_fullsized":"2024-09-12T02:02:18.723717+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:35.143044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":9234,"num_write":9,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"266'13","reported_seq":109,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959403+0000","last_change":"2024-09-12T00:26:23.354584+0000","last_active":"2024-09-12T02:03:23.959403+0000","last_peered":"2024-09-12T02:03:23.959403+0000","last_clean":"2024-09-12T02:03:23.959403+0000","last_became_active":"2024-09-12T00:26:23.353590+0000","last_became_peered":"2024-09-12T00:26:23.353590+0000","last_unstale":"2024-09-12T02:03:23.959403+0000","last_undegraded":"2024-09-12T02:03:23.959403+0000","last_fullsized":"2024-09-12T02:03:23.959403+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:36.184285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":34,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738884+0000","last_change":"2024-09-12T01:00:24.070343+0000","last_active":"2024-09-12T02:03:23.738884+0000","last_peered":"2024-09-12T02:03:23.738884+0000","last_clean":"2024-09-12T02:03:23.738884+0000","last_became_active":"2024-09-12T01:00:24.069491+0000","last_became_peered":"2024-09-12T01:00:24.069491+0000","last_unstale":"2024-09-12T02:03:23.738884+0000","last_undegraded":"2024-09-12T02:03:23.738884+0000","last_fullsized":"2024-09-12T02:03:23.738884+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:08.859472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942173+0000","last_change":"2024-09-12T00:32:21.668898+0000","last_active":"2024-09-12T02:02:23.942173+0000","last_peered":"2024-09-12T02:02:23.942173+0000","last_clean":"2024-09-12T02:02:23.942173+0000","last_became_active":"2024-09-12T00:32:21.668268+0000","last_became_peered":"2024-09-12T00:32:21.668268+0000","last_unstale":"2024-09-12T02:02:23.942173+0000","last_undegraded":"2024-09-12T02:02:23.942173+0000","last_fullsized":"2024-09-12T02:02:23.942173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:44.371260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"266'5","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.714942+0000","last_change":"2024-09-12T00:32:14.610770+0000","last_active":"2024-09-12T02:04:28.714942+0000","last_peered":"2024-09-12T02:04:28.714942+0000","last_clean":"2024-09-12T02:04:28.714942+0000","last_became_active":"2024-09-12T00:32:14.610187+0000","last_became_peered":"2024-09-12T00:32:14.610187+0000","last_unstale":"2024-09-12T02:04:28.714942+0000","last_undegraded":"2024-09-12T02:04:28.714942+0000","last_fullsized":"2024-09-12T02:04:28.714942+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:04.103920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2577,"num_write":10,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:09.732099+0000","last_change":"2024-09-12T00:26:23.333218+0000","last_active":"2024-09-12T02:03:09.732099+0000","last_peered":"2024-09-12T02:03:09.732099+0000","last_clean":"2024-09-12T02:03:09.732099+0000","last_became_active":"2024-09-12T00:26:23.328238+0000","last_became_peered":"2024-09-12T00:26:23.328238+0000","last_unstale":"2024-09-12T02:03:09.732099+0000","last_undegraded":"2024-09-12T02:03:09.732099+0000","last_fullsized":"2024-09-12T02:03:09.732099+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:08.447428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.710796+0000","last_change":"2024-09-12T01:00:24.075014+0000","last_active":"2024-09-12T02:03:13.710796+0000","last_peered":"2024-09-12T02:03:13.710796+0000","last_clean":"2024-09-12T02:03:13.710796+0000","last_became_active":"2024-09-12T01:00:24.074237+0000","last_became_peered":"2024-09-12T01:00:24.074237+0000","last_unstale":"2024-09-12T02:03:13.710796+0000","last_undegraded":"2024-09-12T02:03:13.710796+0000","last_fullsized":"2024-09-12T02:03:13.710796+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:45.410941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.683956+0000","last_change":"2024-09-12T00:32:21.643228+0000","last_active":"2024-09-12T02:02:53.683956+0000","last_peered":"2024-09-12T02:02:53.683956+0000","last_clean":"2024-09-12T02:02:53.683956+0000","last_became_active":"2024-09-12T00:32:21.642517+0000","last_became_peered":"2024-09-12T00:32:21.642517+0000","last_unstale":"2024-09-12T02:02:53.683956+0000","last_undegraded":"2024-09-12T02:02:53.683956+0000","last_fullsized":"2024-09-12T02:02:53.683956+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:33.274779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"266'1","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.714036+0000","last_change":"2024-09-12T00:32:14.608254+0000","last_active":"2024-09-12T02:02:18.714036+0000","last_peered":"2024-09-12T02:02:18.714036+0000","last_clean":"2024-09-12T02:02:18.714036+0000","last_became_active":"2024-09-12T00:32:14.607520+0000","last_became_peered":"2024-09-12T00:32:14.607520+0000","last_unstale":"2024-09-12T02:02:18.714036+0000","last_undegraded":"2024-09-12T02:02:18.714036+0000","last_fullsized":"2024-09-12T02:02:18.714036+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:55.311964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"266'27","reported_seq":149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.709720+0000","last_change":"2024-09-12T00:26:23.314752+0000","last_active":"2024-09-12T02:03:08.709720+0000","last_peered":"2024-09-12T02:03:08.709720+0000","last_clean":"2024-09-12T02:03:08.709720+0000","last_became_active":"2024-09-12T00:26:23.313697+0000","last_became_peered":"2024-09-12T00:26:23.313697+0000","last_unstale":"2024-09-12T02:03:08.709720+0000","last_undegraded":"2024-09-12T02:03:08.709720+0000","last_fullsized":"2024-09-12T02:03:08.709720+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:17.759882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.736399+0000","last_change":"2024-09-12T01:00:24.077672+0000","last_active":"2024-09-12T02:03:13.736399+0000","last_peered":"2024-09-12T02:03:13.736399+0000","last_clean":"2024-09-12T02:03:13.736399+0000","last_became_active":"2024-09-12T01:00:24.072931+0000","last_became_peered":"2024-09-12T01:00:24.072931+0000","last_unstale":"2024-09-12T02:03:13.736399+0000","last_undegraded":"2024-09-12T02:03:13.736399+0000","last_fullsized":"2024-09-12T02:03:13.736399+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:03.310383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"266'7","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942349+0000","last_change":"2024-09-12T00:32:21.649878+0000","last_active":"2024-09-12T02:02:23.942349+0000","last_peered":"2024-09-12T02:02:23.942349+0000","last_clean":"2024-09-12T02:02:23.942349+0000","last_became_active":"2024-09-12T00:32:21.641431+0000","last_became_peered":"2024-09-12T00:32:21.641431+0000","last_unstale":"2024-09-12T02:02:23.942349+0000","last_undegraded":"2024-09-12T02:02:23.942349+0000","last_fullsized":"2024-09-12T02:02:23.942349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:17.569247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":20470,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681384+0000","last_change":"2024-09-12T00:32:14.597040+0000","last_active":"2024-09-12T02:02:43.681384+0000","last_peered":"2024-09-12T02:02:43.681384+0000","last_clean":"2024-09-12T02:02:43.681384+0000","last_became_active":"2024-09-12T00:32:14.596263+0000","last_became_peered":"2024-09-12T00:32:14.596263+0000","last_unstale":"2024-09-12T02:02:43.681384+0000","last_undegraded":"2024-09-12T02:02:43.681384+0000","last_fullsized":"2024-09-12T02:02:43.681384+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:09.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"266'66","reported_seq":265,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.698119+0000","last_change":"2024-09-12T00:26:23.328307+0000","last_active":"2024-09-12T02:03:08.698119+0000","last_peered":"2024-09-12T02:03:08.698119+0000","last_clean":"2024-09-12T02:03:08.698119+0000","last_became_active":"2024-09-12T00:26:23.327784+0000","last_became_peered":"2024-09-12T00:26:23.327784+0000","last_unstale":"2024-09-12T02:03:08.698119+0000","last_undegraded":"2024-09-12T02:03:08.698119+0000","last_fullsized":"2024-09-12T02:03:08.698119+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:59.830797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":253,"num_write":117,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959347+0000","last_change":"2024-09-12T01:00:24.067841+0000","last_active":"2024-09-12T02:03:23.959347+0000","last_peered":"2024-09-12T02:03:23.959347+0000","last_clean":"2024-09-12T02:03:23.959347+0000","last_became_active":"2024-09-12T01:00:24.066842+0000","last_became_peered":"2024-09-12T01:00:24.066842+0000","last_unstale":"2024-09-12T02:03:23.959347+0000","last_undegraded":"2024-09-12T02:03:23.959347+0000","last_fullsized":"2024-09-12T02:03:23.959347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:36.376146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.744288+0000","last_change":"2024-09-12T00:32:21.667714+0000","last_active":"2024-09-12T02:03:23.744288+0000","last_peered":"2024-09-12T02:03:23.744288+0000","last_clean":"2024-09-12T02:03:23.744288+0000","last_became_active":"2024-09-12T00:32:21.667149+0000","last_became_peered":"2024-09-12T00:32:21.667149+0000","last_unstale":"2024-09-12T02:03:23.744288+0000","last_undegraded":"2024-09-12T02:03:23.744288+0000","last_fullsized":"2024-09-12T02:03:23.744288+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:34.141900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.728379+0000","last_change":"2024-09-12T00:32:14.601942+0000","last_active":"2024-09-12T02:03:18.728379+0000","last_peered":"2024-09-12T02:03:18.728379+0000","last_clean":"2024-09-12T02:03:18.728379+0000","last_became_active":"2024-09-12T00:32:14.601148+0000","last_became_peered":"2024-09-12T00:32:14.601148+0000","last_unstale":"2024-09-12T02:03:18.728379+0000","last_undegraded":"2024-09-12T02:03:18.728379+0000","last_fullsized":"2024-09-12T02:03:18.728379+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:16.003152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"266'39","reported_seq":182,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.725801+0000","last_change":"2024-09-12T00:26:23.318410+0000","last_active":"2024-09-12T02:03:08.725801+0000","last_peered":"2024-09-12T02:03:08.725801+0000","last_clean":"2024-09-12T02:03:08.725801+0000","last_became_active":"2024-09-12T00:26:23.317880+0000","last_became_peered":"2024-09-12T00:26:23.317880+0000","last_unstale":"2024-09-12T02:03:08.725801+0000","last_undegraded":"2024-09-12T02:03:08.725801+0000","last_fullsized":"2024-09-12T02:03:08.725801+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:35.423826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.742402+0000","last_change":"2024-09-12T01:00:24.086998+0000","last_active":"2024-09-12T02:03:38.742402+0000","last_peered":"2024-09-12T02:03:38.742402+0000","last_clean":"2024-09-12T02:03:38.742402+0000","last_became_active":"2024-09-12T01:00:24.086101+0000","last_became_peered":"2024-09-12T01:00:24.086101+0000","last_unstale":"2024-09-12T02:03:38.742402+0000","last_undegraded":"2024-09-12T02:03:38.742402+0000","last_fullsized":"2024-09-12T02:03:38.742402+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.433366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738790+0000","last_change":"2024-09-12T00:32:21.639641+0000","last_active":"2024-09-12T02:03:23.738790+0000","last_peered":"2024-09-12T02:03:23.738790+0000","last_clean":"2024-09-12T02:03:23.738790+0000","last_became_active":"2024-09-12T00:32:21.634440+0000","last_became_peered":"2024-09-12T00:32:21.634440+0000","last_unstale":"2024-09-12T02:03:23.738790+0000","last_undegraded":"2024-09-12T02:03:23.738790+0000","last_fullsized":"2024-09-12T02:03:23.738790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:52.190306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"266'3","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.688344+0000","last_change":"2024-09-12T00:32:14.596514+0000","last_active":"2024-09-12T02:03:13.688344+0000","last_peered":"2024-09-12T02:03:13.688344+0000","last_clean":"2024-09-12T02:03:13.688344+0000","last_became_active":"2024-09-12T00:32:14.595782+0000","last_became_peered":"2024-09-12T00:32:14.595782+0000","last_unstale":"2024-09-12T02:03:13.688344+0000","last_undegraded":"2024-09-12T02:03:13.688344+0000","last_fullsized":"2024-09-12T02:03:13.688344+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:40.885479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8384512,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":8,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":165,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.750980+0000","last_change":"2024-09-12T00:26:23.324857+0000","last_active":"2024-09-12T02:04:13.750980+0000","last_peered":"2024-09-12T02:04:13.750980+0000","last_clean":"2024-09-12T02:04:13.750980+0000","last_became_active":"2024-09-12T00:26:23.324140+0000","last_became_peered":"2024-09-12T00:26:23.324140+0000","last_unstale":"2024-09-12T02:04:13.750980+0000","last_undegraded":"2024-09-12T02:04:13.750980+0000","last_fullsized":"2024-09-12T02:04:13.750980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:21.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":114,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738926+0000","last_change":"2024-09-12T01:00:24.081545+0000","last_active":"2024-09-12T02:03:23.738926+0000","last_peered":"2024-09-12T02:03:23.738926+0000","last_clean":"2024-09-12T02:03:23.738926+0000","last_became_active":"2024-09-12T01:00:24.080855+0000","last_became_peered":"2024-09-12T01:00:24.080855+0000","last_unstale":"2024-09-12T02:03:23.738926+0000","last_undegraded":"2024-09-12T02:03:23.738926+0000","last_fullsized":"2024-09-12T02:03:23.738926+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:06.572347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'4","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.676309+0000","last_change":"2024-09-12T00:32:21.649120+0000","last_active":"2024-09-12T02:02:23.676309+0000","last_peered":"2024-09-12T02:02:23.676309+0000","last_clean":"2024-09-12T02:02:23.676309+0000","last_became_active":"2024-09-12T00:32:21.648333+0000","last_became_peered":"2024-09-12T00:32:21.648333+0000","last_unstale":"2024-09-12T02:02:23.676309+0000","last_undegraded":"2024-09-12T02:02:23.676309+0000","last_fullsized":"2024-09-12T02:02:23.676309+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:27.155415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"266'2","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:48.524114+0000","last_change":"2024-09-12T00:32:14.600607+0000","last_active":"2024-09-12T02:03:48.524114+0000","last_peered":"2024-09-12T02:03:48.524114+0000","last_clean":"2024-09-12T02:03:48.524114+0000","last_became_active":"2024-09-12T00:32:14.592875+0000","last_became_peered":"2024-09-12T00:32:14.592875+0000","last_unstale":"2024-09-12T02:03:48.524114+0000","last_undegraded":"2024-09-12T02:03:48.524114+0000","last_fullsized":"2024-09-12T02:03:48.524114+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:09.233319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5124,"num_write":2,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"266'15","reported_seq":118,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.966977+0000","last_change":"2024-09-12T00:26:23.325693+0000","last_active":"2024-09-12T02:03:53.966977+0000","last_peered":"2024-09-12T02:03:53.966977+0000","last_clean":"2024-09-12T02:03:53.966977+0000","last_became_active":"2024-09-12T00:26:23.324884+0000","last_became_peered":"2024-09-12T00:26:23.324884+0000","last_unstale":"2024-09-12T02:03:53.966977+0000","last_undegraded":"2024-09-12T02:03:53.966977+0000","last_fullsized":"2024-09-12T02:03:53.966977+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:53.038478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.517888+0000","last_change":"2024-09-12T01:00:24.062624+0000","last_active":"2024-09-12T02:03:23.517888+0000","last_peered":"2024-09-12T02:03:23.517888+0000","last_clean":"2024-09-12T02:03:23.517888+0000","last_became_active":"2024-09-12T01:00:24.061882+0000","last_became_peered":"2024-09-12T01:00:24.061882+0000","last_unstale":"2024-09-12T02:03:23.517888+0000","last_undegraded":"2024-09-12T02:03:23.517888+0000","last_fullsized":"2024-09-12T02:03:23.517888+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:52.723554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'4","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743502+0000","last_change":"2024-09-12T00:32:21.668310+0000","last_active":"2024-09-12T02:03:43.743502+0000","last_peered":"2024-09-12T02:03:43.743502+0000","last_clean":"2024-09-12T02:03:43.743502+0000","last_became_active":"2024-09-12T00:32:21.667346+0000","last_became_peered":"2024-09-12T00:32:21.667346+0000","last_unstale":"2024-09-12T02:03:43.743502+0000","last_undegraded":"2024-09-12T02:03:43.743502+0000","last_fullsized":"2024-09-12T02:03:43.743502+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:33.558216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"266'7","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.729838+0000","last_change":"2024-09-12T00:32:14.577757+0000","last_active":"2024-09-12T02:02:18.729838+0000","last_peered":"2024-09-12T02:02:18.729838+0000","last_clean":"2024-09-12T02:02:18.729838+0000","last_became_active":"2024-09-12T00:32:14.576974+0000","last_became_peered":"2024-09-12T00:32:14.576974+0000","last_unstale":"2024-09-12T02:02:18.729838+0000","last_undegraded":"2024-09-12T02:02:18.729838+0000","last_fullsized":"2024-09-12T02:02:18.729838+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:03.910967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202496,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4127,"num_write":12,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"266'52","reported_seq":231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719368+0000","last_change":"2024-09-12T00:26:23.316961+0000","last_active":"2024-09-12T02:03:53.719368+0000","last_peered":"2024-09-12T02:03:53.719368+0000","last_clean":"2024-09-12T02:03:53.719368+0000","last_became_active":"2024-09-12T00:26:23.315633+0000","last_became_peered":"2024-09-12T00:26:23.315633+0000","last_unstale":"2024-09-12T02:03:53.719368+0000","last_undegraded":"2024-09-12T02:03:53.719368+0000","last_fullsized":"2024-09-12T02:03:53.719368+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:49.483501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":203,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731755+0000","last_change":"2024-09-12T01:00:24.080426+0000","last_active":"2024-09-12T02:02:53.731755+0000","last_peered":"2024-09-12T02:02:53.731755+0000","last_clean":"2024-09-12T02:02:53.731755+0000","last_became_active":"2024-09-12T01:00:24.079834+0000","last_became_peered":"2024-09-12T01:00:24.079834+0000","last_unstale":"2024-09-12T02:02:53.731755+0000","last_undegraded":"2024-09-12T02:02:53.731755+0000","last_fullsized":"2024-09-12T02:02:53.731755+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:05.052155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.535089+0000","last_change":"2024-09-12T00:32:21.664365+0000","last_active":"2024-09-12T02:04:33.535089+0000","last_peered":"2024-09-12T02:04:33.535089+0000","last_clean":"2024-09-12T02:04:33.535089+0000","last_became_active":"2024-09-12T00:32:21.663547+0000","last_became_peered":"2024-09-12T00:32:21.663547+0000","last_unstale":"2024-09-12T02:04:33.535089+0000","last_undegraded":"2024-09-12T02:04:33.535089+0000","last_fullsized":"2024-09-12T02:04:33.535089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:42.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.747512+0000","last_change":"2024-09-12T00:32:14.596240+0000","last_active":"2024-09-12T02:03:58.747512+0000","last_peered":"2024-09-12T02:03:58.747512+0000","last_clean":"2024-09-12T02:03:58.747512+0000","last_became_active":"2024-09-12T00:32:14.593670+0000","last_became_peered":"2024-09-12T00:32:14.593670+0000","last_unstale":"2024-09-12T02:03:58.747512+0000","last_undegraded":"2024-09-12T02:03:58.747512+0000","last_fullsized":"2024-09-12T02:03:58.747512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:01.077637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'28","reported_seq":156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525498+0000","last_change":"2024-09-12T00:26:23.350883+0000","last_active":"2024-09-12T02:03:53.525498+0000","last_peered":"2024-09-12T02:03:53.525498+0000","last_clean":"2024-09-12T02:03:53.525498+0000","last_became_active":"2024-09-12T00:26:23.338248+0000","last_became_peered":"2024-09-12T00:26:23.338248+0000","last_unstale":"2024-09-12T02:03:53.525498+0000","last_undegraded":"2024-09-12T02:03:53.525498+0000","last_fullsized":"2024-09-12T02:03:53.525498+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:58.473095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:54.728722+0000","last_change":"2024-09-12T01:00:24.077369+0000","last_active":"2024-09-12T02:02:54.728722+0000","last_peered":"2024-09-12T02:02:54.728722+0000","last_clean":"2024-09-12T02:02:54.728722+0000","last_became_active":"2024-09-12T01:00:24.068145+0000","last_became_peered":"2024-09-12T01:00:24.068145+0000","last_unstale":"2024-09-12T02:02:54.728722+0000","last_undegraded":"2024-09-12T02:02:54.728722+0000","last_fullsized":"2024-09-12T02:02:54.728722+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:15.100781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.527728+0000","last_change":"2024-09-12T00:32:21.674579+0000","last_active":"2024-09-12T02:04:03.527728+0000","last_peered":"2024-09-12T02:04:03.527728+0000","last_clean":"2024-09-12T02:04:03.527728+0000","last_became_active":"2024-09-12T00:32:21.668979+0000","last_became_peered":"2024-09-12T00:32:21.668979+0000","last_unstale":"2024-09-12T02:04:03.527728+0000","last_undegraded":"2024-09-12T02:04:03.527728+0000","last_fullsized":"2024-09-12T02:04:03.527728+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:43.618228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"266'2","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.712945+0000","last_change":"2024-09-12T00:32:14.611138+0000","last_active":"2024-09-12T02:04:18.712945+0000","last_peered":"2024-09-12T02:04:18.712945+0000","last_clean":"2024-09-12T02:04:18.712945+0000","last_became_active":"2024-09-12T00:32:14.610414+0000","last_became_peered":"2024-09-12T00:32:14.610414+0000","last_unstale":"2024-09-12T02:04:18.712945+0000","last_undegraded":"2024-09-12T02:04:18.712945+0000","last_fullsized":"2024-09-12T02:04:18.712945+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.944085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6140,"num_write":2,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"266'33","reported_seq":168,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719573+0000","last_change":"2024-09-12T00:26:23.328059+0000","last_active":"2024-09-12T02:03:53.719573+0000","last_peered":"2024-09-12T02:03:53.719573+0000","last_clean":"2024-09-12T02:03:53.719573+0000","last_became_active":"2024-09-12T00:26:23.327296+0000","last_became_peered":"2024-09-12T00:26:23.327296+0000","last_unstale":"2024-09-12T02:03:53.719573+0000","last_undegraded":"2024-09-12T02:03:53.719573+0000","last_fullsized":"2024-09-12T02:03:53.719573+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:43.942150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709243+0000","last_change":"2024-09-12T01:00:24.068043+0000","last_active":"2024-09-12T02:04:43.709243+0000","last_peered":"2024-09-12T02:04:43.709243+0000","last_clean":"2024-09-12T02:04:43.709243+0000","last_became_active":"2024-09-12T01:00:24.067665+0000","last_became_peered":"2024-09-12T01:00:24.067665+0000","last_unstale":"2024-09-12T02:04:43.709243+0000","last_undegraded":"2024-09-12T02:04:43.709243+0000","last_fullsized":"2024-09-12T02:04:43.709243+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:47.648058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.739021+0000","last_change":"2024-09-12T00:32:21.645575+0000","last_active":"2024-09-12T02:03:23.739021+0000","last_peered":"2024-09-12T02:03:23.739021+0000","last_clean":"2024-09-12T02:03:23.739021+0000","last_became_active":"2024-09-12T00:32:21.644891+0000","last_became_peered":"2024-09-12T00:32:21.644891+0000","last_unstale":"2024-09-12T02:03:23.739021+0000","last_undegraded":"2024-09-12T02:03:23.739021+0000","last_fullsized":"2024-09-12T02:03:23.739021+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.537775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"266'1","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:14.733184+0000","last_change":"2024-09-12T00:32:14.599778+0000","last_active":"2024-09-12T02:03:14.733184+0000","last_peered":"2024-09-12T02:03:14.733184+0000","last_clean":"2024-09-12T02:03:14.733184+0000","last_became_active":"2024-09-12T00:32:14.598981+0000","last_became_peered":"2024-09-12T00:32:14.598981+0000","last_unstale":"2024-09-12T02:03:14.733184+0000","last_undegraded":"2024-09-12T02:03:14.733184+0000","last_fullsized":"2024-09-12T02:03:14.733184+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:06.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"266'25","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.757357+0000","last_change":"2024-09-12T00:26:23.317228+0000","last_active":"2024-09-12T02:04:38.757357+0000","last_peered":"2024-09-12T02:04:38.757357+0000","last_clean":"2024-09-12T02:04:38.757357+0000","last_became_active":"2024-09-12T00:26:23.316443+0000","last_became_peered":"2024-09-12T00:26:23.316443+0000","last_unstale":"2024-09-12T02:04:38.757357+0000","last_undegraded":"2024-09-12T02:04:38.757357+0000","last_fullsized":"2024-09-12T02:04:38.757357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:54.406238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":90,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.737725+0000","last_change":"2024-09-12T01:00:24.072339+0000","last_active":"2024-09-12T02:02:53.737725+0000","last_peered":"2024-09-12T02:02:53.737725+0000","last_clean":"2024-09-12T02:02:53.737725+0000","last_became_active":"2024-09-12T01:00:24.071428+0000","last_became_peered":"2024-09-12T01:00:24.071428+0000","last_unstale":"2024-09-12T02:02:53.737725+0000","last_undegraded":"2024-09-12T02:02:53.737725+0000","last_fullsized":"2024-09-12T02:02:53.737725+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:11.332721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"266'7","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.744448+0000","last_change":"2024-09-12T00:32:21.654444+0000","last_active":"2024-09-12T02:03:23.744448+0000","last_peered":"2024-09-12T02:03:23.744448+0000","last_clean":"2024-09-12T02:03:23.744448+0000","last_became_active":"2024-09-12T00:32:21.653749+0000","last_became_peered":"2024-09-12T00:32:21.653749+0000","last_unstale":"2024-09-12T02:03:23.744448+0000","last_undegraded":"2024-09-12T02:03:23.744448+0000","last_fullsized":"2024-09-12T02:03:23.744448+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:33.575071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":12,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.737749+0000","last_change":"2024-09-12T00:32:14.597114+0000","last_active":"2024-09-12T02:03:18.737749+0000","last_peered":"2024-09-12T02:03:18.737749+0000","last_clean":"2024-09-12T02:03:18.737749+0000","last_became_active":"2024-09-12T00:32:14.596498+0000","last_became_peered":"2024-09-12T00:32:14.596498+0000","last_unstale":"2024-09-12T02:03:18.737749+0000","last_undegraded":"2024-09-12T02:03:18.737749+0000","last_fullsized":"2024-09-12T02:03:18.737749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:03.408422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"266'50","reported_seq":218,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.703534+0000","last_change":"2024-09-12T00:26:23.341311+0000","last_active":"2024-09-12T02:04:18.703534+0000","last_peered":"2024-09-12T02:04:18.703534+0000","last_clean":"2024-09-12T02:04:18.703534+0000","last_became_active":"2024-09-12T00:26:23.340608+0000","last_became_peered":"2024-09-12T00:26:23.340608+0000","last_unstale":"2024-09-12T02:04:18.703534+0000","last_undegraded":"2024-09-12T02:04:18.703534+0000","last_fullsized":"2024-09-12T02:04:18.703534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:24.402590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":178,"num_write":83,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.699157+0000","last_change":"2024-09-12T01:00:24.083558+0000","last_active":"2024-09-12T02:03:13.699157+0000","last_peered":"2024-09-12T02:03:13.699157+0000","last_clean":"2024-09-12T02:03:13.699157+0000","last_became_active":"2024-09-12T01:00:24.083260+0000","last_became_peered":"2024-09-12T01:00:24.083260+0000","last_unstale":"2024-09-12T02:03:13.699157+0000","last_undegraded":"2024-09-12T02:03:13.699157+0000","last_fullsized":"2024-09-12T02:03:13.699157+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"266'8","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.700065+0000","last_change":"2024-09-12T00:32:21.656599+0000","last_active":"2024-09-12T02:04:03.700065+0000","last_peered":"2024-09-12T02:04:03.700065+0000","last_clean":"2024-09-12T02:04:03.700065+0000","last_became_active":"2024-09-12T00:32:21.655849+0000","last_became_peered":"2024-09-12T00:32:21.655849+0000","last_unstale":"2024-09-12T02:04:03.700065+0000","last_undegraded":"2024-09-12T02:04:03.700065+0000","last_fullsized":"2024-09-12T02:04:03.700065+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:45.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":15358,"num_write":13,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"266'1","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.757136+0000","last_change":"2024-09-12T00:32:14.605108+0000","last_active":"2024-09-12T02:04:38.757136+0000","last_peered":"2024-09-12T02:04:38.757136+0000","last_clean":"2024-09-12T02:04:38.757136+0000","last_became_active":"2024-09-12T00:32:14.604519+0000","last_became_peered":"2024-09-12T00:32:14.604519+0000","last_unstale":"2024-09-12T02:04:38.757136+0000","last_undegraded":"2024-09-12T02:04:38.757136+0000","last_fullsized":"2024-09-12T02:04:38.757136+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:45.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":153,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:19.747660+0000","last_change":"2024-09-12T00:26:23.332950+0000","last_active":"2024-09-12T02:04:19.747660+0000","last_peered":"2024-09-12T02:04:19.747660+0000","last_clean":"2024-09-12T02:04:19.747660+0000","last_became_active":"2024-09-12T00:26:23.328187+0000","last_became_peered":"2024-09-12T00:26:23.328187+0000","last_unstale":"2024-09-12T02:04:19.747660+0000","last_undegraded":"2024-09-12T02:04:19.747660+0000","last_fullsized":"2024-09-12T02:04:19.747660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.206262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":91,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727347+0000","last_change":"2024-09-12T01:00:24.063315+0000","last_active":"2024-09-12T02:03:13.727347+0000","last_peered":"2024-09-12T02:03:13.727347+0000","last_clean":"2024-09-12T02:03:13.727347+0000","last_became_active":"2024-09-12T01:00:24.062597+0000","last_became_peered":"2024-09-12T01:00:24.062597+0000","last_unstale":"2024-09-12T02:03:13.727347+0000","last_undegraded":"2024-09-12T02:03:13.727347+0000","last_fullsized":"2024-09-12T02:03:13.727347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:00.125865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:34.751341+0000","last_change":"2024-09-12T00:32:21.646859+0000","last_active":"2024-09-12T02:04:34.751341+0000","last_peered":"2024-09-12T02:04:34.751341+0000","last_clean":"2024-09-12T02:04:34.751341+0000","last_became_active":"2024-09-12T00:32:21.644950+0000","last_became_peered":"2024-09-12T00:32:21.644950+0000","last_unstale":"2024-09-12T02:04:34.751341+0000","last_undegraded":"2024-09-12T02:04:34.751341+0000","last_fullsized":"2024-09-12T02:04:34.751341+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:04.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"266'3","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.747407+0000","last_change":"2024-09-12T00:32:14.598048+0000","last_active":"2024-09-12T02:03:58.747407+0000","last_peered":"2024-09-12T02:03:58.747407+0000","last_clean":"2024-09-12T02:03:58.747407+0000","last_became_active":"2024-09-12T00:32:14.597376+0000","last_became_peered":"2024-09-12T00:32:14.597376+0000","last_unstale":"2024-09-12T02:03:58.747407+0000","last_undegraded":"2024-09-12T02:03:58.747407+0000","last_fullsized":"2024-09-12T02:03:58.747407+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:44.028314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12276,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"266'77","reported_seq":297,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.756664+0000","last_change":"2024-09-12T00:26:23.338797+0000","last_active":"2024-09-12T02:04:18.756664+0000","last_peered":"2024-09-12T02:04:18.756664+0000","last_clean":"2024-09-12T02:04:18.756664+0000","last_became_active":"2024-09-12T00:26:23.338274+0000","last_became_peered":"2024-09-12T00:26:23.338274+0000","last_unstale":"2024-09-12T02:04:18.756664+0000","last_undegraded":"2024-09-12T02:04:18.756664+0000","last_fullsized":"2024-09-12T02:04:18.756664+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:48.119590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":296,"num_write":117,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.722148+0000","last_change":"2024-09-12T01:00:24.054473+0000","last_active":"2024-09-12T02:02:53.722148+0000","last_peered":"2024-09-12T02:02:53.722148+0000","last_clean":"2024-09-12T02:02:53.722148+0000","last_became_active":"2024-09-12T01:00:24.053408+0000","last_became_peered":"2024-09-12T01:00:24.053408+0000","last_unstale":"2024-09-12T02:02:53.722148+0000","last_undegraded":"2024-09-12T02:02:53.722148+0000","last_fullsized":"2024-09-12T02:02:53.722148+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:50.708086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.721667+0000","last_change":"2024-09-12T00:32:33.790651+0000","last_active":"2024-09-12T02:04:03.721667+0000","last_peered":"2024-09-12T02:04:03.721667+0000","last_clean":"2024-09-12T02:04:03.721667+0000","last_became_active":"2024-09-12T00:32:33.790018+0000","last_became_peered":"2024-09-12T00:32:33.790018+0000","last_unstale":"2024-09-12T02:04:03.721667+0000","last_undegraded":"2024-09-12T02:04:03.721667+0000","last_fullsized":"2024-09-12T02:04:03.721667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:15.389367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.697604+0000","last_change":"2024-09-12T00:32:14.581204+0000","last_active":"2024-09-12T02:03:53.697604+0000","last_peered":"2024-09-12T02:03:53.697604+0000","last_clean":"2024-09-12T02:03:53.697604+0000","last_became_active":"2024-09-12T00:32:14.580350+0000","last_became_peered":"2024-09-12T00:32:14.580350+0000","last_unstale":"2024-09-12T02:03:53.697604+0000","last_undegraded":"2024-09-12T02:03:53.697604+0000","last_fullsized":"2024-09-12T02:03:53.697604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:27.342223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"266'23","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.724815+0000","last_change":"2024-09-12T00:26:23.327068+0000","last_active":"2024-09-12T02:04:18.724815+0000","last_peered":"2024-09-12T02:04:18.724815+0000","last_clean":"2024-09-12T02:04:18.724815+0000","last_became_active":"2024-09-12T00:26:23.318720+0000","last_became_peered":"2024-09-12T00:26:23.318720+0000","last_unstale":"2024-09-12T02:04:18.724815+0000","last_undegraded":"2024-09-12T02:04:18.724815+0000","last_fullsized":"2024-09-12T02:04:18.724815+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.176923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.735348+0000","last_change":"2024-09-12T01:00:24.074486+0000","last_active":"2024-09-12T02:03:08.735348+0000","last_peered":"2024-09-12T02:03:08.735348+0000","last_clean":"2024-09-12T02:03:08.735348+0000","last_became_active":"2024-09-12T01:00:24.072773+0000","last_became_peered":"2024-09-12T01:00:24.072773+0000","last_unstale":"2024-09-12T02:03:08.735348+0000","last_undegraded":"2024-09-12T02:03:08.735348+0000","last_fullsized":"2024-09-12T02:03:08.735348+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:12.560655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"266'6","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.753006+0000","last_change":"2024-09-12T00:32:21.644007+0000","last_active":"2024-09-12T02:04:03.753006+0000","last_peered":"2024-09-12T02:04:03.753006+0000","last_clean":"2024-09-12T02:04:03.753006+0000","last_became_active":"2024-09-12T00:32:21.643272+0000","last_became_peered":"2024-09-12T00:32:21.643272+0000","last_unstale":"2024-09-12T02:04:03.753006+0000","last_undegraded":"2024-09-12T02:04:03.753006+0000","last_fullsized":"2024-09-12T02:04:03.753006+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.420621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10236,"num_write":16,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.720610+0000","last_change":"2024-09-12T00:32:14.580374+0000","last_active":"2024-09-12T02:03:58.720610+0000","last_peered":"2024-09-12T02:03:58.720610+0000","last_clean":"2024-09-12T02:03:58.720610+0000","last_became_active":"2024-09-12T00:32:14.579278+0000","last_became_peered":"2024-09-12T00:32:14.579278+0000","last_unstale":"2024-09-12T02:03:58.720610+0000","last_undegraded":"2024-09-12T02:03:58.720610+0000","last_fullsized":"2024-09-12T02:03:58.720610+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:01.599717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"266'19","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.758435+0000","last_change":"2024-09-12T00:26:23.306938+0000","last_active":"2024-09-12T02:04:43.758435+0000","last_peered":"2024-09-12T02:04:43.758435+0000","last_clean":"2024-09-12T02:04:43.758435+0000","last_became_active":"2024-09-12T00:26:23.306139+0000","last_became_peered":"2024-09-12T00:26:23.306139+0000","last_unstale":"2024-09-12T02:04:43.758435+0000","last_undegraded":"2024-09-12T02:04:43.758435+0000","last_fullsized":"2024-09-12T02:04:43.758435+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:31.920270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"266'268","reported_seq":1013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.756136+0000","last_change":"2024-09-12T00:09:59.316653+0000","last_active":"2024-09-12T02:04:33.756136+0000","last_peered":"2024-09-12T02:04:33.756136+0000","last_clean":"2024-09-12T02:04:33.756136+0000","last_became_active":"2024-09-12T00:09:59.316094+0000","last_became_peered":"2024-09-12T00:09:59.316094+0000","last_unstale":"2024-09-12T02:04:33.756136+0000","last_undegraded":"2024-09-12T02:04:33.756136+0000","last_fullsized":"2024-09-12T02:04:33.756136+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:40.253738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27549764,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":520,"num_read_kb":103151,"num_write":937,"num_write_kb":38551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"266'995","reported_seq":2777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:34.723877+0000","last_change":"2024-09-12T00:10:01.282096+0000","last_active":"2024-09-12T02:02:34.723877+0000","last_peered":"2024-09-12T02:02:34.723877+0000","last_clean":"2024-09-12T02:02:34.723877+0000","last_became_active":"2024-09-12T00:10:01.281465+0000","last_became_peered":"2024-09-12T00:10:01.281465+0000","last_unstale":"2024-09-12T02:02:34.723877+0000","last_undegraded":"2024-09-12T02:02:34.723877+0000","last_fullsized":"2024-09-12T02:02:34.723877+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:52.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4736,"num_read_kb":4236,"num_write":1359,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"266'290","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.707063+0000","last_change":"2024-09-12T00:09:59.311726+0000","last_active":"2024-09-12T02:04:33.707063+0000","last_peered":"2024-09-12T02:04:33.707063+0000","last_clean":"2024-09-12T02:04:33.707063+0000","last_became_active":"2024-09-12T00:09:59.311178+0000","last_became_peered":"2024-09-12T00:09:59.311178+0000","last_unstale":"2024-09-12T02:04:33.707063+0000","last_undegraded":"2024-09-12T02:04:33.707063+0000","last_fullsized":"2024-09-12T02:04:33.707063+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:44.209100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2509673,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":478,"num_read_kb":11355,"num_write":1113,"num_write_kb":19733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"266'875","reported_seq":2482,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.639756+0000","last_change":"2024-09-12T00:10:01.270508+0000","last_active":"2024-09-12T02:06:05.639756+0000","last_peered":"2024-09-12T02:06:05.639756+0000","last_clean":"2024-09-12T02:06:05.639756+0000","last_became_active":"2024-09-12T00:10:01.268068+0000","last_became_peered":"2024-09-12T00:10:01.268068+0000","last_unstale":"2024-09-12T02:06:05.639756+0000","last_undegraded":"2024-09-12T02:06:05.639756+0000","last_fullsized":"2024-09-12T02:06:05.639756+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:03.001681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4189,"num_read_kb":3768,"num_write":1161,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"266'305","reported_seq":1011,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.535038+0000","last_change":"2024-09-12T00:09:59.296889+0000","last_active":"2024-09-12T02:04:33.535038+0000","last_peered":"2024-09-12T02:04:33.535038+0000","last_clean":"2024-09-12T02:04:33.535038+0000","last_became_active":"2024-09-12T00:09:59.296557+0000","last_became_peered":"2024-09-12T00:09:59.296557+0000","last_unstale":"2024-09-12T02:04:33.535038+0000","last_undegraded":"2024-09-12T02:04:33.535038+0000","last_fullsized":"2024-09-12T02:04:33.535038+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:27.013161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8018165,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":504,"num_read_kb":57177,"num_write":1114,"num_write_kb":38522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1196","reported_seq":2908,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.643791+0000","last_change":"2024-09-12T00:10:01.251720+0000","last_active":"2024-09-12T02:06:05.643791+0000","last_peered":"2024-09-12T02:06:05.643791+0000","last_clean":"2024-09-12T02:06:05.643791+0000","last_became_active":"2024-09-12T00:10:01.251038+0000","last_became_peered":"2024-09-12T00:10:01.251038+0000","last_unstale":"2024-09-12T02:06:05.643791+0000","last_undegraded":"2024-09-12T02:06:05.643791+0000","last_fullsized":"2024-09-12T02:06:05.643791+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:38.505152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5594,"num_read_kb":4965,"num_write":1641,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"266'257","reported_seq":906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.644958+0000","last_change":"2024-09-12T00:09:59.279104+0000","last_active":"2024-09-12T02:06:44.644958+0000","last_peered":"2024-09-12T02:06:44.644958+0000","last_clean":"2024-09-12T02:06:44.644958+0000","last_became_active":"2024-09-12T00:09:59.278426+0000","last_became_peered":"2024-09-12T00:09:59.278426+0000","last_unstale":"2024-09-12T02:06:44.644958+0000","last_undegraded":"2024-09-12T02:06:44.644958+0000","last_fullsized":"2024-09-12T02:06:44.644958+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:22.498936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13888078,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":381,"num_read_kb":8612,"num_write":971,"num_write_kb":32048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"266'440","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719993+0000","last_change":"2024-09-12T00:10:01.248182+0000","last_active":"2024-09-12T02:04:59.719993+0000","last_peered":"2024-09-12T02:04:59.719993+0000","last_clean":"2024-09-12T02:04:59.719993+0000","last_became_active":"2024-09-12T00:10:01.247807+0000","last_became_peered":"2024-09-12T00:10:01.247807+0000","last_unstale":"2024-09-12T02:04:59.719993+0000","last_undegraded":"2024-09-12T02:04:59.719993+0000","last_fullsized":"2024-09-12T02:04:59.719993+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.770019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2317,"num_read_kb":2164,"num_write":517,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"266'247","reported_seq":956,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.725923+0000","last_change":"2024-09-12T00:09:59.314721+0000","last_active":"2024-09-12T02:02:28.725923+0000","last_peered":"2024-09-12T02:02:28.725923+0000","last_clean":"2024-09-12T02:02:28.725923+0000","last_became_active":"2024-09-12T00:09:59.314222+0000","last_became_peered":"2024-09-12T00:09:59.314222+0000","last_unstale":"2024-09-12T02:02:28.725923+0000","last_undegraded":"2024-09-12T02:02:28.725923+0000","last_fullsized":"2024-09-12T02:02:28.725923+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:31.303567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13053492,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":532,"num_read_kb":10075,"num_write":882,"num_write_kb":41375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"266'513","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.728189+0000","last_change":"2024-09-12T00:10:01.256948+0000","last_active":"2024-09-12T02:04:33.728189+0000","last_peered":"2024-09-12T02:04:33.728189+0000","last_clean":"2024-09-12T02:04:33.728189+0000","last_became_active":"2024-09-12T00:10:01.256253+0000","last_became_peered":"2024-09-12T00:10:01.256253+0000","last_unstale":"2024-09-12T02:04:33.728189+0000","last_undegraded":"2024-09-12T02:04:33.728189+0000","last_fullsized":"2024-09-12T02:04:33.728189+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:03.333567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2461,"num_read_kb":2278,"num_write":611,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"266'281","reported_seq":935,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.581178+0000","last_change":"2024-09-12T00:09:59.298976+0000","last_active":"2024-09-12T02:06:44.581178+0000","last_peered":"2024-09-12T02:06:44.581178+0000","last_clean":"2024-09-12T02:06:44.581178+0000","last_became_active":"2024-09-12T00:09:59.297821+0000","last_became_peered":"2024-09-12T00:09:59.297821+0000","last_unstale":"2024-09-12T02:06:44.581178+0000","last_undegraded":"2024-09-12T02:06:44.581178+0000","last_fullsized":"2024-09-12T02:06:44.581178+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:47.378293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6310664,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":428,"num_read_kb":14780,"num_write":902,"num_write_kb":35747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"266'378","reported_seq":1843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936221+0000","last_change":"2024-09-12T00:10:01.252712+0000","last_active":"2024-09-12T02:04:59.936221+0000","last_peered":"2024-09-12T02:04:59.936221+0000","last_clean":"2024-09-12T02:04:59.936221+0000","last_became_active":"2024-09-12T00:10:01.250663+0000","last_became_peered":"2024-09-12T00:10:01.250663+0000","last_unstale":"2024-09-12T02:04:59.936221+0000","last_undegraded":"2024-09-12T02:04:59.936221+0000","last_fullsized":"2024-09-12T02:04:59.936221+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:19.125375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2078,"num_read_kb":1972,"num_write":422,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"266'299","reported_seq":1069,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.725834+0000","last_change":"2024-09-12T00:09:59.312324+0000","last_active":"2024-09-12T02:02:28.725834+0000","last_peered":"2024-09-12T02:02:28.725834+0000","last_clean":"2024-09-12T02:02:28.725834+0000","last_became_active":"2024-09-12T00:09:59.311825+0000","last_became_peered":"2024-09-12T00:09:59.311825+0000","last_unstale":"2024-09-12T02:02:28.725834+0000","last_undegraded":"2024-09-12T02:02:28.725834+0000","last_fullsized":"2024-09-12T02:02:28.725834+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:41.321551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5995381,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":788,"num_read_kb":88204,"num_write":1081,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"266'420","reported_seq":1882,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.720872+0000","last_change":"2024-09-12T00:10:01.275162+0000","last_active":"2024-09-12T02:04:59.720872+0000","last_peered":"2024-09-12T02:04:59.720872+0000","last_clean":"2024-09-12T02:04:59.720872+0000","last_became_active":"2024-09-12T00:10:01.274405+0000","last_became_peered":"2024-09-12T00:10:01.274405+0000","last_unstale":"2024-09-12T02:04:59.720872+0000","last_undegraded":"2024-09-12T02:04:59.720872+0000","last_fullsized":"2024-09-12T02:04:59.720872+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:26.880309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2137,"num_read_kb":2003,"num_write":477,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"266'327","reported_seq":1014,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.005054+0000","last_change":"2024-09-12T00:09:59.249333+0000","last_active":"2024-09-12T02:02:33.005054+0000","last_peered":"2024-09-12T02:02:33.005054+0000","last_clean":"2024-09-12T02:02:33.005054+0000","last_became_active":"2024-09-12T00:09:59.248750+0000","last_became_peered":"2024-09-12T00:09:59.248750+0000","last_unstale":"2024-09-12T02:02:33.005054+0000","last_undegraded":"2024-09-12T02:02:33.005054+0000","last_fullsized":"2024-09-12T02:02:33.005054+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:33.945077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10227707,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":647,"num_read_kb":26164,"num_write":1089,"num_write_kb":31035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"266'818","reported_seq":2443,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.717310+0000","last_change":"2024-09-12T00:10:01.249377+0000","last_active":"2024-09-12T02:04:38.717310+0000","last_peered":"2024-09-12T02:04:38.717310+0000","last_clean":"2024-09-12T02:04:38.717310+0000","last_became_active":"2024-09-12T00:10:01.249016+0000","last_became_peered":"2024-09-12T00:10:01.249016+0000","last_unstale":"2024-09-12T02:04:38.717310+0000","last_undegraded":"2024-09-12T02:04:38.717310+0000","last_fullsized":"2024-09-12T02:04:38.717310+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:28.289903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3841,"num_read_kb":3467,"num_write":1075,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"266'626","reported_seq":2380,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936425+0000","last_change":"2024-09-12T00:10:01.253763+0000","last_active":"2024-09-12T02:04:59.936425+0000","last_peered":"2024-09-12T02:04:59.936425+0000","last_clean":"2024-09-12T02:04:59.936425+0000","last_became_active":"2024-09-12T00:10:01.252790+0000","last_became_peered":"2024-09-12T00:10:01.252790+0000","last_unstale":"2024-09-12T02:04:59.936425+0000","last_undegraded":"2024-09-12T02:04:59.936425+0000","last_fullsized":"2024-09-12T02:04:59.936425+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.963549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2892,"num_write":772,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"266'345","reported_seq":1042,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.747611+0000","last_change":"2024-09-12T00:09:59.288779+0000","last_active":"2024-09-12T02:03:58.747611+0000","last_peered":"2024-09-12T02:03:58.747611+0000","last_clean":"2024-09-12T02:03:58.747611+0000","last_became_active":"2024-09-12T00:09:59.285279+0000","last_became_peered":"2024-09-12T00:09:59.285279+0000","last_unstale":"2024-09-12T02:03:58.747611+0000","last_undegraded":"2024-09-12T02:03:58.747611+0000","last_fullsized":"2024-09-12T02:03:58.747611+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:31.545971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11110426,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":581,"num_read_kb":33154,"num_write":1246,"num_write_kb":40723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"266'380","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753363+0000","last_change":"2024-09-12T00:10:01.271450+0000","last_active":"2024-09-12T02:04:23.753363+0000","last_peered":"2024-09-12T02:04:23.753363+0000","last_clean":"2024-09-12T02:04:23.753363+0000","last_became_active":"2024-09-12T00:10:01.269235+0000","last_became_peered":"2024-09-12T00:10:01.269235+0000","last_unstale":"2024-09-12T02:04:23.753363+0000","last_undegraded":"2024-09-12T02:04:23.753363+0000","last_fullsized":"2024-09-12T02:04:23.753363+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:12.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2516,"num_read_kb":2424,"num_write":449,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"266'273","reported_seq":914,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.715229+0000","last_change":"2024-09-12T00:09:59.303818+0000","last_active":"2024-09-12T02:03:33.715229+0000","last_peered":"2024-09-12T02:03:33.715229+0000","last_clean":"2024-09-12T02:03:33.715229+0000","last_became_active":"2024-09-12T00:09:59.298975+0000","last_became_peered":"2024-09-12T00:09:59.298975+0000","last_unstale":"2024-09-12T02:03:33.715229+0000","last_undegraded":"2024-09-12T02:03:33.715229+0000","last_fullsized":"2024-09-12T02:03:33.715229+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:31.548154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10575818,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":363,"num_read_kb":20543,"num_write":909,"num_write_kb":37808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"266'1147","reported_seq":2680,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:19.720322+0000","last_change":"2024-09-12T00:10:01.275965+0000","last_active":"2024-09-12T02:02:19.720322+0000","last_peered":"2024-09-12T02:02:19.720322+0000","last_clean":"2024-09-12T02:02:19.720322+0000","last_became_active":"2024-09-12T00:10:01.270566+0000","last_became_peered":"2024-09-12T00:10:01.270566+0000","last_unstale":"2024-09-12T02:02:19.720322+0000","last_undegraded":"2024-09-12T02:02:19.720322+0000","last_fullsized":"2024-09-12T02:02:19.720322+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":1100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:08.981670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5146,"num_read_kb":4532,"num_write":1573,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"266'261","reported_seq":909,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.710916+0000","last_change":"2024-09-12T00:10:31.476025+0000","last_active":"2024-09-12T02:04:08.710916+0000","last_peered":"2024-09-12T02:04:08.710916+0000","last_clean":"2024-09-12T02:04:08.710916+0000","last_became_active":"2024-09-12T00:10:31.475207+0000","last_became_peered":"2024-09-12T00:10:31.475207+0000","last_unstale":"2024-09-12T02:04:08.710916+0000","last_undegraded":"2024-09-12T02:04:08.710916+0000","last_fullsized":"2024-09-12T02:04:08.710916+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:42.892508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17287695,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":408,"num_read_kb":35516,"num_write":1010,"num_write_kb":27332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"266'424","reported_seq":2056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.704716+0000","last_change":"2024-09-12T00:10:01.249435+0000","last_active":"2024-09-12T02:03:38.704716+0000","last_peered":"2024-09-12T02:03:38.704716+0000","last_clean":"2024-09-12T02:03:38.704716+0000","last_became_active":"2024-09-12T00:10:01.249060+0000","last_became_peered":"2024-09-12T00:10:01.249060+0000","last_unstale":"2024-09-12T02:03:38.704716+0000","last_undegraded":"2024-09-12T02:03:38.704716+0000","last_fullsized":"2024-09-12T02:03:38.704716+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:57.590588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2301,"num_write":498,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"266'275","reported_seq":940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:54.350016+0000","last_change":"2024-09-12T00:09:59.309576+0000","last_active":"2024-09-12T02:05:54.350016+0000","last_peered":"2024-09-12T02:05:54.350016+0000","last_clean":"2024-09-12T02:05:54.350016+0000","last_became_active":"2024-09-12T00:09:59.308979+0000","last_became_peered":"2024-09-12T00:09:59.308979+0000","last_unstale":"2024-09-12T02:05:54.350016+0000","last_undegraded":"2024-09-12T02:05:54.350016+0000","last_fullsized":"2024-09-12T02:05:54.350016+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:02.012541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10170430,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":394,"num_read_kb":33875,"num_write":963,"num_write_kb":29129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"266'437","reported_seq":1921,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.543220+0000","last_change":"2024-09-12T00:10:01.239020+0000","last_active":"2024-09-12T02:04:57.543220+0000","last_peered":"2024-09-12T02:04:57.543220+0000","last_clean":"2024-09-12T02:04:57.543220+0000","last_became_active":"2024-09-12T00:10:01.238251+0000","last_became_peered":"2024-09-12T00:10:01.238251+0000","last_unstale":"2024-09-12T02:04:57.543220+0000","last_undegraded":"2024-09-12T02:04:57.543220+0000","last_fullsized":"2024-09-12T02:04:57.543220+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:04.492050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2194,"num_read_kb":2058,"num_write":515,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"266'254","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.961470+0000","last_change":"2024-09-12T00:09:59.263678+0000","last_active":"2024-09-12T02:03:33.961470+0000","last_peered":"2024-09-12T02:03:33.961470+0000","last_clean":"2024-09-12T02:03:33.961470+0000","last_became_active":"2024-09-12T00:09:59.262666+0000","last_became_peered":"2024-09-12T00:09:59.262666+0000","last_unstale":"2024-09-12T02:03:33.961470+0000","last_undegraded":"2024-09-12T02:03:33.961470+0000","last_fullsized":"2024-09-12T02:03:33.961470+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:36.226668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13397264,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":363,"num_read_kb":23030,"num_write":926,"num_write_kb":39870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"266'656","reported_seq":2175,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.747746+0000","last_change":"2024-09-12T00:10:01.258577+0000","last_active":"2024-09-12T02:03:38.747746+0000","last_peered":"2024-09-12T02:03:38.747746+0000","last_clean":"2024-09-12T02:03:38.747746+0000","last_became_active":"2024-09-12T00:10:01.257792+0000","last_became_peered":"2024-09-12T00:10:01.257792+0000","last_unstale":"2024-09-12T02:03:38.747746+0000","last_undegraded":"2024-09-12T02:03:38.747746+0000","last_fullsized":"2024-09-12T02:03:38.747746+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:43.563199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3304,"num_read_kb":2964,"num_write":919,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"266'274","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.715800+0000","last_change":"2024-09-12T00:09:59.294360+0000","last_active":"2024-09-12T02:02:28.715800+0000","last_peered":"2024-09-12T02:02:28.715800+0000","last_clean":"2024-09-12T02:02:28.715800+0000","last_became_active":"2024-09-12T00:09:59.293921+0000","last_became_peered":"2024-09-12T00:09:59.293921+0000","last_unstale":"2024-09-12T02:02:28.715800+0000","last_undegraded":"2024-09-12T02:02:28.715800+0000","last_fullsized":"2024-09-12T02:02:28.715800+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:40.424733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10094067,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":427,"num_read_kb":35720,"num_write":1029,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"266'142","reported_seq":678,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.114050+0000","last_change":"2024-09-12T00:10:09.356862+0000","last_active":"2024-09-12T02:06:07.114050+0000","last_peered":"2024-09-12T02:06:07.114050+0000","last_clean":"2024-09-12T02:06:07.114050+0000","last_became_active":"2024-09-12T00:10:09.356144+0000","last_became_peered":"2024-09-12T00:10:09.356144+0000","last_unstale":"2024-09-12T02:06:07.114050+0000","last_undegraded":"2024-09-12T02:06:07.114050+0000","last_fullsized":"2024-09-12T02:06:07.114050+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:09.813648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":339,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"266'785","reported_seq":2333,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.852208+0000","last_change":"2024-09-12T00:10:01.259453+0000","last_active":"2024-09-12T02:04:59.852208+0000","last_peered":"2024-09-12T02:04:59.852208+0000","last_clean":"2024-09-12T02:04:59.852208+0000","last_became_active":"2024-09-12T00:10:01.259053+0000","last_became_peered":"2024-09-12T00:10:01.259053+0000","last_unstale":"2024-09-12T02:04:59.852208+0000","last_undegraded":"2024-09-12T02:04:59.852208+0000","last_fullsized":"2024-09-12T02:04:59.852208+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:38.055321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3705,"num_read_kb":3341,"num_write":1024,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"266'319","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.752239+0000","last_change":"2024-09-12T00:09:59.311180+0000","last_active":"2024-09-12T02:04:18.752239+0000","last_peered":"2024-09-12T02:04:18.752239+0000","last_clean":"2024-09-12T02:04:18.752239+0000","last_became_active":"2024-09-12T00:09:59.310643+0000","last_became_peered":"2024-09-12T00:09:59.310643+0000","last_unstale":"2024-09-12T02:04:18.752239+0000","last_undegraded":"2024-09-12T02:04:18.752239+0000","last_fullsized":"2024-09-12T02:04:18.752239+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:20.368803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20005980,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":469,"num_read_kb":31265,"num_write":1231,"num_write_kb":60174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.738969+0000","last_change":"2024-09-12T00:10:03.273556+0000","last_active":"2024-09-12T02:03:39.738969+0000","last_peered":"2024-09-12T02:03:39.738969+0000","last_clean":"2024-09-12T02:03:39.738969+0000","last_became_active":"2024-09-12T00:10:03.271233+0000","last_became_peered":"2024-09-12T00:10:03.271233+0000","last_unstale":"2024-09-12T02:03:39.738969+0000","last_undegraded":"2024-09-12T02:03:39.738969+0000","last_fullsized":"2024-09-12T02:03:39.738969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:53.667695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"266'370","reported_seq":1024,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.068298+0000","last_change":"2024-09-12T00:10:05.286196+0000","last_active":"2024-09-12T02:06:07.068298+0000","last_peered":"2024-09-12T02:06:07.068298+0000","last_clean":"2024-09-12T02:06:07.068298+0000","last_became_active":"2024-09-12T00:10:05.285417+0000","last_became_peered":"2024-09-12T00:10:05.285417+0000","last_unstale":"2024-09-12T02:06:07.068298+0000","last_undegraded":"2024-09-12T02:06:07.068298+0000","last_fullsized":"2024-09-12T02:06:07.068298+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.508820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":1047,"num_write":454,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743886+0000","last_change":"2024-09-12T00:10:07.318948+0000","last_active":"2024-09-12T02:03:43.743886+0000","last_peered":"2024-09-12T02:03:43.743886+0000","last_clean":"2024-09-12T02:03:43.743886+0000","last_became_active":"2024-09-12T00:10:07.318114+0000","last_became_peered":"2024-09-12T00:10:07.318114+0000","last_unstale":"2024-09-12T02:03:43.743886+0000","last_undegraded":"2024-09-12T02:03:43.743886+0000","last_fullsized":"2024-09-12T02:03:43.743886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:24.177651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"266'2464","reported_seq":4396,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.745617+0000","last_change":"2024-09-12T00:10:09.371782+0000","last_active":"2024-09-12T02:04:59.745617+0000","last_peered":"2024-09-12T02:04:59.745617+0000","last_clean":"2024-09-12T02:04:59.745617+0000","last_became_active":"2024-09-12T00:10:09.370949+0000","last_became_peered":"2024-09-12T00:10:09.370949+0000","last_unstale":"2024-09-12T02:04:59.745617+0000","last_undegraded":"2024-09-12T02:04:59.745617+0000","last_fullsized":"2024-09-12T02:04:59.745617+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:02.640276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6210,"num_read_kb":6193,"num_write":4929,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"266'415","reported_seq":1953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.738917+0000","last_change":"2024-09-12T00:10:01.275549+0000","last_active":"2024-09-12T02:03:39.738917+0000","last_peered":"2024-09-12T02:03:39.738917+0000","last_clean":"2024-09-12T02:03:39.738917+0000","last_became_active":"2024-09-12T00:10:01.274710+0000","last_became_peered":"2024-09-12T00:10:01.274710+0000","last_unstale":"2024-09-12T02:03:39.738917+0000","last_undegraded":"2024-09-12T02:03:39.738917+0000","last_fullsized":"2024-09-12T02:03:39.738917+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:13.598102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2273,"num_read_kb":2145,"num_write":493,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"266'332","reported_seq":1053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.531180+0000","last_change":"2024-09-12T00:09:59.282658+0000","last_active":"2024-09-12T02:04:18.531180+0000","last_peered":"2024-09-12T02:04:18.531180+0000","last_clean":"2024-09-12T02:04:18.531180+0000","last_became_active":"2024-09-12T00:09:59.282228+0000","last_became_peered":"2024-09-12T00:09:59.282228+0000","last_unstale":"2024-09-12T02:04:18.531180+0000","last_undegraded":"2024-09-12T02:04:18.531180+0000","last_fullsized":"2024-09-12T02:04:18.531180+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:12.393975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16880935,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":597,"num_read_kb":89133,"num_write":1418,"num_write_kb":44201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.940910+0000","last_change":"2024-09-12T00:10:03.254783+0000","last_active":"2024-09-12T02:02:18.940910+0000","last_peered":"2024-09-12T02:02:18.940910+0000","last_clean":"2024-09-12T02:02:18.940910+0000","last_became_active":"2024-09-12T00:10:03.254006+0000","last_became_peered":"2024-09-12T00:10:03.254006+0000","last_unstale":"2024-09-12T02:02:18.940910+0000","last_undegraded":"2024-09-12T02:02:18.940910+0000","last_fullsized":"2024-09-12T02:02:18.940910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:47.826880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"266'138","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.748930+0000","last_change":"2024-09-12T00:10:05.280695+0000","last_active":"2024-09-12T02:03:43.748930+0000","last_peered":"2024-09-12T02:03:43.748930+0000","last_clean":"2024-09-12T02:03:43.748930+0000","last_became_active":"2024-09-12T00:10:05.279990+0000","last_became_peered":"2024-09-12T00:10:05.279990+0000","last_unstale":"2024-09-12T02:03:43.748930+0000","last_undegraded":"2024-09-12T02:03:43.748930+0000","last_fullsized":"2024-09-12T02:03:43.748930+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:32.073641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.748898+0000","last_change":"2024-09-12T00:10:07.310717+0000","last_active":"2024-09-12T02:03:43.748898+0000","last_peered":"2024-09-12T02:03:43.748898+0000","last_clean":"2024-09-12T02:03:43.748898+0000","last_became_active":"2024-09-12T00:10:07.309927+0000","last_became_peered":"2024-09-12T00:10:07.309927+0000","last_unstale":"2024-09-12T02:03:43.748898+0000","last_undegraded":"2024-09-12T02:03:43.748898+0000","last_fullsized":"2024-09-12T02:03:43.748898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:30.558288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"266'102","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718247+0000","last_change":"2024-09-12T00:10:09.365676+0000","last_active":"2024-09-12T02:02:38.718247+0000","last_peered":"2024-09-12T02:02:38.718247+0000","last_clean":"2024-09-12T02:02:38.718247+0000","last_became_active":"2024-09-12T00:10:09.364927+0000","last_became_peered":"2024-09-12T00:10:09.364927+0000","last_unstale":"2024-09-12T02:02:38.718247+0000","last_undegraded":"2024-09-12T02:02:38.718247+0000","last_fullsized":"2024-09-12T02:02:38.718247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.618632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":243,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"266'381","reported_seq":1911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.521800+0000","last_change":"2024-09-12T00:10:01.247147+0000","last_active":"2024-09-12T02:03:38.521800+0000","last_peered":"2024-09-12T02:03:38.521800+0000","last_clean":"2024-09-12T02:03:38.521800+0000","last_became_active":"2024-09-12T00:10:01.246633+0000","last_became_peered":"2024-09-12T00:10:01.246633+0000","last_unstale":"2024-09-12T02:03:38.521800+0000","last_undegraded":"2024-09-12T02:03:38.521800+0000","last_fullsized":"2024-09-12T02:03:38.521800+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:18.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2031,"num_read_kb":1954,"num_write":422,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"266'258","reported_seq":907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689777+0000","last_change":"2024-09-12T00:10:31.472958+0000","last_active":"2024-09-12T02:02:33.689777+0000","last_peered":"2024-09-12T02:02:33.689777+0000","last_clean":"2024-09-12T02:02:33.689777+0000","last_became_active":"2024-09-12T00:10:31.472231+0000","last_became_peered":"2024-09-12T00:10:31.472231+0000","last_unstale":"2024-09-12T02:02:33.689777+0000","last_undegraded":"2024-09-12T02:02:33.689777+0000","last_fullsized":"2024-09-12T02:02:33.689777+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:02.415644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14756796,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":414,"num_read_kb":34991,"num_write":935,"num_write_kb":46604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"37'3","reported_seq":1004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:06.532879+0000","last_change":"2024-09-12T00:10:03.266585+0000","last_active":"2024-09-12T02:06:06.532879+0000","last_peered":"2024-09-12T02:06:06.532879+0000","last_clean":"2024-09-12T02:06:06.532879+0000","last_became_active":"2024-09-12T00:10:03.265816+0000","last_became_peered":"2024-09-12T00:10:03.265816+0000","last_unstale":"2024-09-12T02:06:06.532879+0000","last_undegraded":"2024-09-12T02:06:06.532879+0000","last_fullsized":"2024-09-12T02:06:06.532879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:06.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"266'189","reported_seq":796,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689892+0000","last_change":"2024-09-12T00:10:05.276198+0000","last_active":"2024-09-12T02:02:33.689892+0000","last_peered":"2024-09-12T02:02:33.689892+0000","last_clean":"2024-09-12T02:02:33.689892+0000","last_became_active":"2024-09-12T00:10:05.275499+0000","last_became_peered":"2024-09-12T00:10:05.275499+0000","last_unstale":"2024-09-12T02:02:33.689892+0000","last_undegraded":"2024-09-12T02:02:33.689892+0000","last_fullsized":"2024-09-12T02:02:33.689892+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:30.503399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":245,"num_read_kb":237,"num_write":164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"266'769","reported_seq":3025,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.386655+0000","last_change":"2024-09-12T00:10:07.319071+0000","last_active":"2024-09-12T02:06:10.386655+0000","last_peered":"2024-09-12T02:06:10.386655+0000","last_clean":"2024-09-12T02:06:10.386655+0000","last_became_active":"2024-09-12T00:10:07.318302+0000","last_became_peered":"2024-09-12T00:10:07.318302+0000","last_unstale":"2024-09-12T02:06:10.386655+0000","last_undegraded":"2024-09-12T02:06:10.386655+0000","last_fullsized":"2024-09-12T02:06:10.386655+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:04.659101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"266'205","reported_seq":1059,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.365691+0000","last_change":"2024-09-12T00:10:09.433574+0000","last_active":"2024-09-12T02:06:05.365691+0000","last_peered":"2024-09-12T02:06:05.365691+0000","last_clean":"2024-09-12T02:06:05.365691+0000","last_became_active":"2024-09-12T00:10:09.433045+0000","last_became_peered":"2024-09-12T00:10:09.433045+0000","last_unstale":"2024-09-12T02:06:05.365691+0000","last_undegraded":"2024-09-12T02:06:05.365691+0000","last_fullsized":"2024-09-12T02:06:05.365691+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:02.345129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":620,"num_write":453,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"266'389","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.963036+0000","last_change":"2024-09-12T00:10:01.261564+0000","last_active":"2024-09-12T02:03:38.963036+0000","last_peered":"2024-09-12T02:03:38.963036+0000","last_clean":"2024-09-12T02:03:38.963036+0000","last_became_active":"2024-09-12T00:10:01.261217+0000","last_became_peered":"2024-09-12T00:10:01.261217+0000","last_unstale":"2024-09-12T02:03:38.963036+0000","last_undegraded":"2024-09-12T02:03:38.963036+0000","last_fullsized":"2024-09-12T02:03:38.963036+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2298,"num_read_kb":2187,"num_write":432,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"266'277","reported_seq":932,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.724742+0000","last_change":"2024-09-12T00:09:59.286394+0000","last_active":"2024-09-12T02:04:18.724742+0000","last_peered":"2024-09-12T02:04:18.724742+0000","last_clean":"2024-09-12T02:04:18.724742+0000","last_became_active":"2024-09-12T00:09:59.281330+0000","last_became_peered":"2024-09-12T00:09:59.281330+0000","last_unstale":"2024-09-12T02:04:18.724742+0000","last_undegraded":"2024-09-12T02:04:18.724742+0000","last_fullsized":"2024-09-12T02:04:18.724742+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:20.081291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9960239,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":414,"num_read_kb":6619,"num_write":1033,"num_write_kb":41386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.739031+0000","last_change":"2024-09-12T00:10:03.273556+0000","last_active":"2024-09-12T02:03:39.739031+0000","last_peered":"2024-09-12T02:03:39.739031+0000","last_clean":"2024-09-12T02:03:39.739031+0000","last_became_active":"2024-09-12T00:10:03.271292+0000","last_became_peered":"2024-09-12T00:10:03.271292+0000","last_unstale":"2024-09-12T02:03:39.739031+0000","last_undegraded":"2024-09-12T02:03:39.739031+0000","last_fullsized":"2024-09-12T02:03:39.739031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"266'315","reported_seq":928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.052520+0000","last_change":"2024-09-12T00:10:05.363194+0000","last_active":"2024-09-12T02:06:07.052520+0000","last_peered":"2024-09-12T02:06:07.052520+0000","last_clean":"2024-09-12T02:06:07.052520+0000","last_became_active":"2024-09-12T00:10:05.361419+0000","last_became_peered":"2024-09-12T00:10:05.361419+0000","last_unstale":"2024-09-12T02:06:07.052520+0000","last_undegraded":"2024-09-12T02:06:07.052520+0000","last_fullsized":"2024-09-12T02:06:07.052520+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:25.749053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70929,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1028,"num_write":412,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"266'821","reported_seq":3116,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.370722+0000","last_change":"2024-09-12T00:10:07.335921+0000","last_active":"2024-09-12T02:06:10.370722+0000","last_peered":"2024-09-12T02:06:10.370722+0000","last_clean":"2024-09-12T02:06:10.370722+0000","last_became_active":"2024-09-12T00:10:07.335181+0000","last_became_peered":"2024-09-12T00:10:07.335181+0000","last_unstale":"2024-09-12T02:06:10.370722+0000","last_undegraded":"2024-09-12T02:06:10.370722+0000","last_fullsized":"2024-09-12T02:06:10.370722+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:17.529066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"266'419","reported_seq":1870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726289+0000","last_change":"2024-09-12T00:10:01.267267+0000","last_active":"2024-09-12T02:02:44.726289+0000","last_peered":"2024-09-12T02:02:44.726289+0000","last_clean":"2024-09-12T02:02:44.726289+0000","last_became_active":"2024-09-12T00:10:01.266204+0000","last_became_peered":"2024-09-12T00:10:01.266204+0000","last_unstale":"2024-09-12T02:02:44.726289+0000","last_undegraded":"2024-09-12T02:02:44.726289+0000","last_fullsized":"2024-09-12T02:02:44.726289+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:02.715482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2063,"num_read_kb":1939,"num_write":461,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"266'303","reported_seq":959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.732009+0000","last_change":"2024-09-12T00:09:59.308323+0000","last_active":"2024-09-12T02:02:53.732009+0000","last_peered":"2024-09-12T02:02:53.732009+0000","last_clean":"2024-09-12T02:02:53.732009+0000","last_became_active":"2024-09-12T00:09:59.307481+0000","last_became_peered":"2024-09-12T00:09:59.307481+0000","last_unstale":"2024-09-12T02:02:53.732009+0000","last_undegraded":"2024-09-12T02:02:53.732009+0000","last_fullsized":"2024-09-12T02:02:53.732009+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.962499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9042945,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":468,"num_read_kb":11316,"num_write":1124,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.729507+0000","last_change":"2024-09-12T00:10:03.261104+0000","last_active":"2024-09-12T02:02:43.729507+0000","last_peered":"2024-09-12T02:02:43.729507+0000","last_clean":"2024-09-12T02:02:43.729507+0000","last_became_active":"2024-09-12T00:10:03.258601+0000","last_became_peered":"2024-09-12T00:10:03.258601+0000","last_unstale":"2024-09-12T02:02:43.729507+0000","last_undegraded":"2024-09-12T02:02:43.729507+0000","last_fullsized":"2024-09-12T02:02:43.729507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:49.169082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"266'473","reported_seq":1170,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.079330+0000","last_change":"2024-09-12T00:10:05.362098+0000","last_active":"2024-09-12T02:06:07.079330+0000","last_peered":"2024-09-12T02:06:07.079330+0000","last_clean":"2024-09-12T02:06:07.079330+0000","last_became_active":"2024-09-12T00:10:05.361273+0000","last_became_peered":"2024-09-12T00:10:05.361273+0000","last_unstale":"2024-09-12T02:06:07.079330+0000","last_undegraded":"2024-09-12T02:06:07.079330+0000","last_fullsized":"2024-09-12T02:06:07.079330+0000","mapping_epoch":31,"log_start":"266'400","ondisk_log_start":"266'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:08.958275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61868,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":760,"num_read_kb":1277,"num_write":586,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679765+0000","last_change":"2024-09-12T00:10:07.317430+0000","last_active":"2024-09-12T02:02:38.679765+0000","last_peered":"2024-09-12T02:02:38.679765+0000","last_clean":"2024-09-12T02:02:38.679765+0000","last_became_active":"2024-09-12T00:10:07.316670+0000","last_became_peered":"2024-09-12T00:10:07.316670+0000","last_unstale":"2024-09-12T02:02:38.679765+0000","last_undegraded":"2024-09-12T02:02:38.679765+0000","last_fullsized":"2024-09-12T02:02:38.679765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.008641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"266'599","reported_seq":1440,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.111464+0000","last_change":"2024-09-12T00:10:09.368828+0000","last_active":"2024-09-12T02:06:07.111464+0000","last_peered":"2024-09-12T02:06:07.111464+0000","last_clean":"2024-09-12T02:06:07.111464+0000","last_became_active":"2024-09-12T00:10:09.368091+0000","last_became_peered":"2024-09-12T00:10:09.368091+0000","last_unstale":"2024-09-12T02:06:07.111464+0000","last_undegraded":"2024-09-12T02:06:07.111464+0000","last_fullsized":"2024-09-12T02:06:07.111464+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:38.890638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1323,"num_read_kb":1320,"num_write":1284,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"266'475","reported_seq":2134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.482999+0000","last_change":"2024-09-12T00:10:01.258535+0000","last_active":"2024-09-12T02:04:57.482999+0000","last_peered":"2024-09-12T02:04:57.482999+0000","last_clean":"2024-09-12T02:04:57.482999+0000","last_became_active":"2024-09-12T00:10:01.257821+0000","last_became_peered":"2024-09-12T00:10:01.257821+0000","last_unstale":"2024-09-12T02:04:57.482999+0000","last_undegraded":"2024-09-12T02:04:57.482999+0000","last_fullsized":"2024-09-12T02:04:57.482999+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:45.635084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2372,"num_write":561,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"266'284","reported_seq":932,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.726017+0000","last_change":"2024-09-12T00:09:59.308750+0000","last_active":"2024-09-12T02:02:28.726017+0000","last_peered":"2024-09-12T02:02:28.726017+0000","last_clean":"2024-09-12T02:02:28.726017+0000","last_became_active":"2024-09-12T00:09:59.308185+0000","last_became_peered":"2024-09-12T00:09:59.308185+0000","last_unstale":"2024-09-12T02:02:28.726017+0000","last_undegraded":"2024-09-12T02:02:28.726017+0000","last_fullsized":"2024-09-12T02:02:28.726017+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:51.112048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5250410,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":405,"num_read_kb":32387,"num_write":1018,"num_write_kb":39559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.691933+0000","last_change":"2024-09-12T00:10:03.250952+0000","last_active":"2024-09-12T02:02:43.691933+0000","last_peered":"2024-09-12T02:02:43.691933+0000","last_clean":"2024-09-12T02:02:43.691933+0000","last_became_active":"2024-09-12T00:10:03.250360+0000","last_became_peered":"2024-09-12T00:10:03.250360+0000","last_unstale":"2024-09-12T02:02:43.691933+0000","last_undegraded":"2024-09-12T02:02:43.691933+0000","last_fullsized":"2024-09-12T02:02:43.691933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:07.747068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"266'304","reported_seq":924,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:53.983324+0000","last_change":"2024-09-12T00:10:05.292211+0000","last_active":"2024-09-12T02:04:53.983324+0000","last_peered":"2024-09-12T02:04:53.983324+0000","last_clean":"2024-09-12T02:04:53.983324+0000","last_became_active":"2024-09-12T00:10:05.288035+0000","last_became_peered":"2024-09-12T00:10:05.288035+0000","last_unstale":"2024-09-12T02:04:53.983324+0000","last_undegraded":"2024-09-12T02:04:53.983324+0000","last_fullsized":"2024-09-12T02:04:53.983324+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:11.001735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":999,"num_write":402,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.952988+0000","last_change":"2024-09-12T00:10:07.340807+0000","last_active":"2024-09-12T02:03:03.952988+0000","last_peered":"2024-09-12T02:03:03.952988+0000","last_clean":"2024-09-12T02:03:03.952988+0000","last_became_active":"2024-09-12T00:10:07.340248+0000","last_became_peered":"2024-09-12T00:10:07.340248+0000","last_unstale":"2024-09-12T02:03:03.952988+0000","last_undegraded":"2024-09-12T02:03:03.952988+0000","last_fullsized":"2024-09-12T02:03:03.952988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.585478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"266'116","reported_seq":643,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:13.737132+0000","last_change":"2024-09-12T00:10:09.361661+0000","last_active":"2024-09-12T02:05:13.737132+0000","last_peered":"2024-09-12T02:05:13.737132+0000","last_clean":"2024-09-12T02:05:13.737132+0000","last_became_active":"2024-09-12T00:10:09.359663+0000","last_became_peered":"2024-09-12T00:10:09.359663+0000","last_unstale":"2024-09-12T02:05:13.737132+0000","last_undegraded":"2024-09-12T02:05:13.737132+0000","last_fullsized":"2024-09-12T02:05:13.737132+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:19.918840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":110,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"266'1041","reported_seq":2833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.717280+0000","last_change":"2024-09-12T00:10:01.263893+0000","last_active":"2024-09-12T02:04:59.717280+0000","last_peered":"2024-09-12T02:04:59.717280+0000","last_clean":"2024-09-12T02:04:59.717280+0000","last_became_active":"2024-09-12T00:10:01.263012+0000","last_became_peered":"2024-09-12T00:10:01.263012+0000","last_unstale":"2024-09-12T02:04:59.717280+0000","last_undegraded":"2024-09-12T02:04:59.717280+0000","last_fullsized":"2024-09-12T02:04:59.717280+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1000,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:53.923315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4917,"num_read_kb":4393,"num_write":1427,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"266'232","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.696896+0000","last_change":"2024-09-12T00:10:31.478771+0000","last_active":"2024-09-12T02:03:03.696896+0000","last_peered":"2024-09-12T02:03:03.696896+0000","last_clean":"2024-09-12T02:03:03.696896+0000","last_became_active":"2024-09-12T00:10:31.477934+0000","last_became_peered":"2024-09-12T00:10:31.477934+0000","last_unstale":"2024-09-12T02:03:03.696896+0000","last_undegraded":"2024-09-12T02:03:03.696896+0000","last_fullsized":"2024-09-12T02:03:03.696896+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:03.480837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8621166,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":331,"num_read_kb":33907,"num_write":869,"num_write_kb":31727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689840+0000","last_change":"2024-09-12T00:10:03.254945+0000","last_active":"2024-09-12T02:02:33.689840+0000","last_peered":"2024-09-12T02:02:33.689840+0000","last_clean":"2024-09-12T02:02:33.689840+0000","last_became_active":"2024-09-12T00:10:03.254328+0000","last_became_peered":"2024-09-12T00:10:03.254328+0000","last_unstale":"2024-09-12T02:02:33.689840+0000","last_undegraded":"2024-09-12T02:02:33.689840+0000","last_fullsized":"2024-09-12T02:02:33.689840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:03.177090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"266'392","reported_seq":1052,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.762044+0000","last_change":"2024-09-12T00:10:05.286921+0000","last_active":"2024-09-12T02:04:58.762044+0000","last_peered":"2024-09-12T02:04:58.762044+0000","last_clean":"2024-09-12T02:04:58.762044+0000","last_became_active":"2024-09-12T00:10:05.285616+0000","last_became_peered":"2024-09-12T00:10:05.285616+0000","last_unstale":"2024-09-12T02:04:58.762044+0000","last_undegraded":"2024-09-12T02:04:58.762044+0000","last_fullsized":"2024-09-12T02:04:58.762044+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:58.157359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54596,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":623,"num_read_kb":1096,"num_write":488,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"266'800","reported_seq":3289,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.425059+0000","last_change":"2024-09-12T00:10:07.320523+0000","last_active":"2024-09-12T02:06:10.425059+0000","last_peered":"2024-09-12T02:06:10.425059+0000","last_clean":"2024-09-12T02:06:10.425059+0000","last_became_active":"2024-09-12T00:10:07.319708+0000","last_became_peered":"2024-09-12T00:10:07.319708+0000","last_unstale":"2024-09-12T02:06:10.425059+0000","last_undegraded":"2024-09-12T02:06:10.425059+0000","last_fullsized":"2024-09-12T02:06:10.425059+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:21.157783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"266'112","reported_seq":638,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.365117+0000","last_change":"2024-09-12T00:10:09.358471+0000","last_active":"2024-09-12T02:06:05.365117+0000","last_peered":"2024-09-12T02:06:05.365117+0000","last_clean":"2024-09-12T02:06:05.365117+0000","last_became_active":"2024-09-12T00:10:09.357682+0000","last_became_peered":"2024-09-12T00:10:09.357682+0000","last_unstale":"2024-09-12T02:06:05.365117+0000","last_undegraded":"2024-09-12T02:06:05.365117+0000","last_fullsized":"2024-09-12T02:06:05.365117+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:14.701980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":265,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"266'779","reported_seq":2339,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.717005+0000","last_change":"2024-09-12T00:10:01.258907+0000","last_active":"2024-09-12T02:02:33.717005+0000","last_peered":"2024-09-12T02:02:33.717005+0000","last_clean":"2024-09-12T02:02:33.717005+0000","last_became_active":"2024-09-12T00:10:01.258536+0000","last_became_peered":"2024-09-12T00:10:01.258536+0000","last_unstale":"2024-09-12T02:02:33.717005+0000","last_undegraded":"2024-09-12T02:02:33.717005+0000","last_fullsized":"2024-09-12T02:02:33.717005+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:13.970208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3854,"num_read_kb":3489,"num_write":1035,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"266'320","reported_seq":978,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.528575+0000","last_change":"2024-09-12T00:09:59.284888+0000","last_active":"2024-09-12T02:06:44.528575+0000","last_peered":"2024-09-12T02:06:44.528575+0000","last_clean":"2024-09-12T02:06:44.528575+0000","last_became_active":"2024-09-12T00:09:59.283882+0000","last_became_peered":"2024-09-12T00:09:59.283882+0000","last_unstale":"2024-09-12T02:06:44.528575+0000","last_undegraded":"2024-09-12T02:06:44.528575+0000","last_fullsized":"2024-09-12T02:06:44.528575+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:55.361739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8414688,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":429,"num_read_kb":25086,"num_write":1143,"num_write_kb":35310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.698033+0000","last_change":"2024-09-12T00:10:03.251387+0000","last_active":"2024-09-12T02:03:08.698033+0000","last_peered":"2024-09-12T02:03:08.698033+0000","last_clean":"2024-09-12T02:03:08.698033+0000","last_became_active":"2024-09-12T00:10:03.250840+0000","last_became_peered":"2024-09-12T00:10:03.250840+0000","last_unstale":"2024-09-12T02:03:08.698033+0000","last_undegraded":"2024-09-12T02:03:08.698033+0000","last_fullsized":"2024-09-12T02:03:08.698033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.168119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"266'528","reported_seq":1210,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.032873+0000","last_change":"2024-09-12T00:10:05.287261+0000","last_active":"2024-09-12T02:06:07.032873+0000","last_peered":"2024-09-12T02:06:07.032873+0000","last_clean":"2024-09-12T02:06:07.032873+0000","last_became_active":"2024-09-12T00:10:05.285823+0000","last_became_peered":"2024-09-12T00:10:05.285823+0000","last_unstale":"2024-09-12T02:06:07.032873+0000","last_undegraded":"2024-09-12T02:06:07.032873+0000","last_fullsized":"2024-09-12T02:06:07.032873+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":500,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:57.618303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116957,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":910,"num_read_kb":1902,"num_write":746,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.692984+0000","last_change":"2024-09-12T00:10:07.321850+0000","last_active":"2024-09-12T02:02:48.692984+0000","last_peered":"2024-09-12T02:02:48.692984+0000","last_clean":"2024-09-12T02:02:48.692984+0000","last_became_active":"2024-09-12T00:10:07.321180+0000","last_became_peered":"2024-09-12T00:10:07.321180+0000","last_unstale":"2024-09-12T02:02:48.692984+0000","last_undegraded":"2024-09-12T02:02:48.692984+0000","last_fullsized":"2024-09-12T02:02:48.692984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:15.729989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"266'133","reported_seq":710,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.508275+0000","last_change":"2024-09-12T00:10:09.361110+0000","last_active":"2024-09-12T02:04:57.508275+0000","last_peered":"2024-09-12T02:04:57.508275+0000","last_clean":"2024-09-12T02:04:57.508275+0000","last_became_active":"2024-09-12T00:10:09.359011+0000","last_became_peered":"2024-09-12T00:10:09.359011+0000","last_unstale":"2024-09-12T02:04:57.508275+0000","last_undegraded":"2024-09-12T02:04:57.508275+0000","last_fullsized":"2024-09-12T02:04:57.508275+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:07.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":320,"num_read_kb":272,"num_write":321,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"266'1103","reported_seq":2643,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.874650+0000","last_change":"2024-09-12T00:10:01.249017+0000","last_active":"2024-09-12T02:04:59.874650+0000","last_peered":"2024-09-12T02:04:59.874650+0000","last_clean":"2024-09-12T02:04:59.874650+0000","last_became_active":"2024-09-12T00:10:01.248297+0000","last_became_peered":"2024-09-12T00:10:01.248297+0000","last_unstale":"2024-09-12T02:04:59.874650+0000","last_undegraded":"2024-09-12T02:04:59.874650+0000","last_fullsized":"2024-09-12T02:04:59.874650+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":1000,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:34.449342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4909,"num_read_kb":4337,"num_write":1501,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"266'257","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.943593+0000","last_change":"2024-09-12T00:10:31.166221+0000","last_active":"2024-09-12T02:02:28.943593+0000","last_peered":"2024-09-12T02:02:28.943593+0000","last_clean":"2024-09-12T02:02:28.943593+0000","last_became_active":"2024-09-12T00:10:31.165905+0000","last_became_peered":"2024-09-12T00:10:31.165905+0000","last_unstale":"2024-09-12T02:02:28.943593+0000","last_undegraded":"2024-09-12T02:02:28.943593+0000","last_fullsized":"2024-09-12T02:02:28.943593+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:02.031075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2274550,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":365,"num_read_kb":2613,"num_write":967,"num_write_kb":17332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,7],"acting":[3,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689930+0000","last_change":"2024-09-12T00:10:03.254698+0000","last_active":"2024-09-12T02:02:33.689930+0000","last_peered":"2024-09-12T02:02:33.689930+0000","last_clean":"2024-09-12T02:02:33.689930+0000","last_became_active":"2024-09-12T00:10:03.254056+0000","last_became_peered":"2024-09-12T00:10:03.254056+0000","last_unstale":"2024-09-12T02:02:33.689930+0000","last_undegraded":"2024-09-12T02:02:33.689930+0000","last_fullsized":"2024-09-12T02:02:33.689930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:22.359128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"266'374","reported_seq":1006,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:53.765078+0000","last_change":"2024-09-12T00:10:05.300463+0000","last_active":"2024-09-12T02:04:53.765078+0000","last_peered":"2024-09-12T02:04:53.765078+0000","last_clean":"2024-09-12T02:04:53.765078+0000","last_became_active":"2024-09-12T00:10:05.299568+0000","last_became_peered":"2024-09-12T00:10:05.299568+0000","last_unstale":"2024-09-12T02:04:53.765078+0000","last_undegraded":"2024-09-12T02:04:53.765078+0000","last_fullsized":"2024-09-12T02:04:53.765078+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:55.828313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67364,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":622,"num_read_kb":1177,"num_write":548,"num_write_kb":410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.726007+0000","last_change":"2024-09-12T00:10:07.335273+0000","last_active":"2024-09-12T02:03:08.726007+0000","last_peered":"2024-09-12T02:03:08.726007+0000","last_clean":"2024-09-12T02:03:08.726007+0000","last_became_active":"2024-09-12T00:10:07.334527+0000","last_became_peered":"2024-09-12T00:10:07.334527+0000","last_unstale":"2024-09-12T02:03:08.726007+0000","last_undegraded":"2024-09-12T02:03:08.726007+0000","last_fullsized":"2024-09-12T02:03:08.726007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:58.243181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"266'171","reported_seq":743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:53.394855+0000","last_change":"2024-09-12T00:10:09.373893+0000","last_active":"2024-09-12T02:05:53.394855+0000","last_peered":"2024-09-12T02:05:53.394855+0000","last_clean":"2024-09-12T02:05:53.394855+0000","last_became_active":"2024-09-12T00:10:09.373318+0000","last_became_peered":"2024-09-12T00:10:09.373318+0000","last_unstale":"2024-09-12T02:05:53.394855+0000","last_undegraded":"2024-09-12T02:05:53.394855+0000","last_fullsized":"2024-09-12T02:05:53.394855+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:12.690531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":275,"num_write":406,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"266'789","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.475401+0000","last_change":"2024-09-12T00:10:01.242970+0000","last_active":"2024-09-12T02:04:57.475401+0000","last_peered":"2024-09-12T02:04:57.475401+0000","last_clean":"2024-09-12T02:04:57.475401+0000","last_became_active":"2024-09-12T00:10:01.242213+0000","last_became_peered":"2024-09-12T00:10:01.242213+0000","last_unstale":"2024-09-12T02:04:57.475401+0000","last_undegraded":"2024-09-12T02:04:57.475401+0000","last_fullsized":"2024-09-12T02:04:57.475401+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3776,"num_read_kb":3427,"num_write":1023,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"266'318","reported_seq":1009,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.709626+0000","last_change":"2024-09-12T00:09:59.299620+0000","last_active":"2024-09-12T02:03:08.709626+0000","last_peered":"2024-09-12T02:03:08.709626+0000","last_clean":"2024-09-12T02:03:08.709626+0000","last_became_active":"2024-09-12T00:09:59.298986+0000","last_became_peered":"2024-09-12T00:09:59.298986+0000","last_unstale":"2024-09-12T02:03:08.709626+0000","last_undegraded":"2024-09-12T02:03:08.709626+0000","last_fullsized":"2024-09-12T02:03:08.709626+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:32.999083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245815,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":517,"num_read_kb":16563,"num_write":1117,"num_write_kb":29581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.678607+0000","last_change":"2024-09-12T00:10:03.262756+0000","last_active":"2024-09-12T02:02:33.678607+0000","last_peered":"2024-09-12T02:02:33.678607+0000","last_clean":"2024-09-12T02:02:33.678607+0000","last_became_active":"2024-09-12T00:10:03.262121+0000","last_became_peered":"2024-09-12T00:10:03.262121+0000","last_unstale":"2024-09-12T02:02:33.678607+0000","last_undegraded":"2024-09-12T02:02:33.678607+0000","last_fullsized":"2024-09-12T02:02:33.678607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:37.206721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"266'385","reported_seq":1035,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:00.682811+0000","last_change":"2024-09-12T00:10:05.295381+0000","last_active":"2024-09-12T02:06:00.682811+0000","last_peered":"2024-09-12T02:06:00.682811+0000","last_clean":"2024-09-12T02:06:00.682811+0000","last_became_active":"2024-09-12T00:10:05.294629+0000","last_became_peered":"2024-09-12T00:10:05.294629+0000","last_unstale":"2024-09-12T02:06:00.682811+0000","last_undegraded":"2024-09-12T02:06:00.682811+0000","last_fullsized":"2024-09-12T02:06:00.682811+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:11.786672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61081,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":618,"num_read_kb":1106,"num_write":486,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"266'745","reported_seq":3283,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.390578+0000","last_change":"2024-09-12T00:10:07.315482+0000","last_active":"2024-09-12T02:06:10.390578+0000","last_peered":"2024-09-12T02:06:10.390578+0000","last_clean":"2024-09-12T02:06:10.390578+0000","last_became_active":"2024-09-12T00:10:07.314777+0000","last_became_peered":"2024-09-12T00:10:07.314777+0000","last_unstale":"2024-09-12T02:06:10.390578+0000","last_undegraded":"2024-09-12T02:06:10.390578+0000","last_fullsized":"2024-09-12T02:06:10.390578+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.137312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"266'132","reported_seq":669,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:56.532648+0000","last_change":"2024-09-12T00:10:09.347267+0000","last_active":"2024-09-12T02:04:56.532648+0000","last_peered":"2024-09-12T02:04:56.532648+0000","last_clean":"2024-09-12T02:04:56.532648+0000","last_became_active":"2024-09-12T00:10:09.346452+0000","last_became_peered":"2024-09-12T00:10:09.346452+0000","last_unstale":"2024-09-12T02:04:56.532648+0000","last_undegraded":"2024-09-12T02:04:56.532648+0000","last_fullsized":"2024-09-12T02:04:56.532648+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:11.712124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":133,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"266'1057","reported_seq":2646,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.763934+0000","last_change":"2024-09-12T00:10:01.265761+0000","last_active":"2024-09-12T02:04:48.763934+0000","last_peered":"2024-09-12T02:04:48.763934+0000","last_clean":"2024-09-12T02:04:48.763934+0000","last_became_active":"2024-09-12T00:10:01.264718+0000","last_became_peered":"2024-09-12T00:10:01.264718+0000","last_unstale":"2024-09-12T02:04:48.763934+0000","last_undegraded":"2024-09-12T02:04:48.763934+0000","last_fullsized":"2024-09-12T02:04:48.763934+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1000,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:21.890638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4853,"num_read_kb":4249,"num_write":1477,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"266'336","reported_seq":1032,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.734343+0000","last_change":"2024-09-12T00:09:59.307052+0000","last_active":"2024-09-12T02:02:38.734343+0000","last_peered":"2024-09-12T02:02:38.734343+0000","last_clean":"2024-09-12T02:02:38.734343+0000","last_became_active":"2024-09-12T00:09:59.301303+0000","last_became_peered":"2024-09-12T00:09:59.301303+0000","last_unstale":"2024-09-12T02:02:38.734343+0000","last_undegraded":"2024-09-12T02:02:38.734343+0000","last_fullsized":"2024-09-12T02:02:38.734343+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:46.678907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1490094,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":548,"num_read_kb":39517,"num_write":1198,"num_write_kb":37758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.121629+0000","last_change":"2024-09-12T00:10:03.274423+0000","last_active":"2024-09-12T02:06:44.121629+0000","last_peered":"2024-09-12T02:06:44.121629+0000","last_clean":"2024-09-12T02:06:44.121629+0000","last_became_active":"2024-09-12T00:10:03.271281+0000","last_became_peered":"2024-09-12T00:10:03.271281+0000","last_unstale":"2024-09-12T02:06:44.121629+0000","last_undegraded":"2024-09-12T02:06:44.121629+0000","last_fullsized":"2024-09-12T02:06:44.121629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:31.849595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"266'147","reported_seq":728,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.946308+0000","last_change":"2024-09-12T00:10:05.363280+0000","last_active":"2024-09-12T02:02:38.946308+0000","last_peered":"2024-09-12T02:02:38.946308+0000","last_clean":"2024-09-12T02:02:38.946308+0000","last_became_active":"2024-09-12T00:10:05.362449+0000","last_became_peered":"2024-09-12T00:10:05.362449+0000","last_unstale":"2024-09-12T02:02:38.946308+0000","last_undegraded":"2024-09-12T02:02:38.946308+0000","last_fullsized":"2024-09-12T02:02:38.946308+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:21.556082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"266'760","reported_seq":3342,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.370416+0000","last_change":"2024-09-12T00:10:07.319650+0000","last_active":"2024-09-12T02:06:10.370416+0000","last_peered":"2024-09-12T02:06:10.370416+0000","last_clean":"2024-09-12T02:06:10.370416+0000","last_became_active":"2024-09-12T00:10:07.318566+0000","last_became_peered":"2024-09-12T00:10:07.318566+0000","last_unstale":"2024-09-12T02:06:10.370416+0000","last_undegraded":"2024-09-12T02:06:10.370416+0000","last_fullsized":"2024-09-12T02:06:10.370416+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:17.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"266'180","reported_seq":710,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:56.908097+0000","last_change":"2024-09-12T00:10:09.353927+0000","last_active":"2024-09-12T02:04:56.908097+0000","last_peered":"2024-09-12T02:04:56.908097+0000","last_clean":"2024-09-12T02:04:56.908097+0000","last_became_active":"2024-09-12T00:10:09.353213+0000","last_became_peered":"2024-09-12T00:10:09.353213+0000","last_unstale":"2024-09-12T02:04:56.908097+0000","last_undegraded":"2024-09-12T02:04:56.908097+0000","last_fullsized":"2024-09-12T02:04:56.908097+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:39.991544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":410,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"266'436","reported_seq":1987,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.686240+0000","last_change":"2024-09-12T00:10:01.256672+0000","last_active":"2024-09-12T02:03:03.686240+0000","last_peered":"2024-09-12T02:03:03.686240+0000","last_clean":"2024-09-12T02:03:03.686240+0000","last_became_active":"2024-09-12T00:10:01.256287+0000","last_became_peered":"2024-09-12T00:10:01.256287+0000","last_unstale":"2024-09-12T02:03:03.686240+0000","last_undegraded":"2024-09-12T02:03:03.686240+0000","last_fullsized":"2024-09-12T02:03:03.686240+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:39.690690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2163,"num_write":523,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"266'393","reported_seq":1331,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.945995+0000","last_change":"2024-09-12T00:10:31.169004+0000","last_active":"2024-09-12T02:02:38.945995+0000","last_peered":"2024-09-12T02:02:38.945995+0000","last_clean":"2024-09-12T02:02:38.945995+0000","last_became_active":"2024-09-12T00:10:31.168654+0000","last_became_peered":"2024-09-12T00:10:31.168654+0000","last_unstale":"2024-09-12T02:02:38.945995+0000","last_undegraded":"2024-09-12T02:02:38.945995+0000","last_fullsized":"2024-09-12T02:02:38.945995+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:25.883597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837649,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":1187,"num_read_kb":67964,"num_write":1285,"num_write_kb":19763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733393+0000","last_change":"2024-09-12T00:10:03.273199+0000","last_active":"2024-09-12T02:02:33.733393+0000","last_peered":"2024-09-12T02:02:33.733393+0000","last_clean":"2024-09-12T02:02:33.733393+0000","last_became_active":"2024-09-12T00:10:03.272284+0000","last_became_peered":"2024-09-12T00:10:03.272284+0000","last_unstale":"2024-09-12T02:02:33.733393+0000","last_undegraded":"2024-09-12T02:02:33.733393+0000","last_fullsized":"2024-09-12T02:02:33.733393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:34.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"266'532","reported_seq":1209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.070439+0000","last_change":"2024-09-12T00:10:05.301341+0000","last_active":"2024-09-12T02:06:07.070439+0000","last_peered":"2024-09-12T02:06:07.070439+0000","last_clean":"2024-09-12T02:06:07.070439+0000","last_became_active":"2024-09-12T00:10:05.300354+0000","last_became_peered":"2024-09-12T00:10:05.300354+0000","last_unstale":"2024-09-12T02:06:07.070439+0000","last_undegraded":"2024-09-12T02:06:07.070439+0000","last_fullsized":"2024-09-12T02:06:07.070439+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:12.920116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56958,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1425,"num_read_kb":1877,"num_write":2036,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.703060+0000","last_change":"2024-09-12T00:10:07.340586+0000","last_active":"2024-09-12T02:02:38.703060+0000","last_peered":"2024-09-12T02:02:38.703060+0000","last_clean":"2024-09-12T02:02:38.703060+0000","last_became_active":"2024-09-12T00:10:07.340008+0000","last_became_peered":"2024-09-12T00:10:07.340008+0000","last_unstale":"2024-09-12T02:02:38.703060+0000","last_undegraded":"2024-09-12T02:02:38.703060+0000","last_fullsized":"2024-09-12T02:02:38.703060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:10.322035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"266'137","reported_seq":680,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679739+0000","last_change":"2024-09-12T00:10:09.373165+0000","last_active":"2024-09-12T02:02:38.679739+0000","last_peered":"2024-09-12T02:02:38.679739+0000","last_clean":"2024-09-12T02:02:38.679739+0000","last_became_active":"2024-09-12T00:10:09.372231+0000","last_became_peered":"2024-09-12T00:10:09.372231+0000","last_unstale":"2024-09-12T02:02:38.679739+0000","last_undegraded":"2024-09-12T02:02:38.679739+0000","last_fullsized":"2024-09-12T02:02:38.679739+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:27.875059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"266'755","reported_seq":2305,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.708542+0000","last_change":"2024-09-12T00:10:01.263233+0000","last_active":"2024-09-12T02:03:03.708542+0000","last_peered":"2024-09-12T02:03:03.708542+0000","last_clean":"2024-09-12T02:03:03.708542+0000","last_became_active":"2024-09-12T00:10:01.262490+0000","last_became_peered":"2024-09-12T00:10:01.262490+0000","last_unstale":"2024-09-12T02:03:03.708542+0000","last_undegraded":"2024-09-12T02:03:03.708542+0000","last_fullsized":"2024-09-12T02:03:03.708542+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:53.059969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3216,"num_write":966,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.749663+0000","last_change":"2024-09-12T00:09:40.226824+0000","last_active":"2024-09-12T02:04:08.749663+0000","last_peered":"2024-09-12T02:04:08.749663+0000","last_clean":"2024-09-12T02:04:08.749663+0000","last_became_active":"2024-09-12T00:09:40.224430+0000","last_became_peered":"2024-09-12T00:09:40.224430+0000","last_unstale":"2024-09-12T02:04:08.749663+0000","last_undegraded":"2024-09-12T02:04:08.749663+0000","last_fullsized":"2024-09-12T02:04:08.749663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_clean_scrub_stamp":"2024-09-12T00:09:39.068560+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.078225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":557,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:24.749088+0000","last_change":"2024-09-12T00:09:48.187085+0000","last_active":"2024-09-12T02:04:24.749088+0000","last_peered":"2024-09-12T02:04:24.749088+0000","last_clean":"2024-09-12T02:04:24.749088+0000","last_became_active":"2024-09-12T00:09:46.162330+0000","last_became_peered":"2024-09-12T00:09:46.162330+0000","last_unstale":"2024-09-12T02:04:24.749088+0000","last_undegraded":"2024-09-12T02:04:24.749088+0000","last_fullsized":"2024-09-12T02:04:24.749088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:31.598024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090615300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"266'259","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.977405+0000","last_change":"2024-09-12T00:09:59.310501+0000","last_active":"2024-09-12T02:04:33.977405+0000","last_peered":"2024-09-12T02:04:33.977405+0000","last_clean":"2024-09-12T02:04:33.977405+0000","last_became_active":"2024-09-12T00:09:59.310092+0000","last_became_peered":"2024-09-12T00:09:59.310092+0000","last_unstale":"2024-09-12T02:04:33.977405+0000","last_undegraded":"2024-09-12T02:04:33.977405+0000","last_fullsized":"2024-09-12T02:04:33.977405+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:33.851016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571160,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":432,"num_read_kb":13893,"num_write":956,"num_write_kb":29182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"37'5","reported_seq":1008,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:06.545908+0000","last_change":"2024-09-12T00:10:03.266852+0000","last_active":"2024-09-12T02:06:06.545908+0000","last_peered":"2024-09-12T02:06:06.545908+0000","last_clean":"2024-09-12T02:06:06.545908+0000","last_became_active":"2024-09-12T00:10:03.261183+0000","last_became_peered":"2024-09-12T00:10:03.261183+0000","last_unstale":"2024-09-12T02:06:06.545908+0000","last_undegraded":"2024-09-12T02:06:06.545908+0000","last_fullsized":"2024-09-12T02:06:06.545908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:03.208998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"266'795","reported_seq":1534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.441198+0000","last_change":"2024-09-12T00:10:05.294884+0000","last_active":"2024-09-12T02:06:44.441198+0000","last_peered":"2024-09-12T02:06:44.441198+0000","last_clean":"2024-09-12T02:06:44.441198+0000","last_became_active":"2024-09-12T00:10:05.294267+0000","last_became_peered":"2024-09-12T00:10:05.294267+0000","last_unstale":"2024-09-12T02:06:44.441198+0000","last_undegraded":"2024-09-12T02:06:44.441198+0000","last_fullsized":"2024-09-12T02:06:44.441198+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:05.135490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187509,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1528,"num_read_kb":3059,"num_write":1522,"num_write_kb":1361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.720998+0000","last_change":"2024-09-12T00:10:07.324124+0000","last_active":"2024-09-12T02:02:48.720998+0000","last_peered":"2024-09-12T02:02:48.720998+0000","last_clean":"2024-09-12T02:02:48.720998+0000","last_became_active":"2024-09-12T00:10:07.323398+0000","last_became_peered":"2024-09-12T00:10:07.323398+0000","last_unstale":"2024-09-12T02:02:48.720998+0000","last_undegraded":"2024-09-12T02:02:48.720998+0000","last_fullsized":"2024-09-12T02:02:48.720998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:42.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"266'247","reported_seq":998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.733816+0000","last_change":"2024-09-12T00:10:09.374413+0000","last_active":"2024-09-12T02:04:58.733816+0000","last_peered":"2024-09-12T02:04:58.733816+0000","last_clean":"2024-09-12T02:04:58.733816+0000","last_became_active":"2024-09-12T00:10:09.373661+0000","last_became_peered":"2024-09-12T00:10:09.373661+0000","last_unstale":"2024-09-12T02:04:58.733816+0000","last_undegraded":"2024-09-12T02:04:58.733816+0000","last_fullsized":"2024-09-12T02:04:58.733816+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.718166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":498,"num_write":430,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"266'1252","reported_seq":3052,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.719612+0000","last_change":"2024-09-12T00:10:31.472451+0000","last_active":"2024-09-12T02:02:43.719612+0000","last_peered":"2024-09-12T02:02:43.719612+0000","last_clean":"2024-09-12T02:02:43.719612+0000","last_became_active":"2024-09-12T00:10:31.471885+0000","last_became_peered":"2024-09-12T00:10:31.471885+0000","last_unstale":"2024-09-12T02:02:43.719612+0000","last_undegraded":"2024-09-12T02:02:43.719612+0000","last_fullsized":"2024-09-12T02:02:43.719612+0000","mapping_epoch":38,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:24.536885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6022,"num_read_kb":5329,"num_write":1728,"num_write_kb":723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.750901+0000","last_change":"2024-09-12T00:09:48.283186+0000","last_active":"2024-09-12T02:04:13.750901+0000","last_peered":"2024-09-12T02:04:13.750901+0000","last_clean":"2024-09-12T02:04:13.750901+0000","last_became_active":"2024-09-12T00:09:46.164248+0000","last_became_peered":"2024-09-12T00:09:46.164248+0000","last_unstale":"2024-09-12T02:04:13.750901+0000","last_undegraded":"2024-09-12T02:04:13.750901+0000","last_fullsized":"2024-09-12T02:04:13.750901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:55.257275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099742600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"266'285","reported_seq":933,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.534849+0000","last_change":"2024-09-12T00:09:59.294360+0000","last_active":"2024-09-12T02:04:33.534849+0000","last_peered":"2024-09-12T02:04:33.534849+0000","last_clean":"2024-09-12T02:04:33.534849+0000","last_became_active":"2024-09-12T00:09:59.293880+0000","last_became_peered":"2024-09-12T00:09:59.293880+0000","last_unstale":"2024-09-12T02:04:33.534849+0000","last_undegraded":"2024-09-12T02:04:33.534849+0000","last_fullsized":"2024-09-12T02:04:33.534849+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:11.691652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5863766,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":400,"num_read_kb":16782,"num_write":1044,"num_write_kb":42263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726532+0000","last_change":"2024-09-12T00:10:03.273620+0000","last_active":"2024-09-12T02:02:44.726532+0000","last_peered":"2024-09-12T02:02:44.726532+0000","last_clean":"2024-09-12T02:02:44.726532+0000","last_became_active":"2024-09-12T00:10:03.271454+0000","last_became_peered":"2024-09-12T00:10:03.271454+0000","last_unstale":"2024-09-12T02:02:44.726532+0000","last_undegraded":"2024-09-12T02:02:44.726532+0000","last_fullsized":"2024-09-12T02:02:44.726532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:12.327352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"266'1434","reported_seq":3812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.366500+0000","last_change":"2024-09-12T00:10:05.295762+0000","last_active":"2024-09-12T02:06:10.366500+0000","last_peered":"2024-09-12T02:06:10.366500+0000","last_clean":"2024-09-12T02:06:10.366500+0000","last_became_active":"2024-09-12T00:10:05.295058+0000","last_became_peered":"2024-09-12T00:10:05.295058+0000","last_unstale":"2024-09-12T02:06:10.366500+0000","last_undegraded":"2024-09-12T02:06:10.366500+0000","last_fullsized":"2024-09-12T02:06:10.366500+0000","mapping_epoch":31,"log_start":"266'1400","ondisk_log_start":"266'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:03.236457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204440,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2238,"num_read_kb":3798,"num_write":1368,"num_write_kb":1151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.734237+0000","last_change":"2024-09-12T00:10:07.320656+0000","last_active":"2024-09-12T02:03:03.734237+0000","last_peered":"2024-09-12T02:03:03.734237+0000","last_clean":"2024-09-12T02:03:03.734237+0000","last_became_active":"2024-09-12T00:10:07.319957+0000","last_became_peered":"2024-09-12T00:10:07.319957+0000","last_unstale":"2024-09-12T02:03:03.734237+0000","last_undegraded":"2024-09-12T02:03:03.734237+0000","last_fullsized":"2024-09-12T02:03:03.734237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:05.134552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"266'86","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.689469+0000","last_change":"2024-09-12T00:10:09.431550+0000","last_active":"2024-09-12T02:03:18.689469+0000","last_peered":"2024-09-12T02:03:18.689469+0000","last_clean":"2024-09-12T02:03:18.689469+0000","last_became_active":"2024-09-12T00:10:09.430727+0000","last_became_peered":"2024-09-12T00:10:09.430727+0000","last_unstale":"2024-09-12T02:03:18.689469+0000","last_undegraded":"2024-09-12T02:03:18.689469+0000","last_fullsized":"2024-09-12T02:03:18.689469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:34.946722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"266'638","reported_seq":2418,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681419+0000","last_change":"2024-09-12T00:10:01.277654+0000","last_active":"2024-09-12T02:02:43.681419+0000","last_peered":"2024-09-12T02:02:43.681419+0000","last_clean":"2024-09-12T02:02:43.681419+0000","last_became_active":"2024-09-12T00:10:01.277302+0000","last_became_peered":"2024-09-12T00:10:01.277302+0000","last_unstale":"2024-09-12T02:02:43.681419+0000","last_undegraded":"2024-09-12T02:02:43.681419+0000","last_fullsized":"2024-09-12T02:02:43.681419+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.220111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3369,"num_read_kb":3119,"num_write":789,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":554,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.713874+0000","last_change":"2024-09-12T00:09:48.355061+0000","last_active":"2024-09-12T02:04:23.713874+0000","last_peered":"2024-09-12T02:04:23.713874+0000","last_clean":"2024-09-12T02:04:23.713874+0000","last_became_active":"2024-09-12T00:09:46.179853+0000","last_became_peered":"2024-09-12T00:09:46.179853+0000","last_unstale":"2024-09-12T02:04:23.713874+0000","last_undegraded":"2024-09-12T02:04:23.713874+0000","last_fullsized":"2024-09-12T02:04:23.713874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:34.347111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056473999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"266'271","reported_seq":977,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:04.556373+0000","last_change":"2024-09-12T00:09:59.317598+0000","last_active":"2024-09-12T02:06:04.556373+0000","last_peered":"2024-09-12T02:06:04.556373+0000","last_clean":"2024-09-12T02:06:04.556373+0000","last_became_active":"2024-09-12T00:09:59.317172+0000","last_became_peered":"2024-09-12T00:09:59.317172+0000","last_unstale":"2024-09-12T02:06:04.556373+0000","last_undegraded":"2024-09-12T02:06:04.556373+0000","last_fullsized":"2024-09-12T02:06:04.556373+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:24.166492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14293531,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":445,"num_read_kb":79957,"num_write":1018,"num_write_kb":20693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.692067+0000","last_change":"2024-09-12T00:10:03.275174+0000","last_active":"2024-09-12T02:02:43.692067+0000","last_peered":"2024-09-12T02:02:43.692067+0000","last_clean":"2024-09-12T02:02:43.692067+0000","last_became_active":"2024-09-12T00:10:03.274519+0000","last_became_peered":"2024-09-12T00:10:03.274519+0000","last_unstale":"2024-09-12T02:02:43.692067+0000","last_undegraded":"2024-09-12T02:02:43.692067+0000","last_fullsized":"2024-09-12T02:02:43.692067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:46.889133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"266'397","reported_seq":2386,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.496951+0000","last_change":"2024-09-12T00:10:05.366148+0000","last_active":"2024-09-12T02:06:03.496951+0000","last_peered":"2024-09-12T02:06:03.496951+0000","last_clean":"2024-09-12T02:06:03.496951+0000","last_became_active":"2024-09-12T00:10:05.365417+0000","last_became_peered":"2024-09-12T00:10:05.365417+0000","last_unstale":"2024-09-12T02:06:03.496951+0000","last_undegraded":"2024-09-12T02:06:03.496951+0000","last_fullsized":"2024-09-12T02:06:03.496951+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:25.902387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":388,"num_read_kb":374,"num_write":387,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718342+0000","last_change":"2024-09-12T00:10:07.322896+0000","last_active":"2024-09-12T02:02:38.718342+0000","last_peered":"2024-09-12T02:02:38.718342+0000","last_clean":"2024-09-12T02:02:38.718342+0000","last_became_active":"2024-09-12T00:10:07.319786+0000","last_became_peered":"2024-09-12T00:10:07.319786+0000","last_unstale":"2024-09-12T02:02:38.718342+0000","last_undegraded":"2024-09-12T02:02:38.718342+0000","last_fullsized":"2024-09-12T02:02:38.718342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:38.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"266'255","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.247959+0000","last_change":"2024-09-12T00:10:09.366267+0000","last_active":"2024-09-12T02:05:00.247959+0000","last_peered":"2024-09-12T02:05:00.247959+0000","last_clean":"2024-09-12T02:05:00.247959+0000","last_became_active":"2024-09-12T00:10:09.365558+0000","last_became_peered":"2024-09-12T00:10:09.365558+0000","last_unstale":"2024-09-12T02:05:00.247959+0000","last_undegraded":"2024-09-12T02:05:00.247959+0000","last_fullsized":"2024-09-12T02:05:00.247959+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:50.920683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":520,"num_write":557,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"266'478","reported_seq":2049,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708234+0000","last_change":"2024-09-12T00:10:01.257820+0000","last_active":"2024-09-12T02:04:38.708234+0000","last_peered":"2024-09-12T02:04:38.708234+0000","last_clean":"2024-09-12T02:04:38.708234+0000","last_became_active":"2024-09-12T00:10:01.256107+0000","last_became_peered":"2024-09-12T00:10:01.256107+0000","last_unstale":"2024-09-12T02:04:38.708234+0000","last_undegraded":"2024-09-12T02:04:38.708234+0000","last_fullsized":"2024-09-12T02:04:38.708234+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:11.113107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2517,"num_read_kb":2366,"num_write":564,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:24.749016+0000","last_change":"2024-09-12T00:09:48.188360+0000","last_active":"2024-09-12T02:04:24.749016+0000","last_peered":"2024-09-12T02:04:24.749016+0000","last_clean":"2024-09-12T02:04:24.749016+0000","last_became_active":"2024-09-12T00:09:46.161046+0000","last_became_peered":"2024-09-12T00:09:46.161046+0000","last_unstale":"2024-09-12T02:04:24.749016+0000","last_undegraded":"2024-09-12T02:04:24.749016+0000","last_fullsized":"2024-09-12T02:04:24.749016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:21.375528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022130560000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"266'330","reported_seq":985,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.696765+0000","last_change":"2024-09-12T00:10:31.474540+0000","last_active":"2024-09-12T02:03:03.696765+0000","last_peered":"2024-09-12T02:03:03.696765+0000","last_clean":"2024-09-12T02:03:03.696765+0000","last_became_active":"2024-09-12T00:10:31.473891+0000","last_became_peered":"2024-09-12T00:10:31.473891+0000","last_unstale":"2024-09-12T02:03:03.696765+0000","last_undegraded":"2024-09-12T02:03:03.696765+0000","last_fullsized":"2024-09-12T02:03:03.696765+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:20.027100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8222059,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":515,"num_read_kb":35034,"num_write":1165,"num_write_kb":35348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.724461+0000","last_change":"2024-09-12T00:10:03.265946+0000","last_active":"2024-09-12T02:03:03.724461+0000","last_peered":"2024-09-12T02:03:03.724461+0000","last_clean":"2024-09-12T02:03:03.724461+0000","last_became_active":"2024-09-12T00:10:03.264991+0000","last_became_peered":"2024-09-12T00:10:03.264991+0000","last_unstale":"2024-09-12T02:03:03.724461+0000","last_undegraded":"2024-09-12T02:03:03.724461+0000","last_fullsized":"2024-09-12T02:03:03.724461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:41.880299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"266'207","reported_seq":818,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.945244+0000","last_change":"2024-09-12T00:10:05.287107+0000","last_active":"2024-09-12T02:06:03.945244+0000","last_peered":"2024-09-12T02:06:03.945244+0000","last_clean":"2024-09-12T02:06:03.945244+0000","last_became_active":"2024-09-12T00:10:05.286433+0000","last_became_peered":"2024-09-12T00:10:05.286433+0000","last_unstale":"2024-09-12T02:06:03.945244+0000","last_undegraded":"2024-09-12T02:06:03.945244+0000","last_fullsized":"2024-09-12T02:06:03.945244+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:16.708268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":276,"num_read_kb":269,"num_write":202,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.705489+0000","last_change":"2024-09-12T00:10:07.331079+0000","last_active":"2024-09-12T02:02:48.705489+0000","last_peered":"2024-09-12T02:02:48.705489+0000","last_clean":"2024-09-12T02:02:48.705489+0000","last_became_active":"2024-09-12T00:10:07.329823+0000","last_became_peered":"2024-09-12T00:10:07.329823+0000","last_unstale":"2024-09-12T02:02:48.705489+0000","last_undegraded":"2024-09-12T02:02:48.705489+0000","last_fullsized":"2024-09-12T02:02:48.705489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.018430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"266'101","reported_seq":681,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.757399+0000","last_change":"2024-09-12T00:10:09.368892+0000","last_active":"2024-09-12T02:04:59.757399+0000","last_peered":"2024-09-12T02:04:59.757399+0000","last_clean":"2024-09-12T02:04:59.757399+0000","last_became_active":"2024-09-12T00:10:09.368176+0000","last_became_peered":"2024-09-12T00:10:09.368176+0000","last_unstale":"2024-09-12T02:04:59.757399+0000","last_undegraded":"2024-09-12T02:04:59.757399+0000","last_fullsized":"2024-09-12T02:04:59.757399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:23.692773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":222,"num_read_kb":212,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"266'444","reported_seq":2071,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708133+0000","last_change":"2024-09-12T00:10:01.276074+0000","last_active":"2024-09-12T02:04:38.708133+0000","last_peered":"2024-09-12T02:04:38.708133+0000","last_clean":"2024-09-12T02:04:38.708133+0000","last_became_active":"2024-09-12T00:10:01.275794+0000","last_became_peered":"2024-09-12T00:10:01.275794+0000","last_unstale":"2024-09-12T02:04:38.708133+0000","last_undegraded":"2024-09-12T02:04:38.708133+0000","last_fullsized":"2024-09-12T02:04:38.708133+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:44.490041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":509,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"266'295","reported_seq":1000,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.663615+0000","last_change":"2024-09-12T00:09:59.264987+0000","last_active":"2024-09-12T02:06:44.663615+0000","last_peered":"2024-09-12T02:06:44.663615+0000","last_clean":"2024-09-12T02:06:44.663615+0000","last_became_active":"2024-09-12T00:09:59.262793+0000","last_became_peered":"2024-09-12T00:09:59.262793+0000","last_unstale":"2024-09-12T02:06:44.663615+0000","last_undegraded":"2024-09-12T02:06:44.663615+0000","last_fullsized":"2024-09-12T02:06:44.663615+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:14.855206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9586267,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":496,"num_read_kb":23140,"num_write":1070,"num_write_kb":26459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":552,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.704660+0000","last_change":"2024-09-12T00:09:48.193791+0000","last_active":"2024-09-12T02:04:23.704660+0000","last_peered":"2024-09-12T02:04:23.704660+0000","last_clean":"2024-09-12T02:04:23.704660+0000","last_became_active":"2024-09-12T00:09:46.178541+0000","last_became_peered":"2024-09-12T00:09:46.178541+0000","last_unstale":"2024-09-12T02:04:23.704660+0000","last_undegraded":"2024-09-12T02:04:23.704660+0000","last_fullsized":"2024-09-12T02:04:23.704660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:55.733179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00107328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536250+0000","last_change":"2024-09-12T00:10:03.258979+0000","last_active":"2024-09-12T02:04:38.536250+0000","last_peered":"2024-09-12T02:04:38.536250+0000","last_clean":"2024-09-12T02:04:38.536250+0000","last_became_active":"2024-09-12T00:10:03.258209+0000","last_became_peered":"2024-09-12T00:10:03.258209+0000","last_unstale":"2024-09-12T02:04:38.536250+0000","last_undegraded":"2024-09-12T02:04:38.536250+0000","last_fullsized":"2024-09-12T02:04:38.536250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:09.760649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"266'721","reported_seq":1460,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.105802+0000","last_change":"2024-09-12T00:10:05.292028+0000","last_active":"2024-09-12T02:06:07.105802+0000","last_peered":"2024-09-12T02:06:07.105802+0000","last_clean":"2024-09-12T02:06:07.105802+0000","last_became_active":"2024-09-12T00:10:05.289058+0000","last_became_peered":"2024-09-12T00:10:05.289058+0000","last_unstale":"2024-09-12T02:06:07.105802+0000","last_undegraded":"2024-09-12T02:06:07.105802+0000","last_fullsized":"2024-09-12T02:06:07.105802+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:22.158935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106132,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1142,"num_read_kb":2068,"num_write":1038,"num_write_kb":779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.734389+0000","last_change":"2024-09-12T00:10:07.327012+0000","last_active":"2024-09-12T02:02:38.734389+0000","last_peered":"2024-09-12T02:02:38.734389+0000","last_clean":"2024-09-12T02:02:38.734389+0000","last_became_active":"2024-09-12T00:10:07.326146+0000","last_became_peered":"2024-09-12T00:10:07.326146+0000","last_unstale":"2024-09-12T02:02:38.734389+0000","last_undegraded":"2024-09-12T02:02:38.734389+0000","last_fullsized":"2024-09-12T02:02:38.734389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:31.757093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"266'134","reported_seq":658,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.013228+0000","last_change":"2024-09-12T00:10:09.434271+0000","last_active":"2024-09-12T02:04:59.013228+0000","last_peered":"2024-09-12T02:04:59.013228+0000","last_clean":"2024-09-12T02:04:59.013228+0000","last_became_active":"2024-09-12T00:10:09.433444+0000","last_became_peered":"2024-09-12T00:10:09.433444+0000","last_unstale":"2024-09-12T02:04:59.013228+0000","last_undegraded":"2024-09-12T02:04:59.013228+0000","last_fullsized":"2024-09-12T02:04:59.013228+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:56.732745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"266'402","reported_seq":1906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536207+0000","last_change":"2024-09-12T00:10:01.282757+0000","last_active":"2024-09-12T02:04:38.536207+0000","last_peered":"2024-09-12T02:04:38.536207+0000","last_clean":"2024-09-12T02:04:38.536207+0000","last_became_active":"2024-09-12T00:10:01.282373+0000","last_became_peered":"2024-09-12T00:10:01.282373+0000","last_unstale":"2024-09-12T02:04:38.536207+0000","last_undegraded":"2024-09-12T02:04:38.536207+0000","last_fullsized":"2024-09-12T02:04:38.536207+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:40.586380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2068,"num_read_kb":1970,"num_write":460,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"266'350","reported_seq":1130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.706957+0000","last_change":"2024-09-12T00:09:59.251699+0000","last_active":"2024-09-12T02:04:33.706957+0000","last_peered":"2024-09-12T02:04:33.706957+0000","last_clean":"2024-09-12T02:04:33.706957+0000","last_became_active":"2024-09-12T00:09:59.251235+0000","last_became_peered":"2024-09-12T00:09:59.251235+0000","last_unstale":"2024-09-12T02:04:33.706957+0000","last_undegraded":"2024-09-12T02:04:33.706957+0000","last_fullsized":"2024-09-12T02:04:33.706957+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:43.287785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11137230,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":799,"num_read_kb":78667,"num_write":1208,"num_write_kb":36022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":549,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.729609+0000","last_change":"2024-09-12T00:09:48.283460+0000","last_active":"2024-09-12T02:02:43.729609+0000","last_peered":"2024-09-12T02:02:43.729609+0000","last_clean":"2024-09-12T02:02:43.729609+0000","last_became_active":"2024-09-12T00:09:46.177603+0000","last_became_peered":"2024-09-12T00:09:46.177603+0000","last_unstale":"2024-09-12T02:02:43.729609+0000","last_undegraded":"2024-09-12T02:02:43.729609+0000","last_fullsized":"2024-09-12T02:02:43.729609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:26.898658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729177+0000","last_change":"2024-09-12T00:10:03.259727+0000","last_active":"2024-09-12T02:04:38.729177+0000","last_peered":"2024-09-12T02:04:38.729177+0000","last_clean":"2024-09-12T02:04:38.729177+0000","last_became_active":"2024-09-12T00:10:03.258944+0000","last_became_peered":"2024-09-12T00:10:03.258944+0000","last_unstale":"2024-09-12T02:04:38.729177+0000","last_undegraded":"2024-09-12T02:04:38.729177+0000","last_fullsized":"2024-09-12T02:04:38.729177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:58.686752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"266'257","reported_seq":900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679693+0000","last_change":"2024-09-12T00:10:05.367281+0000","last_active":"2024-09-12T02:02:38.679693+0000","last_peered":"2024-09-12T02:02:38.679693+0000","last_clean":"2024-09-12T02:02:38.679693+0000","last_became_active":"2024-09-12T00:10:05.366757+0000","last_became_peered":"2024-09-12T00:10:05.366757+0000","last_unstale":"2024-09-12T02:02:38.679693+0000","last_undegraded":"2024-09-12T02:02:38.679693+0000","last_fullsized":"2024-09-12T02:02:38.679693+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:45.057953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":341,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"266'824","reported_seq":5672,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.363176+0000","last_change":"2024-09-12T00:10:07.314520+0000","last_active":"2024-09-12T02:06:44.363176+0000","last_peered":"2024-09-12T02:06:44.363176+0000","last_clean":"2024-09-12T02:06:44.363176+0000","last_became_active":"2024-09-12T00:10:07.313773+0000","last_became_peered":"2024-09-12T00:10:07.313773+0000","last_unstale":"2024-09-12T02:06:44.363176+0000","last_undegraded":"2024-09-12T02:06:44.363176+0000","last_fullsized":"2024-09-12T02:06:44.363176+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:32.654308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"266'129","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.986570+0000","last_change":"2024-09-12T00:10:09.431402+0000","last_active":"2024-09-12T02:05:08.986570+0000","last_peered":"2024-09-12T02:05:08.986570+0000","last_clean":"2024-09-12T02:05:08.986570+0000","last_became_active":"2024-09-12T00:10:09.430396+0000","last_became_peered":"2024-09-12T00:10:09.430396+0000","last_unstale":"2024-09-12T02:05:08.986570+0000","last_undegraded":"2024-09-12T02:05:08.986570+0000","last_fullsized":"2024-09-12T02:05:08.986570+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:54.666346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"266'481","reported_seq":2194,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.725448+0000","last_change":"2024-09-12T00:10:01.261429+0000","last_active":"2024-09-12T02:04:59.725448+0000","last_peered":"2024-09-12T02:04:59.725448+0000","last_clean":"2024-09-12T02:04:59.725448+0000","last_became_active":"2024-09-12T00:10:01.261139+0000","last_became_peered":"2024-09-12T00:10:01.261139+0000","last_unstale":"2024-09-12T02:04:59.725448+0000","last_undegraded":"2024-09-12T02:04:59.725448+0000","last_fullsized":"2024-09-12T02:04:59.725448+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:23.775837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2740,"num_read_kb":2607,"num_write":578,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"266'330","reported_seq":1138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.946409+0000","last_change":"2024-09-12T00:09:59.280417+0000","last_active":"2024-09-12T02:02:38.946409+0000","last_peered":"2024-09-12T02:02:38.946409+0000","last_clean":"2024-09-12T02:02:38.946409+0000","last_became_active":"2024-09-12T00:09:59.280008+0000","last_became_peered":"2024-09-12T00:09:59.280008+0000","last_unstale":"2024-09-12T02:02:38.946409+0000","last_undegraded":"2024-09-12T02:02:38.946409+0000","last_fullsized":"2024-09-12T02:02:38.946409+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:21.353806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3246317,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":636,"num_read_kb":14006,"num_write":1222,"num_write_kb":38960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":549,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.677491+0000","last_change":"2024-09-12T00:09:48.193796+0000","last_active":"2024-09-12T02:02:28.677491+0000","last_peered":"2024-09-12T02:02:28.677491+0000","last_clean":"2024-09-12T02:02:28.677491+0000","last_became_active":"2024-09-12T00:09:46.162309+0000","last_became_peered":"2024-09-12T00:09:46.162309+0000","last_unstale":"2024-09-12T02:02:28.677491+0000","last_undegraded":"2024-09-12T02:02:28.677491+0000","last_fullsized":"2024-09-12T02:02:28.677491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:57.198136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010860449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.761245+0000","last_change":"2024-09-12T00:10:03.257249+0000","last_active":"2024-09-12T02:04:38.761245+0000","last_peered":"2024-09-12T02:04:38.761245+0000","last_clean":"2024-09-12T02:04:38.761245+0000","last_became_active":"2024-09-12T00:10:03.256290+0000","last_became_peered":"2024-09-12T00:10:03.256290+0000","last_unstale":"2024-09-12T02:04:38.761245+0000","last_undegraded":"2024-09-12T02:04:38.761245+0000","last_fullsized":"2024-09-12T02:04:38.761245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:00.212778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"266'177","reported_seq":784,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.734473+0000","last_change":"2024-09-12T00:10:05.294735+0000","last_active":"2024-09-12T02:02:38.734473+0000","last_peered":"2024-09-12T02:02:38.734473+0000","last_clean":"2024-09-12T02:02:38.734473+0000","last_became_active":"2024-09-12T00:10:05.293955+0000","last_became_peered":"2024-09-12T00:10:05.293955+0000","last_unstale":"2024-09-12T02:02:38.734473+0000","last_undegraded":"2024-09-12T02:02:38.734473+0000","last_fullsized":"2024-09-12T02:02:38.734473+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:54.115604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":227,"num_write":154,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"266'822","reported_seq":5152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.370514+0000","last_change":"2024-09-12T00:10:07.334366+0000","last_active":"2024-09-12T02:06:10.370514+0000","last_peered":"2024-09-12T02:06:10.370514+0000","last_clean":"2024-09-12T02:06:10.370514+0000","last_became_active":"2024-09-12T00:10:07.333642+0000","last_became_peered":"2024-09-12T00:10:07.333642+0000","last_unstale":"2024-09-12T02:06:10.370514+0000","last_undegraded":"2024-09-12T02:06:10.370514+0000","last_fullsized":"2024-09-12T02:06:10.370514+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:25.710728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"266'301","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718365+0000","last_change":"2024-09-12T00:10:09.359415+0000","last_active":"2024-09-12T02:02:38.718365+0000","last_peered":"2024-09-12T02:02:38.718365+0000","last_clean":"2024-09-12T02:02:38.718365+0000","last_became_active":"2024-09-12T00:10:09.358708+0000","last_became_peered":"2024-09-12T00:10:09.358708+0000","last_unstale":"2024-09-12T02:02:38.718365+0000","last_undegraded":"2024-09-12T02:02:38.718365+0000","last_fullsized":"2024-09-12T02:02:38.718365+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:01.334064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":399,"num_read_kb":387,"num_write":681,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"266'1115","reported_seq":2647,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.761286+0000","last_change":"2024-09-12T00:10:01.274977+0000","last_active":"2024-09-12T02:04:38.761286+0000","last_peered":"2024-09-12T02:04:38.761286+0000","last_clean":"2024-09-12T02:04:38.761286+0000","last_became_active":"2024-09-12T00:10:01.274310+0000","last_became_peered":"2024-09-12T00:10:01.274310+0000","last_unstale":"2024-09-12T02:04:38.761286+0000","last_undegraded":"2024-09-12T02:04:38.761286+0000","last_fullsized":"2024-09-12T02:04:38.761286+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:46.070135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5066,"num_read_kb":4471,"num_write":1537,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"266'312","reported_seq":1008,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718425+0000","last_change":"2024-09-12T00:09:59.291971+0000","last_active":"2024-09-12T02:02:38.718425+0000","last_peered":"2024-09-12T02:02:38.718425+0000","last_clean":"2024-09-12T02:02:38.718425+0000","last_became_active":"2024-09-12T00:09:59.291630+0000","last_became_peered":"2024-09-12T00:09:59.291630+0000","last_unstale":"2024-09-12T02:02:38.718425+0000","last_undegraded":"2024-09-12T02:02:38.718425+0000","last_fullsized":"2024-09-12T02:02:38.718425+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:38.513416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9012540,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":543,"num_read_kb":13946,"num_write":1114,"num_write_kb":43869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":552,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.700990+0000","last_change":"2024-09-12T00:09:48.181937+0000","last_active":"2024-09-12T02:02:28.700990+0000","last_peered":"2024-09-12T02:02:28.700990+0000","last_clean":"2024-09-12T02:02:28.700990+0000","last_became_active":"2024-09-12T00:09:46.163643+0000","last_became_peered":"2024-09-12T00:09:46.163643+0000","last_unstale":"2024-09-12T02:02:28.700990+0000","last_undegraded":"2024-09-12T02:02:28.700990+0000","last_fullsized":"2024-09-12T02:02:28.700990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:23.976934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095304600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.973403+0000","last_change":"2024-09-12T00:10:03.265795+0000","last_active":"2024-09-12T02:04:18.973403+0000","last_peered":"2024-09-12T02:04:18.973403+0000","last_clean":"2024-09-12T02:04:18.973403+0000","last_became_active":"2024-09-12T00:10:03.265087+0000","last_became_peered":"2024-09-12T00:10:03.265087+0000","last_unstale":"2024-09-12T02:04:18.973403+0000","last_undegraded":"2024-09-12T02:04:18.973403+0000","last_fullsized":"2024-09-12T02:04:18.973403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:19.906488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"266'814","reported_seq":1588,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.046879+0000","last_change":"2024-09-12T00:10:05.362216+0000","last_active":"2024-09-12T02:06:07.046879+0000","last_peered":"2024-09-12T02:06:07.046879+0000","last_clean":"2024-09-12T02:06:07.046879+0000","last_became_active":"2024-09-12T00:10:05.361458+0000","last_became_peered":"2024-09-12T00:10:05.361458+0000","last_unstale":"2024-09-12T02:06:07.046879+0000","last_undegraded":"2024-09-12T02:06:07.046879+0000","last_fullsized":"2024-09-12T02:06:07.046879+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:05.415919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180491,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1424,"num_read_kb":2938,"num_write":1162,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.946113+0000","last_change":"2024-09-12T00:10:07.341062+0000","last_active":"2024-09-12T02:02:38.946113+0000","last_peered":"2024-09-12T02:02:38.946113+0000","last_clean":"2024-09-12T02:02:38.946113+0000","last_became_active":"2024-09-12T00:10:07.333984+0000","last_became_peered":"2024-09-12T00:10:07.333984+0000","last_unstale":"2024-09-12T02:02:38.946113+0000","last_undegraded":"2024-09-12T02:02:38.946113+0000","last_fullsized":"2024-09-12T02:02:38.946113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:04.270793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"266'123","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725287+0000","last_change":"2024-09-12T00:10:09.369672+0000","last_active":"2024-09-12T02:02:39.725287+0000","last_peered":"2024-09-12T02:02:39.725287+0000","last_clean":"2024-09-12T02:02:39.725287+0000","last_became_active":"2024-09-12T00:10:09.368289+0000","last_became_peered":"2024-09-12T00:10:09.368289+0000","last_unstale":"2024-09-12T02:02:39.725287+0000","last_undegraded":"2024-09-12T02:02:39.725287+0000","last_fullsized":"2024-09-12T02:02:39.725287+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:07.697855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"266'155","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.927775+0000","last_change":"2024-09-12T00:10:09.373153+0000","last_active":"2024-09-12T02:04:57.927775+0000","last_peered":"2024-09-12T02:04:57.927775+0000","last_clean":"2024-09-12T02:04:57.927775+0000","last_became_active":"2024-09-12T00:10:09.372467+0000","last_became_peered":"2024-09-12T00:10:09.372467+0000","last_unstale":"2024-09-12T02:04:57.927775+0000","last_undegraded":"2024-09-12T02:04:57.927775+0000","last_fullsized":"2024-09-12T02:04:57.927775+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:35.985971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":220,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"266'886","reported_seq":2695,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.724639+0000","last_change":"2024-09-12T00:10:01.267707+0000","last_active":"2024-09-12T02:06:05.724639+0000","last_peered":"2024-09-12T02:06:05.724639+0000","last_clean":"2024-09-12T02:06:05.724639+0000","last_became_active":"2024-09-12T00:10:01.266479+0000","last_became_peered":"2024-09-12T00:10:01.266479+0000","last_unstale":"2024-09-12T02:06:05.724639+0000","last_undegraded":"2024-09-12T02:06:05.724639+0000","last_fullsized":"2024-09-12T02:06:05.724639+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:27.980168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4439,"num_read_kb":4016,"num_write":1172,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"266'265","reported_seq":1005,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.730967+0000","last_change":"2024-09-12T00:09:59.311766+0000","last_active":"2024-09-12T02:02:23.730967+0000","last_peered":"2024-09-12T02:02:23.730967+0000","last_clean":"2024-09-12T02:02:23.730967+0000","last_became_active":"2024-09-12T00:09:59.309979+0000","last_became_peered":"2024-09-12T00:09:59.309979+0000","last_unstale":"2024-09-12T02:02:23.730967+0000","last_undegraded":"2024-09-12T02:02:23.730967+0000","last_fullsized":"2024-09-12T02:02:23.730967+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:48.006276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4191113,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":698,"num_read_kb":10875,"num_write":934,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.704615+0000","last_change":"2024-09-12T00:10:03.273557+0000","last_active":"2024-09-12T02:04:23.704615+0000","last_peered":"2024-09-12T02:04:23.704615+0000","last_clean":"2024-09-12T02:04:23.704615+0000","last_became_active":"2024-09-12T00:10:03.272547+0000","last_became_peered":"2024-09-12T00:10:03.272547+0000","last_unstale":"2024-09-12T02:04:23.704615+0000","last_undegraded":"2024-09-12T02:04:23.704615+0000","last_fullsized":"2024-09-12T02:04:23.704615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:14.979796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"266'327","reported_seq":957,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976224+0000","last_change":"2024-09-12T00:10:05.293284+0000","last_active":"2024-09-12T02:04:28.976224+0000","last_peered":"2024-09-12T02:04:28.976224+0000","last_clean":"2024-09-12T02:04:28.976224+0000","last_became_active":"2024-09-12T00:10:05.292446+0000","last_became_peered":"2024-09-12T00:10:05.292446+0000","last_unstale":"2024-09-12T02:04:28.976224+0000","last_undegraded":"2024-09-12T02:04:28.976224+0000","last_fullsized":"2024-09-12T02:04:28.976224+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49680,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":506,"num_read_kb":930,"num_write":396,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:08.938223+0000","last_change":"2024-09-12T00:10:07.339677+0000","last_active":"2024-09-12T02:02:08.938223+0000","last_peered":"2024-09-12T02:02:08.938223+0000","last_clean":"2024-09-12T02:02:08.938223+0000","last_became_active":"2024-09-12T00:10:07.335659+0000","last_became_peered":"2024-09-12T00:10:07.335659+0000","last_unstale":"2024-09-12T02:02:08.938223+0000","last_undegraded":"2024-09-12T02:02:08.938223+0000","last_fullsized":"2024-09-12T02:02:08.938223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:04.120142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"266'115","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.231862+0000","last_change":"2024-09-12T00:10:09.357232+0000","last_active":"2024-09-12T02:05:00.231862+0000","last_peered":"2024-09-12T02:05:00.231862+0000","last_clean":"2024-09-12T02:05:00.231862+0000","last_became_active":"2024-09-12T00:10:09.356043+0000","last_became_peered":"2024-09-12T00:10:09.356043+0000","last_unstale":"2024-09-12T02:05:00.231862+0000","last_undegraded":"2024-09-12T02:05:00.231862+0000","last_fullsized":"2024-09-12T02:05:00.231862+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:08.121957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":102,"num_write":274,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"266'481","reported_seq":2035,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.932083+0000","last_change":"2024-09-12T00:10:01.265349+0000","last_active":"2024-09-12T02:04:59.932083+0000","last_peered":"2024-09-12T02:04:59.932083+0000","last_clean":"2024-09-12T02:04:59.932083+0000","last_became_active":"2024-09-12T00:10:01.264977+0000","last_became_peered":"2024-09-12T00:10:01.264977+0000","last_unstale":"2024-09-12T02:04:59.932083+0000","last_undegraded":"2024-09-12T02:04:59.932083+0000","last_fullsized":"2024-09-12T02:04:59.932083+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2306,"num_write":570,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"266'312","reported_seq":947,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.741277+0000","last_change":"2024-09-12T00:09:59.300779+0000","last_active":"2024-09-12T02:03:33.741277+0000","last_peered":"2024-09-12T02:03:33.741277+0000","last_clean":"2024-09-12T02:03:33.741277+0000","last_became_active":"2024-09-12T00:09:59.300181+0000","last_became_peered":"2024-09-12T00:09:59.300181+0000","last_unstale":"2024-09-12T02:03:33.741277+0000","last_undegraded":"2024-09-12T02:03:33.741277+0000","last_fullsized":"2024-09-12T02:03:33.741277+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:30.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5350679,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":417,"num_read_kb":10768,"num_write":1148,"num_write_kb":35109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.975027+0000","last_change":"2024-09-12T00:10:03.256755+0000","last_active":"2024-09-12T02:04:23.975027+0000","last_peered":"2024-09-12T02:04:23.975027+0000","last_clean":"2024-09-12T02:04:23.975027+0000","last_became_active":"2024-09-12T00:10:03.256053+0000","last_became_peered":"2024-09-12T00:10:03.256053+0000","last_unstale":"2024-09-12T02:04:23.975027+0000","last_undegraded":"2024-09-12T02:04:23.975027+0000","last_fullsized":"2024-09-12T02:04:23.975027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:53.915837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"266'74","reported_seq":614,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.533535+0000","last_change":"2024-09-12T00:10:05.289328+0000","last_active":"2024-09-12T02:04:28.533535+0000","last_peered":"2024-09-12T02:04:28.533535+0000","last_clean":"2024-09-12T02:04:28.533535+0000","last_became_active":"2024-09-12T00:10:05.288688+0000","last_became_peered":"2024-09-12T00:10:05.288688+0000","last_unstale":"2024-09-12T02:04:28.533535+0000","last_undegraded":"2024-09-12T02:04:28.533535+0000","last_fullsized":"2024-09-12T02:04:28.533535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.509523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:08.721193+0000","last_change":"2024-09-12T00:10:07.321379+0000","last_active":"2024-09-12T02:02:08.721193+0000","last_peered":"2024-09-12T02:02:08.721193+0000","last_clean":"2024-09-12T02:02:08.721193+0000","last_became_active":"2024-09-12T00:10:07.320729+0000","last_became_peered":"2024-09-12T00:10:07.320729+0000","last_unstale":"2024-09-12T02:02:08.721193+0000","last_undegraded":"2024-09-12T02:02:08.721193+0000","last_fullsized":"2024-09-12T02:02:08.721193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:20.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"266'204","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.570680+0000","last_change":"2024-09-12T00:10:09.362996+0000","last_active":"2024-09-12T02:04:57.570680+0000","last_peered":"2024-09-12T02:04:57.570680+0000","last_clean":"2024-09-12T02:04:57.570680+0000","last_became_active":"2024-09-12T00:10:09.362096+0000","last_became_peered":"2024-09-12T00:10:09.362096+0000","last_unstale":"2024-09-12T02:04:57.570680+0000","last_undegraded":"2024-09-12T02:04:57.570680+0000","last_fullsized":"2024-09-12T02:04:57.570680+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:36.489316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":296,"num_read_kb":291,"num_write":467,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"266'430","reported_seq":2143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.720489+0000","last_change":"2024-09-12T00:10:01.261417+0000","last_active":"2024-09-12T02:06:05.720489+0000","last_peered":"2024-09-12T02:06:05.720489+0000","last_clean":"2024-09-12T02:06:05.720489+0000","last_became_active":"2024-09-12T00:10:01.261030+0000","last_became_peered":"2024-09-12T00:10:01.261030+0000","last_unstale":"2024-09-12T02:06:05.720489+0000","last_undegraded":"2024-09-12T02:06:05.720489+0000","last_fullsized":"2024-09-12T02:06:05.720489+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:45.394167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2550,"num_read_kb":2440,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"266'313","reported_seq":1007,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.749735+0000","last_change":"2024-09-12T00:09:59.288987+0000","last_active":"2024-09-12T02:06:44.749735+0000","last_peered":"2024-09-12T02:06:44.749735+0000","last_clean":"2024-09-12T02:06:44.749735+0000","last_became_active":"2024-09-12T00:09:59.288100+0000","last_became_peered":"2024-09-12T00:09:59.288100+0000","last_unstale":"2024-09-12T02:06:44.749735+0000","last_undegraded":"2024-09-12T02:06:44.749735+0000","last_fullsized":"2024-09-12T02:06:44.749735+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:51.350979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9466169,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":528,"num_read_kb":15869,"num_write":1106,"num_write_kb":23659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753274+0000","last_change":"2024-09-12T00:10:03.257101+0000","last_active":"2024-09-12T02:04:23.753274+0000","last_peered":"2024-09-12T02:04:23.753274+0000","last_clean":"2024-09-12T02:04:23.753274+0000","last_became_active":"2024-09-12T00:10:03.255669+0000","last_became_peered":"2024-09-12T00:10:03.255669+0000","last_unstale":"2024-09-12T02:04:23.753274+0000","last_undegraded":"2024-09-12T02:04:23.753274+0000","last_fullsized":"2024-09-12T02:04:23.753274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:32.002572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"266'340","reported_seq":980,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976323+0000","last_change":"2024-09-12T00:10:05.300654+0000","last_active":"2024-09-12T02:04:28.976323+0000","last_peered":"2024-09-12T02:04:28.976323+0000","last_clean":"2024-09-12T02:04:28.976323+0000","last_became_active":"2024-09-12T00:10:05.299730+0000","last_became_peered":"2024-09-12T00:10:05.299730+0000","last_unstale":"2024-09-12T02:04:28.976323+0000","last_undegraded":"2024-09-12T02:04:28.976323+0000","last_fullsized":"2024-09-12T02:04:28.976323+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:30.946739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":1010,"num_write":422,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:08.696869+0000","last_change":"2024-09-12T00:10:07.330541+0000","last_active":"2024-09-12T02:02:08.696869+0000","last_peered":"2024-09-12T02:02:08.696869+0000","last_clean":"2024-09-12T02:02:08.696869+0000","last_became_active":"2024-09-12T00:10:07.329741+0000","last_became_peered":"2024-09-12T00:10:07.329741+0000","last_unstale":"2024-09-12T02:02:08.696869+0000","last_undegraded":"2024-09-12T02:02:08.696869+0000","last_fullsized":"2024-09-12T02:02:08.696869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:23.412449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"266'89","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725178+0000","last_change":"2024-09-12T00:10:09.372894+0000","last_active":"2024-09-12T02:02:39.725178+0000","last_peered":"2024-09-12T02:02:39.725178+0000","last_clean":"2024-09-12T02:02:39.725178+0000","last_became_active":"2024-09-12T00:10:09.371755+0000","last_became_peered":"2024-09-12T00:10:09.371755+0000","last_unstale":"2024-09-12T02:02:39.725178+0000","last_undegraded":"2024-09-12T02:02:39.725178+0000","last_fullsized":"2024-09-12T02:02:39.725178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:18.332494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":213,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"266'805","reported_seq":2435,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974707+0000","last_change":"2024-09-12T00:10:01.259175+0000","last_active":"2024-09-12T02:04:23.974707+0000","last_peered":"2024-09-12T02:04:23.974707+0000","last_clean":"2024-09-12T02:04:23.974707+0000","last_became_active":"2024-09-12T00:10:01.258814+0000","last_became_peered":"2024-09-12T00:10:01.258814+0000","last_unstale":"2024-09-12T02:04:23.974707+0000","last_undegraded":"2024-09-12T02:04:23.974707+0000","last_fullsized":"2024-09-12T02:04:23.974707+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:34.228716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3906,"num_read_kb":3532,"num_write":1046,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"266'329","reported_seq":993,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.520686+0000","last_change":"2024-09-12T00:09:59.263146+0000","last_active":"2024-09-12T02:03:33.520686+0000","last_peered":"2024-09-12T02:03:33.520686+0000","last_clean":"2024-09-12T02:03:33.520686+0000","last_became_active":"2024-09-12T00:09:59.262775+0000","last_became_peered":"2024-09-12T00:09:59.262775+0000","last_unstale":"2024-09-12T02:03:33.520686+0000","last_undegraded":"2024-09-12T02:03:33.520686+0000","last_fullsized":"2024-09-12T02:03:33.520686+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:27.798550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3092,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":471,"num_read_kb":525,"num_write":1243,"num_write_kb":18885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.725899+0000","last_change":"2024-09-12T00:10:03.258677+0000","last_active":"2024-09-12T02:04:23.725899+0000","last_peered":"2024-09-12T02:04:23.725899+0000","last_clean":"2024-09-12T02:04:23.725899+0000","last_became_active":"2024-09-12T00:10:03.257953+0000","last_became_peered":"2024-09-12T00:10:03.257953+0000","last_unstale":"2024-09-12T02:04:23.725899+0000","last_undegraded":"2024-09-12T02:04:23.725899+0000","last_fullsized":"2024-09-12T02:04:23.725899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:23.465779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"266'322","reported_seq":930,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.754724+0000","last_change":"2024-09-12T00:10:05.286232+0000","last_active":"2024-09-12T02:04:28.754724+0000","last_peered":"2024-09-12T02:04:28.754724+0000","last_clean":"2024-09-12T02:04:28.754724+0000","last_became_active":"2024-09-12T00:10:05.285485+0000","last_became_peered":"2024-09-12T00:10:05.285485+0000","last_unstale":"2024-09-12T02:04:28.754724+0000","last_undegraded":"2024-09-12T02:04:28.754724+0000","last_fullsized":"2024-09-12T02:04:28.754724+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:50.842485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73246,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1115,"num_write":440,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:08.712193+0000","last_change":"2024-09-12T00:10:07.326257+0000","last_active":"2024-09-12T02:02:08.712193+0000","last_peered":"2024-09-12T02:02:08.712193+0000","last_clean":"2024-09-12T02:02:08.712193+0000","last_became_active":"2024-09-12T00:10:07.325482+0000","last_became_peered":"2024-09-12T00:10:07.325482+0000","last_unstale":"2024-09-12T02:02:08.712193+0000","last_undegraded":"2024-09-12T02:02:08.712193+0000","last_fullsized":"2024-09-12T02:02:08.712193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:27.852281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"266'839","reported_seq":2400,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729315+0000","last_change":"2024-09-12T00:10:01.277544+0000","last_active":"2024-09-12T02:04:38.729315+0000","last_peered":"2024-09-12T02:04:38.729315+0000","last_clean":"2024-09-12T02:04:38.729315+0000","last_became_active":"2024-09-12T00:10:01.276906+0000","last_became_peered":"2024-09-12T00:10:01.276906+0000","last_unstale":"2024-09-12T02:04:38.729315+0000","last_undegraded":"2024-09-12T02:04:38.729315+0000","last_fullsized":"2024-09-12T02:04:38.729315+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:55.926406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3919,"num_read_kb":3507,"num_write":1092,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"266'264","reported_seq":938,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:59.606810+0000","last_change":"2024-09-12T00:09:59.249092+0000","last_active":"2024-09-12T02:05:59.606810+0000","last_peered":"2024-09-12T02:05:59.606810+0000","last_clean":"2024-09-12T02:05:59.606810+0000","last_became_active":"2024-09-12T00:09:59.248681+0000","last_became_peered":"2024-09-12T00:09:59.248681+0000","last_unstale":"2024-09-12T02:05:59.606810+0000","last_undegraded":"2024-09-12T02:05:59.606810+0000","last_fullsized":"2024-09-12T02:05:59.606810+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:44.662803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11196370,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":444,"num_read_kb":23742,"num_write":1054,"num_write_kb":29955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536376+0000","last_change":"2024-09-12T00:10:03.261107+0000","last_active":"2024-09-12T02:04:38.536376+0000","last_peered":"2024-09-12T02:04:38.536376+0000","last_clean":"2024-09-12T02:04:38.536376+0000","last_became_active":"2024-09-12T00:10:03.260387+0000","last_became_peered":"2024-09-12T00:10:03.260387+0000","last_unstale":"2024-09-12T02:04:38.536376+0000","last_undegraded":"2024-09-12T02:04:38.536376+0000","last_fullsized":"2024-09-12T02:04:38.536376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:53.966697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"266'532","reported_seq":1200,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.038233+0000","last_change":"2024-09-12T00:10:05.301383+0000","last_active":"2024-09-12T02:06:07.038233+0000","last_peered":"2024-09-12T02:06:07.038233+0000","last_clean":"2024-09-12T02:06:07.038233+0000","last_became_active":"2024-09-12T00:10:05.300613+0000","last_became_peered":"2024-09-12T00:10:05.300613+0000","last_unstale":"2024-09-12T02:06:07.038233+0000","last_undegraded":"2024-09-12T02:06:07.038233+0000","last_fullsized":"2024-09-12T02:06:07.038233+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:48.609813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123660,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":933,"num_read_kb":1946,"num_write":806,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725243+0000","last_change":"2024-09-12T00:10:07.343479+0000","last_active":"2024-09-12T02:02:39.725243+0000","last_peered":"2024-09-12T02:02:39.725243+0000","last_clean":"2024-09-12T02:02:39.725243+0000","last_became_active":"2024-09-12T00:10:07.342700+0000","last_became_peered":"2024-09-12T00:10:07.342700+0000","last_unstale":"2024-09-12T02:02:39.725243+0000","last_undegraded":"2024-09-12T02:02:39.725243+0000","last_fullsized":"2024-09-12T02:02:39.725243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:29.670776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"266'157","reported_seq":687,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:08.938400+0000","last_change":"2024-09-12T00:10:09.436544+0000","last_active":"2024-09-12T02:02:08.938400+0000","last_peered":"2024-09-12T02:02:08.938400+0000","last_clean":"2024-09-12T02:02:08.938400+0000","last_became_active":"2024-09-12T00:10:09.435513+0000","last_became_peered":"2024-09-12T00:10:09.435513+0000","last_unstale":"2024-09-12T02:02:08.938400+0000","last_undegraded":"2024-09-12T02:02:08.938400+0000","last_fullsized":"2024-09-12T02:02:08.938400+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:42.230555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":193,"num_write":343,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"266'810","reported_seq":2368,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719876+0000","last_change":"2024-09-12T00:10:01.260517+0000","last_active":"2024-09-12T02:04:59.719876+0000","last_peered":"2024-09-12T02:04:59.719876+0000","last_clean":"2024-09-12T02:04:59.719876+0000","last_became_active":"2024-09-12T00:10:01.260115+0000","last_became_peered":"2024-09-12T00:10:01.260115+0000","last_unstale":"2024-09-12T02:04:59.719876+0000","last_undegraded":"2024-09-12T02:04:59.719876+0000","last_fullsized":"2024-09-12T02:04:59.719876+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:58.706655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3786,"num_read_kb":3403,"num_write":1061,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"266'314","reported_seq":1089,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.700016+0000","last_change":"2024-09-12T00:09:59.286280+0000","last_active":"2024-09-12T02:04:03.700016+0000","last_peered":"2024-09-12T02:04:03.700016+0000","last_clean":"2024-09-12T02:04:03.700016+0000","last_became_active":"2024-09-12T00:09:59.285792+0000","last_became_peered":"2024-09-12T00:09:59.285792+0000","last_unstale":"2024-09-12T02:04:03.700016+0000","last_undegraded":"2024-09-12T02:04:03.700016+0000","last_fullsized":"2024-09-12T02:04:03.700016+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:19.960444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4224380,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":672,"num_read_kb":25287,"num_write":1145,"num_write_kb":29345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729275+0000","last_change":"2024-09-12T00:10:03.258466+0000","last_active":"2024-09-12T02:04:38.729275+0000","last_peered":"2024-09-12T02:04:38.729275+0000","last_clean":"2024-09-12T02:04:38.729275+0000","last_became_active":"2024-09-12T00:10:03.257760+0000","last_became_peered":"2024-09-12T00:10:03.257760+0000","last_unstale":"2024-09-12T02:04:38.729275+0000","last_undegraded":"2024-09-12T02:04:38.729275+0000","last_fullsized":"2024-09-12T02:04:38.729275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:08.684067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"266'377","reported_seq":1018,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.764434+0000","last_change":"2024-09-12T00:10:05.293759+0000","last_active":"2024-09-12T02:05:08.764434+0000","last_peered":"2024-09-12T02:05:08.764434+0000","last_clean":"2024-09-12T02:05:08.764434+0000","last_became_active":"2024-09-12T00:10:05.292902+0000","last_became_peered":"2024-09-12T00:10:05.292902+0000","last_unstale":"2024-09-12T02:05:08.764434+0000","last_undegraded":"2024-09-12T02:05:08.764434+0000","last_fullsized":"2024-09-12T02:05:08.764434+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:01.365556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53886,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1078,"num_write":504,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679856+0000","last_change":"2024-09-12T00:10:07.322324+0000","last_active":"2024-09-12T02:02:38.679856+0000","last_peered":"2024-09-12T02:02:38.679856+0000","last_clean":"2024-09-12T02:02:38.679856+0000","last_became_active":"2024-09-12T00:10:07.321400+0000","last_became_peered":"2024-09-12T00:10:07.321400+0000","last_unstale":"2024-09-12T02:02:38.679856+0000","last_undegraded":"2024-09-12T02:02:38.679856+0000","last_fullsized":"2024-09-12T02:02:38.679856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:09.420108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"266'186","reported_seq":740,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.727037+0000","last_change":"2024-09-12T00:10:09.356446+0000","last_active":"2024-09-12T02:04:28.727037+0000","last_peered":"2024-09-12T02:04:28.727037+0000","last_clean":"2024-09-12T02:04:28.727037+0000","last_became_active":"2024-09-12T00:10:09.355548+0000","last_became_peered":"2024-09-12T00:10:09.355548+0000","last_unstale":"2024-09-12T02:04:28.727037+0000","last_undegraded":"2024-09-12T02:04:28.727037+0000","last_fullsized":"2024-09-12T02:04:28.727037+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:14.356852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":268,"num_write":529,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"266'393","reported_seq":1777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.725362+0000","last_change":"2024-09-12T00:10:01.257147+0000","last_active":"2024-09-12T02:04:59.725362+0000","last_peered":"2024-09-12T02:04:59.725362+0000","last_clean":"2024-09-12T02:04:59.725362+0000","last_became_active":"2024-09-12T00:10:01.256781+0000","last_became_peered":"2024-09-12T00:10:01.256781+0000","last_unstale":"2024-09-12T02:04:59.725362+0000","last_undegraded":"2024-09-12T02:04:59.725362+0000","last_fullsized":"2024-09-12T02:04:59.725362+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:08.713733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1972,"num_read_kb":1849,"num_write":456,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"266'277","reported_seq":919,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.732051+0000","last_change":"2024-09-12T00:09:59.301265+0000","last_active":"2024-09-12T02:02:28.732051+0000","last_peered":"2024-09-12T02:02:28.732051+0000","last_clean":"2024-09-12T02:02:28.732051+0000","last_became_active":"2024-09-12T00:09:59.295949+0000","last_became_peered":"2024-09-12T00:09:59.295949+0000","last_unstale":"2024-09-12T02:02:28.732051+0000","last_undegraded":"2024-09-12T02:02:28.732051+0000","last_fullsized":"2024-09-12T02:02:28.732051+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:00.402184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4511892,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":415,"num_read_kb":1958,"num_write":939,"num_write_kb":21693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733298+0000","last_change":"2024-09-12T00:10:03.255686+0000","last_active":"2024-09-12T02:02:33.733298+0000","last_peered":"2024-09-12T02:02:33.733298+0000","last_clean":"2024-09-12T02:02:33.733298+0000","last_became_active":"2024-09-12T00:10:03.254941+0000","last_became_peered":"2024-09-12T00:10:03.254941+0000","last_unstale":"2024-09-12T02:02:33.733298+0000","last_undegraded":"2024-09-12T02:02:33.733298+0000","last_fullsized":"2024-09-12T02:02:33.733298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:39.484405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"266'341","reported_seq":977,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.980585+0000","last_change":"2024-09-12T00:10:05.362933+0000","last_active":"2024-09-12T02:04:43.980585+0000","last_peered":"2024-09-12T02:04:43.980585+0000","last_clean":"2024-09-12T02:04:43.980585+0000","last_became_active":"2024-09-12T00:10:05.362151+0000","last_became_peered":"2024-09-12T00:10:05.362151+0000","last_unstale":"2024-09-12T02:04:43.980585+0000","last_undegraded":"2024-09-12T02:04:43.980585+0000","last_fullsized":"2024-09-12T02:04:43.980585+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:23.347759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":1075,"num_write":452,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708301+0000","last_change":"2024-09-12T00:10:07.336945+0000","last_active":"2024-09-12T02:04:38.708301+0000","last_peered":"2024-09-12T02:04:38.708301+0000","last_clean":"2024-09-12T02:04:38.708301+0000","last_became_active":"2024-09-12T00:10:07.336129+0000","last_became_peered":"2024-09-12T00:10:07.336129+0000","last_unstale":"2024-09-12T02:04:38.708301+0000","last_undegraded":"2024-09-12T02:04:38.708301+0000","last_fullsized":"2024-09-12T02:04:38.708301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:22.333025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"266'100","reported_seq":624,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.109970+0000","last_change":"2024-09-12T00:10:09.371725+0000","last_active":"2024-09-12T02:06:07.109970+0000","last_peered":"2024-09-12T02:06:07.109970+0000","last_clean":"2024-09-12T02:06:07.109970+0000","last_became_active":"2024-09-12T00:10:09.370925+0000","last_became_peered":"2024-09-12T00:10:09.370925+0000","last_unstale":"2024-09-12T02:06:07.109970+0000","last_undegraded":"2024-09-12T02:06:07.109970+0000","last_fullsized":"2024-09-12T02:06:07.109970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:01.455208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"266'455","reported_seq":2115,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689872+0000","last_change":"2024-09-12T00:10:01.257454+0000","last_active":"2024-09-12T02:02:33.689872+0000","last_peered":"2024-09-12T02:02:33.689872+0000","last_clean":"2024-09-12T02:02:33.689872+0000","last_became_active":"2024-09-12T00:10:01.257064+0000","last_became_peered":"2024-09-12T00:10:01.257064+0000","last_unstale":"2024-09-12T02:02:33.689872+0000","last_undegraded":"2024-09-12T02:02:33.689872+0000","last_fullsized":"2024-09-12T02:02:33.689872+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:41.782738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2638,"num_read_kb":2500,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"266'333","reported_seq":1027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.715844+0000","last_change":"2024-09-12T00:09:59.289590+0000","last_active":"2024-09-12T02:02:28.715844+0000","last_peered":"2024-09-12T02:02:28.715844+0000","last_clean":"2024-09-12T02:02:28.715844+0000","last_became_active":"2024-09-12T00:09:59.289217+0000","last_became_peered":"2024-09-12T00:09:59.289217+0000","last_unstale":"2024-09-12T02:02:28.715844+0000","last_undegraded":"2024-09-12T02:02:28.715844+0000","last_fullsized":"2024-09-12T02:02:28.715844+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:02.241515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14722358,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":582,"num_read_kb":33363,"num_write":1196,"num_write_kb":62829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.678668+0000","last_change":"2024-09-12T00:10:03.265403+0000","last_active":"2024-09-12T02:02:33.678668+0000","last_peered":"2024-09-12T02:02:33.678668+0000","last_clean":"2024-09-12T02:02:33.678668+0000","last_became_active":"2024-09-12T00:10:03.264802+0000","last_became_peered":"2024-09-12T00:10:03.264802+0000","last_unstale":"2024-09-12T02:02:33.678668+0000","last_undegraded":"2024-09-12T02:02:33.678668+0000","last_fullsized":"2024-09-12T02:02:33.678668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:04.107888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"266'163","reported_seq":757,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.760399+0000","last_change":"2024-09-12T00:10:05.362816+0000","last_active":"2024-09-12T02:04:33.760399+0000","last_peered":"2024-09-12T02:04:33.760399+0000","last_clean":"2024-09-12T02:04:33.760399+0000","last_became_active":"2024-09-12T00:10:05.361625+0000","last_became_peered":"2024-09-12T00:10:05.361625+0000","last_unstale":"2024-09-12T02:04:33.760399+0000","last_undegraded":"2024-09-12T02:04:33.760399+0000","last_fullsized":"2024-09-12T02:04:33.760399+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:40.143219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":192,"num_write":144,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"266'760","reported_seq":3190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.370358+0000","last_change":"2024-09-12T00:10:07.315770+0000","last_active":"2024-09-12T02:06:10.370358+0000","last_peered":"2024-09-12T02:06:10.370358+0000","last_clean":"2024-09-12T02:06:10.370358+0000","last_became_active":"2024-09-12T00:10:07.314980+0000","last_became_peered":"2024-09-12T00:10:07.314980+0000","last_unstale":"2024-09-12T02:06:10.370358+0000","last_undegraded":"2024-09-12T02:06:10.370358+0000","last_fullsized":"2024-09-12T02:06:10.370358+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:26.700418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"266'122","reported_seq":639,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:08.721152+0000","last_change":"2024-09-12T00:10:09.370317+0000","last_active":"2024-09-12T02:02:08.721152+0000","last_peered":"2024-09-12T02:02:08.721152+0000","last_clean":"2024-09-12T02:02:08.721152+0000","last_became_active":"2024-09-12T00:10:09.369670+0000","last_became_peered":"2024-09-12T00:10:09.369670+0000","last_unstale":"2024-09-12T02:02:08.721152+0000","last_undegraded":"2024-09-12T02:02:08.721152+0000","last_fullsized":"2024-09-12T02:02:08.721152+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:51.975587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":303,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"266'514","reported_seq":2009,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733221+0000","last_change":"2024-09-12T00:10:01.249269+0000","last_active":"2024-09-12T02:02:33.733221+0000","last_peered":"2024-09-12T02:02:33.733221+0000","last_clean":"2024-09-12T02:02:33.733221+0000","last_became_active":"2024-09-12T00:10:01.248535+0000","last_became_peered":"2024-09-12T00:10:01.248535+0000","last_unstale":"2024-09-12T02:02:33.733221+0000","last_undegraded":"2024-09-12T02:02:33.733221+0000","last_fullsized":"2024-09-12T02:02:33.733221+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:56.739255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2593,"num_read_kb":2391,"num_write":659,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"266'330","reported_seq":1029,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.714691+0000","last_change":"2024-09-12T00:09:59.297197+0000","last_active":"2024-09-12T02:06:44.714691+0000","last_peered":"2024-09-12T02:06:44.714691+0000","last_clean":"2024-09-12T02:06:44.714691+0000","last_became_active":"2024-09-12T00:09:59.296207+0000","last_became_peered":"2024-09-12T00:09:59.296207+0000","last_unstale":"2024-09-12T02:06:44.714691+0000","last_undegraded":"2024-09-12T02:06:44.714691+0000","last_fullsized":"2024-09-12T02:06:44.714691+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:59.878998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5083213,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":523,"num_read_kb":14261,"num_write":1185,"num_write_kb":35890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.727067+0000","last_change":"2024-09-12T00:10:03.260439+0000","last_active":"2024-09-12T02:02:33.727067+0000","last_peered":"2024-09-12T02:02:33.727067+0000","last_clean":"2024-09-12T02:02:33.727067+0000","last_became_active":"2024-09-12T00:10:03.259644+0000","last_became_peered":"2024-09-12T00:10:03.259644+0000","last_unstale":"2024-09-12T02:02:33.727067+0000","last_undegraded":"2024-09-12T02:02:33.727067+0000","last_fullsized":"2024-09-12T02:02:33.727067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:33.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"266'378","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:24.777642+0000","last_change":"2024-09-12T00:10:05.297805+0000","last_active":"2024-09-12T02:06:24.777642+0000","last_peered":"2024-09-12T02:06:24.777642+0000","last_clean":"2024-09-12T02:06:24.777642+0000","last_became_active":"2024-09-12T00:10:05.297223+0000","last_became_peered":"2024-09-12T00:10:05.297223+0000","last_unstale":"2024-09-12T02:06:24.777642+0000","last_undegraded":"2024-09-12T02:06:24.777642+0000","last_fullsized":"2024-09-12T02:06:24.777642+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:02.183020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46610,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":587,"num_read_kb":987,"num_write":442,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.522957+0000","last_change":"2024-09-12T00:10:07.324114+0000","last_active":"2024-09-12T02:03:43.522957+0000","last_peered":"2024-09-12T02:03:43.522957+0000","last_clean":"2024-09-12T02:03:43.522957+0000","last_became_active":"2024-09-12T00:10:07.323296+0000","last_became_peered":"2024-09-12T00:10:07.323296+0000","last_unstale":"2024-09-12T02:03:43.522957+0000","last_undegraded":"2024-09-12T02:03:43.522957+0000","last_fullsized":"2024-09-12T02:03:43.522957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:17.788189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"266'145","reported_seq":669,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:52.636170+0000","last_change":"2024-09-12T00:10:09.362544+0000","last_active":"2024-09-12T02:04:52.636170+0000","last_peered":"2024-09-12T02:04:52.636170+0000","last_clean":"2024-09-12T02:04:52.636170+0000","last_became_active":"2024-09-12T00:10:09.361797+0000","last_became_peered":"2024-09-12T00:10:09.361797+0000","last_unstale":"2024-09-12T02:04:52.636170+0000","last_undegraded":"2024-09-12T02:04:52.636170+0000","last_fullsized":"2024-09-12T02:04:52.636170+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:59.618943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":153,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"266'798","reported_seq":2149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733158+0000","last_change":"2024-09-12T00:10:31.165648+0000","last_active":"2024-09-12T02:02:33.733158+0000","last_peered":"2024-09-12T02:02:33.733158+0000","last_clean":"2024-09-12T02:02:33.733158+0000","last_became_active":"2024-09-12T00:10:31.165044+0000","last_became_peered":"2024-09-12T00:10:31.165044+0000","last_unstale":"2024-09-12T02:02:33.733158+0000","last_undegraded":"2024-09-12T02:02:33.733158+0000","last_fullsized":"2024-09-12T02:02:33.733158+0000","mapping_epoch":38,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:52.001534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3606,"num_read_kb":3182,"num_write":1095,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"266'320","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.636792+0000","last_change":"2024-09-12T00:09:59.271158+0000","last_active":"2024-09-12T02:06:44.636792+0000","last_peered":"2024-09-12T02:06:44.636792+0000","last_clean":"2024-09-12T02:06:44.636792+0000","last_became_active":"2024-09-12T00:09:59.264091+0000","last_became_peered":"2024-09-12T00:09:59.264091+0000","last_unstale":"2024-09-12T02:06:44.636792+0000","last_undegraded":"2024-09-12T02:06:44.636792+0000","last_fullsized":"2024-09-12T02:06:44.636792+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:19.196253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1786383,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":590,"num_read_kb":45982,"num_write":1051,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:34.724000+0000","last_change":"2024-09-12T00:10:03.264424+0000","last_active":"2024-09-12T02:02:34.724000+0000","last_peered":"2024-09-12T02:02:34.724000+0000","last_clean":"2024-09-12T02:02:34.724000+0000","last_became_active":"2024-09-12T00:10:03.263712+0000","last_became_peered":"2024-09-12T00:10:03.263712+0000","last_unstale":"2024-09-12T02:02:34.724000+0000","last_undegraded":"2024-09-12T02:02:34.724000+0000","last_fullsized":"2024-09-12T02:02:34.724000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:02.001466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"266'306","reported_seq":920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.021498+0000","last_change":"2024-09-12T00:10:05.298555+0000","last_active":"2024-09-12T02:06:07.021498+0000","last_peered":"2024-09-12T02:06:07.021498+0000","last_clean":"2024-09-12T02:06:07.021498+0000","last_became_active":"2024-09-12T00:10:05.297514+0000","last_became_peered":"2024-09-12T00:10:05.297514+0000","last_unstale":"2024-09-12T02:06:07.021498+0000","last_undegraded":"2024-09-12T02:06:07.021498+0000","last_fullsized":"2024-09-12T02:06:07.021498+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:45.661380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53891,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":976,"num_write":404,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.723739+0000","last_change":"2024-09-12T00:10:07.325384+0000","last_active":"2024-09-12T02:04:13.723739+0000","last_peered":"2024-09-12T02:04:13.723739+0000","last_clean":"2024-09-12T02:04:13.723739+0000","last_became_active":"2024-09-12T00:10:07.320880+0000","last_became_peered":"2024-09-12T00:10:07.320880+0000","last_unstale":"2024-09-12T02:04:13.723739+0000","last_undegraded":"2024-09-12T02:04:13.723739+0000","last_fullsized":"2024-09-12T02:04:13.723739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:10.636128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"266'120","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.964456+0000","last_change":"2024-09-12T00:10:09.434166+0000","last_active":"2024-09-12T02:03:43.964456+0000","last_peered":"2024-09-12T02:03:43.964456+0000","last_clean":"2024-09-12T02:03:43.964456+0000","last_became_active":"2024-09-12T00:10:09.433296+0000","last_became_peered":"2024-09-12T00:10:09.433296+0000","last_unstale":"2024-09-12T02:03:43.964456+0000","last_undegraded":"2024-09-12T02:03:43.964456+0000","last_fullsized":"2024-09-12T02:03:43.964456+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:16.296420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1168,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":163,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"266'596","reported_seq":2323,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.720907+0000","last_change":"2024-09-12T00:10:01.242398+0000","last_active":"2024-09-12T02:06:05.720907+0000","last_peered":"2024-09-12T02:06:05.720907+0000","last_clean":"2024-09-12T02:06:05.720907+0000","last_became_active":"2024-09-12T00:10:01.242013+0000","last_became_peered":"2024-09-12T00:10:01.242013+0000","last_unstale":"2024-09-12T02:06:05.720907+0000","last_undegraded":"2024-09-12T02:06:05.720907+0000","last_fullsized":"2024-09-12T02:06:05.720907+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:24.130259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3158,"num_read_kb":2927,"num_write":761,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"266'284","reported_seq":959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.972388+0000","last_change":"2024-09-12T00:09:59.311530+0000","last_active":"2024-09-12T02:04:13.972388+0000","last_peered":"2024-09-12T02:04:13.972388+0000","last_clean":"2024-09-12T02:04:13.972388+0000","last_became_active":"2024-09-12T00:09:59.311148+0000","last_became_peered":"2024-09-12T00:09:59.311148+0000","last_unstale":"2024-09-12T02:04:13.972388+0000","last_undegraded":"2024-09-12T02:04:13.972388+0000","last_fullsized":"2024-09-12T02:04:13.972388+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:05.724347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6884012,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":417,"num_read_kb":27101,"num_write":1056,"num_write_kb":32356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.747561+0000","last_change":"2024-09-12T00:10:03.253703+0000","last_active":"2024-09-12T02:03:38.747561+0000","last_peered":"2024-09-12T02:03:38.747561+0000","last_clean":"2024-09-12T02:03:38.747561+0000","last_became_active":"2024-09-12T00:10:03.252562+0000","last_became_peered":"2024-09-12T00:10:03.252562+0000","last_unstale":"2024-09-12T02:03:38.747561+0000","last_undegraded":"2024-09-12T02:03:38.747561+0000","last_fullsized":"2024-09-12T02:03:38.747561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:41.543603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"266'270","reported_seq":861,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.986469+0000","last_change":"2024-09-12T00:10:05.293010+0000","last_active":"2024-09-12T02:05:08.986469+0000","last_peered":"2024-09-12T02:05:08.986469+0000","last_clean":"2024-09-12T02:05:08.986469+0000","last_became_active":"2024-09-12T00:10:05.291758+0000","last_became_peered":"2024-09-12T00:10:05.291758+0000","last_unstale":"2024-09-12T02:05:08.986469+0000","last_undegraded":"2024-09-12T02:05:08.986469+0000","last_fullsized":"2024-09-12T02:05:08.986469+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:40.013931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":458,"num_read_kb":969,"num_write":382,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.734558+0000","last_change":"2024-09-12T00:10:07.321987+0000","last_active":"2024-09-12T02:02:38.734558+0000","last_peered":"2024-09-12T02:02:38.734558+0000","last_clean":"2024-09-12T02:02:38.734558+0000","last_became_active":"2024-09-12T00:10:07.320509+0000","last_became_peered":"2024-09-12T00:10:07.320509+0000","last_unstale":"2024-09-12T02:02:38.734558+0000","last_undegraded":"2024-09-12T02:02:38.734558+0000","last_fullsized":"2024-09-12T02:02:38.734558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:24.557032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"266'169","reported_seq":1660,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:52.460371+0000","last_change":"2024-09-12T00:10:09.364380+0000","last_active":"2024-09-12T02:04:52.460371+0000","last_peered":"2024-09-12T02:04:52.460371+0000","last_clean":"2024-09-12T02:04:52.460371+0000","last_became_active":"2024-09-12T00:10:09.363609+0000","last_became_peered":"2024-09-12T00:10:09.363609+0000","last_unstale":"2024-09-12T02:04:52.460371+0000","last_undegraded":"2024-09-12T02:04:52.460371+0000","last_fullsized":"2024-09-12T02:04:52.460371+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:27.382248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1201,"num_read_kb":1188,"num_write":377,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"266'767","reported_seq":2292,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.935938+0000","last_change":"2024-09-12T00:10:01.255788+0000","last_active":"2024-09-12T02:04:59.935938+0000","last_peered":"2024-09-12T02:04:59.935938+0000","last_clean":"2024-09-12T02:04:59.935938+0000","last_became_active":"2024-09-12T00:10:01.255086+0000","last_became_peered":"2024-09-12T00:10:01.255086+0000","last_unstale":"2024-09-12T02:04:59.935938+0000","last_undegraded":"2024-09-12T02:04:59.935938+0000","last_fullsized":"2024-09-12T02:04:59.935938+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:14.844500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3623,"num_read_kb":3271,"num_write":1000,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"266'264","reported_seq":965,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.535196+0000","last_change":"2024-09-12T00:09:59.294231+0000","last_active":"2024-09-12T02:04:33.535196+0000","last_peered":"2024-09-12T02:04:33.535196+0000","last_clean":"2024-09-12T02:04:33.535196+0000","last_became_active":"2024-09-12T00:09:59.293822+0000","last_became_peered":"2024-09-12T00:09:59.293822+0000","last_unstale":"2024-09-12T02:04:33.535196+0000","last_undegraded":"2024-09-12T02:04:33.535196+0000","last_fullsized":"2024-09-12T02:04:33.535196+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:58.704023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7800593,"num_objects":56,"num_object_clones":0,"num_object_copies":224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":469,"num_read_kb":10999,"num_write":930,"num_write_kb":11811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.701152+0000","last_change":"2024-09-12T00:10:03.273307+0000","last_active":"2024-09-12T02:04:08.701152+0000","last_peered":"2024-09-12T02:04:08.701152+0000","last_clean":"2024-09-12T02:04:08.701152+0000","last_became_active":"2024-09-12T00:10:03.272579+0000","last_became_peered":"2024-09-12T00:10:03.272579+0000","last_unstale":"2024-09-12T02:04:08.701152+0000","last_undegraded":"2024-09-12T02:04:08.701152+0000","last_fullsized":"2024-09-12T02:04:08.701152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:05.059545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"266'366","reported_seq":1003,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.768464+0000","last_change":"2024-09-12T00:10:05.289062+0000","last_active":"2024-09-12T02:05:08.768464+0000","last_peered":"2024-09-12T02:05:08.768464+0000","last_clean":"2024-09-12T02:05:08.768464+0000","last_became_active":"2024-09-12T00:10:05.288230+0000","last_became_peered":"2024-09-12T00:10:05.288230+0000","last_unstale":"2024-09-12T02:05:08.768464+0000","last_undegraded":"2024-09-12T02:05:08.768464+0000","last_fullsized":"2024-09-12T02:05:08.768464+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:10.127963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70618,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":1144,"num_write":480,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718281+0000","last_change":"2024-09-12T00:10:07.327719+0000","last_active":"2024-09-12T02:02:38.718281+0000","last_peered":"2024-09-12T02:02:38.718281+0000","last_clean":"2024-09-12T02:02:38.718281+0000","last_became_active":"2024-09-12T00:10:07.325726+0000","last_became_peered":"2024-09-12T00:10:07.325726+0000","last_unstale":"2024-09-12T02:02:38.718281+0000","last_undegraded":"2024-09-12T02:02:38.718281+0000","last_fullsized":"2024-09-12T02:02:38.718281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:25.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"266'151","reported_seq":678,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.634814+0000","last_change":"2024-09-12T00:10:09.353828+0000","last_active":"2024-09-12T02:06:05.634814+0000","last_peered":"2024-09-12T02:06:05.634814+0000","last_clean":"2024-09-12T02:06:05.634814+0000","last_became_active":"2024-09-12T00:10:09.353036+0000","last_became_peered":"2024-09-12T00:10:09.353036+0000","last_unstale":"2024-09-12T02:06:05.634814+0000","last_undegraded":"2024-09-12T02:06:05.634814+0000","last_fullsized":"2024-09-12T02:06:05.634814+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:42.519114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":163,"num_write":387,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"266'724","reported_seq":2128,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.863697+0000","last_change":"2024-09-12T00:10:01.264074+0000","last_active":"2024-09-12T02:04:59.863697+0000","last_peered":"2024-09-12T02:04:59.863697+0000","last_clean":"2024-09-12T02:04:59.863697+0000","last_became_active":"2024-09-12T00:10:01.263786+0000","last_became_peered":"2024-09-12T00:10:01.263786+0000","last_unstale":"2024-09-12T02:04:59.863697+0000","last_undegraded":"2024-09-12T02:04:59.863697+0000","last_fullsized":"2024-09-12T02:04:59.863697+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:21.005100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3380,"num_read_kb":3030,"num_write":963,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"266'274","reported_seq":939,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:00.696700+0000","last_change":"2024-09-12T00:09:59.288404+0000","last_active":"2024-09-12T02:06:00.696700+0000","last_peered":"2024-09-12T02:06:00.696700+0000","last_clean":"2024-09-12T02:06:00.696700+0000","last_became_active":"2024-09-12T00:09:59.287488+0000","last_became_peered":"2024-09-12T00:09:59.287488+0000","last_unstale":"2024-09-12T02:06:00.696700+0000","last_undegraded":"2024-09-12T02:06:00.696700+0000","last_fullsized":"2024-09-12T02:06:00.696700+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:21.087354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11715102,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":374,"num_read_kb":42853,"num_write":896,"num_write_kb":24863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"266'457","reported_seq":1949,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.867698+0000","last_change":"2024-09-12T00:10:01.258659+0000","last_active":"2024-09-12T02:04:59.867698+0000","last_peered":"2024-09-12T02:04:59.867698+0000","last_clean":"2024-09-12T02:04:59.867698+0000","last_became_active":"2024-09-12T00:10:01.258361+0000","last_became_peered":"2024-09-12T00:10:01.258361+0000","last_unstale":"2024-09-12T02:04:59.867698+0000","last_undegraded":"2024-09-12T02:04:59.867698+0000","last_fullsized":"2024-09-12T02:04:59.867698+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:18.423469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2374,"num_read_kb":2204,"num_write":589,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"266'277","reported_seq":988,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.715993+0000","last_change":"2024-09-12T00:10:31.470461+0000","last_active":"2024-09-12T02:04:33.715993+0000","last_peered":"2024-09-12T02:04:33.715993+0000","last_clean":"2024-09-12T02:04:33.715993+0000","last_became_active":"2024-09-12T00:10:31.469140+0000","last_became_peered":"2024-09-12T00:10:31.469140+0000","last_unstale":"2024-09-12T02:04:33.715993+0000","last_undegraded":"2024-09-12T02:04:33.715993+0000","last_fullsized":"2024-09-12T02:04:33.715993+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:15.566429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9763700,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":490,"num_read_kb":38593,"num_write":1038,"num_write_kb":37292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"266'822","reported_seq":2507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726468+0000","last_change":"2024-09-12T00:10:01.279500+0000","last_active":"2024-09-12T02:02:44.726468+0000","last_peered":"2024-09-12T02:02:44.726468+0000","last_clean":"2024-09-12T02:02:44.726468+0000","last_became_active":"2024-09-12T00:10:01.275843+0000","last_became_peered":"2024-09-12T00:10:01.275843+0000","last_unstale":"2024-09-12T02:02:44.726468+0000","last_undegraded":"2024-09-12T02:02:44.726468+0000","last_fullsized":"2024-09-12T02:02:44.726468+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:29.293928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4035,"num_read_kb":3644,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"266'299","reported_seq":977,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.745692+0000","last_change":"2024-09-12T00:09:59.309888+0000","last_active":"2024-09-12T02:06:44.745692+0000","last_peered":"2024-09-12T02:06:44.745692+0000","last_clean":"2024-09-12T02:06:44.745692+0000","last_became_active":"2024-09-12T00:09:59.309327+0000","last_became_peered":"2024-09-12T00:09:59.309327+0000","last_unstale":"2024-09-12T02:06:44.745692+0000","last_undegraded":"2024-09-12T02:06:44.745692+0000","last_fullsized":"2024-09-12T02:06:44.745692+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:38.157743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6635867,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":484,"num_read_kb":15467,"num_write":1062,"num_write_kb":37224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"266'496","reported_seq":2144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681200+0000","last_change":"2024-09-12T00:10:01.261722+0000","last_active":"2024-09-12T02:02:43.681200+0000","last_peered":"2024-09-12T02:02:43.681200+0000","last_clean":"2024-09-12T02:02:43.681200+0000","last_became_active":"2024-09-12T00:10:01.261418+0000","last_became_peered":"2024-09-12T00:10:01.261418+0000","last_unstale":"2024-09-12T02:02:43.681200+0000","last_undegraded":"2024-09-12T02:02:43.681200+0000","last_fullsized":"2024-09-12T02:02:43.681200+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:12.125604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2751,"num_read_kb":2561,"num_write":595,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"266'286","reported_seq":1046,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:58.723228+0000","last_change":"2024-09-12T00:09:59.287032+0000","last_active":"2024-09-12T02:02:58.723228+0000","last_peered":"2024-09-12T02:02:58.723228+0000","last_clean":"2024-09-12T02:02:58.723228+0000","last_became_active":"2024-09-12T00:09:59.286590+0000","last_became_peered":"2024-09-12T00:09:59.286590+0000","last_unstale":"2024-09-12T02:02:58.723228+0000","last_undegraded":"2024-09-12T02:02:58.723228+0000","last_fullsized":"2024-09-12T02:02:58.723228+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:35.622983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11424046,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":647,"num_read_kb":40012,"num_write":1010,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"266'1463","reported_seq":3083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.676957+0000","last_change":"2024-09-12T00:10:01.262679+0000","last_active":"2024-09-12T02:06:05.676957+0000","last_peered":"2024-09-12T02:06:05.676957+0000","last_clean":"2024-09-12T02:06:05.676957+0000","last_became_active":"2024-09-12T00:10:01.261999+0000","last_became_peered":"2024-09-12T00:10:01.261999+0000","last_unstale":"2024-09-12T02:06:05.676957+0000","last_undegraded":"2024-09-12T02:06:05.676957+0000","last_fullsized":"2024-09-12T02:06:05.676957+0000","mapping_epoch":27,"log_start":"266'1400","ondisk_log_start":"266'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":1400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:32.253175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6652,"num_read_kb":5741,"num_write":2141,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"266'319","reported_seq":1062,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:57.966990+0000","last_change":"2024-09-12T00:09:59.286623+0000","last_active":"2024-09-12T02:05:57.966990+0000","last_peered":"2024-09-12T02:05:57.966990+0000","last_clean":"2024-09-12T02:05:57.966990+0000","last_became_active":"2024-09-12T00:09:59.286301+0000","last_became_peered":"2024-09-12T00:09:59.286301+0000","last_unstale":"2024-09-12T02:05:57.966990+0000","last_undegraded":"2024-09-12T02:05:57.966990+0000","last_fullsized":"2024-09-12T02:05:57.966990+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:46.585588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6602067,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":716,"num_read_kb":8719,"num_write":1137,"num_write_kb":26143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"266'391","reported_seq":1861,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936338+0000","last_change":"2024-09-12T00:10:01.268784+0000","last_active":"2024-09-12T02:04:59.936338+0000","last_peered":"2024-09-12T02:04:59.936338+0000","last_clean":"2024-09-12T02:04:59.936338+0000","last_became_active":"2024-09-12T00:10:01.266927+0000","last_became_peered":"2024-09-12T00:10:01.266927+0000","last_unstale":"2024-09-12T02:04:59.936338+0000","last_undegraded":"2024-09-12T02:04:59.936338+0000","last_fullsized":"2024-09-12T02:04:59.936338+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:03.258226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2147,"num_read_kb":2014,"num_write":451,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"266'287","reported_seq":996,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679831+0000","last_change":"2024-09-12T00:09:59.252139+0000","last_active":"2024-09-12T02:02:38.679831+0000","last_peered":"2024-09-12T02:02:38.679831+0000","last_clean":"2024-09-12T02:02:38.679831+0000","last_became_active":"2024-09-12T00:09:59.251413+0000","last_became_peered":"2024-09-12T00:09:59.251413+0000","last_unstale":"2024-09-12T02:02:38.679831+0000","last_undegraded":"2024-09-12T02:02:38.679831+0000","last_fullsized":"2024-09-12T02:02:38.679831+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:50.326651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2480726,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":505,"num_read_kb":23722,"num_write":1127,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"266'445","reported_seq":2119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.978719+0000","last_change":"2024-09-12T00:10:01.261639+0000","last_active":"2024-09-12T02:04:38.978719+0000","last_peered":"2024-09-12T02:04:38.978719+0000","last_clean":"2024-09-12T02:04:38.978719+0000","last_became_active":"2024-09-12T00:10:01.259942+0000","last_became_peered":"2024-09-12T00:10:01.259942+0000","last_unstale":"2024-09-12T02:04:38.978719+0000","last_undegraded":"2024-09-12T02:04:38.978719+0000","last_fullsized":"2024-09-12T02:04:38.978719+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:46.512977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2415,"num_read_kb":2305,"num_write":502,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"266'285","reported_seq":1010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.703200+0000","last_change":"2024-09-12T00:09:59.299099+0000","last_active":"2024-09-12T02:02:38.703200+0000","last_peered":"2024-09-12T02:02:38.703200+0000","last_clean":"2024-09-12T02:02:38.703200+0000","last_became_active":"2024-09-12T00:09:59.298085+0000","last_became_peered":"2024-09-12T00:09:59.298085+0000","last_unstale":"2024-09-12T02:02:38.703200+0000","last_undegraded":"2024-09-12T02:02:38.703200+0000","last_fullsized":"2024-09-12T02:02:38.703200+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:01.824707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9877543,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":548,"num_read_kb":58646,"num_write":1111,"num_write_kb":29645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"266'499","reported_seq":2206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729090+0000","last_change":"2024-09-12T00:10:01.256111+0000","last_active":"2024-09-12T02:04:38.729090+0000","last_peered":"2024-09-12T02:04:38.729090+0000","last_clean":"2024-09-12T02:04:38.729090+0000","last_became_active":"2024-09-12T00:10:01.255302+0000","last_became_peered":"2024-09-12T00:10:01.255302+0000","last_unstale":"2024-09-12T02:04:38.729090+0000","last_undegraded":"2024-09-12T02:04:38.729090+0000","last_fullsized":"2024-09-12T02:04:38.729090+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:49.290623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2619,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"266'286","reported_seq":1013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:56.725624+0000","last_change":"2024-09-12T00:09:59.286963+0000","last_active":"2024-09-12T02:05:56.725624+0000","last_peered":"2024-09-12T02:05:56.725624+0000","last_clean":"2024-09-12T02:05:56.725624+0000","last_became_active":"2024-09-12T00:09:59.286393+0000","last_became_peered":"2024-09-12T00:09:59.286393+0000","last_unstale":"2024-09-12T02:05:56.725624+0000","last_undegraded":"2024-09-12T02:05:56.725624+0000","last_fullsized":"2024-09-12T02:05:56.725624+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:52.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2536306,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":560,"num_read_kb":4602,"num_write":1105,"num_write_kb":13882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"266'595","reported_seq":2551,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719733+0000","last_change":"2024-09-12T00:10:01.248053+0000","last_active":"2024-09-12T02:04:59.719733+0000","last_peered":"2024-09-12T02:04:59.719733+0000","last_clean":"2024-09-12T02:04:59.719733+0000","last_became_active":"2024-09-12T00:10:01.247691+0000","last_became_peered":"2024-09-12T00:10:01.247691+0000","last_unstale":"2024-09-12T02:04:59.719733+0000","last_undegraded":"2024-09-12T02:04:59.719733+0000","last_fullsized":"2024-09-12T02:04:59.719733+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:02.948022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3679,"num_read_kb":3455,"num_write":725,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"266'294","reported_seq":954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.692346+0000","last_change":"2024-09-12T00:09:59.301446+0000","last_active":"2024-09-12T02:06:44.692346+0000","last_peered":"2024-09-12T02:06:44.692346+0000","last_clean":"2024-09-12T02:06:44.692346+0000","last_became_active":"2024-09-12T00:09:59.300760+0000","last_became_peered":"2024-09-12T00:09:59.300760+0000","last_unstale":"2024-09-12T02:06:44.692346+0000","last_undegraded":"2024-09-12T02:06:44.692346+0000","last_fullsized":"2024-09-12T02:06:44.692346+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:42.952819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18340267,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":411,"num_read_kb":26981,"num_write":1106,"num_write_kb":52645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"266'957","reported_seq":2608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.758101+0000","last_change":"2024-09-12T00:10:01.239366+0000","last_active":"2024-09-12T02:04:23.758101+0000","last_peered":"2024-09-12T02:04:23.758101+0000","last_clean":"2024-09-12T02:04:23.758101+0000","last_became_active":"2024-09-12T00:10:01.238674+0000","last_became_peered":"2024-09-12T00:10:01.238674+0000","last_unstale":"2024-09-12T02:04:23.758101+0000","last_undegraded":"2024-09-12T02:04:23.758101+0000","last_fullsized":"2024-09-12T02:04:23.758101+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":900,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:27.928106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4713,"num_read_kb":4229,"num_write":1343,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"266'235","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.980115+0000","last_change":"2024-09-12T00:09:59.289360+0000","last_active":"2024-09-12T02:04:43.980115+0000","last_peered":"2024-09-12T02:04:43.980115+0000","last_clean":"2024-09-12T02:04:43.980115+0000","last_became_active":"2024-09-12T00:09:59.288260+0000","last_became_peered":"2024-09-12T00:09:59.288260+0000","last_unstale":"2024-09-12T02:04:43.980115+0000","last_undegraded":"2024-09-12T02:04:43.980115+0000","last_fullsized":"2024-09-12T02:04:43.980115+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:05.984205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6365656,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":381,"num_read_kb":7701,"num_write":834,"num_write_kb":23188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"266'342","reported_seq":1890,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.726617+0000","last_change":"2024-09-12T00:10:01.265917+0000","last_active":"2024-09-12T02:06:05.726617+0000","last_peered":"2024-09-12T02:06:05.726617+0000","last_clean":"2024-09-12T02:06:05.726617+0000","last_became_active":"2024-09-12T00:10:01.265676+0000","last_became_peered":"2024-09-12T00:10:01.265676+0000","last_unstale":"2024-09-12T02:06:05.726617+0000","last_undegraded":"2024-09-12T02:06:05.726617+0000","last_fullsized":"2024-09-12T02:06:05.726617+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:37.696003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1939,"num_read_kb":1902,"num_write":362,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"266'264","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.706867+0000","last_change":"2024-09-12T00:09:59.311681+0000","last_active":"2024-09-12T02:06:44.706867+0000","last_peered":"2024-09-12T02:06:44.706867+0000","last_clean":"2024-09-12T02:06:44.706867+0000","last_became_active":"2024-09-12T00:09:59.311132+0000","last_became_peered":"2024-09-12T00:09:59.311132+0000","last_unstale":"2024-09-12T02:06:44.706867+0000","last_undegraded":"2024-09-12T02:06:44.706867+0000","last_fullsized":"2024-09-12T02:06:44.706867+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:34.389668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14238252,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":445,"num_read_kb":37892,"num_write":972,"num_write_kb":21146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"266'929","reported_seq":2547,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.499343+0000","last_change":"2024-09-12T00:10:01.256409+0000","last_active":"2024-09-12T02:04:57.499343+0000","last_peered":"2024-09-12T02:04:57.499343+0000","last_clean":"2024-09-12T02:04:57.499343+0000","last_became_active":"2024-09-12T00:10:01.255682+0000","last_became_peered":"2024-09-12T00:10:01.255682+0000","last_unstale":"2024-09-12T02:04:57.499343+0000","last_undegraded":"2024-09-12T02:04:57.499343+0000","last_fullsized":"2024-09-12T02:04:57.499343+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:22.673852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4312,"num_read_kb":3831,"num_write":1239,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"266'269","reported_seq":952,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.715872+0000","last_change":"2024-09-12T00:09:59.301361+0000","last_active":"2024-09-12T02:02:28.715872+0000","last_peered":"2024-09-12T02:02:28.715872+0000","last_clean":"2024-09-12T02:02:28.715872+0000","last_became_active":"2024-09-12T00:09:59.300699+0000","last_became_peered":"2024-09-12T00:09:59.300699+0000","last_unstale":"2024-09-12T02:02:28.715872+0000","last_undegraded":"2024-09-12T02:02:28.715872+0000","last_fullsized":"2024-09-12T02:02:28.715872+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:17.083956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2394295,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":490,"num_read_kb":7531,"num_write":1024,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"266'857","reported_seq":2535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.886077+0000","last_change":"2024-09-12T00:10:01.265550+0000","last_active":"2024-09-12T02:04:59.886077+0000","last_peered":"2024-09-12T02:04:59.886077+0000","last_clean":"2024-09-12T02:04:59.886077+0000","last_became_active":"2024-09-12T00:10:01.264795+0000","last_became_peered":"2024-09-12T00:10:01.264795+0000","last_unstale":"2024-09-12T02:04:59.886077+0000","last_undegraded":"2024-09-12T02:04:59.886077+0000","last_fullsized":"2024-09-12T02:04:59.886077+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:05.882685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3745,"num_write":1135,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"266'314","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.700929+0000","last_change":"2024-09-12T00:09:59.304543+0000","last_active":"2024-09-12T02:02:28.700929+0000","last_peered":"2024-09-12T02:02:28.700929+0000","last_clean":"2024-09-12T02:02:28.700929+0000","last_became_active":"2024-09-12T00:09:59.299516+0000","last_became_peered":"2024-09-12T00:09:59.299516+0000","last_unstale":"2024-09-12T02:02:28.700929+0000","last_undegraded":"2024-09-12T02:02:28.700929+0000","last_fullsized":"2024-09-12T02:02:28.700929+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:57.946312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5333108,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":489,"num_read_kb":14942,"num_write":1162,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"266'496","reported_seq":2130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.538818+0000","last_change":"2024-09-12T00:10:01.259052+0000","last_active":"2024-09-12T02:04:48.538818+0000","last_peered":"2024-09-12T02:04:48.538818+0000","last_clean":"2024-09-12T02:04:48.538818+0000","last_became_active":"2024-09-12T00:10:01.258691+0000","last_became_peered":"2024-09-12T00:10:01.258691+0000","last_unstale":"2024-09-12T02:04:48.538818+0000","last_undegraded":"2024-09-12T02:04:48.538818+0000","last_fullsized":"2024-09-12T02:04:48.538818+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:25.573412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2775,"num_read_kb":2593,"num_write":624,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"266'302","reported_seq":963,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731914+0000","last_change":"2024-09-12T00:09:59.314098+0000","last_active":"2024-09-12T02:02:53.731914+0000","last_peered":"2024-09-12T02:02:53.731914+0000","last_clean":"2024-09-12T02:02:53.731914+0000","last_became_active":"2024-09-12T00:09:59.313345+0000","last_became_peered":"2024-09-12T00:09:59.313345+0000","last_unstale":"2024-09-12T02:02:53.731914+0000","last_undegraded":"2024-09-12T02:02:53.731914+0000","last_fullsized":"2024-09-12T02:02:53.731914+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.271942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6963102,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":451,"num_read_kb":14475,"num_write":1024,"num_write_kb":25771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"266'323","reported_seq":1744,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.944772+0000","last_change":"2024-09-12T00:10:01.250260+0000","last_active":"2024-09-12T02:02:33.944772+0000","last_peered":"2024-09-12T02:02:33.944772+0000","last_clean":"2024-09-12T02:02:33.944772+0000","last_became_active":"2024-09-12T00:10:01.249832+0000","last_became_peered":"2024-09-12T00:10:01.249832+0000","last_unstale":"2024-09-12T02:02:33.944772+0000","last_undegraded":"2024-09-12T02:02:33.944772+0000","last_fullsized":"2024-09-12T02:02:33.944772+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:36.961457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1802,"num_read_kb":1736,"num_write":351,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"266'258","reported_seq":956,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.713014+0000","last_change":"2024-09-12T00:09:59.311678+0000","last_active":"2024-09-12T02:04:18.713014+0000","last_peered":"2024-09-12T02:04:18.713014+0000","last_clean":"2024-09-12T02:04:18.713014+0000","last_became_active":"2024-09-12T00:09:59.311158+0000","last_became_peered":"2024-09-12T00:09:59.311158+0000","last_unstale":"2024-09-12T02:04:18.713014+0000","last_undegraded":"2024-09-12T02:04:18.713014+0000","last_fullsized":"2024-09-12T02:04:18.713014+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:56.573170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21207376,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":449,"num_read_kb":115277,"num_write":936,"num_write_kb":39549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"266'719","reported_seq":2261,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.735208+0000","last_change":"2024-09-12T00:10:01.268377+0000","last_active":"2024-09-12T02:03:08.735208+0000","last_peered":"2024-09-12T02:03:08.735208+0000","last_clean":"2024-09-12T02:03:08.735208+0000","last_became_active":"2024-09-12T00:10:01.267027+0000","last_became_peered":"2024-09-12T00:10:01.267027+0000","last_unstale":"2024-09-12T02:03:08.735208+0000","last_undegraded":"2024-09-12T02:03:08.735208+0000","last_fullsized":"2024-09-12T02:03:08.735208+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:46.063409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3526,"num_read_kb":3200,"num_write":1050,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"266'278","reported_seq":941,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.566392+0000","last_change":"2024-09-12T00:09:59.287224+0000","last_active":"2024-09-12T02:06:44.566392+0000","last_peered":"2024-09-12T02:06:44.566392+0000","last_clean":"2024-09-12T02:06:44.566392+0000","last_became_active":"2024-09-12T00:09:59.285907+0000","last_became_peered":"2024-09-12T00:09:59.285907+0000","last_unstale":"2024-09-12T02:06:44.566392+0000","last_undegraded":"2024-09-12T02:06:44.566392+0000","last_fullsized":"2024-09-12T02:06:44.566392+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:31.224850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10543114,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":391,"num_read_kb":44645,"num_write":898,"num_write_kb":42281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"266'269","reported_seq":944,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.655638+0000","last_change":"2024-09-12T00:09:59.284497+0000","last_active":"2024-09-12T02:06:44.655638+0000","last_peered":"2024-09-12T02:06:44.655638+0000","last_clean":"2024-09-12T02:06:44.655638+0000","last_became_active":"2024-09-12T00:09:59.282446+0000","last_became_peered":"2024-09-12T00:09:59.282446+0000","last_unstale":"2024-09-12T02:06:44.655638+0000","last_undegraded":"2024-09-12T02:06:44.655638+0000","last_fullsized":"2024-09-12T02:06:44.655638+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:03.250241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852705,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":427,"num_read_kb":44688,"num_write":1004,"num_write_kb":33304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"266'455","reported_seq":2028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.721307+0000","last_change":"2024-09-12T00:10:01.248091+0000","last_active":"2024-09-12T02:06:05.721307+0000","last_peered":"2024-09-12T02:06:05.721307+0000","last_clean":"2024-09-12T02:06:05.721307+0000","last_became_active":"2024-09-12T00:10:01.247767+0000","last_became_peered":"2024-09-12T00:10:01.247767+0000","last_unstale":"2024-09-12T02:06:05.721307+0000","last_undegraded":"2024-09-12T02:06:05.721307+0000","last_fullsized":"2024-09-12T02:06:05.721307+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.370640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2488,"num_read_kb":2350,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"266'296","reported_seq":1003,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.703437+0000","last_change":"2024-09-12T00:10:31.168863+0000","last_active":"2024-09-12T02:04:18.703437+0000","last_peered":"2024-09-12T02:04:18.703437+0000","last_clean":"2024-09-12T02:04:18.703437+0000","last_became_active":"2024-09-12T00:10:31.168444+0000","last_became_peered":"2024-09-12T00:10:31.168444+0000","last_unstale":"2024-09-12T02:04:18.703437+0000","last_undegraded":"2024-09-12T02:04:18.703437+0000","last_fullsized":"2024-09-12T02:04:18.703437+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:26.977451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6685060,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":542,"num_read_kb":20125,"num_write":1237,"num_write_kb":40521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,0],"acting":[1,4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"266'1085","reported_seq":2767,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.671979+0000","last_change":"2024-09-12T00:10:01.279860+0000","last_active":"2024-09-12T02:06:05.671979+0000","last_peered":"2024-09-12T02:06:05.671979+0000","last_clean":"2024-09-12T02:06:05.671979+0000","last_became_active":"2024-09-12T00:10:01.278762+0000","last_became_peered":"2024-09-12T00:10:01.278762+0000","last_unstale":"2024-09-12T02:06:05.671979+0000","last_undegraded":"2024-09-12T02:06:05.671979+0000","last_fullsized":"2024-09-12T02:06:05.671979+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:38.059400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5202,"num_read_kb":4573,"num_write":1592,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6060,"num_read_kb":4225,"num_write":1955,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1026,"ondisk_log_size":1026,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":15149,"num_read_kb":14793,"num_write":16764,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":401,"ondisk_log_size":401,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1922792,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":20853,"num_read_kb":36649,"num_write":17541,"num_write_kb":12451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":2795406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2416,"num_read_kb":2879,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213079,"num_read_kb":194397,"num_write":55367,"num_write_kb":18884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":567081307,"num_objects":4426,"num_object_clones":0,"num_object_copies":17704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4426,"num_whiteouts":0,"num_read":32250,"num_read_kb":1955743,"num_write":67977,"num_write_kb":2110952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":826138624,"data_stored":826138624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3814,"ondisk_log_size":3814,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":74495462,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":136,"num_read_kb":180842,"num_write":158,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":148996096,"data_stored":148990924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":74495462,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":132,"num_read_kb":169574,"num_write":158,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":148996096,"data_stored":148990924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543554,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":445280,"kb_used_data":129488,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93926560,"statfs":{"total":96636764160,"available":96180797440,"internally_reserved":0,"allocated":132595712,"data_stored":130540172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323353034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543554,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":442628,"kb_used_data":150452,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93929212,"statfs":{"total":96636764160,"available":96183513088,"internally_reserved":0,"allocated":154062848,"data_stored":152082673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543560,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311840,"kb_used_data":146052,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94060000,"statfs":{"total":96636764160,"available":96317440000,"internally_reserved":0,"allocated":149557248,"data_stored":147478110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543555,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267484,"kb_used_data":150220,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94104356,"statfs":{"total":96636764160,"available":96362860544,"internally_reserved":0,"allocated":153825280,"data_stored":151886213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543557,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438936,"kb_used_data":142600,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":93932904,"statfs":{"total":96636764160,"available":96187293696,"internally_reserved":0,"allocated":146022400,"data_stored":143970504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":303430087},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543555,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247480,"kb_used_data":135784,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94124360,"statfs":{"total":96636764160,"available":96383344640,"internally_reserved":0,"allocated":139042816,"data_stored":137087320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543557,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318920,"kb_used_data":143416,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94052920,"statfs":{"total":96636764160,"available":96310190080,"internally_reserved":0,"allocated":146857984,"data_stored":144840785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543556,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":432384,"kb_used_data":140272,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93939456,"statfs":{"total":96636764160,"available":96194002944,"internally_reserved":0,"allocated":143638528,"data_stored":141597819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":109019136,"data_stored":109019136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":93872128,"data_stored":93872128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94810112,"data_stored":94810112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":100274176,"data_stored":100274176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":88641536,"data_stored":88641536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118468608,"data_stored":118468608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":112795648,"data_stored":112795648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":108257280,"data_stored":108257280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":323827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":396927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":136578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":465781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":100661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":583903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":269872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":517857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20975616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29356032,"data_stored":29355146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16824668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21012480,"data_stored":21010780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6290570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22016000,"data_stored":22016000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9449472,"data_stored":9449472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6303744,"data_stored":6303744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27308032,"data_stored":27305446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10493952,"data_stored":10493952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24113152,"data_stored":24113152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39845888,"data_stored":39845003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":16785408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14712832,"data_stored":14711131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":9433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:48.937 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:06:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:06:49.328 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-12T02:06:49.341 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":3772,"stamp":"2024-09-12T02:06:48.892893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":271335317,"num_objects":2274,"num_object_clones":0,"num_object_copies":8068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2274,"num_whiteouts":0,"num_read":293183,"num_read_kb":2562013,"num_write":162940,"num_write_kb":2404893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12905,"ondisk_log_size":12905,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2170780,"kb_used_data":385428,"kb_used_omap":12,"kb_used_meta":1784563,"kb_avail":752803940,"statfs":{"total":773094113280,"available":770871234560,"internally_reserved":0,"allocated":394678272,"data_stored":378726368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1827393072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-452511741,"num_objects":-2767,"num_object_clones":0,"num_object_copies":-10980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2767,"num_whiteouts":0,"num_read":3092,"num_read_kb":2849,"num_write":2935,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.019717"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:54.728675+0000","last_change":"2024-09-12T01:00:24.087308+0000","last_active":"2024-09-12T02:02:54.728675+0000","last_peered":"2024-09-12T02:02:54.728675+0000","last_clean":"2024-09-12T02:02:54.728675+0000","last_became_active":"2024-09-12T01:00:24.086540+0000","last_became_peered":"2024-09-12T01:00:24.086540+0000","last_unstale":"2024-09-12T02:02:54.728675+0000","last_undegraded":"2024-09-12T02:02:54.728675+0000","last_fullsized":"2024-09-12T02:02:54.728675+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:55.672405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"266'2","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:24.721564+0000","last_change":"2024-09-12T00:32:21.646660+0000","last_active":"2024-09-12T02:02:24.721564+0000","last_peered":"2024-09-12T02:02:24.721564+0000","last_clean":"2024-09-12T02:02:24.721564+0000","last_became_active":"2024-09-12T00:32:21.645757+0000","last_became_peered":"2024-09-12T00:32:21.645757+0000","last_unstale":"2024-09-12T02:02:24.721564+0000","last_undegraded":"2024-09-12T02:02:24.721564+0000","last_fullsized":"2024-09-12T02:02:24.721564+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"266'4","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.939619+0000","last_change":"2024-09-12T00:32:14.592938+0000","last_active":"2024-09-12T02:02:13.939619+0000","last_peered":"2024-09-12T02:02:13.939619+0000","last_clean":"2024-09-12T02:02:13.939619+0000","last_became_active":"2024-09-12T00:32:14.592177+0000","last_became_peered":"2024-09-12T00:32:14.592177+0000","last_unstale":"2024-09-12T02:02:13.939619+0000","last_undegraded":"2024-09-12T02:02:13.939619+0000","last_fullsized":"2024-09-12T02:02:13.939619+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:54.401327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4193419,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8188,"num_write":4,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"266'29","reported_seq":164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.531382+0000","last_change":"2024-09-12T00:26:23.355721+0000","last_active":"2024-09-12T02:04:18.531382+0000","last_peered":"2024-09-12T02:04:18.531382+0000","last_clean":"2024-09-12T02:04:18.531382+0000","last_became_active":"2024-09-12T00:26:23.353338+0000","last_became_peered":"2024-09-12T00:26:23.353338+0000","last_unstale":"2024-09-12T02:04:18.531382+0000","last_undegraded":"2024-09-12T02:04:18.531382+0000","last_fullsized":"2024-09-12T02:04:18.531382+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.176865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.694256+0000","last_change":"2024-09-12T01:00:24.074808+0000","last_active":"2024-09-12T02:02:53.694256+0000","last_peered":"2024-09-12T02:02:53.694256+0000","last_clean":"2024-09-12T02:02:53.694256+0000","last_became_active":"2024-09-12T01:00:24.074048+0000","last_became_peered":"2024-09-12T01:00:24.074048+0000","last_unstale":"2024-09-12T02:02:53.694256+0000","last_undegraded":"2024-09-12T02:02:53.694256+0000","last_fullsized":"2024-09-12T02:02:53.694256+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:33.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"266'13","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.492562+0000","last_change":"2024-09-12T00:32:21.643734+0000","last_active":"2024-09-12T02:06:46.492562+0000","last_peered":"2024-09-12T02:06:46.492562+0000","last_clean":"2024-09-12T02:06:46.492562+0000","last_became_active":"2024-09-12T00:32:21.642967+0000","last_became_peered":"2024-09-12T00:32:21.642967+0000","last_unstale":"2024-09-12T02:06:46.492562+0000","last_undegraded":"2024-09-12T02:06:46.492562+0000","last_fullsized":"2024-09-12T02:06:46.492562+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:09.883461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24594,"num_write":18,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.674367+0000","last_change":"2024-09-12T00:32:14.603921+0000","last_active":"2024-09-12T02:02:13.674367+0000","last_peered":"2024-09-12T02:02:13.674367+0000","last_clean":"2024-09-12T02:02:13.674367+0000","last_became_active":"2024-09-12T00:32:14.602766+0000","last_became_peered":"2024-09-12T00:32:14.602766+0000","last_unstale":"2024-09-12T02:02:13.674367+0000","last_undegraded":"2024-09-12T02:02:13.674367+0000","last_fullsized":"2024-09-12T02:02:13.674367+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.170421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"266'26","reported_seq":151,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.719414+0000","last_change":"2024-09-12T00:26:23.322380+0000","last_active":"2024-09-12T02:04:48.719414+0000","last_peered":"2024-09-12T02:04:48.719414+0000","last_clean":"2024-09-12T02:04:48.719414+0000","last_became_active":"2024-09-12T00:26:23.321682+0000","last_became_peered":"2024-09-12T00:26:23.321682+0000","last_unstale":"2024-09-12T02:04:48.719414+0000","last_undegraded":"2024-09-12T02:04:48.719414+0000","last_fullsized":"2024-09-12T02:04:48.719414+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:28.612956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.710738+0000","last_change":"2024-09-12T01:00:24.076714+0000","last_active":"2024-09-12T02:03:13.710738+0000","last_peered":"2024-09-12T02:03:13.710738+0000","last_clean":"2024-09-12T02:03:13.710738+0000","last_became_active":"2024-09-12T01:00:24.075719+0000","last_became_peered":"2024-09-12T01:00:24.075719+0000","last_unstale":"2024-09-12T02:03:13.710738+0000","last_undegraded":"2024-09-12T02:03:13.710738+0000","last_fullsized":"2024-09-12T02:03:13.710738+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:33.848488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"266'2","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:08.555301+0000","last_change":"2024-09-12T00:32:21.664584+0000","last_active":"2024-09-12T02:06:08.555301+0000","last_peered":"2024-09-12T02:06:08.555301+0000","last_clean":"2024-09-12T02:06:08.555301+0000","last_became_active":"2024-09-12T00:32:21.663938+0000","last_became_peered":"2024-09-12T00:32:21.663938+0000","last_unstale":"2024-09-12T02:06:08.555301+0000","last_undegraded":"2024-09-12T02:06:08.555301+0000","last_fullsized":"2024-09-12T02:06:08.555301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:56.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"266'10","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.739819+0000","last_change":"2024-09-12T00:32:14.598635+0000","last_active":"2024-09-12T02:06:38.739819+0000","last_peered":"2024-09-12T02:06:38.739819+0000","last_clean":"2024-09-12T02:06:38.739819+0000","last_became_active":"2024-09-12T00:32:14.597094+0000","last_became_peered":"2024-09-12T00:32:14.597094+0000","last_unstale":"2024-09-12T02:06:38.739819+0000","last_undegraded":"2024-09-12T02:06:38.739819+0000","last_fullsized":"2024-09-12T02:06:38.739819+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:37.960853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24574,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"266'4","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525390+0000","last_change":"2024-09-12T00:26:23.350775+0000","last_active":"2024-09-12T02:03:53.525390+0000","last_peered":"2024-09-12T02:03:53.525390+0000","last_clean":"2024-09-12T02:03:53.525390+0000","last_became_active":"2024-09-12T00:26:23.349476+0000","last_became_peered":"2024-09-12T00:26:23.349476+0000","last_unstale":"2024-09-12T02:03:53.525390+0000","last_undegraded":"2024-09-12T02:03:53.525390+0000","last_fullsized":"2024-09-12T02:03:53.525390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:55.207200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959089+0000","last_change":"2024-09-12T01:00:24.070271+0000","last_active":"2024-09-12T02:03:23.959089+0000","last_peered":"2024-09-12T02:03:23.959089+0000","last_clean":"2024-09-12T02:03:23.959089+0000","last_became_active":"2024-09-12T01:00:24.069555+0000","last_became_peered":"2024-09-12T01:00:24.069555+0000","last_unstale":"2024-09-12T02:03:23.959089+0000","last_undegraded":"2024-09-12T02:03:23.959089+0000","last_fullsized":"2024-09-12T02:03:23.959089+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:30.440481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"266'1","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.979004+0000","last_change":"2024-09-12T00:32:21.658088+0000","last_active":"2024-09-12T02:04:38.979004+0000","last_peered":"2024-09-12T02:04:38.979004+0000","last_clean":"2024-09-12T02:04:38.979004+0000","last_became_active":"2024-09-12T00:32:21.654241+0000","last_became_peered":"2024-09-12T00:32:21.654241+0000","last_unstale":"2024-09-12T02:04:38.979004+0000","last_undegraded":"2024-09-12T02:04:38.979004+0000","last_fullsized":"2024-09-12T02:04:38.979004+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:08.083982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"266'13","reported_seq":98,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.298455+0000","last_change":"2024-09-12T00:32:14.586986+0000","last_active":"2024-09-12T02:06:46.298455+0000","last_peered":"2024-09-12T02:06:46.298455+0000","last_clean":"2024-09-12T02:06:46.298455+0000","last_became_active":"2024-09-12T00:32:14.586250+0000","last_became_peered":"2024-09-12T00:32:14.586250+0000","last_unstale":"2024-09-12T02:06:46.298455+0000","last_undegraded":"2024-09-12T02:06:46.298455+0000","last_fullsized":"2024-09-12T02:06:46.298455+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.871370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":31734,"num_write":18,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"266'26","reported_seq":142,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967298+0000","last_change":"2024-09-12T00:26:23.334469+0000","last_active":"2024-09-12T02:03:53.967298+0000","last_peered":"2024-09-12T02:03:53.967298+0000","last_clean":"2024-09-12T02:03:53.967298+0000","last_became_active":"2024-09-12T00:26:23.327186+0000","last_became_peered":"2024-09-12T00:26:23.327186+0000","last_unstale":"2024-09-12T02:03:53.967298+0000","last_undegraded":"2024-09-12T02:03:53.967298+0000","last_fullsized":"2024-09-12T02:03:53.967298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:43.603716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.977562+0000","last_change":"2024-09-12T01:00:24.078700+0000","last_active":"2024-09-12T02:04:33.977562+0000","last_peered":"2024-09-12T02:04:33.977562+0000","last_clean":"2024-09-12T02:04:33.977562+0000","last_became_active":"2024-09-12T01:00:24.077651+0000","last_became_peered":"2024-09-12T01:00:24.077651+0000","last_unstale":"2024-09-12T02:04:33.977562+0000","last_undegraded":"2024-09-12T02:04:33.977562+0000","last_fullsized":"2024-09-12T02:04:33.977562+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"266'4","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:01:59.712373+0000","last_change":"2024-09-12T00:32:21.651210+0000","last_active":"2024-09-12T02:01:59.712373+0000","last_peered":"2024-09-12T02:01:59.712373+0000","last_clean":"2024-09-12T02:01:59.712373+0000","last_became_active":"2024-09-12T00:32:21.649921+0000","last_became_peered":"2024-09-12T00:32:21.649921+0000","last_unstale":"2024-09-12T02:01:59.712373+0000","last_undegraded":"2024-09-12T02:01:59.712373+0000","last_fullsized":"2024-09-12T02:01:59.712373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:54.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.528825+0000","last_change":"2024-09-12T00:32:14.608528+0000","last_active":"2024-09-12T02:04:08.528825+0000","last_peered":"2024-09-12T02:04:08.528825+0000","last_clean":"2024-09-12T02:04:08.528825+0000","last_became_active":"2024-09-12T00:32:14.607652+0000","last_became_peered":"2024-09-12T00:32:14.607652+0000","last_unstale":"2024-09-12T02:04:08.528825+0000","last_undegraded":"2024-09-12T02:04:08.528825+0000","last_fullsized":"2024-09-12T02:04:08.528825+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:12.098399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"266'15","reported_seq":114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967169+0000","last_change":"2024-09-12T00:26:23.343440+0000","last_active":"2024-09-12T02:03:53.967169+0000","last_peered":"2024-09-12T02:03:53.967169+0000","last_clean":"2024-09-12T02:03:53.967169+0000","last_became_active":"2024-09-12T00:26:23.339416+0000","last_became_peered":"2024-09-12T00:26:23.339416+0000","last_unstale":"2024-09-12T02:03:53.967169+0000","last_undegraded":"2024-09-12T02:03:53.967169+0000","last_fullsized":"2024-09-12T02:03:53.967169+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:20.570031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.683894+0000","last_change":"2024-09-12T01:00:24.065435+0000","last_active":"2024-09-12T02:02:53.683894+0000","last_peered":"2024-09-12T02:02:53.683894+0000","last_clean":"2024-09-12T02:02:53.683894+0000","last_became_active":"2024-09-12T01:00:24.064732+0000","last_became_peered":"2024-09-12T01:00:24.064732+0000","last_unstale":"2024-09-12T02:02:53.683894+0000","last_undegraded":"2024-09-12T02:02:53.683894+0000","last_fullsized":"2024-09-12T02:02:53.683894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:36.186270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"266'2","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.755847+0000","last_change":"2024-09-12T00:32:21.650109+0000","last_active":"2024-09-12T02:06:38.755847+0000","last_peered":"2024-09-12T02:06:38.755847+0000","last_clean":"2024-09-12T02:06:38.755847+0000","last_became_active":"2024-09-12T00:32:21.649260+0000","last_became_peered":"2024-09-12T00:32:21.649260+0000","last_unstale":"2024-09-12T02:06:38.755847+0000","last_undegraded":"2024-09-12T02:06:38.755847+0000","last_fullsized":"2024-09-12T02:06:38.755847+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:56.433116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'3","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:03.726329+0000","last_change":"2024-09-12T00:32:14.582866+0000","last_active":"2024-09-12T02:02:03.726329+0000","last_peered":"2024-09-12T02:02:03.726329+0000","last_clean":"2024-09-12T02:02:03.726329+0000","last_became_active":"2024-09-12T00:32:14.582112+0000","last_became_peered":"2024-09-12T00:32:14.582112+0000","last_unstale":"2024-09-12T02:02:03.726329+0000","last_undegraded":"2024-09-12T02:02:03.726329+0000","last_fullsized":"2024-09-12T02:02:03.726329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:42.072877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"266'88","reported_seq":399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719464+0000","last_change":"2024-09-12T00:26:23.329328+0000","last_active":"2024-09-12T02:03:53.719464+0000","last_peered":"2024-09-12T02:03:53.719464+0000","last_clean":"2024-09-12T02:03:53.719464+0000","last_became_active":"2024-09-12T00:26:23.328597+0000","last_became_peered":"2024-09-12T00:26:23.328597+0000","last_unstale":"2024-09-12T02:03:53.719464+0000","last_undegraded":"2024-09-12T02:03:53.719464+0000","last_fullsized":"2024-09-12T02:03:53.719464+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:22.412755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":416,"num_write":108,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731863+0000","last_change":"2024-09-12T01:00:24.071788+0000","last_active":"2024-09-12T02:02:53.731863+0000","last_peered":"2024-09-12T02:02:53.731863+0000","last_clean":"2024-09-12T02:02:53.731863+0000","last_became_active":"2024-09-12T01:00:24.071095+0000","last_became_peered":"2024-09-12T01:00:24.071095+0000","last_unstale":"2024-09-12T02:02:53.731863+0000","last_undegraded":"2024-09-12T02:02:53.731863+0000","last_fullsized":"2024-09-12T02:02:53.731863+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:52.669721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"266'9","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.812457+0000","last_change":"2024-09-12T00:32:21.644665+0000","last_active":"2024-09-12T02:06:44.812457+0000","last_peered":"2024-09-12T02:06:44.812457+0000","last_clean":"2024-09-12T02:06:44.812457+0000","last_became_active":"2024-09-12T00:32:21.643876+0000","last_became_peered":"2024-09-12T00:32:21.643876+0000","last_unstale":"2024-09-12T02:06:44.812457+0000","last_undegraded":"2024-09-12T02:06:44.812457+0000","last_fullsized":"2024-09-12T02:06:44.812457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.090050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10236,"num_write":14,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.729779+0000","last_change":"2024-09-12T00:32:14.589458+0000","last_active":"2024-09-12T02:02:18.729779+0000","last_peered":"2024-09-12T02:02:18.729779+0000","last_clean":"2024-09-12T02:02:18.729779+0000","last_became_active":"2024-09-12T00:32:14.588375+0000","last_became_peered":"2024-09-12T00:32:14.588375+0000","last_unstale":"2024-09-12T02:02:18.729779+0000","last_undegraded":"2024-09-12T02:02:18.729779+0000","last_fullsized":"2024-09-12T02:02:18.729779+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:13.114682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7178,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"266'62","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.520452+0000","last_change":"2024-09-12T00:26:23.337872+0000","last_active":"2024-09-12T02:03:33.520452+0000","last_peered":"2024-09-12T02:03:33.520452+0000","last_clean":"2024-09-12T02:03:33.520452+0000","last_became_active":"2024-09-12T00:26:23.336278+0000","last_became_peered":"2024-09-12T00:26:23.336278+0000","last_unstale":"2024-09-12T02:03:33.520452+0000","last_undegraded":"2024-09-12T02:03:33.520452+0000","last_fullsized":"2024-09-12T02:03:33.520452+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:03.462066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":248,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731956+0000","last_change":"2024-09-12T01:00:24.078804+0000","last_active":"2024-09-12T02:02:53.731956+0000","last_peered":"2024-09-12T02:02:53.731956+0000","last_clean":"2024-09-12T02:02:53.731956+0000","last_became_active":"2024-09-12T01:00:24.078120+0000","last_became_peered":"2024-09-12T01:00:24.078120+0000","last_unstale":"2024-09-12T02:02:53.731956+0000","last_undegraded":"2024-09-12T02:02:53.731956+0000","last_fullsized":"2024-09-12T02:02:53.731956+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.036331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942038+0000","last_change":"2024-09-12T00:32:21.654093+0000","last_active":"2024-09-12T02:02:23.942038+0000","last_peered":"2024-09-12T02:02:23.942038+0000","last_clean":"2024-09-12T02:02:23.942038+0000","last_became_active":"2024-09-12T00:32:21.650564+0000","last_became_peered":"2024-09-12T00:32:21.650564+0000","last_unstale":"2024-09-12T02:02:23.942038+0000","last_undegraded":"2024-09-12T02:02:23.942038+0000","last_fullsized":"2024-09-12T02:02:23.942038+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:58.696714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.713920+0000","last_change":"2024-09-12T00:32:14.600836+0000","last_active":"2024-09-12T02:02:18.713920+0000","last_peered":"2024-09-12T02:02:18.713920+0000","last_clean":"2024-09-12T02:02:18.713920+0000","last_became_active":"2024-09-12T00:32:14.600188+0000","last_became_peered":"2024-09-12T00:32:14.600188+0000","last_unstale":"2024-09-12T02:02:18.713920+0000","last_undegraded":"2024-09-12T02:02:18.713920+0000","last_fullsized":"2024-09-12T02:02:18.713920+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:48.215097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"266'14","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.686029+0000","last_change":"2024-09-12T00:26:23.325628+0000","last_active":"2024-09-12T02:03:03.686029+0000","last_peered":"2024-09-12T02:03:03.686029+0000","last_clean":"2024-09-12T02:03:03.686029+0000","last_became_active":"2024-09-12T00:26:23.325067+0000","last_became_peered":"2024-09-12T00:26:23.325067+0000","last_unstale":"2024-09-12T02:03:03.686029+0000","last_undegraded":"2024-09-12T02:03:03.686029+0000","last_fullsized":"2024-09-12T02:03:03.686029+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.348834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690730+0000","last_change":"2024-09-12T01:00:24.075536+0000","last_active":"2024-09-12T02:03:23.690730+0000","last_peered":"2024-09-12T02:03:23.690730+0000","last_clean":"2024-09-12T02:03:23.690730+0000","last_became_active":"2024-09-12T01:00:24.075148+0000","last_became_peered":"2024-09-12T01:00:24.075148+0000","last_unstale":"2024-09-12T02:03:23.690730+0000","last_undegraded":"2024-09-12T02:03:23.690730+0000","last_fullsized":"2024-09-12T02:03:23.690730+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:59.023799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"266'1","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.972316+0000","last_change":"2024-09-12T00:32:21.658733+0000","last_active":"2024-09-12T02:04:13.972316+0000","last_peered":"2024-09-12T02:04:13.972316+0000","last_clean":"2024-09-12T02:04:13.972316+0000","last_became_active":"2024-09-12T00:32:21.654214+0000","last_became_peered":"2024-09-12T00:32:21.654214+0000","last_unstale":"2024-09-12T02:04:13.972316+0000","last_undegraded":"2024-09-12T02:04:13.972316+0000","last_fullsized":"2024-09-12T02:04:13.972316+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.587733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'5","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735335+0000","last_change":"2024-09-12T00:32:14.586921+0000","last_active":"2024-09-12T02:03:24.735335+0000","last_peered":"2024-09-12T02:03:24.735335+0000","last_clean":"2024-09-12T02:03:24.735335+0000","last_became_active":"2024-09-12T00:32:14.586101+0000","last_became_peered":"2024-09-12T00:32:14.586101+0000","last_unstale":"2024-09-12T02:03:24.735335+0000","last_undegraded":"2024-09-12T02:03:24.735335+0000","last_fullsized":"2024-09-12T02:03:24.735335+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:16.213342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"266'18","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.724550+0000","last_change":"2024-09-12T00:26:23.351546+0000","last_active":"2024-09-12T02:03:03.724550+0000","last_peered":"2024-09-12T02:03:03.724550+0000","last_clean":"2024-09-12T02:03:03.724550+0000","last_became_active":"2024-09-12T00:26:23.338890+0000","last_became_peered":"2024-09-12T00:26:23.338890+0000","last_unstale":"2024-09-12T02:03:03.724550+0000","last_undegraded":"2024-09-12T02:03:03.724550+0000","last_fullsized":"2024-09-12T02:03:03.724550+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:29.634760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.701374+0000","last_change":"2024-09-12T01:00:24.076901+0000","last_active":"2024-09-12T02:03:23.701374+0000","last_peered":"2024-09-12T02:03:23.701374+0000","last_clean":"2024-09-12T02:03:23.701374+0000","last_became_active":"2024-09-12T01:00:24.076081+0000","last_became_peered":"2024-09-12T01:00:24.076081+0000","last_unstale":"2024-09-12T02:03:23.701374+0000","last_undegraded":"2024-09-12T02:03:23.701374+0000","last_fullsized":"2024-09-12T02:03:23.701374+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:03.511093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'5","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.962875+0000","last_change":"2024-09-12T00:32:21.665472+0000","last_active":"2024-09-12T02:03:38.962875+0000","last_peered":"2024-09-12T02:03:38.962875+0000","last_clean":"2024-09-12T02:03:38.962875+0000","last_became_active":"2024-09-12T00:32:21.659460+0000","last_became_peered":"2024-09-12T00:32:21.659460+0000","last_unstale":"2024-09-12T02:03:38.962875+0000","last_undegraded":"2024-09-12T02:03:38.962875+0000","last_fullsized":"2024-09-12T02:03:38.962875+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:34.362543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:33.784493+0000","last_change":"2024-09-12T00:32:14.595556+0000","last_active":"2024-09-12T02:06:33.784493+0000","last_peered":"2024-09-12T02:06:33.784493+0000","last_clean":"2024-09-12T02:06:33.784493+0000","last_became_active":"2024-09-12T00:32:14.594973+0000","last_became_peered":"2024-09-12T00:32:14.594973+0000","last_unstale":"2024-09-12T02:06:33.784493+0000","last_undegraded":"2024-09-12T02:06:33.784493+0000","last_fullsized":"2024-09-12T02:06:33.784493+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":200,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.953162+0000","last_change":"2024-09-12T00:26:23.344345+0000","last_active":"2024-09-12T02:03:03.953162+0000","last_peered":"2024-09-12T02:03:03.953162+0000","last_clean":"2024-09-12T02:03:03.953162+0000","last_became_active":"2024-09-12T00:26:23.338462+0000","last_became_peered":"2024-09-12T00:26:23.338462+0000","last_unstale":"2024-09-12T02:03:03.953162+0000","last_undegraded":"2024-09-12T02:03:03.953162+0000","last_fullsized":"2024-09-12T02:03:03.953162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:51.275824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":170,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738756+0000","last_change":"2024-09-12T01:00:24.077452+0000","last_active":"2024-09-12T02:03:23.738756+0000","last_peered":"2024-09-12T02:03:23.738756+0000","last_clean":"2024-09-12T02:03:23.738756+0000","last_became_active":"2024-09-12T01:00:24.070957+0000","last_became_peered":"2024-09-12T01:00:24.070957+0000","last_unstale":"2024-09-12T02:03:23.738756+0000","last_undegraded":"2024-09-12T02:03:23.738756+0000","last_fullsized":"2024-09-12T02:03:23.738756+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:02.724541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"266'1","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.972451+0000","last_change":"2024-09-12T00:32:21.665635+0000","last_active":"2024-09-12T02:04:13.972451+0000","last_peered":"2024-09-12T02:04:13.972451+0000","last_clean":"2024-09-12T02:04:13.972451+0000","last_became_active":"2024-09-12T00:32:21.665036+0000","last_became_peered":"2024-09-12T00:32:21.665036+0000","last_unstale":"2024-09-12T02:04:13.972451+0000","last_undegraded":"2024-09-12T02:04:13.972451+0000","last_fullsized":"2024-09-12T02:04:13.972451+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.207114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2064,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:28.737035+0000","last_change":"2024-09-12T00:32:14.599371+0000","last_active":"2024-09-12T02:06:28.737035+0000","last_peered":"2024-09-12T02:06:28.737035+0000","last_clean":"2024-09-12T02:06:28.737035+0000","last_became_active":"2024-09-12T00:32:14.597944+0000","last_became_peered":"2024-09-12T00:32:14.597944+0000","last_unstale":"2024-09-12T02:06:28.737035+0000","last_undegraded":"2024-09-12T02:06:28.737035+0000","last_fullsized":"2024-09-12T02:06:28.737035+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:39.404510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"266'38","reported_seq":167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.696938+0000","last_change":"2024-09-12T00:26:23.318556+0000","last_active":"2024-09-12T02:03:03.696938+0000","last_peered":"2024-09-12T02:03:03.696938+0000","last_clean":"2024-09-12T02:03:03.696938+0000","last_became_active":"2024-09-12T00:26:23.317790+0000","last_became_peered":"2024-09-12T00:26:23.317790+0000","last_unstale":"2024-09-12T02:03:03.696938+0000","last_undegraded":"2024-09-12T02:03:03.696938+0000","last_fullsized":"2024-09-12T02:03:03.696938+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":107,"num_write":80,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735210+0000","last_change":"2024-09-12T01:00:24.078191+0000","last_active":"2024-09-12T02:03:24.735210+0000","last_peered":"2024-09-12T02:03:24.735210+0000","last_clean":"2024-09-12T02:03:24.735210+0000","last_became_active":"2024-09-12T01:00:24.077509+0000","last_became_peered":"2024-09-12T01:00:24.077509+0000","last_unstale":"2024-09-12T02:03:24.735210+0000","last_undegraded":"2024-09-12T02:03:24.735210+0000","last_fullsized":"2024-09-12T02:03:24.735210+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.532459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"266'2","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.788301+0000","last_change":"2024-09-12T00:32:21.652772+0000","last_active":"2024-09-12T02:06:38.788301+0000","last_peered":"2024-09-12T02:06:38.788301+0000","last_clean":"2024-09-12T02:06:38.788301+0000","last_became_active":"2024-09-12T00:32:21.644753+0000","last_became_peered":"2024-09-12T00:32:21.644753+0000","last_unstale":"2024-09-12T02:06:38.788301+0000","last_undegraded":"2024-09-12T02:06:38.788301+0000","last_fullsized":"2024-09-12T02:06:38.788301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:09.209891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:33.561239+0000","last_change":"2024-09-12T00:32:14.600221+0000","last_active":"2024-09-12T02:06:33.561239+0000","last_peered":"2024-09-12T02:06:33.561239+0000","last_clean":"2024-09-12T02:06:33.561239+0000","last_became_active":"2024-09-12T00:32:14.599452+0000","last_became_peered":"2024-09-12T00:32:14.599452+0000","last_unstale":"2024-09-12T02:06:33.561239+0000","last_undegraded":"2024-09-12T02:06:33.561239+0000","last_fullsized":"2024-09-12T02:06:33.561239+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:29.978923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"266'136","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.724784+0000","last_change":"2024-09-12T00:26:23.321368+0000","last_active":"2024-09-12T02:02:23.724784+0000","last_peered":"2024-09-12T02:02:23.724784+0000","last_clean":"2024-09-12T02:02:23.724784+0000","last_became_active":"2024-09-12T00:26:23.320613+0000","last_became_peered":"2024-09-12T00:26:23.320613+0000","last_unstale":"2024-09-12T02:02:23.724784+0000","last_undegraded":"2024-09-12T02:02:23.724784+0000","last_fullsized":"2024-09-12T02:02:23.724784+0000","mapping_epoch":253,"log_start":"263'100","ondisk_log_start":"263'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:54.209079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":872,"num_read_kb":592,"num_write":184,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956392+0000","last_change":"2024-09-12T01:00:24.061484+0000","last_active":"2024-09-12T02:03:13.956392+0000","last_peered":"2024-09-12T02:03:13.956392+0000","last_clean":"2024-09-12T02:03:13.956392+0000","last_became_active":"2024-09-12T01:00:24.060699+0000","last_became_peered":"2024-09-12T01:00:24.060699+0000","last_unstale":"2024-09-12T02:03:13.956392+0000","last_undegraded":"2024-09-12T02:03:13.956392+0000","last_fullsized":"2024-09-12T02:03:13.956392+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:39.025638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690685+0000","last_change":"2024-09-12T00:32:21.652868+0000","last_active":"2024-09-12T02:03:23.690685+0000","last_peered":"2024-09-12T02:03:23.690685+0000","last_clean":"2024-09-12T02:03:23.690685+0000","last_became_active":"2024-09-12T00:32:21.652122+0000","last_became_peered":"2024-09-12T00:32:21.652122+0000","last_unstale":"2024-09-12T02:03:23.690685+0000","last_undegraded":"2024-09-12T02:03:23.690685+0000","last_fullsized":"2024-09-12T02:03:23.690685+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:49.993050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"266'7","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:38.774817+0000","last_change":"2024-09-12T00:32:14.592680+0000","last_active":"2024-09-12T02:05:38.774817+0000","last_peered":"2024-09-12T02:05:38.774817+0000","last_clean":"2024-09-12T02:05:38.774817+0000","last_became_active":"2024-09-12T00:32:14.591921+0000","last_became_peered":"2024-09-12T00:32:14.591921+0000","last_unstale":"2024-09-12T02:05:38.774817+0000","last_undegraded":"2024-09-12T02:05:38.774817+0000","last_fullsized":"2024-09-12T02:05:38.774817+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:15.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3114,"num_write":12,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"266'28","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753409+0000","last_change":"2024-09-12T00:26:23.323596+0000","last_active":"2024-09-12T02:04:23.753409+0000","last_peered":"2024-09-12T02:04:23.753409+0000","last_clean":"2024-09-12T02:04:23.753409+0000","last_became_active":"2024-09-12T00:26:23.322866+0000","last_became_peered":"2024-09-12T00:26:23.322866+0000","last_unstale":"2024-09-12T02:04:23.753409+0000","last_undegraded":"2024-09-12T02:04:23.753409+0000","last_fullsized":"2024-09-12T02:04:23.753409+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:51.001961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727306+0000","last_change":"2024-09-12T01:00:24.064920+0000","last_active":"2024-09-12T02:03:13.727306+0000","last_peered":"2024-09-12T02:03:13.727306+0000","last_clean":"2024-09-12T02:03:13.727306+0000","last_became_active":"2024-09-12T01:00:24.064203+0000","last_became_peered":"2024-09-12T01:00:24.064203+0000","last_unstale":"2024-09-12T02:03:13.727306+0000","last_undegraded":"2024-09-12T02:03:13.727306+0000","last_fullsized":"2024-09-12T02:03:13.727306+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:14.355731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"266'7","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.657111+0000","last_change":"2024-09-12T00:32:21.660277+0000","last_active":"2024-09-12T02:06:45.657111+0000","last_peered":"2024-09-12T02:06:45.657111+0000","last_clean":"2024-09-12T02:06:45.657111+0000","last_became_active":"2024-09-12T00:32:21.659437+0000","last_became_peered":"2024-09-12T00:32:21.659437+0000","last_unstale":"2024-09-12T02:06:45.657111+0000","last_undegraded":"2024-09-12T02:06:45.657111+0000","last_fullsized":"2024-09-12T02:06:45.657111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:42.910621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":12,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"266'8","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956092+0000","last_change":"2024-09-12T00:32:14.599370+0000","last_active":"2024-09-12T02:03:13.956092+0000","last_peered":"2024-09-12T02:03:13.956092+0000","last_clean":"2024-09-12T02:03:13.956092+0000","last_became_active":"2024-09-12T00:32:14.597986+0000","last_became_peered":"2024-09-12T00:32:14.597986+0000","last_unstale":"2024-09-12T02:03:13.956092+0000","last_undegraded":"2024-09-12T02:03:13.956092+0000","last_fullsized":"2024-09-12T02:03:13.956092+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:36.841276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":11262,"num_write":13,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"266'46","reported_seq":199,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.532349+0000","last_change":"2024-09-12T00:26:23.336761+0000","last_active":"2024-09-12T02:04:23.532349+0000","last_peered":"2024-09-12T02:04:23.532349+0000","last_clean":"2024-09-12T02:04:23.532349+0000","last_became_active":"2024-09-12T00:26:23.336010+0000","last_became_peered":"2024-09-12T00:26:23.336010+0000","last_unstale":"2024-09-12T02:04:23.532349+0000","last_undegraded":"2024-09-12T02:04:23.532349+0000","last_fullsized":"2024-09-12T02:04:23.532349+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:52.664889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.523057+0000","last_change":"2024-09-12T01:00:24.074232+0000","last_active":"2024-09-12T02:03:43.523057+0000","last_peered":"2024-09-12T02:03:43.523057+0000","last_clean":"2024-09-12T02:03:43.523057+0000","last_became_active":"2024-09-12T01:00:24.061624+0000","last_became_peered":"2024-09-12T01:00:24.061624+0000","last_unstale":"2024-09-12T02:03:43.523057+0000","last_undegraded":"2024-09-12T02:03:43.523057+0000","last_fullsized":"2024-09-12T02:03:43.523057+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:30.381075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'7","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959211+0000","last_change":"2024-09-12T00:32:21.667593+0000","last_active":"2024-09-12T02:03:23.959211+0000","last_peered":"2024-09-12T02:03:23.959211+0000","last_clean":"2024-09-12T02:03:23.959211+0000","last_became_active":"2024-09-12T00:32:21.666101+0000","last_became_peered":"2024-09-12T00:32:21.666101+0000","last_unstale":"2024-09-12T02:03:23.959211+0000","last_undegraded":"2024-09-12T02:03:23.959211+0000","last_fullsized":"2024-09-12T02:03:23.959211+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:18.302518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3603,"num_write":12,"num_write_kb":1553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"266'3","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:38.742679+0000","last_change":"2024-09-12T00:32:14.580110+0000","last_active":"2024-09-12T02:05:38.742679+0000","last_peered":"2024-09-12T02:05:38.742679+0000","last_clean":"2024-09-12T02:05:38.742679+0000","last_became_active":"2024-09-12T00:32:14.579366+0000","last_became_peered":"2024-09-12T00:32:14.579366+0000","last_unstale":"2024-09-12T02:05:38.742679+0000","last_undegraded":"2024-09-12T02:05:38.742679+0000","last_fullsized":"2024-09-12T02:05:38.742679+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.632825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'8","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.757917+0000","last_change":"2024-09-12T00:26:23.323680+0000","last_active":"2024-09-12T02:04:23.757917+0000","last_peered":"2024-09-12T02:04:23.757917+0000","last_clean":"2024-09-12T02:04:23.757917+0000","last_became_active":"2024-09-12T00:26:23.322841+0000","last_became_peered":"2024-09-12T00:26:23.322841+0000","last_unstale":"2024-09-12T02:04:23.757917+0000","last_undegraded":"2024-09-12T02:04:23.757917+0000","last_fullsized":"2024-09-12T02:04:23.757917+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956312+0000","last_change":"2024-09-12T01:00:24.060507+0000","last_active":"2024-09-12T02:03:13.956312+0000","last_peered":"2024-09-12T02:03:13.956312+0000","last_clean":"2024-09-12T02:03:13.956312+0000","last_became_active":"2024-09-12T01:00:24.057061+0000","last_became_peered":"2024-09-12T01:00:24.057061+0000","last_unstale":"2024-09-12T02:03:13.956312+0000","last_undegraded":"2024-09-12T02:03:13.956312+0000","last_fullsized":"2024-09-12T02:03:13.956312+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:07.370347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"266'6","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.497296+0000","last_change":"2024-09-12T00:32:21.647911+0000","last_active":"2024-09-12T02:06:46.497296+0000","last_peered":"2024-09-12T02:06:46.497296+0000","last_clean":"2024-09-12T02:06:46.497296+0000","last_became_active":"2024-09-12T00:32:21.646690+0000","last_became_peered":"2024-09-12T00:32:21.646690+0000","last_unstale":"2024-09-12T02:06:46.497296+0000","last_undegraded":"2024-09-12T02:06:46.497296+0000","last_fullsized":"2024-09-12T02:06:46.497296+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:03.430085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2096,"num_write":6,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:14.733091+0000","last_change":"2024-09-12T00:32:14.577083+0000","last_active":"2024-09-12T02:03:14.733091+0000","last_peered":"2024-09-12T02:03:14.733091+0000","last_clean":"2024-09-12T02:03:14.733091+0000","last_became_active":"2024-09-12T00:32:14.576353+0000","last_became_peered":"2024-09-12T00:32:14.576353+0000","last_unstale":"2024-09-12T02:03:14.733091+0000","last_undegraded":"2024-09-12T02:03:14.733091+0000","last_fullsized":"2024-09-12T02:03:14.733091+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:17.483406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"266'19","reported_seq":129,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974634+0000","last_change":"2024-09-12T00:26:23.342320+0000","last_active":"2024-09-12T02:04:23.974634+0000","last_peered":"2024-09-12T02:04:23.974634+0000","last_clean":"2024-09-12T02:04:23.974634+0000","last_became_active":"2024-09-12T00:26:23.334078+0000","last_became_peered":"2024-09-12T00:26:23.334078+0000","last_unstale":"2024-09-12T02:04:23.974634+0000","last_undegraded":"2024-09-12T02:04:23.974634+0000","last_fullsized":"2024-09-12T02:04:23.974634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.869261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":39,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:28.702468+0000","last_change":"2024-09-12T01:00:24.076331+0000","last_active":"2024-09-12T02:03:28.702468+0000","last_peered":"2024-09-12T02:03:28.702468+0000","last_clean":"2024-09-12T02:03:28.702468+0000","last_became_active":"2024-09-12T01:00:24.075944+0000","last_became_peered":"2024-09-12T01:00:24.075944+0000","last_unstale":"2024-09-12T02:03:28.702468+0000","last_undegraded":"2024-09-12T02:03:28.702468+0000","last_fullsized":"2024-09-12T02:03:28.702468+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.174854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"266'3","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942289+0000","last_change":"2024-09-12T00:32:21.653900+0000","last_active":"2024-09-12T02:02:23.942289+0000","last_peered":"2024-09-12T02:02:23.942289+0000","last_clean":"2024-09-12T02:02:23.942289+0000","last_became_active":"2024-09-12T00:32:21.653054+0000","last_became_peered":"2024-09-12T00:32:21.653054+0000","last_unstale":"2024-09-12T02:02:23.942289+0000","last_undegraded":"2024-09-12T02:02:23.942289+0000","last_fullsized":"2024-09-12T02:02:23.942289+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:26.095259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8207,"num_write":3,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"266'10","reported_seq":91,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.035102+0000","last_change":"2024-09-12T00:32:14.597055+0000","last_active":"2024-09-12T02:06:45.035102+0000","last_peered":"2024-09-12T02:06:45.035102+0000","last_clean":"2024-09-12T02:06:45.035102+0000","last_became_active":"2024-09-12T00:32:14.596393+0000","last_became_peered":"2024-09-12T00:32:14.596393+0000","last_unstale":"2024-09-12T02:06:45.035102+0000","last_undegraded":"2024-09-12T02:06:45.035102+0000","last_fullsized":"2024-09-12T02:06:45.035102+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:35.143044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9234,"num_write":10,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"266'13","reported_seq":109,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959403+0000","last_change":"2024-09-12T00:26:23.354584+0000","last_active":"2024-09-12T02:03:23.959403+0000","last_peered":"2024-09-12T02:03:23.959403+0000","last_clean":"2024-09-12T02:03:23.959403+0000","last_became_active":"2024-09-12T00:26:23.353590+0000","last_became_peered":"2024-09-12T00:26:23.353590+0000","last_unstale":"2024-09-12T02:03:23.959403+0000","last_undegraded":"2024-09-12T02:03:23.959403+0000","last_fullsized":"2024-09-12T02:03:23.959403+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:36.184285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":34,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738884+0000","last_change":"2024-09-12T01:00:24.070343+0000","last_active":"2024-09-12T02:03:23.738884+0000","last_peered":"2024-09-12T02:03:23.738884+0000","last_clean":"2024-09-12T02:03:23.738884+0000","last_became_active":"2024-09-12T01:00:24.069491+0000","last_became_peered":"2024-09-12T01:00:24.069491+0000","last_unstale":"2024-09-12T02:03:23.738884+0000","last_undegraded":"2024-09-12T02:03:23.738884+0000","last_fullsized":"2024-09-12T02:03:23.738884+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:08.859472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942173+0000","last_change":"2024-09-12T00:32:21.668898+0000","last_active":"2024-09-12T02:02:23.942173+0000","last_peered":"2024-09-12T02:02:23.942173+0000","last_clean":"2024-09-12T02:02:23.942173+0000","last_became_active":"2024-09-12T00:32:21.668268+0000","last_became_peered":"2024-09-12T00:32:21.668268+0000","last_unstale":"2024-09-12T02:02:23.942173+0000","last_undegraded":"2024-09-12T02:02:23.942173+0000","last_fullsized":"2024-09-12T02:02:23.942173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:44.371260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"266'7","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.567934+0000","last_change":"2024-09-12T00:32:14.610770+0000","last_active":"2024-09-12T02:06:45.567934+0000","last_peered":"2024-09-12T02:06:45.567934+0000","last_clean":"2024-09-12T02:06:45.567934+0000","last_became_active":"2024-09-12T00:32:14.610187+0000","last_became_peered":"2024-09-12T00:32:14.610187+0000","last_unstale":"2024-09-12T02:06:45.567934+0000","last_undegraded":"2024-09-12T02:06:45.567934+0000","last_fullsized":"2024-09-12T02:06:45.567934+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:04.103920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2577,"num_write":12,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:09.732099+0000","last_change":"2024-09-12T00:26:23.333218+0000","last_active":"2024-09-12T02:03:09.732099+0000","last_peered":"2024-09-12T02:03:09.732099+0000","last_clean":"2024-09-12T02:03:09.732099+0000","last_became_active":"2024-09-12T00:26:23.328238+0000","last_became_peered":"2024-09-12T00:26:23.328238+0000","last_unstale":"2024-09-12T02:03:09.732099+0000","last_undegraded":"2024-09-12T02:03:09.732099+0000","last_fullsized":"2024-09-12T02:03:09.732099+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:08.447428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.710796+0000","last_change":"2024-09-12T01:00:24.075014+0000","last_active":"2024-09-12T02:03:13.710796+0000","last_peered":"2024-09-12T02:03:13.710796+0000","last_clean":"2024-09-12T02:03:13.710796+0000","last_became_active":"2024-09-12T01:00:24.074237+0000","last_became_peered":"2024-09-12T01:00:24.074237+0000","last_unstale":"2024-09-12T02:03:13.710796+0000","last_undegraded":"2024-09-12T02:03:13.710796+0000","last_fullsized":"2024-09-12T02:03:13.710796+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:45.410941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.683956+0000","last_change":"2024-09-12T00:32:21.643228+0000","last_active":"2024-09-12T02:02:53.683956+0000","last_peered":"2024-09-12T02:02:53.683956+0000","last_clean":"2024-09-12T02:02:53.683956+0000","last_became_active":"2024-09-12T00:32:21.642517+0000","last_became_peered":"2024-09-12T00:32:21.642517+0000","last_unstale":"2024-09-12T02:02:53.683956+0000","last_undegraded":"2024-09-12T02:02:53.683956+0000","last_fullsized":"2024-09-12T02:02:53.683956+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:33.274779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.299857+0000","last_change":"2024-09-12T00:32:14.608254+0000","last_active":"2024-09-12T02:06:46.299857+0000","last_peered":"2024-09-12T02:06:46.299857+0000","last_clean":"2024-09-12T02:06:46.299857+0000","last_became_active":"2024-09-12T00:32:14.607520+0000","last_became_peered":"2024-09-12T00:32:14.607520+0000","last_unstale":"2024-09-12T02:06:46.299857+0000","last_undegraded":"2024-09-12T02:06:46.299857+0000","last_fullsized":"2024-09-12T02:06:46.299857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:55.311964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"266'27","reported_seq":149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.709720+0000","last_change":"2024-09-12T00:26:23.314752+0000","last_active":"2024-09-12T02:03:08.709720+0000","last_peered":"2024-09-12T02:03:08.709720+0000","last_clean":"2024-09-12T02:03:08.709720+0000","last_became_active":"2024-09-12T00:26:23.313697+0000","last_became_peered":"2024-09-12T00:26:23.313697+0000","last_unstale":"2024-09-12T02:03:08.709720+0000","last_undegraded":"2024-09-12T02:03:08.709720+0000","last_fullsized":"2024-09-12T02:03:08.709720+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:17.759882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.736399+0000","last_change":"2024-09-12T01:00:24.077672+0000","last_active":"2024-09-12T02:03:13.736399+0000","last_peered":"2024-09-12T02:03:13.736399+0000","last_clean":"2024-09-12T02:03:13.736399+0000","last_became_active":"2024-09-12T01:00:24.072931+0000","last_became_peered":"2024-09-12T01:00:24.072931+0000","last_unstale":"2024-09-12T02:03:13.736399+0000","last_undegraded":"2024-09-12T02:03:13.736399+0000","last_fullsized":"2024-09-12T02:03:13.736399+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:03.310383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"266'7","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942349+0000","last_change":"2024-09-12T00:32:21.649878+0000","last_active":"2024-09-12T02:02:23.942349+0000","last_peered":"2024-09-12T02:02:23.942349+0000","last_clean":"2024-09-12T02:02:23.942349+0000","last_became_active":"2024-09-12T00:32:21.641431+0000","last_became_peered":"2024-09-12T00:32:21.641431+0000","last_unstale":"2024-09-12T02:02:23.942349+0000","last_undegraded":"2024-09-12T02:02:23.942349+0000","last_fullsized":"2024-09-12T02:02:23.942349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:17.569247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":20470,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681384+0000","last_change":"2024-09-12T00:32:14.597040+0000","last_active":"2024-09-12T02:02:43.681384+0000","last_peered":"2024-09-12T02:02:43.681384+0000","last_clean":"2024-09-12T02:02:43.681384+0000","last_became_active":"2024-09-12T00:32:14.596263+0000","last_became_peered":"2024-09-12T00:32:14.596263+0000","last_unstale":"2024-09-12T02:02:43.681384+0000","last_undegraded":"2024-09-12T02:02:43.681384+0000","last_fullsized":"2024-09-12T02:02:43.681384+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:09.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"266'66","reported_seq":265,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.698119+0000","last_change":"2024-09-12T00:26:23.328307+0000","last_active":"2024-09-12T02:03:08.698119+0000","last_peered":"2024-09-12T02:03:08.698119+0000","last_clean":"2024-09-12T02:03:08.698119+0000","last_became_active":"2024-09-12T00:26:23.327784+0000","last_became_peered":"2024-09-12T00:26:23.327784+0000","last_unstale":"2024-09-12T02:03:08.698119+0000","last_undegraded":"2024-09-12T02:03:08.698119+0000","last_fullsized":"2024-09-12T02:03:08.698119+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:59.830797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":253,"num_write":117,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959347+0000","last_change":"2024-09-12T01:00:24.067841+0000","last_active":"2024-09-12T02:03:23.959347+0000","last_peered":"2024-09-12T02:03:23.959347+0000","last_clean":"2024-09-12T02:03:23.959347+0000","last_became_active":"2024-09-12T01:00:24.066842+0000","last_became_peered":"2024-09-12T01:00:24.066842+0000","last_unstale":"2024-09-12T02:03:23.959347+0000","last_undegraded":"2024-09-12T02:03:23.959347+0000","last_fullsized":"2024-09-12T02:03:23.959347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:36.376146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.744288+0000","last_change":"2024-09-12T00:32:21.667714+0000","last_active":"2024-09-12T02:03:23.744288+0000","last_peered":"2024-09-12T02:03:23.744288+0000","last_clean":"2024-09-12T02:03:23.744288+0000","last_became_active":"2024-09-12T00:32:21.667149+0000","last_became_peered":"2024-09-12T00:32:21.667149+0000","last_unstale":"2024-09-12T02:03:23.744288+0000","last_undegraded":"2024-09-12T02:03:23.744288+0000","last_fullsized":"2024-09-12T02:03:23.744288+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:34.141900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"266'3","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:28.547343+0000","last_change":"2024-09-12T00:32:14.601942+0000","last_active":"2024-09-12T02:05:28.547343+0000","last_peered":"2024-09-12T02:05:28.547343+0000","last_clean":"2024-09-12T02:05:28.547343+0000","last_became_active":"2024-09-12T00:32:14.601148+0000","last_became_peered":"2024-09-12T00:32:14.601148+0000","last_unstale":"2024-09-12T02:05:28.547343+0000","last_undegraded":"2024-09-12T02:05:28.547343+0000","last_fullsized":"2024-09-12T02:05:28.547343+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:16.003152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"266'39","reported_seq":182,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.725801+0000","last_change":"2024-09-12T00:26:23.318410+0000","last_active":"2024-09-12T02:03:08.725801+0000","last_peered":"2024-09-12T02:03:08.725801+0000","last_clean":"2024-09-12T02:03:08.725801+0000","last_became_active":"2024-09-12T00:26:23.317880+0000","last_became_peered":"2024-09-12T00:26:23.317880+0000","last_unstale":"2024-09-12T02:03:08.725801+0000","last_undegraded":"2024-09-12T02:03:08.725801+0000","last_fullsized":"2024-09-12T02:03:08.725801+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:35.423826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.742402+0000","last_change":"2024-09-12T01:00:24.086998+0000","last_active":"2024-09-12T02:03:38.742402+0000","last_peered":"2024-09-12T02:03:38.742402+0000","last_clean":"2024-09-12T02:03:38.742402+0000","last_became_active":"2024-09-12T01:00:24.086101+0000","last_became_peered":"2024-09-12T01:00:24.086101+0000","last_unstale":"2024-09-12T02:03:38.742402+0000","last_undegraded":"2024-09-12T02:03:38.742402+0000","last_fullsized":"2024-09-12T02:03:38.742402+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.433366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738790+0000","last_change":"2024-09-12T00:32:21.639641+0000","last_active":"2024-09-12T02:03:23.738790+0000","last_peered":"2024-09-12T02:03:23.738790+0000","last_clean":"2024-09-12T02:03:23.738790+0000","last_became_active":"2024-09-12T00:32:21.634440+0000","last_became_peered":"2024-09-12T00:32:21.634440+0000","last_unstale":"2024-09-12T02:03:23.738790+0000","last_undegraded":"2024-09-12T02:03:23.738790+0000","last_fullsized":"2024-09-12T02:03:23.738790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:52.190306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.770418+0000","last_change":"2024-09-12T00:32:14.596514+0000","last_active":"2024-09-12T02:06:45.770418+0000","last_peered":"2024-09-12T02:06:45.770418+0000","last_clean":"2024-09-12T02:06:45.770418+0000","last_became_active":"2024-09-12T00:32:14.595782+0000","last_became_peered":"2024-09-12T00:32:14.595782+0000","last_unstale":"2024-09-12T02:06:45.770418+0000","last_undegraded":"2024-09-12T02:06:45.770418+0000","last_fullsized":"2024-09-12T02:06:45.770418+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:40.885479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":165,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.750980+0000","last_change":"2024-09-12T00:26:23.324857+0000","last_active":"2024-09-12T02:04:13.750980+0000","last_peered":"2024-09-12T02:04:13.750980+0000","last_clean":"2024-09-12T02:04:13.750980+0000","last_became_active":"2024-09-12T00:26:23.324140+0000","last_became_peered":"2024-09-12T00:26:23.324140+0000","last_unstale":"2024-09-12T02:04:13.750980+0000","last_undegraded":"2024-09-12T02:04:13.750980+0000","last_fullsized":"2024-09-12T02:04:13.750980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:21.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":114,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738926+0000","last_change":"2024-09-12T01:00:24.081545+0000","last_active":"2024-09-12T02:03:23.738926+0000","last_peered":"2024-09-12T02:03:23.738926+0000","last_clean":"2024-09-12T02:03:23.738926+0000","last_became_active":"2024-09-12T01:00:24.080855+0000","last_became_peered":"2024-09-12T01:00:24.080855+0000","last_unstale":"2024-09-12T02:03:23.738926+0000","last_undegraded":"2024-09-12T02:03:23.738926+0000","last_fullsized":"2024-09-12T02:03:23.738926+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:06.572347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'4","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.676309+0000","last_change":"2024-09-12T00:32:21.649120+0000","last_active":"2024-09-12T02:02:23.676309+0000","last_peered":"2024-09-12T02:02:23.676309+0000","last_clean":"2024-09-12T02:02:23.676309+0000","last_became_active":"2024-09-12T00:32:21.648333+0000","last_became_peered":"2024-09-12T00:32:21.648333+0000","last_unstale":"2024-09-12T02:02:23.676309+0000","last_undegraded":"2024-09-12T02:02:23.676309+0000","last_fullsized":"2024-09-12T02:02:23.676309+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:27.155415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"266'4","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.770058+0000","last_change":"2024-09-12T00:32:14.600607+0000","last_active":"2024-09-12T02:06:45.770058+0000","last_peered":"2024-09-12T02:06:45.770058+0000","last_clean":"2024-09-12T02:06:45.770058+0000","last_became_active":"2024-09-12T00:32:14.592875+0000","last_became_peered":"2024-09-12T00:32:14.592875+0000","last_unstale":"2024-09-12T02:06:45.770058+0000","last_undegraded":"2024-09-12T02:06:45.770058+0000","last_fullsized":"2024-09-12T02:06:45.770058+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:09.233319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"266'15","reported_seq":118,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.966977+0000","last_change":"2024-09-12T00:26:23.325693+0000","last_active":"2024-09-12T02:03:53.966977+0000","last_peered":"2024-09-12T02:03:53.966977+0000","last_clean":"2024-09-12T02:03:53.966977+0000","last_became_active":"2024-09-12T00:26:23.324884+0000","last_became_peered":"2024-09-12T00:26:23.324884+0000","last_unstale":"2024-09-12T02:03:53.966977+0000","last_undegraded":"2024-09-12T02:03:53.966977+0000","last_fullsized":"2024-09-12T02:03:53.966977+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:53.038478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.517888+0000","last_change":"2024-09-12T01:00:24.062624+0000","last_active":"2024-09-12T02:03:23.517888+0000","last_peered":"2024-09-12T02:03:23.517888+0000","last_clean":"2024-09-12T02:03:23.517888+0000","last_became_active":"2024-09-12T01:00:24.061882+0000","last_became_peered":"2024-09-12T01:00:24.061882+0000","last_unstale":"2024-09-12T02:03:23.517888+0000","last_undegraded":"2024-09-12T02:03:23.517888+0000","last_fullsized":"2024-09-12T02:03:23.517888+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:52.723554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'4","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743502+0000","last_change":"2024-09-12T00:32:21.668310+0000","last_active":"2024-09-12T02:03:43.743502+0000","last_peered":"2024-09-12T02:03:43.743502+0000","last_clean":"2024-09-12T02:03:43.743502+0000","last_became_active":"2024-09-12T00:32:21.667346+0000","last_became_peered":"2024-09-12T00:32:21.667346+0000","last_unstale":"2024-09-12T02:03:43.743502+0000","last_undegraded":"2024-09-12T02:03:43.743502+0000","last_fullsized":"2024-09-12T02:03:43.743502+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:33.558216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"266'9","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.262602+0000","last_change":"2024-09-12T00:32:14.577757+0000","last_active":"2024-09-12T02:06:47.262602+0000","last_peered":"2024-09-12T02:06:47.262602+0000","last_clean":"2024-09-12T02:06:47.262602+0000","last_became_active":"2024-09-12T00:32:14.576974+0000","last_became_peered":"2024-09-12T00:32:14.576974+0000","last_unstale":"2024-09-12T02:06:47.262602+0000","last_undegraded":"2024-09-12T02:06:47.262602+0000","last_fullsized":"2024-09-12T02:06:47.262602+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:03.910967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4127,"num_write":14,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"266'52","reported_seq":231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719368+0000","last_change":"2024-09-12T00:26:23.316961+0000","last_active":"2024-09-12T02:03:53.719368+0000","last_peered":"2024-09-12T02:03:53.719368+0000","last_clean":"2024-09-12T02:03:53.719368+0000","last_became_active":"2024-09-12T00:26:23.315633+0000","last_became_peered":"2024-09-12T00:26:23.315633+0000","last_unstale":"2024-09-12T02:03:53.719368+0000","last_undegraded":"2024-09-12T02:03:53.719368+0000","last_fullsized":"2024-09-12T02:03:53.719368+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:49.483501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":203,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731755+0000","last_change":"2024-09-12T01:00:24.080426+0000","last_active":"2024-09-12T02:02:53.731755+0000","last_peered":"2024-09-12T02:02:53.731755+0000","last_clean":"2024-09-12T02:02:53.731755+0000","last_became_active":"2024-09-12T01:00:24.079834+0000","last_became_peered":"2024-09-12T01:00:24.079834+0000","last_unstale":"2024-09-12T02:02:53.731755+0000","last_undegraded":"2024-09-12T02:02:53.731755+0000","last_fullsized":"2024-09-12T02:02:53.731755+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:05.052155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.535089+0000","last_change":"2024-09-12T00:32:21.664365+0000","last_active":"2024-09-12T02:04:33.535089+0000","last_peered":"2024-09-12T02:04:33.535089+0000","last_clean":"2024-09-12T02:04:33.535089+0000","last_became_active":"2024-09-12T00:32:21.663547+0000","last_became_peered":"2024-09-12T00:32:21.663547+0000","last_unstale":"2024-09-12T02:04:33.535089+0000","last_undegraded":"2024-09-12T02:04:33.535089+0000","last_fullsized":"2024-09-12T02:04:33.535089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:42.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.747512+0000","last_change":"2024-09-12T00:32:14.596240+0000","last_active":"2024-09-12T02:03:58.747512+0000","last_peered":"2024-09-12T02:03:58.747512+0000","last_clean":"2024-09-12T02:03:58.747512+0000","last_became_active":"2024-09-12T00:32:14.593670+0000","last_became_peered":"2024-09-12T00:32:14.593670+0000","last_unstale":"2024-09-12T02:03:58.747512+0000","last_undegraded":"2024-09-12T02:03:58.747512+0000","last_fullsized":"2024-09-12T02:03:58.747512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:01.077637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'28","reported_seq":156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525498+0000","last_change":"2024-09-12T00:26:23.350883+0000","last_active":"2024-09-12T02:03:53.525498+0000","last_peered":"2024-09-12T02:03:53.525498+0000","last_clean":"2024-09-12T02:03:53.525498+0000","last_became_active":"2024-09-12T00:26:23.338248+0000","last_became_peered":"2024-09-12T00:26:23.338248+0000","last_unstale":"2024-09-12T02:03:53.525498+0000","last_undegraded":"2024-09-12T02:03:53.525498+0000","last_fullsized":"2024-09-12T02:03:53.525498+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:58.473095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:54.728722+0000","last_change":"2024-09-12T01:00:24.077369+0000","last_active":"2024-09-12T02:02:54.728722+0000","last_peered":"2024-09-12T02:02:54.728722+0000","last_clean":"2024-09-12T02:02:54.728722+0000","last_became_active":"2024-09-12T01:00:24.068145+0000","last_became_peered":"2024-09-12T01:00:24.068145+0000","last_unstale":"2024-09-12T02:02:54.728722+0000","last_undegraded":"2024-09-12T02:02:54.728722+0000","last_fullsized":"2024-09-12T02:02:54.728722+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:15.100781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.527728+0000","last_change":"2024-09-12T00:32:21.674579+0000","last_active":"2024-09-12T02:04:03.527728+0000","last_peered":"2024-09-12T02:04:03.527728+0000","last_clean":"2024-09-12T02:04:03.527728+0000","last_became_active":"2024-09-12T00:32:21.668979+0000","last_became_peered":"2024-09-12T00:32:21.668979+0000","last_unstale":"2024-09-12T02:04:03.527728+0000","last_undegraded":"2024-09-12T02:04:03.527728+0000","last_fullsized":"2024-09-12T02:04:03.527728+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:43.618228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.037358+0000","last_change":"2024-09-12T00:32:14.611138+0000","last_active":"2024-09-12T02:06:45.037358+0000","last_peered":"2024-09-12T02:06:45.037358+0000","last_clean":"2024-09-12T02:06:45.037358+0000","last_became_active":"2024-09-12T00:32:14.610414+0000","last_became_peered":"2024-09-12T00:32:14.610414+0000","last_unstale":"2024-09-12T02:06:45.037358+0000","last_undegraded":"2024-09-12T02:06:45.037358+0000","last_fullsized":"2024-09-12T02:06:45.037358+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.944085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"266'33","reported_seq":168,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719573+0000","last_change":"2024-09-12T00:26:23.328059+0000","last_active":"2024-09-12T02:03:53.719573+0000","last_peered":"2024-09-12T02:03:53.719573+0000","last_clean":"2024-09-12T02:03:53.719573+0000","last_became_active":"2024-09-12T00:26:23.327296+0000","last_became_peered":"2024-09-12T00:26:23.327296+0000","last_unstale":"2024-09-12T02:03:53.719573+0000","last_undegraded":"2024-09-12T02:03:53.719573+0000","last_fullsized":"2024-09-12T02:03:53.719573+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:43.942150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709243+0000","last_change":"2024-09-12T01:00:24.068043+0000","last_active":"2024-09-12T02:04:43.709243+0000","last_peered":"2024-09-12T02:04:43.709243+0000","last_clean":"2024-09-12T02:04:43.709243+0000","last_became_active":"2024-09-12T01:00:24.067665+0000","last_became_peered":"2024-09-12T01:00:24.067665+0000","last_unstale":"2024-09-12T02:04:43.709243+0000","last_undegraded":"2024-09-12T02:04:43.709243+0000","last_fullsized":"2024-09-12T02:04:43.709243+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:47.648058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.739021+0000","last_change":"2024-09-12T00:32:21.645575+0000","last_active":"2024-09-12T02:03:23.739021+0000","last_peered":"2024-09-12T02:03:23.739021+0000","last_clean":"2024-09-12T02:03:23.739021+0000","last_became_active":"2024-09-12T00:32:21.644891+0000","last_became_peered":"2024-09-12T00:32:21.644891+0000","last_unstale":"2024-09-12T02:03:23.739021+0000","last_undegraded":"2024-09-12T02:03:23.739021+0000","last_fullsized":"2024-09-12T02:03:23.739021+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.537775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"266'1","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:14.733184+0000","last_change":"2024-09-12T00:32:14.599778+0000","last_active":"2024-09-12T02:03:14.733184+0000","last_peered":"2024-09-12T02:03:14.733184+0000","last_clean":"2024-09-12T02:03:14.733184+0000","last_became_active":"2024-09-12T00:32:14.598981+0000","last_became_peered":"2024-09-12T00:32:14.598981+0000","last_unstale":"2024-09-12T02:03:14.733184+0000","last_undegraded":"2024-09-12T02:03:14.733184+0000","last_fullsized":"2024-09-12T02:03:14.733184+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:06.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"266'25","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.757357+0000","last_change":"2024-09-12T00:26:23.317228+0000","last_active":"2024-09-12T02:04:38.757357+0000","last_peered":"2024-09-12T02:04:38.757357+0000","last_clean":"2024-09-12T02:04:38.757357+0000","last_became_active":"2024-09-12T00:26:23.316443+0000","last_became_peered":"2024-09-12T00:26:23.316443+0000","last_unstale":"2024-09-12T02:04:38.757357+0000","last_undegraded":"2024-09-12T02:04:38.757357+0000","last_fullsized":"2024-09-12T02:04:38.757357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:54.406238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":90,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.737725+0000","last_change":"2024-09-12T01:00:24.072339+0000","last_active":"2024-09-12T02:02:53.737725+0000","last_peered":"2024-09-12T02:02:53.737725+0000","last_clean":"2024-09-12T02:02:53.737725+0000","last_became_active":"2024-09-12T01:00:24.071428+0000","last_became_peered":"2024-09-12T01:00:24.071428+0000","last_unstale":"2024-09-12T02:02:53.737725+0000","last_undegraded":"2024-09-12T02:02:53.737725+0000","last_fullsized":"2024-09-12T02:02:53.737725+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:11.332721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"266'9","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.740844+0000","last_change":"2024-09-12T00:32:21.654444+0000","last_active":"2024-09-12T02:06:46.740844+0000","last_peered":"2024-09-12T02:06:46.740844+0000","last_clean":"2024-09-12T02:06:46.740844+0000","last_became_active":"2024-09-12T00:32:21.653749+0000","last_became_peered":"2024-09-12T00:32:21.653749+0000","last_unstale":"2024-09-12T02:06:46.740844+0000","last_undegraded":"2024-09-12T02:06:46.740844+0000","last_fullsized":"2024-09-12T02:06:46.740844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:33.575071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.737749+0000","last_change":"2024-09-12T00:32:14.597114+0000","last_active":"2024-09-12T02:03:18.737749+0000","last_peered":"2024-09-12T02:03:18.737749+0000","last_clean":"2024-09-12T02:03:18.737749+0000","last_became_active":"2024-09-12T00:32:14.596498+0000","last_became_peered":"2024-09-12T00:32:14.596498+0000","last_unstale":"2024-09-12T02:03:18.737749+0000","last_undegraded":"2024-09-12T02:03:18.737749+0000","last_fullsized":"2024-09-12T02:03:18.737749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:03.408422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"266'50","reported_seq":218,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.703534+0000","last_change":"2024-09-12T00:26:23.341311+0000","last_active":"2024-09-12T02:04:18.703534+0000","last_peered":"2024-09-12T02:04:18.703534+0000","last_clean":"2024-09-12T02:04:18.703534+0000","last_became_active":"2024-09-12T00:26:23.340608+0000","last_became_peered":"2024-09-12T00:26:23.340608+0000","last_unstale":"2024-09-12T02:04:18.703534+0000","last_undegraded":"2024-09-12T02:04:18.703534+0000","last_fullsized":"2024-09-12T02:04:18.703534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:24.402590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":178,"num_write":83,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.699157+0000","last_change":"2024-09-12T01:00:24.083558+0000","last_active":"2024-09-12T02:03:13.699157+0000","last_peered":"2024-09-12T02:03:13.699157+0000","last_clean":"2024-09-12T02:03:13.699157+0000","last_became_active":"2024-09-12T01:00:24.083260+0000","last_became_peered":"2024-09-12T01:00:24.083260+0000","last_unstale":"2024-09-12T02:03:13.699157+0000","last_undegraded":"2024-09-12T02:03:13.699157+0000","last_fullsized":"2024-09-12T02:03:13.699157+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"266'9","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:08.726835+0000","last_change":"2024-09-12T00:32:21.656599+0000","last_active":"2024-09-12T02:06:08.726835+0000","last_peered":"2024-09-12T02:06:08.726835+0000","last_clean":"2024-09-12T02:06:08.726835+0000","last_became_active":"2024-09-12T00:32:21.655849+0000","last_became_peered":"2024-09-12T00:32:21.655849+0000","last_unstale":"2024-09-12T02:06:08.726835+0000","last_undegraded":"2024-09-12T02:06:08.726835+0000","last_fullsized":"2024-09-12T02:06:08.726835+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:45.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15358,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.785624+0000","last_change":"2024-09-12T00:32:14.605108+0000","last_active":"2024-09-12T02:06:38.785624+0000","last_peered":"2024-09-12T02:06:38.785624+0000","last_clean":"2024-09-12T02:06:38.785624+0000","last_became_active":"2024-09-12T00:32:14.604519+0000","last_became_peered":"2024-09-12T00:32:14.604519+0000","last_unstale":"2024-09-12T02:06:38.785624+0000","last_undegraded":"2024-09-12T02:06:38.785624+0000","last_fullsized":"2024-09-12T02:06:38.785624+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:45.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":153,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:19.747660+0000","last_change":"2024-09-12T00:26:23.332950+0000","last_active":"2024-09-12T02:04:19.747660+0000","last_peered":"2024-09-12T02:04:19.747660+0000","last_clean":"2024-09-12T02:04:19.747660+0000","last_became_active":"2024-09-12T00:26:23.328187+0000","last_became_peered":"2024-09-12T00:26:23.328187+0000","last_unstale":"2024-09-12T02:04:19.747660+0000","last_undegraded":"2024-09-12T02:04:19.747660+0000","last_fullsized":"2024-09-12T02:04:19.747660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.206262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":91,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727347+0000","last_change":"2024-09-12T01:00:24.063315+0000","last_active":"2024-09-12T02:03:13.727347+0000","last_peered":"2024-09-12T02:03:13.727347+0000","last_clean":"2024-09-12T02:03:13.727347+0000","last_became_active":"2024-09-12T01:00:24.062597+0000","last_became_peered":"2024-09-12T01:00:24.062597+0000","last_unstale":"2024-09-12T02:03:13.727347+0000","last_undegraded":"2024-09-12T02:03:13.727347+0000","last_fullsized":"2024-09-12T02:03:13.727347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:00.125865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:34.751341+0000","last_change":"2024-09-12T00:32:21.646859+0000","last_active":"2024-09-12T02:04:34.751341+0000","last_peered":"2024-09-12T02:04:34.751341+0000","last_clean":"2024-09-12T02:04:34.751341+0000","last_became_active":"2024-09-12T00:32:21.644950+0000","last_became_peered":"2024-09-12T00:32:21.644950+0000","last_unstale":"2024-09-12T02:04:34.751341+0000","last_undegraded":"2024-09-12T02:04:34.751341+0000","last_fullsized":"2024-09-12T02:04:34.751341+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:04.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.777079+0000","last_change":"2024-09-12T00:32:14.598048+0000","last_active":"2024-09-12T02:06:03.777079+0000","last_peered":"2024-09-12T02:06:03.777079+0000","last_clean":"2024-09-12T02:06:03.777079+0000","last_became_active":"2024-09-12T00:32:14.597376+0000","last_became_peered":"2024-09-12T00:32:14.597376+0000","last_unstale":"2024-09-12T02:06:03.777079+0000","last_undegraded":"2024-09-12T02:06:03.777079+0000","last_fullsized":"2024-09-12T02:06:03.777079+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:44.028314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"266'77","reported_seq":297,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.756664+0000","last_change":"2024-09-12T00:26:23.338797+0000","last_active":"2024-09-12T02:04:18.756664+0000","last_peered":"2024-09-12T02:04:18.756664+0000","last_clean":"2024-09-12T02:04:18.756664+0000","last_became_active":"2024-09-12T00:26:23.338274+0000","last_became_peered":"2024-09-12T00:26:23.338274+0000","last_unstale":"2024-09-12T02:04:18.756664+0000","last_undegraded":"2024-09-12T02:04:18.756664+0000","last_fullsized":"2024-09-12T02:04:18.756664+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:48.119590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":296,"num_write":117,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.722148+0000","last_change":"2024-09-12T01:00:24.054473+0000","last_active":"2024-09-12T02:02:53.722148+0000","last_peered":"2024-09-12T02:02:53.722148+0000","last_clean":"2024-09-12T02:02:53.722148+0000","last_became_active":"2024-09-12T01:00:24.053408+0000","last_became_peered":"2024-09-12T01:00:24.053408+0000","last_unstale":"2024-09-12T02:02:53.722148+0000","last_undegraded":"2024-09-12T02:02:53.722148+0000","last_fullsized":"2024-09-12T02:02:53.722148+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:50.708086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.721667+0000","last_change":"2024-09-12T00:32:33.790651+0000","last_active":"2024-09-12T02:04:03.721667+0000","last_peered":"2024-09-12T02:04:03.721667+0000","last_clean":"2024-09-12T02:04:03.721667+0000","last_became_active":"2024-09-12T00:32:33.790018+0000","last_became_peered":"2024-09-12T00:32:33.790018+0000","last_unstale":"2024-09-12T02:04:03.721667+0000","last_undegraded":"2024-09-12T02:04:03.721667+0000","last_fullsized":"2024-09-12T02:04:03.721667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:15.389367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.697604+0000","last_change":"2024-09-12T00:32:14.581204+0000","last_active":"2024-09-12T02:03:53.697604+0000","last_peered":"2024-09-12T02:03:53.697604+0000","last_clean":"2024-09-12T02:03:53.697604+0000","last_became_active":"2024-09-12T00:32:14.580350+0000","last_became_peered":"2024-09-12T00:32:14.580350+0000","last_unstale":"2024-09-12T02:03:53.697604+0000","last_undegraded":"2024-09-12T02:03:53.697604+0000","last_fullsized":"2024-09-12T02:03:53.697604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:27.342223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"266'23","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.724815+0000","last_change":"2024-09-12T00:26:23.327068+0000","last_active":"2024-09-12T02:04:18.724815+0000","last_peered":"2024-09-12T02:04:18.724815+0000","last_clean":"2024-09-12T02:04:18.724815+0000","last_became_active":"2024-09-12T00:26:23.318720+0000","last_became_peered":"2024-09-12T00:26:23.318720+0000","last_unstale":"2024-09-12T02:04:18.724815+0000","last_undegraded":"2024-09-12T02:04:18.724815+0000","last_fullsized":"2024-09-12T02:04:18.724815+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.176923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.735348+0000","last_change":"2024-09-12T01:00:24.074486+0000","last_active":"2024-09-12T02:03:08.735348+0000","last_peered":"2024-09-12T02:03:08.735348+0000","last_clean":"2024-09-12T02:03:08.735348+0000","last_became_active":"2024-09-12T01:00:24.072773+0000","last_became_peered":"2024-09-12T01:00:24.072773+0000","last_unstale":"2024-09-12T02:03:08.735348+0000","last_undegraded":"2024-09-12T02:03:08.735348+0000","last_fullsized":"2024-09-12T02:03:08.735348+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:12.560655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"266'8","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.466415+0000","last_change":"2024-09-12T00:32:21.644007+0000","last_active":"2024-09-12T02:06:45.466415+0000","last_peered":"2024-09-12T02:06:45.466415+0000","last_clean":"2024-09-12T02:06:45.466415+0000","last_became_active":"2024-09-12T00:32:21.643272+0000","last_became_peered":"2024-09-12T00:32:21.643272+0000","last_unstale":"2024-09-12T02:06:45.466415+0000","last_undegraded":"2024-09-12T02:06:45.466415+0000","last_fullsized":"2024-09-12T02:06:45.466415+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.420621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":18,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.720610+0000","last_change":"2024-09-12T00:32:14.580374+0000","last_active":"2024-09-12T02:03:58.720610+0000","last_peered":"2024-09-12T02:03:58.720610+0000","last_clean":"2024-09-12T02:03:58.720610+0000","last_became_active":"2024-09-12T00:32:14.579278+0000","last_became_peered":"2024-09-12T00:32:14.579278+0000","last_unstale":"2024-09-12T02:03:58.720610+0000","last_undegraded":"2024-09-12T02:03:58.720610+0000","last_fullsized":"2024-09-12T02:03:58.720610+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:01.599717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"266'19","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.758435+0000","last_change":"2024-09-12T00:26:23.306938+0000","last_active":"2024-09-12T02:04:43.758435+0000","last_peered":"2024-09-12T02:04:43.758435+0000","last_clean":"2024-09-12T02:04:43.758435+0000","last_became_active":"2024-09-12T00:26:23.306139+0000","last_became_peered":"2024-09-12T00:26:23.306139+0000","last_unstale":"2024-09-12T02:04:43.758435+0000","last_undegraded":"2024-09-12T02:04:43.758435+0000","last_fullsized":"2024-09-12T02:04:43.758435+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:31.920270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"266'329","reported_seq":1074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.558135+0000","last_change":"2024-09-12T00:09:59.316653+0000","last_active":"2024-09-12T02:06:47.558135+0000","last_peered":"2024-09-12T02:06:47.558135+0000","last_clean":"2024-09-12T02:06:47.558135+0000","last_became_active":"2024-09-12T00:09:59.316094+0000","last_became_peered":"2024-09-12T00:09:59.316094+0000","last_unstale":"2024-09-12T02:06:47.558135+0000","last_undegraded":"2024-09-12T02:06:47.558135+0000","last_fullsized":"2024-09-12T02:06:47.558135+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:40.253738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441871,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":581,"num_read_kb":103153,"num_write":998,"num_write_kb":38551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"266'995","reported_seq":2777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:34.723877+0000","last_change":"2024-09-12T00:10:01.282096+0000","last_active":"2024-09-12T02:02:34.723877+0000","last_peered":"2024-09-12T02:02:34.723877+0000","last_clean":"2024-09-12T02:02:34.723877+0000","last_became_active":"2024-09-12T00:10:01.281465+0000","last_became_peered":"2024-09-12T00:10:01.281465+0000","last_unstale":"2024-09-12T02:02:34.723877+0000","last_undegraded":"2024-09-12T02:02:34.723877+0000","last_fullsized":"2024-09-12T02:02:34.723877+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:52.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4736,"num_read_kb":4236,"num_write":1359,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"266'354","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.554535+0000","last_change":"2024-09-12T00:09:59.311726+0000","last_active":"2024-09-12T02:06:47.554535+0000","last_peered":"2024-09-12T02:06:47.554535+0000","last_clean":"2024-09-12T02:06:47.554535+0000","last_became_active":"2024-09-12T00:09:59.311178+0000","last_became_peered":"2024-09-12T00:09:59.311178+0000","last_unstale":"2024-09-12T02:06:47.554535+0000","last_undegraded":"2024-09-12T02:06:47.554535+0000","last_fullsized":"2024-09-12T02:06:47.554535+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:44.209100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399015,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":11355,"num_write":1177,"num_write_kb":19733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"266'875","reported_seq":2482,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.639756+0000","last_change":"2024-09-12T00:10:01.270508+0000","last_active":"2024-09-12T02:06:05.639756+0000","last_peered":"2024-09-12T02:06:05.639756+0000","last_clean":"2024-09-12T02:06:05.639756+0000","last_became_active":"2024-09-12T00:10:01.268068+0000","last_became_peered":"2024-09-12T00:10:01.268068+0000","last_unstale":"2024-09-12T02:06:05.639756+0000","last_undegraded":"2024-09-12T02:06:05.639756+0000","last_fullsized":"2024-09-12T02:06:05.639756+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:03.001681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4189,"num_read_kb":3768,"num_write":1161,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"266'376","reported_seq":1082,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.490697+0000","last_change":"2024-09-12T00:09:59.296889+0000","last_active":"2024-09-12T02:06:47.490697+0000","last_peered":"2024-09-12T02:06:47.490697+0000","last_clean":"2024-09-12T02:06:47.490697+0000","last_became_active":"2024-09-12T00:09:59.296557+0000","last_became_peered":"2024-09-12T00:09:59.296557+0000","last_unstale":"2024-09-12T02:06:47.490697+0000","last_undegraded":"2024-09-12T02:06:47.490697+0000","last_fullsized":"2024-09-12T02:06:47.490697+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:27.013161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653297,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":575,"num_read_kb":57177,"num_write":1185,"num_write_kb":38522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1196","reported_seq":2908,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.643791+0000","last_change":"2024-09-12T00:10:01.251720+0000","last_active":"2024-09-12T02:06:05.643791+0000","last_peered":"2024-09-12T02:06:05.643791+0000","last_clean":"2024-09-12T02:06:05.643791+0000","last_became_active":"2024-09-12T00:10:01.251038+0000","last_became_peered":"2024-09-12T00:10:01.251038+0000","last_unstale":"2024-09-12T02:06:05.643791+0000","last_undegraded":"2024-09-12T02:06:05.643791+0000","last_fullsized":"2024-09-12T02:06:05.643791+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:38.505152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5594,"num_read_kb":4965,"num_write":1641,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"266'257","reported_seq":906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.644958+0000","last_change":"2024-09-12T00:09:59.279104+0000","last_active":"2024-09-12T02:06:44.644958+0000","last_peered":"2024-09-12T02:06:44.644958+0000","last_clean":"2024-09-12T02:06:44.644958+0000","last_became_active":"2024-09-12T00:09:59.278426+0000","last_became_peered":"2024-09-12T00:09:59.278426+0000","last_unstale":"2024-09-12T02:06:44.644958+0000","last_undegraded":"2024-09-12T02:06:44.644958+0000","last_fullsized":"2024-09-12T02:06:44.644958+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:22.498936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13888078,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":381,"num_read_kb":8612,"num_write":971,"num_write_kb":32048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"266'440","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719993+0000","last_change":"2024-09-12T00:10:01.248182+0000","last_active":"2024-09-12T02:04:59.719993+0000","last_peered":"2024-09-12T02:04:59.719993+0000","last_clean":"2024-09-12T02:04:59.719993+0000","last_became_active":"2024-09-12T00:10:01.247807+0000","last_became_peered":"2024-09-12T00:10:01.247807+0000","last_unstale":"2024-09-12T02:04:59.719993+0000","last_undegraded":"2024-09-12T02:04:59.719993+0000","last_fullsized":"2024-09-12T02:04:59.719993+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.770019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2317,"num_read_kb":2164,"num_write":517,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"266'312","reported_seq":1021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.501611+0000","last_change":"2024-09-12T00:09:59.314721+0000","last_active":"2024-09-12T02:06:47.501611+0000","last_peered":"2024-09-12T02:06:47.501611+0000","last_clean":"2024-09-12T02:06:47.501611+0000","last_became_active":"2024-09-12T00:09:59.314222+0000","last_became_peered":"2024-09-12T00:09:59.314222+0000","last_unstale":"2024-09-12T02:06:47.501611+0000","last_undegraded":"2024-09-12T02:06:47.501611+0000","last_fullsized":"2024-09-12T02:06:47.501611+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:31.303567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":10075,"num_write":947,"num_write_kb":41375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"266'513","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.728189+0000","last_change":"2024-09-12T00:10:01.256948+0000","last_active":"2024-09-12T02:04:33.728189+0000","last_peered":"2024-09-12T02:04:33.728189+0000","last_clean":"2024-09-12T02:04:33.728189+0000","last_became_active":"2024-09-12T00:10:01.256253+0000","last_became_peered":"2024-09-12T00:10:01.256253+0000","last_unstale":"2024-09-12T02:04:33.728189+0000","last_undegraded":"2024-09-12T02:04:33.728189+0000","last_fullsized":"2024-09-12T02:04:33.728189+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:03.333567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2461,"num_read_kb":2278,"num_write":611,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"266'281","reported_seq":935,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.581178+0000","last_change":"2024-09-12T00:09:59.298976+0000","last_active":"2024-09-12T02:06:44.581178+0000","last_peered":"2024-09-12T02:06:44.581178+0000","last_clean":"2024-09-12T02:06:44.581178+0000","last_became_active":"2024-09-12T00:09:59.297821+0000","last_became_peered":"2024-09-12T00:09:59.297821+0000","last_unstale":"2024-09-12T02:06:44.581178+0000","last_undegraded":"2024-09-12T02:06:44.581178+0000","last_fullsized":"2024-09-12T02:06:44.581178+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:47.378293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6310664,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":428,"num_read_kb":14780,"num_write":902,"num_write_kb":35747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"266'378","reported_seq":1843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936221+0000","last_change":"2024-09-12T00:10:01.252712+0000","last_active":"2024-09-12T02:04:59.936221+0000","last_peered":"2024-09-12T02:04:59.936221+0000","last_clean":"2024-09-12T02:04:59.936221+0000","last_became_active":"2024-09-12T00:10:01.250663+0000","last_became_peered":"2024-09-12T00:10:01.250663+0000","last_unstale":"2024-09-12T02:04:59.936221+0000","last_undegraded":"2024-09-12T02:04:59.936221+0000","last_fullsized":"2024-09-12T02:04:59.936221+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:19.125375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2078,"num_read_kb":1972,"num_write":422,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"266'353","reported_seq":1123,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.478037+0000","last_change":"2024-09-12T00:09:59.312324+0000","last_active":"2024-09-12T02:06:47.478037+0000","last_peered":"2024-09-12T02:06:47.478037+0000","last_clean":"2024-09-12T02:06:47.478037+0000","last_became_active":"2024-09-12T00:09:59.311825+0000","last_became_peered":"2024-09-12T00:09:59.311825+0000","last_unstale":"2024-09-12T02:06:47.478037+0000","last_undegraded":"2024-09-12T02:06:47.478037+0000","last_fullsized":"2024-09-12T02:06:47.478037+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:41.321551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399264,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":842,"num_read_kb":88204,"num_write":1135,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"266'420","reported_seq":1882,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.720872+0000","last_change":"2024-09-12T00:10:01.275162+0000","last_active":"2024-09-12T02:04:59.720872+0000","last_peered":"2024-09-12T02:04:59.720872+0000","last_clean":"2024-09-12T02:04:59.720872+0000","last_became_active":"2024-09-12T00:10:01.274405+0000","last_became_peered":"2024-09-12T00:10:01.274405+0000","last_unstale":"2024-09-12T02:04:59.720872+0000","last_undegraded":"2024-09-12T02:04:59.720872+0000","last_fullsized":"2024-09-12T02:04:59.720872+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:26.880309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2137,"num_read_kb":2003,"num_write":477,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"266'327","reported_seq":1014,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.005054+0000","last_change":"2024-09-12T00:09:59.249333+0000","last_active":"2024-09-12T02:02:33.005054+0000","last_peered":"2024-09-12T02:02:33.005054+0000","last_clean":"2024-09-12T02:02:33.005054+0000","last_became_active":"2024-09-12T00:09:59.248750+0000","last_became_peered":"2024-09-12T00:09:59.248750+0000","last_unstale":"2024-09-12T02:02:33.005054+0000","last_undegraded":"2024-09-12T02:02:33.005054+0000","last_fullsized":"2024-09-12T02:02:33.005054+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:33.945077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10227707,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":647,"num_read_kb":26164,"num_write":1089,"num_write_kb":31035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"266'818","reported_seq":2443,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.717310+0000","last_change":"2024-09-12T00:10:01.249377+0000","last_active":"2024-09-12T02:04:38.717310+0000","last_peered":"2024-09-12T02:04:38.717310+0000","last_clean":"2024-09-12T02:04:38.717310+0000","last_became_active":"2024-09-12T00:10:01.249016+0000","last_became_peered":"2024-09-12T00:10:01.249016+0000","last_unstale":"2024-09-12T02:04:38.717310+0000","last_undegraded":"2024-09-12T02:04:38.717310+0000","last_fullsized":"2024-09-12T02:04:38.717310+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:28.289903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3841,"num_read_kb":3467,"num_write":1075,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"266'626","reported_seq":2380,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936425+0000","last_change":"2024-09-12T00:10:01.253763+0000","last_active":"2024-09-12T02:04:59.936425+0000","last_peered":"2024-09-12T02:04:59.936425+0000","last_clean":"2024-09-12T02:04:59.936425+0000","last_became_active":"2024-09-12T00:10:01.252790+0000","last_became_peered":"2024-09-12T00:10:01.252790+0000","last_unstale":"2024-09-12T02:04:59.936425+0000","last_undegraded":"2024-09-12T02:04:59.936425+0000","last_fullsized":"2024-09-12T02:04:59.936425+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.963549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2892,"num_write":772,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"266'411","reported_seq":1108,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.552876+0000","last_change":"2024-09-12T00:09:59.288779+0000","last_active":"2024-09-12T02:06:47.552876+0000","last_peered":"2024-09-12T02:06:47.552876+0000","last_clean":"2024-09-12T02:06:47.552876+0000","last_became_active":"2024-09-12T00:09:59.285279+0000","last_became_peered":"2024-09-12T00:09:59.285279+0000","last_unstale":"2024-09-12T02:06:47.552876+0000","last_undegraded":"2024-09-12T02:06:47.552876+0000","last_fullsized":"2024-09-12T02:06:47.552876+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:31.545971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569417,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":647,"num_read_kb":33158,"num_write":1312,"num_write_kb":40723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"266'380","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753363+0000","last_change":"2024-09-12T00:10:01.271450+0000","last_active":"2024-09-12T02:04:23.753363+0000","last_peered":"2024-09-12T02:04:23.753363+0000","last_clean":"2024-09-12T02:04:23.753363+0000","last_became_active":"2024-09-12T00:10:01.269235+0000","last_became_peered":"2024-09-12T00:10:01.269235+0000","last_unstale":"2024-09-12T02:04:23.753363+0000","last_undegraded":"2024-09-12T02:04:23.753363+0000","last_fullsized":"2024-09-12T02:04:23.753363+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:12.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2516,"num_read_kb":2424,"num_write":449,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"266'351","reported_seq":992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.410595+0000","last_change":"2024-09-12T00:09:59.303818+0000","last_active":"2024-09-12T02:06:47.410595+0000","last_peered":"2024-09-12T02:06:47.410595+0000","last_clean":"2024-09-12T02:06:47.410595+0000","last_became_active":"2024-09-12T00:09:59.298975+0000","last_became_peered":"2024-09-12T00:09:59.298975+0000","last_unstale":"2024-09-12T02:06:47.410595+0000","last_undegraded":"2024-09-12T02:06:47.410595+0000","last_fullsized":"2024-09-12T02:06:47.410595+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:31.548154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":20543,"num_write":987,"num_write_kb":37808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"266'1147","reported_seq":2680,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:19.720322+0000","last_change":"2024-09-12T00:10:01.275965+0000","last_active":"2024-09-12T02:02:19.720322+0000","last_peered":"2024-09-12T02:02:19.720322+0000","last_clean":"2024-09-12T02:02:19.720322+0000","last_became_active":"2024-09-12T00:10:01.270566+0000","last_became_peered":"2024-09-12T00:10:01.270566+0000","last_unstale":"2024-09-12T02:02:19.720322+0000","last_undegraded":"2024-09-12T02:02:19.720322+0000","last_fullsized":"2024-09-12T02:02:19.720322+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":1100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:08.981670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5146,"num_read_kb":4532,"num_write":1573,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"266'328","reported_seq":976,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.549542+0000","last_change":"2024-09-12T00:10:31.476025+0000","last_active":"2024-09-12T02:06:47.549542+0000","last_peered":"2024-09-12T02:06:47.549542+0000","last_clean":"2024-09-12T02:06:47.549542+0000","last_became_active":"2024-09-12T00:10:31.475207+0000","last_became_peered":"2024-09-12T00:10:31.475207+0000","last_unstale":"2024-09-12T02:06:47.549542+0000","last_undegraded":"2024-09-12T02:06:47.549542+0000","last_fullsized":"2024-09-12T02:06:47.549542+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:42.892508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35516,"num_write":1077,"num_write_kb":27332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"266'424","reported_seq":2056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.704716+0000","last_change":"2024-09-12T00:10:01.249435+0000","last_active":"2024-09-12T02:03:38.704716+0000","last_peered":"2024-09-12T02:03:38.704716+0000","last_clean":"2024-09-12T02:03:38.704716+0000","last_became_active":"2024-09-12T00:10:01.249060+0000","last_became_peered":"2024-09-12T00:10:01.249060+0000","last_unstale":"2024-09-12T02:03:38.704716+0000","last_undegraded":"2024-09-12T02:03:38.704716+0000","last_fullsized":"2024-09-12T02:03:38.704716+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:57.590588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2301,"num_write":498,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"266'349","reported_seq":1014,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.459203+0000","last_change":"2024-09-12T00:09:59.309576+0000","last_active":"2024-09-12T02:06:47.459203+0000","last_peered":"2024-09-12T02:06:47.459203+0000","last_clean":"2024-09-12T02:06:47.459203+0000","last_became_active":"2024-09-12T00:09:59.308979+0000","last_became_peered":"2024-09-12T00:09:59.308979+0000","last_unstale":"2024-09-12T02:06:47.459203+0000","last_undegraded":"2024-09-12T02:06:47.459203+0000","last_fullsized":"2024-09-12T02:06:47.459203+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:02.012541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9921950,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":33875,"num_write":1037,"num_write_kb":29129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"266'437","reported_seq":1921,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.543220+0000","last_change":"2024-09-12T00:10:01.239020+0000","last_active":"2024-09-12T02:04:57.543220+0000","last_peered":"2024-09-12T02:04:57.543220+0000","last_clean":"2024-09-12T02:04:57.543220+0000","last_became_active":"2024-09-12T00:10:01.238251+0000","last_became_peered":"2024-09-12T00:10:01.238251+0000","last_unstale":"2024-09-12T02:04:57.543220+0000","last_undegraded":"2024-09-12T02:04:57.543220+0000","last_fullsized":"2024-09-12T02:04:57.543220+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:04.492050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2194,"num_read_kb":2058,"num_write":515,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"266'254","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.961470+0000","last_change":"2024-09-12T00:09:59.263678+0000","last_active":"2024-09-12T02:03:33.961470+0000","last_peered":"2024-09-12T02:03:33.961470+0000","last_clean":"2024-09-12T02:03:33.961470+0000","last_became_active":"2024-09-12T00:09:59.262666+0000","last_became_peered":"2024-09-12T00:09:59.262666+0000","last_unstale":"2024-09-12T02:03:33.961470+0000","last_undegraded":"2024-09-12T02:03:33.961470+0000","last_fullsized":"2024-09-12T02:03:33.961470+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:36.226668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13397264,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":363,"num_read_kb":23030,"num_write":926,"num_write_kb":39870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"266'656","reported_seq":2175,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.747746+0000","last_change":"2024-09-12T00:10:01.258577+0000","last_active":"2024-09-12T02:03:38.747746+0000","last_peered":"2024-09-12T02:03:38.747746+0000","last_clean":"2024-09-12T02:03:38.747746+0000","last_became_active":"2024-09-12T00:10:01.257792+0000","last_became_peered":"2024-09-12T00:10:01.257792+0000","last_unstale":"2024-09-12T02:03:38.747746+0000","last_undegraded":"2024-09-12T02:03:38.747746+0000","last_fullsized":"2024-09-12T02:03:38.747746+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:43.563199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3304,"num_read_kb":2964,"num_write":919,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"266'329","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.315223+0000","last_change":"2024-09-12T00:09:59.294360+0000","last_active":"2024-09-12T02:06:47.315223+0000","last_peered":"2024-09-12T02:06:47.315223+0000","last_clean":"2024-09-12T02:06:47.315223+0000","last_became_active":"2024-09-12T00:09:59.293921+0000","last_became_peered":"2024-09-12T00:09:59.293921+0000","last_unstale":"2024-09-12T02:06:47.315223+0000","last_undegraded":"2024-09-12T02:06:47.315223+0000","last_fullsized":"2024-09-12T02:06:47.315223+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:40.424733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262199,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":482,"num_read_kb":35722,"num_write":1084,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"266'142","reported_seq":678,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.114050+0000","last_change":"2024-09-12T00:10:09.356862+0000","last_active":"2024-09-12T02:06:07.114050+0000","last_peered":"2024-09-12T02:06:07.114050+0000","last_clean":"2024-09-12T02:06:07.114050+0000","last_became_active":"2024-09-12T00:10:09.356144+0000","last_became_peered":"2024-09-12T00:10:09.356144+0000","last_unstale":"2024-09-12T02:06:07.114050+0000","last_undegraded":"2024-09-12T02:06:07.114050+0000","last_fullsized":"2024-09-12T02:06:07.114050+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:09.813648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":339,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"266'785","reported_seq":2333,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.852208+0000","last_change":"2024-09-12T00:10:01.259453+0000","last_active":"2024-09-12T02:04:59.852208+0000","last_peered":"2024-09-12T02:04:59.852208+0000","last_clean":"2024-09-12T02:04:59.852208+0000","last_became_active":"2024-09-12T00:10:01.259053+0000","last_became_peered":"2024-09-12T00:10:01.259053+0000","last_unstale":"2024-09-12T02:04:59.852208+0000","last_undegraded":"2024-09-12T02:04:59.852208+0000","last_fullsized":"2024-09-12T02:04:59.852208+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:38.055321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3705,"num_read_kb":3341,"num_write":1024,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"266'390","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.443615+0000","last_change":"2024-09-12T00:09:59.311180+0000","last_active":"2024-09-12T02:06:47.443615+0000","last_peered":"2024-09-12T02:06:47.443615+0000","last_clean":"2024-09-12T02:06:47.443615+0000","last_became_active":"2024-09-12T00:09:59.310643+0000","last_became_peered":"2024-09-12T00:09:59.310643+0000","last_unstale":"2024-09-12T02:06:47.443615+0000","last_undegraded":"2024-09-12T02:06:47.443615+0000","last_fullsized":"2024-09-12T02:06:47.443615+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:20.368803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136934,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":31265,"num_write":1302,"num_write_kb":60174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.738969+0000","last_change":"2024-09-12T00:10:03.273556+0000","last_active":"2024-09-12T02:03:39.738969+0000","last_peered":"2024-09-12T02:03:39.738969+0000","last_clean":"2024-09-12T02:03:39.738969+0000","last_became_active":"2024-09-12T00:10:03.271233+0000","last_became_peered":"2024-09-12T00:10:03.271233+0000","last_unstale":"2024-09-12T02:03:39.738969+0000","last_undegraded":"2024-09-12T02:03:39.738969+0000","last_fullsized":"2024-09-12T02:03:39.738969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:53.667695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"266'375","reported_seq":1034,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.087115+0000","last_change":"2024-09-12T00:10:05.286196+0000","last_active":"2024-09-12T02:06:47.087115+0000","last_peered":"2024-09-12T02:06:47.087115+0000","last_clean":"2024-09-12T02:06:47.087115+0000","last_became_active":"2024-09-12T00:10:05.285417+0000","last_became_peered":"2024-09-12T00:10:05.285417+0000","last_unstale":"2024-09-12T02:06:47.087115+0000","last_undegraded":"2024-09-12T02:06:47.087115+0000","last_fullsized":"2024-09-12T02:06:47.087115+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.508820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47464,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1152,"num_write":460,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743886+0000","last_change":"2024-09-12T00:10:07.318948+0000","last_active":"2024-09-12T02:03:43.743886+0000","last_peered":"2024-09-12T02:03:43.743886+0000","last_clean":"2024-09-12T02:03:43.743886+0000","last_became_active":"2024-09-12T00:10:07.318114+0000","last_became_peered":"2024-09-12T00:10:07.318114+0000","last_unstale":"2024-09-12T02:03:43.743886+0000","last_undegraded":"2024-09-12T02:03:43.743886+0000","last_fullsized":"2024-09-12T02:03:43.743886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:24.177651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"266'2464","reported_seq":4396,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.745617+0000","last_change":"2024-09-12T00:10:09.371782+0000","last_active":"2024-09-12T02:04:59.745617+0000","last_peered":"2024-09-12T02:04:59.745617+0000","last_clean":"2024-09-12T02:04:59.745617+0000","last_became_active":"2024-09-12T00:10:09.370949+0000","last_became_peered":"2024-09-12T00:10:09.370949+0000","last_unstale":"2024-09-12T02:04:59.745617+0000","last_undegraded":"2024-09-12T02:04:59.745617+0000","last_fullsized":"2024-09-12T02:04:59.745617+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:02.640276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6210,"num_read_kb":6193,"num_write":4929,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"266'415","reported_seq":1953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.738917+0000","last_change":"2024-09-12T00:10:01.275549+0000","last_active":"2024-09-12T02:03:39.738917+0000","last_peered":"2024-09-12T02:03:39.738917+0000","last_clean":"2024-09-12T02:03:39.738917+0000","last_became_active":"2024-09-12T00:10:01.274710+0000","last_became_peered":"2024-09-12T00:10:01.274710+0000","last_unstale":"2024-09-12T02:03:39.738917+0000","last_undegraded":"2024-09-12T02:03:39.738917+0000","last_fullsized":"2024-09-12T02:03:39.738917+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:13.598102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2273,"num_read_kb":2145,"num_write":493,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"266'407","reported_seq":1128,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.502699+0000","last_change":"2024-09-12T00:09:59.282658+0000","last_active":"2024-09-12T02:06:47.502699+0000","last_peered":"2024-09-12T02:06:47.502699+0000","last_clean":"2024-09-12T02:06:47.502699+0000","last_became_active":"2024-09-12T00:09:59.282228+0000","last_became_peered":"2024-09-12T00:09:59.282228+0000","last_unstale":"2024-09-12T02:06:47.502699+0000","last_undegraded":"2024-09-12T02:06:47.502699+0000","last_fullsized":"2024-09-12T02:06:47.502699+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:12.393975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":89139,"num_write":1493,"num_write_kb":44201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.940910+0000","last_change":"2024-09-12T00:10:03.254783+0000","last_active":"2024-09-12T02:02:18.940910+0000","last_peered":"2024-09-12T02:02:18.940910+0000","last_clean":"2024-09-12T02:02:18.940910+0000","last_became_active":"2024-09-12T00:10:03.254006+0000","last_became_peered":"2024-09-12T00:10:03.254006+0000","last_unstale":"2024-09-12T02:02:18.940910+0000","last_undegraded":"2024-09-12T02:02:18.940910+0000","last_fullsized":"2024-09-12T02:02:18.940910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:47.826880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"266'138","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.748930+0000","last_change":"2024-09-12T00:10:05.280695+0000","last_active":"2024-09-12T02:03:43.748930+0000","last_peered":"2024-09-12T02:03:43.748930+0000","last_clean":"2024-09-12T02:03:43.748930+0000","last_became_active":"2024-09-12T00:10:05.279990+0000","last_became_peered":"2024-09-12T00:10:05.279990+0000","last_unstale":"2024-09-12T02:03:43.748930+0000","last_undegraded":"2024-09-12T02:03:43.748930+0000","last_fullsized":"2024-09-12T02:03:43.748930+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:32.073641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.748898+0000","last_change":"2024-09-12T00:10:07.310717+0000","last_active":"2024-09-12T02:03:43.748898+0000","last_peered":"2024-09-12T02:03:43.748898+0000","last_clean":"2024-09-12T02:03:43.748898+0000","last_became_active":"2024-09-12T00:10:07.309927+0000","last_became_peered":"2024-09-12T00:10:07.309927+0000","last_unstale":"2024-09-12T02:03:43.748898+0000","last_undegraded":"2024-09-12T02:03:43.748898+0000","last_fullsized":"2024-09-12T02:03:43.748898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:30.558288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"266'102","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718247+0000","last_change":"2024-09-12T00:10:09.365676+0000","last_active":"2024-09-12T02:02:38.718247+0000","last_peered":"2024-09-12T02:02:38.718247+0000","last_clean":"2024-09-12T02:02:38.718247+0000","last_became_active":"2024-09-12T00:10:09.364927+0000","last_became_peered":"2024-09-12T00:10:09.364927+0000","last_unstale":"2024-09-12T02:02:38.718247+0000","last_undegraded":"2024-09-12T02:02:38.718247+0000","last_fullsized":"2024-09-12T02:02:38.718247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.618632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":243,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"266'381","reported_seq":1911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.521800+0000","last_change":"2024-09-12T00:10:01.247147+0000","last_active":"2024-09-12T02:03:38.521800+0000","last_peered":"2024-09-12T02:03:38.521800+0000","last_clean":"2024-09-12T02:03:38.521800+0000","last_became_active":"2024-09-12T00:10:01.246633+0000","last_became_peered":"2024-09-12T00:10:01.246633+0000","last_unstale":"2024-09-12T02:03:38.521800+0000","last_undegraded":"2024-09-12T02:03:38.521800+0000","last_fullsized":"2024-09-12T02:03:38.521800+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:18.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2031,"num_read_kb":1954,"num_write":422,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"266'322","reported_seq":971,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.548754+0000","last_change":"2024-09-12T00:10:31.472958+0000","last_active":"2024-09-12T02:06:47.548754+0000","last_peered":"2024-09-12T02:06:47.548754+0000","last_clean":"2024-09-12T02:06:47.548754+0000","last_became_active":"2024-09-12T00:10:31.472231+0000","last_became_peered":"2024-09-12T00:10:31.472231+0000","last_unstale":"2024-09-12T02:06:47.548754+0000","last_undegraded":"2024-09-12T02:06:47.548754+0000","last_fullsized":"2024-09-12T02:06:47.548754+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:02.415644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536061,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":478,"num_read_kb":34994,"num_write":999,"num_write_kb":46604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"37'3","reported_seq":1004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:06.532879+0000","last_change":"2024-09-12T00:10:03.266585+0000","last_active":"2024-09-12T02:06:06.532879+0000","last_peered":"2024-09-12T02:06:06.532879+0000","last_clean":"2024-09-12T02:06:06.532879+0000","last_became_active":"2024-09-12T00:10:03.265816+0000","last_became_peered":"2024-09-12T00:10:03.265816+0000","last_unstale":"2024-09-12T02:06:06.532879+0000","last_undegraded":"2024-09-12T02:06:06.532879+0000","last_fullsized":"2024-09-12T02:06:06.532879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:06.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"266'189","reported_seq":796,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689892+0000","last_change":"2024-09-12T00:10:05.276198+0000","last_active":"2024-09-12T02:02:33.689892+0000","last_peered":"2024-09-12T02:02:33.689892+0000","last_clean":"2024-09-12T02:02:33.689892+0000","last_became_active":"2024-09-12T00:10:05.275499+0000","last_became_peered":"2024-09-12T00:10:05.275499+0000","last_unstale":"2024-09-12T02:02:33.689892+0000","last_undegraded":"2024-09-12T02:02:33.689892+0000","last_fullsized":"2024-09-12T02:02:33.689892+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:30.503399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":245,"num_read_kb":237,"num_write":164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"266'774","reported_seq":3030,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.967482+0000","last_change":"2024-09-12T00:10:07.319071+0000","last_active":"2024-09-12T02:06:46.967482+0000","last_peered":"2024-09-12T02:06:46.967482+0000","last_clean":"2024-09-12T02:06:46.967482+0000","last_became_active":"2024-09-12T00:10:07.318302+0000","last_became_peered":"2024-09-12T00:10:07.318302+0000","last_unstale":"2024-09-12T02:06:46.967482+0000","last_undegraded":"2024-09-12T02:06:46.967482+0000","last_fullsized":"2024-09-12T02:06:46.967482+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:04.659101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"266'205","reported_seq":1059,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.365691+0000","last_change":"2024-09-12T00:10:09.433574+0000","last_active":"2024-09-12T02:06:05.365691+0000","last_peered":"2024-09-12T02:06:05.365691+0000","last_clean":"2024-09-12T02:06:05.365691+0000","last_became_active":"2024-09-12T00:10:09.433045+0000","last_became_peered":"2024-09-12T00:10:09.433045+0000","last_unstale":"2024-09-12T02:06:05.365691+0000","last_undegraded":"2024-09-12T02:06:05.365691+0000","last_fullsized":"2024-09-12T02:06:05.365691+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:02.345129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":620,"num_write":453,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"266'389","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.963036+0000","last_change":"2024-09-12T00:10:01.261564+0000","last_active":"2024-09-12T02:03:38.963036+0000","last_peered":"2024-09-12T02:03:38.963036+0000","last_clean":"2024-09-12T02:03:38.963036+0000","last_became_active":"2024-09-12T00:10:01.261217+0000","last_became_peered":"2024-09-12T00:10:01.261217+0000","last_unstale":"2024-09-12T02:03:38.963036+0000","last_undegraded":"2024-09-12T02:03:38.963036+0000","last_fullsized":"2024-09-12T02:03:38.963036+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2298,"num_read_kb":2187,"num_write":432,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"266'343","reported_seq":998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.468362+0000","last_change":"2024-09-12T00:09:59.286394+0000","last_active":"2024-09-12T02:06:47.468362+0000","last_peered":"2024-09-12T02:06:47.468362+0000","last_clean":"2024-09-12T02:06:47.468362+0000","last_became_active":"2024-09-12T00:09:59.281330+0000","last_became_peered":"2024-09-12T00:09:59.281330+0000","last_unstale":"2024-09-12T02:06:47.468362+0000","last_undegraded":"2024-09-12T02:06:47.468362+0000","last_fullsized":"2024-09-12T02:06:47.468362+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:20.081291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":6619,"num_write":1099,"num_write_kb":41386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.739031+0000","last_change":"2024-09-12T00:10:03.273556+0000","last_active":"2024-09-12T02:03:39.739031+0000","last_peered":"2024-09-12T02:03:39.739031+0000","last_clean":"2024-09-12T02:03:39.739031+0000","last_became_active":"2024-09-12T00:10:03.271292+0000","last_became_peered":"2024-09-12T00:10:03.271292+0000","last_unstale":"2024-09-12T02:03:39.739031+0000","last_undegraded":"2024-09-12T02:03:39.739031+0000","last_fullsized":"2024-09-12T02:03:39.739031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"266'320","reported_seq":938,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.659989+0000","last_change":"2024-09-12T00:10:05.363194+0000","last_active":"2024-09-12T02:06:46.659989+0000","last_peered":"2024-09-12T02:06:46.659989+0000","last_clean":"2024-09-12T02:06:46.659989+0000","last_became_active":"2024-09-12T00:10:05.361419+0000","last_became_peered":"2024-09-12T00:10:05.361419+0000","last_unstale":"2024-09-12T02:06:46.659989+0000","last_undegraded":"2024-09-12T02:06:46.659989+0000","last_fullsized":"2024-09-12T02:06:46.659989+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:25.749053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":523,"num_read_kb":1153,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"266'821","reported_seq":3116,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.370722+0000","last_change":"2024-09-12T00:10:07.335921+0000","last_active":"2024-09-12T02:06:10.370722+0000","last_peered":"2024-09-12T02:06:10.370722+0000","last_clean":"2024-09-12T02:06:10.370722+0000","last_became_active":"2024-09-12T00:10:07.335181+0000","last_became_peered":"2024-09-12T00:10:07.335181+0000","last_unstale":"2024-09-12T02:06:10.370722+0000","last_undegraded":"2024-09-12T02:06:10.370722+0000","last_fullsized":"2024-09-12T02:06:10.370722+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:17.529066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"266'419","reported_seq":1870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726289+0000","last_change":"2024-09-12T00:10:01.267267+0000","last_active":"2024-09-12T02:02:44.726289+0000","last_peered":"2024-09-12T02:02:44.726289+0000","last_clean":"2024-09-12T02:02:44.726289+0000","last_became_active":"2024-09-12T00:10:01.266204+0000","last_became_peered":"2024-09-12T00:10:01.266204+0000","last_unstale":"2024-09-12T02:02:44.726289+0000","last_undegraded":"2024-09-12T02:02:44.726289+0000","last_fullsized":"2024-09-12T02:02:44.726289+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:02.715482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2063,"num_read_kb":1939,"num_write":461,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"266'375","reported_seq":1031,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.507786+0000","last_change":"2024-09-12T00:09:59.308323+0000","last_active":"2024-09-12T02:06:47.507786+0000","last_peered":"2024-09-12T02:06:47.507786+0000","last_clean":"2024-09-12T02:06:47.507786+0000","last_became_active":"2024-09-12T00:09:59.307481+0000","last_became_peered":"2024-09-12T00:09:59.307481+0000","last_unstale":"2024-09-12T02:06:47.507786+0000","last_undegraded":"2024-09-12T02:06:47.507786+0000","last_fullsized":"2024-09-12T02:06:47.507786+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.962499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":11316,"num_write":1196,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.729507+0000","last_change":"2024-09-12T00:10:03.261104+0000","last_active":"2024-09-12T02:02:43.729507+0000","last_peered":"2024-09-12T02:02:43.729507+0000","last_clean":"2024-09-12T02:02:43.729507+0000","last_became_active":"2024-09-12T00:10:03.258601+0000","last_became_peered":"2024-09-12T00:10:03.258601+0000","last_unstale":"2024-09-12T02:02:43.729507+0000","last_undegraded":"2024-09-12T02:02:43.729507+0000","last_fullsized":"2024-09-12T02:02:43.729507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:49.169082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"266'473","reported_seq":1170,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.079330+0000","last_change":"2024-09-12T00:10:05.362098+0000","last_active":"2024-09-12T02:06:07.079330+0000","last_peered":"2024-09-12T02:06:07.079330+0000","last_clean":"2024-09-12T02:06:07.079330+0000","last_became_active":"2024-09-12T00:10:05.361273+0000","last_became_peered":"2024-09-12T00:10:05.361273+0000","last_unstale":"2024-09-12T02:06:07.079330+0000","last_undegraded":"2024-09-12T02:06:07.079330+0000","last_fullsized":"2024-09-12T02:06:07.079330+0000","mapping_epoch":31,"log_start":"266'400","ondisk_log_start":"266'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:08.958275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61868,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":760,"num_read_kb":1277,"num_write":586,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679765+0000","last_change":"2024-09-12T00:10:07.317430+0000","last_active":"2024-09-12T02:02:38.679765+0000","last_peered":"2024-09-12T02:02:38.679765+0000","last_clean":"2024-09-12T02:02:38.679765+0000","last_became_active":"2024-09-12T00:10:07.316670+0000","last_became_peered":"2024-09-12T00:10:07.316670+0000","last_unstale":"2024-09-12T02:02:38.679765+0000","last_undegraded":"2024-09-12T02:02:38.679765+0000","last_fullsized":"2024-09-12T02:02:38.679765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.008641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"266'599","reported_seq":1440,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.111464+0000","last_change":"2024-09-12T00:10:09.368828+0000","last_active":"2024-09-12T02:06:07.111464+0000","last_peered":"2024-09-12T02:06:07.111464+0000","last_clean":"2024-09-12T02:06:07.111464+0000","last_became_active":"2024-09-12T00:10:09.368091+0000","last_became_peered":"2024-09-12T00:10:09.368091+0000","last_unstale":"2024-09-12T02:06:07.111464+0000","last_undegraded":"2024-09-12T02:06:07.111464+0000","last_fullsized":"2024-09-12T02:06:07.111464+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:38.890638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1323,"num_read_kb":1320,"num_write":1284,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"266'475","reported_seq":2134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.482999+0000","last_change":"2024-09-12T00:10:01.258535+0000","last_active":"2024-09-12T02:04:57.482999+0000","last_peered":"2024-09-12T02:04:57.482999+0000","last_clean":"2024-09-12T02:04:57.482999+0000","last_became_active":"2024-09-12T00:10:01.257821+0000","last_became_peered":"2024-09-12T00:10:01.257821+0000","last_unstale":"2024-09-12T02:04:57.482999+0000","last_undegraded":"2024-09-12T02:04:57.482999+0000","last_fullsized":"2024-09-12T02:04:57.482999+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:45.635084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2372,"num_write":561,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"266'348","reported_seq":996,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.524014+0000","last_change":"2024-09-12T00:09:59.308750+0000","last_active":"2024-09-12T02:06:47.524014+0000","last_peered":"2024-09-12T02:06:47.524014+0000","last_clean":"2024-09-12T02:06:47.524014+0000","last_became_active":"2024-09-12T00:09:59.308185+0000","last_became_peered":"2024-09-12T00:09:59.308185+0000","last_unstale":"2024-09-12T02:06:47.524014+0000","last_undegraded":"2024-09-12T02:06:47.524014+0000","last_fullsized":"2024-09-12T02:06:47.524014+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:51.112048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":32387,"num_write":1082,"num_write_kb":39559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.691933+0000","last_change":"2024-09-12T00:10:03.250952+0000","last_active":"2024-09-12T02:02:43.691933+0000","last_peered":"2024-09-12T02:02:43.691933+0000","last_clean":"2024-09-12T02:02:43.691933+0000","last_became_active":"2024-09-12T00:10:03.250360+0000","last_became_peered":"2024-09-12T00:10:03.250360+0000","last_unstale":"2024-09-12T02:02:43.691933+0000","last_undegraded":"2024-09-12T02:02:43.691933+0000","last_fullsized":"2024-09-12T02:02:43.691933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:07.747068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"266'304","reported_seq":924,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:53.983324+0000","last_change":"2024-09-12T00:10:05.292211+0000","last_active":"2024-09-12T02:04:53.983324+0000","last_peered":"2024-09-12T02:04:53.983324+0000","last_clean":"2024-09-12T02:04:53.983324+0000","last_became_active":"2024-09-12T00:10:05.288035+0000","last_became_peered":"2024-09-12T00:10:05.288035+0000","last_unstale":"2024-09-12T02:04:53.983324+0000","last_undegraded":"2024-09-12T02:04:53.983324+0000","last_fullsized":"2024-09-12T02:04:53.983324+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:11.001735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":999,"num_write":402,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.952988+0000","last_change":"2024-09-12T00:10:07.340807+0000","last_active":"2024-09-12T02:03:03.952988+0000","last_peered":"2024-09-12T02:03:03.952988+0000","last_clean":"2024-09-12T02:03:03.952988+0000","last_became_active":"2024-09-12T00:10:07.340248+0000","last_became_peered":"2024-09-12T00:10:07.340248+0000","last_unstale":"2024-09-12T02:03:03.952988+0000","last_undegraded":"2024-09-12T02:03:03.952988+0000","last_fullsized":"2024-09-12T02:03:03.952988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.585478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"266'116","reported_seq":643,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:13.737132+0000","last_change":"2024-09-12T00:10:09.361661+0000","last_active":"2024-09-12T02:05:13.737132+0000","last_peered":"2024-09-12T02:05:13.737132+0000","last_clean":"2024-09-12T02:05:13.737132+0000","last_became_active":"2024-09-12T00:10:09.359663+0000","last_became_peered":"2024-09-12T00:10:09.359663+0000","last_unstale":"2024-09-12T02:05:13.737132+0000","last_undegraded":"2024-09-12T02:05:13.737132+0000","last_fullsized":"2024-09-12T02:05:13.737132+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:19.918840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":110,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"266'1041","reported_seq":2833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.717280+0000","last_change":"2024-09-12T00:10:01.263893+0000","last_active":"2024-09-12T02:04:59.717280+0000","last_peered":"2024-09-12T02:04:59.717280+0000","last_clean":"2024-09-12T02:04:59.717280+0000","last_became_active":"2024-09-12T00:10:01.263012+0000","last_became_peered":"2024-09-12T00:10:01.263012+0000","last_unstale":"2024-09-12T02:04:59.717280+0000","last_undegraded":"2024-09-12T02:04:59.717280+0000","last_fullsized":"2024-09-12T02:04:59.717280+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1000,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:53.923315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4917,"num_read_kb":4393,"num_write":1427,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"266'301","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.508942+0000","last_change":"2024-09-12T00:10:31.478771+0000","last_active":"2024-09-12T02:06:47.508942+0000","last_peered":"2024-09-12T02:06:47.508942+0000","last_clean":"2024-09-12T02:06:47.508942+0000","last_became_active":"2024-09-12T00:10:31.477934+0000","last_became_peered":"2024-09-12T00:10:31.477934+0000","last_unstale":"2024-09-12T02:06:47.508942+0000","last_undegraded":"2024-09-12T02:06:47.508942+0000","last_fullsized":"2024-09-12T02:06:47.508942+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:03.480837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":400,"num_read_kb":33911,"num_write":938,"num_write_kb":31727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689840+0000","last_change":"2024-09-12T00:10:03.254945+0000","last_active":"2024-09-12T02:02:33.689840+0000","last_peered":"2024-09-12T02:02:33.689840+0000","last_clean":"2024-09-12T02:02:33.689840+0000","last_became_active":"2024-09-12T00:10:03.254328+0000","last_became_peered":"2024-09-12T00:10:03.254328+0000","last_unstale":"2024-09-12T02:02:33.689840+0000","last_undegraded":"2024-09-12T02:02:33.689840+0000","last_fullsized":"2024-09-12T02:02:33.689840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:03.177090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"266'397","reported_seq":1062,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.565854+0000","last_change":"2024-09-12T00:10:05.286921+0000","last_active":"2024-09-12T02:06:47.565854+0000","last_peered":"2024-09-12T02:06:47.565854+0000","last_clean":"2024-09-12T02:06:47.565854+0000","last_became_active":"2024-09-12T00:10:05.285616+0000","last_became_peered":"2024-09-12T00:10:05.285616+0000","last_unstale":"2024-09-12T02:06:47.565854+0000","last_undegraded":"2024-09-12T02:06:47.565854+0000","last_fullsized":"2024-09-12T02:06:47.565854+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:58.157359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44989,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":1221,"num_write":494,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"266'803","reported_seq":3292,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.382150+0000","last_change":"2024-09-12T00:10:07.320523+0000","last_active":"2024-09-12T02:06:44.382150+0000","last_peered":"2024-09-12T02:06:44.382150+0000","last_clean":"2024-09-12T02:06:44.382150+0000","last_became_active":"2024-09-12T00:10:07.319708+0000","last_became_peered":"2024-09-12T00:10:07.319708+0000","last_unstale":"2024-09-12T02:06:44.382150+0000","last_undegraded":"2024-09-12T02:06:44.382150+0000","last_fullsized":"2024-09-12T02:06:44.382150+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:21.157783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"266'112","reported_seq":638,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.365117+0000","last_change":"2024-09-12T00:10:09.358471+0000","last_active":"2024-09-12T02:06:05.365117+0000","last_peered":"2024-09-12T02:06:05.365117+0000","last_clean":"2024-09-12T02:06:05.365117+0000","last_became_active":"2024-09-12T00:10:09.357682+0000","last_became_peered":"2024-09-12T00:10:09.357682+0000","last_unstale":"2024-09-12T02:06:05.365117+0000","last_undegraded":"2024-09-12T02:06:05.365117+0000","last_fullsized":"2024-09-12T02:06:05.365117+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:14.701980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":265,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"266'779","reported_seq":2339,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.717005+0000","last_change":"2024-09-12T00:10:01.258907+0000","last_active":"2024-09-12T02:02:33.717005+0000","last_peered":"2024-09-12T02:02:33.717005+0000","last_clean":"2024-09-12T02:02:33.717005+0000","last_became_active":"2024-09-12T00:10:01.258536+0000","last_became_peered":"2024-09-12T00:10:01.258536+0000","last_unstale":"2024-09-12T02:02:33.717005+0000","last_undegraded":"2024-09-12T02:02:33.717005+0000","last_fullsized":"2024-09-12T02:02:33.717005+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:13.970208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3854,"num_read_kb":3489,"num_write":1035,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"266'320","reported_seq":978,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.528575+0000","last_change":"2024-09-12T00:09:59.284888+0000","last_active":"2024-09-12T02:06:44.528575+0000","last_peered":"2024-09-12T02:06:44.528575+0000","last_clean":"2024-09-12T02:06:44.528575+0000","last_became_active":"2024-09-12T00:09:59.283882+0000","last_became_peered":"2024-09-12T00:09:59.283882+0000","last_unstale":"2024-09-12T02:06:44.528575+0000","last_undegraded":"2024-09-12T02:06:44.528575+0000","last_fullsized":"2024-09-12T02:06:44.528575+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:55.361739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8414688,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":429,"num_read_kb":25086,"num_write":1143,"num_write_kb":35310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.698033+0000","last_change":"2024-09-12T00:10:03.251387+0000","last_active":"2024-09-12T02:03:08.698033+0000","last_peered":"2024-09-12T02:03:08.698033+0000","last_clean":"2024-09-12T02:03:08.698033+0000","last_became_active":"2024-09-12T00:10:03.250840+0000","last_became_peered":"2024-09-12T00:10:03.250840+0000","last_unstale":"2024-09-12T02:03:08.698033+0000","last_undegraded":"2024-09-12T02:03:08.698033+0000","last_fullsized":"2024-09-12T02:03:08.698033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.168119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"266'538","reported_seq":1230,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.953250+0000","last_change":"2024-09-12T00:10:05.287261+0000","last_active":"2024-09-12T02:06:45.953250+0000","last_peered":"2024-09-12T02:06:45.953250+0000","last_clean":"2024-09-12T02:06:45.953250+0000","last_became_active":"2024-09-12T00:10:05.285823+0000","last_became_peered":"2024-09-12T00:10:05.285823+0000","last_unstale":"2024-09-12T02:06:45.953250+0000","last_undegraded":"2024-09-12T02:06:45.953250+0000","last_fullsized":"2024-09-12T02:06:45.953250+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:57.618303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96632,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":936,"num_read_kb":2160,"num_write":758,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.692984+0000","last_change":"2024-09-12T00:10:07.321850+0000","last_active":"2024-09-12T02:02:48.692984+0000","last_peered":"2024-09-12T02:02:48.692984+0000","last_clean":"2024-09-12T02:02:48.692984+0000","last_became_active":"2024-09-12T00:10:07.321180+0000","last_became_peered":"2024-09-12T00:10:07.321180+0000","last_unstale":"2024-09-12T02:02:48.692984+0000","last_undegraded":"2024-09-12T02:02:48.692984+0000","last_fullsized":"2024-09-12T02:02:48.692984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:15.729989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"266'133","reported_seq":710,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.508275+0000","last_change":"2024-09-12T00:10:09.361110+0000","last_active":"2024-09-12T02:04:57.508275+0000","last_peered":"2024-09-12T02:04:57.508275+0000","last_clean":"2024-09-12T02:04:57.508275+0000","last_became_active":"2024-09-12T00:10:09.359011+0000","last_became_peered":"2024-09-12T00:10:09.359011+0000","last_unstale":"2024-09-12T02:04:57.508275+0000","last_undegraded":"2024-09-12T02:04:57.508275+0000","last_fullsized":"2024-09-12T02:04:57.508275+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:07.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":320,"num_read_kb":272,"num_write":321,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"266'1103","reported_seq":2643,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.874650+0000","last_change":"2024-09-12T00:10:01.249017+0000","last_active":"2024-09-12T02:04:59.874650+0000","last_peered":"2024-09-12T02:04:59.874650+0000","last_clean":"2024-09-12T02:04:59.874650+0000","last_became_active":"2024-09-12T00:10:01.248297+0000","last_became_peered":"2024-09-12T00:10:01.248297+0000","last_unstale":"2024-09-12T02:04:59.874650+0000","last_undegraded":"2024-09-12T02:04:59.874650+0000","last_fullsized":"2024-09-12T02:04:59.874650+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":1000,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:34.449342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4909,"num_read_kb":4337,"num_write":1501,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"266'257","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.943593+0000","last_change":"2024-09-12T00:10:31.166221+0000","last_active":"2024-09-12T02:02:28.943593+0000","last_peered":"2024-09-12T02:02:28.943593+0000","last_clean":"2024-09-12T02:02:28.943593+0000","last_became_active":"2024-09-12T00:10:31.165905+0000","last_became_peered":"2024-09-12T00:10:31.165905+0000","last_unstale":"2024-09-12T02:02:28.943593+0000","last_undegraded":"2024-09-12T02:02:28.943593+0000","last_fullsized":"2024-09-12T02:02:28.943593+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:02.031075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2274550,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":365,"num_read_kb":2613,"num_write":967,"num_write_kb":17332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,7],"acting":[3,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689930+0000","last_change":"2024-09-12T00:10:03.254698+0000","last_active":"2024-09-12T02:02:33.689930+0000","last_peered":"2024-09-12T02:02:33.689930+0000","last_clean":"2024-09-12T02:02:33.689930+0000","last_became_active":"2024-09-12T00:10:03.254056+0000","last_became_peered":"2024-09-12T00:10:03.254056+0000","last_unstale":"2024-09-12T02:02:33.689930+0000","last_undegraded":"2024-09-12T02:02:33.689930+0000","last_fullsized":"2024-09-12T02:02:33.689930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:22.359128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"266'379","reported_seq":1016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.069287+0000","last_change":"2024-09-12T00:10:05.300463+0000","last_active":"2024-09-12T02:06:46.069287+0000","last_peered":"2024-09-12T02:06:46.069287+0000","last_clean":"2024-09-12T02:06:46.069287+0000","last_became_active":"2024-09-12T00:10:05.299568+0000","last_became_peered":"2024-09-12T00:10:05.299568+0000","last_unstale":"2024-09-12T02:06:46.069287+0000","last_undegraded":"2024-09-12T02:06:46.069287+0000","last_fullsized":"2024-09-12T02:06:46.069287+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:55.828313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":635,"num_read_kb":1318,"num_write":554,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.726007+0000","last_change":"2024-09-12T00:10:07.335273+0000","last_active":"2024-09-12T02:03:08.726007+0000","last_peered":"2024-09-12T02:03:08.726007+0000","last_clean":"2024-09-12T02:03:08.726007+0000","last_became_active":"2024-09-12T00:10:07.334527+0000","last_became_peered":"2024-09-12T00:10:07.334527+0000","last_unstale":"2024-09-12T02:03:08.726007+0000","last_undegraded":"2024-09-12T02:03:08.726007+0000","last_fullsized":"2024-09-12T02:03:08.726007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:58.243181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"266'171","reported_seq":743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:53.394855+0000","last_change":"2024-09-12T00:10:09.373893+0000","last_active":"2024-09-12T02:05:53.394855+0000","last_peered":"2024-09-12T02:05:53.394855+0000","last_clean":"2024-09-12T02:05:53.394855+0000","last_became_active":"2024-09-12T00:10:09.373318+0000","last_became_peered":"2024-09-12T00:10:09.373318+0000","last_unstale":"2024-09-12T02:05:53.394855+0000","last_undegraded":"2024-09-12T02:05:53.394855+0000","last_fullsized":"2024-09-12T02:05:53.394855+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:12.690531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":275,"num_write":406,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"266'789","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.475401+0000","last_change":"2024-09-12T00:10:01.242970+0000","last_active":"2024-09-12T02:04:57.475401+0000","last_peered":"2024-09-12T02:04:57.475401+0000","last_clean":"2024-09-12T02:04:57.475401+0000","last_became_active":"2024-09-12T00:10:01.242213+0000","last_became_peered":"2024-09-12T00:10:01.242213+0000","last_unstale":"2024-09-12T02:04:57.475401+0000","last_undegraded":"2024-09-12T02:04:57.475401+0000","last_fullsized":"2024-09-12T02:04:57.475401+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3776,"num_read_kb":3427,"num_write":1023,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"266'387","reported_seq":1078,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.383112+0000","last_change":"2024-09-12T00:09:59.299620+0000","last_active":"2024-09-12T02:06:47.383112+0000","last_peered":"2024-09-12T02:06:47.383112+0000","last_clean":"2024-09-12T02:06:47.383112+0000","last_became_active":"2024-09-12T00:09:59.298986+0000","last_became_peered":"2024-09-12T00:09:59.298986+0000","last_unstale":"2024-09-12T02:06:47.383112+0000","last_undegraded":"2024-09-12T02:06:47.383112+0000","last_fullsized":"2024-09-12T02:06:47.383112+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:32.999083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":586,"num_read_kb":16563,"num_write":1186,"num_write_kb":29581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.678607+0000","last_change":"2024-09-12T00:10:03.262756+0000","last_active":"2024-09-12T02:02:33.678607+0000","last_peered":"2024-09-12T02:02:33.678607+0000","last_clean":"2024-09-12T02:02:33.678607+0000","last_became_active":"2024-09-12T00:10:03.262121+0000","last_became_peered":"2024-09-12T00:10:03.262121+0000","last_unstale":"2024-09-12T02:02:33.678607+0000","last_undegraded":"2024-09-12T02:02:33.678607+0000","last_fullsized":"2024-09-12T02:02:33.678607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:37.206721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"266'390","reported_seq":1045,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.380567+0000","last_change":"2024-09-12T00:10:05.295381+0000","last_active":"2024-09-12T02:06:45.380567+0000","last_peered":"2024-09-12T02:06:45.380567+0000","last_clean":"2024-09-12T02:06:45.380567+0000","last_became_active":"2024-09-12T00:10:05.294629+0000","last_became_peered":"2024-09-12T00:10:05.294629+0000","last_unstale":"2024-09-12T02:06:45.380567+0000","last_undegraded":"2024-09-12T02:06:45.380567+0000","last_fullsized":"2024-09-12T02:06:45.380567+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:11.786672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46543,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":631,"num_read_kb":1251,"num_write":492,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"266'749","reported_seq":3287,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.735407+0000","last_change":"2024-09-12T00:10:07.315482+0000","last_active":"2024-09-12T02:06:46.735407+0000","last_peered":"2024-09-12T02:06:46.735407+0000","last_clean":"2024-09-12T02:06:46.735407+0000","last_became_active":"2024-09-12T00:10:07.314777+0000","last_became_peered":"2024-09-12T00:10:07.314777+0000","last_unstale":"2024-09-12T02:06:46.735407+0000","last_undegraded":"2024-09-12T02:06:46.735407+0000","last_fullsized":"2024-09-12T02:06:46.735407+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.137312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"266'132","reported_seq":670,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.682437+0000","last_change":"2024-09-12T00:10:09.347267+0000","last_active":"2024-09-12T02:04:57.682437+0000","last_peered":"2024-09-12T02:04:57.682437+0000","last_clean":"2024-09-12T02:04:57.682437+0000","last_became_active":"2024-09-12T00:10:09.346452+0000","last_became_peered":"2024-09-12T00:10:09.346452+0000","last_unstale":"2024-09-12T02:04:57.682437+0000","last_undegraded":"2024-09-12T02:04:57.682437+0000","last_fullsized":"2024-09-12T02:04:57.682437+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:11.712124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":133,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"266'1057","reported_seq":2646,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.763934+0000","last_change":"2024-09-12T00:10:01.265761+0000","last_active":"2024-09-12T02:04:48.763934+0000","last_peered":"2024-09-12T02:04:48.763934+0000","last_clean":"2024-09-12T02:04:48.763934+0000","last_became_active":"2024-09-12T00:10:01.264718+0000","last_became_peered":"2024-09-12T00:10:01.264718+0000","last_unstale":"2024-09-12T02:04:48.763934+0000","last_undegraded":"2024-09-12T02:04:48.763934+0000","last_fullsized":"2024-09-12T02:04:48.763934+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1000,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:21.890638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4853,"num_read_kb":4249,"num_write":1477,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"266'417","reported_seq":1113,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.507177+0000","last_change":"2024-09-12T00:09:59.307052+0000","last_active":"2024-09-12T02:06:47.507177+0000","last_peered":"2024-09-12T02:06:47.507177+0000","last_clean":"2024-09-12T02:06:47.507177+0000","last_became_active":"2024-09-12T00:09:59.301303+0000","last_became_peered":"2024-09-12T00:09:59.301303+0000","last_unstale":"2024-09-12T02:06:47.507177+0000","last_undegraded":"2024-09-12T02:06:47.507177+0000","last_fullsized":"2024-09-12T02:06:47.507177+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:46.678907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443899,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":39523,"num_write":1279,"num_write_kb":37758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.121629+0000","last_change":"2024-09-12T00:10:03.274423+0000","last_active":"2024-09-12T02:06:44.121629+0000","last_peered":"2024-09-12T02:06:44.121629+0000","last_clean":"2024-09-12T02:06:44.121629+0000","last_became_active":"2024-09-12T00:10:03.271281+0000","last_became_peered":"2024-09-12T00:10:03.271281+0000","last_unstale":"2024-09-12T02:06:44.121629+0000","last_undegraded":"2024-09-12T02:06:44.121629+0000","last_fullsized":"2024-09-12T02:06:44.121629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:31.849595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"266'147","reported_seq":728,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.946308+0000","last_change":"2024-09-12T00:10:05.363280+0000","last_active":"2024-09-12T02:02:38.946308+0000","last_peered":"2024-09-12T02:02:38.946308+0000","last_clean":"2024-09-12T02:02:38.946308+0000","last_became_active":"2024-09-12T00:10:05.362449+0000","last_became_peered":"2024-09-12T00:10:05.362449+0000","last_unstale":"2024-09-12T02:02:38.946308+0000","last_undegraded":"2024-09-12T02:02:38.946308+0000","last_fullsized":"2024-09-12T02:02:38.946308+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:21.556082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"266'764","reported_seq":3346,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.015394+0000","last_change":"2024-09-12T00:10:07.319650+0000","last_active":"2024-09-12T02:06:47.015394+0000","last_peered":"2024-09-12T02:06:47.015394+0000","last_clean":"2024-09-12T02:06:47.015394+0000","last_became_active":"2024-09-12T00:10:07.318566+0000","last_became_peered":"2024-09-12T00:10:07.318566+0000","last_unstale":"2024-09-12T02:06:47.015394+0000","last_undegraded":"2024-09-12T02:06:47.015394+0000","last_fullsized":"2024-09-12T02:06:47.015394+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:17.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"266'180","reported_seq":711,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.523007+0000","last_change":"2024-09-12T00:10:09.353927+0000","last_active":"2024-09-12T02:04:57.523007+0000","last_peered":"2024-09-12T02:04:57.523007+0000","last_clean":"2024-09-12T02:04:57.523007+0000","last_became_active":"2024-09-12T00:10:09.353213+0000","last_became_peered":"2024-09-12T00:10:09.353213+0000","last_unstale":"2024-09-12T02:04:57.523007+0000","last_undegraded":"2024-09-12T02:04:57.523007+0000","last_fullsized":"2024-09-12T02:04:57.523007+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:39.991544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":410,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"266'436","reported_seq":1987,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.686240+0000","last_change":"2024-09-12T00:10:01.256672+0000","last_active":"2024-09-12T02:03:03.686240+0000","last_peered":"2024-09-12T02:03:03.686240+0000","last_clean":"2024-09-12T02:03:03.686240+0000","last_became_active":"2024-09-12T00:10:01.256287+0000","last_became_peered":"2024-09-12T00:10:01.256287+0000","last_unstale":"2024-09-12T02:03:03.686240+0000","last_undegraded":"2024-09-12T02:03:03.686240+0000","last_fullsized":"2024-09-12T02:03:03.686240+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:39.690690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2163,"num_write":523,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"266'393","reported_seq":1331,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.945995+0000","last_change":"2024-09-12T00:10:31.169004+0000","last_active":"2024-09-12T02:02:38.945995+0000","last_peered":"2024-09-12T02:02:38.945995+0000","last_clean":"2024-09-12T02:02:38.945995+0000","last_became_active":"2024-09-12T00:10:31.168654+0000","last_became_peered":"2024-09-12T00:10:31.168654+0000","last_unstale":"2024-09-12T02:02:38.945995+0000","last_undegraded":"2024-09-12T02:02:38.945995+0000","last_fullsized":"2024-09-12T02:02:38.945995+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:25.883597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837649,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":1187,"num_read_kb":67964,"num_write":1285,"num_write_kb":19763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733393+0000","last_change":"2024-09-12T00:10:03.273199+0000","last_active":"2024-09-12T02:02:33.733393+0000","last_peered":"2024-09-12T02:02:33.733393+0000","last_clean":"2024-09-12T02:02:33.733393+0000","last_became_active":"2024-09-12T00:10:03.272284+0000","last_became_peered":"2024-09-12T00:10:03.272284+0000","last_unstale":"2024-09-12T02:02:33.733393+0000","last_undegraded":"2024-09-12T02:02:33.733393+0000","last_fullsized":"2024-09-12T02:02:33.733393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:34.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"266'532","reported_seq":1209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.070439+0000","last_change":"2024-09-12T00:10:05.301341+0000","last_active":"2024-09-12T02:06:07.070439+0000","last_peered":"2024-09-12T02:06:07.070439+0000","last_clean":"2024-09-12T02:06:07.070439+0000","last_became_active":"2024-09-12T00:10:05.300354+0000","last_became_peered":"2024-09-12T00:10:05.300354+0000","last_unstale":"2024-09-12T02:06:07.070439+0000","last_undegraded":"2024-09-12T02:06:07.070439+0000","last_fullsized":"2024-09-12T02:06:07.070439+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:12.920116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56958,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1425,"num_read_kb":1877,"num_write":2036,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.703060+0000","last_change":"2024-09-12T00:10:07.340586+0000","last_active":"2024-09-12T02:02:38.703060+0000","last_peered":"2024-09-12T02:02:38.703060+0000","last_clean":"2024-09-12T02:02:38.703060+0000","last_became_active":"2024-09-12T00:10:07.340008+0000","last_became_peered":"2024-09-12T00:10:07.340008+0000","last_unstale":"2024-09-12T02:02:38.703060+0000","last_undegraded":"2024-09-12T02:02:38.703060+0000","last_fullsized":"2024-09-12T02:02:38.703060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:10.322035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"266'137","reported_seq":681,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709447+0000","last_change":"2024-09-12T00:10:09.373165+0000","last_active":"2024-09-12T02:04:43.709447+0000","last_peered":"2024-09-12T02:04:43.709447+0000","last_clean":"2024-09-12T02:04:43.709447+0000","last_became_active":"2024-09-12T00:10:09.372231+0000","last_became_peered":"2024-09-12T00:10:09.372231+0000","last_unstale":"2024-09-12T02:04:43.709447+0000","last_undegraded":"2024-09-12T02:04:43.709447+0000","last_fullsized":"2024-09-12T02:04:43.709447+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:27.875059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"266'755","reported_seq":2305,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.708542+0000","last_change":"2024-09-12T00:10:01.263233+0000","last_active":"2024-09-12T02:03:03.708542+0000","last_peered":"2024-09-12T02:03:03.708542+0000","last_clean":"2024-09-12T02:03:03.708542+0000","last_became_active":"2024-09-12T00:10:01.262490+0000","last_became_peered":"2024-09-12T00:10:01.262490+0000","last_unstale":"2024-09-12T02:03:03.708542+0000","last_undegraded":"2024-09-12T02:03:03.708542+0000","last_fullsized":"2024-09-12T02:03:03.708542+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:53.059969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3216,"num_write":966,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.749663+0000","last_change":"2024-09-12T00:09:40.226824+0000","last_active":"2024-09-12T02:04:08.749663+0000","last_peered":"2024-09-12T02:04:08.749663+0000","last_clean":"2024-09-12T02:04:08.749663+0000","last_became_active":"2024-09-12T00:09:40.224430+0000","last_became_peered":"2024-09-12T00:09:40.224430+0000","last_unstale":"2024-09-12T02:04:08.749663+0000","last_undegraded":"2024-09-12T02:04:08.749663+0000","last_fullsized":"2024-09-12T02:04:08.749663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_clean_scrub_stamp":"2024-09-12T00:09:39.068560+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.078225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":557,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:24.749088+0000","last_change":"2024-09-12T00:09:48.187085+0000","last_active":"2024-09-12T02:04:24.749088+0000","last_peered":"2024-09-12T02:04:24.749088+0000","last_clean":"2024-09-12T02:04:24.749088+0000","last_became_active":"2024-09-12T00:09:46.162330+0000","last_became_peered":"2024-09-12T00:09:46.162330+0000","last_unstale":"2024-09-12T02:04:24.749088+0000","last_undegraded":"2024-09-12T02:04:24.749088+0000","last_fullsized":"2024-09-12T02:04:24.749088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:31.598024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090615300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"266'259","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.977405+0000","last_change":"2024-09-12T00:09:59.310501+0000","last_active":"2024-09-12T02:04:33.977405+0000","last_peered":"2024-09-12T02:04:33.977405+0000","last_clean":"2024-09-12T02:04:33.977405+0000","last_became_active":"2024-09-12T00:09:59.310092+0000","last_became_peered":"2024-09-12T00:09:59.310092+0000","last_unstale":"2024-09-12T02:04:33.977405+0000","last_undegraded":"2024-09-12T02:04:33.977405+0000","last_fullsized":"2024-09-12T02:04:33.977405+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:33.851016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571160,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":432,"num_read_kb":13893,"num_write":956,"num_write_kb":29182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"37'5","reported_seq":1010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.107035+0000","last_change":"2024-09-12T00:10:03.266852+0000","last_active":"2024-09-12T02:06:44.107035+0000","last_peered":"2024-09-12T02:06:44.107035+0000","last_clean":"2024-09-12T02:06:44.107035+0000","last_became_active":"2024-09-12T00:10:03.261183+0000","last_became_peered":"2024-09-12T00:10:03.261183+0000","last_unstale":"2024-09-12T02:06:44.107035+0000","last_undegraded":"2024-09-12T02:06:44.107035+0000","last_fullsized":"2024-09-12T02:06:44.107035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:03.208998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"266'795","reported_seq":1534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.441198+0000","last_change":"2024-09-12T00:10:05.294884+0000","last_active":"2024-09-12T02:06:44.441198+0000","last_peered":"2024-09-12T02:06:44.441198+0000","last_clean":"2024-09-12T02:06:44.441198+0000","last_became_active":"2024-09-12T00:10:05.294267+0000","last_became_peered":"2024-09-12T00:10:05.294267+0000","last_unstale":"2024-09-12T02:06:44.441198+0000","last_undegraded":"2024-09-12T02:06:44.441198+0000","last_fullsized":"2024-09-12T02:06:44.441198+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:05.135490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187509,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1528,"num_read_kb":3059,"num_write":1522,"num_write_kb":1361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.720998+0000","last_change":"2024-09-12T00:10:07.324124+0000","last_active":"2024-09-12T02:02:48.720998+0000","last_peered":"2024-09-12T02:02:48.720998+0000","last_clean":"2024-09-12T02:02:48.720998+0000","last_became_active":"2024-09-12T00:10:07.323398+0000","last_became_peered":"2024-09-12T00:10:07.323398+0000","last_unstale":"2024-09-12T02:02:48.720998+0000","last_undegraded":"2024-09-12T02:02:48.720998+0000","last_fullsized":"2024-09-12T02:02:48.720998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:42.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"266'247","reported_seq":998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.733816+0000","last_change":"2024-09-12T00:10:09.374413+0000","last_active":"2024-09-12T02:04:58.733816+0000","last_peered":"2024-09-12T02:04:58.733816+0000","last_clean":"2024-09-12T02:04:58.733816+0000","last_became_active":"2024-09-12T00:10:09.373661+0000","last_became_peered":"2024-09-12T00:10:09.373661+0000","last_unstale":"2024-09-12T02:04:58.733816+0000","last_undegraded":"2024-09-12T02:04:58.733816+0000","last_fullsized":"2024-09-12T02:04:58.733816+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.718166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":498,"num_write":430,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"266'1252","reported_seq":3052,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.719612+0000","last_change":"2024-09-12T00:10:31.472451+0000","last_active":"2024-09-12T02:02:43.719612+0000","last_peered":"2024-09-12T02:02:43.719612+0000","last_clean":"2024-09-12T02:02:43.719612+0000","last_became_active":"2024-09-12T00:10:31.471885+0000","last_became_peered":"2024-09-12T00:10:31.471885+0000","last_unstale":"2024-09-12T02:02:43.719612+0000","last_undegraded":"2024-09-12T02:02:43.719612+0000","last_fullsized":"2024-09-12T02:02:43.719612+0000","mapping_epoch":38,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:24.536885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6022,"num_read_kb":5329,"num_write":1728,"num_write_kb":723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.750901+0000","last_change":"2024-09-12T00:09:48.283186+0000","last_active":"2024-09-12T02:04:13.750901+0000","last_peered":"2024-09-12T02:04:13.750901+0000","last_clean":"2024-09-12T02:04:13.750901+0000","last_became_active":"2024-09-12T00:09:46.164248+0000","last_became_peered":"2024-09-12T00:09:46.164248+0000","last_unstale":"2024-09-12T02:04:13.750901+0000","last_undegraded":"2024-09-12T02:04:13.750901+0000","last_fullsized":"2024-09-12T02:04:13.750901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:55.257275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099742600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"266'334","reported_seq":982,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.532807+0000","last_change":"2024-09-12T00:09:59.294360+0000","last_active":"2024-09-12T02:06:47.532807+0000","last_peered":"2024-09-12T02:06:47.532807+0000","last_clean":"2024-09-12T02:06:47.532807+0000","last_became_active":"2024-09-12T00:09:59.293880+0000","last_became_peered":"2024-09-12T00:09:59.293880+0000","last_unstale":"2024-09-12T02:06:47.532807+0000","last_undegraded":"2024-09-12T02:06:47.532807+0000","last_fullsized":"2024-09-12T02:06:47.532807+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:11.691652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5590248,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":16782,"num_write":1093,"num_write_kb":42263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726532+0000","last_change":"2024-09-12T00:10:03.273620+0000","last_active":"2024-09-12T02:02:44.726532+0000","last_peered":"2024-09-12T02:02:44.726532+0000","last_clean":"2024-09-12T02:02:44.726532+0000","last_became_active":"2024-09-12T00:10:03.271454+0000","last_became_peered":"2024-09-12T00:10:03.271454+0000","last_unstale":"2024-09-12T02:02:44.726532+0000","last_undegraded":"2024-09-12T02:02:44.726532+0000","last_fullsized":"2024-09-12T02:02:44.726532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:12.327352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"266'1452","reported_seq":3847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.569225+0000","last_change":"2024-09-12T00:10:05.295762+0000","last_active":"2024-09-12T02:06:47.569225+0000","last_peered":"2024-09-12T02:06:47.569225+0000","last_clean":"2024-09-12T02:06:47.569225+0000","last_became_active":"2024-09-12T00:10:05.295058+0000","last_became_peered":"2024-09-12T00:10:05.295058+0000","last_unstale":"2024-09-12T02:06:47.569225+0000","last_undegraded":"2024-09-12T02:06:47.569225+0000","last_fullsized":"2024-09-12T02:06:47.569225+0000","mapping_epoch":31,"log_start":"266'1400","ondisk_log_start":"266'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:03.236457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161189,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2280,"num_read_kb":4238,"num_write":1386,"num_write_kb":1157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.734237+0000","last_change":"2024-09-12T00:10:07.320656+0000","last_active":"2024-09-12T02:03:03.734237+0000","last_peered":"2024-09-12T02:03:03.734237+0000","last_clean":"2024-09-12T02:03:03.734237+0000","last_became_active":"2024-09-12T00:10:07.319957+0000","last_became_peered":"2024-09-12T00:10:07.319957+0000","last_unstale":"2024-09-12T02:03:03.734237+0000","last_undegraded":"2024-09-12T02:03:03.734237+0000","last_fullsized":"2024-09-12T02:03:03.734237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:05.134552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"266'86","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.689469+0000","last_change":"2024-09-12T00:10:09.431550+0000","last_active":"2024-09-12T02:03:18.689469+0000","last_peered":"2024-09-12T02:03:18.689469+0000","last_clean":"2024-09-12T02:03:18.689469+0000","last_became_active":"2024-09-12T00:10:09.430727+0000","last_became_peered":"2024-09-12T00:10:09.430727+0000","last_unstale":"2024-09-12T02:03:18.689469+0000","last_undegraded":"2024-09-12T02:03:18.689469+0000","last_fullsized":"2024-09-12T02:03:18.689469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:34.946722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"266'638","reported_seq":2418,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681419+0000","last_change":"2024-09-12T00:10:01.277654+0000","last_active":"2024-09-12T02:02:43.681419+0000","last_peered":"2024-09-12T02:02:43.681419+0000","last_clean":"2024-09-12T02:02:43.681419+0000","last_became_active":"2024-09-12T00:10:01.277302+0000","last_became_peered":"2024-09-12T00:10:01.277302+0000","last_unstale":"2024-09-12T02:02:43.681419+0000","last_undegraded":"2024-09-12T02:02:43.681419+0000","last_fullsized":"2024-09-12T02:02:43.681419+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.220111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3369,"num_read_kb":3119,"num_write":789,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":554,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.713874+0000","last_change":"2024-09-12T00:09:48.355061+0000","last_active":"2024-09-12T02:04:23.713874+0000","last_peered":"2024-09-12T02:04:23.713874+0000","last_clean":"2024-09-12T02:04:23.713874+0000","last_became_active":"2024-09-12T00:09:46.179853+0000","last_became_peered":"2024-09-12T00:09:46.179853+0000","last_unstale":"2024-09-12T02:04:23.713874+0000","last_undegraded":"2024-09-12T02:04:23.713874+0000","last_fullsized":"2024-09-12T02:04:23.713874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:34.347111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056473999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"266'337","reported_seq":1043,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.554732+0000","last_change":"2024-09-12T00:09:59.317598+0000","last_active":"2024-09-12T02:06:47.554732+0000","last_peered":"2024-09-12T02:06:47.554732+0000","last_clean":"2024-09-12T02:06:47.554732+0000","last_became_active":"2024-09-12T00:09:59.317172+0000","last_became_peered":"2024-09-12T00:09:59.317172+0000","last_unstale":"2024-09-12T02:06:47.554732+0000","last_undegraded":"2024-09-12T02:06:47.554732+0000","last_fullsized":"2024-09-12T02:06:47.554732+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:24.166492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":79957,"num_write":1084,"num_write_kb":20693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.692067+0000","last_change":"2024-09-12T00:10:03.275174+0000","last_active":"2024-09-12T02:02:43.692067+0000","last_peered":"2024-09-12T02:02:43.692067+0000","last_clean":"2024-09-12T02:02:43.692067+0000","last_became_active":"2024-09-12T00:10:03.274519+0000","last_became_peered":"2024-09-12T00:10:03.274519+0000","last_unstale":"2024-09-12T02:02:43.692067+0000","last_undegraded":"2024-09-12T02:02:43.692067+0000","last_fullsized":"2024-09-12T02:02:43.692067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:46.889133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"266'397","reported_seq":2386,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.496951+0000","last_change":"2024-09-12T00:10:05.366148+0000","last_active":"2024-09-12T02:06:03.496951+0000","last_peered":"2024-09-12T02:06:03.496951+0000","last_clean":"2024-09-12T02:06:03.496951+0000","last_became_active":"2024-09-12T00:10:05.365417+0000","last_became_peered":"2024-09-12T00:10:05.365417+0000","last_unstale":"2024-09-12T02:06:03.496951+0000","last_undegraded":"2024-09-12T02:06:03.496951+0000","last_fullsized":"2024-09-12T02:06:03.496951+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:25.902387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":388,"num_read_kb":374,"num_write":387,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.537567+0000","last_change":"2024-09-12T00:10:07.322896+0000","last_active":"2024-09-12T02:04:43.537567+0000","last_peered":"2024-09-12T02:04:43.537567+0000","last_clean":"2024-09-12T02:04:43.537567+0000","last_became_active":"2024-09-12T00:10:07.319786+0000","last_became_peered":"2024-09-12T00:10:07.319786+0000","last_unstale":"2024-09-12T02:04:43.537567+0000","last_undegraded":"2024-09-12T02:04:43.537567+0000","last_fullsized":"2024-09-12T02:04:43.537567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:38.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"266'255","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.247959+0000","last_change":"2024-09-12T00:10:09.366267+0000","last_active":"2024-09-12T02:05:00.247959+0000","last_peered":"2024-09-12T02:05:00.247959+0000","last_clean":"2024-09-12T02:05:00.247959+0000","last_became_active":"2024-09-12T00:10:09.365558+0000","last_became_peered":"2024-09-12T00:10:09.365558+0000","last_unstale":"2024-09-12T02:05:00.247959+0000","last_undegraded":"2024-09-12T02:05:00.247959+0000","last_fullsized":"2024-09-12T02:05:00.247959+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:50.920683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":520,"num_write":557,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"266'478","reported_seq":2049,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708234+0000","last_change":"2024-09-12T00:10:01.257820+0000","last_active":"2024-09-12T02:04:38.708234+0000","last_peered":"2024-09-12T02:04:38.708234+0000","last_clean":"2024-09-12T02:04:38.708234+0000","last_became_active":"2024-09-12T00:10:01.256107+0000","last_became_peered":"2024-09-12T00:10:01.256107+0000","last_unstale":"2024-09-12T02:04:38.708234+0000","last_undegraded":"2024-09-12T02:04:38.708234+0000","last_fullsized":"2024-09-12T02:04:38.708234+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:11.113107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2517,"num_read_kb":2366,"num_write":564,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:24.749016+0000","last_change":"2024-09-12T00:09:48.188360+0000","last_active":"2024-09-12T02:04:24.749016+0000","last_peered":"2024-09-12T02:04:24.749016+0000","last_clean":"2024-09-12T02:04:24.749016+0000","last_became_active":"2024-09-12T00:09:46.161046+0000","last_became_peered":"2024-09-12T00:09:46.161046+0000","last_unstale":"2024-09-12T02:04:24.749016+0000","last_undegraded":"2024-09-12T02:04:24.749016+0000","last_fullsized":"2024-09-12T02:04:24.749016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:21.375528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022130560000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"266'390","reported_seq":1045,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.409427+0000","last_change":"2024-09-12T00:10:31.474540+0000","last_active":"2024-09-12T02:06:47.409427+0000","last_peered":"2024-09-12T02:06:47.409427+0000","last_clean":"2024-09-12T02:06:47.409427+0000","last_became_active":"2024-09-12T00:10:31.473891+0000","last_became_peered":"2024-09-12T00:10:31.473891+0000","last_unstale":"2024-09-12T02:06:47.409427+0000","last_undegraded":"2024-09-12T02:06:47.409427+0000","last_fullsized":"2024-09-12T02:06:47.409427+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:20.027100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1728219,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":35036,"num_write":1225,"num_write_kb":35348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.724461+0000","last_change":"2024-09-12T00:10:03.265946+0000","last_active":"2024-09-12T02:03:03.724461+0000","last_peered":"2024-09-12T02:03:03.724461+0000","last_clean":"2024-09-12T02:03:03.724461+0000","last_became_active":"2024-09-12T00:10:03.264991+0000","last_became_peered":"2024-09-12T00:10:03.264991+0000","last_unstale":"2024-09-12T02:03:03.724461+0000","last_undegraded":"2024-09-12T02:03:03.724461+0000","last_fullsized":"2024-09-12T02:03:03.724461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:41.880299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"266'207","reported_seq":818,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.945244+0000","last_change":"2024-09-12T00:10:05.287107+0000","last_active":"2024-09-12T02:06:03.945244+0000","last_peered":"2024-09-12T02:06:03.945244+0000","last_clean":"2024-09-12T02:06:03.945244+0000","last_became_active":"2024-09-12T00:10:05.286433+0000","last_became_peered":"2024-09-12T00:10:05.286433+0000","last_unstale":"2024-09-12T02:06:03.945244+0000","last_undegraded":"2024-09-12T02:06:03.945244+0000","last_fullsized":"2024-09-12T02:06:03.945244+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:16.708268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":276,"num_read_kb":269,"num_write":202,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.705489+0000","last_change":"2024-09-12T00:10:07.331079+0000","last_active":"2024-09-12T02:02:48.705489+0000","last_peered":"2024-09-12T02:02:48.705489+0000","last_clean":"2024-09-12T02:02:48.705489+0000","last_became_active":"2024-09-12T00:10:07.329823+0000","last_became_peered":"2024-09-12T00:10:07.329823+0000","last_unstale":"2024-09-12T02:02:48.705489+0000","last_undegraded":"2024-09-12T02:02:48.705489+0000","last_fullsized":"2024-09-12T02:02:48.705489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.018430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"266'101","reported_seq":681,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.757399+0000","last_change":"2024-09-12T00:10:09.368892+0000","last_active":"2024-09-12T02:04:59.757399+0000","last_peered":"2024-09-12T02:04:59.757399+0000","last_clean":"2024-09-12T02:04:59.757399+0000","last_became_active":"2024-09-12T00:10:09.368176+0000","last_became_peered":"2024-09-12T00:10:09.368176+0000","last_unstale":"2024-09-12T02:04:59.757399+0000","last_undegraded":"2024-09-12T02:04:59.757399+0000","last_fullsized":"2024-09-12T02:04:59.757399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:23.692773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":222,"num_read_kb":212,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"266'444","reported_seq":2071,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708133+0000","last_change":"2024-09-12T00:10:01.276074+0000","last_active":"2024-09-12T02:04:38.708133+0000","last_peered":"2024-09-12T02:04:38.708133+0000","last_clean":"2024-09-12T02:04:38.708133+0000","last_became_active":"2024-09-12T00:10:01.275794+0000","last_became_peered":"2024-09-12T00:10:01.275794+0000","last_unstale":"2024-09-12T02:04:38.708133+0000","last_undegraded":"2024-09-12T02:04:38.708133+0000","last_fullsized":"2024-09-12T02:04:38.708133+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:44.490041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":509,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"266'295","reported_seq":1000,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.663615+0000","last_change":"2024-09-12T00:09:59.264987+0000","last_active":"2024-09-12T02:06:44.663615+0000","last_peered":"2024-09-12T02:06:44.663615+0000","last_clean":"2024-09-12T02:06:44.663615+0000","last_became_active":"2024-09-12T00:09:59.262793+0000","last_became_peered":"2024-09-12T00:09:59.262793+0000","last_unstale":"2024-09-12T02:06:44.663615+0000","last_undegraded":"2024-09-12T02:06:44.663615+0000","last_fullsized":"2024-09-12T02:06:44.663615+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:14.855206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9586267,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":496,"num_read_kb":23140,"num_write":1070,"num_write_kb":26459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":552,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.704660+0000","last_change":"2024-09-12T00:09:48.193791+0000","last_active":"2024-09-12T02:04:23.704660+0000","last_peered":"2024-09-12T02:04:23.704660+0000","last_clean":"2024-09-12T02:04:23.704660+0000","last_became_active":"2024-09-12T00:09:46.178541+0000","last_became_peered":"2024-09-12T00:09:46.178541+0000","last_unstale":"2024-09-12T02:04:23.704660+0000","last_undegraded":"2024-09-12T02:04:23.704660+0000","last_fullsized":"2024-09-12T02:04:23.704660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:55.733179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00107328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536250+0000","last_change":"2024-09-12T00:10:03.258979+0000","last_active":"2024-09-12T02:04:38.536250+0000","last_peered":"2024-09-12T02:04:38.536250+0000","last_clean":"2024-09-12T02:04:38.536250+0000","last_became_active":"2024-09-12T00:10:03.258209+0000","last_became_peered":"2024-09-12T00:10:03.258209+0000","last_unstale":"2024-09-12T02:04:38.536250+0000","last_undegraded":"2024-09-12T02:04:38.536250+0000","last_fullsized":"2024-09-12T02:04:38.536250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:09.760649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"266'731","reported_seq":1480,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.734931+0000","last_change":"2024-09-12T00:10:05.292028+0000","last_active":"2024-09-12T02:06:46.734931+0000","last_peered":"2024-09-12T02:06:46.734931+0000","last_clean":"2024-09-12T02:06:46.734931+0000","last_became_active":"2024-09-12T00:10:05.289058+0000","last_became_peered":"2024-09-12T00:10:05.289058+0000","last_unstale":"2024-09-12T02:06:46.734931+0000","last_undegraded":"2024-09-12T02:06:46.734931+0000","last_fullsized":"2024-09-12T02:06:46.734931+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:22.158935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92166,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1168,"num_read_kb":2300,"num_write":1050,"num_write_kb":783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.762388+0000","last_change":"2024-09-12T00:10:07.327012+0000","last_active":"2024-09-12T02:04:43.762388+0000","last_peered":"2024-09-12T02:04:43.762388+0000","last_clean":"2024-09-12T02:04:43.762388+0000","last_became_active":"2024-09-12T00:10:07.326146+0000","last_became_peered":"2024-09-12T00:10:07.326146+0000","last_unstale":"2024-09-12T02:04:43.762388+0000","last_undegraded":"2024-09-12T02:04:43.762388+0000","last_fullsized":"2024-09-12T02:04:43.762388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:31.757093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"266'134","reported_seq":658,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.013228+0000","last_change":"2024-09-12T00:10:09.434271+0000","last_active":"2024-09-12T02:04:59.013228+0000","last_peered":"2024-09-12T02:04:59.013228+0000","last_clean":"2024-09-12T02:04:59.013228+0000","last_became_active":"2024-09-12T00:10:09.433444+0000","last_became_peered":"2024-09-12T00:10:09.433444+0000","last_unstale":"2024-09-12T02:04:59.013228+0000","last_undegraded":"2024-09-12T02:04:59.013228+0000","last_fullsized":"2024-09-12T02:04:59.013228+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:56.732745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"266'402","reported_seq":1906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536207+0000","last_change":"2024-09-12T00:10:01.282757+0000","last_active":"2024-09-12T02:04:38.536207+0000","last_peered":"2024-09-12T02:04:38.536207+0000","last_clean":"2024-09-12T02:04:38.536207+0000","last_became_active":"2024-09-12T00:10:01.282373+0000","last_became_peered":"2024-09-12T00:10:01.282373+0000","last_unstale":"2024-09-12T02:04:38.536207+0000","last_undegraded":"2024-09-12T02:04:38.536207+0000","last_fullsized":"2024-09-12T02:04:38.536207+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:40.586380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2068,"num_read_kb":1970,"num_write":460,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"266'417","reported_seq":1197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.490091+0000","last_change":"2024-09-12T00:09:59.251699+0000","last_active":"2024-09-12T02:06:47.490091+0000","last_peered":"2024-09-12T02:06:47.490091+0000","last_clean":"2024-09-12T02:06:47.490091+0000","last_became_active":"2024-09-12T00:09:59.251235+0000","last_became_peered":"2024-09-12T00:09:59.251235+0000","last_unstale":"2024-09-12T02:06:47.490091+0000","last_undegraded":"2024-09-12T02:06:47.490091+0000","last_fullsized":"2024-09-12T02:06:47.490091+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:43.287785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":866,"num_read_kb":78676,"num_write":1275,"num_write_kb":36022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":549,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.729609+0000","last_change":"2024-09-12T00:09:48.283460+0000","last_active":"2024-09-12T02:02:43.729609+0000","last_peered":"2024-09-12T02:02:43.729609+0000","last_clean":"2024-09-12T02:02:43.729609+0000","last_became_active":"2024-09-12T00:09:46.177603+0000","last_became_peered":"2024-09-12T00:09:46.177603+0000","last_unstale":"2024-09-12T02:02:43.729609+0000","last_undegraded":"2024-09-12T02:02:43.729609+0000","last_fullsized":"2024-09-12T02:02:43.729609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:26.898658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729177+0000","last_change":"2024-09-12T00:10:03.259727+0000","last_active":"2024-09-12T02:04:38.729177+0000","last_peered":"2024-09-12T02:04:38.729177+0000","last_clean":"2024-09-12T02:04:38.729177+0000","last_became_active":"2024-09-12T00:10:03.258944+0000","last_became_peered":"2024-09-12T00:10:03.258944+0000","last_unstale":"2024-09-12T02:04:38.729177+0000","last_undegraded":"2024-09-12T02:04:38.729177+0000","last_fullsized":"2024-09-12T02:04:38.729177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:58.686752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"266'257","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709373+0000","last_change":"2024-09-12T00:10:05.367281+0000","last_active":"2024-09-12T02:04:43.709373+0000","last_peered":"2024-09-12T02:04:43.709373+0000","last_clean":"2024-09-12T02:04:43.709373+0000","last_became_active":"2024-09-12T00:10:05.366757+0000","last_became_peered":"2024-09-12T00:10:05.366757+0000","last_unstale":"2024-09-12T02:04:43.709373+0000","last_undegraded":"2024-09-12T02:04:43.709373+0000","last_fullsized":"2024-09-12T02:04:43.709373+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:45.057953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":341,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"266'824","reported_seq":5672,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.363176+0000","last_change":"2024-09-12T00:10:07.314520+0000","last_active":"2024-09-12T02:06:44.363176+0000","last_peered":"2024-09-12T02:06:44.363176+0000","last_clean":"2024-09-12T02:06:44.363176+0000","last_became_active":"2024-09-12T00:10:07.313773+0000","last_became_peered":"2024-09-12T00:10:07.313773+0000","last_unstale":"2024-09-12T02:06:44.363176+0000","last_undegraded":"2024-09-12T02:06:44.363176+0000","last_fullsized":"2024-09-12T02:06:44.363176+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:32.654308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"266'129","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.986570+0000","last_change":"2024-09-12T00:10:09.431402+0000","last_active":"2024-09-12T02:05:08.986570+0000","last_peered":"2024-09-12T02:05:08.986570+0000","last_clean":"2024-09-12T02:05:08.986570+0000","last_became_active":"2024-09-12T00:10:09.430396+0000","last_became_peered":"2024-09-12T00:10:09.430396+0000","last_unstale":"2024-09-12T02:05:08.986570+0000","last_undegraded":"2024-09-12T02:05:08.986570+0000","last_fullsized":"2024-09-12T02:05:08.986570+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:54.666346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"266'481","reported_seq":2194,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.725448+0000","last_change":"2024-09-12T00:10:01.261429+0000","last_active":"2024-09-12T02:04:59.725448+0000","last_peered":"2024-09-12T02:04:59.725448+0000","last_clean":"2024-09-12T02:04:59.725448+0000","last_became_active":"2024-09-12T00:10:01.261139+0000","last_became_peered":"2024-09-12T00:10:01.261139+0000","last_unstale":"2024-09-12T02:04:59.725448+0000","last_undegraded":"2024-09-12T02:04:59.725448+0000","last_fullsized":"2024-09-12T02:04:59.725448+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:23.775837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2740,"num_read_kb":2607,"num_write":578,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"266'330","reported_seq":1138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.946409+0000","last_change":"2024-09-12T00:09:59.280417+0000","last_active":"2024-09-12T02:02:38.946409+0000","last_peered":"2024-09-12T02:02:38.946409+0000","last_clean":"2024-09-12T02:02:38.946409+0000","last_became_active":"2024-09-12T00:09:59.280008+0000","last_became_peered":"2024-09-12T00:09:59.280008+0000","last_unstale":"2024-09-12T02:02:38.946409+0000","last_undegraded":"2024-09-12T02:02:38.946409+0000","last_fullsized":"2024-09-12T02:02:38.946409+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:21.353806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3246317,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":636,"num_read_kb":14006,"num_write":1222,"num_write_kb":38960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":550,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708281+0000","last_change":"2024-09-12T00:09:48.193796+0000","last_active":"2024-09-12T02:04:38.708281+0000","last_peered":"2024-09-12T02:04:38.708281+0000","last_clean":"2024-09-12T02:04:38.708281+0000","last_became_active":"2024-09-12T00:09:46.162309+0000","last_became_peered":"2024-09-12T00:09:46.162309+0000","last_unstale":"2024-09-12T02:04:38.708281+0000","last_undegraded":"2024-09-12T02:04:38.708281+0000","last_fullsized":"2024-09-12T02:04:38.708281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:57.198136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010860449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.761245+0000","last_change":"2024-09-12T00:10:03.257249+0000","last_active":"2024-09-12T02:04:38.761245+0000","last_peered":"2024-09-12T02:04:38.761245+0000","last_clean":"2024-09-12T02:04:38.761245+0000","last_became_active":"2024-09-12T00:10:03.256290+0000","last_became_peered":"2024-09-12T00:10:03.256290+0000","last_unstale":"2024-09-12T02:04:38.761245+0000","last_undegraded":"2024-09-12T02:04:38.761245+0000","last_fullsized":"2024-09-12T02:04:38.761245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:00.212778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"266'177","reported_seq":785,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.762472+0000","last_change":"2024-09-12T00:10:05.294735+0000","last_active":"2024-09-12T02:04:43.762472+0000","last_peered":"2024-09-12T02:04:43.762472+0000","last_clean":"2024-09-12T02:04:43.762472+0000","last_became_active":"2024-09-12T00:10:05.293955+0000","last_became_peered":"2024-09-12T00:10:05.293955+0000","last_unstale":"2024-09-12T02:04:43.762472+0000","last_undegraded":"2024-09-12T02:04:43.762472+0000","last_fullsized":"2024-09-12T02:04:43.762472+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:54.115604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":227,"num_write":154,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"266'822","reported_seq":5152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.370514+0000","last_change":"2024-09-12T00:10:07.334366+0000","last_active":"2024-09-12T02:06:10.370514+0000","last_peered":"2024-09-12T02:06:10.370514+0000","last_clean":"2024-09-12T02:06:10.370514+0000","last_became_active":"2024-09-12T00:10:07.333642+0000","last_became_peered":"2024-09-12T00:10:07.333642+0000","last_unstale":"2024-09-12T02:06:10.370514+0000","last_undegraded":"2024-09-12T02:06:10.370514+0000","last_fullsized":"2024-09-12T02:06:10.370514+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:25.710728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"266'301","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718365+0000","last_change":"2024-09-12T00:10:09.359415+0000","last_active":"2024-09-12T02:02:38.718365+0000","last_peered":"2024-09-12T02:02:38.718365+0000","last_clean":"2024-09-12T02:02:38.718365+0000","last_became_active":"2024-09-12T00:10:09.358708+0000","last_became_peered":"2024-09-12T00:10:09.358708+0000","last_unstale":"2024-09-12T02:02:38.718365+0000","last_undegraded":"2024-09-12T02:02:38.718365+0000","last_fullsized":"2024-09-12T02:02:38.718365+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:01.334064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":399,"num_read_kb":387,"num_write":681,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"266'1115","reported_seq":2647,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.761286+0000","last_change":"2024-09-12T00:10:01.274977+0000","last_active":"2024-09-12T02:04:38.761286+0000","last_peered":"2024-09-12T02:04:38.761286+0000","last_clean":"2024-09-12T02:04:38.761286+0000","last_became_active":"2024-09-12T00:10:01.274310+0000","last_became_peered":"2024-09-12T00:10:01.274310+0000","last_unstale":"2024-09-12T02:04:38.761286+0000","last_undegraded":"2024-09-12T02:04:38.761286+0000","last_fullsized":"2024-09-12T02:04:38.761286+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:46.070135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5066,"num_read_kb":4471,"num_write":1537,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"266'372","reported_seq":1068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.471298+0000","last_change":"2024-09-12T00:09:59.291971+0000","last_active":"2024-09-12T02:06:47.471298+0000","last_peered":"2024-09-12T02:06:47.471298+0000","last_clean":"2024-09-12T02:06:47.471298+0000","last_became_active":"2024-09-12T00:09:59.291630+0000","last_became_peered":"2024-09-12T00:09:59.291630+0000","last_unstale":"2024-09-12T02:06:47.471298+0000","last_undegraded":"2024-09-12T02:06:47.471298+0000","last_fullsized":"2024-09-12T02:06:47.471298+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:38.513416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306724,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":13946,"num_write":1174,"num_write_kb":43869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":553,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729253+0000","last_change":"2024-09-12T00:09:48.181937+0000","last_active":"2024-09-12T02:04:38.729253+0000","last_peered":"2024-09-12T02:04:38.729253+0000","last_clean":"2024-09-12T02:04:38.729253+0000","last_became_active":"2024-09-12T00:09:46.163643+0000","last_became_peered":"2024-09-12T00:09:46.163643+0000","last_unstale":"2024-09-12T02:04:38.729253+0000","last_undegraded":"2024-09-12T02:04:38.729253+0000","last_fullsized":"2024-09-12T02:04:38.729253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:23.976934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095304600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.973403+0000","last_change":"2024-09-12T00:10:03.265795+0000","last_active":"2024-09-12T02:04:18.973403+0000","last_peered":"2024-09-12T02:04:18.973403+0000","last_clean":"2024-09-12T02:04:18.973403+0000","last_became_active":"2024-09-12T00:10:03.265087+0000","last_became_peered":"2024-09-12T00:10:03.265087+0000","last_unstale":"2024-09-12T02:04:18.973403+0000","last_undegraded":"2024-09-12T02:04:18.973403+0000","last_fullsized":"2024-09-12T02:04:18.973403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:19.906488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"266'829","reported_seq":1619,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.017176+0000","last_change":"2024-09-12T00:10:05.362216+0000","last_active":"2024-09-12T02:06:47.017176+0000","last_peered":"2024-09-12T02:06:47.017176+0000","last_clean":"2024-09-12T02:06:47.017176+0000","last_became_active":"2024-09-12T00:10:05.361458+0000","last_became_peered":"2024-09-12T00:10:05.361458+0000","last_unstale":"2024-09-12T02:06:47.017176+0000","last_undegraded":"2024-09-12T02:06:47.017176+0000","last_fullsized":"2024-09-12T02:06:47.017176+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:05.415919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1463,"num_read_kb":3339,"num_write":1180,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.946113+0000","last_change":"2024-09-12T00:10:07.341062+0000","last_active":"2024-09-12T02:02:38.946113+0000","last_peered":"2024-09-12T02:02:38.946113+0000","last_clean":"2024-09-12T02:02:38.946113+0000","last_became_active":"2024-09-12T00:10:07.333984+0000","last_became_peered":"2024-09-12T00:10:07.333984+0000","last_unstale":"2024-09-12T02:02:38.946113+0000","last_undegraded":"2024-09-12T02:02:38.946113+0000","last_fullsized":"2024-09-12T02:02:38.946113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:04.270793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"266'123","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725287+0000","last_change":"2024-09-12T00:10:09.369672+0000","last_active":"2024-09-12T02:02:39.725287+0000","last_peered":"2024-09-12T02:02:39.725287+0000","last_clean":"2024-09-12T02:02:39.725287+0000","last_became_active":"2024-09-12T00:10:09.368289+0000","last_became_peered":"2024-09-12T00:10:09.368289+0000","last_unstale":"2024-09-12T02:02:39.725287+0000","last_undegraded":"2024-09-12T02:02:39.725287+0000","last_fullsized":"2024-09-12T02:02:39.725287+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:07.697855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"266'155","reported_seq":743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.414654+0000","last_change":"2024-09-12T00:10:09.373153+0000","last_active":"2024-09-12T02:05:00.414654+0000","last_peered":"2024-09-12T02:05:00.414654+0000","last_clean":"2024-09-12T02:05:00.414654+0000","last_became_active":"2024-09-12T00:10:09.372467+0000","last_became_peered":"2024-09-12T00:10:09.372467+0000","last_unstale":"2024-09-12T02:05:00.414654+0000","last_undegraded":"2024-09-12T02:05:00.414654+0000","last_fullsized":"2024-09-12T02:05:00.414654+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:35.985971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":220,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"266'886","reported_seq":2695,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.724639+0000","last_change":"2024-09-12T00:10:01.267707+0000","last_active":"2024-09-12T02:06:05.724639+0000","last_peered":"2024-09-12T02:06:05.724639+0000","last_clean":"2024-09-12T02:06:05.724639+0000","last_became_active":"2024-09-12T00:10:01.266479+0000","last_became_peered":"2024-09-12T00:10:01.266479+0000","last_unstale":"2024-09-12T02:06:05.724639+0000","last_undegraded":"2024-09-12T02:06:05.724639+0000","last_fullsized":"2024-09-12T02:06:05.724639+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:27.980168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4439,"num_read_kb":4016,"num_write":1172,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"266'328","reported_seq":1068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.526748+0000","last_change":"2024-09-12T00:09:59.311766+0000","last_active":"2024-09-12T02:06:47.526748+0000","last_peered":"2024-09-12T02:06:47.526748+0000","last_clean":"2024-09-12T02:06:47.526748+0000","last_became_active":"2024-09-12T00:09:59.309979+0000","last_became_peered":"2024-09-12T00:09:59.309979+0000","last_unstale":"2024-09-12T02:06:47.526748+0000","last_undegraded":"2024-09-12T02:06:47.526748+0000","last_fullsized":"2024-09-12T02:06:47.526748+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:48.006276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":761,"num_read_kb":10875,"num_write":997,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.704615+0000","last_change":"2024-09-12T00:10:03.273557+0000","last_active":"2024-09-12T02:04:23.704615+0000","last_peered":"2024-09-12T02:04:23.704615+0000","last_clean":"2024-09-12T02:04:23.704615+0000","last_became_active":"2024-09-12T00:10:03.272547+0000","last_became_peered":"2024-09-12T00:10:03.272547+0000","last_unstale":"2024-09-12T02:04:23.704615+0000","last_undegraded":"2024-09-12T02:04:23.704615+0000","last_fullsized":"2024-09-12T02:04:23.704615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:14.979796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"266'327","reported_seq":957,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976224+0000","last_change":"2024-09-12T00:10:05.293284+0000","last_active":"2024-09-12T02:04:28.976224+0000","last_peered":"2024-09-12T02:04:28.976224+0000","last_clean":"2024-09-12T02:04:28.976224+0000","last_became_active":"2024-09-12T00:10:05.292446+0000","last_became_peered":"2024-09-12T00:10:05.292446+0000","last_unstale":"2024-09-12T02:04:28.976224+0000","last_undegraded":"2024-09-12T02:04:28.976224+0000","last_fullsized":"2024-09-12T02:04:28.976224+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49680,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":506,"num_read_kb":930,"num_write":396,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:08.938223+0000","last_change":"2024-09-12T00:10:07.339677+0000","last_active":"2024-09-12T02:02:08.938223+0000","last_peered":"2024-09-12T02:02:08.938223+0000","last_clean":"2024-09-12T02:02:08.938223+0000","last_became_active":"2024-09-12T00:10:07.335659+0000","last_became_peered":"2024-09-12T00:10:07.335659+0000","last_unstale":"2024-09-12T02:02:08.938223+0000","last_undegraded":"2024-09-12T02:02:08.938223+0000","last_fullsized":"2024-09-12T02:02:08.938223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:04.120142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"266'115","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.231862+0000","last_change":"2024-09-12T00:10:09.357232+0000","last_active":"2024-09-12T02:05:00.231862+0000","last_peered":"2024-09-12T02:05:00.231862+0000","last_clean":"2024-09-12T02:05:00.231862+0000","last_became_active":"2024-09-12T00:10:09.356043+0000","last_became_peered":"2024-09-12T00:10:09.356043+0000","last_unstale":"2024-09-12T02:05:00.231862+0000","last_undegraded":"2024-09-12T02:05:00.231862+0000","last_fullsized":"2024-09-12T02:05:00.231862+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:08.121957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":102,"num_write":274,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"266'481","reported_seq":2035,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.932083+0000","last_change":"2024-09-12T00:10:01.265349+0000","last_active":"2024-09-12T02:04:59.932083+0000","last_peered":"2024-09-12T02:04:59.932083+0000","last_clean":"2024-09-12T02:04:59.932083+0000","last_became_active":"2024-09-12T00:10:01.264977+0000","last_became_peered":"2024-09-12T00:10:01.264977+0000","last_unstale":"2024-09-12T02:04:59.932083+0000","last_undegraded":"2024-09-12T02:04:59.932083+0000","last_fullsized":"2024-09-12T02:04:59.932083+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2306,"num_write":570,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"266'380","reported_seq":1015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.464304+0000","last_change":"2024-09-12T00:09:59.300779+0000","last_active":"2024-09-12T02:06:47.464304+0000","last_peered":"2024-09-12T02:06:47.464304+0000","last_clean":"2024-09-12T02:06:47.464304+0000","last_became_active":"2024-09-12T00:09:59.300181+0000","last_became_peered":"2024-09-12T00:09:59.300181+0000","last_unstale":"2024-09-12T02:06:47.464304+0000","last_undegraded":"2024-09-12T02:06:47.464304+0000","last_fullsized":"2024-09-12T02:06:47.464304+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:30.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":10768,"num_write":1216,"num_write_kb":35109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.975027+0000","last_change":"2024-09-12T00:10:03.256755+0000","last_active":"2024-09-12T02:04:23.975027+0000","last_peered":"2024-09-12T02:04:23.975027+0000","last_clean":"2024-09-12T02:04:23.975027+0000","last_became_active":"2024-09-12T00:10:03.256053+0000","last_became_peered":"2024-09-12T00:10:03.256053+0000","last_unstale":"2024-09-12T02:04:23.975027+0000","last_undegraded":"2024-09-12T02:04:23.975027+0000","last_fullsized":"2024-09-12T02:04:23.975027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:53.915837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"266'74","reported_seq":615,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.954859+0000","last_change":"2024-09-12T00:10:05.289328+0000","last_active":"2024-09-12T02:04:59.954859+0000","last_peered":"2024-09-12T02:04:59.954859+0000","last_clean":"2024-09-12T02:04:59.954859+0000","last_became_active":"2024-09-12T00:10:05.288688+0000","last_became_peered":"2024-09-12T00:10:05.288688+0000","last_unstale":"2024-09-12T02:04:59.954859+0000","last_undegraded":"2024-09-12T02:04:59.954859+0000","last_fullsized":"2024-09-12T02:04:59.954859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.509523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.754653+0000","last_change":"2024-09-12T00:10:07.321379+0000","last_active":"2024-09-12T02:04:28.754653+0000","last_peered":"2024-09-12T02:04:28.754653+0000","last_clean":"2024-09-12T02:04:28.754653+0000","last_became_active":"2024-09-12T00:10:07.320729+0000","last_became_peered":"2024-09-12T00:10:07.320729+0000","last_unstale":"2024-09-12T02:04:28.754653+0000","last_undegraded":"2024-09-12T02:04:28.754653+0000","last_fullsized":"2024-09-12T02:04:28.754653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:20.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"266'204","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.570680+0000","last_change":"2024-09-12T00:10:09.362996+0000","last_active":"2024-09-12T02:04:57.570680+0000","last_peered":"2024-09-12T02:04:57.570680+0000","last_clean":"2024-09-12T02:04:57.570680+0000","last_became_active":"2024-09-12T00:10:09.362096+0000","last_became_peered":"2024-09-12T00:10:09.362096+0000","last_unstale":"2024-09-12T02:04:57.570680+0000","last_undegraded":"2024-09-12T02:04:57.570680+0000","last_fullsized":"2024-09-12T02:04:57.570680+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:36.489316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":296,"num_read_kb":291,"num_write":467,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"266'430","reported_seq":2143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.720489+0000","last_change":"2024-09-12T00:10:01.261417+0000","last_active":"2024-09-12T02:06:05.720489+0000","last_peered":"2024-09-12T02:06:05.720489+0000","last_clean":"2024-09-12T02:06:05.720489+0000","last_became_active":"2024-09-12T00:10:01.261030+0000","last_became_peered":"2024-09-12T00:10:01.261030+0000","last_unstale":"2024-09-12T02:06:05.720489+0000","last_undegraded":"2024-09-12T02:06:05.720489+0000","last_fullsized":"2024-09-12T02:06:05.720489+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:45.394167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2550,"num_read_kb":2440,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"266'313","reported_seq":1007,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.749735+0000","last_change":"2024-09-12T00:09:59.288987+0000","last_active":"2024-09-12T02:06:44.749735+0000","last_peered":"2024-09-12T02:06:44.749735+0000","last_clean":"2024-09-12T02:06:44.749735+0000","last_became_active":"2024-09-12T00:09:59.288100+0000","last_became_peered":"2024-09-12T00:09:59.288100+0000","last_unstale":"2024-09-12T02:06:44.749735+0000","last_undegraded":"2024-09-12T02:06:44.749735+0000","last_fullsized":"2024-09-12T02:06:44.749735+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:51.350979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9466169,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":528,"num_read_kb":15869,"num_write":1106,"num_write_kb":23659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753274+0000","last_change":"2024-09-12T00:10:03.257101+0000","last_active":"2024-09-12T02:04:23.753274+0000","last_peered":"2024-09-12T02:04:23.753274+0000","last_clean":"2024-09-12T02:04:23.753274+0000","last_became_active":"2024-09-12T00:10:03.255669+0000","last_became_peered":"2024-09-12T00:10:03.255669+0000","last_unstale":"2024-09-12T02:04:23.753274+0000","last_undegraded":"2024-09-12T02:04:23.753274+0000","last_fullsized":"2024-09-12T02:04:23.753274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:32.002572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"266'340","reported_seq":980,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976323+0000","last_change":"2024-09-12T00:10:05.300654+0000","last_active":"2024-09-12T02:04:28.976323+0000","last_peered":"2024-09-12T02:04:28.976323+0000","last_clean":"2024-09-12T02:04:28.976323+0000","last_became_active":"2024-09-12T00:10:05.299730+0000","last_became_peered":"2024-09-12T00:10:05.299730+0000","last_unstale":"2024-09-12T02:04:28.976323+0000","last_undegraded":"2024-09-12T02:04:28.976323+0000","last_fullsized":"2024-09-12T02:04:28.976323+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:30.946739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":1010,"num_write":422,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.727089+0000","last_change":"2024-09-12T00:10:07.330541+0000","last_active":"2024-09-12T02:04:28.727089+0000","last_peered":"2024-09-12T02:04:28.727089+0000","last_clean":"2024-09-12T02:04:28.727089+0000","last_became_active":"2024-09-12T00:10:07.329741+0000","last_became_peered":"2024-09-12T00:10:07.329741+0000","last_unstale":"2024-09-12T02:04:28.727089+0000","last_undegraded":"2024-09-12T02:04:28.727089+0000","last_fullsized":"2024-09-12T02:04:28.727089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:23.412449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"266'89","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725178+0000","last_change":"2024-09-12T00:10:09.372894+0000","last_active":"2024-09-12T02:02:39.725178+0000","last_peered":"2024-09-12T02:02:39.725178+0000","last_clean":"2024-09-12T02:02:39.725178+0000","last_became_active":"2024-09-12T00:10:09.371755+0000","last_became_peered":"2024-09-12T00:10:09.371755+0000","last_unstale":"2024-09-12T02:02:39.725178+0000","last_undegraded":"2024-09-12T02:02:39.725178+0000","last_fullsized":"2024-09-12T02:02:39.725178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:18.332494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":213,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"266'805","reported_seq":2435,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974707+0000","last_change":"2024-09-12T00:10:01.259175+0000","last_active":"2024-09-12T02:04:23.974707+0000","last_peered":"2024-09-12T02:04:23.974707+0000","last_clean":"2024-09-12T02:04:23.974707+0000","last_became_active":"2024-09-12T00:10:01.258814+0000","last_became_peered":"2024-09-12T00:10:01.258814+0000","last_unstale":"2024-09-12T02:04:23.974707+0000","last_undegraded":"2024-09-12T02:04:23.974707+0000","last_fullsized":"2024-09-12T02:04:23.974707+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:34.228716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3906,"num_read_kb":3532,"num_write":1046,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"266'415","reported_seq":1079,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.547826+0000","last_change":"2024-09-12T00:09:59.263146+0000","last_active":"2024-09-12T02:06:47.547826+0000","last_peered":"2024-09-12T02:06:47.547826+0000","last_clean":"2024-09-12T02:06:47.547826+0000","last_became_active":"2024-09-12T00:09:59.262775+0000","last_became_peered":"2024-09-12T00:09:59.262775+0000","last_unstale":"2024-09-12T02:06:47.547826+0000","last_undegraded":"2024-09-12T02:06:47.547826+0000","last_fullsized":"2024-09-12T02:06:47.547826+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:27.798550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":557,"num_read_kb":527,"num_write":1329,"num_write_kb":18885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.725899+0000","last_change":"2024-09-12T00:10:03.258677+0000","last_active":"2024-09-12T02:04:23.725899+0000","last_peered":"2024-09-12T02:04:23.725899+0000","last_clean":"2024-09-12T02:04:23.725899+0000","last_became_active":"2024-09-12T00:10:03.257953+0000","last_became_peered":"2024-09-12T00:10:03.257953+0000","last_unstale":"2024-09-12T02:04:23.725899+0000","last_undegraded":"2024-09-12T02:04:23.725899+0000","last_fullsized":"2024-09-12T02:04:23.725899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:23.465779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"266'327","reported_seq":941,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.290038+0000","last_change":"2024-09-12T00:10:05.286232+0000","last_active":"2024-09-12T02:06:46.290038+0000","last_peered":"2024-09-12T02:06:46.290038+0000","last_clean":"2024-09-12T02:06:46.290038+0000","last_became_active":"2024-09-12T00:10:05.285485+0000","last_became_peered":"2024-09-12T00:10:05.285485+0000","last_unstale":"2024-09-12T02:06:46.290038+0000","last_undegraded":"2024-09-12T02:06:46.290038+0000","last_fullsized":"2024-09-12T02:06:46.290038+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:50.842485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":1250,"num_write":446,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.533657+0000","last_change":"2024-09-12T00:10:07.326257+0000","last_active":"2024-09-12T02:04:28.533657+0000","last_peered":"2024-09-12T02:04:28.533657+0000","last_clean":"2024-09-12T02:04:28.533657+0000","last_became_active":"2024-09-12T00:10:07.325482+0000","last_became_peered":"2024-09-12T00:10:07.325482+0000","last_unstale":"2024-09-12T02:04:28.533657+0000","last_undegraded":"2024-09-12T02:04:28.533657+0000","last_fullsized":"2024-09-12T02:04:28.533657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:27.852281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"266'839","reported_seq":2400,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729315+0000","last_change":"2024-09-12T00:10:01.277544+0000","last_active":"2024-09-12T02:04:38.729315+0000","last_peered":"2024-09-12T02:04:38.729315+0000","last_clean":"2024-09-12T02:04:38.729315+0000","last_became_active":"2024-09-12T00:10:01.276906+0000","last_became_peered":"2024-09-12T00:10:01.276906+0000","last_unstale":"2024-09-12T02:04:38.729315+0000","last_undegraded":"2024-09-12T02:04:38.729315+0000","last_fullsized":"2024-09-12T02:04:38.729315+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:55.926406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3919,"num_read_kb":3507,"num_write":1092,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"266'264","reported_seq":938,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:59.606810+0000","last_change":"2024-09-12T00:09:59.249092+0000","last_active":"2024-09-12T02:05:59.606810+0000","last_peered":"2024-09-12T02:05:59.606810+0000","last_clean":"2024-09-12T02:05:59.606810+0000","last_became_active":"2024-09-12T00:09:59.248681+0000","last_became_peered":"2024-09-12T00:09:59.248681+0000","last_unstale":"2024-09-12T02:05:59.606810+0000","last_undegraded":"2024-09-12T02:05:59.606810+0000","last_fullsized":"2024-09-12T02:05:59.606810+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:44.662803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11196370,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":444,"num_read_kb":23742,"num_write":1054,"num_write_kb":29955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536376+0000","last_change":"2024-09-12T00:10:03.261107+0000","last_active":"2024-09-12T02:04:38.536376+0000","last_peered":"2024-09-12T02:04:38.536376+0000","last_clean":"2024-09-12T02:04:38.536376+0000","last_became_active":"2024-09-12T00:10:03.260387+0000","last_became_peered":"2024-09-12T00:10:03.260387+0000","last_unstale":"2024-09-12T02:04:38.536376+0000","last_undegraded":"2024-09-12T02:04:38.536376+0000","last_fullsized":"2024-09-12T02:04:38.536376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:53.966697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"266'542","reported_seq":1220,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.173354+0000","last_change":"2024-09-12T00:10:05.301383+0000","last_active":"2024-09-12T02:06:46.173354+0000","last_peered":"2024-09-12T02:06:46.173354+0000","last_clean":"2024-09-12T02:06:46.173354+0000","last_became_active":"2024-09-12T00:10:05.300613+0000","last_became_peered":"2024-09-12T00:10:05.300613+0000","last_unstale":"2024-09-12T02:06:46.173354+0000","last_undegraded":"2024-09-12T02:06:46.173354+0000","last_fullsized":"2024-09-12T02:06:46.173354+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:48.609813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102448,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":959,"num_read_kb":2206,"num_write":818,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725243+0000","last_change":"2024-09-12T00:10:07.343479+0000","last_active":"2024-09-12T02:02:39.725243+0000","last_peered":"2024-09-12T02:02:39.725243+0000","last_clean":"2024-09-12T02:02:39.725243+0000","last_became_active":"2024-09-12T00:10:07.342700+0000","last_became_peered":"2024-09-12T00:10:07.342700+0000","last_unstale":"2024-09-12T02:02:39.725243+0000","last_undegraded":"2024-09-12T02:02:39.725243+0000","last_fullsized":"2024-09-12T02:02:39.725243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:29.670776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"266'157","reported_seq":687,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:08.938400+0000","last_change":"2024-09-12T00:10:09.436544+0000","last_active":"2024-09-12T02:02:08.938400+0000","last_peered":"2024-09-12T02:02:08.938400+0000","last_clean":"2024-09-12T02:02:08.938400+0000","last_became_active":"2024-09-12T00:10:09.435513+0000","last_became_peered":"2024-09-12T00:10:09.435513+0000","last_unstale":"2024-09-12T02:02:08.938400+0000","last_undegraded":"2024-09-12T02:02:08.938400+0000","last_fullsized":"2024-09-12T02:02:08.938400+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:42.230555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":193,"num_write":343,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"266'810","reported_seq":2368,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719876+0000","last_change":"2024-09-12T00:10:01.260517+0000","last_active":"2024-09-12T02:04:59.719876+0000","last_peered":"2024-09-12T02:04:59.719876+0000","last_clean":"2024-09-12T02:04:59.719876+0000","last_became_active":"2024-09-12T00:10:01.260115+0000","last_became_peered":"2024-09-12T00:10:01.260115+0000","last_unstale":"2024-09-12T02:04:59.719876+0000","last_undegraded":"2024-09-12T02:04:59.719876+0000","last_fullsized":"2024-09-12T02:04:59.719876+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:58.706655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3786,"num_read_kb":3403,"num_write":1061,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"266'381","reported_seq":1156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.547753+0000","last_change":"2024-09-12T00:09:59.286280+0000","last_active":"2024-09-12T02:06:47.547753+0000","last_peered":"2024-09-12T02:06:47.547753+0000","last_clean":"2024-09-12T02:06:47.547753+0000","last_became_active":"2024-09-12T00:09:59.285792+0000","last_became_peered":"2024-09-12T00:09:59.285792+0000","last_unstale":"2024-09-12T02:06:47.547753+0000","last_undegraded":"2024-09-12T02:06:47.547753+0000","last_fullsized":"2024-09-12T02:06:47.547753+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:19.960444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":739,"num_read_kb":25287,"num_write":1212,"num_write_kb":29345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729275+0000","last_change":"2024-09-12T00:10:03.258466+0000","last_active":"2024-09-12T02:04:38.729275+0000","last_peered":"2024-09-12T02:04:38.729275+0000","last_clean":"2024-09-12T02:04:38.729275+0000","last_became_active":"2024-09-12T00:10:03.257760+0000","last_became_peered":"2024-09-12T00:10:03.257760+0000","last_unstale":"2024-09-12T02:04:38.729275+0000","last_undegraded":"2024-09-12T02:04:38.729275+0000","last_fullsized":"2024-09-12T02:04:38.729275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:08.684067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"266'382","reported_seq":1028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.379891+0000","last_change":"2024-09-12T00:10:05.293759+0000","last_active":"2024-09-12T02:06:46.379891+0000","last_peered":"2024-09-12T02:06:46.379891+0000","last_clean":"2024-09-12T02:06:46.379891+0000","last_became_active":"2024-09-12T00:10:05.292902+0000","last_became_peered":"2024-09-12T00:10:05.292902+0000","last_unstale":"2024-09-12T02:06:46.379891+0000","last_undegraded":"2024-09-12T02:06:46.379891+0000","last_fullsized":"2024-09-12T02:06:46.379891+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:01.365556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":1193,"num_write":510,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679856+0000","last_change":"2024-09-12T00:10:07.322324+0000","last_active":"2024-09-12T02:02:38.679856+0000","last_peered":"2024-09-12T02:02:38.679856+0000","last_clean":"2024-09-12T02:02:38.679856+0000","last_became_active":"2024-09-12T00:10:07.321400+0000","last_became_peered":"2024-09-12T00:10:07.321400+0000","last_unstale":"2024-09-12T02:02:38.679856+0000","last_undegraded":"2024-09-12T02:02:38.679856+0000","last_fullsized":"2024-09-12T02:02:38.679856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:09.420108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"266'186","reported_seq":741,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:50.389377+0000","last_change":"2024-09-12T00:10:09.356446+0000","last_active":"2024-09-12T02:04:50.389377+0000","last_peered":"2024-09-12T02:04:50.389377+0000","last_clean":"2024-09-12T02:04:50.389377+0000","last_became_active":"2024-09-12T00:10:09.355548+0000","last_became_peered":"2024-09-12T00:10:09.355548+0000","last_unstale":"2024-09-12T02:04:50.389377+0000","last_undegraded":"2024-09-12T02:04:50.389377+0000","last_fullsized":"2024-09-12T02:04:50.389377+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:14.356852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":268,"num_write":529,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"266'393","reported_seq":1777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.725362+0000","last_change":"2024-09-12T00:10:01.257147+0000","last_active":"2024-09-12T02:04:59.725362+0000","last_peered":"2024-09-12T02:04:59.725362+0000","last_clean":"2024-09-12T02:04:59.725362+0000","last_became_active":"2024-09-12T00:10:01.256781+0000","last_became_peered":"2024-09-12T00:10:01.256781+0000","last_unstale":"2024-09-12T02:04:59.725362+0000","last_undegraded":"2024-09-12T02:04:59.725362+0000","last_fullsized":"2024-09-12T02:04:59.725362+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:08.713733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1972,"num_read_kb":1849,"num_write":456,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"266'342","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.401668+0000","last_change":"2024-09-12T00:09:59.301265+0000","last_active":"2024-09-12T02:06:47.401668+0000","last_peered":"2024-09-12T02:06:47.401668+0000","last_clean":"2024-09-12T02:06:47.401668+0000","last_became_active":"2024-09-12T00:09:59.295949+0000","last_became_peered":"2024-09-12T00:09:59.295949+0000","last_unstale":"2024-09-12T02:06:47.401668+0000","last_undegraded":"2024-09-12T02:06:47.401668+0000","last_fullsized":"2024-09-12T02:06:47.401668+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:00.402184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314586,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":1958,"num_write":1004,"num_write_kb":21693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733298+0000","last_change":"2024-09-12T00:10:03.255686+0000","last_active":"2024-09-12T02:02:33.733298+0000","last_peered":"2024-09-12T02:02:33.733298+0000","last_clean":"2024-09-12T02:02:33.733298+0000","last_became_active":"2024-09-12T00:10:03.254941+0000","last_became_peered":"2024-09-12T00:10:03.254941+0000","last_unstale":"2024-09-12T02:02:33.733298+0000","last_undegraded":"2024-09-12T02:02:33.733298+0000","last_fullsized":"2024-09-12T02:02:33.733298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:39.484405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"266'341","reported_seq":977,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.980585+0000","last_change":"2024-09-12T00:10:05.362933+0000","last_active":"2024-09-12T02:04:43.980585+0000","last_peered":"2024-09-12T02:04:43.980585+0000","last_clean":"2024-09-12T02:04:43.980585+0000","last_became_active":"2024-09-12T00:10:05.362151+0000","last_became_peered":"2024-09-12T00:10:05.362151+0000","last_unstale":"2024-09-12T02:04:43.980585+0000","last_undegraded":"2024-09-12T02:04:43.980585+0000","last_fullsized":"2024-09-12T02:04:43.980585+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:23.347759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":1075,"num_write":452,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708301+0000","last_change":"2024-09-12T00:10:07.336945+0000","last_active":"2024-09-12T02:04:38.708301+0000","last_peered":"2024-09-12T02:04:38.708301+0000","last_clean":"2024-09-12T02:04:38.708301+0000","last_became_active":"2024-09-12T00:10:07.336129+0000","last_became_peered":"2024-09-12T00:10:07.336129+0000","last_unstale":"2024-09-12T02:04:38.708301+0000","last_undegraded":"2024-09-12T02:04:38.708301+0000","last_fullsized":"2024-09-12T02:04:38.708301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:22.333025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"266'100","reported_seq":624,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.109970+0000","last_change":"2024-09-12T00:10:09.371725+0000","last_active":"2024-09-12T02:06:07.109970+0000","last_peered":"2024-09-12T02:06:07.109970+0000","last_clean":"2024-09-12T02:06:07.109970+0000","last_became_active":"2024-09-12T00:10:09.370925+0000","last_became_peered":"2024-09-12T00:10:09.370925+0000","last_unstale":"2024-09-12T02:06:07.109970+0000","last_undegraded":"2024-09-12T02:06:07.109970+0000","last_fullsized":"2024-09-12T02:06:07.109970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:01.455208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"266'455","reported_seq":2115,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689872+0000","last_change":"2024-09-12T00:10:01.257454+0000","last_active":"2024-09-12T02:02:33.689872+0000","last_peered":"2024-09-12T02:02:33.689872+0000","last_clean":"2024-09-12T02:02:33.689872+0000","last_became_active":"2024-09-12T00:10:01.257064+0000","last_became_peered":"2024-09-12T00:10:01.257064+0000","last_unstale":"2024-09-12T02:02:33.689872+0000","last_undegraded":"2024-09-12T02:02:33.689872+0000","last_fullsized":"2024-09-12T02:02:33.689872+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:41.782738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2638,"num_read_kb":2500,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"266'393","reported_seq":1087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.549604+0000","last_change":"2024-09-12T00:09:59.289590+0000","last_active":"2024-09-12T02:06:47.549604+0000","last_peered":"2024-09-12T02:06:47.549604+0000","last_clean":"2024-09-12T02:06:47.549604+0000","last_became_active":"2024-09-12T00:09:59.289217+0000","last_became_peered":"2024-09-12T00:09:59.289217+0000","last_unstale":"2024-09-12T02:06:47.549604+0000","last_undegraded":"2024-09-12T02:06:47.549604+0000","last_fullsized":"2024-09-12T02:06:47.549604+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:02.241515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":33363,"num_write":1255,"num_write_kb":62829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.678668+0000","last_change":"2024-09-12T00:10:03.265403+0000","last_active":"2024-09-12T02:02:33.678668+0000","last_peered":"2024-09-12T02:02:33.678668+0000","last_clean":"2024-09-12T02:02:33.678668+0000","last_became_active":"2024-09-12T00:10:03.264802+0000","last_became_peered":"2024-09-12T00:10:03.264802+0000","last_unstale":"2024-09-12T02:02:33.678668+0000","last_undegraded":"2024-09-12T02:02:33.678668+0000","last_fullsized":"2024-09-12T02:02:33.678668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:04.107888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"266'163","reported_seq":757,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.760399+0000","last_change":"2024-09-12T00:10:05.362816+0000","last_active":"2024-09-12T02:04:33.760399+0000","last_peered":"2024-09-12T02:04:33.760399+0000","last_clean":"2024-09-12T02:04:33.760399+0000","last_became_active":"2024-09-12T00:10:05.361625+0000","last_became_peered":"2024-09-12T00:10:05.361625+0000","last_unstale":"2024-09-12T02:04:33.760399+0000","last_undegraded":"2024-09-12T02:04:33.760399+0000","last_fullsized":"2024-09-12T02:04:33.760399+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:40.143219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":192,"num_write":144,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"266'764","reported_seq":3195,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.569476+0000","last_change":"2024-09-12T00:10:07.315770+0000","last_active":"2024-09-12T02:06:47.569476+0000","last_peered":"2024-09-12T02:06:47.569476+0000","last_clean":"2024-09-12T02:06:47.569476+0000","last_became_active":"2024-09-12T00:10:07.314980+0000","last_became_peered":"2024-09-12T00:10:07.314980+0000","last_unstale":"2024-09-12T02:06:47.569476+0000","last_undegraded":"2024-09-12T02:06:47.569476+0000","last_fullsized":"2024-09-12T02:06:47.569476+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:26.700418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"266'122","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.754575+0000","last_change":"2024-09-12T00:10:09.370317+0000","last_active":"2024-09-12T02:04:28.754575+0000","last_peered":"2024-09-12T02:04:28.754575+0000","last_clean":"2024-09-12T02:04:28.754575+0000","last_became_active":"2024-09-12T00:10:09.369670+0000","last_became_peered":"2024-09-12T00:10:09.369670+0000","last_unstale":"2024-09-12T02:04:28.754575+0000","last_undegraded":"2024-09-12T02:04:28.754575+0000","last_fullsized":"2024-09-12T02:04:28.754575+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:51.975587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":303,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"266'514","reported_seq":2009,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733221+0000","last_change":"2024-09-12T00:10:01.249269+0000","last_active":"2024-09-12T02:02:33.733221+0000","last_peered":"2024-09-12T02:02:33.733221+0000","last_clean":"2024-09-12T02:02:33.733221+0000","last_became_active":"2024-09-12T00:10:01.248535+0000","last_became_peered":"2024-09-12T00:10:01.248535+0000","last_unstale":"2024-09-12T02:02:33.733221+0000","last_undegraded":"2024-09-12T02:02:33.733221+0000","last_fullsized":"2024-09-12T02:02:33.733221+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:56.739255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2593,"num_read_kb":2391,"num_write":659,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"266'330","reported_seq":1029,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.714691+0000","last_change":"2024-09-12T00:09:59.297197+0000","last_active":"2024-09-12T02:06:44.714691+0000","last_peered":"2024-09-12T02:06:44.714691+0000","last_clean":"2024-09-12T02:06:44.714691+0000","last_became_active":"2024-09-12T00:09:59.296207+0000","last_became_peered":"2024-09-12T00:09:59.296207+0000","last_unstale":"2024-09-12T02:06:44.714691+0000","last_undegraded":"2024-09-12T02:06:44.714691+0000","last_fullsized":"2024-09-12T02:06:44.714691+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:59.878998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5083213,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":523,"num_read_kb":14261,"num_write":1185,"num_write_kb":35890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.727067+0000","last_change":"2024-09-12T00:10:03.260439+0000","last_active":"2024-09-12T02:02:33.727067+0000","last_peered":"2024-09-12T02:02:33.727067+0000","last_clean":"2024-09-12T02:02:33.727067+0000","last_became_active":"2024-09-12T00:10:03.259644+0000","last_became_peered":"2024-09-12T00:10:03.259644+0000","last_unstale":"2024-09-12T02:02:33.727067+0000","last_undegraded":"2024-09-12T02:02:33.727067+0000","last_fullsized":"2024-09-12T02:02:33.727067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:33.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"266'378","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:24.777642+0000","last_change":"2024-09-12T00:10:05.297805+0000","last_active":"2024-09-12T02:06:24.777642+0000","last_peered":"2024-09-12T02:06:24.777642+0000","last_clean":"2024-09-12T02:06:24.777642+0000","last_became_active":"2024-09-12T00:10:05.297223+0000","last_became_peered":"2024-09-12T00:10:05.297223+0000","last_unstale":"2024-09-12T02:06:24.777642+0000","last_undegraded":"2024-09-12T02:06:24.777642+0000","last_fullsized":"2024-09-12T02:06:24.777642+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:02.183020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46610,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":587,"num_read_kb":987,"num_write":442,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.522957+0000","last_change":"2024-09-12T00:10:07.324114+0000","last_active":"2024-09-12T02:03:43.522957+0000","last_peered":"2024-09-12T02:03:43.522957+0000","last_clean":"2024-09-12T02:03:43.522957+0000","last_became_active":"2024-09-12T00:10:07.323296+0000","last_became_peered":"2024-09-12T00:10:07.323296+0000","last_unstale":"2024-09-12T02:03:43.522957+0000","last_undegraded":"2024-09-12T02:03:43.522957+0000","last_fullsized":"2024-09-12T02:03:43.522957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:17.788189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"266'145","reported_seq":669,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:52.636170+0000","last_change":"2024-09-12T00:10:09.362544+0000","last_active":"2024-09-12T02:04:52.636170+0000","last_peered":"2024-09-12T02:04:52.636170+0000","last_clean":"2024-09-12T02:04:52.636170+0000","last_became_active":"2024-09-12T00:10:09.361797+0000","last_became_peered":"2024-09-12T00:10:09.361797+0000","last_unstale":"2024-09-12T02:04:52.636170+0000","last_undegraded":"2024-09-12T02:04:52.636170+0000","last_fullsized":"2024-09-12T02:04:52.636170+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:59.618943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":153,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"266'798","reported_seq":2149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733158+0000","last_change":"2024-09-12T00:10:31.165648+0000","last_active":"2024-09-12T02:02:33.733158+0000","last_peered":"2024-09-12T02:02:33.733158+0000","last_clean":"2024-09-12T02:02:33.733158+0000","last_became_active":"2024-09-12T00:10:31.165044+0000","last_became_peered":"2024-09-12T00:10:31.165044+0000","last_unstale":"2024-09-12T02:02:33.733158+0000","last_undegraded":"2024-09-12T02:02:33.733158+0000","last_fullsized":"2024-09-12T02:02:33.733158+0000","mapping_epoch":38,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:52.001534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3606,"num_read_kb":3182,"num_write":1095,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"266'320","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.636792+0000","last_change":"2024-09-12T00:09:59.271158+0000","last_active":"2024-09-12T02:06:44.636792+0000","last_peered":"2024-09-12T02:06:44.636792+0000","last_clean":"2024-09-12T02:06:44.636792+0000","last_became_active":"2024-09-12T00:09:59.264091+0000","last_became_peered":"2024-09-12T00:09:59.264091+0000","last_unstale":"2024-09-12T02:06:44.636792+0000","last_undegraded":"2024-09-12T02:06:44.636792+0000","last_fullsized":"2024-09-12T02:06:44.636792+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:19.196253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1786383,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":590,"num_read_kb":45982,"num_write":1051,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:34.724000+0000","last_change":"2024-09-12T00:10:03.264424+0000","last_active":"2024-09-12T02:02:34.724000+0000","last_peered":"2024-09-12T02:02:34.724000+0000","last_clean":"2024-09-12T02:02:34.724000+0000","last_became_active":"2024-09-12T00:10:03.263712+0000","last_became_peered":"2024-09-12T00:10:03.263712+0000","last_unstale":"2024-09-12T02:02:34.724000+0000","last_undegraded":"2024-09-12T02:02:34.724000+0000","last_fullsized":"2024-09-12T02:02:34.724000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:02.001466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"266'311","reported_seq":930,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.559880+0000","last_change":"2024-09-12T00:10:05.298555+0000","last_active":"2024-09-12T02:06:45.559880+0000","last_peered":"2024-09-12T02:06:45.559880+0000","last_clean":"2024-09-12T02:06:45.559880+0000","last_became_active":"2024-09-12T00:10:05.297514+0000","last_became_peered":"2024-09-12T00:10:05.297514+0000","last_unstale":"2024-09-12T02:06:45.559880+0000","last_undegraded":"2024-09-12T02:06:45.559880+0000","last_fullsized":"2024-09-12T02:06:45.559880+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:45.661380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42254,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1111,"num_write":410,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.723739+0000","last_change":"2024-09-12T00:10:07.325384+0000","last_active":"2024-09-12T02:04:13.723739+0000","last_peered":"2024-09-12T02:04:13.723739+0000","last_clean":"2024-09-12T02:04:13.723739+0000","last_became_active":"2024-09-12T00:10:07.320880+0000","last_became_peered":"2024-09-12T00:10:07.320880+0000","last_unstale":"2024-09-12T02:04:13.723739+0000","last_undegraded":"2024-09-12T02:04:13.723739+0000","last_fullsized":"2024-09-12T02:04:13.723739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:10.636128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"266'120","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.964456+0000","last_change":"2024-09-12T00:10:09.434166+0000","last_active":"2024-09-12T02:03:43.964456+0000","last_peered":"2024-09-12T02:03:43.964456+0000","last_clean":"2024-09-12T02:03:43.964456+0000","last_became_active":"2024-09-12T00:10:09.433296+0000","last_became_peered":"2024-09-12T00:10:09.433296+0000","last_unstale":"2024-09-12T02:03:43.964456+0000","last_undegraded":"2024-09-12T02:03:43.964456+0000","last_fullsized":"2024-09-12T02:03:43.964456+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:16.296420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1168,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":163,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"266'596","reported_seq":2323,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.720907+0000","last_change":"2024-09-12T00:10:01.242398+0000","last_active":"2024-09-12T02:06:05.720907+0000","last_peered":"2024-09-12T02:06:05.720907+0000","last_clean":"2024-09-12T02:06:05.720907+0000","last_became_active":"2024-09-12T00:10:01.242013+0000","last_became_peered":"2024-09-12T00:10:01.242013+0000","last_unstale":"2024-09-12T02:06:05.720907+0000","last_undegraded":"2024-09-12T02:06:05.720907+0000","last_fullsized":"2024-09-12T02:06:05.720907+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:24.130259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3158,"num_read_kb":2927,"num_write":761,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"266'284","reported_seq":959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.972388+0000","last_change":"2024-09-12T00:09:59.311530+0000","last_active":"2024-09-12T02:04:13.972388+0000","last_peered":"2024-09-12T02:04:13.972388+0000","last_clean":"2024-09-12T02:04:13.972388+0000","last_became_active":"2024-09-12T00:09:59.311148+0000","last_became_peered":"2024-09-12T00:09:59.311148+0000","last_unstale":"2024-09-12T02:04:13.972388+0000","last_undegraded":"2024-09-12T02:04:13.972388+0000","last_fullsized":"2024-09-12T02:04:13.972388+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:05.724347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6884012,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":417,"num_read_kb":27101,"num_write":1056,"num_write_kb":32356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.747561+0000","last_change":"2024-09-12T00:10:03.253703+0000","last_active":"2024-09-12T02:03:38.747561+0000","last_peered":"2024-09-12T02:03:38.747561+0000","last_clean":"2024-09-12T02:03:38.747561+0000","last_became_active":"2024-09-12T00:10:03.252562+0000","last_became_peered":"2024-09-12T00:10:03.252562+0000","last_unstale":"2024-09-12T02:03:38.747561+0000","last_undegraded":"2024-09-12T02:03:38.747561+0000","last_fullsized":"2024-09-12T02:03:38.747561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:41.543603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"266'270","reported_seq":861,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.986469+0000","last_change":"2024-09-12T00:10:05.293010+0000","last_active":"2024-09-12T02:05:08.986469+0000","last_peered":"2024-09-12T02:05:08.986469+0000","last_clean":"2024-09-12T02:05:08.986469+0000","last_became_active":"2024-09-12T00:10:05.291758+0000","last_became_peered":"2024-09-12T00:10:05.291758+0000","last_unstale":"2024-09-12T02:05:08.986469+0000","last_undegraded":"2024-09-12T02:05:08.986469+0000","last_fullsized":"2024-09-12T02:05:08.986469+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:40.013931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":458,"num_read_kb":969,"num_write":382,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.734558+0000","last_change":"2024-09-12T00:10:07.321987+0000","last_active":"2024-09-12T02:02:38.734558+0000","last_peered":"2024-09-12T02:02:38.734558+0000","last_clean":"2024-09-12T02:02:38.734558+0000","last_became_active":"2024-09-12T00:10:07.320509+0000","last_became_peered":"2024-09-12T00:10:07.320509+0000","last_unstale":"2024-09-12T02:02:38.734558+0000","last_undegraded":"2024-09-12T02:02:38.734558+0000","last_fullsized":"2024-09-12T02:02:38.734558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:24.557032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"266'169","reported_seq":1660,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:52.460371+0000","last_change":"2024-09-12T00:10:09.364380+0000","last_active":"2024-09-12T02:04:52.460371+0000","last_peered":"2024-09-12T02:04:52.460371+0000","last_clean":"2024-09-12T02:04:52.460371+0000","last_became_active":"2024-09-12T00:10:09.363609+0000","last_became_peered":"2024-09-12T00:10:09.363609+0000","last_unstale":"2024-09-12T02:04:52.460371+0000","last_undegraded":"2024-09-12T02:04:52.460371+0000","last_fullsized":"2024-09-12T02:04:52.460371+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:27.382248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1201,"num_read_kb":1188,"num_write":377,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"266'767","reported_seq":2292,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.935938+0000","last_change":"2024-09-12T00:10:01.255788+0000","last_active":"2024-09-12T02:04:59.935938+0000","last_peered":"2024-09-12T02:04:59.935938+0000","last_clean":"2024-09-12T02:04:59.935938+0000","last_became_active":"2024-09-12T00:10:01.255086+0000","last_became_peered":"2024-09-12T00:10:01.255086+0000","last_unstale":"2024-09-12T02:04:59.935938+0000","last_undegraded":"2024-09-12T02:04:59.935938+0000","last_fullsized":"2024-09-12T02:04:59.935938+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:14.844500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3623,"num_read_kb":3271,"num_write":1000,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"266'318","reported_seq":1019,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.479187+0000","last_change":"2024-09-12T00:09:59.294231+0000","last_active":"2024-09-12T02:06:47.479187+0000","last_peered":"2024-09-12T02:06:47.479187+0000","last_clean":"2024-09-12T02:06:47.479187+0000","last_became_active":"2024-09-12T00:09:59.293822+0000","last_became_peered":"2024-09-12T00:09:59.293822+0000","last_unstale":"2024-09-12T02:06:47.479187+0000","last_undegraded":"2024-09-12T02:06:47.479187+0000","last_fullsized":"2024-09-12T02:06:47.479187+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:58.704023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":523,"num_read_kb":10999,"num_write":984,"num_write_kb":11811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.701152+0000","last_change":"2024-09-12T00:10:03.273307+0000","last_active":"2024-09-12T02:04:08.701152+0000","last_peered":"2024-09-12T02:04:08.701152+0000","last_clean":"2024-09-12T02:04:08.701152+0000","last_became_active":"2024-09-12T00:10:03.272579+0000","last_became_peered":"2024-09-12T00:10:03.272579+0000","last_unstale":"2024-09-12T02:04:08.701152+0000","last_undegraded":"2024-09-12T02:04:08.701152+0000","last_fullsized":"2024-09-12T02:04:08.701152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:05.059545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"266'371","reported_seq":1013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.925039+0000","last_change":"2024-09-12T00:10:05.289062+0000","last_active":"2024-09-12T02:06:44.925039+0000","last_peered":"2024-09-12T02:06:44.925039+0000","last_clean":"2024-09-12T02:06:44.925039+0000","last_became_active":"2024-09-12T00:10:05.288230+0000","last_became_peered":"2024-09-12T00:10:05.288230+0000","last_unstale":"2024-09-12T02:06:44.925039+0000","last_undegraded":"2024-09-12T02:06:44.925039+0000","last_fullsized":"2024-09-12T02:06:44.925039+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:10.127963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51419,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":1309,"num_write":486,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718281+0000","last_change":"2024-09-12T00:10:07.327719+0000","last_active":"2024-09-12T02:02:38.718281+0000","last_peered":"2024-09-12T02:02:38.718281+0000","last_clean":"2024-09-12T02:02:38.718281+0000","last_became_active":"2024-09-12T00:10:07.325726+0000","last_became_peered":"2024-09-12T00:10:07.325726+0000","last_unstale":"2024-09-12T02:02:38.718281+0000","last_undegraded":"2024-09-12T02:02:38.718281+0000","last_fullsized":"2024-09-12T02:02:38.718281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:25.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"266'151","reported_seq":678,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.634814+0000","last_change":"2024-09-12T00:10:09.353828+0000","last_active":"2024-09-12T02:06:05.634814+0000","last_peered":"2024-09-12T02:06:05.634814+0000","last_clean":"2024-09-12T02:06:05.634814+0000","last_became_active":"2024-09-12T00:10:09.353036+0000","last_became_peered":"2024-09-12T00:10:09.353036+0000","last_unstale":"2024-09-12T02:06:05.634814+0000","last_undegraded":"2024-09-12T02:06:05.634814+0000","last_fullsized":"2024-09-12T02:06:05.634814+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:42.519114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":163,"num_write":387,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"266'724","reported_seq":2128,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.863697+0000","last_change":"2024-09-12T00:10:01.264074+0000","last_active":"2024-09-12T02:04:59.863697+0000","last_peered":"2024-09-12T02:04:59.863697+0000","last_clean":"2024-09-12T02:04:59.863697+0000","last_became_active":"2024-09-12T00:10:01.263786+0000","last_became_peered":"2024-09-12T00:10:01.263786+0000","last_unstale":"2024-09-12T02:04:59.863697+0000","last_undegraded":"2024-09-12T02:04:59.863697+0000","last_fullsized":"2024-09-12T02:04:59.863697+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:21.005100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3380,"num_read_kb":3030,"num_write":963,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"266'351","reported_seq":1016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.503459+0000","last_change":"2024-09-12T00:09:59.288404+0000","last_active":"2024-09-12T02:06:47.503459+0000","last_peered":"2024-09-12T02:06:47.503459+0000","last_clean":"2024-09-12T02:06:47.503459+0000","last_became_active":"2024-09-12T00:09:59.287488+0000","last_became_peered":"2024-09-12T00:09:59.287488+0000","last_unstale":"2024-09-12T02:06:47.503459+0000","last_undegraded":"2024-09-12T02:06:47.503459+0000","last_fullsized":"2024-09-12T02:06:47.503459+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:21.087354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174806,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":42853,"num_write":973,"num_write_kb":24863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"266'457","reported_seq":1949,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.867698+0000","last_change":"2024-09-12T00:10:01.258659+0000","last_active":"2024-09-12T02:04:59.867698+0000","last_peered":"2024-09-12T02:04:59.867698+0000","last_clean":"2024-09-12T02:04:59.867698+0000","last_became_active":"2024-09-12T00:10:01.258361+0000","last_became_peered":"2024-09-12T00:10:01.258361+0000","last_unstale":"2024-09-12T02:04:59.867698+0000","last_undegraded":"2024-09-12T02:04:59.867698+0000","last_fullsized":"2024-09-12T02:04:59.867698+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:18.423469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2374,"num_read_kb":2204,"num_write":589,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"266'345","reported_seq":1056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.416786+0000","last_change":"2024-09-12T00:10:31.470461+0000","last_active":"2024-09-12T02:06:47.416786+0000","last_peered":"2024-09-12T02:06:47.416786+0000","last_clean":"2024-09-12T02:06:47.416786+0000","last_became_active":"2024-09-12T00:10:31.469140+0000","last_became_peered":"2024-09-12T00:10:31.469140+0000","last_unstale":"2024-09-12T02:06:47.416786+0000","last_undegraded":"2024-09-12T02:06:47.416786+0000","last_fullsized":"2024-09-12T02:06:47.416786+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:15.566429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314842,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":558,"num_read_kb":38599,"num_write":1106,"num_write_kb":37292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"266'822","reported_seq":2507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726468+0000","last_change":"2024-09-12T00:10:01.279500+0000","last_active":"2024-09-12T02:02:44.726468+0000","last_peered":"2024-09-12T02:02:44.726468+0000","last_clean":"2024-09-12T02:02:44.726468+0000","last_became_active":"2024-09-12T00:10:01.275843+0000","last_became_peered":"2024-09-12T00:10:01.275843+0000","last_unstale":"2024-09-12T02:02:44.726468+0000","last_undegraded":"2024-09-12T02:02:44.726468+0000","last_fullsized":"2024-09-12T02:02:44.726468+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:29.293928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4035,"num_read_kb":3644,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"266'299","reported_seq":977,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.745692+0000","last_change":"2024-09-12T00:09:59.309888+0000","last_active":"2024-09-12T02:06:44.745692+0000","last_peered":"2024-09-12T02:06:44.745692+0000","last_clean":"2024-09-12T02:06:44.745692+0000","last_became_active":"2024-09-12T00:09:59.309327+0000","last_became_peered":"2024-09-12T00:09:59.309327+0000","last_unstale":"2024-09-12T02:06:44.745692+0000","last_undegraded":"2024-09-12T02:06:44.745692+0000","last_fullsized":"2024-09-12T02:06:44.745692+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:38.157743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6635867,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":484,"num_read_kb":15467,"num_write":1062,"num_write_kb":37224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"266'496","reported_seq":2144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681200+0000","last_change":"2024-09-12T00:10:01.261722+0000","last_active":"2024-09-12T02:02:43.681200+0000","last_peered":"2024-09-12T02:02:43.681200+0000","last_clean":"2024-09-12T02:02:43.681200+0000","last_became_active":"2024-09-12T00:10:01.261418+0000","last_became_peered":"2024-09-12T00:10:01.261418+0000","last_unstale":"2024-09-12T02:02:43.681200+0000","last_undegraded":"2024-09-12T02:02:43.681200+0000","last_fullsized":"2024-09-12T02:02:43.681200+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:12.125604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2751,"num_read_kb":2561,"num_write":595,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"266'353","reported_seq":1113,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.524646+0000","last_change":"2024-09-12T00:09:59.287032+0000","last_active":"2024-09-12T02:06:47.524646+0000","last_peered":"2024-09-12T02:06:47.524646+0000","last_clean":"2024-09-12T02:06:47.524646+0000","last_became_active":"2024-09-12T00:09:59.286590+0000","last_became_peered":"2024-09-12T00:09:59.286590+0000","last_unstale":"2024-09-12T02:06:47.524646+0000","last_undegraded":"2024-09-12T02:06:47.524646+0000","last_fullsized":"2024-09-12T02:06:47.524646+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:35.622983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904210,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":714,"num_read_kb":40012,"num_write":1077,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"266'1463","reported_seq":3083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.676957+0000","last_change":"2024-09-12T00:10:01.262679+0000","last_active":"2024-09-12T02:06:05.676957+0000","last_peered":"2024-09-12T02:06:05.676957+0000","last_clean":"2024-09-12T02:06:05.676957+0000","last_became_active":"2024-09-12T00:10:01.261999+0000","last_became_peered":"2024-09-12T00:10:01.261999+0000","last_unstale":"2024-09-12T02:06:05.676957+0000","last_undegraded":"2024-09-12T02:06:05.676957+0000","last_fullsized":"2024-09-12T02:06:05.676957+0000","mapping_epoch":27,"log_start":"266'1400","ondisk_log_start":"266'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":1400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:32.253175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6652,"num_read_kb":5741,"num_write":2141,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"266'319","reported_seq":1062,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:57.966990+0000","last_change":"2024-09-12T00:09:59.286623+0000","last_active":"2024-09-12T02:05:57.966990+0000","last_peered":"2024-09-12T02:05:57.966990+0000","last_clean":"2024-09-12T02:05:57.966990+0000","last_became_active":"2024-09-12T00:09:59.286301+0000","last_became_peered":"2024-09-12T00:09:59.286301+0000","last_unstale":"2024-09-12T02:05:57.966990+0000","last_undegraded":"2024-09-12T02:05:57.966990+0000","last_fullsized":"2024-09-12T02:05:57.966990+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:46.585588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6602067,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":716,"num_read_kb":8719,"num_write":1137,"num_write_kb":26143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"266'391","reported_seq":1861,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936338+0000","last_change":"2024-09-12T00:10:01.268784+0000","last_active":"2024-09-12T02:04:59.936338+0000","last_peered":"2024-09-12T02:04:59.936338+0000","last_clean":"2024-09-12T02:04:59.936338+0000","last_became_active":"2024-09-12T00:10:01.266927+0000","last_became_peered":"2024-09-12T00:10:01.266927+0000","last_unstale":"2024-09-12T02:04:59.936338+0000","last_undegraded":"2024-09-12T02:04:59.936338+0000","last_fullsized":"2024-09-12T02:04:59.936338+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:03.258226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2147,"num_read_kb":2014,"num_write":451,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"266'355","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.550046+0000","last_change":"2024-09-12T00:09:59.252139+0000","last_active":"2024-09-12T02:06:47.550046+0000","last_peered":"2024-09-12T02:06:47.550046+0000","last_clean":"2024-09-12T02:06:47.550046+0000","last_became_active":"2024-09-12T00:09:59.251413+0000","last_became_peered":"2024-09-12T00:09:59.251413+0000","last_unstale":"2024-09-12T02:06:47.550046+0000","last_undegraded":"2024-09-12T02:06:47.550046+0000","last_fullsized":"2024-09-12T02:06:47.550046+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:50.326651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":573,"num_read_kb":23722,"num_write":1195,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"266'445","reported_seq":2119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.978719+0000","last_change":"2024-09-12T00:10:01.261639+0000","last_active":"2024-09-12T02:04:38.978719+0000","last_peered":"2024-09-12T02:04:38.978719+0000","last_clean":"2024-09-12T02:04:38.978719+0000","last_became_active":"2024-09-12T00:10:01.259942+0000","last_became_peered":"2024-09-12T00:10:01.259942+0000","last_unstale":"2024-09-12T02:04:38.978719+0000","last_undegraded":"2024-09-12T02:04:38.978719+0000","last_fullsized":"2024-09-12T02:04:38.978719+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:46.512977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2415,"num_read_kb":2305,"num_write":502,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"266'339","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.495004+0000","last_change":"2024-09-12T00:09:59.299099+0000","last_active":"2024-09-12T02:06:47.495004+0000","last_peered":"2024-09-12T02:06:47.495004+0000","last_clean":"2024-09-12T02:06:47.495004+0000","last_became_active":"2024-09-12T00:09:59.298085+0000","last_became_peered":"2024-09-12T00:09:59.298085+0000","last_unstale":"2024-09-12T02:06:47.495004+0000","last_undegraded":"2024-09-12T02:06:47.495004+0000","last_fullsized":"2024-09-12T02:06:47.495004+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:01.824707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136867,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":58646,"num_write":1165,"num_write_kb":29645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"266'499","reported_seq":2206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729090+0000","last_change":"2024-09-12T00:10:01.256111+0000","last_active":"2024-09-12T02:04:38.729090+0000","last_peered":"2024-09-12T02:04:38.729090+0000","last_clean":"2024-09-12T02:04:38.729090+0000","last_became_active":"2024-09-12T00:10:01.255302+0000","last_became_peered":"2024-09-12T00:10:01.255302+0000","last_unstale":"2024-09-12T02:04:38.729090+0000","last_undegraded":"2024-09-12T02:04:38.729090+0000","last_fullsized":"2024-09-12T02:04:38.729090+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:49.290623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2619,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"266'286","reported_seq":1013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:56.725624+0000","last_change":"2024-09-12T00:09:59.286963+0000","last_active":"2024-09-12T02:05:56.725624+0000","last_peered":"2024-09-12T02:05:56.725624+0000","last_clean":"2024-09-12T02:05:56.725624+0000","last_became_active":"2024-09-12T00:09:59.286393+0000","last_became_peered":"2024-09-12T00:09:59.286393+0000","last_unstale":"2024-09-12T02:05:56.725624+0000","last_undegraded":"2024-09-12T02:05:56.725624+0000","last_fullsized":"2024-09-12T02:05:56.725624+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:52.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2536306,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":560,"num_read_kb":4602,"num_write":1105,"num_write_kb":13882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"266'595","reported_seq":2551,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719733+0000","last_change":"2024-09-12T00:10:01.248053+0000","last_active":"2024-09-12T02:04:59.719733+0000","last_peered":"2024-09-12T02:04:59.719733+0000","last_clean":"2024-09-12T02:04:59.719733+0000","last_became_active":"2024-09-12T00:10:01.247691+0000","last_became_peered":"2024-09-12T00:10:01.247691+0000","last_unstale":"2024-09-12T02:04:59.719733+0000","last_undegraded":"2024-09-12T02:04:59.719733+0000","last_fullsized":"2024-09-12T02:04:59.719733+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:02.948022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3679,"num_read_kb":3455,"num_write":725,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"266'294","reported_seq":954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.692346+0000","last_change":"2024-09-12T00:09:59.301446+0000","last_active":"2024-09-12T02:06:44.692346+0000","last_peered":"2024-09-12T02:06:44.692346+0000","last_clean":"2024-09-12T02:06:44.692346+0000","last_became_active":"2024-09-12T00:09:59.300760+0000","last_became_peered":"2024-09-12T00:09:59.300760+0000","last_unstale":"2024-09-12T02:06:44.692346+0000","last_undegraded":"2024-09-12T02:06:44.692346+0000","last_fullsized":"2024-09-12T02:06:44.692346+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:42.952819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18340267,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":411,"num_read_kb":26981,"num_write":1106,"num_write_kb":52645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"266'957","reported_seq":2608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.758101+0000","last_change":"2024-09-12T00:10:01.239366+0000","last_active":"2024-09-12T02:04:23.758101+0000","last_peered":"2024-09-12T02:04:23.758101+0000","last_clean":"2024-09-12T02:04:23.758101+0000","last_became_active":"2024-09-12T00:10:01.238674+0000","last_became_peered":"2024-09-12T00:10:01.238674+0000","last_unstale":"2024-09-12T02:04:23.758101+0000","last_undegraded":"2024-09-12T02:04:23.758101+0000","last_fullsized":"2024-09-12T02:04:23.758101+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":900,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:27.928106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4713,"num_read_kb":4229,"num_write":1343,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"266'235","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.980115+0000","last_change":"2024-09-12T00:09:59.289360+0000","last_active":"2024-09-12T02:04:43.980115+0000","last_peered":"2024-09-12T02:04:43.980115+0000","last_clean":"2024-09-12T02:04:43.980115+0000","last_became_active":"2024-09-12T00:09:59.288260+0000","last_became_peered":"2024-09-12T00:09:59.288260+0000","last_unstale":"2024-09-12T02:04:43.980115+0000","last_undegraded":"2024-09-12T02:04:43.980115+0000","last_fullsized":"2024-09-12T02:04:43.980115+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:05.984205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6365656,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":381,"num_read_kb":7701,"num_write":834,"num_write_kb":23188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"266'342","reported_seq":1890,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.726617+0000","last_change":"2024-09-12T00:10:01.265917+0000","last_active":"2024-09-12T02:06:05.726617+0000","last_peered":"2024-09-12T02:06:05.726617+0000","last_clean":"2024-09-12T02:06:05.726617+0000","last_became_active":"2024-09-12T00:10:01.265676+0000","last_became_peered":"2024-09-12T00:10:01.265676+0000","last_unstale":"2024-09-12T02:06:05.726617+0000","last_undegraded":"2024-09-12T02:06:05.726617+0000","last_fullsized":"2024-09-12T02:06:05.726617+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:37.696003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1939,"num_read_kb":1902,"num_write":362,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"266'264","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.706867+0000","last_change":"2024-09-12T00:09:59.311681+0000","last_active":"2024-09-12T02:06:44.706867+0000","last_peered":"2024-09-12T02:06:44.706867+0000","last_clean":"2024-09-12T02:06:44.706867+0000","last_became_active":"2024-09-12T00:09:59.311132+0000","last_became_peered":"2024-09-12T00:09:59.311132+0000","last_unstale":"2024-09-12T02:06:44.706867+0000","last_undegraded":"2024-09-12T02:06:44.706867+0000","last_fullsized":"2024-09-12T02:06:44.706867+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:34.389668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14238252,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":445,"num_read_kb":37892,"num_write":972,"num_write_kb":21146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"266'929","reported_seq":2547,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.499343+0000","last_change":"2024-09-12T00:10:01.256409+0000","last_active":"2024-09-12T02:04:57.499343+0000","last_peered":"2024-09-12T02:04:57.499343+0000","last_clean":"2024-09-12T02:04:57.499343+0000","last_became_active":"2024-09-12T00:10:01.255682+0000","last_became_peered":"2024-09-12T00:10:01.255682+0000","last_unstale":"2024-09-12T02:04:57.499343+0000","last_undegraded":"2024-09-12T02:04:57.499343+0000","last_fullsized":"2024-09-12T02:04:57.499343+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:22.673852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4312,"num_read_kb":3831,"num_write":1239,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"266'335","reported_seq":1018,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.481170+0000","last_change":"2024-09-12T00:09:59.301361+0000","last_active":"2024-09-12T02:06:47.481170+0000","last_peered":"2024-09-12T02:06:47.481170+0000","last_clean":"2024-09-12T02:06:47.481170+0000","last_became_active":"2024-09-12T00:09:59.300699+0000","last_became_peered":"2024-09-12T00:09:59.300699+0000","last_unstale":"2024-09-12T02:06:47.481170+0000","last_undegraded":"2024-09-12T02:06:47.481170+0000","last_fullsized":"2024-09-12T02:06:47.481170+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:17.083956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315873,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":7533,"num_write":1090,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"266'857","reported_seq":2535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.886077+0000","last_change":"2024-09-12T00:10:01.265550+0000","last_active":"2024-09-12T02:04:59.886077+0000","last_peered":"2024-09-12T02:04:59.886077+0000","last_clean":"2024-09-12T02:04:59.886077+0000","last_became_active":"2024-09-12T00:10:01.264795+0000","last_became_peered":"2024-09-12T00:10:01.264795+0000","last_unstale":"2024-09-12T02:04:59.886077+0000","last_undegraded":"2024-09-12T02:04:59.886077+0000","last_fullsized":"2024-09-12T02:04:59.886077+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:05.882685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3745,"num_write":1135,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"266'384","reported_seq":1056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.495001+0000","last_change":"2024-09-12T00:09:59.304543+0000","last_active":"2024-09-12T02:06:47.495001+0000","last_peered":"2024-09-12T02:06:47.495001+0000","last_clean":"2024-09-12T02:06:47.495001+0000","last_became_active":"2024-09-12T00:09:59.299516+0000","last_became_peered":"2024-09-12T00:09:59.299516+0000","last_unstale":"2024-09-12T02:06:47.495001+0000","last_undegraded":"2024-09-12T02:06:47.495001+0000","last_fullsized":"2024-09-12T02:06:47.495001+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:57.946312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":14945,"num_write":1232,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"266'496","reported_seq":2130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.538818+0000","last_change":"2024-09-12T00:10:01.259052+0000","last_active":"2024-09-12T02:04:48.538818+0000","last_peered":"2024-09-12T02:04:48.538818+0000","last_clean":"2024-09-12T02:04:48.538818+0000","last_became_active":"2024-09-12T00:10:01.258691+0000","last_became_peered":"2024-09-12T00:10:01.258691+0000","last_unstale":"2024-09-12T02:04:48.538818+0000","last_undegraded":"2024-09-12T02:04:48.538818+0000","last_fullsized":"2024-09-12T02:04:48.538818+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:25.573412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2775,"num_read_kb":2593,"num_write":624,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"266'376","reported_seq":1037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.451469+0000","last_change":"2024-09-12T00:09:59.314098+0000","last_active":"2024-09-12T02:06:47.451469+0000","last_peered":"2024-09-12T02:06:47.451469+0000","last_clean":"2024-09-12T02:06:47.451469+0000","last_became_active":"2024-09-12T00:09:59.313345+0000","last_became_peered":"2024-09-12T00:09:59.313345+0000","last_unstale":"2024-09-12T02:06:47.451469+0000","last_undegraded":"2024-09-12T02:06:47.451469+0000","last_fullsized":"2024-09-12T02:06:47.451469+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.271942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4483063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":14481,"num_write":1098,"num_write_kb":25771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"266'323","reported_seq":1744,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.944772+0000","last_change":"2024-09-12T00:10:01.250260+0000","last_active":"2024-09-12T02:02:33.944772+0000","last_peered":"2024-09-12T02:02:33.944772+0000","last_clean":"2024-09-12T02:02:33.944772+0000","last_became_active":"2024-09-12T00:10:01.249832+0000","last_became_peered":"2024-09-12T00:10:01.249832+0000","last_unstale":"2024-09-12T02:02:33.944772+0000","last_undegraded":"2024-09-12T02:02:33.944772+0000","last_fullsized":"2024-09-12T02:02:33.944772+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:36.961457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1802,"num_read_kb":1736,"num_write":351,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"266'317","reported_seq":1015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.435541+0000","last_change":"2024-09-12T00:09:59.311678+0000","last_active":"2024-09-12T02:06:47.435541+0000","last_peered":"2024-09-12T02:06:47.435541+0000","last_clean":"2024-09-12T02:06:47.435541+0000","last_became_active":"2024-09-12T00:09:59.311158+0000","last_became_peered":"2024-09-12T00:09:59.311158+0000","last_unstale":"2024-09-12T02:06:47.435541+0000","last_undegraded":"2024-09-12T02:06:47.435541+0000","last_fullsized":"2024-09-12T02:06:47.435541+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:56.573170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316829,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":115277,"num_write":995,"num_write_kb":39549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"266'719","reported_seq":2261,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.735208+0000","last_change":"2024-09-12T00:10:01.268377+0000","last_active":"2024-09-12T02:03:08.735208+0000","last_peered":"2024-09-12T02:03:08.735208+0000","last_clean":"2024-09-12T02:03:08.735208+0000","last_became_active":"2024-09-12T00:10:01.267027+0000","last_became_peered":"2024-09-12T00:10:01.267027+0000","last_unstale":"2024-09-12T02:03:08.735208+0000","last_undegraded":"2024-09-12T02:03:08.735208+0000","last_fullsized":"2024-09-12T02:03:08.735208+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:46.063409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3526,"num_read_kb":3200,"num_write":1050,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"266'278","reported_seq":941,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.566392+0000","last_change":"2024-09-12T00:09:59.287224+0000","last_active":"2024-09-12T02:06:44.566392+0000","last_peered":"2024-09-12T02:06:44.566392+0000","last_clean":"2024-09-12T02:06:44.566392+0000","last_became_active":"2024-09-12T00:09:59.285907+0000","last_became_peered":"2024-09-12T00:09:59.285907+0000","last_unstale":"2024-09-12T02:06:44.566392+0000","last_undegraded":"2024-09-12T02:06:44.566392+0000","last_fullsized":"2024-09-12T02:06:44.566392+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:31.224850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10543114,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":391,"num_read_kb":44645,"num_write":898,"num_write_kb":42281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"266'269","reported_seq":944,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.655638+0000","last_change":"2024-09-12T00:09:59.284497+0000","last_active":"2024-09-12T02:06:44.655638+0000","last_peered":"2024-09-12T02:06:44.655638+0000","last_clean":"2024-09-12T02:06:44.655638+0000","last_became_active":"2024-09-12T00:09:59.282446+0000","last_became_peered":"2024-09-12T00:09:59.282446+0000","last_unstale":"2024-09-12T02:06:44.655638+0000","last_undegraded":"2024-09-12T02:06:44.655638+0000","last_fullsized":"2024-09-12T02:06:44.655638+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:03.250241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852705,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":427,"num_read_kb":44688,"num_write":1004,"num_write_kb":33304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"266'455","reported_seq":2028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.721307+0000","last_change":"2024-09-12T00:10:01.248091+0000","last_active":"2024-09-12T02:06:05.721307+0000","last_peered":"2024-09-12T02:06:05.721307+0000","last_clean":"2024-09-12T02:06:05.721307+0000","last_became_active":"2024-09-12T00:10:01.247767+0000","last_became_peered":"2024-09-12T00:10:01.247767+0000","last_unstale":"2024-09-12T02:06:05.721307+0000","last_undegraded":"2024-09-12T02:06:05.721307+0000","last_fullsized":"2024-09-12T02:06:05.721307+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.370640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2488,"num_read_kb":2350,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"266'350","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.468042+0000","last_change":"2024-09-12T00:10:31.168863+0000","last_active":"2024-09-12T02:06:47.468042+0000","last_peered":"2024-09-12T02:06:47.468042+0000","last_clean":"2024-09-12T02:06:47.468042+0000","last_became_active":"2024-09-12T00:10:31.168444+0000","last_became_peered":"2024-09-12T00:10:31.168444+0000","last_unstale":"2024-09-12T02:06:47.468042+0000","last_undegraded":"2024-09-12T02:06:47.468042+0000","last_fullsized":"2024-09-12T02:06:47.468042+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:26.977451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400029,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":20125,"num_write":1291,"num_write_kb":40521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,0],"acting":[1,4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"266'1085","reported_seq":2767,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.671979+0000","last_change":"2024-09-12T00:10:01.279860+0000","last_active":"2024-09-12T02:06:05.671979+0000","last_peered":"2024-09-12T02:06:05.671979+0000","last_clean":"2024-09-12T02:06:05.671979+0000","last_became_active":"2024-09-12T00:10:01.278762+0000","last_became_peered":"2024-09-12T00:10:01.278762+0000","last_unstale":"2024-09-12T02:06:05.671979+0000","last_undegraded":"2024-09-12T02:06:05.671979+0000","last_fullsized":"2024-09-12T02:06:05.671979+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:38.059400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5202,"num_read_kb":4573,"num_write":1592,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6060,"num_read_kb":4225,"num_write":1955,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1026,"ondisk_log_size":1026,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":15149,"num_read_kb":14793,"num_write":16764,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":421,"ondisk_log_size":421,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1689480,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":21129,"num_read_kb":39431,"num_write":17667,"num_write_kb":12493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1417216,"data_stored":1054420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1953,"ondisk_log_size":1953,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2419,"num_read_kb":2884,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213079,"num_read_kb":194397,"num_write":55367,"num_write_kb":18884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":233391821,"num_objects":1760,"num_object_clones":0,"num_object_copies":7040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1760,"num_whiteouts":0,"num_read":34957,"num_read_kb":1955800,"num_write":70684,"num_write_kb":2110952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":291090432,"data_stored":291090432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3422,"ondisk_log_size":3422,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":27258880,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":156,"num_read_kb":180842,"num_write":178,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40898560,"data_stored":40898560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":8386837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":156,"num_read_kb":169574,"num_write":182,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23117824,"data_stored":23115238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543555,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341692,"kb_used_data":17580,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94030148,"statfs":{"total":96636764160,"available":96286871552,"internally_reserved":0,"allocated":18001920,"data_stored":15991149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543555,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":18656,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":19103744,"data_stored":17151124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543560,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311840,"kb_used_data":146052,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94060000,"statfs":{"total":96636764160,"available":96317440000,"internally_reserved":0,"allocated":149557248,"data_stored":147478110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543556,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158712,"kb_used_data":15080,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94213128,"statfs":{"total":96636764160,"available":96474243072,"internally_reserved":0,"allocated":15441920,"data_stored":13515589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543557,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438936,"kb_used_data":142600,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":93932904,"statfs":{"total":96636764160,"available":96187293696,"internally_reserved":0,"allocated":146022400,"data_stored":143970504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":303430087},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543556,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117124,"kb_used_data":13652,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94254716,"statfs":{"total":96636764160,"available":96516829184,"internally_reserved":0,"allocated":13979648,"data_stored":12036246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543558,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195176,"kb_used_data":11212,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94176664,"statfs":{"total":96636764160,"available":96436903936,"internally_reserved":0,"allocated":11481088,"data_stored":9500646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543557,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304548,"kb_used_data":20596,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94067292,"statfs":{"total":96636764160,"available":96324907008,"internally_reserved":0,"allocated":21090304,"data_stored":19083000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16199680,"data_stored":16199680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7208960,"data_stored":7208960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9744384,"data_stored":9744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":100274176,"data_stored":100274176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11227136,"data_stored":11227136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118468608,"data_stored":118468608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14860288,"data_stored":14860288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13107200,"data_stored":13107200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":465781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":583903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16824668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6290570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24113152,"data_stored":24113152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":16785408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:49.355 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:06:49.356 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:06:49.738 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:06:49.750 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-12T02:06:49.755 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":3772,"stamp":"2024-09-12T02:06:48.892893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":271335317,"num_objects":2274,"num_object_clones":0,"num_object_copies":8068,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2274,"num_whiteouts":0,"num_read":293183,"num_read_kb":2562013,"num_write":162940,"num_write_kb":2404893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12905,"ondisk_log_size":12905,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2170780,"kb_used_data":385428,"kb_used_omap":12,"kb_used_meta":1784563,"kb_avail":752803940,"statfs":{"total":773094113280,"available":770871234560,"internally_reserved":0,"allocated":394678272,"data_stored":378726368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1827393072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-452511741,"num_objects":-2767,"num_object_clones":0,"num_object_copies":-10980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2767,"num_whiteouts":0,"num_read":3092,"num_read_kb":2849,"num_write":2935,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.019717"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:54.728675+0000","last_change":"2024-09-12T01:00:24.087308+0000","last_active":"2024-09-12T02:02:54.728675+0000","last_peered":"2024-09-12T02:02:54.728675+0000","last_clean":"2024-09-12T02:02:54.728675+0000","last_became_active":"2024-09-12T01:00:24.086540+0000","last_became_peered":"2024-09-12T01:00:24.086540+0000","last_unstale":"2024-09-12T02:02:54.728675+0000","last_undegraded":"2024-09-12T02:02:54.728675+0000","last_fullsized":"2024-09-12T02:02:54.728675+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:55.672405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"266'2","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:24.721564+0000","last_change":"2024-09-12T00:32:21.646660+0000","last_active":"2024-09-12T02:02:24.721564+0000","last_peered":"2024-09-12T02:02:24.721564+0000","last_clean":"2024-09-12T02:02:24.721564+0000","last_became_active":"2024-09-12T00:32:21.645757+0000","last_became_peered":"2024-09-12T00:32:21.645757+0000","last_unstale":"2024-09-12T02:02:24.721564+0000","last_undegraded":"2024-09-12T02:02:24.721564+0000","last_fullsized":"2024-09-12T02:02:24.721564+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"266'4","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.939619+0000","last_change":"2024-09-12T00:32:14.592938+0000","last_active":"2024-09-12T02:02:13.939619+0000","last_peered":"2024-09-12T02:02:13.939619+0000","last_clean":"2024-09-12T02:02:13.939619+0000","last_became_active":"2024-09-12T00:32:14.592177+0000","last_became_peered":"2024-09-12T00:32:14.592177+0000","last_unstale":"2024-09-12T02:02:13.939619+0000","last_undegraded":"2024-09-12T02:02:13.939619+0000","last_fullsized":"2024-09-12T02:02:13.939619+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:54.401327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4193419,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8188,"num_write":4,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"266'29","reported_seq":164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.531382+0000","last_change":"2024-09-12T00:26:23.355721+0000","last_active":"2024-09-12T02:04:18.531382+0000","last_peered":"2024-09-12T02:04:18.531382+0000","last_clean":"2024-09-12T02:04:18.531382+0000","last_became_active":"2024-09-12T00:26:23.353338+0000","last_became_peered":"2024-09-12T00:26:23.353338+0000","last_unstale":"2024-09-12T02:04:18.531382+0000","last_undegraded":"2024-09-12T02:04:18.531382+0000","last_fullsized":"2024-09-12T02:04:18.531382+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.176865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.694256+0000","last_change":"2024-09-12T01:00:24.074808+0000","last_active":"2024-09-12T02:02:53.694256+0000","last_peered":"2024-09-12T02:02:53.694256+0000","last_clean":"2024-09-12T02:02:53.694256+0000","last_became_active":"2024-09-12T01:00:24.074048+0000","last_became_peered":"2024-09-12T01:00:24.074048+0000","last_unstale":"2024-09-12T02:02:53.694256+0000","last_undegraded":"2024-09-12T02:02:53.694256+0000","last_fullsized":"2024-09-12T02:02:53.694256+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:33.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"266'13","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.492562+0000","last_change":"2024-09-12T00:32:21.643734+0000","last_active":"2024-09-12T02:06:46.492562+0000","last_peered":"2024-09-12T02:06:46.492562+0000","last_clean":"2024-09-12T02:06:46.492562+0000","last_became_active":"2024-09-12T00:32:21.642967+0000","last_became_peered":"2024-09-12T00:32:21.642967+0000","last_unstale":"2024-09-12T02:06:46.492562+0000","last_undegraded":"2024-09-12T02:06:46.492562+0000","last_fullsized":"2024-09-12T02:06:46.492562+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:09.883461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24594,"num_write":18,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.674367+0000","last_change":"2024-09-12T00:32:14.603921+0000","last_active":"2024-09-12T02:02:13.674367+0000","last_peered":"2024-09-12T02:02:13.674367+0000","last_clean":"2024-09-12T02:02:13.674367+0000","last_became_active":"2024-09-12T00:32:14.602766+0000","last_became_peered":"2024-09-12T00:32:14.602766+0000","last_unstale":"2024-09-12T02:02:13.674367+0000","last_undegraded":"2024-09-12T02:02:13.674367+0000","last_fullsized":"2024-09-12T02:02:13.674367+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.170421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"266'26","reported_seq":151,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.719414+0000","last_change":"2024-09-12T00:26:23.322380+0000","last_active":"2024-09-12T02:04:48.719414+0000","last_peered":"2024-09-12T02:04:48.719414+0000","last_clean":"2024-09-12T02:04:48.719414+0000","last_became_active":"2024-09-12T00:26:23.321682+0000","last_became_peered":"2024-09-12T00:26:23.321682+0000","last_unstale":"2024-09-12T02:04:48.719414+0000","last_undegraded":"2024-09-12T02:04:48.719414+0000","last_fullsized":"2024-09-12T02:04:48.719414+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:28.612956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.710738+0000","last_change":"2024-09-12T01:00:24.076714+0000","last_active":"2024-09-12T02:03:13.710738+0000","last_peered":"2024-09-12T02:03:13.710738+0000","last_clean":"2024-09-12T02:03:13.710738+0000","last_became_active":"2024-09-12T01:00:24.075719+0000","last_became_peered":"2024-09-12T01:00:24.075719+0000","last_unstale":"2024-09-12T02:03:13.710738+0000","last_undegraded":"2024-09-12T02:03:13.710738+0000","last_fullsized":"2024-09-12T02:03:13.710738+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:33.848488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"266'2","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:08.555301+0000","last_change":"2024-09-12T00:32:21.664584+0000","last_active":"2024-09-12T02:06:08.555301+0000","last_peered":"2024-09-12T02:06:08.555301+0000","last_clean":"2024-09-12T02:06:08.555301+0000","last_became_active":"2024-09-12T00:32:21.663938+0000","last_became_peered":"2024-09-12T00:32:21.663938+0000","last_unstale":"2024-09-12T02:06:08.555301+0000","last_undegraded":"2024-09-12T02:06:08.555301+0000","last_fullsized":"2024-09-12T02:06:08.555301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:56.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"266'10","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.739819+0000","last_change":"2024-09-12T00:32:14.598635+0000","last_active":"2024-09-12T02:06:38.739819+0000","last_peered":"2024-09-12T02:06:38.739819+0000","last_clean":"2024-09-12T02:06:38.739819+0000","last_became_active":"2024-09-12T00:32:14.597094+0000","last_became_peered":"2024-09-12T00:32:14.597094+0000","last_unstale":"2024-09-12T02:06:38.739819+0000","last_undegraded":"2024-09-12T02:06:38.739819+0000","last_fullsized":"2024-09-12T02:06:38.739819+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:37.960853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24574,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"266'4","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525390+0000","last_change":"2024-09-12T00:26:23.350775+0000","last_active":"2024-09-12T02:03:53.525390+0000","last_peered":"2024-09-12T02:03:53.525390+0000","last_clean":"2024-09-12T02:03:53.525390+0000","last_became_active":"2024-09-12T00:26:23.349476+0000","last_became_peered":"2024-09-12T00:26:23.349476+0000","last_unstale":"2024-09-12T02:03:53.525390+0000","last_undegraded":"2024-09-12T02:03:53.525390+0000","last_fullsized":"2024-09-12T02:03:53.525390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:55.207200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959089+0000","last_change":"2024-09-12T01:00:24.070271+0000","last_active":"2024-09-12T02:03:23.959089+0000","last_peered":"2024-09-12T02:03:23.959089+0000","last_clean":"2024-09-12T02:03:23.959089+0000","last_became_active":"2024-09-12T01:00:24.069555+0000","last_became_peered":"2024-09-12T01:00:24.069555+0000","last_unstale":"2024-09-12T02:03:23.959089+0000","last_undegraded":"2024-09-12T02:03:23.959089+0000","last_fullsized":"2024-09-12T02:03:23.959089+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:30.440481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"266'1","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.979004+0000","last_change":"2024-09-12T00:32:21.658088+0000","last_active":"2024-09-12T02:04:38.979004+0000","last_peered":"2024-09-12T02:04:38.979004+0000","last_clean":"2024-09-12T02:04:38.979004+0000","last_became_active":"2024-09-12T00:32:21.654241+0000","last_became_peered":"2024-09-12T00:32:21.654241+0000","last_unstale":"2024-09-12T02:04:38.979004+0000","last_undegraded":"2024-09-12T02:04:38.979004+0000","last_fullsized":"2024-09-12T02:04:38.979004+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:08.083982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"266'13","reported_seq":98,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.298455+0000","last_change":"2024-09-12T00:32:14.586986+0000","last_active":"2024-09-12T02:06:46.298455+0000","last_peered":"2024-09-12T02:06:46.298455+0000","last_clean":"2024-09-12T02:06:46.298455+0000","last_became_active":"2024-09-12T00:32:14.586250+0000","last_became_peered":"2024-09-12T00:32:14.586250+0000","last_unstale":"2024-09-12T02:06:46.298455+0000","last_undegraded":"2024-09-12T02:06:46.298455+0000","last_fullsized":"2024-09-12T02:06:46.298455+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.871370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":31734,"num_write":18,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"266'26","reported_seq":142,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967298+0000","last_change":"2024-09-12T00:26:23.334469+0000","last_active":"2024-09-12T02:03:53.967298+0000","last_peered":"2024-09-12T02:03:53.967298+0000","last_clean":"2024-09-12T02:03:53.967298+0000","last_became_active":"2024-09-12T00:26:23.327186+0000","last_became_peered":"2024-09-12T00:26:23.327186+0000","last_unstale":"2024-09-12T02:03:53.967298+0000","last_undegraded":"2024-09-12T02:03:53.967298+0000","last_fullsized":"2024-09-12T02:03:53.967298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:43.603716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.977562+0000","last_change":"2024-09-12T01:00:24.078700+0000","last_active":"2024-09-12T02:04:33.977562+0000","last_peered":"2024-09-12T02:04:33.977562+0000","last_clean":"2024-09-12T02:04:33.977562+0000","last_became_active":"2024-09-12T01:00:24.077651+0000","last_became_peered":"2024-09-12T01:00:24.077651+0000","last_unstale":"2024-09-12T02:04:33.977562+0000","last_undegraded":"2024-09-12T02:04:33.977562+0000","last_fullsized":"2024-09-12T02:04:33.977562+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"266'4","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:01:59.712373+0000","last_change":"2024-09-12T00:32:21.651210+0000","last_active":"2024-09-12T02:01:59.712373+0000","last_peered":"2024-09-12T02:01:59.712373+0000","last_clean":"2024-09-12T02:01:59.712373+0000","last_became_active":"2024-09-12T00:32:21.649921+0000","last_became_peered":"2024-09-12T00:32:21.649921+0000","last_unstale":"2024-09-12T02:01:59.712373+0000","last_undegraded":"2024-09-12T02:01:59.712373+0000","last_fullsized":"2024-09-12T02:01:59.712373+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:54.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.528825+0000","last_change":"2024-09-12T00:32:14.608528+0000","last_active":"2024-09-12T02:04:08.528825+0000","last_peered":"2024-09-12T02:04:08.528825+0000","last_clean":"2024-09-12T02:04:08.528825+0000","last_became_active":"2024-09-12T00:32:14.607652+0000","last_became_peered":"2024-09-12T00:32:14.607652+0000","last_unstale":"2024-09-12T02:04:08.528825+0000","last_undegraded":"2024-09-12T02:04:08.528825+0000","last_fullsized":"2024-09-12T02:04:08.528825+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:12.098399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"266'15","reported_seq":114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967169+0000","last_change":"2024-09-12T00:26:23.343440+0000","last_active":"2024-09-12T02:03:53.967169+0000","last_peered":"2024-09-12T02:03:53.967169+0000","last_clean":"2024-09-12T02:03:53.967169+0000","last_became_active":"2024-09-12T00:26:23.339416+0000","last_became_peered":"2024-09-12T00:26:23.339416+0000","last_unstale":"2024-09-12T02:03:53.967169+0000","last_undegraded":"2024-09-12T02:03:53.967169+0000","last_fullsized":"2024-09-12T02:03:53.967169+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:20.570031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.683894+0000","last_change":"2024-09-12T01:00:24.065435+0000","last_active":"2024-09-12T02:02:53.683894+0000","last_peered":"2024-09-12T02:02:53.683894+0000","last_clean":"2024-09-12T02:02:53.683894+0000","last_became_active":"2024-09-12T01:00:24.064732+0000","last_became_peered":"2024-09-12T01:00:24.064732+0000","last_unstale":"2024-09-12T02:02:53.683894+0000","last_undegraded":"2024-09-12T02:02:53.683894+0000","last_fullsized":"2024-09-12T02:02:53.683894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:36.186270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"266'2","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.755847+0000","last_change":"2024-09-12T00:32:21.650109+0000","last_active":"2024-09-12T02:06:38.755847+0000","last_peered":"2024-09-12T02:06:38.755847+0000","last_clean":"2024-09-12T02:06:38.755847+0000","last_became_active":"2024-09-12T00:32:21.649260+0000","last_became_peered":"2024-09-12T00:32:21.649260+0000","last_unstale":"2024-09-12T02:06:38.755847+0000","last_undegraded":"2024-09-12T02:06:38.755847+0000","last_fullsized":"2024-09-12T02:06:38.755847+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:56.433116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'3","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:03.726329+0000","last_change":"2024-09-12T00:32:14.582866+0000","last_active":"2024-09-12T02:02:03.726329+0000","last_peered":"2024-09-12T02:02:03.726329+0000","last_clean":"2024-09-12T02:02:03.726329+0000","last_became_active":"2024-09-12T00:32:14.582112+0000","last_became_peered":"2024-09-12T00:32:14.582112+0000","last_unstale":"2024-09-12T02:02:03.726329+0000","last_undegraded":"2024-09-12T02:02:03.726329+0000","last_fullsized":"2024-09-12T02:02:03.726329+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:42.072877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"266'88","reported_seq":399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719464+0000","last_change":"2024-09-12T00:26:23.329328+0000","last_active":"2024-09-12T02:03:53.719464+0000","last_peered":"2024-09-12T02:03:53.719464+0000","last_clean":"2024-09-12T02:03:53.719464+0000","last_became_active":"2024-09-12T00:26:23.328597+0000","last_became_peered":"2024-09-12T00:26:23.328597+0000","last_unstale":"2024-09-12T02:03:53.719464+0000","last_undegraded":"2024-09-12T02:03:53.719464+0000","last_fullsized":"2024-09-12T02:03:53.719464+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:22.412755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":416,"num_write":108,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731863+0000","last_change":"2024-09-12T01:00:24.071788+0000","last_active":"2024-09-12T02:02:53.731863+0000","last_peered":"2024-09-12T02:02:53.731863+0000","last_clean":"2024-09-12T02:02:53.731863+0000","last_became_active":"2024-09-12T01:00:24.071095+0000","last_became_peered":"2024-09-12T01:00:24.071095+0000","last_unstale":"2024-09-12T02:02:53.731863+0000","last_undegraded":"2024-09-12T02:02:53.731863+0000","last_fullsized":"2024-09-12T02:02:53.731863+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:52.669721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"266'9","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.812457+0000","last_change":"2024-09-12T00:32:21.644665+0000","last_active":"2024-09-12T02:06:44.812457+0000","last_peered":"2024-09-12T02:06:44.812457+0000","last_clean":"2024-09-12T02:06:44.812457+0000","last_became_active":"2024-09-12T00:32:21.643876+0000","last_became_peered":"2024-09-12T00:32:21.643876+0000","last_unstale":"2024-09-12T02:06:44.812457+0000","last_undegraded":"2024-09-12T02:06:44.812457+0000","last_fullsized":"2024-09-12T02:06:44.812457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.090050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10236,"num_write":14,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.729779+0000","last_change":"2024-09-12T00:32:14.589458+0000","last_active":"2024-09-12T02:02:18.729779+0000","last_peered":"2024-09-12T02:02:18.729779+0000","last_clean":"2024-09-12T02:02:18.729779+0000","last_became_active":"2024-09-12T00:32:14.588375+0000","last_became_peered":"2024-09-12T00:32:14.588375+0000","last_unstale":"2024-09-12T02:02:18.729779+0000","last_undegraded":"2024-09-12T02:02:18.729779+0000","last_fullsized":"2024-09-12T02:02:18.729779+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:13.114682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7178,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"266'62","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.520452+0000","last_change":"2024-09-12T00:26:23.337872+0000","last_active":"2024-09-12T02:03:33.520452+0000","last_peered":"2024-09-12T02:03:33.520452+0000","last_clean":"2024-09-12T02:03:33.520452+0000","last_became_active":"2024-09-12T00:26:23.336278+0000","last_became_peered":"2024-09-12T00:26:23.336278+0000","last_unstale":"2024-09-12T02:03:33.520452+0000","last_undegraded":"2024-09-12T02:03:33.520452+0000","last_fullsized":"2024-09-12T02:03:33.520452+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:03.462066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":248,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731956+0000","last_change":"2024-09-12T01:00:24.078804+0000","last_active":"2024-09-12T02:02:53.731956+0000","last_peered":"2024-09-12T02:02:53.731956+0000","last_clean":"2024-09-12T02:02:53.731956+0000","last_became_active":"2024-09-12T01:00:24.078120+0000","last_became_peered":"2024-09-12T01:00:24.078120+0000","last_unstale":"2024-09-12T02:02:53.731956+0000","last_undegraded":"2024-09-12T02:02:53.731956+0000","last_fullsized":"2024-09-12T02:02:53.731956+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.036331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942038+0000","last_change":"2024-09-12T00:32:21.654093+0000","last_active":"2024-09-12T02:02:23.942038+0000","last_peered":"2024-09-12T02:02:23.942038+0000","last_clean":"2024-09-12T02:02:23.942038+0000","last_became_active":"2024-09-12T00:32:21.650564+0000","last_became_peered":"2024-09-12T00:32:21.650564+0000","last_unstale":"2024-09-12T02:02:23.942038+0000","last_undegraded":"2024-09-12T02:02:23.942038+0000","last_fullsized":"2024-09-12T02:02:23.942038+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:58.696714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.713920+0000","last_change":"2024-09-12T00:32:14.600836+0000","last_active":"2024-09-12T02:02:18.713920+0000","last_peered":"2024-09-12T02:02:18.713920+0000","last_clean":"2024-09-12T02:02:18.713920+0000","last_became_active":"2024-09-12T00:32:14.600188+0000","last_became_peered":"2024-09-12T00:32:14.600188+0000","last_unstale":"2024-09-12T02:02:18.713920+0000","last_undegraded":"2024-09-12T02:02:18.713920+0000","last_fullsized":"2024-09-12T02:02:18.713920+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:48.215097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"266'14","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.686029+0000","last_change":"2024-09-12T00:26:23.325628+0000","last_active":"2024-09-12T02:03:03.686029+0000","last_peered":"2024-09-12T02:03:03.686029+0000","last_clean":"2024-09-12T02:03:03.686029+0000","last_became_active":"2024-09-12T00:26:23.325067+0000","last_became_peered":"2024-09-12T00:26:23.325067+0000","last_unstale":"2024-09-12T02:03:03.686029+0000","last_undegraded":"2024-09-12T02:03:03.686029+0000","last_fullsized":"2024-09-12T02:03:03.686029+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.348834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690730+0000","last_change":"2024-09-12T01:00:24.075536+0000","last_active":"2024-09-12T02:03:23.690730+0000","last_peered":"2024-09-12T02:03:23.690730+0000","last_clean":"2024-09-12T02:03:23.690730+0000","last_became_active":"2024-09-12T01:00:24.075148+0000","last_became_peered":"2024-09-12T01:00:24.075148+0000","last_unstale":"2024-09-12T02:03:23.690730+0000","last_undegraded":"2024-09-12T02:03:23.690730+0000","last_fullsized":"2024-09-12T02:03:23.690730+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:59.023799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"266'1","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.972316+0000","last_change":"2024-09-12T00:32:21.658733+0000","last_active":"2024-09-12T02:04:13.972316+0000","last_peered":"2024-09-12T02:04:13.972316+0000","last_clean":"2024-09-12T02:04:13.972316+0000","last_became_active":"2024-09-12T00:32:21.654214+0000","last_became_peered":"2024-09-12T00:32:21.654214+0000","last_unstale":"2024-09-12T02:04:13.972316+0000","last_undegraded":"2024-09-12T02:04:13.972316+0000","last_fullsized":"2024-09-12T02:04:13.972316+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.587733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'5","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735335+0000","last_change":"2024-09-12T00:32:14.586921+0000","last_active":"2024-09-12T02:03:24.735335+0000","last_peered":"2024-09-12T02:03:24.735335+0000","last_clean":"2024-09-12T02:03:24.735335+0000","last_became_active":"2024-09-12T00:32:14.586101+0000","last_became_peered":"2024-09-12T00:32:14.586101+0000","last_unstale":"2024-09-12T02:03:24.735335+0000","last_undegraded":"2024-09-12T02:03:24.735335+0000","last_fullsized":"2024-09-12T02:03:24.735335+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:16.213342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"266'18","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.724550+0000","last_change":"2024-09-12T00:26:23.351546+0000","last_active":"2024-09-12T02:03:03.724550+0000","last_peered":"2024-09-12T02:03:03.724550+0000","last_clean":"2024-09-12T02:03:03.724550+0000","last_became_active":"2024-09-12T00:26:23.338890+0000","last_became_peered":"2024-09-12T00:26:23.338890+0000","last_unstale":"2024-09-12T02:03:03.724550+0000","last_undegraded":"2024-09-12T02:03:03.724550+0000","last_fullsized":"2024-09-12T02:03:03.724550+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:29.634760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.701374+0000","last_change":"2024-09-12T01:00:24.076901+0000","last_active":"2024-09-12T02:03:23.701374+0000","last_peered":"2024-09-12T02:03:23.701374+0000","last_clean":"2024-09-12T02:03:23.701374+0000","last_became_active":"2024-09-12T01:00:24.076081+0000","last_became_peered":"2024-09-12T01:00:24.076081+0000","last_unstale":"2024-09-12T02:03:23.701374+0000","last_undegraded":"2024-09-12T02:03:23.701374+0000","last_fullsized":"2024-09-12T02:03:23.701374+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:03.511093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'5","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.962875+0000","last_change":"2024-09-12T00:32:21.665472+0000","last_active":"2024-09-12T02:03:38.962875+0000","last_peered":"2024-09-12T02:03:38.962875+0000","last_clean":"2024-09-12T02:03:38.962875+0000","last_became_active":"2024-09-12T00:32:21.659460+0000","last_became_peered":"2024-09-12T00:32:21.659460+0000","last_unstale":"2024-09-12T02:03:38.962875+0000","last_undegraded":"2024-09-12T02:03:38.962875+0000","last_fullsized":"2024-09-12T02:03:38.962875+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:34.362543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:33.784493+0000","last_change":"2024-09-12T00:32:14.595556+0000","last_active":"2024-09-12T02:06:33.784493+0000","last_peered":"2024-09-12T02:06:33.784493+0000","last_clean":"2024-09-12T02:06:33.784493+0000","last_became_active":"2024-09-12T00:32:14.594973+0000","last_became_peered":"2024-09-12T00:32:14.594973+0000","last_unstale":"2024-09-12T02:06:33.784493+0000","last_undegraded":"2024-09-12T02:06:33.784493+0000","last_fullsized":"2024-09-12T02:06:33.784493+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":200,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.953162+0000","last_change":"2024-09-12T00:26:23.344345+0000","last_active":"2024-09-12T02:03:03.953162+0000","last_peered":"2024-09-12T02:03:03.953162+0000","last_clean":"2024-09-12T02:03:03.953162+0000","last_became_active":"2024-09-12T00:26:23.338462+0000","last_became_peered":"2024-09-12T00:26:23.338462+0000","last_unstale":"2024-09-12T02:03:03.953162+0000","last_undegraded":"2024-09-12T02:03:03.953162+0000","last_fullsized":"2024-09-12T02:03:03.953162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:51.275824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":170,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738756+0000","last_change":"2024-09-12T01:00:24.077452+0000","last_active":"2024-09-12T02:03:23.738756+0000","last_peered":"2024-09-12T02:03:23.738756+0000","last_clean":"2024-09-12T02:03:23.738756+0000","last_became_active":"2024-09-12T01:00:24.070957+0000","last_became_peered":"2024-09-12T01:00:24.070957+0000","last_unstale":"2024-09-12T02:03:23.738756+0000","last_undegraded":"2024-09-12T02:03:23.738756+0000","last_fullsized":"2024-09-12T02:03:23.738756+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:02.724541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"266'1","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.972451+0000","last_change":"2024-09-12T00:32:21.665635+0000","last_active":"2024-09-12T02:04:13.972451+0000","last_peered":"2024-09-12T02:04:13.972451+0000","last_clean":"2024-09-12T02:04:13.972451+0000","last_became_active":"2024-09-12T00:32:21.665036+0000","last_became_peered":"2024-09-12T00:32:21.665036+0000","last_unstale":"2024-09-12T02:04:13.972451+0000","last_undegraded":"2024-09-12T02:04:13.972451+0000","last_fullsized":"2024-09-12T02:04:13.972451+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.207114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2064,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:28.737035+0000","last_change":"2024-09-12T00:32:14.599371+0000","last_active":"2024-09-12T02:06:28.737035+0000","last_peered":"2024-09-12T02:06:28.737035+0000","last_clean":"2024-09-12T02:06:28.737035+0000","last_became_active":"2024-09-12T00:32:14.597944+0000","last_became_peered":"2024-09-12T00:32:14.597944+0000","last_unstale":"2024-09-12T02:06:28.737035+0000","last_undegraded":"2024-09-12T02:06:28.737035+0000","last_fullsized":"2024-09-12T02:06:28.737035+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:39.404510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"266'38","reported_seq":167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.696938+0000","last_change":"2024-09-12T00:26:23.318556+0000","last_active":"2024-09-12T02:03:03.696938+0000","last_peered":"2024-09-12T02:03:03.696938+0000","last_clean":"2024-09-12T02:03:03.696938+0000","last_became_active":"2024-09-12T00:26:23.317790+0000","last_became_peered":"2024-09-12T00:26:23.317790+0000","last_unstale":"2024-09-12T02:03:03.696938+0000","last_undegraded":"2024-09-12T02:03:03.696938+0000","last_fullsized":"2024-09-12T02:03:03.696938+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":107,"num_write":80,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735210+0000","last_change":"2024-09-12T01:00:24.078191+0000","last_active":"2024-09-12T02:03:24.735210+0000","last_peered":"2024-09-12T02:03:24.735210+0000","last_clean":"2024-09-12T02:03:24.735210+0000","last_became_active":"2024-09-12T01:00:24.077509+0000","last_became_peered":"2024-09-12T01:00:24.077509+0000","last_unstale":"2024-09-12T02:03:24.735210+0000","last_undegraded":"2024-09-12T02:03:24.735210+0000","last_fullsized":"2024-09-12T02:03:24.735210+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.532459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"266'2","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.788301+0000","last_change":"2024-09-12T00:32:21.652772+0000","last_active":"2024-09-12T02:06:38.788301+0000","last_peered":"2024-09-12T02:06:38.788301+0000","last_clean":"2024-09-12T02:06:38.788301+0000","last_became_active":"2024-09-12T00:32:21.644753+0000","last_became_peered":"2024-09-12T00:32:21.644753+0000","last_unstale":"2024-09-12T02:06:38.788301+0000","last_undegraded":"2024-09-12T02:06:38.788301+0000","last_fullsized":"2024-09-12T02:06:38.788301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:09.209891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:33.561239+0000","last_change":"2024-09-12T00:32:14.600221+0000","last_active":"2024-09-12T02:06:33.561239+0000","last_peered":"2024-09-12T02:06:33.561239+0000","last_clean":"2024-09-12T02:06:33.561239+0000","last_became_active":"2024-09-12T00:32:14.599452+0000","last_became_peered":"2024-09-12T00:32:14.599452+0000","last_unstale":"2024-09-12T02:06:33.561239+0000","last_undegraded":"2024-09-12T02:06:33.561239+0000","last_fullsized":"2024-09-12T02:06:33.561239+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:29.978923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"266'136","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.724784+0000","last_change":"2024-09-12T00:26:23.321368+0000","last_active":"2024-09-12T02:02:23.724784+0000","last_peered":"2024-09-12T02:02:23.724784+0000","last_clean":"2024-09-12T02:02:23.724784+0000","last_became_active":"2024-09-12T00:26:23.320613+0000","last_became_peered":"2024-09-12T00:26:23.320613+0000","last_unstale":"2024-09-12T02:02:23.724784+0000","last_undegraded":"2024-09-12T02:02:23.724784+0000","last_fullsized":"2024-09-12T02:02:23.724784+0000","mapping_epoch":253,"log_start":"263'100","ondisk_log_start":"263'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:54.209079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":872,"num_read_kb":592,"num_write":184,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956392+0000","last_change":"2024-09-12T01:00:24.061484+0000","last_active":"2024-09-12T02:03:13.956392+0000","last_peered":"2024-09-12T02:03:13.956392+0000","last_clean":"2024-09-12T02:03:13.956392+0000","last_became_active":"2024-09-12T01:00:24.060699+0000","last_became_peered":"2024-09-12T01:00:24.060699+0000","last_unstale":"2024-09-12T02:03:13.956392+0000","last_undegraded":"2024-09-12T02:03:13.956392+0000","last_fullsized":"2024-09-12T02:03:13.956392+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:39.025638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690685+0000","last_change":"2024-09-12T00:32:21.652868+0000","last_active":"2024-09-12T02:03:23.690685+0000","last_peered":"2024-09-12T02:03:23.690685+0000","last_clean":"2024-09-12T02:03:23.690685+0000","last_became_active":"2024-09-12T00:32:21.652122+0000","last_became_peered":"2024-09-12T00:32:21.652122+0000","last_unstale":"2024-09-12T02:03:23.690685+0000","last_undegraded":"2024-09-12T02:03:23.690685+0000","last_fullsized":"2024-09-12T02:03:23.690685+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:49.993050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"266'7","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:38.774817+0000","last_change":"2024-09-12T00:32:14.592680+0000","last_active":"2024-09-12T02:05:38.774817+0000","last_peered":"2024-09-12T02:05:38.774817+0000","last_clean":"2024-09-12T02:05:38.774817+0000","last_became_active":"2024-09-12T00:32:14.591921+0000","last_became_peered":"2024-09-12T00:32:14.591921+0000","last_unstale":"2024-09-12T02:05:38.774817+0000","last_undegraded":"2024-09-12T02:05:38.774817+0000","last_fullsized":"2024-09-12T02:05:38.774817+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:15.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3114,"num_write":12,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"266'28","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753409+0000","last_change":"2024-09-12T00:26:23.323596+0000","last_active":"2024-09-12T02:04:23.753409+0000","last_peered":"2024-09-12T02:04:23.753409+0000","last_clean":"2024-09-12T02:04:23.753409+0000","last_became_active":"2024-09-12T00:26:23.322866+0000","last_became_peered":"2024-09-12T00:26:23.322866+0000","last_unstale":"2024-09-12T02:04:23.753409+0000","last_undegraded":"2024-09-12T02:04:23.753409+0000","last_fullsized":"2024-09-12T02:04:23.753409+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:51.001961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727306+0000","last_change":"2024-09-12T01:00:24.064920+0000","last_active":"2024-09-12T02:03:13.727306+0000","last_peered":"2024-09-12T02:03:13.727306+0000","last_clean":"2024-09-12T02:03:13.727306+0000","last_became_active":"2024-09-12T01:00:24.064203+0000","last_became_peered":"2024-09-12T01:00:24.064203+0000","last_unstale":"2024-09-12T02:03:13.727306+0000","last_undegraded":"2024-09-12T02:03:13.727306+0000","last_fullsized":"2024-09-12T02:03:13.727306+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:14.355731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"266'7","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.657111+0000","last_change":"2024-09-12T00:32:21.660277+0000","last_active":"2024-09-12T02:06:45.657111+0000","last_peered":"2024-09-12T02:06:45.657111+0000","last_clean":"2024-09-12T02:06:45.657111+0000","last_became_active":"2024-09-12T00:32:21.659437+0000","last_became_peered":"2024-09-12T00:32:21.659437+0000","last_unstale":"2024-09-12T02:06:45.657111+0000","last_undegraded":"2024-09-12T02:06:45.657111+0000","last_fullsized":"2024-09-12T02:06:45.657111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:42.910621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":12,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"266'8","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956092+0000","last_change":"2024-09-12T00:32:14.599370+0000","last_active":"2024-09-12T02:03:13.956092+0000","last_peered":"2024-09-12T02:03:13.956092+0000","last_clean":"2024-09-12T02:03:13.956092+0000","last_became_active":"2024-09-12T00:32:14.597986+0000","last_became_peered":"2024-09-12T00:32:14.597986+0000","last_unstale":"2024-09-12T02:03:13.956092+0000","last_undegraded":"2024-09-12T02:03:13.956092+0000","last_fullsized":"2024-09-12T02:03:13.956092+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:36.841276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":11262,"num_write":13,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"266'46","reported_seq":199,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.532349+0000","last_change":"2024-09-12T00:26:23.336761+0000","last_active":"2024-09-12T02:04:23.532349+0000","last_peered":"2024-09-12T02:04:23.532349+0000","last_clean":"2024-09-12T02:04:23.532349+0000","last_became_active":"2024-09-12T00:26:23.336010+0000","last_became_peered":"2024-09-12T00:26:23.336010+0000","last_unstale":"2024-09-12T02:04:23.532349+0000","last_undegraded":"2024-09-12T02:04:23.532349+0000","last_fullsized":"2024-09-12T02:04:23.532349+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:52.664889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.523057+0000","last_change":"2024-09-12T01:00:24.074232+0000","last_active":"2024-09-12T02:03:43.523057+0000","last_peered":"2024-09-12T02:03:43.523057+0000","last_clean":"2024-09-12T02:03:43.523057+0000","last_became_active":"2024-09-12T01:00:24.061624+0000","last_became_peered":"2024-09-12T01:00:24.061624+0000","last_unstale":"2024-09-12T02:03:43.523057+0000","last_undegraded":"2024-09-12T02:03:43.523057+0000","last_fullsized":"2024-09-12T02:03:43.523057+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:30.381075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'7","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959211+0000","last_change":"2024-09-12T00:32:21.667593+0000","last_active":"2024-09-12T02:03:23.959211+0000","last_peered":"2024-09-12T02:03:23.959211+0000","last_clean":"2024-09-12T02:03:23.959211+0000","last_became_active":"2024-09-12T00:32:21.666101+0000","last_became_peered":"2024-09-12T00:32:21.666101+0000","last_unstale":"2024-09-12T02:03:23.959211+0000","last_undegraded":"2024-09-12T02:03:23.959211+0000","last_fullsized":"2024-09-12T02:03:23.959211+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:18.302518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3603,"num_write":12,"num_write_kb":1553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"266'3","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:38.742679+0000","last_change":"2024-09-12T00:32:14.580110+0000","last_active":"2024-09-12T02:05:38.742679+0000","last_peered":"2024-09-12T02:05:38.742679+0000","last_clean":"2024-09-12T02:05:38.742679+0000","last_became_active":"2024-09-12T00:32:14.579366+0000","last_became_peered":"2024-09-12T00:32:14.579366+0000","last_unstale":"2024-09-12T02:05:38.742679+0000","last_undegraded":"2024-09-12T02:05:38.742679+0000","last_fullsized":"2024-09-12T02:05:38.742679+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.632825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'8","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.757917+0000","last_change":"2024-09-12T00:26:23.323680+0000","last_active":"2024-09-12T02:04:23.757917+0000","last_peered":"2024-09-12T02:04:23.757917+0000","last_clean":"2024-09-12T02:04:23.757917+0000","last_became_active":"2024-09-12T00:26:23.322841+0000","last_became_peered":"2024-09-12T00:26:23.322841+0000","last_unstale":"2024-09-12T02:04:23.757917+0000","last_undegraded":"2024-09-12T02:04:23.757917+0000","last_fullsized":"2024-09-12T02:04:23.757917+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956312+0000","last_change":"2024-09-12T01:00:24.060507+0000","last_active":"2024-09-12T02:03:13.956312+0000","last_peered":"2024-09-12T02:03:13.956312+0000","last_clean":"2024-09-12T02:03:13.956312+0000","last_became_active":"2024-09-12T01:00:24.057061+0000","last_became_peered":"2024-09-12T01:00:24.057061+0000","last_unstale":"2024-09-12T02:03:13.956312+0000","last_undegraded":"2024-09-12T02:03:13.956312+0000","last_fullsized":"2024-09-12T02:03:13.956312+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:07.370347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"266'6","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.497296+0000","last_change":"2024-09-12T00:32:21.647911+0000","last_active":"2024-09-12T02:06:46.497296+0000","last_peered":"2024-09-12T02:06:46.497296+0000","last_clean":"2024-09-12T02:06:46.497296+0000","last_became_active":"2024-09-12T00:32:21.646690+0000","last_became_peered":"2024-09-12T00:32:21.646690+0000","last_unstale":"2024-09-12T02:06:46.497296+0000","last_undegraded":"2024-09-12T02:06:46.497296+0000","last_fullsized":"2024-09-12T02:06:46.497296+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:03.430085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2096,"num_write":6,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:14.733091+0000","last_change":"2024-09-12T00:32:14.577083+0000","last_active":"2024-09-12T02:03:14.733091+0000","last_peered":"2024-09-12T02:03:14.733091+0000","last_clean":"2024-09-12T02:03:14.733091+0000","last_became_active":"2024-09-12T00:32:14.576353+0000","last_became_peered":"2024-09-12T00:32:14.576353+0000","last_unstale":"2024-09-12T02:03:14.733091+0000","last_undegraded":"2024-09-12T02:03:14.733091+0000","last_fullsized":"2024-09-12T02:03:14.733091+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:17.483406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"266'19","reported_seq":129,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974634+0000","last_change":"2024-09-12T00:26:23.342320+0000","last_active":"2024-09-12T02:04:23.974634+0000","last_peered":"2024-09-12T02:04:23.974634+0000","last_clean":"2024-09-12T02:04:23.974634+0000","last_became_active":"2024-09-12T00:26:23.334078+0000","last_became_peered":"2024-09-12T00:26:23.334078+0000","last_unstale":"2024-09-12T02:04:23.974634+0000","last_undegraded":"2024-09-12T02:04:23.974634+0000","last_fullsized":"2024-09-12T02:04:23.974634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.869261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":39,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:28.702468+0000","last_change":"2024-09-12T01:00:24.076331+0000","last_active":"2024-09-12T02:03:28.702468+0000","last_peered":"2024-09-12T02:03:28.702468+0000","last_clean":"2024-09-12T02:03:28.702468+0000","last_became_active":"2024-09-12T01:00:24.075944+0000","last_became_peered":"2024-09-12T01:00:24.075944+0000","last_unstale":"2024-09-12T02:03:28.702468+0000","last_undegraded":"2024-09-12T02:03:28.702468+0000","last_fullsized":"2024-09-12T02:03:28.702468+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.174854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"266'3","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942289+0000","last_change":"2024-09-12T00:32:21.653900+0000","last_active":"2024-09-12T02:02:23.942289+0000","last_peered":"2024-09-12T02:02:23.942289+0000","last_clean":"2024-09-12T02:02:23.942289+0000","last_became_active":"2024-09-12T00:32:21.653054+0000","last_became_peered":"2024-09-12T00:32:21.653054+0000","last_unstale":"2024-09-12T02:02:23.942289+0000","last_undegraded":"2024-09-12T02:02:23.942289+0000","last_fullsized":"2024-09-12T02:02:23.942289+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:26.095259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8207,"num_write":3,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"266'10","reported_seq":91,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.035102+0000","last_change":"2024-09-12T00:32:14.597055+0000","last_active":"2024-09-12T02:06:45.035102+0000","last_peered":"2024-09-12T02:06:45.035102+0000","last_clean":"2024-09-12T02:06:45.035102+0000","last_became_active":"2024-09-12T00:32:14.596393+0000","last_became_peered":"2024-09-12T00:32:14.596393+0000","last_unstale":"2024-09-12T02:06:45.035102+0000","last_undegraded":"2024-09-12T02:06:45.035102+0000","last_fullsized":"2024-09-12T02:06:45.035102+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:35.143044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9234,"num_write":10,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"266'13","reported_seq":109,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959403+0000","last_change":"2024-09-12T00:26:23.354584+0000","last_active":"2024-09-12T02:03:23.959403+0000","last_peered":"2024-09-12T02:03:23.959403+0000","last_clean":"2024-09-12T02:03:23.959403+0000","last_became_active":"2024-09-12T00:26:23.353590+0000","last_became_peered":"2024-09-12T00:26:23.353590+0000","last_unstale":"2024-09-12T02:03:23.959403+0000","last_undegraded":"2024-09-12T02:03:23.959403+0000","last_fullsized":"2024-09-12T02:03:23.959403+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:36.184285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":34,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738884+0000","last_change":"2024-09-12T01:00:24.070343+0000","last_active":"2024-09-12T02:03:23.738884+0000","last_peered":"2024-09-12T02:03:23.738884+0000","last_clean":"2024-09-12T02:03:23.738884+0000","last_became_active":"2024-09-12T01:00:24.069491+0000","last_became_peered":"2024-09-12T01:00:24.069491+0000","last_unstale":"2024-09-12T02:03:23.738884+0000","last_undegraded":"2024-09-12T02:03:23.738884+0000","last_fullsized":"2024-09-12T02:03:23.738884+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:08.859472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942173+0000","last_change":"2024-09-12T00:32:21.668898+0000","last_active":"2024-09-12T02:02:23.942173+0000","last_peered":"2024-09-12T02:02:23.942173+0000","last_clean":"2024-09-12T02:02:23.942173+0000","last_became_active":"2024-09-12T00:32:21.668268+0000","last_became_peered":"2024-09-12T00:32:21.668268+0000","last_unstale":"2024-09-12T02:02:23.942173+0000","last_undegraded":"2024-09-12T02:02:23.942173+0000","last_fullsized":"2024-09-12T02:02:23.942173+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:44.371260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"266'7","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.567934+0000","last_change":"2024-09-12T00:32:14.610770+0000","last_active":"2024-09-12T02:06:45.567934+0000","last_peered":"2024-09-12T02:06:45.567934+0000","last_clean":"2024-09-12T02:06:45.567934+0000","last_became_active":"2024-09-12T00:32:14.610187+0000","last_became_peered":"2024-09-12T00:32:14.610187+0000","last_unstale":"2024-09-12T02:06:45.567934+0000","last_undegraded":"2024-09-12T02:06:45.567934+0000","last_fullsized":"2024-09-12T02:06:45.567934+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:04.103920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2577,"num_write":12,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:09.732099+0000","last_change":"2024-09-12T00:26:23.333218+0000","last_active":"2024-09-12T02:03:09.732099+0000","last_peered":"2024-09-12T02:03:09.732099+0000","last_clean":"2024-09-12T02:03:09.732099+0000","last_became_active":"2024-09-12T00:26:23.328238+0000","last_became_peered":"2024-09-12T00:26:23.328238+0000","last_unstale":"2024-09-12T02:03:09.732099+0000","last_undegraded":"2024-09-12T02:03:09.732099+0000","last_fullsized":"2024-09-12T02:03:09.732099+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:08.447428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.710796+0000","last_change":"2024-09-12T01:00:24.075014+0000","last_active":"2024-09-12T02:03:13.710796+0000","last_peered":"2024-09-12T02:03:13.710796+0000","last_clean":"2024-09-12T02:03:13.710796+0000","last_became_active":"2024-09-12T01:00:24.074237+0000","last_became_peered":"2024-09-12T01:00:24.074237+0000","last_unstale":"2024-09-12T02:03:13.710796+0000","last_undegraded":"2024-09-12T02:03:13.710796+0000","last_fullsized":"2024-09-12T02:03:13.710796+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:45.410941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.683956+0000","last_change":"2024-09-12T00:32:21.643228+0000","last_active":"2024-09-12T02:02:53.683956+0000","last_peered":"2024-09-12T02:02:53.683956+0000","last_clean":"2024-09-12T02:02:53.683956+0000","last_became_active":"2024-09-12T00:32:21.642517+0000","last_became_peered":"2024-09-12T00:32:21.642517+0000","last_unstale":"2024-09-12T02:02:53.683956+0000","last_undegraded":"2024-09-12T02:02:53.683956+0000","last_fullsized":"2024-09-12T02:02:53.683956+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:33.274779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.299857+0000","last_change":"2024-09-12T00:32:14.608254+0000","last_active":"2024-09-12T02:06:46.299857+0000","last_peered":"2024-09-12T02:06:46.299857+0000","last_clean":"2024-09-12T02:06:46.299857+0000","last_became_active":"2024-09-12T00:32:14.607520+0000","last_became_peered":"2024-09-12T00:32:14.607520+0000","last_unstale":"2024-09-12T02:06:46.299857+0000","last_undegraded":"2024-09-12T02:06:46.299857+0000","last_fullsized":"2024-09-12T02:06:46.299857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:55.311964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"266'27","reported_seq":149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.709720+0000","last_change":"2024-09-12T00:26:23.314752+0000","last_active":"2024-09-12T02:03:08.709720+0000","last_peered":"2024-09-12T02:03:08.709720+0000","last_clean":"2024-09-12T02:03:08.709720+0000","last_became_active":"2024-09-12T00:26:23.313697+0000","last_became_peered":"2024-09-12T00:26:23.313697+0000","last_unstale":"2024-09-12T02:03:08.709720+0000","last_undegraded":"2024-09-12T02:03:08.709720+0000","last_fullsized":"2024-09-12T02:03:08.709720+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:17.759882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.736399+0000","last_change":"2024-09-12T01:00:24.077672+0000","last_active":"2024-09-12T02:03:13.736399+0000","last_peered":"2024-09-12T02:03:13.736399+0000","last_clean":"2024-09-12T02:03:13.736399+0000","last_became_active":"2024-09-12T01:00:24.072931+0000","last_became_peered":"2024-09-12T01:00:24.072931+0000","last_unstale":"2024-09-12T02:03:13.736399+0000","last_undegraded":"2024-09-12T02:03:13.736399+0000","last_fullsized":"2024-09-12T02:03:13.736399+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:03.310383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"266'7","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942349+0000","last_change":"2024-09-12T00:32:21.649878+0000","last_active":"2024-09-12T02:02:23.942349+0000","last_peered":"2024-09-12T02:02:23.942349+0000","last_clean":"2024-09-12T02:02:23.942349+0000","last_became_active":"2024-09-12T00:32:21.641431+0000","last_became_peered":"2024-09-12T00:32:21.641431+0000","last_unstale":"2024-09-12T02:02:23.942349+0000","last_undegraded":"2024-09-12T02:02:23.942349+0000","last_fullsized":"2024-09-12T02:02:23.942349+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:17.569247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":20470,"num_write":12,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681384+0000","last_change":"2024-09-12T00:32:14.597040+0000","last_active":"2024-09-12T02:02:43.681384+0000","last_peered":"2024-09-12T02:02:43.681384+0000","last_clean":"2024-09-12T02:02:43.681384+0000","last_became_active":"2024-09-12T00:32:14.596263+0000","last_became_peered":"2024-09-12T00:32:14.596263+0000","last_unstale":"2024-09-12T02:02:43.681384+0000","last_undegraded":"2024-09-12T02:02:43.681384+0000","last_fullsized":"2024-09-12T02:02:43.681384+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:09.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"266'66","reported_seq":265,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.698119+0000","last_change":"2024-09-12T00:26:23.328307+0000","last_active":"2024-09-12T02:03:08.698119+0000","last_peered":"2024-09-12T02:03:08.698119+0000","last_clean":"2024-09-12T02:03:08.698119+0000","last_became_active":"2024-09-12T00:26:23.327784+0000","last_became_peered":"2024-09-12T00:26:23.327784+0000","last_unstale":"2024-09-12T02:03:08.698119+0000","last_undegraded":"2024-09-12T02:03:08.698119+0000","last_fullsized":"2024-09-12T02:03:08.698119+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:59.830797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":253,"num_write":117,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959347+0000","last_change":"2024-09-12T01:00:24.067841+0000","last_active":"2024-09-12T02:03:23.959347+0000","last_peered":"2024-09-12T02:03:23.959347+0000","last_clean":"2024-09-12T02:03:23.959347+0000","last_became_active":"2024-09-12T01:00:24.066842+0000","last_became_peered":"2024-09-12T01:00:24.066842+0000","last_unstale":"2024-09-12T02:03:23.959347+0000","last_undegraded":"2024-09-12T02:03:23.959347+0000","last_fullsized":"2024-09-12T02:03:23.959347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:36.376146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.744288+0000","last_change":"2024-09-12T00:32:21.667714+0000","last_active":"2024-09-12T02:03:23.744288+0000","last_peered":"2024-09-12T02:03:23.744288+0000","last_clean":"2024-09-12T02:03:23.744288+0000","last_became_active":"2024-09-12T00:32:21.667149+0000","last_became_peered":"2024-09-12T00:32:21.667149+0000","last_unstale":"2024-09-12T02:03:23.744288+0000","last_undegraded":"2024-09-12T02:03:23.744288+0000","last_fullsized":"2024-09-12T02:03:23.744288+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:34.141900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"266'3","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:28.547343+0000","last_change":"2024-09-12T00:32:14.601942+0000","last_active":"2024-09-12T02:05:28.547343+0000","last_peered":"2024-09-12T02:05:28.547343+0000","last_clean":"2024-09-12T02:05:28.547343+0000","last_became_active":"2024-09-12T00:32:14.601148+0000","last_became_peered":"2024-09-12T00:32:14.601148+0000","last_unstale":"2024-09-12T02:05:28.547343+0000","last_undegraded":"2024-09-12T02:05:28.547343+0000","last_fullsized":"2024-09-12T02:05:28.547343+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:16.003152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"266'39","reported_seq":182,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.725801+0000","last_change":"2024-09-12T00:26:23.318410+0000","last_active":"2024-09-12T02:03:08.725801+0000","last_peered":"2024-09-12T02:03:08.725801+0000","last_clean":"2024-09-12T02:03:08.725801+0000","last_became_active":"2024-09-12T00:26:23.317880+0000","last_became_peered":"2024-09-12T00:26:23.317880+0000","last_unstale":"2024-09-12T02:03:08.725801+0000","last_undegraded":"2024-09-12T02:03:08.725801+0000","last_fullsized":"2024-09-12T02:03:08.725801+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:35.423826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.742402+0000","last_change":"2024-09-12T01:00:24.086998+0000","last_active":"2024-09-12T02:03:38.742402+0000","last_peered":"2024-09-12T02:03:38.742402+0000","last_clean":"2024-09-12T02:03:38.742402+0000","last_became_active":"2024-09-12T01:00:24.086101+0000","last_became_peered":"2024-09-12T01:00:24.086101+0000","last_unstale":"2024-09-12T02:03:38.742402+0000","last_undegraded":"2024-09-12T02:03:38.742402+0000","last_fullsized":"2024-09-12T02:03:38.742402+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.433366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738790+0000","last_change":"2024-09-12T00:32:21.639641+0000","last_active":"2024-09-12T02:03:23.738790+0000","last_peered":"2024-09-12T02:03:23.738790+0000","last_clean":"2024-09-12T02:03:23.738790+0000","last_became_active":"2024-09-12T00:32:21.634440+0000","last_became_peered":"2024-09-12T00:32:21.634440+0000","last_unstale":"2024-09-12T02:03:23.738790+0000","last_undegraded":"2024-09-12T02:03:23.738790+0000","last_fullsized":"2024-09-12T02:03:23.738790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:52.190306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.770418+0000","last_change":"2024-09-12T00:32:14.596514+0000","last_active":"2024-09-12T02:06:45.770418+0000","last_peered":"2024-09-12T02:06:45.770418+0000","last_clean":"2024-09-12T02:06:45.770418+0000","last_became_active":"2024-09-12T00:32:14.595782+0000","last_became_peered":"2024-09-12T00:32:14.595782+0000","last_unstale":"2024-09-12T02:06:45.770418+0000","last_undegraded":"2024-09-12T02:06:45.770418+0000","last_fullsized":"2024-09-12T02:06:45.770418+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:40.885479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":165,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.750980+0000","last_change":"2024-09-12T00:26:23.324857+0000","last_active":"2024-09-12T02:04:13.750980+0000","last_peered":"2024-09-12T02:04:13.750980+0000","last_clean":"2024-09-12T02:04:13.750980+0000","last_became_active":"2024-09-12T00:26:23.324140+0000","last_became_peered":"2024-09-12T00:26:23.324140+0000","last_unstale":"2024-09-12T02:04:13.750980+0000","last_undegraded":"2024-09-12T02:04:13.750980+0000","last_fullsized":"2024-09-12T02:04:13.750980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:21.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":114,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738926+0000","last_change":"2024-09-12T01:00:24.081545+0000","last_active":"2024-09-12T02:03:23.738926+0000","last_peered":"2024-09-12T02:03:23.738926+0000","last_clean":"2024-09-12T02:03:23.738926+0000","last_became_active":"2024-09-12T01:00:24.080855+0000","last_became_peered":"2024-09-12T01:00:24.080855+0000","last_unstale":"2024-09-12T02:03:23.738926+0000","last_undegraded":"2024-09-12T02:03:23.738926+0000","last_fullsized":"2024-09-12T02:03:23.738926+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:06.572347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'4","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.676309+0000","last_change":"2024-09-12T00:32:21.649120+0000","last_active":"2024-09-12T02:02:23.676309+0000","last_peered":"2024-09-12T02:02:23.676309+0000","last_clean":"2024-09-12T02:02:23.676309+0000","last_became_active":"2024-09-12T00:32:21.648333+0000","last_became_peered":"2024-09-12T00:32:21.648333+0000","last_unstale":"2024-09-12T02:02:23.676309+0000","last_undegraded":"2024-09-12T02:02:23.676309+0000","last_fullsized":"2024-09-12T02:02:23.676309+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:27.155415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"266'4","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.770058+0000","last_change":"2024-09-12T00:32:14.600607+0000","last_active":"2024-09-12T02:06:45.770058+0000","last_peered":"2024-09-12T02:06:45.770058+0000","last_clean":"2024-09-12T02:06:45.770058+0000","last_became_active":"2024-09-12T00:32:14.592875+0000","last_became_peered":"2024-09-12T00:32:14.592875+0000","last_unstale":"2024-09-12T02:06:45.770058+0000","last_undegraded":"2024-09-12T02:06:45.770058+0000","last_fullsized":"2024-09-12T02:06:45.770058+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:09.233319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"266'15","reported_seq":118,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.966977+0000","last_change":"2024-09-12T00:26:23.325693+0000","last_active":"2024-09-12T02:03:53.966977+0000","last_peered":"2024-09-12T02:03:53.966977+0000","last_clean":"2024-09-12T02:03:53.966977+0000","last_became_active":"2024-09-12T00:26:23.324884+0000","last_became_peered":"2024-09-12T00:26:23.324884+0000","last_unstale":"2024-09-12T02:03:53.966977+0000","last_undegraded":"2024-09-12T02:03:53.966977+0000","last_fullsized":"2024-09-12T02:03:53.966977+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:53.038478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.517888+0000","last_change":"2024-09-12T01:00:24.062624+0000","last_active":"2024-09-12T02:03:23.517888+0000","last_peered":"2024-09-12T02:03:23.517888+0000","last_clean":"2024-09-12T02:03:23.517888+0000","last_became_active":"2024-09-12T01:00:24.061882+0000","last_became_peered":"2024-09-12T01:00:24.061882+0000","last_unstale":"2024-09-12T02:03:23.517888+0000","last_undegraded":"2024-09-12T02:03:23.517888+0000","last_fullsized":"2024-09-12T02:03:23.517888+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:52.723554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'4","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743502+0000","last_change":"2024-09-12T00:32:21.668310+0000","last_active":"2024-09-12T02:03:43.743502+0000","last_peered":"2024-09-12T02:03:43.743502+0000","last_clean":"2024-09-12T02:03:43.743502+0000","last_became_active":"2024-09-12T00:32:21.667346+0000","last_became_peered":"2024-09-12T00:32:21.667346+0000","last_unstale":"2024-09-12T02:03:43.743502+0000","last_undegraded":"2024-09-12T02:03:43.743502+0000","last_fullsized":"2024-09-12T02:03:43.743502+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:33.558216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"266'9","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.262602+0000","last_change":"2024-09-12T00:32:14.577757+0000","last_active":"2024-09-12T02:06:47.262602+0000","last_peered":"2024-09-12T02:06:47.262602+0000","last_clean":"2024-09-12T02:06:47.262602+0000","last_became_active":"2024-09-12T00:32:14.576974+0000","last_became_peered":"2024-09-12T00:32:14.576974+0000","last_unstale":"2024-09-12T02:06:47.262602+0000","last_undegraded":"2024-09-12T02:06:47.262602+0000","last_fullsized":"2024-09-12T02:06:47.262602+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:03.910967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4127,"num_write":14,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"266'52","reported_seq":231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719368+0000","last_change":"2024-09-12T00:26:23.316961+0000","last_active":"2024-09-12T02:03:53.719368+0000","last_peered":"2024-09-12T02:03:53.719368+0000","last_clean":"2024-09-12T02:03:53.719368+0000","last_became_active":"2024-09-12T00:26:23.315633+0000","last_became_peered":"2024-09-12T00:26:23.315633+0000","last_unstale":"2024-09-12T02:03:53.719368+0000","last_undegraded":"2024-09-12T02:03:53.719368+0000","last_fullsized":"2024-09-12T02:03:53.719368+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:49.483501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":203,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731755+0000","last_change":"2024-09-12T01:00:24.080426+0000","last_active":"2024-09-12T02:02:53.731755+0000","last_peered":"2024-09-12T02:02:53.731755+0000","last_clean":"2024-09-12T02:02:53.731755+0000","last_became_active":"2024-09-12T01:00:24.079834+0000","last_became_peered":"2024-09-12T01:00:24.079834+0000","last_unstale":"2024-09-12T02:02:53.731755+0000","last_undegraded":"2024-09-12T02:02:53.731755+0000","last_fullsized":"2024-09-12T02:02:53.731755+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:05.052155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.535089+0000","last_change":"2024-09-12T00:32:21.664365+0000","last_active":"2024-09-12T02:04:33.535089+0000","last_peered":"2024-09-12T02:04:33.535089+0000","last_clean":"2024-09-12T02:04:33.535089+0000","last_became_active":"2024-09-12T00:32:21.663547+0000","last_became_peered":"2024-09-12T00:32:21.663547+0000","last_unstale":"2024-09-12T02:04:33.535089+0000","last_undegraded":"2024-09-12T02:04:33.535089+0000","last_fullsized":"2024-09-12T02:04:33.535089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:42.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.747512+0000","last_change":"2024-09-12T00:32:14.596240+0000","last_active":"2024-09-12T02:03:58.747512+0000","last_peered":"2024-09-12T02:03:58.747512+0000","last_clean":"2024-09-12T02:03:58.747512+0000","last_became_active":"2024-09-12T00:32:14.593670+0000","last_became_peered":"2024-09-12T00:32:14.593670+0000","last_unstale":"2024-09-12T02:03:58.747512+0000","last_undegraded":"2024-09-12T02:03:58.747512+0000","last_fullsized":"2024-09-12T02:03:58.747512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:01.077637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'28","reported_seq":156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525498+0000","last_change":"2024-09-12T00:26:23.350883+0000","last_active":"2024-09-12T02:03:53.525498+0000","last_peered":"2024-09-12T02:03:53.525498+0000","last_clean":"2024-09-12T02:03:53.525498+0000","last_became_active":"2024-09-12T00:26:23.338248+0000","last_became_peered":"2024-09-12T00:26:23.338248+0000","last_unstale":"2024-09-12T02:03:53.525498+0000","last_undegraded":"2024-09-12T02:03:53.525498+0000","last_fullsized":"2024-09-12T02:03:53.525498+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:58.473095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:54.728722+0000","last_change":"2024-09-12T01:00:24.077369+0000","last_active":"2024-09-12T02:02:54.728722+0000","last_peered":"2024-09-12T02:02:54.728722+0000","last_clean":"2024-09-12T02:02:54.728722+0000","last_became_active":"2024-09-12T01:00:24.068145+0000","last_became_peered":"2024-09-12T01:00:24.068145+0000","last_unstale":"2024-09-12T02:02:54.728722+0000","last_undegraded":"2024-09-12T02:02:54.728722+0000","last_fullsized":"2024-09-12T02:02:54.728722+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:15.100781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.527728+0000","last_change":"2024-09-12T00:32:21.674579+0000","last_active":"2024-09-12T02:04:03.527728+0000","last_peered":"2024-09-12T02:04:03.527728+0000","last_clean":"2024-09-12T02:04:03.527728+0000","last_became_active":"2024-09-12T00:32:21.668979+0000","last_became_peered":"2024-09-12T00:32:21.668979+0000","last_unstale":"2024-09-12T02:04:03.527728+0000","last_undegraded":"2024-09-12T02:04:03.527728+0000","last_fullsized":"2024-09-12T02:04:03.527728+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:43.618228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.037358+0000","last_change":"2024-09-12T00:32:14.611138+0000","last_active":"2024-09-12T02:06:45.037358+0000","last_peered":"2024-09-12T02:06:45.037358+0000","last_clean":"2024-09-12T02:06:45.037358+0000","last_became_active":"2024-09-12T00:32:14.610414+0000","last_became_peered":"2024-09-12T00:32:14.610414+0000","last_unstale":"2024-09-12T02:06:45.037358+0000","last_undegraded":"2024-09-12T02:06:45.037358+0000","last_fullsized":"2024-09-12T02:06:45.037358+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.944085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"266'33","reported_seq":168,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719573+0000","last_change":"2024-09-12T00:26:23.328059+0000","last_active":"2024-09-12T02:03:53.719573+0000","last_peered":"2024-09-12T02:03:53.719573+0000","last_clean":"2024-09-12T02:03:53.719573+0000","last_became_active":"2024-09-12T00:26:23.327296+0000","last_became_peered":"2024-09-12T00:26:23.327296+0000","last_unstale":"2024-09-12T02:03:53.719573+0000","last_undegraded":"2024-09-12T02:03:53.719573+0000","last_fullsized":"2024-09-12T02:03:53.719573+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:43.942150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709243+0000","last_change":"2024-09-12T01:00:24.068043+0000","last_active":"2024-09-12T02:04:43.709243+0000","last_peered":"2024-09-12T02:04:43.709243+0000","last_clean":"2024-09-12T02:04:43.709243+0000","last_became_active":"2024-09-12T01:00:24.067665+0000","last_became_peered":"2024-09-12T01:00:24.067665+0000","last_unstale":"2024-09-12T02:04:43.709243+0000","last_undegraded":"2024-09-12T02:04:43.709243+0000","last_fullsized":"2024-09-12T02:04:43.709243+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:47.648058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.739021+0000","last_change":"2024-09-12T00:32:21.645575+0000","last_active":"2024-09-12T02:03:23.739021+0000","last_peered":"2024-09-12T02:03:23.739021+0000","last_clean":"2024-09-12T02:03:23.739021+0000","last_became_active":"2024-09-12T00:32:21.644891+0000","last_became_peered":"2024-09-12T00:32:21.644891+0000","last_unstale":"2024-09-12T02:03:23.739021+0000","last_undegraded":"2024-09-12T02:03:23.739021+0000","last_fullsized":"2024-09-12T02:03:23.739021+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.537775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"266'1","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:14.733184+0000","last_change":"2024-09-12T00:32:14.599778+0000","last_active":"2024-09-12T02:03:14.733184+0000","last_peered":"2024-09-12T02:03:14.733184+0000","last_clean":"2024-09-12T02:03:14.733184+0000","last_became_active":"2024-09-12T00:32:14.598981+0000","last_became_peered":"2024-09-12T00:32:14.598981+0000","last_unstale":"2024-09-12T02:03:14.733184+0000","last_undegraded":"2024-09-12T02:03:14.733184+0000","last_fullsized":"2024-09-12T02:03:14.733184+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:06.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3210,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"266'25","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.757357+0000","last_change":"2024-09-12T00:26:23.317228+0000","last_active":"2024-09-12T02:04:38.757357+0000","last_peered":"2024-09-12T02:04:38.757357+0000","last_clean":"2024-09-12T02:04:38.757357+0000","last_became_active":"2024-09-12T00:26:23.316443+0000","last_became_peered":"2024-09-12T00:26:23.316443+0000","last_unstale":"2024-09-12T02:04:38.757357+0000","last_undegraded":"2024-09-12T02:04:38.757357+0000","last_fullsized":"2024-09-12T02:04:38.757357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:54.406238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":90,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.737725+0000","last_change":"2024-09-12T01:00:24.072339+0000","last_active":"2024-09-12T02:02:53.737725+0000","last_peered":"2024-09-12T02:02:53.737725+0000","last_clean":"2024-09-12T02:02:53.737725+0000","last_became_active":"2024-09-12T01:00:24.071428+0000","last_became_peered":"2024-09-12T01:00:24.071428+0000","last_unstale":"2024-09-12T02:02:53.737725+0000","last_undegraded":"2024-09-12T02:02:53.737725+0000","last_fullsized":"2024-09-12T02:02:53.737725+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:11.332721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"266'9","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.740844+0000","last_change":"2024-09-12T00:32:21.654444+0000","last_active":"2024-09-12T02:06:46.740844+0000","last_peered":"2024-09-12T02:06:46.740844+0000","last_clean":"2024-09-12T02:06:46.740844+0000","last_became_active":"2024-09-12T00:32:21.653749+0000","last_became_peered":"2024-09-12T00:32:21.653749+0000","last_unstale":"2024-09-12T02:06:46.740844+0000","last_undegraded":"2024-09-12T02:06:46.740844+0000","last_fullsized":"2024-09-12T02:06:46.740844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:33.575071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.737749+0000","last_change":"2024-09-12T00:32:14.597114+0000","last_active":"2024-09-12T02:03:18.737749+0000","last_peered":"2024-09-12T02:03:18.737749+0000","last_clean":"2024-09-12T02:03:18.737749+0000","last_became_active":"2024-09-12T00:32:14.596498+0000","last_became_peered":"2024-09-12T00:32:14.596498+0000","last_unstale":"2024-09-12T02:03:18.737749+0000","last_undegraded":"2024-09-12T02:03:18.737749+0000","last_fullsized":"2024-09-12T02:03:18.737749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:03.408422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"266'50","reported_seq":218,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.703534+0000","last_change":"2024-09-12T00:26:23.341311+0000","last_active":"2024-09-12T02:04:18.703534+0000","last_peered":"2024-09-12T02:04:18.703534+0000","last_clean":"2024-09-12T02:04:18.703534+0000","last_became_active":"2024-09-12T00:26:23.340608+0000","last_became_peered":"2024-09-12T00:26:23.340608+0000","last_unstale":"2024-09-12T02:04:18.703534+0000","last_undegraded":"2024-09-12T02:04:18.703534+0000","last_fullsized":"2024-09-12T02:04:18.703534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:24.402590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":178,"num_write":83,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.699157+0000","last_change":"2024-09-12T01:00:24.083558+0000","last_active":"2024-09-12T02:03:13.699157+0000","last_peered":"2024-09-12T02:03:13.699157+0000","last_clean":"2024-09-12T02:03:13.699157+0000","last_became_active":"2024-09-12T01:00:24.083260+0000","last_became_peered":"2024-09-12T01:00:24.083260+0000","last_unstale":"2024-09-12T02:03:13.699157+0000","last_undegraded":"2024-09-12T02:03:13.699157+0000","last_fullsized":"2024-09-12T02:03:13.699157+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"266'9","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:08.726835+0000","last_change":"2024-09-12T00:32:21.656599+0000","last_active":"2024-09-12T02:06:08.726835+0000","last_peered":"2024-09-12T02:06:08.726835+0000","last_clean":"2024-09-12T02:06:08.726835+0000","last_became_active":"2024-09-12T00:32:21.655849+0000","last_became_peered":"2024-09-12T00:32:21.655849+0000","last_unstale":"2024-09-12T02:06:08.726835+0000","last_undegraded":"2024-09-12T02:06:08.726835+0000","last_fullsized":"2024-09-12T02:06:08.726835+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:45.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15358,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.785624+0000","last_change":"2024-09-12T00:32:14.605108+0000","last_active":"2024-09-12T02:06:38.785624+0000","last_peered":"2024-09-12T02:06:38.785624+0000","last_clean":"2024-09-12T02:06:38.785624+0000","last_became_active":"2024-09-12T00:32:14.604519+0000","last_became_peered":"2024-09-12T00:32:14.604519+0000","last_unstale":"2024-09-12T02:06:38.785624+0000","last_undegraded":"2024-09-12T02:06:38.785624+0000","last_fullsized":"2024-09-12T02:06:38.785624+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:45.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":153,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:19.747660+0000","last_change":"2024-09-12T00:26:23.332950+0000","last_active":"2024-09-12T02:04:19.747660+0000","last_peered":"2024-09-12T02:04:19.747660+0000","last_clean":"2024-09-12T02:04:19.747660+0000","last_became_active":"2024-09-12T00:26:23.328187+0000","last_became_peered":"2024-09-12T00:26:23.328187+0000","last_unstale":"2024-09-12T02:04:19.747660+0000","last_undegraded":"2024-09-12T02:04:19.747660+0000","last_fullsized":"2024-09-12T02:04:19.747660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.206262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":91,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727347+0000","last_change":"2024-09-12T01:00:24.063315+0000","last_active":"2024-09-12T02:03:13.727347+0000","last_peered":"2024-09-12T02:03:13.727347+0000","last_clean":"2024-09-12T02:03:13.727347+0000","last_became_active":"2024-09-12T01:00:24.062597+0000","last_became_peered":"2024-09-12T01:00:24.062597+0000","last_unstale":"2024-09-12T02:03:13.727347+0000","last_undegraded":"2024-09-12T02:03:13.727347+0000","last_fullsized":"2024-09-12T02:03:13.727347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:00.125865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:34.751341+0000","last_change":"2024-09-12T00:32:21.646859+0000","last_active":"2024-09-12T02:04:34.751341+0000","last_peered":"2024-09-12T02:04:34.751341+0000","last_clean":"2024-09-12T02:04:34.751341+0000","last_became_active":"2024-09-12T00:32:21.644950+0000","last_became_peered":"2024-09-12T00:32:21.644950+0000","last_unstale":"2024-09-12T02:04:34.751341+0000","last_undegraded":"2024-09-12T02:04:34.751341+0000","last_fullsized":"2024-09-12T02:04:34.751341+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:04.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.777079+0000","last_change":"2024-09-12T00:32:14.598048+0000","last_active":"2024-09-12T02:06:03.777079+0000","last_peered":"2024-09-12T02:06:03.777079+0000","last_clean":"2024-09-12T02:06:03.777079+0000","last_became_active":"2024-09-12T00:32:14.597376+0000","last_became_peered":"2024-09-12T00:32:14.597376+0000","last_unstale":"2024-09-12T02:06:03.777079+0000","last_undegraded":"2024-09-12T02:06:03.777079+0000","last_fullsized":"2024-09-12T02:06:03.777079+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:44.028314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"266'77","reported_seq":297,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.756664+0000","last_change":"2024-09-12T00:26:23.338797+0000","last_active":"2024-09-12T02:04:18.756664+0000","last_peered":"2024-09-12T02:04:18.756664+0000","last_clean":"2024-09-12T02:04:18.756664+0000","last_became_active":"2024-09-12T00:26:23.338274+0000","last_became_peered":"2024-09-12T00:26:23.338274+0000","last_unstale":"2024-09-12T02:04:18.756664+0000","last_undegraded":"2024-09-12T02:04:18.756664+0000","last_fullsized":"2024-09-12T02:04:18.756664+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:48.119590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":296,"num_write":117,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.722148+0000","last_change":"2024-09-12T01:00:24.054473+0000","last_active":"2024-09-12T02:02:53.722148+0000","last_peered":"2024-09-12T02:02:53.722148+0000","last_clean":"2024-09-12T02:02:53.722148+0000","last_became_active":"2024-09-12T01:00:24.053408+0000","last_became_peered":"2024-09-12T01:00:24.053408+0000","last_unstale":"2024-09-12T02:02:53.722148+0000","last_undegraded":"2024-09-12T02:02:53.722148+0000","last_fullsized":"2024-09-12T02:02:53.722148+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:50.708086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.721667+0000","last_change":"2024-09-12T00:32:33.790651+0000","last_active":"2024-09-12T02:04:03.721667+0000","last_peered":"2024-09-12T02:04:03.721667+0000","last_clean":"2024-09-12T02:04:03.721667+0000","last_became_active":"2024-09-12T00:32:33.790018+0000","last_became_peered":"2024-09-12T00:32:33.790018+0000","last_unstale":"2024-09-12T02:04:03.721667+0000","last_undegraded":"2024-09-12T02:04:03.721667+0000","last_fullsized":"2024-09-12T02:04:03.721667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:15.389367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.697604+0000","last_change":"2024-09-12T00:32:14.581204+0000","last_active":"2024-09-12T02:03:53.697604+0000","last_peered":"2024-09-12T02:03:53.697604+0000","last_clean":"2024-09-12T02:03:53.697604+0000","last_became_active":"2024-09-12T00:32:14.580350+0000","last_became_peered":"2024-09-12T00:32:14.580350+0000","last_unstale":"2024-09-12T02:03:53.697604+0000","last_undegraded":"2024-09-12T02:03:53.697604+0000","last_fullsized":"2024-09-12T02:03:53.697604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:27.342223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"266'23","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.724815+0000","last_change":"2024-09-12T00:26:23.327068+0000","last_active":"2024-09-12T02:04:18.724815+0000","last_peered":"2024-09-12T02:04:18.724815+0000","last_clean":"2024-09-12T02:04:18.724815+0000","last_became_active":"2024-09-12T00:26:23.318720+0000","last_became_peered":"2024-09-12T00:26:23.318720+0000","last_unstale":"2024-09-12T02:04:18.724815+0000","last_undegraded":"2024-09-12T02:04:18.724815+0000","last_fullsized":"2024-09-12T02:04:18.724815+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.176923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.735348+0000","last_change":"2024-09-12T01:00:24.074486+0000","last_active":"2024-09-12T02:03:08.735348+0000","last_peered":"2024-09-12T02:03:08.735348+0000","last_clean":"2024-09-12T02:03:08.735348+0000","last_became_active":"2024-09-12T01:00:24.072773+0000","last_became_peered":"2024-09-12T01:00:24.072773+0000","last_unstale":"2024-09-12T02:03:08.735348+0000","last_undegraded":"2024-09-12T02:03:08.735348+0000","last_fullsized":"2024-09-12T02:03:08.735348+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:12.560655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"266'8","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.466415+0000","last_change":"2024-09-12T00:32:21.644007+0000","last_active":"2024-09-12T02:06:45.466415+0000","last_peered":"2024-09-12T02:06:45.466415+0000","last_clean":"2024-09-12T02:06:45.466415+0000","last_became_active":"2024-09-12T00:32:21.643272+0000","last_became_peered":"2024-09-12T00:32:21.643272+0000","last_unstale":"2024-09-12T02:06:45.466415+0000","last_undegraded":"2024-09-12T02:06:45.466415+0000","last_fullsized":"2024-09-12T02:06:45.466415+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.420621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":18,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.720610+0000","last_change":"2024-09-12T00:32:14.580374+0000","last_active":"2024-09-12T02:03:58.720610+0000","last_peered":"2024-09-12T02:03:58.720610+0000","last_clean":"2024-09-12T02:03:58.720610+0000","last_became_active":"2024-09-12T00:32:14.579278+0000","last_became_peered":"2024-09-12T00:32:14.579278+0000","last_unstale":"2024-09-12T02:03:58.720610+0000","last_undegraded":"2024-09-12T02:03:58.720610+0000","last_fullsized":"2024-09-12T02:03:58.720610+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:01.599717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"266'19","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.758435+0000","last_change":"2024-09-12T00:26:23.306938+0000","last_active":"2024-09-12T02:04:43.758435+0000","last_peered":"2024-09-12T02:04:43.758435+0000","last_clean":"2024-09-12T02:04:43.758435+0000","last_became_active":"2024-09-12T00:26:23.306139+0000","last_became_peered":"2024-09-12T00:26:23.306139+0000","last_unstale":"2024-09-12T02:04:43.758435+0000","last_undegraded":"2024-09-12T02:04:43.758435+0000","last_fullsized":"2024-09-12T02:04:43.758435+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:31.920270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"266'329","reported_seq":1074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.558135+0000","last_change":"2024-09-12T00:09:59.316653+0000","last_active":"2024-09-12T02:06:47.558135+0000","last_peered":"2024-09-12T02:06:47.558135+0000","last_clean":"2024-09-12T02:06:47.558135+0000","last_became_active":"2024-09-12T00:09:59.316094+0000","last_became_peered":"2024-09-12T00:09:59.316094+0000","last_unstale":"2024-09-12T02:06:47.558135+0000","last_undegraded":"2024-09-12T02:06:47.558135+0000","last_fullsized":"2024-09-12T02:06:47.558135+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:40.253738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441871,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":581,"num_read_kb":103153,"num_write":998,"num_write_kb":38551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"266'995","reported_seq":2777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:34.723877+0000","last_change":"2024-09-12T00:10:01.282096+0000","last_active":"2024-09-12T02:02:34.723877+0000","last_peered":"2024-09-12T02:02:34.723877+0000","last_clean":"2024-09-12T02:02:34.723877+0000","last_became_active":"2024-09-12T00:10:01.281465+0000","last_became_peered":"2024-09-12T00:10:01.281465+0000","last_unstale":"2024-09-12T02:02:34.723877+0000","last_undegraded":"2024-09-12T02:02:34.723877+0000","last_fullsized":"2024-09-12T02:02:34.723877+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:52.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4736,"num_read_kb":4236,"num_write":1359,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"266'354","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.554535+0000","last_change":"2024-09-12T00:09:59.311726+0000","last_active":"2024-09-12T02:06:47.554535+0000","last_peered":"2024-09-12T02:06:47.554535+0000","last_clean":"2024-09-12T02:06:47.554535+0000","last_became_active":"2024-09-12T00:09:59.311178+0000","last_became_peered":"2024-09-12T00:09:59.311178+0000","last_unstale":"2024-09-12T02:06:47.554535+0000","last_undegraded":"2024-09-12T02:06:47.554535+0000","last_fullsized":"2024-09-12T02:06:47.554535+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:44.209100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399015,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":11355,"num_write":1177,"num_write_kb":19733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"266'875","reported_seq":2482,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.639756+0000","last_change":"2024-09-12T00:10:01.270508+0000","last_active":"2024-09-12T02:06:05.639756+0000","last_peered":"2024-09-12T02:06:05.639756+0000","last_clean":"2024-09-12T02:06:05.639756+0000","last_became_active":"2024-09-12T00:10:01.268068+0000","last_became_peered":"2024-09-12T00:10:01.268068+0000","last_unstale":"2024-09-12T02:06:05.639756+0000","last_undegraded":"2024-09-12T02:06:05.639756+0000","last_fullsized":"2024-09-12T02:06:05.639756+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:03.001681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4189,"num_read_kb":3768,"num_write":1161,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"266'376","reported_seq":1082,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.490697+0000","last_change":"2024-09-12T00:09:59.296889+0000","last_active":"2024-09-12T02:06:47.490697+0000","last_peered":"2024-09-12T02:06:47.490697+0000","last_clean":"2024-09-12T02:06:47.490697+0000","last_became_active":"2024-09-12T00:09:59.296557+0000","last_became_peered":"2024-09-12T00:09:59.296557+0000","last_unstale":"2024-09-12T02:06:47.490697+0000","last_undegraded":"2024-09-12T02:06:47.490697+0000","last_fullsized":"2024-09-12T02:06:47.490697+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:27.013161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653297,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":575,"num_read_kb":57177,"num_write":1185,"num_write_kb":38522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1196","reported_seq":2908,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.643791+0000","last_change":"2024-09-12T00:10:01.251720+0000","last_active":"2024-09-12T02:06:05.643791+0000","last_peered":"2024-09-12T02:06:05.643791+0000","last_clean":"2024-09-12T02:06:05.643791+0000","last_became_active":"2024-09-12T00:10:01.251038+0000","last_became_peered":"2024-09-12T00:10:01.251038+0000","last_unstale":"2024-09-12T02:06:05.643791+0000","last_undegraded":"2024-09-12T02:06:05.643791+0000","last_fullsized":"2024-09-12T02:06:05.643791+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:38.505152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5594,"num_read_kb":4965,"num_write":1641,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"266'257","reported_seq":906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.644958+0000","last_change":"2024-09-12T00:09:59.279104+0000","last_active":"2024-09-12T02:06:44.644958+0000","last_peered":"2024-09-12T02:06:44.644958+0000","last_clean":"2024-09-12T02:06:44.644958+0000","last_became_active":"2024-09-12T00:09:59.278426+0000","last_became_peered":"2024-09-12T00:09:59.278426+0000","last_unstale":"2024-09-12T02:06:44.644958+0000","last_undegraded":"2024-09-12T02:06:44.644958+0000","last_fullsized":"2024-09-12T02:06:44.644958+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:22.498936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13888078,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":381,"num_read_kb":8612,"num_write":971,"num_write_kb":32048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"266'440","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719993+0000","last_change":"2024-09-12T00:10:01.248182+0000","last_active":"2024-09-12T02:04:59.719993+0000","last_peered":"2024-09-12T02:04:59.719993+0000","last_clean":"2024-09-12T02:04:59.719993+0000","last_became_active":"2024-09-12T00:10:01.247807+0000","last_became_peered":"2024-09-12T00:10:01.247807+0000","last_unstale":"2024-09-12T02:04:59.719993+0000","last_undegraded":"2024-09-12T02:04:59.719993+0000","last_fullsized":"2024-09-12T02:04:59.719993+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.770019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2317,"num_read_kb":2164,"num_write":517,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"266'312","reported_seq":1021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.501611+0000","last_change":"2024-09-12T00:09:59.314721+0000","last_active":"2024-09-12T02:06:47.501611+0000","last_peered":"2024-09-12T02:06:47.501611+0000","last_clean":"2024-09-12T02:06:47.501611+0000","last_became_active":"2024-09-12T00:09:59.314222+0000","last_became_peered":"2024-09-12T00:09:59.314222+0000","last_unstale":"2024-09-12T02:06:47.501611+0000","last_undegraded":"2024-09-12T02:06:47.501611+0000","last_fullsized":"2024-09-12T02:06:47.501611+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:31.303567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":10075,"num_write":947,"num_write_kb":41375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"266'513","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.728189+0000","last_change":"2024-09-12T00:10:01.256948+0000","last_active":"2024-09-12T02:04:33.728189+0000","last_peered":"2024-09-12T02:04:33.728189+0000","last_clean":"2024-09-12T02:04:33.728189+0000","last_became_active":"2024-09-12T00:10:01.256253+0000","last_became_peered":"2024-09-12T00:10:01.256253+0000","last_unstale":"2024-09-12T02:04:33.728189+0000","last_undegraded":"2024-09-12T02:04:33.728189+0000","last_fullsized":"2024-09-12T02:04:33.728189+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:03.333567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2461,"num_read_kb":2278,"num_write":611,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"266'281","reported_seq":935,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.581178+0000","last_change":"2024-09-12T00:09:59.298976+0000","last_active":"2024-09-12T02:06:44.581178+0000","last_peered":"2024-09-12T02:06:44.581178+0000","last_clean":"2024-09-12T02:06:44.581178+0000","last_became_active":"2024-09-12T00:09:59.297821+0000","last_became_peered":"2024-09-12T00:09:59.297821+0000","last_unstale":"2024-09-12T02:06:44.581178+0000","last_undegraded":"2024-09-12T02:06:44.581178+0000","last_fullsized":"2024-09-12T02:06:44.581178+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:47.378293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6310664,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":428,"num_read_kb":14780,"num_write":902,"num_write_kb":35747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"266'378","reported_seq":1843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936221+0000","last_change":"2024-09-12T00:10:01.252712+0000","last_active":"2024-09-12T02:04:59.936221+0000","last_peered":"2024-09-12T02:04:59.936221+0000","last_clean":"2024-09-12T02:04:59.936221+0000","last_became_active":"2024-09-12T00:10:01.250663+0000","last_became_peered":"2024-09-12T00:10:01.250663+0000","last_unstale":"2024-09-12T02:04:59.936221+0000","last_undegraded":"2024-09-12T02:04:59.936221+0000","last_fullsized":"2024-09-12T02:04:59.936221+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:19.125375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2078,"num_read_kb":1972,"num_write":422,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"266'353","reported_seq":1123,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.478037+0000","last_change":"2024-09-12T00:09:59.312324+0000","last_active":"2024-09-12T02:06:47.478037+0000","last_peered":"2024-09-12T02:06:47.478037+0000","last_clean":"2024-09-12T02:06:47.478037+0000","last_became_active":"2024-09-12T00:09:59.311825+0000","last_became_peered":"2024-09-12T00:09:59.311825+0000","last_unstale":"2024-09-12T02:06:47.478037+0000","last_undegraded":"2024-09-12T02:06:47.478037+0000","last_fullsized":"2024-09-12T02:06:47.478037+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:41.321551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399264,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":842,"num_read_kb":88204,"num_write":1135,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"266'420","reported_seq":1882,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.720872+0000","last_change":"2024-09-12T00:10:01.275162+0000","last_active":"2024-09-12T02:04:59.720872+0000","last_peered":"2024-09-12T02:04:59.720872+0000","last_clean":"2024-09-12T02:04:59.720872+0000","last_became_active":"2024-09-12T00:10:01.274405+0000","last_became_peered":"2024-09-12T00:10:01.274405+0000","last_unstale":"2024-09-12T02:04:59.720872+0000","last_undegraded":"2024-09-12T02:04:59.720872+0000","last_fullsized":"2024-09-12T02:04:59.720872+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:26.880309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2137,"num_read_kb":2003,"num_write":477,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"266'327","reported_seq":1014,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.005054+0000","last_change":"2024-09-12T00:09:59.249333+0000","last_active":"2024-09-12T02:02:33.005054+0000","last_peered":"2024-09-12T02:02:33.005054+0000","last_clean":"2024-09-12T02:02:33.005054+0000","last_became_active":"2024-09-12T00:09:59.248750+0000","last_became_peered":"2024-09-12T00:09:59.248750+0000","last_unstale":"2024-09-12T02:02:33.005054+0000","last_undegraded":"2024-09-12T02:02:33.005054+0000","last_fullsized":"2024-09-12T02:02:33.005054+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:33.945077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10227707,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":647,"num_read_kb":26164,"num_write":1089,"num_write_kb":31035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"266'818","reported_seq":2443,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.717310+0000","last_change":"2024-09-12T00:10:01.249377+0000","last_active":"2024-09-12T02:04:38.717310+0000","last_peered":"2024-09-12T02:04:38.717310+0000","last_clean":"2024-09-12T02:04:38.717310+0000","last_became_active":"2024-09-12T00:10:01.249016+0000","last_became_peered":"2024-09-12T00:10:01.249016+0000","last_unstale":"2024-09-12T02:04:38.717310+0000","last_undegraded":"2024-09-12T02:04:38.717310+0000","last_fullsized":"2024-09-12T02:04:38.717310+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:28.289903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3841,"num_read_kb":3467,"num_write":1075,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"266'626","reported_seq":2380,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936425+0000","last_change":"2024-09-12T00:10:01.253763+0000","last_active":"2024-09-12T02:04:59.936425+0000","last_peered":"2024-09-12T02:04:59.936425+0000","last_clean":"2024-09-12T02:04:59.936425+0000","last_became_active":"2024-09-12T00:10:01.252790+0000","last_became_peered":"2024-09-12T00:10:01.252790+0000","last_unstale":"2024-09-12T02:04:59.936425+0000","last_undegraded":"2024-09-12T02:04:59.936425+0000","last_fullsized":"2024-09-12T02:04:59.936425+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.963549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2892,"num_write":772,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"266'411","reported_seq":1108,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.552876+0000","last_change":"2024-09-12T00:09:59.288779+0000","last_active":"2024-09-12T02:06:47.552876+0000","last_peered":"2024-09-12T02:06:47.552876+0000","last_clean":"2024-09-12T02:06:47.552876+0000","last_became_active":"2024-09-12T00:09:59.285279+0000","last_became_peered":"2024-09-12T00:09:59.285279+0000","last_unstale":"2024-09-12T02:06:47.552876+0000","last_undegraded":"2024-09-12T02:06:47.552876+0000","last_fullsized":"2024-09-12T02:06:47.552876+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:31.545971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569417,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":647,"num_read_kb":33158,"num_write":1312,"num_write_kb":40723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"266'380","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753363+0000","last_change":"2024-09-12T00:10:01.271450+0000","last_active":"2024-09-12T02:04:23.753363+0000","last_peered":"2024-09-12T02:04:23.753363+0000","last_clean":"2024-09-12T02:04:23.753363+0000","last_became_active":"2024-09-12T00:10:01.269235+0000","last_became_peered":"2024-09-12T00:10:01.269235+0000","last_unstale":"2024-09-12T02:04:23.753363+0000","last_undegraded":"2024-09-12T02:04:23.753363+0000","last_fullsized":"2024-09-12T02:04:23.753363+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:12.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2516,"num_read_kb":2424,"num_write":449,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"266'351","reported_seq":992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.410595+0000","last_change":"2024-09-12T00:09:59.303818+0000","last_active":"2024-09-12T02:06:47.410595+0000","last_peered":"2024-09-12T02:06:47.410595+0000","last_clean":"2024-09-12T02:06:47.410595+0000","last_became_active":"2024-09-12T00:09:59.298975+0000","last_became_peered":"2024-09-12T00:09:59.298975+0000","last_unstale":"2024-09-12T02:06:47.410595+0000","last_undegraded":"2024-09-12T02:06:47.410595+0000","last_fullsized":"2024-09-12T02:06:47.410595+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:31.548154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":20543,"num_write":987,"num_write_kb":37808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"266'1147","reported_seq":2680,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:19.720322+0000","last_change":"2024-09-12T00:10:01.275965+0000","last_active":"2024-09-12T02:02:19.720322+0000","last_peered":"2024-09-12T02:02:19.720322+0000","last_clean":"2024-09-12T02:02:19.720322+0000","last_became_active":"2024-09-12T00:10:01.270566+0000","last_became_peered":"2024-09-12T00:10:01.270566+0000","last_unstale":"2024-09-12T02:02:19.720322+0000","last_undegraded":"2024-09-12T02:02:19.720322+0000","last_fullsized":"2024-09-12T02:02:19.720322+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":1100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:08.981670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5146,"num_read_kb":4532,"num_write":1573,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"266'328","reported_seq":976,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.549542+0000","last_change":"2024-09-12T00:10:31.476025+0000","last_active":"2024-09-12T02:06:47.549542+0000","last_peered":"2024-09-12T02:06:47.549542+0000","last_clean":"2024-09-12T02:06:47.549542+0000","last_became_active":"2024-09-12T00:10:31.475207+0000","last_became_peered":"2024-09-12T00:10:31.475207+0000","last_unstale":"2024-09-12T02:06:47.549542+0000","last_undegraded":"2024-09-12T02:06:47.549542+0000","last_fullsized":"2024-09-12T02:06:47.549542+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:42.892508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35516,"num_write":1077,"num_write_kb":27332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"266'424","reported_seq":2056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.704716+0000","last_change":"2024-09-12T00:10:01.249435+0000","last_active":"2024-09-12T02:03:38.704716+0000","last_peered":"2024-09-12T02:03:38.704716+0000","last_clean":"2024-09-12T02:03:38.704716+0000","last_became_active":"2024-09-12T00:10:01.249060+0000","last_became_peered":"2024-09-12T00:10:01.249060+0000","last_unstale":"2024-09-12T02:03:38.704716+0000","last_undegraded":"2024-09-12T02:03:38.704716+0000","last_fullsized":"2024-09-12T02:03:38.704716+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:57.590588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2301,"num_write":498,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"266'349","reported_seq":1014,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.459203+0000","last_change":"2024-09-12T00:09:59.309576+0000","last_active":"2024-09-12T02:06:47.459203+0000","last_peered":"2024-09-12T02:06:47.459203+0000","last_clean":"2024-09-12T02:06:47.459203+0000","last_became_active":"2024-09-12T00:09:59.308979+0000","last_became_peered":"2024-09-12T00:09:59.308979+0000","last_unstale":"2024-09-12T02:06:47.459203+0000","last_undegraded":"2024-09-12T02:06:47.459203+0000","last_fullsized":"2024-09-12T02:06:47.459203+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:02.012541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9921950,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":33875,"num_write":1037,"num_write_kb":29129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"266'437","reported_seq":1921,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.543220+0000","last_change":"2024-09-12T00:10:01.239020+0000","last_active":"2024-09-12T02:04:57.543220+0000","last_peered":"2024-09-12T02:04:57.543220+0000","last_clean":"2024-09-12T02:04:57.543220+0000","last_became_active":"2024-09-12T00:10:01.238251+0000","last_became_peered":"2024-09-12T00:10:01.238251+0000","last_unstale":"2024-09-12T02:04:57.543220+0000","last_undegraded":"2024-09-12T02:04:57.543220+0000","last_fullsized":"2024-09-12T02:04:57.543220+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:04.492050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2194,"num_read_kb":2058,"num_write":515,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"266'254","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.961470+0000","last_change":"2024-09-12T00:09:59.263678+0000","last_active":"2024-09-12T02:03:33.961470+0000","last_peered":"2024-09-12T02:03:33.961470+0000","last_clean":"2024-09-12T02:03:33.961470+0000","last_became_active":"2024-09-12T00:09:59.262666+0000","last_became_peered":"2024-09-12T00:09:59.262666+0000","last_unstale":"2024-09-12T02:03:33.961470+0000","last_undegraded":"2024-09-12T02:03:33.961470+0000","last_fullsized":"2024-09-12T02:03:33.961470+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:36.226668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13397264,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":363,"num_read_kb":23030,"num_write":926,"num_write_kb":39870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"266'656","reported_seq":2175,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.747746+0000","last_change":"2024-09-12T00:10:01.258577+0000","last_active":"2024-09-12T02:03:38.747746+0000","last_peered":"2024-09-12T02:03:38.747746+0000","last_clean":"2024-09-12T02:03:38.747746+0000","last_became_active":"2024-09-12T00:10:01.257792+0000","last_became_peered":"2024-09-12T00:10:01.257792+0000","last_unstale":"2024-09-12T02:03:38.747746+0000","last_undegraded":"2024-09-12T02:03:38.747746+0000","last_fullsized":"2024-09-12T02:03:38.747746+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:43.563199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3304,"num_read_kb":2964,"num_write":919,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"266'329","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.315223+0000","last_change":"2024-09-12T00:09:59.294360+0000","last_active":"2024-09-12T02:06:47.315223+0000","last_peered":"2024-09-12T02:06:47.315223+0000","last_clean":"2024-09-12T02:06:47.315223+0000","last_became_active":"2024-09-12T00:09:59.293921+0000","last_became_peered":"2024-09-12T00:09:59.293921+0000","last_unstale":"2024-09-12T02:06:47.315223+0000","last_undegraded":"2024-09-12T02:06:47.315223+0000","last_fullsized":"2024-09-12T02:06:47.315223+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:40.424733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262199,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":482,"num_read_kb":35722,"num_write":1084,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"266'142","reported_seq":678,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.114050+0000","last_change":"2024-09-12T00:10:09.356862+0000","last_active":"2024-09-12T02:06:07.114050+0000","last_peered":"2024-09-12T02:06:07.114050+0000","last_clean":"2024-09-12T02:06:07.114050+0000","last_became_active":"2024-09-12T00:10:09.356144+0000","last_became_peered":"2024-09-12T00:10:09.356144+0000","last_unstale":"2024-09-12T02:06:07.114050+0000","last_undegraded":"2024-09-12T02:06:07.114050+0000","last_fullsized":"2024-09-12T02:06:07.114050+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:09.813648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":339,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"266'785","reported_seq":2333,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.852208+0000","last_change":"2024-09-12T00:10:01.259453+0000","last_active":"2024-09-12T02:04:59.852208+0000","last_peered":"2024-09-12T02:04:59.852208+0000","last_clean":"2024-09-12T02:04:59.852208+0000","last_became_active":"2024-09-12T00:10:01.259053+0000","last_became_peered":"2024-09-12T00:10:01.259053+0000","last_unstale":"2024-09-12T02:04:59.852208+0000","last_undegraded":"2024-09-12T02:04:59.852208+0000","last_fullsized":"2024-09-12T02:04:59.852208+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:38.055321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3705,"num_read_kb":3341,"num_write":1024,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"266'390","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.443615+0000","last_change":"2024-09-12T00:09:59.311180+0000","last_active":"2024-09-12T02:06:47.443615+0000","last_peered":"2024-09-12T02:06:47.443615+0000","last_clean":"2024-09-12T02:06:47.443615+0000","last_became_active":"2024-09-12T00:09:59.310643+0000","last_became_peered":"2024-09-12T00:09:59.310643+0000","last_unstale":"2024-09-12T02:06:47.443615+0000","last_undegraded":"2024-09-12T02:06:47.443615+0000","last_fullsized":"2024-09-12T02:06:47.443615+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:20.368803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136934,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":31265,"num_write":1302,"num_write_kb":60174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.738969+0000","last_change":"2024-09-12T00:10:03.273556+0000","last_active":"2024-09-12T02:03:39.738969+0000","last_peered":"2024-09-12T02:03:39.738969+0000","last_clean":"2024-09-12T02:03:39.738969+0000","last_became_active":"2024-09-12T00:10:03.271233+0000","last_became_peered":"2024-09-12T00:10:03.271233+0000","last_unstale":"2024-09-12T02:03:39.738969+0000","last_undegraded":"2024-09-12T02:03:39.738969+0000","last_fullsized":"2024-09-12T02:03:39.738969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:53.667695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"266'375","reported_seq":1034,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.087115+0000","last_change":"2024-09-12T00:10:05.286196+0000","last_active":"2024-09-12T02:06:47.087115+0000","last_peered":"2024-09-12T02:06:47.087115+0000","last_clean":"2024-09-12T02:06:47.087115+0000","last_became_active":"2024-09-12T00:10:05.285417+0000","last_became_peered":"2024-09-12T00:10:05.285417+0000","last_unstale":"2024-09-12T02:06:47.087115+0000","last_undegraded":"2024-09-12T02:06:47.087115+0000","last_fullsized":"2024-09-12T02:06:47.087115+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.508820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47464,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1152,"num_write":460,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743886+0000","last_change":"2024-09-12T00:10:07.318948+0000","last_active":"2024-09-12T02:03:43.743886+0000","last_peered":"2024-09-12T02:03:43.743886+0000","last_clean":"2024-09-12T02:03:43.743886+0000","last_became_active":"2024-09-12T00:10:07.318114+0000","last_became_peered":"2024-09-12T00:10:07.318114+0000","last_unstale":"2024-09-12T02:03:43.743886+0000","last_undegraded":"2024-09-12T02:03:43.743886+0000","last_fullsized":"2024-09-12T02:03:43.743886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:24.177651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"266'2464","reported_seq":4396,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.745617+0000","last_change":"2024-09-12T00:10:09.371782+0000","last_active":"2024-09-12T02:04:59.745617+0000","last_peered":"2024-09-12T02:04:59.745617+0000","last_clean":"2024-09-12T02:04:59.745617+0000","last_became_active":"2024-09-12T00:10:09.370949+0000","last_became_peered":"2024-09-12T00:10:09.370949+0000","last_unstale":"2024-09-12T02:04:59.745617+0000","last_undegraded":"2024-09-12T02:04:59.745617+0000","last_fullsized":"2024-09-12T02:04:59.745617+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:02.640276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6210,"num_read_kb":6193,"num_write":4929,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"266'415","reported_seq":1953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.738917+0000","last_change":"2024-09-12T00:10:01.275549+0000","last_active":"2024-09-12T02:03:39.738917+0000","last_peered":"2024-09-12T02:03:39.738917+0000","last_clean":"2024-09-12T02:03:39.738917+0000","last_became_active":"2024-09-12T00:10:01.274710+0000","last_became_peered":"2024-09-12T00:10:01.274710+0000","last_unstale":"2024-09-12T02:03:39.738917+0000","last_undegraded":"2024-09-12T02:03:39.738917+0000","last_fullsized":"2024-09-12T02:03:39.738917+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:13.598102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2273,"num_read_kb":2145,"num_write":493,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"266'407","reported_seq":1128,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.502699+0000","last_change":"2024-09-12T00:09:59.282658+0000","last_active":"2024-09-12T02:06:47.502699+0000","last_peered":"2024-09-12T02:06:47.502699+0000","last_clean":"2024-09-12T02:06:47.502699+0000","last_became_active":"2024-09-12T00:09:59.282228+0000","last_became_peered":"2024-09-12T00:09:59.282228+0000","last_unstale":"2024-09-12T02:06:47.502699+0000","last_undegraded":"2024-09-12T02:06:47.502699+0000","last_fullsized":"2024-09-12T02:06:47.502699+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:12.393975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":89139,"num_write":1493,"num_write_kb":44201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.940910+0000","last_change":"2024-09-12T00:10:03.254783+0000","last_active":"2024-09-12T02:02:18.940910+0000","last_peered":"2024-09-12T02:02:18.940910+0000","last_clean":"2024-09-12T02:02:18.940910+0000","last_became_active":"2024-09-12T00:10:03.254006+0000","last_became_peered":"2024-09-12T00:10:03.254006+0000","last_unstale":"2024-09-12T02:02:18.940910+0000","last_undegraded":"2024-09-12T02:02:18.940910+0000","last_fullsized":"2024-09-12T02:02:18.940910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:47.826880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"266'138","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.748930+0000","last_change":"2024-09-12T00:10:05.280695+0000","last_active":"2024-09-12T02:03:43.748930+0000","last_peered":"2024-09-12T02:03:43.748930+0000","last_clean":"2024-09-12T02:03:43.748930+0000","last_became_active":"2024-09-12T00:10:05.279990+0000","last_became_peered":"2024-09-12T00:10:05.279990+0000","last_unstale":"2024-09-12T02:03:43.748930+0000","last_undegraded":"2024-09-12T02:03:43.748930+0000","last_fullsized":"2024-09-12T02:03:43.748930+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:32.073641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.748898+0000","last_change":"2024-09-12T00:10:07.310717+0000","last_active":"2024-09-12T02:03:43.748898+0000","last_peered":"2024-09-12T02:03:43.748898+0000","last_clean":"2024-09-12T02:03:43.748898+0000","last_became_active":"2024-09-12T00:10:07.309927+0000","last_became_peered":"2024-09-12T00:10:07.309927+0000","last_unstale":"2024-09-12T02:03:43.748898+0000","last_undegraded":"2024-09-12T02:03:43.748898+0000","last_fullsized":"2024-09-12T02:03:43.748898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:30.558288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"266'102","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718247+0000","last_change":"2024-09-12T00:10:09.365676+0000","last_active":"2024-09-12T02:02:38.718247+0000","last_peered":"2024-09-12T02:02:38.718247+0000","last_clean":"2024-09-12T02:02:38.718247+0000","last_became_active":"2024-09-12T00:10:09.364927+0000","last_became_peered":"2024-09-12T00:10:09.364927+0000","last_unstale":"2024-09-12T02:02:38.718247+0000","last_undegraded":"2024-09-12T02:02:38.718247+0000","last_fullsized":"2024-09-12T02:02:38.718247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.618632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":243,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"266'381","reported_seq":1911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.521800+0000","last_change":"2024-09-12T00:10:01.247147+0000","last_active":"2024-09-12T02:03:38.521800+0000","last_peered":"2024-09-12T02:03:38.521800+0000","last_clean":"2024-09-12T02:03:38.521800+0000","last_became_active":"2024-09-12T00:10:01.246633+0000","last_became_peered":"2024-09-12T00:10:01.246633+0000","last_unstale":"2024-09-12T02:03:38.521800+0000","last_undegraded":"2024-09-12T02:03:38.521800+0000","last_fullsized":"2024-09-12T02:03:38.521800+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:18.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2031,"num_read_kb":1954,"num_write":422,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"266'322","reported_seq":971,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.548754+0000","last_change":"2024-09-12T00:10:31.472958+0000","last_active":"2024-09-12T02:06:47.548754+0000","last_peered":"2024-09-12T02:06:47.548754+0000","last_clean":"2024-09-12T02:06:47.548754+0000","last_became_active":"2024-09-12T00:10:31.472231+0000","last_became_peered":"2024-09-12T00:10:31.472231+0000","last_unstale":"2024-09-12T02:06:47.548754+0000","last_undegraded":"2024-09-12T02:06:47.548754+0000","last_fullsized":"2024-09-12T02:06:47.548754+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:02.415644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536061,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":478,"num_read_kb":34994,"num_write":999,"num_write_kb":46604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"37'3","reported_seq":1004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:06.532879+0000","last_change":"2024-09-12T00:10:03.266585+0000","last_active":"2024-09-12T02:06:06.532879+0000","last_peered":"2024-09-12T02:06:06.532879+0000","last_clean":"2024-09-12T02:06:06.532879+0000","last_became_active":"2024-09-12T00:10:03.265816+0000","last_became_peered":"2024-09-12T00:10:03.265816+0000","last_unstale":"2024-09-12T02:06:06.532879+0000","last_undegraded":"2024-09-12T02:06:06.532879+0000","last_fullsized":"2024-09-12T02:06:06.532879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:06.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"266'189","reported_seq":796,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689892+0000","last_change":"2024-09-12T00:10:05.276198+0000","last_active":"2024-09-12T02:02:33.689892+0000","last_peered":"2024-09-12T02:02:33.689892+0000","last_clean":"2024-09-12T02:02:33.689892+0000","last_became_active":"2024-09-12T00:10:05.275499+0000","last_became_peered":"2024-09-12T00:10:05.275499+0000","last_unstale":"2024-09-12T02:02:33.689892+0000","last_undegraded":"2024-09-12T02:02:33.689892+0000","last_fullsized":"2024-09-12T02:02:33.689892+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:30.503399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":245,"num_read_kb":237,"num_write":164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"266'774","reported_seq":3030,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.967482+0000","last_change":"2024-09-12T00:10:07.319071+0000","last_active":"2024-09-12T02:06:46.967482+0000","last_peered":"2024-09-12T02:06:46.967482+0000","last_clean":"2024-09-12T02:06:46.967482+0000","last_became_active":"2024-09-12T00:10:07.318302+0000","last_became_peered":"2024-09-12T00:10:07.318302+0000","last_unstale":"2024-09-12T02:06:46.967482+0000","last_undegraded":"2024-09-12T02:06:46.967482+0000","last_fullsized":"2024-09-12T02:06:46.967482+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:04.659101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"266'205","reported_seq":1059,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.365691+0000","last_change":"2024-09-12T00:10:09.433574+0000","last_active":"2024-09-12T02:06:05.365691+0000","last_peered":"2024-09-12T02:06:05.365691+0000","last_clean":"2024-09-12T02:06:05.365691+0000","last_became_active":"2024-09-12T00:10:09.433045+0000","last_became_peered":"2024-09-12T00:10:09.433045+0000","last_unstale":"2024-09-12T02:06:05.365691+0000","last_undegraded":"2024-09-12T02:06:05.365691+0000","last_fullsized":"2024-09-12T02:06:05.365691+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:02.345129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":620,"num_write":453,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"266'389","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.963036+0000","last_change":"2024-09-12T00:10:01.261564+0000","last_active":"2024-09-12T02:03:38.963036+0000","last_peered":"2024-09-12T02:03:38.963036+0000","last_clean":"2024-09-12T02:03:38.963036+0000","last_became_active":"2024-09-12T00:10:01.261217+0000","last_became_peered":"2024-09-12T00:10:01.261217+0000","last_unstale":"2024-09-12T02:03:38.963036+0000","last_undegraded":"2024-09-12T02:03:38.963036+0000","last_fullsized":"2024-09-12T02:03:38.963036+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2298,"num_read_kb":2187,"num_write":432,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"266'343","reported_seq":998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.468362+0000","last_change":"2024-09-12T00:09:59.286394+0000","last_active":"2024-09-12T02:06:47.468362+0000","last_peered":"2024-09-12T02:06:47.468362+0000","last_clean":"2024-09-12T02:06:47.468362+0000","last_became_active":"2024-09-12T00:09:59.281330+0000","last_became_peered":"2024-09-12T00:09:59.281330+0000","last_unstale":"2024-09-12T02:06:47.468362+0000","last_undegraded":"2024-09-12T02:06:47.468362+0000","last_fullsized":"2024-09-12T02:06:47.468362+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:20.081291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":6619,"num_write":1099,"num_write_kb":41386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.739031+0000","last_change":"2024-09-12T00:10:03.273556+0000","last_active":"2024-09-12T02:03:39.739031+0000","last_peered":"2024-09-12T02:03:39.739031+0000","last_clean":"2024-09-12T02:03:39.739031+0000","last_became_active":"2024-09-12T00:10:03.271292+0000","last_became_peered":"2024-09-12T00:10:03.271292+0000","last_unstale":"2024-09-12T02:03:39.739031+0000","last_undegraded":"2024-09-12T02:03:39.739031+0000","last_fullsized":"2024-09-12T02:03:39.739031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"266'320","reported_seq":938,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.659989+0000","last_change":"2024-09-12T00:10:05.363194+0000","last_active":"2024-09-12T02:06:46.659989+0000","last_peered":"2024-09-12T02:06:46.659989+0000","last_clean":"2024-09-12T02:06:46.659989+0000","last_became_active":"2024-09-12T00:10:05.361419+0000","last_became_peered":"2024-09-12T00:10:05.361419+0000","last_unstale":"2024-09-12T02:06:46.659989+0000","last_undegraded":"2024-09-12T02:06:46.659989+0000","last_fullsized":"2024-09-12T02:06:46.659989+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:25.749053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":523,"num_read_kb":1153,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"266'821","reported_seq":3116,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.370722+0000","last_change":"2024-09-12T00:10:07.335921+0000","last_active":"2024-09-12T02:06:10.370722+0000","last_peered":"2024-09-12T02:06:10.370722+0000","last_clean":"2024-09-12T02:06:10.370722+0000","last_became_active":"2024-09-12T00:10:07.335181+0000","last_became_peered":"2024-09-12T00:10:07.335181+0000","last_unstale":"2024-09-12T02:06:10.370722+0000","last_undegraded":"2024-09-12T02:06:10.370722+0000","last_fullsized":"2024-09-12T02:06:10.370722+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:17.529066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"266'419","reported_seq":1870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726289+0000","last_change":"2024-09-12T00:10:01.267267+0000","last_active":"2024-09-12T02:02:44.726289+0000","last_peered":"2024-09-12T02:02:44.726289+0000","last_clean":"2024-09-12T02:02:44.726289+0000","last_became_active":"2024-09-12T00:10:01.266204+0000","last_became_peered":"2024-09-12T00:10:01.266204+0000","last_unstale":"2024-09-12T02:02:44.726289+0000","last_undegraded":"2024-09-12T02:02:44.726289+0000","last_fullsized":"2024-09-12T02:02:44.726289+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:02.715482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2063,"num_read_kb":1939,"num_write":461,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"266'375","reported_seq":1031,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.507786+0000","last_change":"2024-09-12T00:09:59.308323+0000","last_active":"2024-09-12T02:06:47.507786+0000","last_peered":"2024-09-12T02:06:47.507786+0000","last_clean":"2024-09-12T02:06:47.507786+0000","last_became_active":"2024-09-12T00:09:59.307481+0000","last_became_peered":"2024-09-12T00:09:59.307481+0000","last_unstale":"2024-09-12T02:06:47.507786+0000","last_undegraded":"2024-09-12T02:06:47.507786+0000","last_fullsized":"2024-09-12T02:06:47.507786+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.962499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":11316,"num_write":1196,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.729507+0000","last_change":"2024-09-12T00:10:03.261104+0000","last_active":"2024-09-12T02:02:43.729507+0000","last_peered":"2024-09-12T02:02:43.729507+0000","last_clean":"2024-09-12T02:02:43.729507+0000","last_became_active":"2024-09-12T00:10:03.258601+0000","last_became_peered":"2024-09-12T00:10:03.258601+0000","last_unstale":"2024-09-12T02:02:43.729507+0000","last_undegraded":"2024-09-12T02:02:43.729507+0000","last_fullsized":"2024-09-12T02:02:43.729507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:49.169082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"266'473","reported_seq":1170,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.079330+0000","last_change":"2024-09-12T00:10:05.362098+0000","last_active":"2024-09-12T02:06:07.079330+0000","last_peered":"2024-09-12T02:06:07.079330+0000","last_clean":"2024-09-12T02:06:07.079330+0000","last_became_active":"2024-09-12T00:10:05.361273+0000","last_became_peered":"2024-09-12T00:10:05.361273+0000","last_unstale":"2024-09-12T02:06:07.079330+0000","last_undegraded":"2024-09-12T02:06:07.079330+0000","last_fullsized":"2024-09-12T02:06:07.079330+0000","mapping_epoch":31,"log_start":"266'400","ondisk_log_start":"266'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:08.958275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61868,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":760,"num_read_kb":1277,"num_write":586,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679765+0000","last_change":"2024-09-12T00:10:07.317430+0000","last_active":"2024-09-12T02:02:38.679765+0000","last_peered":"2024-09-12T02:02:38.679765+0000","last_clean":"2024-09-12T02:02:38.679765+0000","last_became_active":"2024-09-12T00:10:07.316670+0000","last_became_peered":"2024-09-12T00:10:07.316670+0000","last_unstale":"2024-09-12T02:02:38.679765+0000","last_undegraded":"2024-09-12T02:02:38.679765+0000","last_fullsized":"2024-09-12T02:02:38.679765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.008641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"266'599","reported_seq":1440,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.111464+0000","last_change":"2024-09-12T00:10:09.368828+0000","last_active":"2024-09-12T02:06:07.111464+0000","last_peered":"2024-09-12T02:06:07.111464+0000","last_clean":"2024-09-12T02:06:07.111464+0000","last_became_active":"2024-09-12T00:10:09.368091+0000","last_became_peered":"2024-09-12T00:10:09.368091+0000","last_unstale":"2024-09-12T02:06:07.111464+0000","last_undegraded":"2024-09-12T02:06:07.111464+0000","last_fullsized":"2024-09-12T02:06:07.111464+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:38.890638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1323,"num_read_kb":1320,"num_write":1284,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"266'475","reported_seq":2134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.482999+0000","last_change":"2024-09-12T00:10:01.258535+0000","last_active":"2024-09-12T02:04:57.482999+0000","last_peered":"2024-09-12T02:04:57.482999+0000","last_clean":"2024-09-12T02:04:57.482999+0000","last_became_active":"2024-09-12T00:10:01.257821+0000","last_became_peered":"2024-09-12T00:10:01.257821+0000","last_unstale":"2024-09-12T02:04:57.482999+0000","last_undegraded":"2024-09-12T02:04:57.482999+0000","last_fullsized":"2024-09-12T02:04:57.482999+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:45.635084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2372,"num_write":561,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"266'348","reported_seq":996,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.524014+0000","last_change":"2024-09-12T00:09:59.308750+0000","last_active":"2024-09-12T02:06:47.524014+0000","last_peered":"2024-09-12T02:06:47.524014+0000","last_clean":"2024-09-12T02:06:47.524014+0000","last_became_active":"2024-09-12T00:09:59.308185+0000","last_became_peered":"2024-09-12T00:09:59.308185+0000","last_unstale":"2024-09-12T02:06:47.524014+0000","last_undegraded":"2024-09-12T02:06:47.524014+0000","last_fullsized":"2024-09-12T02:06:47.524014+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:51.112048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":32387,"num_write":1082,"num_write_kb":39559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.691933+0000","last_change":"2024-09-12T00:10:03.250952+0000","last_active":"2024-09-12T02:02:43.691933+0000","last_peered":"2024-09-12T02:02:43.691933+0000","last_clean":"2024-09-12T02:02:43.691933+0000","last_became_active":"2024-09-12T00:10:03.250360+0000","last_became_peered":"2024-09-12T00:10:03.250360+0000","last_unstale":"2024-09-12T02:02:43.691933+0000","last_undegraded":"2024-09-12T02:02:43.691933+0000","last_fullsized":"2024-09-12T02:02:43.691933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:07.747068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"266'304","reported_seq":924,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:53.983324+0000","last_change":"2024-09-12T00:10:05.292211+0000","last_active":"2024-09-12T02:04:53.983324+0000","last_peered":"2024-09-12T02:04:53.983324+0000","last_clean":"2024-09-12T02:04:53.983324+0000","last_became_active":"2024-09-12T00:10:05.288035+0000","last_became_peered":"2024-09-12T00:10:05.288035+0000","last_unstale":"2024-09-12T02:04:53.983324+0000","last_undegraded":"2024-09-12T02:04:53.983324+0000","last_fullsized":"2024-09-12T02:04:53.983324+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:11.001735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57037,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":999,"num_write":402,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.952988+0000","last_change":"2024-09-12T00:10:07.340807+0000","last_active":"2024-09-12T02:03:03.952988+0000","last_peered":"2024-09-12T02:03:03.952988+0000","last_clean":"2024-09-12T02:03:03.952988+0000","last_became_active":"2024-09-12T00:10:07.340248+0000","last_became_peered":"2024-09-12T00:10:07.340248+0000","last_unstale":"2024-09-12T02:03:03.952988+0000","last_undegraded":"2024-09-12T02:03:03.952988+0000","last_fullsized":"2024-09-12T02:03:03.952988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.585478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"266'116","reported_seq":643,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:13.737132+0000","last_change":"2024-09-12T00:10:09.361661+0000","last_active":"2024-09-12T02:05:13.737132+0000","last_peered":"2024-09-12T02:05:13.737132+0000","last_clean":"2024-09-12T02:05:13.737132+0000","last_became_active":"2024-09-12T00:10:09.359663+0000","last_became_peered":"2024-09-12T00:10:09.359663+0000","last_unstale":"2024-09-12T02:05:13.737132+0000","last_undegraded":"2024-09-12T02:05:13.737132+0000","last_fullsized":"2024-09-12T02:05:13.737132+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:19.918840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":110,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"266'1041","reported_seq":2833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.717280+0000","last_change":"2024-09-12T00:10:01.263893+0000","last_active":"2024-09-12T02:04:59.717280+0000","last_peered":"2024-09-12T02:04:59.717280+0000","last_clean":"2024-09-12T02:04:59.717280+0000","last_became_active":"2024-09-12T00:10:01.263012+0000","last_became_peered":"2024-09-12T00:10:01.263012+0000","last_unstale":"2024-09-12T02:04:59.717280+0000","last_undegraded":"2024-09-12T02:04:59.717280+0000","last_fullsized":"2024-09-12T02:04:59.717280+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1000,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:53.923315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4917,"num_read_kb":4393,"num_write":1427,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"266'301","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.508942+0000","last_change":"2024-09-12T00:10:31.478771+0000","last_active":"2024-09-12T02:06:47.508942+0000","last_peered":"2024-09-12T02:06:47.508942+0000","last_clean":"2024-09-12T02:06:47.508942+0000","last_became_active":"2024-09-12T00:10:31.477934+0000","last_became_peered":"2024-09-12T00:10:31.477934+0000","last_unstale":"2024-09-12T02:06:47.508942+0000","last_undegraded":"2024-09-12T02:06:47.508942+0000","last_fullsized":"2024-09-12T02:06:47.508942+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:03.480837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":400,"num_read_kb":33911,"num_write":938,"num_write_kb":31727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689840+0000","last_change":"2024-09-12T00:10:03.254945+0000","last_active":"2024-09-12T02:02:33.689840+0000","last_peered":"2024-09-12T02:02:33.689840+0000","last_clean":"2024-09-12T02:02:33.689840+0000","last_became_active":"2024-09-12T00:10:03.254328+0000","last_became_peered":"2024-09-12T00:10:03.254328+0000","last_unstale":"2024-09-12T02:02:33.689840+0000","last_undegraded":"2024-09-12T02:02:33.689840+0000","last_fullsized":"2024-09-12T02:02:33.689840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:03.177090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"266'397","reported_seq":1062,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.565854+0000","last_change":"2024-09-12T00:10:05.286921+0000","last_active":"2024-09-12T02:06:47.565854+0000","last_peered":"2024-09-12T02:06:47.565854+0000","last_clean":"2024-09-12T02:06:47.565854+0000","last_became_active":"2024-09-12T00:10:05.285616+0000","last_became_peered":"2024-09-12T00:10:05.285616+0000","last_unstale":"2024-09-12T02:06:47.565854+0000","last_undegraded":"2024-09-12T02:06:47.565854+0000","last_fullsized":"2024-09-12T02:06:47.565854+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:58.157359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44989,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":1221,"num_write":494,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"266'803","reported_seq":3292,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.382150+0000","last_change":"2024-09-12T00:10:07.320523+0000","last_active":"2024-09-12T02:06:44.382150+0000","last_peered":"2024-09-12T02:06:44.382150+0000","last_clean":"2024-09-12T02:06:44.382150+0000","last_became_active":"2024-09-12T00:10:07.319708+0000","last_became_peered":"2024-09-12T00:10:07.319708+0000","last_unstale":"2024-09-12T02:06:44.382150+0000","last_undegraded":"2024-09-12T02:06:44.382150+0000","last_fullsized":"2024-09-12T02:06:44.382150+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:21.157783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"266'112","reported_seq":638,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.365117+0000","last_change":"2024-09-12T00:10:09.358471+0000","last_active":"2024-09-12T02:06:05.365117+0000","last_peered":"2024-09-12T02:06:05.365117+0000","last_clean":"2024-09-12T02:06:05.365117+0000","last_became_active":"2024-09-12T00:10:09.357682+0000","last_became_peered":"2024-09-12T00:10:09.357682+0000","last_unstale":"2024-09-12T02:06:05.365117+0000","last_undegraded":"2024-09-12T02:06:05.365117+0000","last_fullsized":"2024-09-12T02:06:05.365117+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:14.701980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":265,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"266'779","reported_seq":2339,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.717005+0000","last_change":"2024-09-12T00:10:01.258907+0000","last_active":"2024-09-12T02:02:33.717005+0000","last_peered":"2024-09-12T02:02:33.717005+0000","last_clean":"2024-09-12T02:02:33.717005+0000","last_became_active":"2024-09-12T00:10:01.258536+0000","last_became_peered":"2024-09-12T00:10:01.258536+0000","last_unstale":"2024-09-12T02:02:33.717005+0000","last_undegraded":"2024-09-12T02:02:33.717005+0000","last_fullsized":"2024-09-12T02:02:33.717005+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:13.970208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3854,"num_read_kb":3489,"num_write":1035,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"266'320","reported_seq":978,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.528575+0000","last_change":"2024-09-12T00:09:59.284888+0000","last_active":"2024-09-12T02:06:44.528575+0000","last_peered":"2024-09-12T02:06:44.528575+0000","last_clean":"2024-09-12T02:06:44.528575+0000","last_became_active":"2024-09-12T00:09:59.283882+0000","last_became_peered":"2024-09-12T00:09:59.283882+0000","last_unstale":"2024-09-12T02:06:44.528575+0000","last_undegraded":"2024-09-12T02:06:44.528575+0000","last_fullsized":"2024-09-12T02:06:44.528575+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:55.361739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8414688,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":429,"num_read_kb":25086,"num_write":1143,"num_write_kb":35310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.698033+0000","last_change":"2024-09-12T00:10:03.251387+0000","last_active":"2024-09-12T02:03:08.698033+0000","last_peered":"2024-09-12T02:03:08.698033+0000","last_clean":"2024-09-12T02:03:08.698033+0000","last_became_active":"2024-09-12T00:10:03.250840+0000","last_became_peered":"2024-09-12T00:10:03.250840+0000","last_unstale":"2024-09-12T02:03:08.698033+0000","last_undegraded":"2024-09-12T02:03:08.698033+0000","last_fullsized":"2024-09-12T02:03:08.698033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.168119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"266'538","reported_seq":1230,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.953250+0000","last_change":"2024-09-12T00:10:05.287261+0000","last_active":"2024-09-12T02:06:45.953250+0000","last_peered":"2024-09-12T02:06:45.953250+0000","last_clean":"2024-09-12T02:06:45.953250+0000","last_became_active":"2024-09-12T00:10:05.285823+0000","last_became_peered":"2024-09-12T00:10:05.285823+0000","last_unstale":"2024-09-12T02:06:45.953250+0000","last_undegraded":"2024-09-12T02:06:45.953250+0000","last_fullsized":"2024-09-12T02:06:45.953250+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:57.618303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96632,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":936,"num_read_kb":2160,"num_write":758,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.692984+0000","last_change":"2024-09-12T00:10:07.321850+0000","last_active":"2024-09-12T02:02:48.692984+0000","last_peered":"2024-09-12T02:02:48.692984+0000","last_clean":"2024-09-12T02:02:48.692984+0000","last_became_active":"2024-09-12T00:10:07.321180+0000","last_became_peered":"2024-09-12T00:10:07.321180+0000","last_unstale":"2024-09-12T02:02:48.692984+0000","last_undegraded":"2024-09-12T02:02:48.692984+0000","last_fullsized":"2024-09-12T02:02:48.692984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:15.729989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"266'133","reported_seq":710,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.508275+0000","last_change":"2024-09-12T00:10:09.361110+0000","last_active":"2024-09-12T02:04:57.508275+0000","last_peered":"2024-09-12T02:04:57.508275+0000","last_clean":"2024-09-12T02:04:57.508275+0000","last_became_active":"2024-09-12T00:10:09.359011+0000","last_became_peered":"2024-09-12T00:10:09.359011+0000","last_unstale":"2024-09-12T02:04:57.508275+0000","last_undegraded":"2024-09-12T02:04:57.508275+0000","last_fullsized":"2024-09-12T02:04:57.508275+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:07.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":320,"num_read_kb":272,"num_write":321,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"266'1103","reported_seq":2643,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.874650+0000","last_change":"2024-09-12T00:10:01.249017+0000","last_active":"2024-09-12T02:04:59.874650+0000","last_peered":"2024-09-12T02:04:59.874650+0000","last_clean":"2024-09-12T02:04:59.874650+0000","last_became_active":"2024-09-12T00:10:01.248297+0000","last_became_peered":"2024-09-12T00:10:01.248297+0000","last_unstale":"2024-09-12T02:04:59.874650+0000","last_undegraded":"2024-09-12T02:04:59.874650+0000","last_fullsized":"2024-09-12T02:04:59.874650+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":1000,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:34.449342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4909,"num_read_kb":4337,"num_write":1501,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"266'257","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:28.943593+0000","last_change":"2024-09-12T00:10:31.166221+0000","last_active":"2024-09-12T02:02:28.943593+0000","last_peered":"2024-09-12T02:02:28.943593+0000","last_clean":"2024-09-12T02:02:28.943593+0000","last_became_active":"2024-09-12T00:10:31.165905+0000","last_became_peered":"2024-09-12T00:10:31.165905+0000","last_unstale":"2024-09-12T02:02:28.943593+0000","last_undegraded":"2024-09-12T02:02:28.943593+0000","last_fullsized":"2024-09-12T02:02:28.943593+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:02.031075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2274550,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":365,"num_read_kb":2613,"num_write":967,"num_write_kb":17332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,7],"acting":[3,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689930+0000","last_change":"2024-09-12T00:10:03.254698+0000","last_active":"2024-09-12T02:02:33.689930+0000","last_peered":"2024-09-12T02:02:33.689930+0000","last_clean":"2024-09-12T02:02:33.689930+0000","last_became_active":"2024-09-12T00:10:03.254056+0000","last_became_peered":"2024-09-12T00:10:03.254056+0000","last_unstale":"2024-09-12T02:02:33.689930+0000","last_undegraded":"2024-09-12T02:02:33.689930+0000","last_fullsized":"2024-09-12T02:02:33.689930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:22.359128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"266'379","reported_seq":1016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.069287+0000","last_change":"2024-09-12T00:10:05.300463+0000","last_active":"2024-09-12T02:06:46.069287+0000","last_peered":"2024-09-12T02:06:46.069287+0000","last_clean":"2024-09-12T02:06:46.069287+0000","last_became_active":"2024-09-12T00:10:05.299568+0000","last_became_peered":"2024-09-12T00:10:05.299568+0000","last_unstale":"2024-09-12T02:06:46.069287+0000","last_undegraded":"2024-09-12T02:06:46.069287+0000","last_fullsized":"2024-09-12T02:06:46.069287+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:55.828313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":635,"num_read_kb":1318,"num_write":554,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.726007+0000","last_change":"2024-09-12T00:10:07.335273+0000","last_active":"2024-09-12T02:03:08.726007+0000","last_peered":"2024-09-12T02:03:08.726007+0000","last_clean":"2024-09-12T02:03:08.726007+0000","last_became_active":"2024-09-12T00:10:07.334527+0000","last_became_peered":"2024-09-12T00:10:07.334527+0000","last_unstale":"2024-09-12T02:03:08.726007+0000","last_undegraded":"2024-09-12T02:03:08.726007+0000","last_fullsized":"2024-09-12T02:03:08.726007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:58.243181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"266'171","reported_seq":743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:53.394855+0000","last_change":"2024-09-12T00:10:09.373893+0000","last_active":"2024-09-12T02:05:53.394855+0000","last_peered":"2024-09-12T02:05:53.394855+0000","last_clean":"2024-09-12T02:05:53.394855+0000","last_became_active":"2024-09-12T00:10:09.373318+0000","last_became_peered":"2024-09-12T00:10:09.373318+0000","last_unstale":"2024-09-12T02:05:53.394855+0000","last_undegraded":"2024-09-12T02:05:53.394855+0000","last_fullsized":"2024-09-12T02:05:53.394855+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:12.690531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":275,"num_write":406,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"266'789","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.475401+0000","last_change":"2024-09-12T00:10:01.242970+0000","last_active":"2024-09-12T02:04:57.475401+0000","last_peered":"2024-09-12T02:04:57.475401+0000","last_clean":"2024-09-12T02:04:57.475401+0000","last_became_active":"2024-09-12T00:10:01.242213+0000","last_became_peered":"2024-09-12T00:10:01.242213+0000","last_unstale":"2024-09-12T02:04:57.475401+0000","last_undegraded":"2024-09-12T02:04:57.475401+0000","last_fullsized":"2024-09-12T02:04:57.475401+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3776,"num_read_kb":3427,"num_write":1023,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"266'387","reported_seq":1078,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.383112+0000","last_change":"2024-09-12T00:09:59.299620+0000","last_active":"2024-09-12T02:06:47.383112+0000","last_peered":"2024-09-12T02:06:47.383112+0000","last_clean":"2024-09-12T02:06:47.383112+0000","last_became_active":"2024-09-12T00:09:59.298986+0000","last_became_peered":"2024-09-12T00:09:59.298986+0000","last_unstale":"2024-09-12T02:06:47.383112+0000","last_undegraded":"2024-09-12T02:06:47.383112+0000","last_fullsized":"2024-09-12T02:06:47.383112+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:32.999083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":586,"num_read_kb":16563,"num_write":1186,"num_write_kb":29581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.678607+0000","last_change":"2024-09-12T00:10:03.262756+0000","last_active":"2024-09-12T02:02:33.678607+0000","last_peered":"2024-09-12T02:02:33.678607+0000","last_clean":"2024-09-12T02:02:33.678607+0000","last_became_active":"2024-09-12T00:10:03.262121+0000","last_became_peered":"2024-09-12T00:10:03.262121+0000","last_unstale":"2024-09-12T02:02:33.678607+0000","last_undegraded":"2024-09-12T02:02:33.678607+0000","last_fullsized":"2024-09-12T02:02:33.678607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:37.206721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"266'390","reported_seq":1045,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.380567+0000","last_change":"2024-09-12T00:10:05.295381+0000","last_active":"2024-09-12T02:06:45.380567+0000","last_peered":"2024-09-12T02:06:45.380567+0000","last_clean":"2024-09-12T02:06:45.380567+0000","last_became_active":"2024-09-12T00:10:05.294629+0000","last_became_peered":"2024-09-12T00:10:05.294629+0000","last_unstale":"2024-09-12T02:06:45.380567+0000","last_undegraded":"2024-09-12T02:06:45.380567+0000","last_fullsized":"2024-09-12T02:06:45.380567+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:11.786672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46543,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":631,"num_read_kb":1251,"num_write":492,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"266'749","reported_seq":3287,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.735407+0000","last_change":"2024-09-12T00:10:07.315482+0000","last_active":"2024-09-12T02:06:46.735407+0000","last_peered":"2024-09-12T02:06:46.735407+0000","last_clean":"2024-09-12T02:06:46.735407+0000","last_became_active":"2024-09-12T00:10:07.314777+0000","last_became_peered":"2024-09-12T00:10:07.314777+0000","last_unstale":"2024-09-12T02:06:46.735407+0000","last_undegraded":"2024-09-12T02:06:46.735407+0000","last_fullsized":"2024-09-12T02:06:46.735407+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.137312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"266'132","reported_seq":670,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.682437+0000","last_change":"2024-09-12T00:10:09.347267+0000","last_active":"2024-09-12T02:04:57.682437+0000","last_peered":"2024-09-12T02:04:57.682437+0000","last_clean":"2024-09-12T02:04:57.682437+0000","last_became_active":"2024-09-12T00:10:09.346452+0000","last_became_peered":"2024-09-12T00:10:09.346452+0000","last_unstale":"2024-09-12T02:04:57.682437+0000","last_undegraded":"2024-09-12T02:04:57.682437+0000","last_fullsized":"2024-09-12T02:04:57.682437+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:11.712124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":133,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"266'1057","reported_seq":2646,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.763934+0000","last_change":"2024-09-12T00:10:01.265761+0000","last_active":"2024-09-12T02:04:48.763934+0000","last_peered":"2024-09-12T02:04:48.763934+0000","last_clean":"2024-09-12T02:04:48.763934+0000","last_became_active":"2024-09-12T00:10:01.264718+0000","last_became_peered":"2024-09-12T00:10:01.264718+0000","last_unstale":"2024-09-12T02:04:48.763934+0000","last_undegraded":"2024-09-12T02:04:48.763934+0000","last_fullsized":"2024-09-12T02:04:48.763934+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1000,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:21.890638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4853,"num_read_kb":4249,"num_write":1477,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"266'417","reported_seq":1113,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.507177+0000","last_change":"2024-09-12T00:09:59.307052+0000","last_active":"2024-09-12T02:06:47.507177+0000","last_peered":"2024-09-12T02:06:47.507177+0000","last_clean":"2024-09-12T02:06:47.507177+0000","last_became_active":"2024-09-12T00:09:59.301303+0000","last_became_peered":"2024-09-12T00:09:59.301303+0000","last_unstale":"2024-09-12T02:06:47.507177+0000","last_undegraded":"2024-09-12T02:06:47.507177+0000","last_fullsized":"2024-09-12T02:06:47.507177+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:46.678907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443899,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":39523,"num_write":1279,"num_write_kb":37758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.121629+0000","last_change":"2024-09-12T00:10:03.274423+0000","last_active":"2024-09-12T02:06:44.121629+0000","last_peered":"2024-09-12T02:06:44.121629+0000","last_clean":"2024-09-12T02:06:44.121629+0000","last_became_active":"2024-09-12T00:10:03.271281+0000","last_became_peered":"2024-09-12T00:10:03.271281+0000","last_unstale":"2024-09-12T02:06:44.121629+0000","last_undegraded":"2024-09-12T02:06:44.121629+0000","last_fullsized":"2024-09-12T02:06:44.121629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:31.849595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"266'147","reported_seq":728,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.946308+0000","last_change":"2024-09-12T00:10:05.363280+0000","last_active":"2024-09-12T02:02:38.946308+0000","last_peered":"2024-09-12T02:02:38.946308+0000","last_clean":"2024-09-12T02:02:38.946308+0000","last_became_active":"2024-09-12T00:10:05.362449+0000","last_became_peered":"2024-09-12T00:10:05.362449+0000","last_unstale":"2024-09-12T02:02:38.946308+0000","last_undegraded":"2024-09-12T02:02:38.946308+0000","last_fullsized":"2024-09-12T02:02:38.946308+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:21.556082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"266'764","reported_seq":3346,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.015394+0000","last_change":"2024-09-12T00:10:07.319650+0000","last_active":"2024-09-12T02:06:47.015394+0000","last_peered":"2024-09-12T02:06:47.015394+0000","last_clean":"2024-09-12T02:06:47.015394+0000","last_became_active":"2024-09-12T00:10:07.318566+0000","last_became_peered":"2024-09-12T00:10:07.318566+0000","last_unstale":"2024-09-12T02:06:47.015394+0000","last_undegraded":"2024-09-12T02:06:47.015394+0000","last_fullsized":"2024-09-12T02:06:47.015394+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:17.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"266'180","reported_seq":711,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.523007+0000","last_change":"2024-09-12T00:10:09.353927+0000","last_active":"2024-09-12T02:04:57.523007+0000","last_peered":"2024-09-12T02:04:57.523007+0000","last_clean":"2024-09-12T02:04:57.523007+0000","last_became_active":"2024-09-12T00:10:09.353213+0000","last_became_peered":"2024-09-12T00:10:09.353213+0000","last_unstale":"2024-09-12T02:04:57.523007+0000","last_undegraded":"2024-09-12T02:04:57.523007+0000","last_fullsized":"2024-09-12T02:04:57.523007+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:39.991544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":410,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"266'436","reported_seq":1987,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.686240+0000","last_change":"2024-09-12T00:10:01.256672+0000","last_active":"2024-09-12T02:03:03.686240+0000","last_peered":"2024-09-12T02:03:03.686240+0000","last_clean":"2024-09-12T02:03:03.686240+0000","last_became_active":"2024-09-12T00:10:01.256287+0000","last_became_peered":"2024-09-12T00:10:01.256287+0000","last_unstale":"2024-09-12T02:03:03.686240+0000","last_undegraded":"2024-09-12T02:03:03.686240+0000","last_fullsized":"2024-09-12T02:03:03.686240+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:39.690690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2163,"num_write":523,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"266'393","reported_seq":1331,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.945995+0000","last_change":"2024-09-12T00:10:31.169004+0000","last_active":"2024-09-12T02:02:38.945995+0000","last_peered":"2024-09-12T02:02:38.945995+0000","last_clean":"2024-09-12T02:02:38.945995+0000","last_became_active":"2024-09-12T00:10:31.168654+0000","last_became_peered":"2024-09-12T00:10:31.168654+0000","last_unstale":"2024-09-12T02:02:38.945995+0000","last_undegraded":"2024-09-12T02:02:38.945995+0000","last_fullsized":"2024-09-12T02:02:38.945995+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:25.883597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1837649,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":1187,"num_read_kb":67964,"num_write":1285,"num_write_kb":19763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733393+0000","last_change":"2024-09-12T00:10:03.273199+0000","last_active":"2024-09-12T02:02:33.733393+0000","last_peered":"2024-09-12T02:02:33.733393+0000","last_clean":"2024-09-12T02:02:33.733393+0000","last_became_active":"2024-09-12T00:10:03.272284+0000","last_became_peered":"2024-09-12T00:10:03.272284+0000","last_unstale":"2024-09-12T02:02:33.733393+0000","last_undegraded":"2024-09-12T02:02:33.733393+0000","last_fullsized":"2024-09-12T02:02:33.733393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:34.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"266'532","reported_seq":1209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.070439+0000","last_change":"2024-09-12T00:10:05.301341+0000","last_active":"2024-09-12T02:06:07.070439+0000","last_peered":"2024-09-12T02:06:07.070439+0000","last_clean":"2024-09-12T02:06:07.070439+0000","last_became_active":"2024-09-12T00:10:05.300354+0000","last_became_peered":"2024-09-12T00:10:05.300354+0000","last_unstale":"2024-09-12T02:06:07.070439+0000","last_undegraded":"2024-09-12T02:06:07.070439+0000","last_fullsized":"2024-09-12T02:06:07.070439+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:12.920116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56958,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1425,"num_read_kb":1877,"num_write":2036,"num_write_kb":1813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.703060+0000","last_change":"2024-09-12T00:10:07.340586+0000","last_active":"2024-09-12T02:02:38.703060+0000","last_peered":"2024-09-12T02:02:38.703060+0000","last_clean":"2024-09-12T02:02:38.703060+0000","last_became_active":"2024-09-12T00:10:07.340008+0000","last_became_peered":"2024-09-12T00:10:07.340008+0000","last_unstale":"2024-09-12T02:02:38.703060+0000","last_undegraded":"2024-09-12T02:02:38.703060+0000","last_fullsized":"2024-09-12T02:02:38.703060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:10.322035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"266'137","reported_seq":681,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709447+0000","last_change":"2024-09-12T00:10:09.373165+0000","last_active":"2024-09-12T02:04:43.709447+0000","last_peered":"2024-09-12T02:04:43.709447+0000","last_clean":"2024-09-12T02:04:43.709447+0000","last_became_active":"2024-09-12T00:10:09.372231+0000","last_became_peered":"2024-09-12T00:10:09.372231+0000","last_unstale":"2024-09-12T02:04:43.709447+0000","last_undegraded":"2024-09-12T02:04:43.709447+0000","last_fullsized":"2024-09-12T02:04:43.709447+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:27.875059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"266'755","reported_seq":2305,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.708542+0000","last_change":"2024-09-12T00:10:01.263233+0000","last_active":"2024-09-12T02:03:03.708542+0000","last_peered":"2024-09-12T02:03:03.708542+0000","last_clean":"2024-09-12T02:03:03.708542+0000","last_became_active":"2024-09-12T00:10:01.262490+0000","last_became_peered":"2024-09-12T00:10:01.262490+0000","last_unstale":"2024-09-12T02:03:03.708542+0000","last_undegraded":"2024-09-12T02:03:03.708542+0000","last_fullsized":"2024-09-12T02:03:03.708542+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:53.059969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3216,"num_write":966,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.749663+0000","last_change":"2024-09-12T00:09:40.226824+0000","last_active":"2024-09-12T02:04:08.749663+0000","last_peered":"2024-09-12T02:04:08.749663+0000","last_clean":"2024-09-12T02:04:08.749663+0000","last_became_active":"2024-09-12T00:09:40.224430+0000","last_became_peered":"2024-09-12T00:09:40.224430+0000","last_unstale":"2024-09-12T02:04:08.749663+0000","last_undegraded":"2024-09-12T02:04:08.749663+0000","last_fullsized":"2024-09-12T02:04:08.749663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_clean_scrub_stamp":"2024-09-12T00:09:39.068560+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.078225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":557,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:24.749088+0000","last_change":"2024-09-12T00:09:48.187085+0000","last_active":"2024-09-12T02:04:24.749088+0000","last_peered":"2024-09-12T02:04:24.749088+0000","last_clean":"2024-09-12T02:04:24.749088+0000","last_became_active":"2024-09-12T00:09:46.162330+0000","last_became_peered":"2024-09-12T00:09:46.162330+0000","last_unstale":"2024-09-12T02:04:24.749088+0000","last_undegraded":"2024-09-12T02:04:24.749088+0000","last_fullsized":"2024-09-12T02:04:24.749088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:31.598024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090615300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"266'259","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.977405+0000","last_change":"2024-09-12T00:09:59.310501+0000","last_active":"2024-09-12T02:04:33.977405+0000","last_peered":"2024-09-12T02:04:33.977405+0000","last_clean":"2024-09-12T02:04:33.977405+0000","last_became_active":"2024-09-12T00:09:59.310092+0000","last_became_peered":"2024-09-12T00:09:59.310092+0000","last_unstale":"2024-09-12T02:04:33.977405+0000","last_undegraded":"2024-09-12T02:04:33.977405+0000","last_fullsized":"2024-09-12T02:04:33.977405+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:33.851016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571160,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":432,"num_read_kb":13893,"num_write":956,"num_write_kb":29182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"37'5","reported_seq":1010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.107035+0000","last_change":"2024-09-12T00:10:03.266852+0000","last_active":"2024-09-12T02:06:44.107035+0000","last_peered":"2024-09-12T02:06:44.107035+0000","last_clean":"2024-09-12T02:06:44.107035+0000","last_became_active":"2024-09-12T00:10:03.261183+0000","last_became_peered":"2024-09-12T00:10:03.261183+0000","last_unstale":"2024-09-12T02:06:44.107035+0000","last_undegraded":"2024-09-12T02:06:44.107035+0000","last_fullsized":"2024-09-12T02:06:44.107035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:03.208998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"266'795","reported_seq":1534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.441198+0000","last_change":"2024-09-12T00:10:05.294884+0000","last_active":"2024-09-12T02:06:44.441198+0000","last_peered":"2024-09-12T02:06:44.441198+0000","last_clean":"2024-09-12T02:06:44.441198+0000","last_became_active":"2024-09-12T00:10:05.294267+0000","last_became_peered":"2024-09-12T00:10:05.294267+0000","last_unstale":"2024-09-12T02:06:44.441198+0000","last_undegraded":"2024-09-12T02:06:44.441198+0000","last_fullsized":"2024-09-12T02:06:44.441198+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:05.135490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187509,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1528,"num_read_kb":3059,"num_write":1522,"num_write_kb":1361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.720998+0000","last_change":"2024-09-12T00:10:07.324124+0000","last_active":"2024-09-12T02:02:48.720998+0000","last_peered":"2024-09-12T02:02:48.720998+0000","last_clean":"2024-09-12T02:02:48.720998+0000","last_became_active":"2024-09-12T00:10:07.323398+0000","last_became_peered":"2024-09-12T00:10:07.323398+0000","last_unstale":"2024-09-12T02:02:48.720998+0000","last_undegraded":"2024-09-12T02:02:48.720998+0000","last_fullsized":"2024-09-12T02:02:48.720998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:42.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"266'247","reported_seq":998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.733816+0000","last_change":"2024-09-12T00:10:09.374413+0000","last_active":"2024-09-12T02:04:58.733816+0000","last_peered":"2024-09-12T02:04:58.733816+0000","last_clean":"2024-09-12T02:04:58.733816+0000","last_became_active":"2024-09-12T00:10:09.373661+0000","last_became_peered":"2024-09-12T00:10:09.373661+0000","last_unstale":"2024-09-12T02:04:58.733816+0000","last_undegraded":"2024-09-12T02:04:58.733816+0000","last_fullsized":"2024-09-12T02:04:58.733816+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.718166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":498,"num_write":430,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"266'1252","reported_seq":3052,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.719612+0000","last_change":"2024-09-12T00:10:31.472451+0000","last_active":"2024-09-12T02:02:43.719612+0000","last_peered":"2024-09-12T02:02:43.719612+0000","last_clean":"2024-09-12T02:02:43.719612+0000","last_became_active":"2024-09-12T00:10:31.471885+0000","last_became_peered":"2024-09-12T00:10:31.471885+0000","last_unstale":"2024-09-12T02:02:43.719612+0000","last_undegraded":"2024-09-12T02:02:43.719612+0000","last_fullsized":"2024-09-12T02:02:43.719612+0000","mapping_epoch":38,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:24.536885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6022,"num_read_kb":5329,"num_write":1728,"num_write_kb":723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.750901+0000","last_change":"2024-09-12T00:09:48.283186+0000","last_active":"2024-09-12T02:04:13.750901+0000","last_peered":"2024-09-12T02:04:13.750901+0000","last_clean":"2024-09-12T02:04:13.750901+0000","last_became_active":"2024-09-12T00:09:46.164248+0000","last_became_peered":"2024-09-12T00:09:46.164248+0000","last_unstale":"2024-09-12T02:04:13.750901+0000","last_undegraded":"2024-09-12T02:04:13.750901+0000","last_fullsized":"2024-09-12T02:04:13.750901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:55.257275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099742600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"266'334","reported_seq":982,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.532807+0000","last_change":"2024-09-12T00:09:59.294360+0000","last_active":"2024-09-12T02:06:47.532807+0000","last_peered":"2024-09-12T02:06:47.532807+0000","last_clean":"2024-09-12T02:06:47.532807+0000","last_became_active":"2024-09-12T00:09:59.293880+0000","last_became_peered":"2024-09-12T00:09:59.293880+0000","last_unstale":"2024-09-12T02:06:47.532807+0000","last_undegraded":"2024-09-12T02:06:47.532807+0000","last_fullsized":"2024-09-12T02:06:47.532807+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:11.691652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5590248,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":16782,"num_write":1093,"num_write_kb":42263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726532+0000","last_change":"2024-09-12T00:10:03.273620+0000","last_active":"2024-09-12T02:02:44.726532+0000","last_peered":"2024-09-12T02:02:44.726532+0000","last_clean":"2024-09-12T02:02:44.726532+0000","last_became_active":"2024-09-12T00:10:03.271454+0000","last_became_peered":"2024-09-12T00:10:03.271454+0000","last_unstale":"2024-09-12T02:02:44.726532+0000","last_undegraded":"2024-09-12T02:02:44.726532+0000","last_fullsized":"2024-09-12T02:02:44.726532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:12.327352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"266'1452","reported_seq":3847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.569225+0000","last_change":"2024-09-12T00:10:05.295762+0000","last_active":"2024-09-12T02:06:47.569225+0000","last_peered":"2024-09-12T02:06:47.569225+0000","last_clean":"2024-09-12T02:06:47.569225+0000","last_became_active":"2024-09-12T00:10:05.295058+0000","last_became_peered":"2024-09-12T00:10:05.295058+0000","last_unstale":"2024-09-12T02:06:47.569225+0000","last_undegraded":"2024-09-12T02:06:47.569225+0000","last_fullsized":"2024-09-12T02:06:47.569225+0000","mapping_epoch":31,"log_start":"266'1400","ondisk_log_start":"266'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:03.236457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161189,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2280,"num_read_kb":4238,"num_write":1386,"num_write_kb":1157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.734237+0000","last_change":"2024-09-12T00:10:07.320656+0000","last_active":"2024-09-12T02:03:03.734237+0000","last_peered":"2024-09-12T02:03:03.734237+0000","last_clean":"2024-09-12T02:03:03.734237+0000","last_became_active":"2024-09-12T00:10:07.319957+0000","last_became_peered":"2024-09-12T00:10:07.319957+0000","last_unstale":"2024-09-12T02:03:03.734237+0000","last_undegraded":"2024-09-12T02:03:03.734237+0000","last_fullsized":"2024-09-12T02:03:03.734237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:05.134552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"266'86","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.689469+0000","last_change":"2024-09-12T00:10:09.431550+0000","last_active":"2024-09-12T02:03:18.689469+0000","last_peered":"2024-09-12T02:03:18.689469+0000","last_clean":"2024-09-12T02:03:18.689469+0000","last_became_active":"2024-09-12T00:10:09.430727+0000","last_became_peered":"2024-09-12T00:10:09.430727+0000","last_unstale":"2024-09-12T02:03:18.689469+0000","last_undegraded":"2024-09-12T02:03:18.689469+0000","last_fullsized":"2024-09-12T02:03:18.689469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:34.946722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"266'638","reported_seq":2418,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681419+0000","last_change":"2024-09-12T00:10:01.277654+0000","last_active":"2024-09-12T02:02:43.681419+0000","last_peered":"2024-09-12T02:02:43.681419+0000","last_clean":"2024-09-12T02:02:43.681419+0000","last_became_active":"2024-09-12T00:10:01.277302+0000","last_became_peered":"2024-09-12T00:10:01.277302+0000","last_unstale":"2024-09-12T02:02:43.681419+0000","last_undegraded":"2024-09-12T02:02:43.681419+0000","last_fullsized":"2024-09-12T02:02:43.681419+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.220111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3369,"num_read_kb":3119,"num_write":789,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":554,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.713874+0000","last_change":"2024-09-12T00:09:48.355061+0000","last_active":"2024-09-12T02:04:23.713874+0000","last_peered":"2024-09-12T02:04:23.713874+0000","last_clean":"2024-09-12T02:04:23.713874+0000","last_became_active":"2024-09-12T00:09:46.179853+0000","last_became_peered":"2024-09-12T00:09:46.179853+0000","last_unstale":"2024-09-12T02:04:23.713874+0000","last_undegraded":"2024-09-12T02:04:23.713874+0000","last_fullsized":"2024-09-12T02:04:23.713874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:34.347111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056473999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"266'337","reported_seq":1043,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.554732+0000","last_change":"2024-09-12T00:09:59.317598+0000","last_active":"2024-09-12T02:06:47.554732+0000","last_peered":"2024-09-12T02:06:47.554732+0000","last_clean":"2024-09-12T02:06:47.554732+0000","last_became_active":"2024-09-12T00:09:59.317172+0000","last_became_peered":"2024-09-12T00:09:59.317172+0000","last_unstale":"2024-09-12T02:06:47.554732+0000","last_undegraded":"2024-09-12T02:06:47.554732+0000","last_fullsized":"2024-09-12T02:06:47.554732+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:24.166492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":79957,"num_write":1084,"num_write_kb":20693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.692067+0000","last_change":"2024-09-12T00:10:03.275174+0000","last_active":"2024-09-12T02:02:43.692067+0000","last_peered":"2024-09-12T02:02:43.692067+0000","last_clean":"2024-09-12T02:02:43.692067+0000","last_became_active":"2024-09-12T00:10:03.274519+0000","last_became_peered":"2024-09-12T00:10:03.274519+0000","last_unstale":"2024-09-12T02:02:43.692067+0000","last_undegraded":"2024-09-12T02:02:43.692067+0000","last_fullsized":"2024-09-12T02:02:43.692067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:46.889133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"266'397","reported_seq":2386,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.496951+0000","last_change":"2024-09-12T00:10:05.366148+0000","last_active":"2024-09-12T02:06:03.496951+0000","last_peered":"2024-09-12T02:06:03.496951+0000","last_clean":"2024-09-12T02:06:03.496951+0000","last_became_active":"2024-09-12T00:10:05.365417+0000","last_became_peered":"2024-09-12T00:10:05.365417+0000","last_unstale":"2024-09-12T02:06:03.496951+0000","last_undegraded":"2024-09-12T02:06:03.496951+0000","last_fullsized":"2024-09-12T02:06:03.496951+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:25.902387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":388,"num_read_kb":374,"num_write":387,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.537567+0000","last_change":"2024-09-12T00:10:07.322896+0000","last_active":"2024-09-12T02:04:43.537567+0000","last_peered":"2024-09-12T02:04:43.537567+0000","last_clean":"2024-09-12T02:04:43.537567+0000","last_became_active":"2024-09-12T00:10:07.319786+0000","last_became_peered":"2024-09-12T00:10:07.319786+0000","last_unstale":"2024-09-12T02:04:43.537567+0000","last_undegraded":"2024-09-12T02:04:43.537567+0000","last_fullsized":"2024-09-12T02:04:43.537567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:38.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"266'255","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.247959+0000","last_change":"2024-09-12T00:10:09.366267+0000","last_active":"2024-09-12T02:05:00.247959+0000","last_peered":"2024-09-12T02:05:00.247959+0000","last_clean":"2024-09-12T02:05:00.247959+0000","last_became_active":"2024-09-12T00:10:09.365558+0000","last_became_peered":"2024-09-12T00:10:09.365558+0000","last_unstale":"2024-09-12T02:05:00.247959+0000","last_undegraded":"2024-09-12T02:05:00.247959+0000","last_fullsized":"2024-09-12T02:05:00.247959+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:50.920683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":520,"num_write":557,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"266'478","reported_seq":2049,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708234+0000","last_change":"2024-09-12T00:10:01.257820+0000","last_active":"2024-09-12T02:04:38.708234+0000","last_peered":"2024-09-12T02:04:38.708234+0000","last_clean":"2024-09-12T02:04:38.708234+0000","last_became_active":"2024-09-12T00:10:01.256107+0000","last_became_peered":"2024-09-12T00:10:01.256107+0000","last_unstale":"2024-09-12T02:04:38.708234+0000","last_undegraded":"2024-09-12T02:04:38.708234+0000","last_fullsized":"2024-09-12T02:04:38.708234+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:11.113107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2517,"num_read_kb":2366,"num_write":564,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:24.749016+0000","last_change":"2024-09-12T00:09:48.188360+0000","last_active":"2024-09-12T02:04:24.749016+0000","last_peered":"2024-09-12T02:04:24.749016+0000","last_clean":"2024-09-12T02:04:24.749016+0000","last_became_active":"2024-09-12T00:09:46.161046+0000","last_became_peered":"2024-09-12T00:09:46.161046+0000","last_unstale":"2024-09-12T02:04:24.749016+0000","last_undegraded":"2024-09-12T02:04:24.749016+0000","last_fullsized":"2024-09-12T02:04:24.749016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:21.375528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022130560000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"266'390","reported_seq":1045,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.409427+0000","last_change":"2024-09-12T00:10:31.474540+0000","last_active":"2024-09-12T02:06:47.409427+0000","last_peered":"2024-09-12T02:06:47.409427+0000","last_clean":"2024-09-12T02:06:47.409427+0000","last_became_active":"2024-09-12T00:10:31.473891+0000","last_became_peered":"2024-09-12T00:10:31.473891+0000","last_unstale":"2024-09-12T02:06:47.409427+0000","last_undegraded":"2024-09-12T02:06:47.409427+0000","last_fullsized":"2024-09-12T02:06:47.409427+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:20.027100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1728219,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":35036,"num_write":1225,"num_write_kb":35348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.724461+0000","last_change":"2024-09-12T00:10:03.265946+0000","last_active":"2024-09-12T02:03:03.724461+0000","last_peered":"2024-09-12T02:03:03.724461+0000","last_clean":"2024-09-12T02:03:03.724461+0000","last_became_active":"2024-09-12T00:10:03.264991+0000","last_became_peered":"2024-09-12T00:10:03.264991+0000","last_unstale":"2024-09-12T02:03:03.724461+0000","last_undegraded":"2024-09-12T02:03:03.724461+0000","last_fullsized":"2024-09-12T02:03:03.724461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:41.880299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"266'207","reported_seq":818,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.945244+0000","last_change":"2024-09-12T00:10:05.287107+0000","last_active":"2024-09-12T02:06:03.945244+0000","last_peered":"2024-09-12T02:06:03.945244+0000","last_clean":"2024-09-12T02:06:03.945244+0000","last_became_active":"2024-09-12T00:10:05.286433+0000","last_became_peered":"2024-09-12T00:10:05.286433+0000","last_unstale":"2024-09-12T02:06:03.945244+0000","last_undegraded":"2024-09-12T02:06:03.945244+0000","last_fullsized":"2024-09-12T02:06:03.945244+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:16.708268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":276,"num_read_kb":269,"num_write":202,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.705489+0000","last_change":"2024-09-12T00:10:07.331079+0000","last_active":"2024-09-12T02:02:48.705489+0000","last_peered":"2024-09-12T02:02:48.705489+0000","last_clean":"2024-09-12T02:02:48.705489+0000","last_became_active":"2024-09-12T00:10:07.329823+0000","last_became_peered":"2024-09-12T00:10:07.329823+0000","last_unstale":"2024-09-12T02:02:48.705489+0000","last_undegraded":"2024-09-12T02:02:48.705489+0000","last_fullsized":"2024-09-12T02:02:48.705489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.018430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"266'101","reported_seq":681,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.757399+0000","last_change":"2024-09-12T00:10:09.368892+0000","last_active":"2024-09-12T02:04:59.757399+0000","last_peered":"2024-09-12T02:04:59.757399+0000","last_clean":"2024-09-12T02:04:59.757399+0000","last_became_active":"2024-09-12T00:10:09.368176+0000","last_became_peered":"2024-09-12T00:10:09.368176+0000","last_unstale":"2024-09-12T02:04:59.757399+0000","last_undegraded":"2024-09-12T02:04:59.757399+0000","last_fullsized":"2024-09-12T02:04:59.757399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:23.692773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":222,"num_read_kb":212,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"266'444","reported_seq":2071,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708133+0000","last_change":"2024-09-12T00:10:01.276074+0000","last_active":"2024-09-12T02:04:38.708133+0000","last_peered":"2024-09-12T02:04:38.708133+0000","last_clean":"2024-09-12T02:04:38.708133+0000","last_became_active":"2024-09-12T00:10:01.275794+0000","last_became_peered":"2024-09-12T00:10:01.275794+0000","last_unstale":"2024-09-12T02:04:38.708133+0000","last_undegraded":"2024-09-12T02:04:38.708133+0000","last_fullsized":"2024-09-12T02:04:38.708133+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:44.490041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":509,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"266'295","reported_seq":1000,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.663615+0000","last_change":"2024-09-12T00:09:59.264987+0000","last_active":"2024-09-12T02:06:44.663615+0000","last_peered":"2024-09-12T02:06:44.663615+0000","last_clean":"2024-09-12T02:06:44.663615+0000","last_became_active":"2024-09-12T00:09:59.262793+0000","last_became_peered":"2024-09-12T00:09:59.262793+0000","last_unstale":"2024-09-12T02:06:44.663615+0000","last_undegraded":"2024-09-12T02:06:44.663615+0000","last_fullsized":"2024-09-12T02:06:44.663615+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:14.855206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9586267,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":496,"num_read_kb":23140,"num_write":1070,"num_write_kb":26459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":552,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.704660+0000","last_change":"2024-09-12T00:09:48.193791+0000","last_active":"2024-09-12T02:04:23.704660+0000","last_peered":"2024-09-12T02:04:23.704660+0000","last_clean":"2024-09-12T02:04:23.704660+0000","last_became_active":"2024-09-12T00:09:46.178541+0000","last_became_peered":"2024-09-12T00:09:46.178541+0000","last_unstale":"2024-09-12T02:04:23.704660+0000","last_undegraded":"2024-09-12T02:04:23.704660+0000","last_fullsized":"2024-09-12T02:04:23.704660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:55.733179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00107328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536250+0000","last_change":"2024-09-12T00:10:03.258979+0000","last_active":"2024-09-12T02:04:38.536250+0000","last_peered":"2024-09-12T02:04:38.536250+0000","last_clean":"2024-09-12T02:04:38.536250+0000","last_became_active":"2024-09-12T00:10:03.258209+0000","last_became_peered":"2024-09-12T00:10:03.258209+0000","last_unstale":"2024-09-12T02:04:38.536250+0000","last_undegraded":"2024-09-12T02:04:38.536250+0000","last_fullsized":"2024-09-12T02:04:38.536250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:09.760649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"266'731","reported_seq":1480,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.734931+0000","last_change":"2024-09-12T00:10:05.292028+0000","last_active":"2024-09-12T02:06:46.734931+0000","last_peered":"2024-09-12T02:06:46.734931+0000","last_clean":"2024-09-12T02:06:46.734931+0000","last_became_active":"2024-09-12T00:10:05.289058+0000","last_became_peered":"2024-09-12T00:10:05.289058+0000","last_unstale":"2024-09-12T02:06:46.734931+0000","last_undegraded":"2024-09-12T02:06:46.734931+0000","last_fullsized":"2024-09-12T02:06:46.734931+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:22.158935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92166,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1168,"num_read_kb":2300,"num_write":1050,"num_write_kb":783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.762388+0000","last_change":"2024-09-12T00:10:07.327012+0000","last_active":"2024-09-12T02:04:43.762388+0000","last_peered":"2024-09-12T02:04:43.762388+0000","last_clean":"2024-09-12T02:04:43.762388+0000","last_became_active":"2024-09-12T00:10:07.326146+0000","last_became_peered":"2024-09-12T00:10:07.326146+0000","last_unstale":"2024-09-12T02:04:43.762388+0000","last_undegraded":"2024-09-12T02:04:43.762388+0000","last_fullsized":"2024-09-12T02:04:43.762388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:31.757093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"266'134","reported_seq":658,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.013228+0000","last_change":"2024-09-12T00:10:09.434271+0000","last_active":"2024-09-12T02:04:59.013228+0000","last_peered":"2024-09-12T02:04:59.013228+0000","last_clean":"2024-09-12T02:04:59.013228+0000","last_became_active":"2024-09-12T00:10:09.433444+0000","last_became_peered":"2024-09-12T00:10:09.433444+0000","last_unstale":"2024-09-12T02:04:59.013228+0000","last_undegraded":"2024-09-12T02:04:59.013228+0000","last_fullsized":"2024-09-12T02:04:59.013228+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:56.732745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"266'402","reported_seq":1906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536207+0000","last_change":"2024-09-12T00:10:01.282757+0000","last_active":"2024-09-12T02:04:38.536207+0000","last_peered":"2024-09-12T02:04:38.536207+0000","last_clean":"2024-09-12T02:04:38.536207+0000","last_became_active":"2024-09-12T00:10:01.282373+0000","last_became_peered":"2024-09-12T00:10:01.282373+0000","last_unstale":"2024-09-12T02:04:38.536207+0000","last_undegraded":"2024-09-12T02:04:38.536207+0000","last_fullsized":"2024-09-12T02:04:38.536207+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:40.586380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2068,"num_read_kb":1970,"num_write":460,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"266'417","reported_seq":1197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.490091+0000","last_change":"2024-09-12T00:09:59.251699+0000","last_active":"2024-09-12T02:06:47.490091+0000","last_peered":"2024-09-12T02:06:47.490091+0000","last_clean":"2024-09-12T02:06:47.490091+0000","last_became_active":"2024-09-12T00:09:59.251235+0000","last_became_peered":"2024-09-12T00:09:59.251235+0000","last_unstale":"2024-09-12T02:06:47.490091+0000","last_undegraded":"2024-09-12T02:06:47.490091+0000","last_fullsized":"2024-09-12T02:06:47.490091+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:43.287785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":866,"num_read_kb":78676,"num_write":1275,"num_write_kb":36022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":549,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.729609+0000","last_change":"2024-09-12T00:09:48.283460+0000","last_active":"2024-09-12T02:02:43.729609+0000","last_peered":"2024-09-12T02:02:43.729609+0000","last_clean":"2024-09-12T02:02:43.729609+0000","last_became_active":"2024-09-12T00:09:46.177603+0000","last_became_peered":"2024-09-12T00:09:46.177603+0000","last_unstale":"2024-09-12T02:02:43.729609+0000","last_undegraded":"2024-09-12T02:02:43.729609+0000","last_fullsized":"2024-09-12T02:02:43.729609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:26.898658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729177+0000","last_change":"2024-09-12T00:10:03.259727+0000","last_active":"2024-09-12T02:04:38.729177+0000","last_peered":"2024-09-12T02:04:38.729177+0000","last_clean":"2024-09-12T02:04:38.729177+0000","last_became_active":"2024-09-12T00:10:03.258944+0000","last_became_peered":"2024-09-12T00:10:03.258944+0000","last_unstale":"2024-09-12T02:04:38.729177+0000","last_undegraded":"2024-09-12T02:04:38.729177+0000","last_fullsized":"2024-09-12T02:04:38.729177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:58.686752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"266'257","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709373+0000","last_change":"2024-09-12T00:10:05.367281+0000","last_active":"2024-09-12T02:04:43.709373+0000","last_peered":"2024-09-12T02:04:43.709373+0000","last_clean":"2024-09-12T02:04:43.709373+0000","last_became_active":"2024-09-12T00:10:05.366757+0000","last_became_peered":"2024-09-12T00:10:05.366757+0000","last_unstale":"2024-09-12T02:04:43.709373+0000","last_undegraded":"2024-09-12T02:04:43.709373+0000","last_fullsized":"2024-09-12T02:04:43.709373+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:45.057953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":341,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"266'824","reported_seq":5672,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.363176+0000","last_change":"2024-09-12T00:10:07.314520+0000","last_active":"2024-09-12T02:06:44.363176+0000","last_peered":"2024-09-12T02:06:44.363176+0000","last_clean":"2024-09-12T02:06:44.363176+0000","last_became_active":"2024-09-12T00:10:07.313773+0000","last_became_peered":"2024-09-12T00:10:07.313773+0000","last_unstale":"2024-09-12T02:06:44.363176+0000","last_undegraded":"2024-09-12T02:06:44.363176+0000","last_fullsized":"2024-09-12T02:06:44.363176+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:32.654308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"266'129","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.986570+0000","last_change":"2024-09-12T00:10:09.431402+0000","last_active":"2024-09-12T02:05:08.986570+0000","last_peered":"2024-09-12T02:05:08.986570+0000","last_clean":"2024-09-12T02:05:08.986570+0000","last_became_active":"2024-09-12T00:10:09.430396+0000","last_became_peered":"2024-09-12T00:10:09.430396+0000","last_unstale":"2024-09-12T02:05:08.986570+0000","last_undegraded":"2024-09-12T02:05:08.986570+0000","last_fullsized":"2024-09-12T02:05:08.986570+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:54.666346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"266'481","reported_seq":2194,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.725448+0000","last_change":"2024-09-12T00:10:01.261429+0000","last_active":"2024-09-12T02:04:59.725448+0000","last_peered":"2024-09-12T02:04:59.725448+0000","last_clean":"2024-09-12T02:04:59.725448+0000","last_became_active":"2024-09-12T00:10:01.261139+0000","last_became_peered":"2024-09-12T00:10:01.261139+0000","last_unstale":"2024-09-12T02:04:59.725448+0000","last_undegraded":"2024-09-12T02:04:59.725448+0000","last_fullsized":"2024-09-12T02:04:59.725448+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:23.775837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2740,"num_read_kb":2607,"num_write":578,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"266'330","reported_seq":1138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.946409+0000","last_change":"2024-09-12T00:09:59.280417+0000","last_active":"2024-09-12T02:02:38.946409+0000","last_peered":"2024-09-12T02:02:38.946409+0000","last_clean":"2024-09-12T02:02:38.946409+0000","last_became_active":"2024-09-12T00:09:59.280008+0000","last_became_peered":"2024-09-12T00:09:59.280008+0000","last_unstale":"2024-09-12T02:02:38.946409+0000","last_undegraded":"2024-09-12T02:02:38.946409+0000","last_fullsized":"2024-09-12T02:02:38.946409+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:21.353806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3246317,"num_objects":81,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":636,"num_read_kb":14006,"num_write":1222,"num_write_kb":38960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":550,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708281+0000","last_change":"2024-09-12T00:09:48.193796+0000","last_active":"2024-09-12T02:04:38.708281+0000","last_peered":"2024-09-12T02:04:38.708281+0000","last_clean":"2024-09-12T02:04:38.708281+0000","last_became_active":"2024-09-12T00:09:46.162309+0000","last_became_peered":"2024-09-12T00:09:46.162309+0000","last_unstale":"2024-09-12T02:04:38.708281+0000","last_undegraded":"2024-09-12T02:04:38.708281+0000","last_fullsized":"2024-09-12T02:04:38.708281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:57.198136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010860449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.761245+0000","last_change":"2024-09-12T00:10:03.257249+0000","last_active":"2024-09-12T02:04:38.761245+0000","last_peered":"2024-09-12T02:04:38.761245+0000","last_clean":"2024-09-12T02:04:38.761245+0000","last_became_active":"2024-09-12T00:10:03.256290+0000","last_became_peered":"2024-09-12T00:10:03.256290+0000","last_unstale":"2024-09-12T02:04:38.761245+0000","last_undegraded":"2024-09-12T02:04:38.761245+0000","last_fullsized":"2024-09-12T02:04:38.761245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:00.212778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"266'177","reported_seq":785,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.762472+0000","last_change":"2024-09-12T00:10:05.294735+0000","last_active":"2024-09-12T02:04:43.762472+0000","last_peered":"2024-09-12T02:04:43.762472+0000","last_clean":"2024-09-12T02:04:43.762472+0000","last_became_active":"2024-09-12T00:10:05.293955+0000","last_became_peered":"2024-09-12T00:10:05.293955+0000","last_unstale":"2024-09-12T02:04:43.762472+0000","last_undegraded":"2024-09-12T02:04:43.762472+0000","last_fullsized":"2024-09-12T02:04:43.762472+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:54.115604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":227,"num_write":154,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"266'822","reported_seq":5152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:10.370514+0000","last_change":"2024-09-12T00:10:07.334366+0000","last_active":"2024-09-12T02:06:10.370514+0000","last_peered":"2024-09-12T02:06:10.370514+0000","last_clean":"2024-09-12T02:06:10.370514+0000","last_became_active":"2024-09-12T00:10:07.333642+0000","last_became_peered":"2024-09-12T00:10:07.333642+0000","last_unstale":"2024-09-12T02:06:10.370514+0000","last_undegraded":"2024-09-12T02:06:10.370514+0000","last_fullsized":"2024-09-12T02:06:10.370514+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:25.710728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"266'301","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718365+0000","last_change":"2024-09-12T00:10:09.359415+0000","last_active":"2024-09-12T02:02:38.718365+0000","last_peered":"2024-09-12T02:02:38.718365+0000","last_clean":"2024-09-12T02:02:38.718365+0000","last_became_active":"2024-09-12T00:10:09.358708+0000","last_became_peered":"2024-09-12T00:10:09.358708+0000","last_unstale":"2024-09-12T02:02:38.718365+0000","last_undegraded":"2024-09-12T02:02:38.718365+0000","last_fullsized":"2024-09-12T02:02:38.718365+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:01.334064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":399,"num_read_kb":387,"num_write":681,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"266'1115","reported_seq":2647,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.761286+0000","last_change":"2024-09-12T00:10:01.274977+0000","last_active":"2024-09-12T02:04:38.761286+0000","last_peered":"2024-09-12T02:04:38.761286+0000","last_clean":"2024-09-12T02:04:38.761286+0000","last_became_active":"2024-09-12T00:10:01.274310+0000","last_became_peered":"2024-09-12T00:10:01.274310+0000","last_unstale":"2024-09-12T02:04:38.761286+0000","last_undegraded":"2024-09-12T02:04:38.761286+0000","last_fullsized":"2024-09-12T02:04:38.761286+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:46.070135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5066,"num_read_kb":4471,"num_write":1537,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"266'372","reported_seq":1068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.471298+0000","last_change":"2024-09-12T00:09:59.291971+0000","last_active":"2024-09-12T02:06:47.471298+0000","last_peered":"2024-09-12T02:06:47.471298+0000","last_clean":"2024-09-12T02:06:47.471298+0000","last_became_active":"2024-09-12T00:09:59.291630+0000","last_became_peered":"2024-09-12T00:09:59.291630+0000","last_unstale":"2024-09-12T02:06:47.471298+0000","last_undegraded":"2024-09-12T02:06:47.471298+0000","last_fullsized":"2024-09-12T02:06:47.471298+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:38.513416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306724,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":13946,"num_write":1174,"num_write_kb":43869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":553,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729253+0000","last_change":"2024-09-12T00:09:48.181937+0000","last_active":"2024-09-12T02:04:38.729253+0000","last_peered":"2024-09-12T02:04:38.729253+0000","last_clean":"2024-09-12T02:04:38.729253+0000","last_became_active":"2024-09-12T00:09:46.163643+0000","last_became_peered":"2024-09-12T00:09:46.163643+0000","last_unstale":"2024-09-12T02:04:38.729253+0000","last_undegraded":"2024-09-12T02:04:38.729253+0000","last_fullsized":"2024-09-12T02:04:38.729253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:23.976934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095304600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.973403+0000","last_change":"2024-09-12T00:10:03.265795+0000","last_active":"2024-09-12T02:04:18.973403+0000","last_peered":"2024-09-12T02:04:18.973403+0000","last_clean":"2024-09-12T02:04:18.973403+0000","last_became_active":"2024-09-12T00:10:03.265087+0000","last_became_peered":"2024-09-12T00:10:03.265087+0000","last_unstale":"2024-09-12T02:04:18.973403+0000","last_undegraded":"2024-09-12T02:04:18.973403+0000","last_fullsized":"2024-09-12T02:04:18.973403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:19.906488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"266'829","reported_seq":1619,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.017176+0000","last_change":"2024-09-12T00:10:05.362216+0000","last_active":"2024-09-12T02:06:47.017176+0000","last_peered":"2024-09-12T02:06:47.017176+0000","last_clean":"2024-09-12T02:06:47.017176+0000","last_became_active":"2024-09-12T00:10:05.361458+0000","last_became_peered":"2024-09-12T00:10:05.361458+0000","last_unstale":"2024-09-12T02:06:47.017176+0000","last_undegraded":"2024-09-12T02:06:47.017176+0000","last_fullsized":"2024-09-12T02:06:47.017176+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:05.415919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1463,"num_read_kb":3339,"num_write":1180,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.946113+0000","last_change":"2024-09-12T00:10:07.341062+0000","last_active":"2024-09-12T02:02:38.946113+0000","last_peered":"2024-09-12T02:02:38.946113+0000","last_clean":"2024-09-12T02:02:38.946113+0000","last_became_active":"2024-09-12T00:10:07.333984+0000","last_became_peered":"2024-09-12T00:10:07.333984+0000","last_unstale":"2024-09-12T02:02:38.946113+0000","last_undegraded":"2024-09-12T02:02:38.946113+0000","last_fullsized":"2024-09-12T02:02:38.946113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:04.270793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"266'123","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725287+0000","last_change":"2024-09-12T00:10:09.369672+0000","last_active":"2024-09-12T02:02:39.725287+0000","last_peered":"2024-09-12T02:02:39.725287+0000","last_clean":"2024-09-12T02:02:39.725287+0000","last_became_active":"2024-09-12T00:10:09.368289+0000","last_became_peered":"2024-09-12T00:10:09.368289+0000","last_unstale":"2024-09-12T02:02:39.725287+0000","last_undegraded":"2024-09-12T02:02:39.725287+0000","last_fullsized":"2024-09-12T02:02:39.725287+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:07.697855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"266'155","reported_seq":743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.414654+0000","last_change":"2024-09-12T00:10:09.373153+0000","last_active":"2024-09-12T02:05:00.414654+0000","last_peered":"2024-09-12T02:05:00.414654+0000","last_clean":"2024-09-12T02:05:00.414654+0000","last_became_active":"2024-09-12T00:10:09.372467+0000","last_became_peered":"2024-09-12T00:10:09.372467+0000","last_unstale":"2024-09-12T02:05:00.414654+0000","last_undegraded":"2024-09-12T02:05:00.414654+0000","last_fullsized":"2024-09-12T02:05:00.414654+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:35.985971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":220,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"266'886","reported_seq":2695,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.724639+0000","last_change":"2024-09-12T00:10:01.267707+0000","last_active":"2024-09-12T02:06:05.724639+0000","last_peered":"2024-09-12T02:06:05.724639+0000","last_clean":"2024-09-12T02:06:05.724639+0000","last_became_active":"2024-09-12T00:10:01.266479+0000","last_became_peered":"2024-09-12T00:10:01.266479+0000","last_unstale":"2024-09-12T02:06:05.724639+0000","last_undegraded":"2024-09-12T02:06:05.724639+0000","last_fullsized":"2024-09-12T02:06:05.724639+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:27.980168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4439,"num_read_kb":4016,"num_write":1172,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"266'328","reported_seq":1068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.526748+0000","last_change":"2024-09-12T00:09:59.311766+0000","last_active":"2024-09-12T02:06:47.526748+0000","last_peered":"2024-09-12T02:06:47.526748+0000","last_clean":"2024-09-12T02:06:47.526748+0000","last_became_active":"2024-09-12T00:09:59.309979+0000","last_became_peered":"2024-09-12T00:09:59.309979+0000","last_unstale":"2024-09-12T02:06:47.526748+0000","last_undegraded":"2024-09-12T02:06:47.526748+0000","last_fullsized":"2024-09-12T02:06:47.526748+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:48.006276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":761,"num_read_kb":10875,"num_write":997,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.704615+0000","last_change":"2024-09-12T00:10:03.273557+0000","last_active":"2024-09-12T02:04:23.704615+0000","last_peered":"2024-09-12T02:04:23.704615+0000","last_clean":"2024-09-12T02:04:23.704615+0000","last_became_active":"2024-09-12T00:10:03.272547+0000","last_became_peered":"2024-09-12T00:10:03.272547+0000","last_unstale":"2024-09-12T02:04:23.704615+0000","last_undegraded":"2024-09-12T02:04:23.704615+0000","last_fullsized":"2024-09-12T02:04:23.704615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:14.979796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"266'327","reported_seq":957,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976224+0000","last_change":"2024-09-12T00:10:05.293284+0000","last_active":"2024-09-12T02:04:28.976224+0000","last_peered":"2024-09-12T02:04:28.976224+0000","last_clean":"2024-09-12T02:04:28.976224+0000","last_became_active":"2024-09-12T00:10:05.292446+0000","last_became_peered":"2024-09-12T00:10:05.292446+0000","last_unstale":"2024-09-12T02:04:28.976224+0000","last_undegraded":"2024-09-12T02:04:28.976224+0000","last_fullsized":"2024-09-12T02:04:28.976224+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49680,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":506,"num_read_kb":930,"num_write":396,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:08.938223+0000","last_change":"2024-09-12T00:10:07.339677+0000","last_active":"2024-09-12T02:02:08.938223+0000","last_peered":"2024-09-12T02:02:08.938223+0000","last_clean":"2024-09-12T02:02:08.938223+0000","last_became_active":"2024-09-12T00:10:07.335659+0000","last_became_peered":"2024-09-12T00:10:07.335659+0000","last_unstale":"2024-09-12T02:02:08.938223+0000","last_undegraded":"2024-09-12T02:02:08.938223+0000","last_fullsized":"2024-09-12T02:02:08.938223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:04.120142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"266'115","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.231862+0000","last_change":"2024-09-12T00:10:09.357232+0000","last_active":"2024-09-12T02:05:00.231862+0000","last_peered":"2024-09-12T02:05:00.231862+0000","last_clean":"2024-09-12T02:05:00.231862+0000","last_became_active":"2024-09-12T00:10:09.356043+0000","last_became_peered":"2024-09-12T00:10:09.356043+0000","last_unstale":"2024-09-12T02:05:00.231862+0000","last_undegraded":"2024-09-12T02:05:00.231862+0000","last_fullsized":"2024-09-12T02:05:00.231862+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:08.121957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":102,"num_write":274,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"266'481","reported_seq":2035,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.932083+0000","last_change":"2024-09-12T00:10:01.265349+0000","last_active":"2024-09-12T02:04:59.932083+0000","last_peered":"2024-09-12T02:04:59.932083+0000","last_clean":"2024-09-12T02:04:59.932083+0000","last_became_active":"2024-09-12T00:10:01.264977+0000","last_became_peered":"2024-09-12T00:10:01.264977+0000","last_unstale":"2024-09-12T02:04:59.932083+0000","last_undegraded":"2024-09-12T02:04:59.932083+0000","last_fullsized":"2024-09-12T02:04:59.932083+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2306,"num_write":570,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"266'380","reported_seq":1015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.464304+0000","last_change":"2024-09-12T00:09:59.300779+0000","last_active":"2024-09-12T02:06:47.464304+0000","last_peered":"2024-09-12T02:06:47.464304+0000","last_clean":"2024-09-12T02:06:47.464304+0000","last_became_active":"2024-09-12T00:09:59.300181+0000","last_became_peered":"2024-09-12T00:09:59.300181+0000","last_unstale":"2024-09-12T02:06:47.464304+0000","last_undegraded":"2024-09-12T02:06:47.464304+0000","last_fullsized":"2024-09-12T02:06:47.464304+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:30.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":10768,"num_write":1216,"num_write_kb":35109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.975027+0000","last_change":"2024-09-12T00:10:03.256755+0000","last_active":"2024-09-12T02:04:23.975027+0000","last_peered":"2024-09-12T02:04:23.975027+0000","last_clean":"2024-09-12T02:04:23.975027+0000","last_became_active":"2024-09-12T00:10:03.256053+0000","last_became_peered":"2024-09-12T00:10:03.256053+0000","last_unstale":"2024-09-12T02:04:23.975027+0000","last_undegraded":"2024-09-12T02:04:23.975027+0000","last_fullsized":"2024-09-12T02:04:23.975027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:53.915837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"266'74","reported_seq":615,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.954859+0000","last_change":"2024-09-12T00:10:05.289328+0000","last_active":"2024-09-12T02:04:59.954859+0000","last_peered":"2024-09-12T02:04:59.954859+0000","last_clean":"2024-09-12T02:04:59.954859+0000","last_became_active":"2024-09-12T00:10:05.288688+0000","last_became_peered":"2024-09-12T00:10:05.288688+0000","last_unstale":"2024-09-12T02:04:59.954859+0000","last_undegraded":"2024-09-12T02:04:59.954859+0000","last_fullsized":"2024-09-12T02:04:59.954859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.509523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.754653+0000","last_change":"2024-09-12T00:10:07.321379+0000","last_active":"2024-09-12T02:04:28.754653+0000","last_peered":"2024-09-12T02:04:28.754653+0000","last_clean":"2024-09-12T02:04:28.754653+0000","last_became_active":"2024-09-12T00:10:07.320729+0000","last_became_peered":"2024-09-12T00:10:07.320729+0000","last_unstale":"2024-09-12T02:04:28.754653+0000","last_undegraded":"2024-09-12T02:04:28.754653+0000","last_fullsized":"2024-09-12T02:04:28.754653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:20.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"266'204","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.570680+0000","last_change":"2024-09-12T00:10:09.362996+0000","last_active":"2024-09-12T02:04:57.570680+0000","last_peered":"2024-09-12T02:04:57.570680+0000","last_clean":"2024-09-12T02:04:57.570680+0000","last_became_active":"2024-09-12T00:10:09.362096+0000","last_became_peered":"2024-09-12T00:10:09.362096+0000","last_unstale":"2024-09-12T02:04:57.570680+0000","last_undegraded":"2024-09-12T02:04:57.570680+0000","last_fullsized":"2024-09-12T02:04:57.570680+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:36.489316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":296,"num_read_kb":291,"num_write":467,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"266'430","reported_seq":2143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.720489+0000","last_change":"2024-09-12T00:10:01.261417+0000","last_active":"2024-09-12T02:06:05.720489+0000","last_peered":"2024-09-12T02:06:05.720489+0000","last_clean":"2024-09-12T02:06:05.720489+0000","last_became_active":"2024-09-12T00:10:01.261030+0000","last_became_peered":"2024-09-12T00:10:01.261030+0000","last_unstale":"2024-09-12T02:06:05.720489+0000","last_undegraded":"2024-09-12T02:06:05.720489+0000","last_fullsized":"2024-09-12T02:06:05.720489+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:45.394167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2550,"num_read_kb":2440,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"266'313","reported_seq":1007,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.749735+0000","last_change":"2024-09-12T00:09:59.288987+0000","last_active":"2024-09-12T02:06:44.749735+0000","last_peered":"2024-09-12T02:06:44.749735+0000","last_clean":"2024-09-12T02:06:44.749735+0000","last_became_active":"2024-09-12T00:09:59.288100+0000","last_became_peered":"2024-09-12T00:09:59.288100+0000","last_unstale":"2024-09-12T02:06:44.749735+0000","last_undegraded":"2024-09-12T02:06:44.749735+0000","last_fullsized":"2024-09-12T02:06:44.749735+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:51.350979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9466169,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":528,"num_read_kb":15869,"num_write":1106,"num_write_kb":23659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753274+0000","last_change":"2024-09-12T00:10:03.257101+0000","last_active":"2024-09-12T02:04:23.753274+0000","last_peered":"2024-09-12T02:04:23.753274+0000","last_clean":"2024-09-12T02:04:23.753274+0000","last_became_active":"2024-09-12T00:10:03.255669+0000","last_became_peered":"2024-09-12T00:10:03.255669+0000","last_unstale":"2024-09-12T02:04:23.753274+0000","last_undegraded":"2024-09-12T02:04:23.753274+0000","last_fullsized":"2024-09-12T02:04:23.753274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:32.002572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"266'340","reported_seq":980,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976323+0000","last_change":"2024-09-12T00:10:05.300654+0000","last_active":"2024-09-12T02:04:28.976323+0000","last_peered":"2024-09-12T02:04:28.976323+0000","last_clean":"2024-09-12T02:04:28.976323+0000","last_became_active":"2024-09-12T00:10:05.299730+0000","last_became_peered":"2024-09-12T00:10:05.299730+0000","last_unstale":"2024-09-12T02:04:28.976323+0000","last_undegraded":"2024-09-12T02:04:28.976323+0000","last_fullsized":"2024-09-12T02:04:28.976323+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:30.946739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59233,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":548,"num_read_kb":1010,"num_write":422,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.727089+0000","last_change":"2024-09-12T00:10:07.330541+0000","last_active":"2024-09-12T02:04:28.727089+0000","last_peered":"2024-09-12T02:04:28.727089+0000","last_clean":"2024-09-12T02:04:28.727089+0000","last_became_active":"2024-09-12T00:10:07.329741+0000","last_became_peered":"2024-09-12T00:10:07.329741+0000","last_unstale":"2024-09-12T02:04:28.727089+0000","last_undegraded":"2024-09-12T02:04:28.727089+0000","last_fullsized":"2024-09-12T02:04:28.727089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:23.412449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"266'89","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725178+0000","last_change":"2024-09-12T00:10:09.372894+0000","last_active":"2024-09-12T02:02:39.725178+0000","last_peered":"2024-09-12T02:02:39.725178+0000","last_clean":"2024-09-12T02:02:39.725178+0000","last_became_active":"2024-09-12T00:10:09.371755+0000","last_became_peered":"2024-09-12T00:10:09.371755+0000","last_unstale":"2024-09-12T02:02:39.725178+0000","last_undegraded":"2024-09-12T02:02:39.725178+0000","last_fullsized":"2024-09-12T02:02:39.725178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:18.332494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":213,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"266'805","reported_seq":2435,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974707+0000","last_change":"2024-09-12T00:10:01.259175+0000","last_active":"2024-09-12T02:04:23.974707+0000","last_peered":"2024-09-12T02:04:23.974707+0000","last_clean":"2024-09-12T02:04:23.974707+0000","last_became_active":"2024-09-12T00:10:01.258814+0000","last_became_peered":"2024-09-12T00:10:01.258814+0000","last_unstale":"2024-09-12T02:04:23.974707+0000","last_undegraded":"2024-09-12T02:04:23.974707+0000","last_fullsized":"2024-09-12T02:04:23.974707+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:34.228716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3906,"num_read_kb":3532,"num_write":1046,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"266'415","reported_seq":1079,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.547826+0000","last_change":"2024-09-12T00:09:59.263146+0000","last_active":"2024-09-12T02:06:47.547826+0000","last_peered":"2024-09-12T02:06:47.547826+0000","last_clean":"2024-09-12T02:06:47.547826+0000","last_became_active":"2024-09-12T00:09:59.262775+0000","last_became_peered":"2024-09-12T00:09:59.262775+0000","last_unstale":"2024-09-12T02:06:47.547826+0000","last_undegraded":"2024-09-12T02:06:47.547826+0000","last_fullsized":"2024-09-12T02:06:47.547826+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:27.798550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":557,"num_read_kb":527,"num_write":1329,"num_write_kb":18885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.725899+0000","last_change":"2024-09-12T00:10:03.258677+0000","last_active":"2024-09-12T02:04:23.725899+0000","last_peered":"2024-09-12T02:04:23.725899+0000","last_clean":"2024-09-12T02:04:23.725899+0000","last_became_active":"2024-09-12T00:10:03.257953+0000","last_became_peered":"2024-09-12T00:10:03.257953+0000","last_unstale":"2024-09-12T02:04:23.725899+0000","last_undegraded":"2024-09-12T02:04:23.725899+0000","last_fullsized":"2024-09-12T02:04:23.725899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:23.465779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"266'327","reported_seq":941,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.290038+0000","last_change":"2024-09-12T00:10:05.286232+0000","last_active":"2024-09-12T02:06:46.290038+0000","last_peered":"2024-09-12T02:06:46.290038+0000","last_clean":"2024-09-12T02:06:46.290038+0000","last_became_active":"2024-09-12T00:10:05.285485+0000","last_became_peered":"2024-09-12T00:10:05.285485+0000","last_unstale":"2024-09-12T02:06:46.290038+0000","last_undegraded":"2024-09-12T02:06:46.290038+0000","last_fullsized":"2024-09-12T02:06:46.290038+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:50.842485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":1250,"num_write":446,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.533657+0000","last_change":"2024-09-12T00:10:07.326257+0000","last_active":"2024-09-12T02:04:28.533657+0000","last_peered":"2024-09-12T02:04:28.533657+0000","last_clean":"2024-09-12T02:04:28.533657+0000","last_became_active":"2024-09-12T00:10:07.325482+0000","last_became_peered":"2024-09-12T00:10:07.325482+0000","last_unstale":"2024-09-12T02:04:28.533657+0000","last_undegraded":"2024-09-12T02:04:28.533657+0000","last_fullsized":"2024-09-12T02:04:28.533657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:27.852281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"266'839","reported_seq":2400,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729315+0000","last_change":"2024-09-12T00:10:01.277544+0000","last_active":"2024-09-12T02:04:38.729315+0000","last_peered":"2024-09-12T02:04:38.729315+0000","last_clean":"2024-09-12T02:04:38.729315+0000","last_became_active":"2024-09-12T00:10:01.276906+0000","last_became_peered":"2024-09-12T00:10:01.276906+0000","last_unstale":"2024-09-12T02:04:38.729315+0000","last_undegraded":"2024-09-12T02:04:38.729315+0000","last_fullsized":"2024-09-12T02:04:38.729315+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:55.926406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3919,"num_read_kb":3507,"num_write":1092,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"266'264","reported_seq":938,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:59.606810+0000","last_change":"2024-09-12T00:09:59.249092+0000","last_active":"2024-09-12T02:05:59.606810+0000","last_peered":"2024-09-12T02:05:59.606810+0000","last_clean":"2024-09-12T02:05:59.606810+0000","last_became_active":"2024-09-12T00:09:59.248681+0000","last_became_peered":"2024-09-12T00:09:59.248681+0000","last_unstale":"2024-09-12T02:05:59.606810+0000","last_undegraded":"2024-09-12T02:05:59.606810+0000","last_fullsized":"2024-09-12T02:05:59.606810+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:44.662803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11196370,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":444,"num_read_kb":23742,"num_write":1054,"num_write_kb":29955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536376+0000","last_change":"2024-09-12T00:10:03.261107+0000","last_active":"2024-09-12T02:04:38.536376+0000","last_peered":"2024-09-12T02:04:38.536376+0000","last_clean":"2024-09-12T02:04:38.536376+0000","last_became_active":"2024-09-12T00:10:03.260387+0000","last_became_peered":"2024-09-12T00:10:03.260387+0000","last_unstale":"2024-09-12T02:04:38.536376+0000","last_undegraded":"2024-09-12T02:04:38.536376+0000","last_fullsized":"2024-09-12T02:04:38.536376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:53.966697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"266'542","reported_seq":1220,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.173354+0000","last_change":"2024-09-12T00:10:05.301383+0000","last_active":"2024-09-12T02:06:46.173354+0000","last_peered":"2024-09-12T02:06:46.173354+0000","last_clean":"2024-09-12T02:06:46.173354+0000","last_became_active":"2024-09-12T00:10:05.300613+0000","last_became_peered":"2024-09-12T00:10:05.300613+0000","last_unstale":"2024-09-12T02:06:46.173354+0000","last_undegraded":"2024-09-12T02:06:46.173354+0000","last_fullsized":"2024-09-12T02:06:46.173354+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:48.609813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102448,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":959,"num_read_kb":2206,"num_write":818,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725243+0000","last_change":"2024-09-12T00:10:07.343479+0000","last_active":"2024-09-12T02:02:39.725243+0000","last_peered":"2024-09-12T02:02:39.725243+0000","last_clean":"2024-09-12T02:02:39.725243+0000","last_became_active":"2024-09-12T00:10:07.342700+0000","last_became_peered":"2024-09-12T00:10:07.342700+0000","last_unstale":"2024-09-12T02:02:39.725243+0000","last_undegraded":"2024-09-12T02:02:39.725243+0000","last_fullsized":"2024-09-12T02:02:39.725243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:29.670776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"266'157","reported_seq":687,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:08.938400+0000","last_change":"2024-09-12T00:10:09.436544+0000","last_active":"2024-09-12T02:02:08.938400+0000","last_peered":"2024-09-12T02:02:08.938400+0000","last_clean":"2024-09-12T02:02:08.938400+0000","last_became_active":"2024-09-12T00:10:09.435513+0000","last_became_peered":"2024-09-12T00:10:09.435513+0000","last_unstale":"2024-09-12T02:02:08.938400+0000","last_undegraded":"2024-09-12T02:02:08.938400+0000","last_fullsized":"2024-09-12T02:02:08.938400+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:42.230555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":193,"num_write":343,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"266'810","reported_seq":2368,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719876+0000","last_change":"2024-09-12T00:10:01.260517+0000","last_active":"2024-09-12T02:04:59.719876+0000","last_peered":"2024-09-12T02:04:59.719876+0000","last_clean":"2024-09-12T02:04:59.719876+0000","last_became_active":"2024-09-12T00:10:01.260115+0000","last_became_peered":"2024-09-12T00:10:01.260115+0000","last_unstale":"2024-09-12T02:04:59.719876+0000","last_undegraded":"2024-09-12T02:04:59.719876+0000","last_fullsized":"2024-09-12T02:04:59.719876+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:58.706655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3786,"num_read_kb":3403,"num_write":1061,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"266'381","reported_seq":1156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.547753+0000","last_change":"2024-09-12T00:09:59.286280+0000","last_active":"2024-09-12T02:06:47.547753+0000","last_peered":"2024-09-12T02:06:47.547753+0000","last_clean":"2024-09-12T02:06:47.547753+0000","last_became_active":"2024-09-12T00:09:59.285792+0000","last_became_peered":"2024-09-12T00:09:59.285792+0000","last_unstale":"2024-09-12T02:06:47.547753+0000","last_undegraded":"2024-09-12T02:06:47.547753+0000","last_fullsized":"2024-09-12T02:06:47.547753+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:19.960444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":739,"num_read_kb":25287,"num_write":1212,"num_write_kb":29345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729275+0000","last_change":"2024-09-12T00:10:03.258466+0000","last_active":"2024-09-12T02:04:38.729275+0000","last_peered":"2024-09-12T02:04:38.729275+0000","last_clean":"2024-09-12T02:04:38.729275+0000","last_became_active":"2024-09-12T00:10:03.257760+0000","last_became_peered":"2024-09-12T00:10:03.257760+0000","last_unstale":"2024-09-12T02:04:38.729275+0000","last_undegraded":"2024-09-12T02:04:38.729275+0000","last_fullsized":"2024-09-12T02:04:38.729275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:08.684067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"266'382","reported_seq":1028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.379891+0000","last_change":"2024-09-12T00:10:05.293759+0000","last_active":"2024-09-12T02:06:46.379891+0000","last_peered":"2024-09-12T02:06:46.379891+0000","last_clean":"2024-09-12T02:06:46.379891+0000","last_became_active":"2024-09-12T00:10:05.292902+0000","last_became_peered":"2024-09-12T00:10:05.292902+0000","last_unstale":"2024-09-12T02:06:46.379891+0000","last_undegraded":"2024-09-12T02:06:46.379891+0000","last_fullsized":"2024-09-12T02:06:46.379891+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:01.365556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":1193,"num_write":510,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679856+0000","last_change":"2024-09-12T00:10:07.322324+0000","last_active":"2024-09-12T02:02:38.679856+0000","last_peered":"2024-09-12T02:02:38.679856+0000","last_clean":"2024-09-12T02:02:38.679856+0000","last_became_active":"2024-09-12T00:10:07.321400+0000","last_became_peered":"2024-09-12T00:10:07.321400+0000","last_unstale":"2024-09-12T02:02:38.679856+0000","last_undegraded":"2024-09-12T02:02:38.679856+0000","last_fullsized":"2024-09-12T02:02:38.679856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:09.420108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"266'186","reported_seq":741,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:50.389377+0000","last_change":"2024-09-12T00:10:09.356446+0000","last_active":"2024-09-12T02:04:50.389377+0000","last_peered":"2024-09-12T02:04:50.389377+0000","last_clean":"2024-09-12T02:04:50.389377+0000","last_became_active":"2024-09-12T00:10:09.355548+0000","last_became_peered":"2024-09-12T00:10:09.355548+0000","last_unstale":"2024-09-12T02:04:50.389377+0000","last_undegraded":"2024-09-12T02:04:50.389377+0000","last_fullsized":"2024-09-12T02:04:50.389377+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:14.356852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":268,"num_write":529,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"266'393","reported_seq":1777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.725362+0000","last_change":"2024-09-12T00:10:01.257147+0000","last_active":"2024-09-12T02:04:59.725362+0000","last_peered":"2024-09-12T02:04:59.725362+0000","last_clean":"2024-09-12T02:04:59.725362+0000","last_became_active":"2024-09-12T00:10:01.256781+0000","last_became_peered":"2024-09-12T00:10:01.256781+0000","last_unstale":"2024-09-12T02:04:59.725362+0000","last_undegraded":"2024-09-12T02:04:59.725362+0000","last_fullsized":"2024-09-12T02:04:59.725362+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:08.713733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1972,"num_read_kb":1849,"num_write":456,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"266'342","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.401668+0000","last_change":"2024-09-12T00:09:59.301265+0000","last_active":"2024-09-12T02:06:47.401668+0000","last_peered":"2024-09-12T02:06:47.401668+0000","last_clean":"2024-09-12T02:06:47.401668+0000","last_became_active":"2024-09-12T00:09:59.295949+0000","last_became_peered":"2024-09-12T00:09:59.295949+0000","last_unstale":"2024-09-12T02:06:47.401668+0000","last_undegraded":"2024-09-12T02:06:47.401668+0000","last_fullsized":"2024-09-12T02:06:47.401668+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:00.402184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314586,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":1958,"num_write":1004,"num_write_kb":21693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733298+0000","last_change":"2024-09-12T00:10:03.255686+0000","last_active":"2024-09-12T02:02:33.733298+0000","last_peered":"2024-09-12T02:02:33.733298+0000","last_clean":"2024-09-12T02:02:33.733298+0000","last_became_active":"2024-09-12T00:10:03.254941+0000","last_became_peered":"2024-09-12T00:10:03.254941+0000","last_unstale":"2024-09-12T02:02:33.733298+0000","last_undegraded":"2024-09-12T02:02:33.733298+0000","last_fullsized":"2024-09-12T02:02:33.733298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:39.484405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"266'341","reported_seq":977,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.980585+0000","last_change":"2024-09-12T00:10:05.362933+0000","last_active":"2024-09-12T02:04:43.980585+0000","last_peered":"2024-09-12T02:04:43.980585+0000","last_clean":"2024-09-12T02:04:43.980585+0000","last_became_active":"2024-09-12T00:10:05.362151+0000","last_became_peered":"2024-09-12T00:10:05.362151+0000","last_unstale":"2024-09-12T02:04:43.980585+0000","last_undegraded":"2024-09-12T02:04:43.980585+0000","last_fullsized":"2024-09-12T02:04:43.980585+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:23.347759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55661,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":1075,"num_write":452,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708301+0000","last_change":"2024-09-12T00:10:07.336945+0000","last_active":"2024-09-12T02:04:38.708301+0000","last_peered":"2024-09-12T02:04:38.708301+0000","last_clean":"2024-09-12T02:04:38.708301+0000","last_became_active":"2024-09-12T00:10:07.336129+0000","last_became_peered":"2024-09-12T00:10:07.336129+0000","last_unstale":"2024-09-12T02:04:38.708301+0000","last_undegraded":"2024-09-12T02:04:38.708301+0000","last_fullsized":"2024-09-12T02:04:38.708301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:22.333025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"266'100","reported_seq":624,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.109970+0000","last_change":"2024-09-12T00:10:09.371725+0000","last_active":"2024-09-12T02:06:07.109970+0000","last_peered":"2024-09-12T02:06:07.109970+0000","last_clean":"2024-09-12T02:06:07.109970+0000","last_became_active":"2024-09-12T00:10:09.370925+0000","last_became_peered":"2024-09-12T00:10:09.370925+0000","last_unstale":"2024-09-12T02:06:07.109970+0000","last_undegraded":"2024-09-12T02:06:07.109970+0000","last_fullsized":"2024-09-12T02:06:07.109970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:01.455208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"266'455","reported_seq":2115,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689872+0000","last_change":"2024-09-12T00:10:01.257454+0000","last_active":"2024-09-12T02:02:33.689872+0000","last_peered":"2024-09-12T02:02:33.689872+0000","last_clean":"2024-09-12T02:02:33.689872+0000","last_became_active":"2024-09-12T00:10:01.257064+0000","last_became_peered":"2024-09-12T00:10:01.257064+0000","last_unstale":"2024-09-12T02:02:33.689872+0000","last_undegraded":"2024-09-12T02:02:33.689872+0000","last_fullsized":"2024-09-12T02:02:33.689872+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:41.782738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2638,"num_read_kb":2500,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"266'393","reported_seq":1087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.549604+0000","last_change":"2024-09-12T00:09:59.289590+0000","last_active":"2024-09-12T02:06:47.549604+0000","last_peered":"2024-09-12T02:06:47.549604+0000","last_clean":"2024-09-12T02:06:47.549604+0000","last_became_active":"2024-09-12T00:09:59.289217+0000","last_became_peered":"2024-09-12T00:09:59.289217+0000","last_unstale":"2024-09-12T02:06:47.549604+0000","last_undegraded":"2024-09-12T02:06:47.549604+0000","last_fullsized":"2024-09-12T02:06:47.549604+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:02.241515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":33363,"num_write":1255,"num_write_kb":62829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.678668+0000","last_change":"2024-09-12T00:10:03.265403+0000","last_active":"2024-09-12T02:02:33.678668+0000","last_peered":"2024-09-12T02:02:33.678668+0000","last_clean":"2024-09-12T02:02:33.678668+0000","last_became_active":"2024-09-12T00:10:03.264802+0000","last_became_peered":"2024-09-12T00:10:03.264802+0000","last_unstale":"2024-09-12T02:02:33.678668+0000","last_undegraded":"2024-09-12T02:02:33.678668+0000","last_fullsized":"2024-09-12T02:02:33.678668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:04.107888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"266'163","reported_seq":757,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.760399+0000","last_change":"2024-09-12T00:10:05.362816+0000","last_active":"2024-09-12T02:04:33.760399+0000","last_peered":"2024-09-12T02:04:33.760399+0000","last_clean":"2024-09-12T02:04:33.760399+0000","last_became_active":"2024-09-12T00:10:05.361625+0000","last_became_peered":"2024-09-12T00:10:05.361625+0000","last_unstale":"2024-09-12T02:04:33.760399+0000","last_undegraded":"2024-09-12T02:04:33.760399+0000","last_fullsized":"2024-09-12T02:04:33.760399+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:40.143219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":192,"num_write":144,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"266'764","reported_seq":3195,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.569476+0000","last_change":"2024-09-12T00:10:07.315770+0000","last_active":"2024-09-12T02:06:47.569476+0000","last_peered":"2024-09-12T02:06:47.569476+0000","last_clean":"2024-09-12T02:06:47.569476+0000","last_became_active":"2024-09-12T00:10:07.314980+0000","last_became_peered":"2024-09-12T00:10:07.314980+0000","last_unstale":"2024-09-12T02:06:47.569476+0000","last_undegraded":"2024-09-12T02:06:47.569476+0000","last_fullsized":"2024-09-12T02:06:47.569476+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:26.700418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"266'122","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.754575+0000","last_change":"2024-09-12T00:10:09.370317+0000","last_active":"2024-09-12T02:04:28.754575+0000","last_peered":"2024-09-12T02:04:28.754575+0000","last_clean":"2024-09-12T02:04:28.754575+0000","last_became_active":"2024-09-12T00:10:09.369670+0000","last_became_peered":"2024-09-12T00:10:09.369670+0000","last_unstale":"2024-09-12T02:04:28.754575+0000","last_undegraded":"2024-09-12T02:04:28.754575+0000","last_fullsized":"2024-09-12T02:04:28.754575+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:51.975587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":303,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"266'514","reported_seq":2009,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733221+0000","last_change":"2024-09-12T00:10:01.249269+0000","last_active":"2024-09-12T02:02:33.733221+0000","last_peered":"2024-09-12T02:02:33.733221+0000","last_clean":"2024-09-12T02:02:33.733221+0000","last_became_active":"2024-09-12T00:10:01.248535+0000","last_became_peered":"2024-09-12T00:10:01.248535+0000","last_unstale":"2024-09-12T02:02:33.733221+0000","last_undegraded":"2024-09-12T02:02:33.733221+0000","last_fullsized":"2024-09-12T02:02:33.733221+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:56.739255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2593,"num_read_kb":2391,"num_write":659,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"266'330","reported_seq":1029,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.714691+0000","last_change":"2024-09-12T00:09:59.297197+0000","last_active":"2024-09-12T02:06:44.714691+0000","last_peered":"2024-09-12T02:06:44.714691+0000","last_clean":"2024-09-12T02:06:44.714691+0000","last_became_active":"2024-09-12T00:09:59.296207+0000","last_became_peered":"2024-09-12T00:09:59.296207+0000","last_unstale":"2024-09-12T02:06:44.714691+0000","last_undegraded":"2024-09-12T02:06:44.714691+0000","last_fullsized":"2024-09-12T02:06:44.714691+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:59.878998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5083213,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":523,"num_read_kb":14261,"num_write":1185,"num_write_kb":35890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.727067+0000","last_change":"2024-09-12T00:10:03.260439+0000","last_active":"2024-09-12T02:02:33.727067+0000","last_peered":"2024-09-12T02:02:33.727067+0000","last_clean":"2024-09-12T02:02:33.727067+0000","last_became_active":"2024-09-12T00:10:03.259644+0000","last_became_peered":"2024-09-12T00:10:03.259644+0000","last_unstale":"2024-09-12T02:02:33.727067+0000","last_undegraded":"2024-09-12T02:02:33.727067+0000","last_fullsized":"2024-09-12T02:02:33.727067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:33.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"266'378","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:24.777642+0000","last_change":"2024-09-12T00:10:05.297805+0000","last_active":"2024-09-12T02:06:24.777642+0000","last_peered":"2024-09-12T02:06:24.777642+0000","last_clean":"2024-09-12T02:06:24.777642+0000","last_became_active":"2024-09-12T00:10:05.297223+0000","last_became_peered":"2024-09-12T00:10:05.297223+0000","last_unstale":"2024-09-12T02:06:24.777642+0000","last_undegraded":"2024-09-12T02:06:24.777642+0000","last_fullsized":"2024-09-12T02:06:24.777642+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:02.183020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46610,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":587,"num_read_kb":987,"num_write":442,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.522957+0000","last_change":"2024-09-12T00:10:07.324114+0000","last_active":"2024-09-12T02:03:43.522957+0000","last_peered":"2024-09-12T02:03:43.522957+0000","last_clean":"2024-09-12T02:03:43.522957+0000","last_became_active":"2024-09-12T00:10:07.323296+0000","last_became_peered":"2024-09-12T00:10:07.323296+0000","last_unstale":"2024-09-12T02:03:43.522957+0000","last_undegraded":"2024-09-12T02:03:43.522957+0000","last_fullsized":"2024-09-12T02:03:43.522957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:17.788189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"266'145","reported_seq":669,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:52.636170+0000","last_change":"2024-09-12T00:10:09.362544+0000","last_active":"2024-09-12T02:04:52.636170+0000","last_peered":"2024-09-12T02:04:52.636170+0000","last_clean":"2024-09-12T02:04:52.636170+0000","last_became_active":"2024-09-12T00:10:09.361797+0000","last_became_peered":"2024-09-12T00:10:09.361797+0000","last_unstale":"2024-09-12T02:04:52.636170+0000","last_undegraded":"2024-09-12T02:04:52.636170+0000","last_fullsized":"2024-09-12T02:04:52.636170+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:59.618943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":153,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"266'798","reported_seq":2149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733158+0000","last_change":"2024-09-12T00:10:31.165648+0000","last_active":"2024-09-12T02:02:33.733158+0000","last_peered":"2024-09-12T02:02:33.733158+0000","last_clean":"2024-09-12T02:02:33.733158+0000","last_became_active":"2024-09-12T00:10:31.165044+0000","last_became_peered":"2024-09-12T00:10:31.165044+0000","last_unstale":"2024-09-12T02:02:33.733158+0000","last_undegraded":"2024-09-12T02:02:33.733158+0000","last_fullsized":"2024-09-12T02:02:33.733158+0000","mapping_epoch":38,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:52.001534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3606,"num_read_kb":3182,"num_write":1095,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"266'320","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.636792+0000","last_change":"2024-09-12T00:09:59.271158+0000","last_active":"2024-09-12T02:06:44.636792+0000","last_peered":"2024-09-12T02:06:44.636792+0000","last_clean":"2024-09-12T02:06:44.636792+0000","last_became_active":"2024-09-12T00:09:59.264091+0000","last_became_peered":"2024-09-12T00:09:59.264091+0000","last_unstale":"2024-09-12T02:06:44.636792+0000","last_undegraded":"2024-09-12T02:06:44.636792+0000","last_fullsized":"2024-09-12T02:06:44.636792+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:19.196253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1786383,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":590,"num_read_kb":45982,"num_write":1051,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:34.724000+0000","last_change":"2024-09-12T00:10:03.264424+0000","last_active":"2024-09-12T02:02:34.724000+0000","last_peered":"2024-09-12T02:02:34.724000+0000","last_clean":"2024-09-12T02:02:34.724000+0000","last_became_active":"2024-09-12T00:10:03.263712+0000","last_became_peered":"2024-09-12T00:10:03.263712+0000","last_unstale":"2024-09-12T02:02:34.724000+0000","last_undegraded":"2024-09-12T02:02:34.724000+0000","last_fullsized":"2024-09-12T02:02:34.724000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:02.001466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"266'311","reported_seq":930,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.559880+0000","last_change":"2024-09-12T00:10:05.298555+0000","last_active":"2024-09-12T02:06:45.559880+0000","last_peered":"2024-09-12T02:06:45.559880+0000","last_clean":"2024-09-12T02:06:45.559880+0000","last_became_active":"2024-09-12T00:10:05.297514+0000","last_became_peered":"2024-09-12T00:10:05.297514+0000","last_unstale":"2024-09-12T02:06:45.559880+0000","last_undegraded":"2024-09-12T02:06:45.559880+0000","last_fullsized":"2024-09-12T02:06:45.559880+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:45.661380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42254,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1111,"num_write":410,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.723739+0000","last_change":"2024-09-12T00:10:07.325384+0000","last_active":"2024-09-12T02:04:13.723739+0000","last_peered":"2024-09-12T02:04:13.723739+0000","last_clean":"2024-09-12T02:04:13.723739+0000","last_became_active":"2024-09-12T00:10:07.320880+0000","last_became_peered":"2024-09-12T00:10:07.320880+0000","last_unstale":"2024-09-12T02:04:13.723739+0000","last_undegraded":"2024-09-12T02:04:13.723739+0000","last_fullsized":"2024-09-12T02:04:13.723739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:10.636128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"266'120","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.964456+0000","last_change":"2024-09-12T00:10:09.434166+0000","last_active":"2024-09-12T02:03:43.964456+0000","last_peered":"2024-09-12T02:03:43.964456+0000","last_clean":"2024-09-12T02:03:43.964456+0000","last_became_active":"2024-09-12T00:10:09.433296+0000","last_became_peered":"2024-09-12T00:10:09.433296+0000","last_unstale":"2024-09-12T02:03:43.964456+0000","last_undegraded":"2024-09-12T02:03:43.964456+0000","last_fullsized":"2024-09-12T02:03:43.964456+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:16.296420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1168,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":163,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"266'596","reported_seq":2323,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.720907+0000","last_change":"2024-09-12T00:10:01.242398+0000","last_active":"2024-09-12T02:06:05.720907+0000","last_peered":"2024-09-12T02:06:05.720907+0000","last_clean":"2024-09-12T02:06:05.720907+0000","last_became_active":"2024-09-12T00:10:01.242013+0000","last_became_peered":"2024-09-12T00:10:01.242013+0000","last_unstale":"2024-09-12T02:06:05.720907+0000","last_undegraded":"2024-09-12T02:06:05.720907+0000","last_fullsized":"2024-09-12T02:06:05.720907+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:24.130259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3158,"num_read_kb":2927,"num_write":761,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"266'284","reported_seq":959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.972388+0000","last_change":"2024-09-12T00:09:59.311530+0000","last_active":"2024-09-12T02:04:13.972388+0000","last_peered":"2024-09-12T02:04:13.972388+0000","last_clean":"2024-09-12T02:04:13.972388+0000","last_became_active":"2024-09-12T00:09:59.311148+0000","last_became_peered":"2024-09-12T00:09:59.311148+0000","last_unstale":"2024-09-12T02:04:13.972388+0000","last_undegraded":"2024-09-12T02:04:13.972388+0000","last_fullsized":"2024-09-12T02:04:13.972388+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:05.724347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6884012,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":417,"num_read_kb":27101,"num_write":1056,"num_write_kb":32356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.747561+0000","last_change":"2024-09-12T00:10:03.253703+0000","last_active":"2024-09-12T02:03:38.747561+0000","last_peered":"2024-09-12T02:03:38.747561+0000","last_clean":"2024-09-12T02:03:38.747561+0000","last_became_active":"2024-09-12T00:10:03.252562+0000","last_became_peered":"2024-09-12T00:10:03.252562+0000","last_unstale":"2024-09-12T02:03:38.747561+0000","last_undegraded":"2024-09-12T02:03:38.747561+0000","last_fullsized":"2024-09-12T02:03:38.747561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:41.543603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"266'270","reported_seq":861,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.986469+0000","last_change":"2024-09-12T00:10:05.293010+0000","last_active":"2024-09-12T02:05:08.986469+0000","last_peered":"2024-09-12T02:05:08.986469+0000","last_clean":"2024-09-12T02:05:08.986469+0000","last_became_active":"2024-09-12T00:10:05.291758+0000","last_became_peered":"2024-09-12T00:10:05.291758+0000","last_unstale":"2024-09-12T02:05:08.986469+0000","last_undegraded":"2024-09-12T02:05:08.986469+0000","last_fullsized":"2024-09-12T02:05:08.986469+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:40.013931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":458,"num_read_kb":969,"num_write":382,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.734558+0000","last_change":"2024-09-12T00:10:07.321987+0000","last_active":"2024-09-12T02:02:38.734558+0000","last_peered":"2024-09-12T02:02:38.734558+0000","last_clean":"2024-09-12T02:02:38.734558+0000","last_became_active":"2024-09-12T00:10:07.320509+0000","last_became_peered":"2024-09-12T00:10:07.320509+0000","last_unstale":"2024-09-12T02:02:38.734558+0000","last_undegraded":"2024-09-12T02:02:38.734558+0000","last_fullsized":"2024-09-12T02:02:38.734558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:24.557032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"266'169","reported_seq":1660,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:52.460371+0000","last_change":"2024-09-12T00:10:09.364380+0000","last_active":"2024-09-12T02:04:52.460371+0000","last_peered":"2024-09-12T02:04:52.460371+0000","last_clean":"2024-09-12T02:04:52.460371+0000","last_became_active":"2024-09-12T00:10:09.363609+0000","last_became_peered":"2024-09-12T00:10:09.363609+0000","last_unstale":"2024-09-12T02:04:52.460371+0000","last_undegraded":"2024-09-12T02:04:52.460371+0000","last_fullsized":"2024-09-12T02:04:52.460371+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:27.382248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1201,"num_read_kb":1188,"num_write":377,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"266'767","reported_seq":2292,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.935938+0000","last_change":"2024-09-12T00:10:01.255788+0000","last_active":"2024-09-12T02:04:59.935938+0000","last_peered":"2024-09-12T02:04:59.935938+0000","last_clean":"2024-09-12T02:04:59.935938+0000","last_became_active":"2024-09-12T00:10:01.255086+0000","last_became_peered":"2024-09-12T00:10:01.255086+0000","last_unstale":"2024-09-12T02:04:59.935938+0000","last_undegraded":"2024-09-12T02:04:59.935938+0000","last_fullsized":"2024-09-12T02:04:59.935938+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:14.844500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3623,"num_read_kb":3271,"num_write":1000,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"266'318","reported_seq":1019,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.479187+0000","last_change":"2024-09-12T00:09:59.294231+0000","last_active":"2024-09-12T02:06:47.479187+0000","last_peered":"2024-09-12T02:06:47.479187+0000","last_clean":"2024-09-12T02:06:47.479187+0000","last_became_active":"2024-09-12T00:09:59.293822+0000","last_became_peered":"2024-09-12T00:09:59.293822+0000","last_unstale":"2024-09-12T02:06:47.479187+0000","last_undegraded":"2024-09-12T02:06:47.479187+0000","last_fullsized":"2024-09-12T02:06:47.479187+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:58.704023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":523,"num_read_kb":10999,"num_write":984,"num_write_kb":11811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.701152+0000","last_change":"2024-09-12T00:10:03.273307+0000","last_active":"2024-09-12T02:04:08.701152+0000","last_peered":"2024-09-12T02:04:08.701152+0000","last_clean":"2024-09-12T02:04:08.701152+0000","last_became_active":"2024-09-12T00:10:03.272579+0000","last_became_peered":"2024-09-12T00:10:03.272579+0000","last_unstale":"2024-09-12T02:04:08.701152+0000","last_undegraded":"2024-09-12T02:04:08.701152+0000","last_fullsized":"2024-09-12T02:04:08.701152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:05.059545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"266'371","reported_seq":1013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.925039+0000","last_change":"2024-09-12T00:10:05.289062+0000","last_active":"2024-09-12T02:06:44.925039+0000","last_peered":"2024-09-12T02:06:44.925039+0000","last_clean":"2024-09-12T02:06:44.925039+0000","last_became_active":"2024-09-12T00:10:05.288230+0000","last_became_peered":"2024-09-12T00:10:05.288230+0000","last_unstale":"2024-09-12T02:06:44.925039+0000","last_undegraded":"2024-09-12T02:06:44.925039+0000","last_fullsized":"2024-09-12T02:06:44.925039+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:10.127963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51419,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":1309,"num_write":486,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718281+0000","last_change":"2024-09-12T00:10:07.327719+0000","last_active":"2024-09-12T02:02:38.718281+0000","last_peered":"2024-09-12T02:02:38.718281+0000","last_clean":"2024-09-12T02:02:38.718281+0000","last_became_active":"2024-09-12T00:10:07.325726+0000","last_became_peered":"2024-09-12T00:10:07.325726+0000","last_unstale":"2024-09-12T02:02:38.718281+0000","last_undegraded":"2024-09-12T02:02:38.718281+0000","last_fullsized":"2024-09-12T02:02:38.718281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:25.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"266'151","reported_seq":678,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.634814+0000","last_change":"2024-09-12T00:10:09.353828+0000","last_active":"2024-09-12T02:06:05.634814+0000","last_peered":"2024-09-12T02:06:05.634814+0000","last_clean":"2024-09-12T02:06:05.634814+0000","last_became_active":"2024-09-12T00:10:09.353036+0000","last_became_peered":"2024-09-12T00:10:09.353036+0000","last_unstale":"2024-09-12T02:06:05.634814+0000","last_undegraded":"2024-09-12T02:06:05.634814+0000","last_fullsized":"2024-09-12T02:06:05.634814+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:42.519114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":163,"num_write":387,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"266'724","reported_seq":2128,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.863697+0000","last_change":"2024-09-12T00:10:01.264074+0000","last_active":"2024-09-12T02:04:59.863697+0000","last_peered":"2024-09-12T02:04:59.863697+0000","last_clean":"2024-09-12T02:04:59.863697+0000","last_became_active":"2024-09-12T00:10:01.263786+0000","last_became_peered":"2024-09-12T00:10:01.263786+0000","last_unstale":"2024-09-12T02:04:59.863697+0000","last_undegraded":"2024-09-12T02:04:59.863697+0000","last_fullsized":"2024-09-12T02:04:59.863697+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:21.005100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3380,"num_read_kb":3030,"num_write":963,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"266'351","reported_seq":1016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.503459+0000","last_change":"2024-09-12T00:09:59.288404+0000","last_active":"2024-09-12T02:06:47.503459+0000","last_peered":"2024-09-12T02:06:47.503459+0000","last_clean":"2024-09-12T02:06:47.503459+0000","last_became_active":"2024-09-12T00:09:59.287488+0000","last_became_peered":"2024-09-12T00:09:59.287488+0000","last_unstale":"2024-09-12T02:06:47.503459+0000","last_undegraded":"2024-09-12T02:06:47.503459+0000","last_fullsized":"2024-09-12T02:06:47.503459+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:21.087354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174806,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":42853,"num_write":973,"num_write_kb":24863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"266'457","reported_seq":1949,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.867698+0000","last_change":"2024-09-12T00:10:01.258659+0000","last_active":"2024-09-12T02:04:59.867698+0000","last_peered":"2024-09-12T02:04:59.867698+0000","last_clean":"2024-09-12T02:04:59.867698+0000","last_became_active":"2024-09-12T00:10:01.258361+0000","last_became_peered":"2024-09-12T00:10:01.258361+0000","last_unstale":"2024-09-12T02:04:59.867698+0000","last_undegraded":"2024-09-12T02:04:59.867698+0000","last_fullsized":"2024-09-12T02:04:59.867698+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:18.423469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2374,"num_read_kb":2204,"num_write":589,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"266'345","reported_seq":1056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.416786+0000","last_change":"2024-09-12T00:10:31.470461+0000","last_active":"2024-09-12T02:06:47.416786+0000","last_peered":"2024-09-12T02:06:47.416786+0000","last_clean":"2024-09-12T02:06:47.416786+0000","last_became_active":"2024-09-12T00:10:31.469140+0000","last_became_peered":"2024-09-12T00:10:31.469140+0000","last_unstale":"2024-09-12T02:06:47.416786+0000","last_undegraded":"2024-09-12T02:06:47.416786+0000","last_fullsized":"2024-09-12T02:06:47.416786+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:15.566429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314842,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":558,"num_read_kb":38599,"num_write":1106,"num_write_kb":37292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"266'822","reported_seq":2507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726468+0000","last_change":"2024-09-12T00:10:01.279500+0000","last_active":"2024-09-12T02:02:44.726468+0000","last_peered":"2024-09-12T02:02:44.726468+0000","last_clean":"2024-09-12T02:02:44.726468+0000","last_became_active":"2024-09-12T00:10:01.275843+0000","last_became_peered":"2024-09-12T00:10:01.275843+0000","last_unstale":"2024-09-12T02:02:44.726468+0000","last_undegraded":"2024-09-12T02:02:44.726468+0000","last_fullsized":"2024-09-12T02:02:44.726468+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:29.293928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4035,"num_read_kb":3644,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"266'299","reported_seq":977,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.745692+0000","last_change":"2024-09-12T00:09:59.309888+0000","last_active":"2024-09-12T02:06:44.745692+0000","last_peered":"2024-09-12T02:06:44.745692+0000","last_clean":"2024-09-12T02:06:44.745692+0000","last_became_active":"2024-09-12T00:09:59.309327+0000","last_became_peered":"2024-09-12T00:09:59.309327+0000","last_unstale":"2024-09-12T02:06:44.745692+0000","last_undegraded":"2024-09-12T02:06:44.745692+0000","last_fullsized":"2024-09-12T02:06:44.745692+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:38.157743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6635867,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":484,"num_read_kb":15467,"num_write":1062,"num_write_kb":37224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"266'496","reported_seq":2144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681200+0000","last_change":"2024-09-12T00:10:01.261722+0000","last_active":"2024-09-12T02:02:43.681200+0000","last_peered":"2024-09-12T02:02:43.681200+0000","last_clean":"2024-09-12T02:02:43.681200+0000","last_became_active":"2024-09-12T00:10:01.261418+0000","last_became_peered":"2024-09-12T00:10:01.261418+0000","last_unstale":"2024-09-12T02:02:43.681200+0000","last_undegraded":"2024-09-12T02:02:43.681200+0000","last_fullsized":"2024-09-12T02:02:43.681200+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:12.125604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2751,"num_read_kb":2561,"num_write":595,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"266'353","reported_seq":1113,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.524646+0000","last_change":"2024-09-12T00:09:59.287032+0000","last_active":"2024-09-12T02:06:47.524646+0000","last_peered":"2024-09-12T02:06:47.524646+0000","last_clean":"2024-09-12T02:06:47.524646+0000","last_became_active":"2024-09-12T00:09:59.286590+0000","last_became_peered":"2024-09-12T00:09:59.286590+0000","last_unstale":"2024-09-12T02:06:47.524646+0000","last_undegraded":"2024-09-12T02:06:47.524646+0000","last_fullsized":"2024-09-12T02:06:47.524646+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:35.622983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904210,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":714,"num_read_kb":40012,"num_write":1077,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"266'1463","reported_seq":3083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.676957+0000","last_change":"2024-09-12T00:10:01.262679+0000","last_active":"2024-09-12T02:06:05.676957+0000","last_peered":"2024-09-12T02:06:05.676957+0000","last_clean":"2024-09-12T02:06:05.676957+0000","last_became_active":"2024-09-12T00:10:01.261999+0000","last_became_peered":"2024-09-12T00:10:01.261999+0000","last_unstale":"2024-09-12T02:06:05.676957+0000","last_undegraded":"2024-09-12T02:06:05.676957+0000","last_fullsized":"2024-09-12T02:06:05.676957+0000","mapping_epoch":27,"log_start":"266'1400","ondisk_log_start":"266'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":1400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:32.253175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6652,"num_read_kb":5741,"num_write":2141,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"266'319","reported_seq":1062,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:57.966990+0000","last_change":"2024-09-12T00:09:59.286623+0000","last_active":"2024-09-12T02:05:57.966990+0000","last_peered":"2024-09-12T02:05:57.966990+0000","last_clean":"2024-09-12T02:05:57.966990+0000","last_became_active":"2024-09-12T00:09:59.286301+0000","last_became_peered":"2024-09-12T00:09:59.286301+0000","last_unstale":"2024-09-12T02:05:57.966990+0000","last_undegraded":"2024-09-12T02:05:57.966990+0000","last_fullsized":"2024-09-12T02:05:57.966990+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:46.585588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6602067,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":716,"num_read_kb":8719,"num_write":1137,"num_write_kb":26143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"266'391","reported_seq":1861,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936338+0000","last_change":"2024-09-12T00:10:01.268784+0000","last_active":"2024-09-12T02:04:59.936338+0000","last_peered":"2024-09-12T02:04:59.936338+0000","last_clean":"2024-09-12T02:04:59.936338+0000","last_became_active":"2024-09-12T00:10:01.266927+0000","last_became_peered":"2024-09-12T00:10:01.266927+0000","last_unstale":"2024-09-12T02:04:59.936338+0000","last_undegraded":"2024-09-12T02:04:59.936338+0000","last_fullsized":"2024-09-12T02:04:59.936338+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:03.258226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2147,"num_read_kb":2014,"num_write":451,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"266'355","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.550046+0000","last_change":"2024-09-12T00:09:59.252139+0000","last_active":"2024-09-12T02:06:47.550046+0000","last_peered":"2024-09-12T02:06:47.550046+0000","last_clean":"2024-09-12T02:06:47.550046+0000","last_became_active":"2024-09-12T00:09:59.251413+0000","last_became_peered":"2024-09-12T00:09:59.251413+0000","last_unstale":"2024-09-12T02:06:47.550046+0000","last_undegraded":"2024-09-12T02:06:47.550046+0000","last_fullsized":"2024-09-12T02:06:47.550046+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:50.326651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":573,"num_read_kb":23722,"num_write":1195,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"266'445","reported_seq":2119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.978719+0000","last_change":"2024-09-12T00:10:01.261639+0000","last_active":"2024-09-12T02:04:38.978719+0000","last_peered":"2024-09-12T02:04:38.978719+0000","last_clean":"2024-09-12T02:04:38.978719+0000","last_became_active":"2024-09-12T00:10:01.259942+0000","last_became_peered":"2024-09-12T00:10:01.259942+0000","last_unstale":"2024-09-12T02:04:38.978719+0000","last_undegraded":"2024-09-12T02:04:38.978719+0000","last_fullsized":"2024-09-12T02:04:38.978719+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:46.512977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2415,"num_read_kb":2305,"num_write":502,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"266'339","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.495004+0000","last_change":"2024-09-12T00:09:59.299099+0000","last_active":"2024-09-12T02:06:47.495004+0000","last_peered":"2024-09-12T02:06:47.495004+0000","last_clean":"2024-09-12T02:06:47.495004+0000","last_became_active":"2024-09-12T00:09:59.298085+0000","last_became_peered":"2024-09-12T00:09:59.298085+0000","last_unstale":"2024-09-12T02:06:47.495004+0000","last_undegraded":"2024-09-12T02:06:47.495004+0000","last_fullsized":"2024-09-12T02:06:47.495004+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:01.824707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136867,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":58646,"num_write":1165,"num_write_kb":29645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"266'499","reported_seq":2206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729090+0000","last_change":"2024-09-12T00:10:01.256111+0000","last_active":"2024-09-12T02:04:38.729090+0000","last_peered":"2024-09-12T02:04:38.729090+0000","last_clean":"2024-09-12T02:04:38.729090+0000","last_became_active":"2024-09-12T00:10:01.255302+0000","last_became_peered":"2024-09-12T00:10:01.255302+0000","last_unstale":"2024-09-12T02:04:38.729090+0000","last_undegraded":"2024-09-12T02:04:38.729090+0000","last_fullsized":"2024-09-12T02:04:38.729090+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:49.290623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2619,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"266'286","reported_seq":1013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:56.725624+0000","last_change":"2024-09-12T00:09:59.286963+0000","last_active":"2024-09-12T02:05:56.725624+0000","last_peered":"2024-09-12T02:05:56.725624+0000","last_clean":"2024-09-12T02:05:56.725624+0000","last_became_active":"2024-09-12T00:09:59.286393+0000","last_became_peered":"2024-09-12T00:09:59.286393+0000","last_unstale":"2024-09-12T02:05:56.725624+0000","last_undegraded":"2024-09-12T02:05:56.725624+0000","last_fullsized":"2024-09-12T02:05:56.725624+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:52.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2536306,"num_objects":58,"num_object_clones":0,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":560,"num_read_kb":4602,"num_write":1105,"num_write_kb":13882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"266'595","reported_seq":2551,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719733+0000","last_change":"2024-09-12T00:10:01.248053+0000","last_active":"2024-09-12T02:04:59.719733+0000","last_peered":"2024-09-12T02:04:59.719733+0000","last_clean":"2024-09-12T02:04:59.719733+0000","last_became_active":"2024-09-12T00:10:01.247691+0000","last_became_peered":"2024-09-12T00:10:01.247691+0000","last_unstale":"2024-09-12T02:04:59.719733+0000","last_undegraded":"2024-09-12T02:04:59.719733+0000","last_fullsized":"2024-09-12T02:04:59.719733+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:02.948022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3679,"num_read_kb":3455,"num_write":725,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"266'294","reported_seq":954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.692346+0000","last_change":"2024-09-12T00:09:59.301446+0000","last_active":"2024-09-12T02:06:44.692346+0000","last_peered":"2024-09-12T02:06:44.692346+0000","last_clean":"2024-09-12T02:06:44.692346+0000","last_became_active":"2024-09-12T00:09:59.300760+0000","last_became_peered":"2024-09-12T00:09:59.300760+0000","last_unstale":"2024-09-12T02:06:44.692346+0000","last_undegraded":"2024-09-12T02:06:44.692346+0000","last_fullsized":"2024-09-12T02:06:44.692346+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:42.952819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18340267,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":411,"num_read_kb":26981,"num_write":1106,"num_write_kb":52645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"266'957","reported_seq":2608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.758101+0000","last_change":"2024-09-12T00:10:01.239366+0000","last_active":"2024-09-12T02:04:23.758101+0000","last_peered":"2024-09-12T02:04:23.758101+0000","last_clean":"2024-09-12T02:04:23.758101+0000","last_became_active":"2024-09-12T00:10:01.238674+0000","last_became_peered":"2024-09-12T00:10:01.238674+0000","last_unstale":"2024-09-12T02:04:23.758101+0000","last_undegraded":"2024-09-12T02:04:23.758101+0000","last_fullsized":"2024-09-12T02:04:23.758101+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":900,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:27.928106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4713,"num_read_kb":4229,"num_write":1343,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"266'235","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.980115+0000","last_change":"2024-09-12T00:09:59.289360+0000","last_active":"2024-09-12T02:04:43.980115+0000","last_peered":"2024-09-12T02:04:43.980115+0000","last_clean":"2024-09-12T02:04:43.980115+0000","last_became_active":"2024-09-12T00:09:59.288260+0000","last_became_peered":"2024-09-12T00:09:59.288260+0000","last_unstale":"2024-09-12T02:04:43.980115+0000","last_undegraded":"2024-09-12T02:04:43.980115+0000","last_fullsized":"2024-09-12T02:04:43.980115+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:05.984205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6365656,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":381,"num_read_kb":7701,"num_write":834,"num_write_kb":23188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"266'342","reported_seq":1890,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.726617+0000","last_change":"2024-09-12T00:10:01.265917+0000","last_active":"2024-09-12T02:06:05.726617+0000","last_peered":"2024-09-12T02:06:05.726617+0000","last_clean":"2024-09-12T02:06:05.726617+0000","last_became_active":"2024-09-12T00:10:01.265676+0000","last_became_peered":"2024-09-12T00:10:01.265676+0000","last_unstale":"2024-09-12T02:06:05.726617+0000","last_undegraded":"2024-09-12T02:06:05.726617+0000","last_fullsized":"2024-09-12T02:06:05.726617+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:37.696003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1939,"num_read_kb":1902,"num_write":362,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"266'264","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.706867+0000","last_change":"2024-09-12T00:09:59.311681+0000","last_active":"2024-09-12T02:06:44.706867+0000","last_peered":"2024-09-12T02:06:44.706867+0000","last_clean":"2024-09-12T02:06:44.706867+0000","last_became_active":"2024-09-12T00:09:59.311132+0000","last_became_peered":"2024-09-12T00:09:59.311132+0000","last_unstale":"2024-09-12T02:06:44.706867+0000","last_undegraded":"2024-09-12T02:06:44.706867+0000","last_fullsized":"2024-09-12T02:06:44.706867+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:34.389668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14238252,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":445,"num_read_kb":37892,"num_write":972,"num_write_kb":21146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"266'929","reported_seq":2547,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.499343+0000","last_change":"2024-09-12T00:10:01.256409+0000","last_active":"2024-09-12T02:04:57.499343+0000","last_peered":"2024-09-12T02:04:57.499343+0000","last_clean":"2024-09-12T02:04:57.499343+0000","last_became_active":"2024-09-12T00:10:01.255682+0000","last_became_peered":"2024-09-12T00:10:01.255682+0000","last_unstale":"2024-09-12T02:04:57.499343+0000","last_undegraded":"2024-09-12T02:04:57.499343+0000","last_fullsized":"2024-09-12T02:04:57.499343+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:22.673852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4312,"num_read_kb":3831,"num_write":1239,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"266'335","reported_seq":1018,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.481170+0000","last_change":"2024-09-12T00:09:59.301361+0000","last_active":"2024-09-12T02:06:47.481170+0000","last_peered":"2024-09-12T02:06:47.481170+0000","last_clean":"2024-09-12T02:06:47.481170+0000","last_became_active":"2024-09-12T00:09:59.300699+0000","last_became_peered":"2024-09-12T00:09:59.300699+0000","last_unstale":"2024-09-12T02:06:47.481170+0000","last_undegraded":"2024-09-12T02:06:47.481170+0000","last_fullsized":"2024-09-12T02:06:47.481170+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:17.083956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315873,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":7533,"num_write":1090,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"266'857","reported_seq":2535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.886077+0000","last_change":"2024-09-12T00:10:01.265550+0000","last_active":"2024-09-12T02:04:59.886077+0000","last_peered":"2024-09-12T02:04:59.886077+0000","last_clean":"2024-09-12T02:04:59.886077+0000","last_became_active":"2024-09-12T00:10:01.264795+0000","last_became_peered":"2024-09-12T00:10:01.264795+0000","last_unstale":"2024-09-12T02:04:59.886077+0000","last_undegraded":"2024-09-12T02:04:59.886077+0000","last_fullsized":"2024-09-12T02:04:59.886077+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:05.882685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3745,"num_write":1135,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"266'384","reported_seq":1056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.495001+0000","last_change":"2024-09-12T00:09:59.304543+0000","last_active":"2024-09-12T02:06:47.495001+0000","last_peered":"2024-09-12T02:06:47.495001+0000","last_clean":"2024-09-12T02:06:47.495001+0000","last_became_active":"2024-09-12T00:09:59.299516+0000","last_became_peered":"2024-09-12T00:09:59.299516+0000","last_unstale":"2024-09-12T02:06:47.495001+0000","last_undegraded":"2024-09-12T02:06:47.495001+0000","last_fullsized":"2024-09-12T02:06:47.495001+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:57.946312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":14945,"num_write":1232,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"266'496","reported_seq":2130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.538818+0000","last_change":"2024-09-12T00:10:01.259052+0000","last_active":"2024-09-12T02:04:48.538818+0000","last_peered":"2024-09-12T02:04:48.538818+0000","last_clean":"2024-09-12T02:04:48.538818+0000","last_became_active":"2024-09-12T00:10:01.258691+0000","last_became_peered":"2024-09-12T00:10:01.258691+0000","last_unstale":"2024-09-12T02:04:48.538818+0000","last_undegraded":"2024-09-12T02:04:48.538818+0000","last_fullsized":"2024-09-12T02:04:48.538818+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:25.573412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2775,"num_read_kb":2593,"num_write":624,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"266'376","reported_seq":1037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.451469+0000","last_change":"2024-09-12T00:09:59.314098+0000","last_active":"2024-09-12T02:06:47.451469+0000","last_peered":"2024-09-12T02:06:47.451469+0000","last_clean":"2024-09-12T02:06:47.451469+0000","last_became_active":"2024-09-12T00:09:59.313345+0000","last_became_peered":"2024-09-12T00:09:59.313345+0000","last_unstale":"2024-09-12T02:06:47.451469+0000","last_undegraded":"2024-09-12T02:06:47.451469+0000","last_fullsized":"2024-09-12T02:06:47.451469+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.271942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4483063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":14481,"num_write":1098,"num_write_kb":25771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"266'323","reported_seq":1744,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.944772+0000","last_change":"2024-09-12T00:10:01.250260+0000","last_active":"2024-09-12T02:02:33.944772+0000","last_peered":"2024-09-12T02:02:33.944772+0000","last_clean":"2024-09-12T02:02:33.944772+0000","last_became_active":"2024-09-12T00:10:01.249832+0000","last_became_peered":"2024-09-12T00:10:01.249832+0000","last_unstale":"2024-09-12T02:02:33.944772+0000","last_undegraded":"2024-09-12T02:02:33.944772+0000","last_fullsized":"2024-09-12T02:02:33.944772+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:36.961457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1802,"num_read_kb":1736,"num_write":351,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"266'317","reported_seq":1015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.435541+0000","last_change":"2024-09-12T00:09:59.311678+0000","last_active":"2024-09-12T02:06:47.435541+0000","last_peered":"2024-09-12T02:06:47.435541+0000","last_clean":"2024-09-12T02:06:47.435541+0000","last_became_active":"2024-09-12T00:09:59.311158+0000","last_became_peered":"2024-09-12T00:09:59.311158+0000","last_unstale":"2024-09-12T02:06:47.435541+0000","last_undegraded":"2024-09-12T02:06:47.435541+0000","last_fullsized":"2024-09-12T02:06:47.435541+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:56.573170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316829,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":115277,"num_write":995,"num_write_kb":39549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"266'719","reported_seq":2261,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.735208+0000","last_change":"2024-09-12T00:10:01.268377+0000","last_active":"2024-09-12T02:03:08.735208+0000","last_peered":"2024-09-12T02:03:08.735208+0000","last_clean":"2024-09-12T02:03:08.735208+0000","last_became_active":"2024-09-12T00:10:01.267027+0000","last_became_peered":"2024-09-12T00:10:01.267027+0000","last_unstale":"2024-09-12T02:03:08.735208+0000","last_undegraded":"2024-09-12T02:03:08.735208+0000","last_fullsized":"2024-09-12T02:03:08.735208+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:46.063409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3526,"num_read_kb":3200,"num_write":1050,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"266'278","reported_seq":941,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.566392+0000","last_change":"2024-09-12T00:09:59.287224+0000","last_active":"2024-09-12T02:06:44.566392+0000","last_peered":"2024-09-12T02:06:44.566392+0000","last_clean":"2024-09-12T02:06:44.566392+0000","last_became_active":"2024-09-12T00:09:59.285907+0000","last_became_peered":"2024-09-12T00:09:59.285907+0000","last_unstale":"2024-09-12T02:06:44.566392+0000","last_undegraded":"2024-09-12T02:06:44.566392+0000","last_fullsized":"2024-09-12T02:06:44.566392+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:31.224850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10543114,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":391,"num_read_kb":44645,"num_write":898,"num_write_kb":42281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"266'269","reported_seq":944,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.655638+0000","last_change":"2024-09-12T00:09:59.284497+0000","last_active":"2024-09-12T02:06:44.655638+0000","last_peered":"2024-09-12T02:06:44.655638+0000","last_clean":"2024-09-12T02:06:44.655638+0000","last_became_active":"2024-09-12T00:09:59.282446+0000","last_became_peered":"2024-09-12T00:09:59.282446+0000","last_unstale":"2024-09-12T02:06:44.655638+0000","last_undegraded":"2024-09-12T02:06:44.655638+0000","last_fullsized":"2024-09-12T02:06:44.655638+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:03.250241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7852705,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":427,"num_read_kb":44688,"num_write":1004,"num_write_kb":33304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"266'455","reported_seq":2028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.721307+0000","last_change":"2024-09-12T00:10:01.248091+0000","last_active":"2024-09-12T02:06:05.721307+0000","last_peered":"2024-09-12T02:06:05.721307+0000","last_clean":"2024-09-12T02:06:05.721307+0000","last_became_active":"2024-09-12T00:10:01.247767+0000","last_became_peered":"2024-09-12T00:10:01.247767+0000","last_unstale":"2024-09-12T02:06:05.721307+0000","last_undegraded":"2024-09-12T02:06:05.721307+0000","last_fullsized":"2024-09-12T02:06:05.721307+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.370640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2488,"num_read_kb":2350,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"266'350","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.468042+0000","last_change":"2024-09-12T00:10:31.168863+0000","last_active":"2024-09-12T02:06:47.468042+0000","last_peered":"2024-09-12T02:06:47.468042+0000","last_clean":"2024-09-12T02:06:47.468042+0000","last_became_active":"2024-09-12T00:10:31.168444+0000","last_became_peered":"2024-09-12T00:10:31.168444+0000","last_unstale":"2024-09-12T02:06:47.468042+0000","last_undegraded":"2024-09-12T02:06:47.468042+0000","last_fullsized":"2024-09-12T02:06:47.468042+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:26.977451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400029,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":20125,"num_write":1291,"num_write_kb":40521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,0],"acting":[1,4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"266'1085","reported_seq":2767,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.671979+0000","last_change":"2024-09-12T00:10:01.279860+0000","last_active":"2024-09-12T02:06:05.671979+0000","last_peered":"2024-09-12T02:06:05.671979+0000","last_clean":"2024-09-12T02:06:05.671979+0000","last_became_active":"2024-09-12T00:10:01.278762+0000","last_became_peered":"2024-09-12T00:10:01.278762+0000","last_unstale":"2024-09-12T02:06:05.671979+0000","last_undegraded":"2024-09-12T02:06:05.671979+0000","last_fullsized":"2024-09-12T02:06:05.671979+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:38.059400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5202,"num_read_kb":4573,"num_write":1592,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6060,"num_read_kb":4225,"num_write":1955,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1026,"ondisk_log_size":1026,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":15149,"num_read_kb":14793,"num_write":16764,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":421,"ondisk_log_size":421,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1689480,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":21129,"num_read_kb":39431,"num_write":17667,"num_write_kb":12493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1417216,"data_stored":1054420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1953,"ondisk_log_size":1953,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2419,"num_read_kb":2884,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213079,"num_read_kb":194397,"num_write":55367,"num_write_kb":18884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":233391821,"num_objects":1760,"num_object_clones":0,"num_object_copies":7040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1760,"num_whiteouts":0,"num_read":34957,"num_read_kb":1955800,"num_write":70684,"num_write_kb":2110952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":291090432,"data_stored":291090432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3422,"ondisk_log_size":3422,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":27258880,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":156,"num_read_kb":180842,"num_write":178,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40898560,"data_stored":40898560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":8386837,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":156,"num_read_kb":169574,"num_write":182,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23117824,"data_stored":23115238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543555,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341692,"kb_used_data":17580,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94030148,"statfs":{"total":96636764160,"available":96286871552,"internally_reserved":0,"allocated":18001920,"data_stored":15991149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543555,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":18656,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":19103744,"data_stored":17151124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543560,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311840,"kb_used_data":146052,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94060000,"statfs":{"total":96636764160,"available":96317440000,"internally_reserved":0,"allocated":149557248,"data_stored":147478110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543556,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158712,"kb_used_data":15080,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94213128,"statfs":{"total":96636764160,"available":96474243072,"internally_reserved":0,"allocated":15441920,"data_stored":13515589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543557,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438936,"kb_used_data":142600,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":93932904,"statfs":{"total":96636764160,"available":96187293696,"internally_reserved":0,"allocated":146022400,"data_stored":143970504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":303430087},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543556,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117124,"kb_used_data":13652,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94254716,"statfs":{"total":96636764160,"available":96516829184,"internally_reserved":0,"allocated":13979648,"data_stored":12036246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543558,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195176,"kb_used_data":11212,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94176664,"statfs":{"total":96636764160,"available":96436903936,"internally_reserved":0,"allocated":11481088,"data_stored":9500646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543557,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304548,"kb_used_data":20596,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94067292,"statfs":{"total":96636764160,"available":96324907008,"internally_reserved":0,"allocated":21090304,"data_stored":19083000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16199680,"data_stored":16199680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7208960,"data_stored":7208960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9744384,"data_stored":9744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":100274176,"data_stored":100274176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11227136,"data_stored":11227136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118468608,"data_stored":118468608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14860288,"data_stored":14860288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13107200,"data_stored":13107200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":465781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":583903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16824668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6290570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24113152,"data_stored":24113152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16785408,"data_stored":16785408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:49.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:06:50.117 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:06:50.117 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":266,"fsid":"92c3bfc3-d6f4-44eb-ad73-a93f7ce7c434","created":"2024-09-12T00:09:25.299238+0000","modified":"2024-09-12T01:00:25.027309+0000","last_up_change":"2024-09-12T00:09:38.063826+0000","last_in_change":"2024-09-12T00:09:28.354915+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:09:38.091156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:09:44.342579+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:09:57.214197+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:09:59.582346+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:10:01.500765+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:10:03.581999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:10:05.306308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:10:07.463451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:26:21.888327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:32:13.060025+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:32:20.192829+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"261","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T01:00:22.753948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"266","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0b227208-8b0b-40b7-86af-a3fceb4c1dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6809","nonce":1237794167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6811","nonce":1237794167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6815","nonce":1237794167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1237794167},{"type":"v1","addr":"172.21.15.102:6813","nonce":1237794167}]},"public_addr":"172.21.15.102:6809/1237794167","cluster_addr":"172.21.15.102:6811/1237794167","heartbeat_back_addr":"172.21.15.102:6815/1237794167","heartbeat_front_addr":"172.21.15.102:6813/1237794167","state":["exists","up"]},{"osd":1,"uuid":"616a3dee-4034-4eaa-843f-b03ee416c716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6825","nonce":1865676346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6827","nonce":1865676346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6831","nonce":1865676346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1865676346},{"type":"v1","addr":"172.21.15.102:6829","nonce":1865676346}]},"public_addr":"172.21.15.102:6825/1865676346","cluster_addr":"172.21.15.102:6827/1865676346","heartbeat_back_addr":"172.21.15.102:6831/1865676346","heartbeat_front_addr":"172.21.15.102:6829/1865676346","state":["exists","up"]},{"osd":2,"uuid":"7278941b-405f-4f57-b2ca-568eb73d137b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6817","nonce":1118146796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6819","nonce":1118146796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6823","nonce":1118146796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":1118146796},{"type":"v1","addr":"172.21.15.102:6821","nonce":1118146796}]},"public_addr":"172.21.15.102:6817/1118146796","cluster_addr":"172.21.15.102:6819/1118146796","heartbeat_back_addr":"172.21.15.102:6823/1118146796","heartbeat_front_addr":"172.21.15.102:6821/1118146796","state":["exists","up"]},{"osd":3,"uuid":"6ee9c72e-0150-4c2e-bcce-c57a772fc13f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6801","nonce":1464080842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6803","nonce":1464080842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6807","nonce":1464080842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1464080842},{"type":"v1","addr":"172.21.15.102:6805","nonce":1464080842}]},"public_addr":"172.21.15.102:6801/1464080842","cluster_addr":"172.21.15.102:6803/1464080842","heartbeat_back_addr":"172.21.15.102:6807/1464080842","heartbeat_front_addr":"172.21.15.102:6805/1464080842","state":["exists","up"]},{"osd":4,"uuid":"f364f405-9739-4160-95d2-73606bcfb3e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6827","nonce":1318321638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6829","nonce":1318321638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6833","nonce":1318321638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1318321638},{"type":"v1","addr":"172.21.15.121:6831","nonce":1318321638}]},"public_addr":"172.21.15.121:6827/1318321638","cluster_addr":"172.21.15.121:6829/1318321638","heartbeat_back_addr":"172.21.15.121:6833/1318321638","heartbeat_front_addr":"172.21.15.121:6831/1318321638","state":["exists","up"]},{"osd":5,"uuid":"883c0010-02d5-487e-b74c-8f6558b41b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6811","nonce":1906913778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6813","nonce":1906913778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6817","nonce":1906913778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":1906913778},{"type":"v1","addr":"172.21.15.121:6815","nonce":1906913778}]},"public_addr":"172.21.15.121:6811/1906913778","cluster_addr":"172.21.15.121:6813/1906913778","heartbeat_back_addr":"172.21.15.121:6817/1906913778","heartbeat_front_addr":"172.21.15.121:6815/1906913778","state":["exists","up"]},{"osd":6,"uuid":"6014bfe5-bacf-49a8-a138-48472a94792f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6803","nonce":901978356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6805","nonce":901978356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6809","nonce":901978356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":901978356},{"type":"v1","addr":"172.21.15.121:6807","nonce":901978356}]},"public_addr":"172.21.15.121:6803/901978356","cluster_addr":"172.21.15.121:6805/901978356","heartbeat_back_addr":"172.21.15.121:6809/901978356","heartbeat_front_addr":"172.21.15.121:6807/901978356","state":["exists","up"]},{"osd":7,"uuid":"91c1b7d3-f3ab-41fe-98cc-c76ce4826a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6819","nonce":3404057850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6821","nonce":3404057850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6825","nonce":3404057850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3404057850},{"type":"v1","addr":"172.21.15.121:6823","nonce":3404057850}]},"public_addr":"172.21.15.121:6819/3404057850","cluster_addr":"172.21.15.121:6821/3404057850","heartbeat_back_addr":"172.21.15.121:6825/3404057850","heartbeat_front_addr":"172.21.15.121:6823/3404057850","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:34.951640+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.295761+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.128138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.031338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.295702+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.628290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.279886+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:09:35.148247+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.8","mappings":[{"from":7,"to":2}]},{"pgid":"3.b","mappings":[{"from":4,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":3}]},{"pgid":"3.31","mappings":[{"from":5,"to":3}]},{"pgid":"3.35","mappings":[{"from":6,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"67.3","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:06:51.138 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T02:06:51.138 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:06:51.300 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T02:06:51.301 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:06:51.301 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T02:06:51.317 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T02:06:51.609 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T02:06:51.627 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T02:06:51.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:06:51.766 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T02:06:51.766 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:06:51.766 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T02:06:51.781 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T02:06:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T02:06:52.101 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T02:06:52.101 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:06:52.244 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T02:06:52.245 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:06:52.245 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T02:06:52.260 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T02:06:52.568 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T02:06:52.587 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T02:06:52.587 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:06:52.737 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T02:06:52.738 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:06:52.738 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T02:06:52.753 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T02:06:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T02:06:53.061 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T02:06:53.061 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:06:53.199 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T02:06:53.199 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:06:53.199 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T02:06:53.214 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T02:06:53.495 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T02:06:53.513 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T02:06:53.514 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:06:53.666 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T02:06:53.666 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:06:53.666 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T02:06:53.682 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T02:06:53.961 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T02:06:53.980 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T02:06:53.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:06:54.129 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T02:06:54.129 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:06:54.129 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T02:06:54.146 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T02:06:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T02:06:54.455 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T02:06:54.456 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:06:54.610 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-12T02:06:54.610 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:06:54.610 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-12T02:06:54.626 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T02:06:54.925 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T02:06:54.943 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:06:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:06:55.309 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-12T02:06:55.311 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":3775,"stamp":"2024-09-12T02:06:54.896897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75791055,"num_objects":883,"num_object_clones":0,"num_object_copies":2528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":294733,"num_read_kb":2563326,"num_write":164412,"num_write_kb":2404914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13075,"ondisk_log_size":13075,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1901136,"kb_used_data":132832,"kb_used_omap":12,"kb_used_meta":1767923,"kb_avail":753073584,"statfs":{"total":773094113280,"available":771147350016,"internally_reserved":0,"allocated":136019968,"data_stored":120162322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1810353712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-648056003,"num_objects":-4158,"num_object_clones":0,"num_object_copies":-16520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4158,"num_whiteouts":0,"num_read":4642,"num_read_kb":4162,"num_write":4407,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.019826"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:54.728675+0000","last_change":"2024-09-12T01:00:24.087308+0000","last_active":"2024-09-12T02:02:54.728675+0000","last_peered":"2024-09-12T02:02:54.728675+0000","last_clean":"2024-09-12T02:02:54.728675+0000","last_became_active":"2024-09-12T01:00:24.086540+0000","last_became_peered":"2024-09-12T01:00:24.086540+0000","last_unstale":"2024-09-12T02:02:54.728675+0000","last_undegraded":"2024-09-12T02:02:54.728675+0000","last_fullsized":"2024-09-12T02:02:54.728675+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:55.672405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"266'3","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:54.756292+0000","last_change":"2024-09-12T00:32:21.646660+0000","last_active":"2024-09-12T02:04:54.756292+0000","last_peered":"2024-09-12T02:04:54.756292+0000","last_clean":"2024-09-12T02:04:54.756292+0000","last_became_active":"2024-09-12T00:32:21.645757+0000","last_became_peered":"2024-09-12T00:32:21.645757+0000","last_unstale":"2024-09-12T02:04:54.756292+0000","last_undegraded":"2024-09-12T02:04:54.756292+0000","last_fullsized":"2024-09-12T02:04:54.756292+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"266'6","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.023076+0000","last_change":"2024-09-12T00:32:14.592938+0000","last_active":"2024-09-12T02:06:47.023076+0000","last_peered":"2024-09-12T02:06:47.023076+0000","last_clean":"2024-09-12T02:06:47.023076+0000","last_became_active":"2024-09-12T00:32:14.592177+0000","last_became_peered":"2024-09-12T00:32:14.592177+0000","last_unstale":"2024-09-12T02:06:47.023076+0000","last_undegraded":"2024-09-12T02:06:47.023076+0000","last_fullsized":"2024-09-12T02:06:47.023076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:54.401327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8188,"num_write":6,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"266'29","reported_seq":164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.531382+0000","last_change":"2024-09-12T00:26:23.355721+0000","last_active":"2024-09-12T02:04:18.531382+0000","last_peered":"2024-09-12T02:04:18.531382+0000","last_clean":"2024-09-12T02:04:18.531382+0000","last_became_active":"2024-09-12T00:26:23.353338+0000","last_became_peered":"2024-09-12T00:26:23.353338+0000","last_unstale":"2024-09-12T02:04:18.531382+0000","last_undegraded":"2024-09-12T02:04:18.531382+0000","last_fullsized":"2024-09-12T02:04:18.531382+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.176865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.694256+0000","last_change":"2024-09-12T01:00:24.074808+0000","last_active":"2024-09-12T02:02:53.694256+0000","last_peered":"2024-09-12T02:02:53.694256+0000","last_clean":"2024-09-12T02:02:53.694256+0000","last_became_active":"2024-09-12T01:00:24.074048+0000","last_became_peered":"2024-09-12T01:00:24.074048+0000","last_unstale":"2024-09-12T02:02:53.694256+0000","last_undegraded":"2024-09-12T02:02:53.694256+0000","last_fullsized":"2024-09-12T02:02:53.694256+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:33.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"266'13","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.492562+0000","last_change":"2024-09-12T00:32:21.643734+0000","last_active":"2024-09-12T02:06:46.492562+0000","last_peered":"2024-09-12T02:06:46.492562+0000","last_clean":"2024-09-12T02:06:46.492562+0000","last_became_active":"2024-09-12T00:32:21.642967+0000","last_became_peered":"2024-09-12T00:32:21.642967+0000","last_unstale":"2024-09-12T02:06:46.492562+0000","last_undegraded":"2024-09-12T02:06:46.492562+0000","last_fullsized":"2024-09-12T02:06:46.492562+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:09.883461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24594,"num_write":18,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:13.674367+0000","last_change":"2024-09-12T00:32:14.603921+0000","last_active":"2024-09-12T02:02:13.674367+0000","last_peered":"2024-09-12T02:02:13.674367+0000","last_clean":"2024-09-12T02:02:13.674367+0000","last_became_active":"2024-09-12T00:32:14.602766+0000","last_became_peered":"2024-09-12T00:32:14.602766+0000","last_unstale":"2024-09-12T02:02:13.674367+0000","last_undegraded":"2024-09-12T02:02:13.674367+0000","last_fullsized":"2024-09-12T02:02:13.674367+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.170421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"266'26","reported_seq":151,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.719414+0000","last_change":"2024-09-12T00:26:23.322380+0000","last_active":"2024-09-12T02:04:48.719414+0000","last_peered":"2024-09-12T02:04:48.719414+0000","last_clean":"2024-09-12T02:04:48.719414+0000","last_became_active":"2024-09-12T00:26:23.321682+0000","last_became_peered":"2024-09-12T00:26:23.321682+0000","last_unstale":"2024-09-12T02:04:48.719414+0000","last_undegraded":"2024-09-12T02:04:48.719414+0000","last_fullsized":"2024-09-12T02:04:48.719414+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:28.612956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.710738+0000","last_change":"2024-09-12T01:00:24.076714+0000","last_active":"2024-09-12T02:03:13.710738+0000","last_peered":"2024-09-12T02:03:13.710738+0000","last_clean":"2024-09-12T02:03:13.710738+0000","last_became_active":"2024-09-12T01:00:24.075719+0000","last_became_peered":"2024-09-12T01:00:24.075719+0000","last_unstale":"2024-09-12T02:03:13.710738+0000","last_undegraded":"2024-09-12T02:03:13.710738+0000","last_fullsized":"2024-09-12T02:03:13.710738+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:33.848488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"266'2","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:08.555301+0000","last_change":"2024-09-12T00:32:21.664584+0000","last_active":"2024-09-12T02:06:08.555301+0000","last_peered":"2024-09-12T02:06:08.555301+0000","last_clean":"2024-09-12T02:06:08.555301+0000","last_became_active":"2024-09-12T00:32:21.663938+0000","last_became_peered":"2024-09-12T00:32:21.663938+0000","last_unstale":"2024-09-12T02:06:08.555301+0000","last_undegraded":"2024-09-12T02:06:08.555301+0000","last_fullsized":"2024-09-12T02:06:08.555301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:56.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"266'10","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.739819+0000","last_change":"2024-09-12T00:32:14.598635+0000","last_active":"2024-09-12T02:06:38.739819+0000","last_peered":"2024-09-12T02:06:38.739819+0000","last_clean":"2024-09-12T02:06:38.739819+0000","last_became_active":"2024-09-12T00:32:14.597094+0000","last_became_peered":"2024-09-12T00:32:14.597094+0000","last_unstale":"2024-09-12T02:06:38.739819+0000","last_undegraded":"2024-09-12T02:06:38.739819+0000","last_fullsized":"2024-09-12T02:06:38.739819+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:37.960853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24574,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"266'4","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525390+0000","last_change":"2024-09-12T00:26:23.350775+0000","last_active":"2024-09-12T02:03:53.525390+0000","last_peered":"2024-09-12T02:03:53.525390+0000","last_clean":"2024-09-12T02:03:53.525390+0000","last_became_active":"2024-09-12T00:26:23.349476+0000","last_became_peered":"2024-09-12T00:26:23.349476+0000","last_unstale":"2024-09-12T02:03:53.525390+0000","last_undegraded":"2024-09-12T02:03:53.525390+0000","last_fullsized":"2024-09-12T02:03:53.525390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:55.207200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959089+0000","last_change":"2024-09-12T01:00:24.070271+0000","last_active":"2024-09-12T02:03:23.959089+0000","last_peered":"2024-09-12T02:03:23.959089+0000","last_clean":"2024-09-12T02:03:23.959089+0000","last_became_active":"2024-09-12T01:00:24.069555+0000","last_became_peered":"2024-09-12T01:00:24.069555+0000","last_unstale":"2024-09-12T02:03:23.959089+0000","last_undegraded":"2024-09-12T02:03:23.959089+0000","last_fullsized":"2024-09-12T02:03:23.959089+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:30.440481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:39.005123+0000","last_change":"2024-09-12T00:32:21.658088+0000","last_active":"2024-09-12T02:06:39.005123+0000","last_peered":"2024-09-12T02:06:39.005123+0000","last_clean":"2024-09-12T02:06:39.005123+0000","last_became_active":"2024-09-12T00:32:21.654241+0000","last_became_peered":"2024-09-12T00:32:21.654241+0000","last_unstale":"2024-09-12T02:06:39.005123+0000","last_undegraded":"2024-09-12T02:06:39.005123+0000","last_fullsized":"2024-09-12T02:06:39.005123+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:08.083982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"266'13","reported_seq":98,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.298455+0000","last_change":"2024-09-12T00:32:14.586986+0000","last_active":"2024-09-12T02:06:46.298455+0000","last_peered":"2024-09-12T02:06:46.298455+0000","last_clean":"2024-09-12T02:06:46.298455+0000","last_became_active":"2024-09-12T00:32:14.586250+0000","last_became_peered":"2024-09-12T00:32:14.586250+0000","last_unstale":"2024-09-12T02:06:46.298455+0000","last_undegraded":"2024-09-12T02:06:46.298455+0000","last_fullsized":"2024-09-12T02:06:46.298455+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.871370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":31734,"num_write":18,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"266'26","reported_seq":142,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967298+0000","last_change":"2024-09-12T00:26:23.334469+0000","last_active":"2024-09-12T02:03:53.967298+0000","last_peered":"2024-09-12T02:03:53.967298+0000","last_clean":"2024-09-12T02:03:53.967298+0000","last_became_active":"2024-09-12T00:26:23.327186+0000","last_became_peered":"2024-09-12T00:26:23.327186+0000","last_unstale":"2024-09-12T02:03:53.967298+0000","last_undegraded":"2024-09-12T02:03:53.967298+0000","last_fullsized":"2024-09-12T02:03:53.967298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:43.603716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.977562+0000","last_change":"2024-09-12T01:00:24.078700+0000","last_active":"2024-09-12T02:04:33.977562+0000","last_peered":"2024-09-12T02:04:33.977562+0000","last_clean":"2024-09-12T02:04:33.977562+0000","last_became_active":"2024-09-12T01:00:24.077651+0000","last_became_peered":"2024-09-12T01:00:24.077651+0000","last_unstale":"2024-09-12T02:04:33.977562+0000","last_undegraded":"2024-09-12T02:04:33.977562+0000","last_fullsized":"2024-09-12T02:04:33.977562+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"266'5","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.657954+0000","last_change":"2024-09-12T00:32:21.651210+0000","last_active":"2024-09-12T02:06:45.657954+0000","last_peered":"2024-09-12T02:06:45.657954+0000","last_clean":"2024-09-12T02:06:45.657954+0000","last_became_active":"2024-09-12T00:32:21.649921+0000","last_became_peered":"2024-09-12T00:32:21.649921+0000","last_unstale":"2024-09-12T02:06:45.657954+0000","last_undegraded":"2024-09-12T02:06:45.657954+0000","last_fullsized":"2024-09-12T02:06:45.657954+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:54.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.528825+0000","last_change":"2024-09-12T00:32:14.608528+0000","last_active":"2024-09-12T02:04:08.528825+0000","last_peered":"2024-09-12T02:04:08.528825+0000","last_clean":"2024-09-12T02:04:08.528825+0000","last_became_active":"2024-09-12T00:32:14.607652+0000","last_became_peered":"2024-09-12T00:32:14.607652+0000","last_unstale":"2024-09-12T02:04:08.528825+0000","last_undegraded":"2024-09-12T02:04:08.528825+0000","last_fullsized":"2024-09-12T02:04:08.528825+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:12.098399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"266'15","reported_seq":114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967169+0000","last_change":"2024-09-12T00:26:23.343440+0000","last_active":"2024-09-12T02:03:53.967169+0000","last_peered":"2024-09-12T02:03:53.967169+0000","last_clean":"2024-09-12T02:03:53.967169+0000","last_became_active":"2024-09-12T00:26:23.339416+0000","last_became_peered":"2024-09-12T00:26:23.339416+0000","last_unstale":"2024-09-12T02:03:53.967169+0000","last_undegraded":"2024-09-12T02:03:53.967169+0000","last_fullsized":"2024-09-12T02:03:53.967169+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:20.570031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.683894+0000","last_change":"2024-09-12T01:00:24.065435+0000","last_active":"2024-09-12T02:02:53.683894+0000","last_peered":"2024-09-12T02:02:53.683894+0000","last_clean":"2024-09-12T02:02:53.683894+0000","last_became_active":"2024-09-12T01:00:24.064732+0000","last_became_peered":"2024-09-12T01:00:24.064732+0000","last_unstale":"2024-09-12T02:02:53.683894+0000","last_undegraded":"2024-09-12T02:02:53.683894+0000","last_fullsized":"2024-09-12T02:02:53.683894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:36.186270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"266'2","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.755847+0000","last_change":"2024-09-12T00:32:21.650109+0000","last_active":"2024-09-12T02:06:38.755847+0000","last_peered":"2024-09-12T02:06:38.755847+0000","last_clean":"2024-09-12T02:06:38.755847+0000","last_became_active":"2024-09-12T00:32:21.649260+0000","last_became_peered":"2024-09-12T00:32:21.649260+0000","last_unstale":"2024-09-12T02:06:38.755847+0000","last_undegraded":"2024-09-12T02:06:38.755847+0000","last_fullsized":"2024-09-12T02:06:38.755847+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:56.433116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'3","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.758988+0000","last_change":"2024-09-12T00:32:14.582866+0000","last_active":"2024-09-12T02:04:28.758988+0000","last_peered":"2024-09-12T02:04:28.758988+0000","last_clean":"2024-09-12T02:04:28.758988+0000","last_became_active":"2024-09-12T00:32:14.582112+0000","last_became_peered":"2024-09-12T00:32:14.582112+0000","last_unstale":"2024-09-12T02:04:28.758988+0000","last_undegraded":"2024-09-12T02:04:28.758988+0000","last_fullsized":"2024-09-12T02:04:28.758988+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"266'88","reported_seq":399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719464+0000","last_change":"2024-09-12T00:26:23.329328+0000","last_active":"2024-09-12T02:03:53.719464+0000","last_peered":"2024-09-12T02:03:53.719464+0000","last_clean":"2024-09-12T02:03:53.719464+0000","last_became_active":"2024-09-12T00:26:23.328597+0000","last_became_peered":"2024-09-12T00:26:23.328597+0000","last_unstale":"2024-09-12T02:03:53.719464+0000","last_undegraded":"2024-09-12T02:03:53.719464+0000","last_fullsized":"2024-09-12T02:03:53.719464+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:22.412755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":416,"num_write":108,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731863+0000","last_change":"2024-09-12T01:00:24.071788+0000","last_active":"2024-09-12T02:02:53.731863+0000","last_peered":"2024-09-12T02:02:53.731863+0000","last_clean":"2024-09-12T02:02:53.731863+0000","last_became_active":"2024-09-12T01:00:24.071095+0000","last_became_peered":"2024-09-12T01:00:24.071095+0000","last_unstale":"2024-09-12T02:02:53.731863+0000","last_undegraded":"2024-09-12T02:02:53.731863+0000","last_fullsized":"2024-09-12T02:02:53.731863+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:52.669721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"266'9","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.812457+0000","last_change":"2024-09-12T00:32:21.644665+0000","last_active":"2024-09-12T02:06:44.812457+0000","last_peered":"2024-09-12T02:06:44.812457+0000","last_clean":"2024-09-12T02:06:44.812457+0000","last_became_active":"2024-09-12T00:32:21.643876+0000","last_became_peered":"2024-09-12T00:32:21.643876+0000","last_unstale":"2024-09-12T02:06:44.812457+0000","last_undegraded":"2024-09-12T02:06:44.812457+0000","last_fullsized":"2024-09-12T02:06:44.812457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.090050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10236,"num_write":14,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.729779+0000","last_change":"2024-09-12T00:32:14.589458+0000","last_active":"2024-09-12T02:02:18.729779+0000","last_peered":"2024-09-12T02:02:18.729779+0000","last_clean":"2024-09-12T02:02:18.729779+0000","last_became_active":"2024-09-12T00:32:14.588375+0000","last_became_peered":"2024-09-12T00:32:14.588375+0000","last_unstale":"2024-09-12T02:02:18.729779+0000","last_undegraded":"2024-09-12T02:02:18.729779+0000","last_fullsized":"2024-09-12T02:02:18.729779+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:13.114682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7178,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"266'62","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.520452+0000","last_change":"2024-09-12T00:26:23.337872+0000","last_active":"2024-09-12T02:03:33.520452+0000","last_peered":"2024-09-12T02:03:33.520452+0000","last_clean":"2024-09-12T02:03:33.520452+0000","last_became_active":"2024-09-12T00:26:23.336278+0000","last_became_peered":"2024-09-12T00:26:23.336278+0000","last_unstale":"2024-09-12T02:03:33.520452+0000","last_undegraded":"2024-09-12T02:03:33.520452+0000","last_fullsized":"2024-09-12T02:03:33.520452+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:03.462066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":248,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731956+0000","last_change":"2024-09-12T01:00:24.078804+0000","last_active":"2024-09-12T02:02:53.731956+0000","last_peered":"2024-09-12T02:02:53.731956+0000","last_clean":"2024-09-12T02:02:53.731956+0000","last_became_active":"2024-09-12T01:00:24.078120+0000","last_became_peered":"2024-09-12T01:00:24.078120+0000","last_unstale":"2024-09-12T02:02:53.731956+0000","last_undegraded":"2024-09-12T02:02:53.731956+0000","last_fullsized":"2024-09-12T02:02:53.731956+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.036331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942038+0000","last_change":"2024-09-12T00:32:21.654093+0000","last_active":"2024-09-12T02:02:23.942038+0000","last_peered":"2024-09-12T02:02:23.942038+0000","last_clean":"2024-09-12T02:02:23.942038+0000","last_became_active":"2024-09-12T00:32:21.650564+0000","last_became_peered":"2024-09-12T00:32:21.650564+0000","last_unstale":"2024-09-12T02:02:23.942038+0000","last_undegraded":"2024-09-12T02:02:23.942038+0000","last_fullsized":"2024-09-12T02:02:23.942038+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:58.696714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.713920+0000","last_change":"2024-09-12T00:32:14.600836+0000","last_active":"2024-09-12T02:02:18.713920+0000","last_peered":"2024-09-12T02:02:18.713920+0000","last_clean":"2024-09-12T02:02:18.713920+0000","last_became_active":"2024-09-12T00:32:14.600188+0000","last_became_peered":"2024-09-12T00:32:14.600188+0000","last_unstale":"2024-09-12T02:02:18.713920+0000","last_undegraded":"2024-09-12T02:02:18.713920+0000","last_fullsized":"2024-09-12T02:02:18.713920+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:48.215097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"266'14","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.686029+0000","last_change":"2024-09-12T00:26:23.325628+0000","last_active":"2024-09-12T02:03:03.686029+0000","last_peered":"2024-09-12T02:03:03.686029+0000","last_clean":"2024-09-12T02:03:03.686029+0000","last_became_active":"2024-09-12T00:26:23.325067+0000","last_became_peered":"2024-09-12T00:26:23.325067+0000","last_unstale":"2024-09-12T02:03:03.686029+0000","last_undegraded":"2024-09-12T02:03:03.686029+0000","last_fullsized":"2024-09-12T02:03:03.686029+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.348834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690730+0000","last_change":"2024-09-12T01:00:24.075536+0000","last_active":"2024-09-12T02:03:23.690730+0000","last_peered":"2024-09-12T02:03:23.690730+0000","last_clean":"2024-09-12T02:03:23.690730+0000","last_became_active":"2024-09-12T01:00:24.075148+0000","last_became_peered":"2024-09-12T01:00:24.075148+0000","last_unstale":"2024-09-12T02:03:23.690730+0000","last_undegraded":"2024-09-12T02:03:23.690730+0000","last_fullsized":"2024-09-12T02:03:23.690730+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:59.023799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"266'2","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:39.005064+0000","last_change":"2024-09-12T00:32:21.658733+0000","last_active":"2024-09-12T02:06:39.005064+0000","last_peered":"2024-09-12T02:06:39.005064+0000","last_clean":"2024-09-12T02:06:39.005064+0000","last_became_active":"2024-09-12T00:32:21.654214+0000","last_became_peered":"2024-09-12T00:32:21.654214+0000","last_unstale":"2024-09-12T02:06:39.005064+0000","last_undegraded":"2024-09-12T02:06:39.005064+0000","last_fullsized":"2024-09-12T02:06:39.005064+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.587733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'5","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735335+0000","last_change":"2024-09-12T00:32:14.586921+0000","last_active":"2024-09-12T02:03:24.735335+0000","last_peered":"2024-09-12T02:03:24.735335+0000","last_clean":"2024-09-12T02:03:24.735335+0000","last_became_active":"2024-09-12T00:32:14.586101+0000","last_became_peered":"2024-09-12T00:32:14.586101+0000","last_unstale":"2024-09-12T02:03:24.735335+0000","last_undegraded":"2024-09-12T02:03:24.735335+0000","last_fullsized":"2024-09-12T02:03:24.735335+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:16.213342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"266'18","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.724550+0000","last_change":"2024-09-12T00:26:23.351546+0000","last_active":"2024-09-12T02:03:03.724550+0000","last_peered":"2024-09-12T02:03:03.724550+0000","last_clean":"2024-09-12T02:03:03.724550+0000","last_became_active":"2024-09-12T00:26:23.338890+0000","last_became_peered":"2024-09-12T00:26:23.338890+0000","last_unstale":"2024-09-12T02:03:03.724550+0000","last_undegraded":"2024-09-12T02:03:03.724550+0000","last_fullsized":"2024-09-12T02:03:03.724550+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:29.634760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.701374+0000","last_change":"2024-09-12T01:00:24.076901+0000","last_active":"2024-09-12T02:03:23.701374+0000","last_peered":"2024-09-12T02:03:23.701374+0000","last_clean":"2024-09-12T02:03:23.701374+0000","last_became_active":"2024-09-12T01:00:24.076081+0000","last_became_peered":"2024-09-12T01:00:24.076081+0000","last_unstale":"2024-09-12T02:03:23.701374+0000","last_undegraded":"2024-09-12T02:03:23.701374+0000","last_fullsized":"2024-09-12T02:03:23.701374+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:03.511093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'5","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.962875+0000","last_change":"2024-09-12T00:32:21.665472+0000","last_active":"2024-09-12T02:03:38.962875+0000","last_peered":"2024-09-12T02:03:38.962875+0000","last_clean":"2024-09-12T02:03:38.962875+0000","last_became_active":"2024-09-12T00:32:21.659460+0000","last_became_peered":"2024-09-12T00:32:21.659460+0000","last_unstale":"2024-09-12T02:03:38.962875+0000","last_undegraded":"2024-09-12T02:03:38.962875+0000","last_fullsized":"2024-09-12T02:03:38.962875+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:34.362543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:33.784493+0000","last_change":"2024-09-12T00:32:14.595556+0000","last_active":"2024-09-12T02:06:33.784493+0000","last_peered":"2024-09-12T02:06:33.784493+0000","last_clean":"2024-09-12T02:06:33.784493+0000","last_became_active":"2024-09-12T00:32:14.594973+0000","last_became_peered":"2024-09-12T00:32:14.594973+0000","last_unstale":"2024-09-12T02:06:33.784493+0000","last_undegraded":"2024-09-12T02:06:33.784493+0000","last_fullsized":"2024-09-12T02:06:33.784493+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":200,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.953162+0000","last_change":"2024-09-12T00:26:23.344345+0000","last_active":"2024-09-12T02:03:03.953162+0000","last_peered":"2024-09-12T02:03:03.953162+0000","last_clean":"2024-09-12T02:03:03.953162+0000","last_became_active":"2024-09-12T00:26:23.338462+0000","last_became_peered":"2024-09-12T00:26:23.338462+0000","last_unstale":"2024-09-12T02:03:03.953162+0000","last_undegraded":"2024-09-12T02:03:03.953162+0000","last_fullsized":"2024-09-12T02:03:03.953162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:51.275824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":170,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738756+0000","last_change":"2024-09-12T01:00:24.077452+0000","last_active":"2024-09-12T02:03:23.738756+0000","last_peered":"2024-09-12T02:03:23.738756+0000","last_clean":"2024-09-12T02:03:23.738756+0000","last_became_active":"2024-09-12T01:00:24.070957+0000","last_became_peered":"2024-09-12T01:00:24.070957+0000","last_unstale":"2024-09-12T02:03:23.738756+0000","last_undegraded":"2024-09-12T02:03:23.738756+0000","last_fullsized":"2024-09-12T02:03:23.738756+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:02.724541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:39.005148+0000","last_change":"2024-09-12T00:32:21.665635+0000","last_active":"2024-09-12T02:06:39.005148+0000","last_peered":"2024-09-12T02:06:39.005148+0000","last_clean":"2024-09-12T02:06:39.005148+0000","last_became_active":"2024-09-12T00:32:21.665036+0000","last_became_peered":"2024-09-12T00:32:21.665036+0000","last_unstale":"2024-09-12T02:06:39.005148+0000","last_undegraded":"2024-09-12T02:06:39.005148+0000","last_fullsized":"2024-09-12T02:06:39.005148+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.207114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:28.737035+0000","last_change":"2024-09-12T00:32:14.599371+0000","last_active":"2024-09-12T02:06:28.737035+0000","last_peered":"2024-09-12T02:06:28.737035+0000","last_clean":"2024-09-12T02:06:28.737035+0000","last_became_active":"2024-09-12T00:32:14.597944+0000","last_became_peered":"2024-09-12T00:32:14.597944+0000","last_unstale":"2024-09-12T02:06:28.737035+0000","last_undegraded":"2024-09-12T02:06:28.737035+0000","last_fullsized":"2024-09-12T02:06:28.737035+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:39.404510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"266'38","reported_seq":167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.696938+0000","last_change":"2024-09-12T00:26:23.318556+0000","last_active":"2024-09-12T02:03:03.696938+0000","last_peered":"2024-09-12T02:03:03.696938+0000","last_clean":"2024-09-12T02:03:03.696938+0000","last_became_active":"2024-09-12T00:26:23.317790+0000","last_became_peered":"2024-09-12T00:26:23.317790+0000","last_unstale":"2024-09-12T02:03:03.696938+0000","last_undegraded":"2024-09-12T02:03:03.696938+0000","last_fullsized":"2024-09-12T02:03:03.696938+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":107,"num_write":80,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735210+0000","last_change":"2024-09-12T01:00:24.078191+0000","last_active":"2024-09-12T02:03:24.735210+0000","last_peered":"2024-09-12T02:03:24.735210+0000","last_clean":"2024-09-12T02:03:24.735210+0000","last_became_active":"2024-09-12T01:00:24.077509+0000","last_became_peered":"2024-09-12T01:00:24.077509+0000","last_unstale":"2024-09-12T02:03:24.735210+0000","last_undegraded":"2024-09-12T02:03:24.735210+0000","last_fullsized":"2024-09-12T02:03:24.735210+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.532459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"266'2","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.788301+0000","last_change":"2024-09-12T00:32:21.652772+0000","last_active":"2024-09-12T02:06:38.788301+0000","last_peered":"2024-09-12T02:06:38.788301+0000","last_clean":"2024-09-12T02:06:38.788301+0000","last_became_active":"2024-09-12T00:32:21.644753+0000","last_became_peered":"2024-09-12T00:32:21.644753+0000","last_unstale":"2024-09-12T02:06:38.788301+0000","last_undegraded":"2024-09-12T02:06:38.788301+0000","last_fullsized":"2024-09-12T02:06:38.788301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:09.209891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:33.561239+0000","last_change":"2024-09-12T00:32:14.600221+0000","last_active":"2024-09-12T02:06:33.561239+0000","last_peered":"2024-09-12T02:06:33.561239+0000","last_clean":"2024-09-12T02:06:33.561239+0000","last_became_active":"2024-09-12T00:32:14.599452+0000","last_became_peered":"2024-09-12T00:32:14.599452+0000","last_unstale":"2024-09-12T02:06:33.561239+0000","last_undegraded":"2024-09-12T02:06:33.561239+0000","last_fullsized":"2024-09-12T02:06:33.561239+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:29.978923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"266'136","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.724784+0000","last_change":"2024-09-12T00:26:23.321368+0000","last_active":"2024-09-12T02:02:23.724784+0000","last_peered":"2024-09-12T02:02:23.724784+0000","last_clean":"2024-09-12T02:02:23.724784+0000","last_became_active":"2024-09-12T00:26:23.320613+0000","last_became_peered":"2024-09-12T00:26:23.320613+0000","last_unstale":"2024-09-12T02:02:23.724784+0000","last_undegraded":"2024-09-12T02:02:23.724784+0000","last_fullsized":"2024-09-12T02:02:23.724784+0000","mapping_epoch":253,"log_start":"263'100","ondisk_log_start":"263'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:54.209079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":872,"num_read_kb":592,"num_write":184,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956392+0000","last_change":"2024-09-12T01:00:24.061484+0000","last_active":"2024-09-12T02:03:13.956392+0000","last_peered":"2024-09-12T02:03:13.956392+0000","last_clean":"2024-09-12T02:03:13.956392+0000","last_became_active":"2024-09-12T01:00:24.060699+0000","last_became_peered":"2024-09-12T01:00:24.060699+0000","last_unstale":"2024-09-12T02:03:13.956392+0000","last_undegraded":"2024-09-12T02:03:13.956392+0000","last_fullsized":"2024-09-12T02:03:13.956392+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:39.025638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690685+0000","last_change":"2024-09-12T00:32:21.652868+0000","last_active":"2024-09-12T02:03:23.690685+0000","last_peered":"2024-09-12T02:03:23.690685+0000","last_clean":"2024-09-12T02:03:23.690685+0000","last_became_active":"2024-09-12T00:32:21.652122+0000","last_became_peered":"2024-09-12T00:32:21.652122+0000","last_unstale":"2024-09-12T02:03:23.690685+0000","last_undegraded":"2024-09-12T02:03:23.690685+0000","last_fullsized":"2024-09-12T02:03:23.690685+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:49.993050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"266'7","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:38.774817+0000","last_change":"2024-09-12T00:32:14.592680+0000","last_active":"2024-09-12T02:05:38.774817+0000","last_peered":"2024-09-12T02:05:38.774817+0000","last_clean":"2024-09-12T02:05:38.774817+0000","last_became_active":"2024-09-12T00:32:14.591921+0000","last_became_peered":"2024-09-12T00:32:14.591921+0000","last_unstale":"2024-09-12T02:05:38.774817+0000","last_undegraded":"2024-09-12T02:05:38.774817+0000","last_fullsized":"2024-09-12T02:05:38.774817+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:15.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3114,"num_write":12,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"266'28","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753409+0000","last_change":"2024-09-12T00:26:23.323596+0000","last_active":"2024-09-12T02:04:23.753409+0000","last_peered":"2024-09-12T02:04:23.753409+0000","last_clean":"2024-09-12T02:04:23.753409+0000","last_became_active":"2024-09-12T00:26:23.322866+0000","last_became_peered":"2024-09-12T00:26:23.322866+0000","last_unstale":"2024-09-12T02:04:23.753409+0000","last_undegraded":"2024-09-12T02:04:23.753409+0000","last_fullsized":"2024-09-12T02:04:23.753409+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:51.001961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727306+0000","last_change":"2024-09-12T01:00:24.064920+0000","last_active":"2024-09-12T02:03:13.727306+0000","last_peered":"2024-09-12T02:03:13.727306+0000","last_clean":"2024-09-12T02:03:13.727306+0000","last_became_active":"2024-09-12T01:00:24.064203+0000","last_became_peered":"2024-09-12T01:00:24.064203+0000","last_unstale":"2024-09-12T02:03:13.727306+0000","last_undegraded":"2024-09-12T02:03:13.727306+0000","last_fullsized":"2024-09-12T02:03:13.727306+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:14.355731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"266'7","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.657111+0000","last_change":"2024-09-12T00:32:21.660277+0000","last_active":"2024-09-12T02:06:45.657111+0000","last_peered":"2024-09-12T02:06:45.657111+0000","last_clean":"2024-09-12T02:06:45.657111+0000","last_became_active":"2024-09-12T00:32:21.659437+0000","last_became_peered":"2024-09-12T00:32:21.659437+0000","last_unstale":"2024-09-12T02:06:45.657111+0000","last_undegraded":"2024-09-12T02:06:45.657111+0000","last_fullsized":"2024-09-12T02:06:45.657111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:42.910621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":12,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"266'9","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:33.990232+0000","last_change":"2024-09-12T00:32:14.599370+0000","last_active":"2024-09-12T02:05:33.990232+0000","last_peered":"2024-09-12T02:05:33.990232+0000","last_clean":"2024-09-12T02:05:33.990232+0000","last_became_active":"2024-09-12T00:32:14.597986+0000","last_became_peered":"2024-09-12T00:32:14.597986+0000","last_unstale":"2024-09-12T02:05:33.990232+0000","last_undegraded":"2024-09-12T02:05:33.990232+0000","last_fullsized":"2024-09-12T02:05:33.990232+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:36.841276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"266'46","reported_seq":199,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.532349+0000","last_change":"2024-09-12T00:26:23.336761+0000","last_active":"2024-09-12T02:04:23.532349+0000","last_peered":"2024-09-12T02:04:23.532349+0000","last_clean":"2024-09-12T02:04:23.532349+0000","last_became_active":"2024-09-12T00:26:23.336010+0000","last_became_peered":"2024-09-12T00:26:23.336010+0000","last_unstale":"2024-09-12T02:04:23.532349+0000","last_undegraded":"2024-09-12T02:04:23.532349+0000","last_fullsized":"2024-09-12T02:04:23.532349+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:52.664889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.523057+0000","last_change":"2024-09-12T01:00:24.074232+0000","last_active":"2024-09-12T02:03:43.523057+0000","last_peered":"2024-09-12T02:03:43.523057+0000","last_clean":"2024-09-12T02:03:43.523057+0000","last_became_active":"2024-09-12T01:00:24.061624+0000","last_became_peered":"2024-09-12T01:00:24.061624+0000","last_unstale":"2024-09-12T02:03:43.523057+0000","last_undegraded":"2024-09-12T02:03:43.523057+0000","last_fullsized":"2024-09-12T02:03:43.523057+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:30.381075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'7","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959211+0000","last_change":"2024-09-12T00:32:21.667593+0000","last_active":"2024-09-12T02:03:23.959211+0000","last_peered":"2024-09-12T02:03:23.959211+0000","last_clean":"2024-09-12T02:03:23.959211+0000","last_became_active":"2024-09-12T00:32:21.666101+0000","last_became_peered":"2024-09-12T00:32:21.666101+0000","last_unstale":"2024-09-12T02:03:23.959211+0000","last_undegraded":"2024-09-12T02:03:23.959211+0000","last_fullsized":"2024-09-12T02:03:23.959211+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:18.302518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3603,"num_write":12,"num_write_kb":1553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"266'3","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:38.742679+0000","last_change":"2024-09-12T00:32:14.580110+0000","last_active":"2024-09-12T02:05:38.742679+0000","last_peered":"2024-09-12T02:05:38.742679+0000","last_clean":"2024-09-12T02:05:38.742679+0000","last_became_active":"2024-09-12T00:32:14.579366+0000","last_became_peered":"2024-09-12T00:32:14.579366+0000","last_unstale":"2024-09-12T02:05:38.742679+0000","last_undegraded":"2024-09-12T02:05:38.742679+0000","last_fullsized":"2024-09-12T02:05:38.742679+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.632825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'8","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.757917+0000","last_change":"2024-09-12T00:26:23.323680+0000","last_active":"2024-09-12T02:04:23.757917+0000","last_peered":"2024-09-12T02:04:23.757917+0000","last_clean":"2024-09-12T02:04:23.757917+0000","last_became_active":"2024-09-12T00:26:23.322841+0000","last_became_peered":"2024-09-12T00:26:23.322841+0000","last_unstale":"2024-09-12T02:04:23.757917+0000","last_undegraded":"2024-09-12T02:04:23.757917+0000","last_fullsized":"2024-09-12T02:04:23.757917+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956312+0000","last_change":"2024-09-12T01:00:24.060507+0000","last_active":"2024-09-12T02:03:13.956312+0000","last_peered":"2024-09-12T02:03:13.956312+0000","last_clean":"2024-09-12T02:03:13.956312+0000","last_became_active":"2024-09-12T01:00:24.057061+0000","last_became_peered":"2024-09-12T01:00:24.057061+0000","last_unstale":"2024-09-12T02:03:13.956312+0000","last_undegraded":"2024-09-12T02:03:13.956312+0000","last_fullsized":"2024-09-12T02:03:13.956312+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:07.370347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"266'6","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.497296+0000","last_change":"2024-09-12T00:32:21.647911+0000","last_active":"2024-09-12T02:06:46.497296+0000","last_peered":"2024-09-12T02:06:46.497296+0000","last_clean":"2024-09-12T02:06:46.497296+0000","last_became_active":"2024-09-12T00:32:21.646690+0000","last_became_peered":"2024-09-12T00:32:21.646690+0000","last_unstale":"2024-09-12T02:06:46.497296+0000","last_undegraded":"2024-09-12T02:06:46.497296+0000","last_fullsized":"2024-09-12T02:06:46.497296+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:03.430085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2096,"num_write":6,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:14.733091+0000","last_change":"2024-09-12T00:32:14.577083+0000","last_active":"2024-09-12T02:03:14.733091+0000","last_peered":"2024-09-12T02:03:14.733091+0000","last_clean":"2024-09-12T02:03:14.733091+0000","last_became_active":"2024-09-12T00:32:14.576353+0000","last_became_peered":"2024-09-12T00:32:14.576353+0000","last_unstale":"2024-09-12T02:03:14.733091+0000","last_undegraded":"2024-09-12T02:03:14.733091+0000","last_fullsized":"2024-09-12T02:03:14.733091+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:17.483406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"266'19","reported_seq":129,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974634+0000","last_change":"2024-09-12T00:26:23.342320+0000","last_active":"2024-09-12T02:04:23.974634+0000","last_peered":"2024-09-12T02:04:23.974634+0000","last_clean":"2024-09-12T02:04:23.974634+0000","last_became_active":"2024-09-12T00:26:23.334078+0000","last_became_peered":"2024-09-12T00:26:23.334078+0000","last_unstale":"2024-09-12T02:04:23.974634+0000","last_undegraded":"2024-09-12T02:04:23.974634+0000","last_fullsized":"2024-09-12T02:04:23.974634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.869261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":39,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:28.702468+0000","last_change":"2024-09-12T01:00:24.076331+0000","last_active":"2024-09-12T02:03:28.702468+0000","last_peered":"2024-09-12T02:03:28.702468+0000","last_clean":"2024-09-12T02:03:28.702468+0000","last_became_active":"2024-09-12T01:00:24.075944+0000","last_became_peered":"2024-09-12T01:00:24.075944+0000","last_unstale":"2024-09-12T02:03:28.702468+0000","last_undegraded":"2024-09-12T02:03:28.702468+0000","last_fullsized":"2024-09-12T02:03:28.702468+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.174854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"266'4","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.077517+0000","last_change":"2024-09-12T00:32:21.653900+0000","last_active":"2024-09-12T02:06:46.077517+0000","last_peered":"2024-09-12T02:06:46.077517+0000","last_clean":"2024-09-12T02:06:46.077517+0000","last_became_active":"2024-09-12T00:32:21.653054+0000","last_became_peered":"2024-09-12T00:32:21.653054+0000","last_unstale":"2024-09-12T02:06:46.077517+0000","last_undegraded":"2024-09-12T02:06:46.077517+0000","last_fullsized":"2024-09-12T02:06:46.077517+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8207,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"266'10","reported_seq":91,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.035102+0000","last_change":"2024-09-12T00:32:14.597055+0000","last_active":"2024-09-12T02:06:45.035102+0000","last_peered":"2024-09-12T02:06:45.035102+0000","last_clean":"2024-09-12T02:06:45.035102+0000","last_became_active":"2024-09-12T00:32:14.596393+0000","last_became_peered":"2024-09-12T00:32:14.596393+0000","last_unstale":"2024-09-12T02:06:45.035102+0000","last_undegraded":"2024-09-12T02:06:45.035102+0000","last_fullsized":"2024-09-12T02:06:45.035102+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:35.143044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9234,"num_write":10,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"266'13","reported_seq":109,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959403+0000","last_change":"2024-09-12T00:26:23.354584+0000","last_active":"2024-09-12T02:03:23.959403+0000","last_peered":"2024-09-12T02:03:23.959403+0000","last_clean":"2024-09-12T02:03:23.959403+0000","last_became_active":"2024-09-12T00:26:23.353590+0000","last_became_peered":"2024-09-12T00:26:23.353590+0000","last_unstale":"2024-09-12T02:03:23.959403+0000","last_undegraded":"2024-09-12T02:03:23.959403+0000","last_fullsized":"2024-09-12T02:03:23.959403+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:36.184285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":34,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738884+0000","last_change":"2024-09-12T01:00:24.070343+0000","last_active":"2024-09-12T02:03:23.738884+0000","last_peered":"2024-09-12T02:03:23.738884+0000","last_clean":"2024-09-12T02:03:23.738884+0000","last_became_active":"2024-09-12T01:00:24.069491+0000","last_became_peered":"2024-09-12T01:00:24.069491+0000","last_unstale":"2024-09-12T02:03:23.738884+0000","last_undegraded":"2024-09-12T02:03:23.738884+0000","last_fullsized":"2024-09-12T02:03:23.738884+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:08.859472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.978838+0000","last_change":"2024-09-12T00:32:21.668898+0000","last_active":"2024-09-12T02:04:38.978838+0000","last_peered":"2024-09-12T02:04:38.978838+0000","last_clean":"2024-09-12T02:04:38.978838+0000","last_became_active":"2024-09-12T00:32:21.668268+0000","last_became_peered":"2024-09-12T00:32:21.668268+0000","last_unstale":"2024-09-12T02:04:38.978838+0000","last_undegraded":"2024-09-12T02:04:38.978838+0000","last_fullsized":"2024-09-12T02:04:38.978838+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"266'7","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.567934+0000","last_change":"2024-09-12T00:32:14.610770+0000","last_active":"2024-09-12T02:06:45.567934+0000","last_peered":"2024-09-12T02:06:45.567934+0000","last_clean":"2024-09-12T02:06:45.567934+0000","last_became_active":"2024-09-12T00:32:14.610187+0000","last_became_peered":"2024-09-12T00:32:14.610187+0000","last_unstale":"2024-09-12T02:06:45.567934+0000","last_undegraded":"2024-09-12T02:06:45.567934+0000","last_fullsized":"2024-09-12T02:06:45.567934+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:04.103920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2577,"num_write":12,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:09.732099+0000","last_change":"2024-09-12T00:26:23.333218+0000","last_active":"2024-09-12T02:03:09.732099+0000","last_peered":"2024-09-12T02:03:09.732099+0000","last_clean":"2024-09-12T02:03:09.732099+0000","last_became_active":"2024-09-12T00:26:23.328238+0000","last_became_peered":"2024-09-12T00:26:23.328238+0000","last_unstale":"2024-09-12T02:03:09.732099+0000","last_undegraded":"2024-09-12T02:03:09.732099+0000","last_fullsized":"2024-09-12T02:03:09.732099+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:08.447428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.710796+0000","last_change":"2024-09-12T01:00:24.075014+0000","last_active":"2024-09-12T02:03:13.710796+0000","last_peered":"2024-09-12T02:03:13.710796+0000","last_clean":"2024-09-12T02:03:13.710796+0000","last_became_active":"2024-09-12T01:00:24.074237+0000","last_became_peered":"2024-09-12T01:00:24.074237+0000","last_unstale":"2024-09-12T02:03:13.710796+0000","last_undegraded":"2024-09-12T02:03:13.710796+0000","last_fullsized":"2024-09-12T02:03:13.710796+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:45.410941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.683956+0000","last_change":"2024-09-12T00:32:21.643228+0000","last_active":"2024-09-12T02:02:53.683956+0000","last_peered":"2024-09-12T02:02:53.683956+0000","last_clean":"2024-09-12T02:02:53.683956+0000","last_became_active":"2024-09-12T00:32:21.642517+0000","last_became_peered":"2024-09-12T00:32:21.642517+0000","last_unstale":"2024-09-12T02:02:53.683956+0000","last_undegraded":"2024-09-12T02:02:53.683956+0000","last_fullsized":"2024-09-12T02:02:53.683956+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:33.274779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.299857+0000","last_change":"2024-09-12T00:32:14.608254+0000","last_active":"2024-09-12T02:06:46.299857+0000","last_peered":"2024-09-12T02:06:46.299857+0000","last_clean":"2024-09-12T02:06:46.299857+0000","last_became_active":"2024-09-12T00:32:14.607520+0000","last_became_peered":"2024-09-12T00:32:14.607520+0000","last_unstale":"2024-09-12T02:06:46.299857+0000","last_undegraded":"2024-09-12T02:06:46.299857+0000","last_fullsized":"2024-09-12T02:06:46.299857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:55.311964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"266'27","reported_seq":149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.709720+0000","last_change":"2024-09-12T00:26:23.314752+0000","last_active":"2024-09-12T02:03:08.709720+0000","last_peered":"2024-09-12T02:03:08.709720+0000","last_clean":"2024-09-12T02:03:08.709720+0000","last_became_active":"2024-09-12T00:26:23.313697+0000","last_became_peered":"2024-09-12T00:26:23.313697+0000","last_unstale":"2024-09-12T02:03:08.709720+0000","last_undegraded":"2024-09-12T02:03:08.709720+0000","last_fullsized":"2024-09-12T02:03:08.709720+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:17.759882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.736399+0000","last_change":"2024-09-12T01:00:24.077672+0000","last_active":"2024-09-12T02:03:13.736399+0000","last_peered":"2024-09-12T02:03:13.736399+0000","last_clean":"2024-09-12T02:03:13.736399+0000","last_became_active":"2024-09-12T01:00:24.072931+0000","last_became_peered":"2024-09-12T01:00:24.072931+0000","last_unstale":"2024-09-12T02:03:13.736399+0000","last_undegraded":"2024-09-12T02:03:13.736399+0000","last_fullsized":"2024-09-12T02:03:13.736399+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:03.310383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.495060+0000","last_change":"2024-09-12T00:32:21.649878+0000","last_active":"2024-09-12T02:06:46.495060+0000","last_peered":"2024-09-12T02:06:46.495060+0000","last_clean":"2024-09-12T02:06:46.495060+0000","last_became_active":"2024-09-12T00:32:21.641431+0000","last_became_peered":"2024-09-12T00:32:21.641431+0000","last_unstale":"2024-09-12T02:06:46.495060+0000","last_undegraded":"2024-09-12T02:06:46.495060+0000","last_fullsized":"2024-09-12T02:06:46.495060+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20470,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681384+0000","last_change":"2024-09-12T00:32:14.597040+0000","last_active":"2024-09-12T02:02:43.681384+0000","last_peered":"2024-09-12T02:02:43.681384+0000","last_clean":"2024-09-12T02:02:43.681384+0000","last_became_active":"2024-09-12T00:32:14.596263+0000","last_became_peered":"2024-09-12T00:32:14.596263+0000","last_unstale":"2024-09-12T02:02:43.681384+0000","last_undegraded":"2024-09-12T02:02:43.681384+0000","last_fullsized":"2024-09-12T02:02:43.681384+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:09.877590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"266'66","reported_seq":265,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.698119+0000","last_change":"2024-09-12T00:26:23.328307+0000","last_active":"2024-09-12T02:03:08.698119+0000","last_peered":"2024-09-12T02:03:08.698119+0000","last_clean":"2024-09-12T02:03:08.698119+0000","last_became_active":"2024-09-12T00:26:23.327784+0000","last_became_peered":"2024-09-12T00:26:23.327784+0000","last_unstale":"2024-09-12T02:03:08.698119+0000","last_undegraded":"2024-09-12T02:03:08.698119+0000","last_fullsized":"2024-09-12T02:03:08.698119+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:59.830797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":253,"num_write":117,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959347+0000","last_change":"2024-09-12T01:00:24.067841+0000","last_active":"2024-09-12T02:03:23.959347+0000","last_peered":"2024-09-12T02:03:23.959347+0000","last_clean":"2024-09-12T02:03:23.959347+0000","last_became_active":"2024-09-12T01:00:24.066842+0000","last_became_peered":"2024-09-12T01:00:24.066842+0000","last_unstale":"2024-09-12T02:03:23.959347+0000","last_undegraded":"2024-09-12T02:03:23.959347+0000","last_fullsized":"2024-09-12T02:03:23.959347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:36.376146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.744288+0000","last_change":"2024-09-12T00:32:21.667714+0000","last_active":"2024-09-12T02:03:23.744288+0000","last_peered":"2024-09-12T02:03:23.744288+0000","last_clean":"2024-09-12T02:03:23.744288+0000","last_became_active":"2024-09-12T00:32:21.667149+0000","last_became_peered":"2024-09-12T00:32:21.667149+0000","last_unstale":"2024-09-12T02:03:23.744288+0000","last_undegraded":"2024-09-12T02:03:23.744288+0000","last_fullsized":"2024-09-12T02:03:23.744288+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:34.141900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"266'3","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:28.547343+0000","last_change":"2024-09-12T00:32:14.601942+0000","last_active":"2024-09-12T02:05:28.547343+0000","last_peered":"2024-09-12T02:05:28.547343+0000","last_clean":"2024-09-12T02:05:28.547343+0000","last_became_active":"2024-09-12T00:32:14.601148+0000","last_became_peered":"2024-09-12T00:32:14.601148+0000","last_unstale":"2024-09-12T02:05:28.547343+0000","last_undegraded":"2024-09-12T02:05:28.547343+0000","last_fullsized":"2024-09-12T02:05:28.547343+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:16.003152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"266'39","reported_seq":182,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.725801+0000","last_change":"2024-09-12T00:26:23.318410+0000","last_active":"2024-09-12T02:03:08.725801+0000","last_peered":"2024-09-12T02:03:08.725801+0000","last_clean":"2024-09-12T02:03:08.725801+0000","last_became_active":"2024-09-12T00:26:23.317880+0000","last_became_peered":"2024-09-12T00:26:23.317880+0000","last_unstale":"2024-09-12T02:03:08.725801+0000","last_undegraded":"2024-09-12T02:03:08.725801+0000","last_fullsized":"2024-09-12T02:03:08.725801+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:35.423826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.742402+0000","last_change":"2024-09-12T01:00:24.086998+0000","last_active":"2024-09-12T02:03:38.742402+0000","last_peered":"2024-09-12T02:03:38.742402+0000","last_clean":"2024-09-12T02:03:38.742402+0000","last_became_active":"2024-09-12T01:00:24.086101+0000","last_became_peered":"2024-09-12T01:00:24.086101+0000","last_unstale":"2024-09-12T02:03:38.742402+0000","last_undegraded":"2024-09-12T02:03:38.742402+0000","last_fullsized":"2024-09-12T02:03:38.742402+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.433366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738790+0000","last_change":"2024-09-12T00:32:21.639641+0000","last_active":"2024-09-12T02:03:23.738790+0000","last_peered":"2024-09-12T02:03:23.738790+0000","last_clean":"2024-09-12T02:03:23.738790+0000","last_became_active":"2024-09-12T00:32:21.634440+0000","last_became_peered":"2024-09-12T00:32:21.634440+0000","last_unstale":"2024-09-12T02:03:23.738790+0000","last_undegraded":"2024-09-12T02:03:23.738790+0000","last_fullsized":"2024-09-12T02:03:23.738790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:52.190306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.770418+0000","last_change":"2024-09-12T00:32:14.596514+0000","last_active":"2024-09-12T02:06:45.770418+0000","last_peered":"2024-09-12T02:06:45.770418+0000","last_clean":"2024-09-12T02:06:45.770418+0000","last_became_active":"2024-09-12T00:32:14.595782+0000","last_became_peered":"2024-09-12T00:32:14.595782+0000","last_unstale":"2024-09-12T02:06:45.770418+0000","last_undegraded":"2024-09-12T02:06:45.770418+0000","last_fullsized":"2024-09-12T02:06:45.770418+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:40.885479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":165,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.750980+0000","last_change":"2024-09-12T00:26:23.324857+0000","last_active":"2024-09-12T02:04:13.750980+0000","last_peered":"2024-09-12T02:04:13.750980+0000","last_clean":"2024-09-12T02:04:13.750980+0000","last_became_active":"2024-09-12T00:26:23.324140+0000","last_became_peered":"2024-09-12T00:26:23.324140+0000","last_unstale":"2024-09-12T02:04:13.750980+0000","last_undegraded":"2024-09-12T02:04:13.750980+0000","last_fullsized":"2024-09-12T02:04:13.750980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:21.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":114,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738926+0000","last_change":"2024-09-12T01:00:24.081545+0000","last_active":"2024-09-12T02:03:23.738926+0000","last_peered":"2024-09-12T02:03:23.738926+0000","last_clean":"2024-09-12T02:03:23.738926+0000","last_became_active":"2024-09-12T01:00:24.080855+0000","last_became_peered":"2024-09-12T01:00:24.080855+0000","last_unstale":"2024-09-12T02:03:23.738926+0000","last_undegraded":"2024-09-12T02:03:23.738926+0000","last_fullsized":"2024-09-12T02:03:23.738926+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:06.572347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'4","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708186+0000","last_change":"2024-09-12T00:32:21.649120+0000","last_active":"2024-09-12T02:04:38.708186+0000","last_peered":"2024-09-12T02:04:38.708186+0000","last_clean":"2024-09-12T02:04:38.708186+0000","last_became_active":"2024-09-12T00:32:21.648333+0000","last_became_peered":"2024-09-12T00:32:21.648333+0000","last_unstale":"2024-09-12T02:04:38.708186+0000","last_undegraded":"2024-09-12T02:04:38.708186+0000","last_fullsized":"2024-09-12T02:04:38.708186+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"266'4","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.770058+0000","last_change":"2024-09-12T00:32:14.600607+0000","last_active":"2024-09-12T02:06:45.770058+0000","last_peered":"2024-09-12T02:06:45.770058+0000","last_clean":"2024-09-12T02:06:45.770058+0000","last_became_active":"2024-09-12T00:32:14.592875+0000","last_became_peered":"2024-09-12T00:32:14.592875+0000","last_unstale":"2024-09-12T02:06:45.770058+0000","last_undegraded":"2024-09-12T02:06:45.770058+0000","last_fullsized":"2024-09-12T02:06:45.770058+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:09.233319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"266'15","reported_seq":118,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.966977+0000","last_change":"2024-09-12T00:26:23.325693+0000","last_active":"2024-09-12T02:03:53.966977+0000","last_peered":"2024-09-12T02:03:53.966977+0000","last_clean":"2024-09-12T02:03:53.966977+0000","last_became_active":"2024-09-12T00:26:23.324884+0000","last_became_peered":"2024-09-12T00:26:23.324884+0000","last_unstale":"2024-09-12T02:03:53.966977+0000","last_undegraded":"2024-09-12T02:03:53.966977+0000","last_fullsized":"2024-09-12T02:03:53.966977+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:53.038478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.517888+0000","last_change":"2024-09-12T01:00:24.062624+0000","last_active":"2024-09-12T02:03:23.517888+0000","last_peered":"2024-09-12T02:03:23.517888+0000","last_clean":"2024-09-12T02:03:23.517888+0000","last_became_active":"2024-09-12T01:00:24.061882+0000","last_became_peered":"2024-09-12T01:00:24.061882+0000","last_unstale":"2024-09-12T02:03:23.517888+0000","last_undegraded":"2024-09-12T02:03:23.517888+0000","last_fullsized":"2024-09-12T02:03:23.517888+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:52.723554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'4","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743502+0000","last_change":"2024-09-12T00:32:21.668310+0000","last_active":"2024-09-12T02:03:43.743502+0000","last_peered":"2024-09-12T02:03:43.743502+0000","last_clean":"2024-09-12T02:03:43.743502+0000","last_became_active":"2024-09-12T00:32:21.667346+0000","last_became_peered":"2024-09-12T00:32:21.667346+0000","last_unstale":"2024-09-12T02:03:43.743502+0000","last_undegraded":"2024-09-12T02:03:43.743502+0000","last_fullsized":"2024-09-12T02:03:43.743502+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:33.558216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"266'9","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.262602+0000","last_change":"2024-09-12T00:32:14.577757+0000","last_active":"2024-09-12T02:06:47.262602+0000","last_peered":"2024-09-12T02:06:47.262602+0000","last_clean":"2024-09-12T02:06:47.262602+0000","last_became_active":"2024-09-12T00:32:14.576974+0000","last_became_peered":"2024-09-12T00:32:14.576974+0000","last_unstale":"2024-09-12T02:06:47.262602+0000","last_undegraded":"2024-09-12T02:06:47.262602+0000","last_fullsized":"2024-09-12T02:06:47.262602+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:03.910967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4127,"num_write":14,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"266'52","reported_seq":231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719368+0000","last_change":"2024-09-12T00:26:23.316961+0000","last_active":"2024-09-12T02:03:53.719368+0000","last_peered":"2024-09-12T02:03:53.719368+0000","last_clean":"2024-09-12T02:03:53.719368+0000","last_became_active":"2024-09-12T00:26:23.315633+0000","last_became_peered":"2024-09-12T00:26:23.315633+0000","last_unstale":"2024-09-12T02:03:53.719368+0000","last_undegraded":"2024-09-12T02:03:53.719368+0000","last_fullsized":"2024-09-12T02:03:53.719368+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:49.483501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":203,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731755+0000","last_change":"2024-09-12T01:00:24.080426+0000","last_active":"2024-09-12T02:02:53.731755+0000","last_peered":"2024-09-12T02:02:53.731755+0000","last_clean":"2024-09-12T02:02:53.731755+0000","last_became_active":"2024-09-12T01:00:24.079834+0000","last_became_peered":"2024-09-12T01:00:24.079834+0000","last_unstale":"2024-09-12T02:02:53.731755+0000","last_undegraded":"2024-09-12T02:02:53.731755+0000","last_fullsized":"2024-09-12T02:02:53.731755+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:05.052155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.535089+0000","last_change":"2024-09-12T00:32:21.664365+0000","last_active":"2024-09-12T02:04:33.535089+0000","last_peered":"2024-09-12T02:04:33.535089+0000","last_clean":"2024-09-12T02:04:33.535089+0000","last_became_active":"2024-09-12T00:32:21.663547+0000","last_became_peered":"2024-09-12T00:32:21.663547+0000","last_unstale":"2024-09-12T02:04:33.535089+0000","last_undegraded":"2024-09-12T02:04:33.535089+0000","last_fullsized":"2024-09-12T02:04:33.535089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:42.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.747512+0000","last_change":"2024-09-12T00:32:14.596240+0000","last_active":"2024-09-12T02:03:58.747512+0000","last_peered":"2024-09-12T02:03:58.747512+0000","last_clean":"2024-09-12T02:03:58.747512+0000","last_became_active":"2024-09-12T00:32:14.593670+0000","last_became_peered":"2024-09-12T00:32:14.593670+0000","last_unstale":"2024-09-12T02:03:58.747512+0000","last_undegraded":"2024-09-12T02:03:58.747512+0000","last_fullsized":"2024-09-12T02:03:58.747512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:01.077637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'28","reported_seq":156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525498+0000","last_change":"2024-09-12T00:26:23.350883+0000","last_active":"2024-09-12T02:03:53.525498+0000","last_peered":"2024-09-12T02:03:53.525498+0000","last_clean":"2024-09-12T02:03:53.525498+0000","last_became_active":"2024-09-12T00:26:23.338248+0000","last_became_peered":"2024-09-12T00:26:23.338248+0000","last_unstale":"2024-09-12T02:03:53.525498+0000","last_undegraded":"2024-09-12T02:03:53.525498+0000","last_fullsized":"2024-09-12T02:03:53.525498+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:58.473095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:54.728722+0000","last_change":"2024-09-12T01:00:24.077369+0000","last_active":"2024-09-12T02:02:54.728722+0000","last_peered":"2024-09-12T02:02:54.728722+0000","last_clean":"2024-09-12T02:02:54.728722+0000","last_became_active":"2024-09-12T01:00:24.068145+0000","last_became_peered":"2024-09-12T01:00:24.068145+0000","last_unstale":"2024-09-12T02:02:54.728722+0000","last_undegraded":"2024-09-12T02:02:54.728722+0000","last_fullsized":"2024-09-12T02:02:54.728722+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:15.100781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.527728+0000","last_change":"2024-09-12T00:32:21.674579+0000","last_active":"2024-09-12T02:04:03.527728+0000","last_peered":"2024-09-12T02:04:03.527728+0000","last_clean":"2024-09-12T02:04:03.527728+0000","last_became_active":"2024-09-12T00:32:21.668979+0000","last_became_peered":"2024-09-12T00:32:21.668979+0000","last_unstale":"2024-09-12T02:04:03.527728+0000","last_undegraded":"2024-09-12T02:04:03.527728+0000","last_fullsized":"2024-09-12T02:04:03.527728+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:43.618228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.037358+0000","last_change":"2024-09-12T00:32:14.611138+0000","last_active":"2024-09-12T02:06:45.037358+0000","last_peered":"2024-09-12T02:06:45.037358+0000","last_clean":"2024-09-12T02:06:45.037358+0000","last_became_active":"2024-09-12T00:32:14.610414+0000","last_became_peered":"2024-09-12T00:32:14.610414+0000","last_unstale":"2024-09-12T02:06:45.037358+0000","last_undegraded":"2024-09-12T02:06:45.037358+0000","last_fullsized":"2024-09-12T02:06:45.037358+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.944085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"266'33","reported_seq":168,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719573+0000","last_change":"2024-09-12T00:26:23.328059+0000","last_active":"2024-09-12T02:03:53.719573+0000","last_peered":"2024-09-12T02:03:53.719573+0000","last_clean":"2024-09-12T02:03:53.719573+0000","last_became_active":"2024-09-12T00:26:23.327296+0000","last_became_peered":"2024-09-12T00:26:23.327296+0000","last_unstale":"2024-09-12T02:03:53.719573+0000","last_undegraded":"2024-09-12T02:03:53.719573+0000","last_fullsized":"2024-09-12T02:03:53.719573+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:43.942150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709243+0000","last_change":"2024-09-12T01:00:24.068043+0000","last_active":"2024-09-12T02:04:43.709243+0000","last_peered":"2024-09-12T02:04:43.709243+0000","last_clean":"2024-09-12T02:04:43.709243+0000","last_became_active":"2024-09-12T01:00:24.067665+0000","last_became_peered":"2024-09-12T01:00:24.067665+0000","last_unstale":"2024-09-12T02:04:43.709243+0000","last_undegraded":"2024-09-12T02:04:43.709243+0000","last_fullsized":"2024-09-12T02:04:43.709243+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:47.648058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.739021+0000","last_change":"2024-09-12T00:32:21.645575+0000","last_active":"2024-09-12T02:03:23.739021+0000","last_peered":"2024-09-12T02:03:23.739021+0000","last_clean":"2024-09-12T02:03:23.739021+0000","last_became_active":"2024-09-12T00:32:21.644891+0000","last_became_peered":"2024-09-12T00:32:21.644891+0000","last_unstale":"2024-09-12T02:03:23.739021+0000","last_undegraded":"2024-09-12T02:03:23.739021+0000","last_fullsized":"2024-09-12T02:03:23.739021+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.537775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"266'2","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:24.763883+0000","last_change":"2024-09-12T00:32:14.599778+0000","last_active":"2024-09-12T02:05:24.763883+0000","last_peered":"2024-09-12T02:05:24.763883+0000","last_clean":"2024-09-12T02:05:24.763883+0000","last_became_active":"2024-09-12T00:32:14.598981+0000","last_became_peered":"2024-09-12T00:32:14.598981+0000","last_unstale":"2024-09-12T02:05:24.763883+0000","last_undegraded":"2024-09-12T02:05:24.763883+0000","last_fullsized":"2024-09-12T02:05:24.763883+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:06.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"266'25","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.757357+0000","last_change":"2024-09-12T00:26:23.317228+0000","last_active":"2024-09-12T02:04:38.757357+0000","last_peered":"2024-09-12T02:04:38.757357+0000","last_clean":"2024-09-12T02:04:38.757357+0000","last_became_active":"2024-09-12T00:26:23.316443+0000","last_became_peered":"2024-09-12T00:26:23.316443+0000","last_unstale":"2024-09-12T02:04:38.757357+0000","last_undegraded":"2024-09-12T02:04:38.757357+0000","last_fullsized":"2024-09-12T02:04:38.757357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:54.406238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":90,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.737725+0000","last_change":"2024-09-12T01:00:24.072339+0000","last_active":"2024-09-12T02:02:53.737725+0000","last_peered":"2024-09-12T02:02:53.737725+0000","last_clean":"2024-09-12T02:02:53.737725+0000","last_became_active":"2024-09-12T01:00:24.071428+0000","last_became_peered":"2024-09-12T01:00:24.071428+0000","last_unstale":"2024-09-12T02:02:53.737725+0000","last_undegraded":"2024-09-12T02:02:53.737725+0000","last_fullsized":"2024-09-12T02:02:53.737725+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:11.332721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"266'9","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.740844+0000","last_change":"2024-09-12T00:32:21.654444+0000","last_active":"2024-09-12T02:06:46.740844+0000","last_peered":"2024-09-12T02:06:46.740844+0000","last_clean":"2024-09-12T02:06:46.740844+0000","last_became_active":"2024-09-12T00:32:21.653749+0000","last_became_peered":"2024-09-12T00:32:21.653749+0000","last_unstale":"2024-09-12T02:06:46.740844+0000","last_undegraded":"2024-09-12T02:06:46.740844+0000","last_fullsized":"2024-09-12T02:06:46.740844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:33.575071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.737749+0000","last_change":"2024-09-12T00:32:14.597114+0000","last_active":"2024-09-12T02:03:18.737749+0000","last_peered":"2024-09-12T02:03:18.737749+0000","last_clean":"2024-09-12T02:03:18.737749+0000","last_became_active":"2024-09-12T00:32:14.596498+0000","last_became_peered":"2024-09-12T00:32:14.596498+0000","last_unstale":"2024-09-12T02:03:18.737749+0000","last_undegraded":"2024-09-12T02:03:18.737749+0000","last_fullsized":"2024-09-12T02:03:18.737749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:03.408422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"266'50","reported_seq":218,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.703534+0000","last_change":"2024-09-12T00:26:23.341311+0000","last_active":"2024-09-12T02:04:18.703534+0000","last_peered":"2024-09-12T02:04:18.703534+0000","last_clean":"2024-09-12T02:04:18.703534+0000","last_became_active":"2024-09-12T00:26:23.340608+0000","last_became_peered":"2024-09-12T00:26:23.340608+0000","last_unstale":"2024-09-12T02:04:18.703534+0000","last_undegraded":"2024-09-12T02:04:18.703534+0000","last_fullsized":"2024-09-12T02:04:18.703534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:24.402590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":178,"num_write":83,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.699157+0000","last_change":"2024-09-12T01:00:24.083558+0000","last_active":"2024-09-12T02:03:13.699157+0000","last_peered":"2024-09-12T02:03:13.699157+0000","last_clean":"2024-09-12T02:03:13.699157+0000","last_became_active":"2024-09-12T01:00:24.083260+0000","last_became_peered":"2024-09-12T01:00:24.083260+0000","last_unstale":"2024-09-12T02:03:13.699157+0000","last_undegraded":"2024-09-12T02:03:13.699157+0000","last_fullsized":"2024-09-12T02:03:13.699157+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"266'9","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:08.726835+0000","last_change":"2024-09-12T00:32:21.656599+0000","last_active":"2024-09-12T02:06:08.726835+0000","last_peered":"2024-09-12T02:06:08.726835+0000","last_clean":"2024-09-12T02:06:08.726835+0000","last_became_active":"2024-09-12T00:32:21.655849+0000","last_became_peered":"2024-09-12T00:32:21.655849+0000","last_unstale":"2024-09-12T02:06:08.726835+0000","last_undegraded":"2024-09-12T02:06:08.726835+0000","last_fullsized":"2024-09-12T02:06:08.726835+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:45.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15358,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.785624+0000","last_change":"2024-09-12T00:32:14.605108+0000","last_active":"2024-09-12T02:06:38.785624+0000","last_peered":"2024-09-12T02:06:38.785624+0000","last_clean":"2024-09-12T02:06:38.785624+0000","last_became_active":"2024-09-12T00:32:14.604519+0000","last_became_peered":"2024-09-12T00:32:14.604519+0000","last_unstale":"2024-09-12T02:06:38.785624+0000","last_undegraded":"2024-09-12T02:06:38.785624+0000","last_fullsized":"2024-09-12T02:06:38.785624+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:45.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":153,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:19.747660+0000","last_change":"2024-09-12T00:26:23.332950+0000","last_active":"2024-09-12T02:04:19.747660+0000","last_peered":"2024-09-12T02:04:19.747660+0000","last_clean":"2024-09-12T02:04:19.747660+0000","last_became_active":"2024-09-12T00:26:23.328187+0000","last_became_peered":"2024-09-12T00:26:23.328187+0000","last_unstale":"2024-09-12T02:04:19.747660+0000","last_undegraded":"2024-09-12T02:04:19.747660+0000","last_fullsized":"2024-09-12T02:04:19.747660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.206262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":91,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727347+0000","last_change":"2024-09-12T01:00:24.063315+0000","last_active":"2024-09-12T02:03:13.727347+0000","last_peered":"2024-09-12T02:03:13.727347+0000","last_clean":"2024-09-12T02:03:13.727347+0000","last_became_active":"2024-09-12T01:00:24.062597+0000","last_became_peered":"2024-09-12T01:00:24.062597+0000","last_unstale":"2024-09-12T02:03:13.727347+0000","last_undegraded":"2024-09-12T02:03:13.727347+0000","last_fullsized":"2024-09-12T02:03:13.727347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:00.125865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:34.751341+0000","last_change":"2024-09-12T00:32:21.646859+0000","last_active":"2024-09-12T02:04:34.751341+0000","last_peered":"2024-09-12T02:04:34.751341+0000","last_clean":"2024-09-12T02:04:34.751341+0000","last_became_active":"2024-09-12T00:32:21.644950+0000","last_became_peered":"2024-09-12T00:32:21.644950+0000","last_unstale":"2024-09-12T02:04:34.751341+0000","last_undegraded":"2024-09-12T02:04:34.751341+0000","last_fullsized":"2024-09-12T02:04:34.751341+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:04.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.777079+0000","last_change":"2024-09-12T00:32:14.598048+0000","last_active":"2024-09-12T02:06:03.777079+0000","last_peered":"2024-09-12T02:06:03.777079+0000","last_clean":"2024-09-12T02:06:03.777079+0000","last_became_active":"2024-09-12T00:32:14.597376+0000","last_became_peered":"2024-09-12T00:32:14.597376+0000","last_unstale":"2024-09-12T02:06:03.777079+0000","last_undegraded":"2024-09-12T02:06:03.777079+0000","last_fullsized":"2024-09-12T02:06:03.777079+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:44.028314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"266'77","reported_seq":297,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.756664+0000","last_change":"2024-09-12T00:26:23.338797+0000","last_active":"2024-09-12T02:04:18.756664+0000","last_peered":"2024-09-12T02:04:18.756664+0000","last_clean":"2024-09-12T02:04:18.756664+0000","last_became_active":"2024-09-12T00:26:23.338274+0000","last_became_peered":"2024-09-12T00:26:23.338274+0000","last_unstale":"2024-09-12T02:04:18.756664+0000","last_undegraded":"2024-09-12T02:04:18.756664+0000","last_fullsized":"2024-09-12T02:04:18.756664+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:48.119590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":296,"num_write":117,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.722148+0000","last_change":"2024-09-12T01:00:24.054473+0000","last_active":"2024-09-12T02:02:53.722148+0000","last_peered":"2024-09-12T02:02:53.722148+0000","last_clean":"2024-09-12T02:02:53.722148+0000","last_became_active":"2024-09-12T01:00:24.053408+0000","last_became_peered":"2024-09-12T01:00:24.053408+0000","last_unstale":"2024-09-12T02:02:53.722148+0000","last_undegraded":"2024-09-12T02:02:53.722148+0000","last_fullsized":"2024-09-12T02:02:53.722148+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:50.708086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.721667+0000","last_change":"2024-09-12T00:32:33.790651+0000","last_active":"2024-09-12T02:04:03.721667+0000","last_peered":"2024-09-12T02:04:03.721667+0000","last_clean":"2024-09-12T02:04:03.721667+0000","last_became_active":"2024-09-12T00:32:33.790018+0000","last_became_peered":"2024-09-12T00:32:33.790018+0000","last_unstale":"2024-09-12T02:04:03.721667+0000","last_undegraded":"2024-09-12T02:04:03.721667+0000","last_fullsized":"2024-09-12T02:04:03.721667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:15.389367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.697604+0000","last_change":"2024-09-12T00:32:14.581204+0000","last_active":"2024-09-12T02:03:53.697604+0000","last_peered":"2024-09-12T02:03:53.697604+0000","last_clean":"2024-09-12T02:03:53.697604+0000","last_became_active":"2024-09-12T00:32:14.580350+0000","last_became_peered":"2024-09-12T00:32:14.580350+0000","last_unstale":"2024-09-12T02:03:53.697604+0000","last_undegraded":"2024-09-12T02:03:53.697604+0000","last_fullsized":"2024-09-12T02:03:53.697604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:27.342223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"266'23","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.724815+0000","last_change":"2024-09-12T00:26:23.327068+0000","last_active":"2024-09-12T02:04:18.724815+0000","last_peered":"2024-09-12T02:04:18.724815+0000","last_clean":"2024-09-12T02:04:18.724815+0000","last_became_active":"2024-09-12T00:26:23.318720+0000","last_became_peered":"2024-09-12T00:26:23.318720+0000","last_unstale":"2024-09-12T02:04:18.724815+0000","last_undegraded":"2024-09-12T02:04:18.724815+0000","last_fullsized":"2024-09-12T02:04:18.724815+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.176923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.735348+0000","last_change":"2024-09-12T01:00:24.074486+0000","last_active":"2024-09-12T02:03:08.735348+0000","last_peered":"2024-09-12T02:03:08.735348+0000","last_clean":"2024-09-12T02:03:08.735348+0000","last_became_active":"2024-09-12T01:00:24.072773+0000","last_became_peered":"2024-09-12T01:00:24.072773+0000","last_unstale":"2024-09-12T02:03:08.735348+0000","last_undegraded":"2024-09-12T02:03:08.735348+0000","last_fullsized":"2024-09-12T02:03:08.735348+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:12.560655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"266'8","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.466415+0000","last_change":"2024-09-12T00:32:21.644007+0000","last_active":"2024-09-12T02:06:45.466415+0000","last_peered":"2024-09-12T02:06:45.466415+0000","last_clean":"2024-09-12T02:06:45.466415+0000","last_became_active":"2024-09-12T00:32:21.643272+0000","last_became_peered":"2024-09-12T00:32:21.643272+0000","last_unstale":"2024-09-12T02:06:45.466415+0000","last_undegraded":"2024-09-12T02:06:45.466415+0000","last_fullsized":"2024-09-12T02:06:45.466415+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.420621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":18,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.720610+0000","last_change":"2024-09-12T00:32:14.580374+0000","last_active":"2024-09-12T02:03:58.720610+0000","last_peered":"2024-09-12T02:03:58.720610+0000","last_clean":"2024-09-12T02:03:58.720610+0000","last_became_active":"2024-09-12T00:32:14.579278+0000","last_became_peered":"2024-09-12T00:32:14.579278+0000","last_unstale":"2024-09-12T02:03:58.720610+0000","last_undegraded":"2024-09-12T02:03:58.720610+0000","last_fullsized":"2024-09-12T02:03:58.720610+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:01.599717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"266'19","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.758435+0000","last_change":"2024-09-12T00:26:23.306938+0000","last_active":"2024-09-12T02:04:43.758435+0000","last_peered":"2024-09-12T02:04:43.758435+0000","last_clean":"2024-09-12T02:04:43.758435+0000","last_became_active":"2024-09-12T00:26:23.306139+0000","last_became_peered":"2024-09-12T00:26:23.306139+0000","last_unstale":"2024-09-12T02:04:43.758435+0000","last_undegraded":"2024-09-12T02:04:43.758435+0000","last_fullsized":"2024-09-12T02:04:43.758435+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:31.920270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"266'329","reported_seq":1074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.558135+0000","last_change":"2024-09-12T00:09:59.316653+0000","last_active":"2024-09-12T02:06:47.558135+0000","last_peered":"2024-09-12T02:06:47.558135+0000","last_clean":"2024-09-12T02:06:47.558135+0000","last_became_active":"2024-09-12T00:09:59.316094+0000","last_became_peered":"2024-09-12T00:09:59.316094+0000","last_unstale":"2024-09-12T02:06:47.558135+0000","last_undegraded":"2024-09-12T02:06:47.558135+0000","last_fullsized":"2024-09-12T02:06:47.558135+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:40.253738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441871,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":581,"num_read_kb":103153,"num_write":998,"num_write_kb":38551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"266'995","reported_seq":2777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:34.723877+0000","last_change":"2024-09-12T00:10:01.282096+0000","last_active":"2024-09-12T02:02:34.723877+0000","last_peered":"2024-09-12T02:02:34.723877+0000","last_clean":"2024-09-12T02:02:34.723877+0000","last_became_active":"2024-09-12T00:10:01.281465+0000","last_became_peered":"2024-09-12T00:10:01.281465+0000","last_unstale":"2024-09-12T02:02:34.723877+0000","last_undegraded":"2024-09-12T02:02:34.723877+0000","last_fullsized":"2024-09-12T02:02:34.723877+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:52.523205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4736,"num_read_kb":4236,"num_write":1359,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"266'354","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.554535+0000","last_change":"2024-09-12T00:09:59.311726+0000","last_active":"2024-09-12T02:06:47.554535+0000","last_peered":"2024-09-12T02:06:47.554535+0000","last_clean":"2024-09-12T02:06:47.554535+0000","last_became_active":"2024-09-12T00:09:59.311178+0000","last_became_peered":"2024-09-12T00:09:59.311178+0000","last_unstale":"2024-09-12T02:06:47.554535+0000","last_undegraded":"2024-09-12T02:06:47.554535+0000","last_fullsized":"2024-09-12T02:06:47.554535+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:44.209100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399015,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":11355,"num_write":1177,"num_write_kb":19733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"266'875","reported_seq":2482,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.639756+0000","last_change":"2024-09-12T00:10:01.270508+0000","last_active":"2024-09-12T02:06:05.639756+0000","last_peered":"2024-09-12T02:06:05.639756+0000","last_clean":"2024-09-12T02:06:05.639756+0000","last_became_active":"2024-09-12T00:10:01.268068+0000","last_became_peered":"2024-09-12T00:10:01.268068+0000","last_unstale":"2024-09-12T02:06:05.639756+0000","last_undegraded":"2024-09-12T02:06:05.639756+0000","last_fullsized":"2024-09-12T02:06:05.639756+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:03.001681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4189,"num_read_kb":3768,"num_write":1161,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"266'376","reported_seq":1082,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.490697+0000","last_change":"2024-09-12T00:09:59.296889+0000","last_active":"2024-09-12T02:06:47.490697+0000","last_peered":"2024-09-12T02:06:47.490697+0000","last_clean":"2024-09-12T02:06:47.490697+0000","last_became_active":"2024-09-12T00:09:59.296557+0000","last_became_peered":"2024-09-12T00:09:59.296557+0000","last_unstale":"2024-09-12T02:06:47.490697+0000","last_undegraded":"2024-09-12T02:06:47.490697+0000","last_fullsized":"2024-09-12T02:06:47.490697+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:27.013161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653297,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":575,"num_read_kb":57177,"num_write":1185,"num_write_kb":38522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1196","reported_seq":2908,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.643791+0000","last_change":"2024-09-12T00:10:01.251720+0000","last_active":"2024-09-12T02:06:05.643791+0000","last_peered":"2024-09-12T02:06:05.643791+0000","last_clean":"2024-09-12T02:06:05.643791+0000","last_became_active":"2024-09-12T00:10:01.251038+0000","last_became_peered":"2024-09-12T00:10:01.251038+0000","last_unstale":"2024-09-12T02:06:05.643791+0000","last_undegraded":"2024-09-12T02:06:05.643791+0000","last_fullsized":"2024-09-12T02:06:05.643791+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:38.505152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5594,"num_read_kb":4965,"num_write":1641,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"266'307","reported_seq":956,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.298927+0000","last_change":"2024-09-12T00:09:59.279104+0000","last_active":"2024-09-12T02:06:47.298927+0000","last_peered":"2024-09-12T02:06:47.298927+0000","last_clean":"2024-09-12T02:06:47.298927+0000","last_became_active":"2024-09-12T00:09:59.278426+0000","last_became_peered":"2024-09-12T00:09:59.278426+0000","last_unstale":"2024-09-12T02:06:47.298927+0000","last_undegraded":"2024-09-12T02:06:47.298927+0000","last_fullsized":"2024-09-12T02:06:47.298927+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:22.498936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":431,"num_read_kb":8612,"num_write":1021,"num_write_kb":32048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"266'440","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719993+0000","last_change":"2024-09-12T00:10:01.248182+0000","last_active":"2024-09-12T02:04:59.719993+0000","last_peered":"2024-09-12T02:04:59.719993+0000","last_clean":"2024-09-12T02:04:59.719993+0000","last_became_active":"2024-09-12T00:10:01.247807+0000","last_became_peered":"2024-09-12T00:10:01.247807+0000","last_unstale":"2024-09-12T02:04:59.719993+0000","last_undegraded":"2024-09-12T02:04:59.719993+0000","last_fullsized":"2024-09-12T02:04:59.719993+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:53.770019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2317,"num_read_kb":2164,"num_write":517,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"266'312","reported_seq":1021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.501611+0000","last_change":"2024-09-12T00:09:59.314721+0000","last_active":"2024-09-12T02:06:47.501611+0000","last_peered":"2024-09-12T02:06:47.501611+0000","last_clean":"2024-09-12T02:06:47.501611+0000","last_became_active":"2024-09-12T00:09:59.314222+0000","last_became_peered":"2024-09-12T00:09:59.314222+0000","last_unstale":"2024-09-12T02:06:47.501611+0000","last_undegraded":"2024-09-12T02:06:47.501611+0000","last_fullsized":"2024-09-12T02:06:47.501611+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:31.303567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":10075,"num_write":947,"num_write_kb":41375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"266'513","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.728189+0000","last_change":"2024-09-12T00:10:01.256948+0000","last_active":"2024-09-12T02:04:33.728189+0000","last_peered":"2024-09-12T02:04:33.728189+0000","last_clean":"2024-09-12T02:04:33.728189+0000","last_became_active":"2024-09-12T00:10:01.256253+0000","last_became_peered":"2024-09-12T00:10:01.256253+0000","last_unstale":"2024-09-12T02:04:33.728189+0000","last_undegraded":"2024-09-12T02:04:33.728189+0000","last_fullsized":"2024-09-12T02:04:33.728189+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:03.333567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2461,"num_read_kb":2278,"num_write":611,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"266'342","reported_seq":996,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.479540+0000","last_change":"2024-09-12T00:09:59.298976+0000","last_active":"2024-09-12T02:06:47.479540+0000","last_peered":"2024-09-12T02:06:47.479540+0000","last_clean":"2024-09-12T02:06:47.479540+0000","last_became_active":"2024-09-12T00:09:59.297821+0000","last_became_peered":"2024-09-12T00:09:59.297821+0000","last_unstale":"2024-09-12T02:06:47.479540+0000","last_undegraded":"2024-09-12T02:06:47.479540+0000","last_fullsized":"2024-09-12T02:06:47.479540+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:47.378293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":489,"num_read_kb":14780,"num_write":963,"num_write_kb":35747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"266'378","reported_seq":1843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936221+0000","last_change":"2024-09-12T00:10:01.252712+0000","last_active":"2024-09-12T02:04:59.936221+0000","last_peered":"2024-09-12T02:04:59.936221+0000","last_clean":"2024-09-12T02:04:59.936221+0000","last_became_active":"2024-09-12T00:10:01.250663+0000","last_became_peered":"2024-09-12T00:10:01.250663+0000","last_unstale":"2024-09-12T02:04:59.936221+0000","last_undegraded":"2024-09-12T02:04:59.936221+0000","last_fullsized":"2024-09-12T02:04:59.936221+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:19.125375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2078,"num_read_kb":1972,"num_write":422,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"266'353","reported_seq":1123,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.478037+0000","last_change":"2024-09-12T00:09:59.312324+0000","last_active":"2024-09-12T02:06:47.478037+0000","last_peered":"2024-09-12T02:06:47.478037+0000","last_clean":"2024-09-12T02:06:47.478037+0000","last_became_active":"2024-09-12T00:09:59.311825+0000","last_became_peered":"2024-09-12T00:09:59.311825+0000","last_unstale":"2024-09-12T02:06:47.478037+0000","last_undegraded":"2024-09-12T02:06:47.478037+0000","last_fullsized":"2024-09-12T02:06:47.478037+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:41.321551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399264,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":842,"num_read_kb":88204,"num_write":1135,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"266'420","reported_seq":1882,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.720872+0000","last_change":"2024-09-12T00:10:01.275162+0000","last_active":"2024-09-12T02:04:59.720872+0000","last_peered":"2024-09-12T02:04:59.720872+0000","last_clean":"2024-09-12T02:04:59.720872+0000","last_became_active":"2024-09-12T00:10:01.274405+0000","last_became_peered":"2024-09-12T00:10:01.274405+0000","last_unstale":"2024-09-12T02:04:59.720872+0000","last_undegraded":"2024-09-12T02:04:59.720872+0000","last_fullsized":"2024-09-12T02:04:59.720872+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:26.880309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2137,"num_read_kb":2003,"num_write":477,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"266'378","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.380419+0000","last_change":"2024-09-12T00:09:59.249333+0000","last_active":"2024-09-12T02:06:47.380419+0000","last_peered":"2024-09-12T02:06:47.380419+0000","last_clean":"2024-09-12T02:06:47.380419+0000","last_became_active":"2024-09-12T00:09:59.248750+0000","last_became_peered":"2024-09-12T00:09:59.248750+0000","last_unstale":"2024-09-12T02:06:47.380419+0000","last_undegraded":"2024-09-12T02:06:47.380419+0000","last_fullsized":"2024-09-12T02:06:47.380419+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:33.945077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4478894,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":698,"num_read_kb":26164,"num_write":1140,"num_write_kb":31035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"266'818","reported_seq":2443,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.717310+0000","last_change":"2024-09-12T00:10:01.249377+0000","last_active":"2024-09-12T02:04:38.717310+0000","last_peered":"2024-09-12T02:04:38.717310+0000","last_clean":"2024-09-12T02:04:38.717310+0000","last_became_active":"2024-09-12T00:10:01.249016+0000","last_became_peered":"2024-09-12T00:10:01.249016+0000","last_unstale":"2024-09-12T02:04:38.717310+0000","last_undegraded":"2024-09-12T02:04:38.717310+0000","last_fullsized":"2024-09-12T02:04:38.717310+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:28.289903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3841,"num_read_kb":3467,"num_write":1075,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"266'626","reported_seq":2380,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936425+0000","last_change":"2024-09-12T00:10:01.253763+0000","last_active":"2024-09-12T02:04:59.936425+0000","last_peered":"2024-09-12T02:04:59.936425+0000","last_clean":"2024-09-12T02:04:59.936425+0000","last_became_active":"2024-09-12T00:10:01.252790+0000","last_became_peered":"2024-09-12T00:10:01.252790+0000","last_unstale":"2024-09-12T02:04:59.936425+0000","last_undegraded":"2024-09-12T02:04:59.936425+0000","last_fullsized":"2024-09-12T02:04:59.936425+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:13.963549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2892,"num_write":772,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"266'411","reported_seq":1108,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.552876+0000","last_change":"2024-09-12T00:09:59.288779+0000","last_active":"2024-09-12T02:06:47.552876+0000","last_peered":"2024-09-12T02:06:47.552876+0000","last_clean":"2024-09-12T02:06:47.552876+0000","last_became_active":"2024-09-12T00:09:59.285279+0000","last_became_peered":"2024-09-12T00:09:59.285279+0000","last_unstale":"2024-09-12T02:06:47.552876+0000","last_undegraded":"2024-09-12T02:06:47.552876+0000","last_fullsized":"2024-09-12T02:06:47.552876+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:31.545971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569417,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":647,"num_read_kb":33158,"num_write":1312,"num_write_kb":40723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"266'380","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753363+0000","last_change":"2024-09-12T00:10:01.271450+0000","last_active":"2024-09-12T02:04:23.753363+0000","last_peered":"2024-09-12T02:04:23.753363+0000","last_clean":"2024-09-12T02:04:23.753363+0000","last_became_active":"2024-09-12T00:10:01.269235+0000","last_became_peered":"2024-09-12T00:10:01.269235+0000","last_unstale":"2024-09-12T02:04:23.753363+0000","last_undegraded":"2024-09-12T02:04:23.753363+0000","last_fullsized":"2024-09-12T02:04:23.753363+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:12.945473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2516,"num_read_kb":2424,"num_write":449,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"266'351","reported_seq":992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.410595+0000","last_change":"2024-09-12T00:09:59.303818+0000","last_active":"2024-09-12T02:06:47.410595+0000","last_peered":"2024-09-12T02:06:47.410595+0000","last_clean":"2024-09-12T02:06:47.410595+0000","last_became_active":"2024-09-12T00:09:59.298975+0000","last_became_peered":"2024-09-12T00:09:59.298975+0000","last_unstale":"2024-09-12T02:06:47.410595+0000","last_undegraded":"2024-09-12T02:06:47.410595+0000","last_fullsized":"2024-09-12T02:06:47.410595+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:31.548154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":20543,"num_write":987,"num_write_kb":37808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"266'1147","reported_seq":2680,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:19.720322+0000","last_change":"2024-09-12T00:10:01.275965+0000","last_active":"2024-09-12T02:02:19.720322+0000","last_peered":"2024-09-12T02:02:19.720322+0000","last_clean":"2024-09-12T02:02:19.720322+0000","last_became_active":"2024-09-12T00:10:01.270566+0000","last_became_peered":"2024-09-12T00:10:01.270566+0000","last_unstale":"2024-09-12T02:02:19.720322+0000","last_undegraded":"2024-09-12T02:02:19.720322+0000","last_fullsized":"2024-09-12T02:02:19.720322+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":1100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:08.981670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5146,"num_read_kb":4532,"num_write":1573,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"266'328","reported_seq":976,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.549542+0000","last_change":"2024-09-12T00:10:31.476025+0000","last_active":"2024-09-12T02:06:47.549542+0000","last_peered":"2024-09-12T02:06:47.549542+0000","last_clean":"2024-09-12T02:06:47.549542+0000","last_became_active":"2024-09-12T00:10:31.475207+0000","last_became_peered":"2024-09-12T00:10:31.475207+0000","last_unstale":"2024-09-12T02:06:47.549542+0000","last_undegraded":"2024-09-12T02:06:47.549542+0000","last_fullsized":"2024-09-12T02:06:47.549542+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:42.892508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35516,"num_write":1077,"num_write_kb":27332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"266'424","reported_seq":2056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.704716+0000","last_change":"2024-09-12T00:10:01.249435+0000","last_active":"2024-09-12T02:03:38.704716+0000","last_peered":"2024-09-12T02:03:38.704716+0000","last_clean":"2024-09-12T02:03:38.704716+0000","last_became_active":"2024-09-12T00:10:01.249060+0000","last_became_peered":"2024-09-12T00:10:01.249060+0000","last_unstale":"2024-09-12T02:03:38.704716+0000","last_undegraded":"2024-09-12T02:03:38.704716+0000","last_fullsized":"2024-09-12T02:03:38.704716+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:57.590588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2301,"num_write":498,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"266'349","reported_seq":1014,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.459203+0000","last_change":"2024-09-12T00:09:59.309576+0000","last_active":"2024-09-12T02:06:47.459203+0000","last_peered":"2024-09-12T02:06:47.459203+0000","last_clean":"2024-09-12T02:06:47.459203+0000","last_became_active":"2024-09-12T00:09:59.308979+0000","last_became_peered":"2024-09-12T00:09:59.308979+0000","last_unstale":"2024-09-12T02:06:47.459203+0000","last_undegraded":"2024-09-12T02:06:47.459203+0000","last_fullsized":"2024-09-12T02:06:47.459203+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:02.012541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9921950,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":33875,"num_write":1037,"num_write_kb":29129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"266'437","reported_seq":1921,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.543220+0000","last_change":"2024-09-12T00:10:01.239020+0000","last_active":"2024-09-12T02:04:57.543220+0000","last_peered":"2024-09-12T02:04:57.543220+0000","last_clean":"2024-09-12T02:04:57.543220+0000","last_became_active":"2024-09-12T00:10:01.238251+0000","last_became_peered":"2024-09-12T00:10:01.238251+0000","last_unstale":"2024-09-12T02:04:57.543220+0000","last_undegraded":"2024-09-12T02:04:57.543220+0000","last_fullsized":"2024-09-12T02:04:57.543220+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:04.492050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2194,"num_read_kb":2058,"num_write":515,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"266'313","reported_seq":960,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.376804+0000","last_change":"2024-09-12T00:09:59.263678+0000","last_active":"2024-09-12T02:06:47.376804+0000","last_peered":"2024-09-12T02:06:47.376804+0000","last_clean":"2024-09-12T02:06:47.376804+0000","last_became_active":"2024-09-12T00:09:59.262666+0000","last_became_peered":"2024-09-12T00:09:59.262666+0000","last_unstale":"2024-09-12T02:06:47.376804+0000","last_undegraded":"2024-09-12T02:06:47.376804+0000","last_fullsized":"2024-09-12T02:06:47.376804+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:36.226668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433326,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":422,"num_read_kb":23030,"num_write":985,"num_write_kb":39870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"266'656","reported_seq":2175,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.747746+0000","last_change":"2024-09-12T00:10:01.258577+0000","last_active":"2024-09-12T02:03:38.747746+0000","last_peered":"2024-09-12T02:03:38.747746+0000","last_clean":"2024-09-12T02:03:38.747746+0000","last_became_active":"2024-09-12T00:10:01.257792+0000","last_became_peered":"2024-09-12T00:10:01.257792+0000","last_unstale":"2024-09-12T02:03:38.747746+0000","last_undegraded":"2024-09-12T02:03:38.747746+0000","last_fullsized":"2024-09-12T02:03:38.747746+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:43.563199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3304,"num_read_kb":2964,"num_write":919,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"266'329","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.315223+0000","last_change":"2024-09-12T00:09:59.294360+0000","last_active":"2024-09-12T02:06:47.315223+0000","last_peered":"2024-09-12T02:06:47.315223+0000","last_clean":"2024-09-12T02:06:47.315223+0000","last_became_active":"2024-09-12T00:09:59.293921+0000","last_became_peered":"2024-09-12T00:09:59.293921+0000","last_unstale":"2024-09-12T02:06:47.315223+0000","last_undegraded":"2024-09-12T02:06:47.315223+0000","last_fullsized":"2024-09-12T02:06:47.315223+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:40.424733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262199,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":482,"num_read_kb":35722,"num_write":1084,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"266'142","reported_seq":678,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.114050+0000","last_change":"2024-09-12T00:10:09.356862+0000","last_active":"2024-09-12T02:06:07.114050+0000","last_peered":"2024-09-12T02:06:07.114050+0000","last_clean":"2024-09-12T02:06:07.114050+0000","last_became_active":"2024-09-12T00:10:09.356144+0000","last_became_peered":"2024-09-12T00:10:09.356144+0000","last_unstale":"2024-09-12T02:06:07.114050+0000","last_undegraded":"2024-09-12T02:06:07.114050+0000","last_fullsized":"2024-09-12T02:06:07.114050+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:09.813648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":339,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"266'785","reported_seq":2333,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.852208+0000","last_change":"2024-09-12T00:10:01.259453+0000","last_active":"2024-09-12T02:04:59.852208+0000","last_peered":"2024-09-12T02:04:59.852208+0000","last_clean":"2024-09-12T02:04:59.852208+0000","last_became_active":"2024-09-12T00:10:01.259053+0000","last_became_peered":"2024-09-12T00:10:01.259053+0000","last_unstale":"2024-09-12T02:04:59.852208+0000","last_undegraded":"2024-09-12T02:04:59.852208+0000","last_fullsized":"2024-09-12T02:04:59.852208+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:38.055321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3705,"num_read_kb":3341,"num_write":1024,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"266'390","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.443615+0000","last_change":"2024-09-12T00:09:59.311180+0000","last_active":"2024-09-12T02:06:47.443615+0000","last_peered":"2024-09-12T02:06:47.443615+0000","last_clean":"2024-09-12T02:06:47.443615+0000","last_became_active":"2024-09-12T00:09:59.310643+0000","last_became_peered":"2024-09-12T00:09:59.310643+0000","last_unstale":"2024-09-12T02:06:47.443615+0000","last_undegraded":"2024-09-12T02:06:47.443615+0000","last_fullsized":"2024-09-12T02:06:47.443615+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:20.368803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136934,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":31265,"num_write":1302,"num_write_kb":60174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.738969+0000","last_change":"2024-09-12T00:10:03.273556+0000","last_active":"2024-09-12T02:03:39.738969+0000","last_peered":"2024-09-12T02:03:39.738969+0000","last_clean":"2024-09-12T02:03:39.738969+0000","last_became_active":"2024-09-12T00:10:03.271233+0000","last_became_peered":"2024-09-12T00:10:03.271233+0000","last_unstale":"2024-09-12T02:03:39.738969+0000","last_undegraded":"2024-09-12T02:03:39.738969+0000","last_fullsized":"2024-09-12T02:03:39.738969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:53.667695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"266'375","reported_seq":1034,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.087115+0000","last_change":"2024-09-12T00:10:05.286196+0000","last_active":"2024-09-12T02:06:47.087115+0000","last_peered":"2024-09-12T02:06:47.087115+0000","last_clean":"2024-09-12T02:06:47.087115+0000","last_became_active":"2024-09-12T00:10:05.285417+0000","last_became_peered":"2024-09-12T00:10:05.285417+0000","last_unstale":"2024-09-12T02:06:47.087115+0000","last_undegraded":"2024-09-12T02:06:47.087115+0000","last_fullsized":"2024-09-12T02:06:47.087115+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.508820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47464,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1152,"num_write":460,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743886+0000","last_change":"2024-09-12T00:10:07.318948+0000","last_active":"2024-09-12T02:03:43.743886+0000","last_peered":"2024-09-12T02:03:43.743886+0000","last_clean":"2024-09-12T02:03:43.743886+0000","last_became_active":"2024-09-12T00:10:07.318114+0000","last_became_peered":"2024-09-12T00:10:07.318114+0000","last_unstale":"2024-09-12T02:03:43.743886+0000","last_undegraded":"2024-09-12T02:03:43.743886+0000","last_fullsized":"2024-09-12T02:03:43.743886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:24.177651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"266'2464","reported_seq":4396,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.745617+0000","last_change":"2024-09-12T00:10:09.371782+0000","last_active":"2024-09-12T02:04:59.745617+0000","last_peered":"2024-09-12T02:04:59.745617+0000","last_clean":"2024-09-12T02:04:59.745617+0000","last_became_active":"2024-09-12T00:10:09.370949+0000","last_became_peered":"2024-09-12T00:10:09.370949+0000","last_unstale":"2024-09-12T02:04:59.745617+0000","last_undegraded":"2024-09-12T02:04:59.745617+0000","last_fullsized":"2024-09-12T02:04:59.745617+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:02.640276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6210,"num_read_kb":6193,"num_write":4929,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"266'415","reported_seq":1953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.738917+0000","last_change":"2024-09-12T00:10:01.275549+0000","last_active":"2024-09-12T02:03:39.738917+0000","last_peered":"2024-09-12T02:03:39.738917+0000","last_clean":"2024-09-12T02:03:39.738917+0000","last_became_active":"2024-09-12T00:10:01.274710+0000","last_became_peered":"2024-09-12T00:10:01.274710+0000","last_unstale":"2024-09-12T02:03:39.738917+0000","last_undegraded":"2024-09-12T02:03:39.738917+0000","last_fullsized":"2024-09-12T02:03:39.738917+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:13.598102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2273,"num_read_kb":2145,"num_write":493,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"266'407","reported_seq":1128,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.502699+0000","last_change":"2024-09-12T00:09:59.282658+0000","last_active":"2024-09-12T02:06:47.502699+0000","last_peered":"2024-09-12T02:06:47.502699+0000","last_clean":"2024-09-12T02:06:47.502699+0000","last_became_active":"2024-09-12T00:09:59.282228+0000","last_became_peered":"2024-09-12T00:09:59.282228+0000","last_unstale":"2024-09-12T02:06:47.502699+0000","last_undegraded":"2024-09-12T02:06:47.502699+0000","last_fullsized":"2024-09-12T02:06:47.502699+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:12.393975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":89139,"num_write":1493,"num_write_kb":44201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.940910+0000","last_change":"2024-09-12T00:10:03.254783+0000","last_active":"2024-09-12T02:02:18.940910+0000","last_peered":"2024-09-12T02:02:18.940910+0000","last_clean":"2024-09-12T02:02:18.940910+0000","last_became_active":"2024-09-12T00:10:03.254006+0000","last_became_peered":"2024-09-12T00:10:03.254006+0000","last_unstale":"2024-09-12T02:02:18.940910+0000","last_undegraded":"2024-09-12T02:02:18.940910+0000","last_fullsized":"2024-09-12T02:02:18.940910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:47.826880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"266'138","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.748930+0000","last_change":"2024-09-12T00:10:05.280695+0000","last_active":"2024-09-12T02:03:43.748930+0000","last_peered":"2024-09-12T02:03:43.748930+0000","last_clean":"2024-09-12T02:03:43.748930+0000","last_became_active":"2024-09-12T00:10:05.279990+0000","last_became_peered":"2024-09-12T00:10:05.279990+0000","last_unstale":"2024-09-12T02:03:43.748930+0000","last_undegraded":"2024-09-12T02:03:43.748930+0000","last_fullsized":"2024-09-12T02:03:43.748930+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:32.073641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.748898+0000","last_change":"2024-09-12T00:10:07.310717+0000","last_active":"2024-09-12T02:03:43.748898+0000","last_peered":"2024-09-12T02:03:43.748898+0000","last_clean":"2024-09-12T02:03:43.748898+0000","last_became_active":"2024-09-12T00:10:07.309927+0000","last_became_peered":"2024-09-12T00:10:07.309927+0000","last_unstale":"2024-09-12T02:03:43.748898+0000","last_undegraded":"2024-09-12T02:03:43.748898+0000","last_fullsized":"2024-09-12T02:03:43.748898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:30.558288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"266'102","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718247+0000","last_change":"2024-09-12T00:10:09.365676+0000","last_active":"2024-09-12T02:02:38.718247+0000","last_peered":"2024-09-12T02:02:38.718247+0000","last_clean":"2024-09-12T02:02:38.718247+0000","last_became_active":"2024-09-12T00:10:09.364927+0000","last_became_peered":"2024-09-12T00:10:09.364927+0000","last_unstale":"2024-09-12T02:02:38.718247+0000","last_undegraded":"2024-09-12T02:02:38.718247+0000","last_fullsized":"2024-09-12T02:02:38.718247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.618632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":243,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"266'381","reported_seq":1911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.521800+0000","last_change":"2024-09-12T00:10:01.247147+0000","last_active":"2024-09-12T02:03:38.521800+0000","last_peered":"2024-09-12T02:03:38.521800+0000","last_clean":"2024-09-12T02:03:38.521800+0000","last_became_active":"2024-09-12T00:10:01.246633+0000","last_became_peered":"2024-09-12T00:10:01.246633+0000","last_unstale":"2024-09-12T02:03:38.521800+0000","last_undegraded":"2024-09-12T02:03:38.521800+0000","last_fullsized":"2024-09-12T02:03:38.521800+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:18.318383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2031,"num_read_kb":1954,"num_write":422,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"266'322","reported_seq":971,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.548754+0000","last_change":"2024-09-12T00:10:31.472958+0000","last_active":"2024-09-12T02:06:47.548754+0000","last_peered":"2024-09-12T02:06:47.548754+0000","last_clean":"2024-09-12T02:06:47.548754+0000","last_became_active":"2024-09-12T00:10:31.472231+0000","last_became_peered":"2024-09-12T00:10:31.472231+0000","last_unstale":"2024-09-12T02:06:47.548754+0000","last_undegraded":"2024-09-12T02:06:47.548754+0000","last_fullsized":"2024-09-12T02:06:47.548754+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:02.415644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536061,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":478,"num_read_kb":34994,"num_write":999,"num_write_kb":46604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"37'3","reported_seq":1006,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.109449+0000","last_change":"2024-09-12T00:10:03.266585+0000","last_active":"2024-09-12T02:06:44.109449+0000","last_peered":"2024-09-12T02:06:44.109449+0000","last_clean":"2024-09-12T02:06:44.109449+0000","last_became_active":"2024-09-12T00:10:03.265816+0000","last_became_peered":"2024-09-12T00:10:03.265816+0000","last_unstale":"2024-09-12T02:06:44.109449+0000","last_undegraded":"2024-09-12T02:06:44.109449+0000","last_fullsized":"2024-09-12T02:06:44.109449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:06.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"266'189","reported_seq":796,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689892+0000","last_change":"2024-09-12T00:10:05.276198+0000","last_active":"2024-09-12T02:02:33.689892+0000","last_peered":"2024-09-12T02:02:33.689892+0000","last_clean":"2024-09-12T02:02:33.689892+0000","last_became_active":"2024-09-12T00:10:05.275499+0000","last_became_peered":"2024-09-12T00:10:05.275499+0000","last_unstale":"2024-09-12T02:02:33.689892+0000","last_undegraded":"2024-09-12T02:02:33.689892+0000","last_fullsized":"2024-09-12T02:02:33.689892+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:30.503399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":245,"num_read_kb":237,"num_write":164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"266'774","reported_seq":3030,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.967482+0000","last_change":"2024-09-12T00:10:07.319071+0000","last_active":"2024-09-12T02:06:46.967482+0000","last_peered":"2024-09-12T02:06:46.967482+0000","last_clean":"2024-09-12T02:06:46.967482+0000","last_became_active":"2024-09-12T00:10:07.318302+0000","last_became_peered":"2024-09-12T00:10:07.318302+0000","last_unstale":"2024-09-12T02:06:46.967482+0000","last_undegraded":"2024-09-12T02:06:46.967482+0000","last_fullsized":"2024-09-12T02:06:46.967482+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:04.659101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"266'205","reported_seq":1059,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.365691+0000","last_change":"2024-09-12T00:10:09.433574+0000","last_active":"2024-09-12T02:06:05.365691+0000","last_peered":"2024-09-12T02:06:05.365691+0000","last_clean":"2024-09-12T02:06:05.365691+0000","last_became_active":"2024-09-12T00:10:09.433045+0000","last_became_peered":"2024-09-12T00:10:09.433045+0000","last_unstale":"2024-09-12T02:06:05.365691+0000","last_undegraded":"2024-09-12T02:06:05.365691+0000","last_fullsized":"2024-09-12T02:06:05.365691+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:02.345129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":620,"num_write":453,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"266'389","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.963036+0000","last_change":"2024-09-12T00:10:01.261564+0000","last_active":"2024-09-12T02:03:38.963036+0000","last_peered":"2024-09-12T02:03:38.963036+0000","last_clean":"2024-09-12T02:03:38.963036+0000","last_became_active":"2024-09-12T00:10:01.261217+0000","last_became_peered":"2024-09-12T00:10:01.261217+0000","last_unstale":"2024-09-12T02:03:38.963036+0000","last_undegraded":"2024-09-12T02:03:38.963036+0000","last_fullsized":"2024-09-12T02:03:38.963036+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2298,"num_read_kb":2187,"num_write":432,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"266'343","reported_seq":998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.468362+0000","last_change":"2024-09-12T00:09:59.286394+0000","last_active":"2024-09-12T02:06:47.468362+0000","last_peered":"2024-09-12T02:06:47.468362+0000","last_clean":"2024-09-12T02:06:47.468362+0000","last_became_active":"2024-09-12T00:09:59.281330+0000","last_became_peered":"2024-09-12T00:09:59.281330+0000","last_unstale":"2024-09-12T02:06:47.468362+0000","last_undegraded":"2024-09-12T02:06:47.468362+0000","last_fullsized":"2024-09-12T02:06:47.468362+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:20.081291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":6619,"num_write":1099,"num_write_kb":41386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.739031+0000","last_change":"2024-09-12T00:10:03.273556+0000","last_active":"2024-09-12T02:03:39.739031+0000","last_peered":"2024-09-12T02:03:39.739031+0000","last_clean":"2024-09-12T02:03:39.739031+0000","last_became_active":"2024-09-12T00:10:03.271292+0000","last_became_peered":"2024-09-12T00:10:03.271292+0000","last_unstale":"2024-09-12T02:03:39.739031+0000","last_undegraded":"2024-09-12T02:03:39.739031+0000","last_fullsized":"2024-09-12T02:03:39.739031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"266'320","reported_seq":938,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.659989+0000","last_change":"2024-09-12T00:10:05.363194+0000","last_active":"2024-09-12T02:06:46.659989+0000","last_peered":"2024-09-12T02:06:46.659989+0000","last_clean":"2024-09-12T02:06:46.659989+0000","last_became_active":"2024-09-12T00:10:05.361419+0000","last_became_peered":"2024-09-12T00:10:05.361419+0000","last_unstale":"2024-09-12T02:06:46.659989+0000","last_undegraded":"2024-09-12T02:06:46.659989+0000","last_fullsized":"2024-09-12T02:06:46.659989+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:25.749053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":523,"num_read_kb":1153,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"266'826","reported_seq":3121,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.723071+0000","last_change":"2024-09-12T00:10:07.335921+0000","last_active":"2024-09-12T02:06:46.723071+0000","last_peered":"2024-09-12T02:06:46.723071+0000","last_clean":"2024-09-12T02:06:46.723071+0000","last_became_active":"2024-09-12T00:10:07.335181+0000","last_became_peered":"2024-09-12T00:10:07.335181+0000","last_unstale":"2024-09-12T02:06:46.723071+0000","last_undegraded":"2024-09-12T02:06:46.723071+0000","last_fullsized":"2024-09-12T02:06:46.723071+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:17.529066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"266'419","reported_seq":1870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726289+0000","last_change":"2024-09-12T00:10:01.267267+0000","last_active":"2024-09-12T02:02:44.726289+0000","last_peered":"2024-09-12T02:02:44.726289+0000","last_clean":"2024-09-12T02:02:44.726289+0000","last_became_active":"2024-09-12T00:10:01.266204+0000","last_became_peered":"2024-09-12T00:10:01.266204+0000","last_unstale":"2024-09-12T02:02:44.726289+0000","last_undegraded":"2024-09-12T02:02:44.726289+0000","last_fullsized":"2024-09-12T02:02:44.726289+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:02.715482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2063,"num_read_kb":1939,"num_write":461,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"266'375","reported_seq":1031,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.507786+0000","last_change":"2024-09-12T00:09:59.308323+0000","last_active":"2024-09-12T02:06:47.507786+0000","last_peered":"2024-09-12T02:06:47.507786+0000","last_clean":"2024-09-12T02:06:47.507786+0000","last_became_active":"2024-09-12T00:09:59.307481+0000","last_became_peered":"2024-09-12T00:09:59.307481+0000","last_unstale":"2024-09-12T02:06:47.507786+0000","last_undegraded":"2024-09-12T02:06:47.507786+0000","last_fullsized":"2024-09-12T02:06:47.507786+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:01.962499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":11316,"num_write":1196,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.729507+0000","last_change":"2024-09-12T00:10:03.261104+0000","last_active":"2024-09-12T02:02:43.729507+0000","last_peered":"2024-09-12T02:02:43.729507+0000","last_clean":"2024-09-12T02:02:43.729507+0000","last_became_active":"2024-09-12T00:10:03.258601+0000","last_became_peered":"2024-09-12T00:10:03.258601+0000","last_unstale":"2024-09-12T02:02:43.729507+0000","last_undegraded":"2024-09-12T02:02:43.729507+0000","last_fullsized":"2024-09-12T02:02:43.729507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:49.169082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"266'477","reported_seq":1179,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.421855+0000","last_change":"2024-09-12T00:10:05.362098+0000","last_active":"2024-09-12T02:06:47.421855+0000","last_peered":"2024-09-12T02:06:47.421855+0000","last_clean":"2024-09-12T02:06:47.421855+0000","last_became_active":"2024-09-12T00:10:05.361273+0000","last_became_peered":"2024-09-12T00:10:05.361273+0000","last_unstale":"2024-09-12T02:06:47.421855+0000","last_undegraded":"2024-09-12T02:06:47.421855+0000","last_fullsized":"2024-09-12T02:06:47.421855+0000","mapping_epoch":31,"log_start":"266'400","ondisk_log_start":"266'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:08.958275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46961,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":773,"num_read_kb":1424,"num_write":592,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679765+0000","last_change":"2024-09-12T00:10:07.317430+0000","last_active":"2024-09-12T02:02:38.679765+0000","last_peered":"2024-09-12T02:02:38.679765+0000","last_clean":"2024-09-12T02:02:38.679765+0000","last_became_active":"2024-09-12T00:10:07.316670+0000","last_became_peered":"2024-09-12T00:10:07.316670+0000","last_unstale":"2024-09-12T02:02:38.679765+0000","last_undegraded":"2024-09-12T02:02:38.679765+0000","last_fullsized":"2024-09-12T02:02:38.679765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.008641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"266'599","reported_seq":1441,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.124549+0000","last_change":"2024-09-12T00:10:09.368828+0000","last_active":"2024-09-12T02:06:07.124549+0000","last_peered":"2024-09-12T02:06:07.124549+0000","last_clean":"2024-09-12T02:06:07.124549+0000","last_became_active":"2024-09-12T00:10:09.368091+0000","last_became_peered":"2024-09-12T00:10:09.368091+0000","last_unstale":"2024-09-12T02:06:07.124549+0000","last_undegraded":"2024-09-12T02:06:07.124549+0000","last_fullsized":"2024-09-12T02:06:07.124549+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:38.890638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1323,"num_read_kb":1320,"num_write":1284,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"266'475","reported_seq":2134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.482999+0000","last_change":"2024-09-12T00:10:01.258535+0000","last_active":"2024-09-12T02:04:57.482999+0000","last_peered":"2024-09-12T02:04:57.482999+0000","last_clean":"2024-09-12T02:04:57.482999+0000","last_became_active":"2024-09-12T00:10:01.257821+0000","last_became_peered":"2024-09-12T00:10:01.257821+0000","last_unstale":"2024-09-12T02:04:57.482999+0000","last_undegraded":"2024-09-12T02:04:57.482999+0000","last_fullsized":"2024-09-12T02:04:57.482999+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:45.635084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2372,"num_write":561,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"266'348","reported_seq":996,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.524014+0000","last_change":"2024-09-12T00:09:59.308750+0000","last_active":"2024-09-12T02:06:47.524014+0000","last_peered":"2024-09-12T02:06:47.524014+0000","last_clean":"2024-09-12T02:06:47.524014+0000","last_became_active":"2024-09-12T00:09:59.308185+0000","last_became_peered":"2024-09-12T00:09:59.308185+0000","last_unstale":"2024-09-12T02:06:47.524014+0000","last_undegraded":"2024-09-12T02:06:47.524014+0000","last_fullsized":"2024-09-12T02:06:47.524014+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:51.112048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":32387,"num_write":1082,"num_write_kb":39559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.691933+0000","last_change":"2024-09-12T00:10:03.250952+0000","last_active":"2024-09-12T02:02:43.691933+0000","last_peered":"2024-09-12T02:02:43.691933+0000","last_clean":"2024-09-12T02:02:43.691933+0000","last_became_active":"2024-09-12T00:10:03.250360+0000","last_became_peered":"2024-09-12T00:10:03.250360+0000","last_unstale":"2024-09-12T02:02:43.691933+0000","last_undegraded":"2024-09-12T02:02:43.691933+0000","last_fullsized":"2024-09-12T02:02:43.691933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:07.747068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"266'309","reported_seq":934,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.649955+0000","last_change":"2024-09-12T00:10:05.292211+0000","last_active":"2024-09-12T02:06:45.649955+0000","last_peered":"2024-09-12T02:06:45.649955+0000","last_clean":"2024-09-12T02:06:45.649955+0000","last_became_active":"2024-09-12T00:10:05.288035+0000","last_became_peered":"2024-09-12T00:10:05.288035+0000","last_unstale":"2024-09-12T02:06:45.649955+0000","last_undegraded":"2024-09-12T02:06:45.649955+0000","last_fullsized":"2024-09-12T02:06:45.649955+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:11.001735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51853,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1112,"num_write":408,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.952988+0000","last_change":"2024-09-12T00:10:07.340807+0000","last_active":"2024-09-12T02:03:03.952988+0000","last_peered":"2024-09-12T02:03:03.952988+0000","last_clean":"2024-09-12T02:03:03.952988+0000","last_became_active":"2024-09-12T00:10:07.340248+0000","last_became_peered":"2024-09-12T00:10:07.340248+0000","last_unstale":"2024-09-12T02:03:03.952988+0000","last_undegraded":"2024-09-12T02:03:03.952988+0000","last_fullsized":"2024-09-12T02:03:03.952988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.585478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"266'116","reported_seq":643,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:13.737132+0000","last_change":"2024-09-12T00:10:09.361661+0000","last_active":"2024-09-12T02:05:13.737132+0000","last_peered":"2024-09-12T02:05:13.737132+0000","last_clean":"2024-09-12T02:05:13.737132+0000","last_became_active":"2024-09-12T00:10:09.359663+0000","last_became_peered":"2024-09-12T00:10:09.359663+0000","last_unstale":"2024-09-12T02:05:13.737132+0000","last_undegraded":"2024-09-12T02:05:13.737132+0000","last_fullsized":"2024-09-12T02:05:13.737132+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:19.918840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":110,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"266'1041","reported_seq":2833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.717280+0000","last_change":"2024-09-12T00:10:01.263893+0000","last_active":"2024-09-12T02:04:59.717280+0000","last_peered":"2024-09-12T02:04:59.717280+0000","last_clean":"2024-09-12T02:04:59.717280+0000","last_became_active":"2024-09-12T00:10:01.263012+0000","last_became_peered":"2024-09-12T00:10:01.263012+0000","last_unstale":"2024-09-12T02:04:59.717280+0000","last_undegraded":"2024-09-12T02:04:59.717280+0000","last_fullsized":"2024-09-12T02:04:59.717280+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1000,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:53.923315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4917,"num_read_kb":4393,"num_write":1427,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"266'301","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.508942+0000","last_change":"2024-09-12T00:10:31.478771+0000","last_active":"2024-09-12T02:06:47.508942+0000","last_peered":"2024-09-12T02:06:47.508942+0000","last_clean":"2024-09-12T02:06:47.508942+0000","last_became_active":"2024-09-12T00:10:31.477934+0000","last_became_peered":"2024-09-12T00:10:31.477934+0000","last_unstale":"2024-09-12T02:06:47.508942+0000","last_undegraded":"2024-09-12T02:06:47.508942+0000","last_fullsized":"2024-09-12T02:06:47.508942+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:03.480837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":400,"num_read_kb":33911,"num_write":938,"num_write_kb":31727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689840+0000","last_change":"2024-09-12T00:10:03.254945+0000","last_active":"2024-09-12T02:02:33.689840+0000","last_peered":"2024-09-12T02:02:33.689840+0000","last_clean":"2024-09-12T02:02:33.689840+0000","last_became_active":"2024-09-12T00:10:03.254328+0000","last_became_peered":"2024-09-12T00:10:03.254328+0000","last_unstale":"2024-09-12T02:02:33.689840+0000","last_undegraded":"2024-09-12T02:02:33.689840+0000","last_fullsized":"2024-09-12T02:02:33.689840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:03.177090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"266'397","reported_seq":1062,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.565854+0000","last_change":"2024-09-12T00:10:05.286921+0000","last_active":"2024-09-12T02:06:47.565854+0000","last_peered":"2024-09-12T02:06:47.565854+0000","last_clean":"2024-09-12T02:06:47.565854+0000","last_became_active":"2024-09-12T00:10:05.285616+0000","last_became_peered":"2024-09-12T00:10:05.285616+0000","last_unstale":"2024-09-12T02:06:47.565854+0000","last_undegraded":"2024-09-12T02:06:47.565854+0000","last_fullsized":"2024-09-12T02:06:47.565854+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:58.157359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44989,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":1221,"num_write":494,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"266'803","reported_seq":3292,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.382150+0000","last_change":"2024-09-12T00:10:07.320523+0000","last_active":"2024-09-12T02:06:44.382150+0000","last_peered":"2024-09-12T02:06:44.382150+0000","last_clean":"2024-09-12T02:06:44.382150+0000","last_became_active":"2024-09-12T00:10:07.319708+0000","last_became_peered":"2024-09-12T00:10:07.319708+0000","last_unstale":"2024-09-12T02:06:44.382150+0000","last_undegraded":"2024-09-12T02:06:44.382150+0000","last_fullsized":"2024-09-12T02:06:44.382150+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:21.157783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"266'112","reported_seq":638,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.365117+0000","last_change":"2024-09-12T00:10:09.358471+0000","last_active":"2024-09-12T02:06:05.365117+0000","last_peered":"2024-09-12T02:06:05.365117+0000","last_clean":"2024-09-12T02:06:05.365117+0000","last_became_active":"2024-09-12T00:10:09.357682+0000","last_became_peered":"2024-09-12T00:10:09.357682+0000","last_unstale":"2024-09-12T02:06:05.365117+0000","last_undegraded":"2024-09-12T02:06:05.365117+0000","last_fullsized":"2024-09-12T02:06:05.365117+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:14.701980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":265,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"266'779","reported_seq":2339,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.717005+0000","last_change":"2024-09-12T00:10:01.258907+0000","last_active":"2024-09-12T02:02:33.717005+0000","last_peered":"2024-09-12T02:02:33.717005+0000","last_clean":"2024-09-12T02:02:33.717005+0000","last_became_active":"2024-09-12T00:10:01.258536+0000","last_became_peered":"2024-09-12T00:10:01.258536+0000","last_unstale":"2024-09-12T02:02:33.717005+0000","last_undegraded":"2024-09-12T02:02:33.717005+0000","last_fullsized":"2024-09-12T02:02:33.717005+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:13.970208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3854,"num_read_kb":3489,"num_write":1035,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"266'390","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.489272+0000","last_change":"2024-09-12T00:09:59.284888+0000","last_active":"2024-09-12T02:06:47.489272+0000","last_peered":"2024-09-12T02:06:47.489272+0000","last_clean":"2024-09-12T02:06:47.489272+0000","last_became_active":"2024-09-12T00:09:59.283882+0000","last_became_peered":"2024-09-12T00:09:59.283882+0000","last_unstale":"2024-09-12T02:06:47.489272+0000","last_undegraded":"2024-09-12T02:06:47.489272+0000","last_fullsized":"2024-09-12T02:06:47.489272+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:55.361739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":25090,"num_write":1213,"num_write_kb":35310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.698033+0000","last_change":"2024-09-12T00:10:03.251387+0000","last_active":"2024-09-12T02:03:08.698033+0000","last_peered":"2024-09-12T02:03:08.698033+0000","last_clean":"2024-09-12T02:03:08.698033+0000","last_became_active":"2024-09-12T00:10:03.250840+0000","last_became_peered":"2024-09-12T00:10:03.250840+0000","last_unstale":"2024-09-12T02:03:08.698033+0000","last_undegraded":"2024-09-12T02:03:08.698033+0000","last_fullsized":"2024-09-12T02:03:08.698033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:11.168119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"266'538","reported_seq":1230,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.953250+0000","last_change":"2024-09-12T00:10:05.287261+0000","last_active":"2024-09-12T02:06:45.953250+0000","last_peered":"2024-09-12T02:06:45.953250+0000","last_clean":"2024-09-12T02:06:45.953250+0000","last_became_active":"2024-09-12T00:10:05.285823+0000","last_became_peered":"2024-09-12T00:10:05.285823+0000","last_unstale":"2024-09-12T02:06:45.953250+0000","last_undegraded":"2024-09-12T02:06:45.953250+0000","last_fullsized":"2024-09-12T02:06:45.953250+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:57.618303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96632,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":936,"num_read_kb":2160,"num_write":758,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.692984+0000","last_change":"2024-09-12T00:10:07.321850+0000","last_active":"2024-09-12T02:02:48.692984+0000","last_peered":"2024-09-12T02:02:48.692984+0000","last_clean":"2024-09-12T02:02:48.692984+0000","last_became_active":"2024-09-12T00:10:07.321180+0000","last_became_peered":"2024-09-12T00:10:07.321180+0000","last_unstale":"2024-09-12T02:02:48.692984+0000","last_undegraded":"2024-09-12T02:02:48.692984+0000","last_fullsized":"2024-09-12T02:02:48.692984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:15.729989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"266'133","reported_seq":710,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.508275+0000","last_change":"2024-09-12T00:10:09.361110+0000","last_active":"2024-09-12T02:04:57.508275+0000","last_peered":"2024-09-12T02:04:57.508275+0000","last_clean":"2024-09-12T02:04:57.508275+0000","last_became_active":"2024-09-12T00:10:09.359011+0000","last_became_peered":"2024-09-12T00:10:09.359011+0000","last_unstale":"2024-09-12T02:04:57.508275+0000","last_undegraded":"2024-09-12T02:04:57.508275+0000","last_fullsized":"2024-09-12T02:04:57.508275+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:07.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":320,"num_read_kb":272,"num_write":321,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"266'1103","reported_seq":2643,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.874650+0000","last_change":"2024-09-12T00:10:01.249017+0000","last_active":"2024-09-12T02:04:59.874650+0000","last_peered":"2024-09-12T02:04:59.874650+0000","last_clean":"2024-09-12T02:04:59.874650+0000","last_became_active":"2024-09-12T00:10:01.248297+0000","last_became_peered":"2024-09-12T00:10:01.248297+0000","last_unstale":"2024-09-12T02:04:59.874650+0000","last_undegraded":"2024-09-12T02:04:59.874650+0000","last_fullsized":"2024-09-12T02:04:59.874650+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":1000,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:34.449342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4909,"num_read_kb":4337,"num_write":1501,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"266'325","reported_seq":979,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.527606+0000","last_change":"2024-09-12T00:10:31.166221+0000","last_active":"2024-09-12T02:06:47.527606+0000","last_peered":"2024-09-12T02:06:47.527606+0000","last_clean":"2024-09-12T02:06:47.527606+0000","last_became_active":"2024-09-12T00:10:31.165905+0000","last_became_peered":"2024-09-12T00:10:31.165905+0000","last_unstale":"2024-09-12T02:06:47.527606+0000","last_undegraded":"2024-09-12T02:06:47.527606+0000","last_fullsized":"2024-09-12T02:06:47.527606+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:02.031075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273693,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":433,"num_read_kb":2613,"num_write":1035,"num_write_kb":17332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,7],"acting":[3,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689930+0000","last_change":"2024-09-12T00:10:03.254698+0000","last_active":"2024-09-12T02:02:33.689930+0000","last_peered":"2024-09-12T02:02:33.689930+0000","last_clean":"2024-09-12T02:02:33.689930+0000","last_became_active":"2024-09-12T00:10:03.254056+0000","last_became_peered":"2024-09-12T00:10:03.254056+0000","last_unstale":"2024-09-12T02:02:33.689930+0000","last_undegraded":"2024-09-12T02:02:33.689930+0000","last_fullsized":"2024-09-12T02:02:33.689930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:22.359128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"266'379","reported_seq":1016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.069287+0000","last_change":"2024-09-12T00:10:05.300463+0000","last_active":"2024-09-12T02:06:46.069287+0000","last_peered":"2024-09-12T02:06:46.069287+0000","last_clean":"2024-09-12T02:06:46.069287+0000","last_became_active":"2024-09-12T00:10:05.299568+0000","last_became_peered":"2024-09-12T00:10:05.299568+0000","last_unstale":"2024-09-12T02:06:46.069287+0000","last_undegraded":"2024-09-12T02:06:46.069287+0000","last_fullsized":"2024-09-12T02:06:46.069287+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:55.828313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":635,"num_read_kb":1318,"num_write":554,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.726007+0000","last_change":"2024-09-12T00:10:07.335273+0000","last_active":"2024-09-12T02:03:08.726007+0000","last_peered":"2024-09-12T02:03:08.726007+0000","last_clean":"2024-09-12T02:03:08.726007+0000","last_became_active":"2024-09-12T00:10:07.334527+0000","last_became_peered":"2024-09-12T00:10:07.334527+0000","last_unstale":"2024-09-12T02:03:08.726007+0000","last_undegraded":"2024-09-12T02:03:08.726007+0000","last_fullsized":"2024-09-12T02:03:08.726007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:58.243181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"266'171","reported_seq":743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:53.394855+0000","last_change":"2024-09-12T00:10:09.373893+0000","last_active":"2024-09-12T02:05:53.394855+0000","last_peered":"2024-09-12T02:05:53.394855+0000","last_clean":"2024-09-12T02:05:53.394855+0000","last_became_active":"2024-09-12T00:10:09.373318+0000","last_became_peered":"2024-09-12T00:10:09.373318+0000","last_unstale":"2024-09-12T02:05:53.394855+0000","last_undegraded":"2024-09-12T02:05:53.394855+0000","last_fullsized":"2024-09-12T02:05:53.394855+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:12.690531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":275,"num_write":406,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"266'789","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.475401+0000","last_change":"2024-09-12T00:10:01.242970+0000","last_active":"2024-09-12T02:04:57.475401+0000","last_peered":"2024-09-12T02:04:57.475401+0000","last_clean":"2024-09-12T02:04:57.475401+0000","last_became_active":"2024-09-12T00:10:01.242213+0000","last_became_peered":"2024-09-12T00:10:01.242213+0000","last_unstale":"2024-09-12T02:04:57.475401+0000","last_undegraded":"2024-09-12T02:04:57.475401+0000","last_fullsized":"2024-09-12T02:04:57.475401+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.464884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3776,"num_read_kb":3427,"num_write":1023,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"266'387","reported_seq":1078,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.383112+0000","last_change":"2024-09-12T00:09:59.299620+0000","last_active":"2024-09-12T02:06:47.383112+0000","last_peered":"2024-09-12T02:06:47.383112+0000","last_clean":"2024-09-12T02:06:47.383112+0000","last_became_active":"2024-09-12T00:09:59.298986+0000","last_became_peered":"2024-09-12T00:09:59.298986+0000","last_unstale":"2024-09-12T02:06:47.383112+0000","last_undegraded":"2024-09-12T02:06:47.383112+0000","last_fullsized":"2024-09-12T02:06:47.383112+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:32.999083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":586,"num_read_kb":16563,"num_write":1186,"num_write_kb":29581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.678607+0000","last_change":"2024-09-12T00:10:03.262756+0000","last_active":"2024-09-12T02:02:33.678607+0000","last_peered":"2024-09-12T02:02:33.678607+0000","last_clean":"2024-09-12T02:02:33.678607+0000","last_became_active":"2024-09-12T00:10:03.262121+0000","last_became_peered":"2024-09-12T00:10:03.262121+0000","last_unstale":"2024-09-12T02:02:33.678607+0000","last_undegraded":"2024-09-12T02:02:33.678607+0000","last_fullsized":"2024-09-12T02:02:33.678607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:37.206721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"266'390","reported_seq":1045,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.380567+0000","last_change":"2024-09-12T00:10:05.295381+0000","last_active":"2024-09-12T02:06:45.380567+0000","last_peered":"2024-09-12T02:06:45.380567+0000","last_clean":"2024-09-12T02:06:45.380567+0000","last_became_active":"2024-09-12T00:10:05.294629+0000","last_became_peered":"2024-09-12T00:10:05.294629+0000","last_unstale":"2024-09-12T02:06:45.380567+0000","last_undegraded":"2024-09-12T02:06:45.380567+0000","last_fullsized":"2024-09-12T02:06:45.380567+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:11.786672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46543,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":631,"num_read_kb":1251,"num_write":492,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"266'749","reported_seq":3287,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.735407+0000","last_change":"2024-09-12T00:10:07.315482+0000","last_active":"2024-09-12T02:06:46.735407+0000","last_peered":"2024-09-12T02:06:46.735407+0000","last_clean":"2024-09-12T02:06:46.735407+0000","last_became_active":"2024-09-12T00:10:07.314777+0000","last_became_peered":"2024-09-12T00:10:07.314777+0000","last_unstale":"2024-09-12T02:06:46.735407+0000","last_undegraded":"2024-09-12T02:06:46.735407+0000","last_fullsized":"2024-09-12T02:06:46.735407+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:55.137312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"266'132","reported_seq":670,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.682437+0000","last_change":"2024-09-12T00:10:09.347267+0000","last_active":"2024-09-12T02:04:57.682437+0000","last_peered":"2024-09-12T02:04:57.682437+0000","last_clean":"2024-09-12T02:04:57.682437+0000","last_became_active":"2024-09-12T00:10:09.346452+0000","last_became_peered":"2024-09-12T00:10:09.346452+0000","last_unstale":"2024-09-12T02:04:57.682437+0000","last_undegraded":"2024-09-12T02:04:57.682437+0000","last_fullsized":"2024-09-12T02:04:57.682437+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:11.712124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":133,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"266'1057","reported_seq":2646,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.763934+0000","last_change":"2024-09-12T00:10:01.265761+0000","last_active":"2024-09-12T02:04:48.763934+0000","last_peered":"2024-09-12T02:04:48.763934+0000","last_clean":"2024-09-12T02:04:48.763934+0000","last_became_active":"2024-09-12T00:10:01.264718+0000","last_became_peered":"2024-09-12T00:10:01.264718+0000","last_unstale":"2024-09-12T02:04:48.763934+0000","last_undegraded":"2024-09-12T02:04:48.763934+0000","last_fullsized":"2024-09-12T02:04:48.763934+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":1000,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:21.890638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4853,"num_read_kb":4249,"num_write":1477,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"266'417","reported_seq":1113,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.507177+0000","last_change":"2024-09-12T00:09:59.307052+0000","last_active":"2024-09-12T02:06:47.507177+0000","last_peered":"2024-09-12T02:06:47.507177+0000","last_clean":"2024-09-12T02:06:47.507177+0000","last_became_active":"2024-09-12T00:09:59.301303+0000","last_became_peered":"2024-09-12T00:09:59.301303+0000","last_unstale":"2024-09-12T02:06:47.507177+0000","last_undegraded":"2024-09-12T02:06:47.507177+0000","last_fullsized":"2024-09-12T02:06:47.507177+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:46.678907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443899,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":39523,"num_write":1279,"num_write_kb":37758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.121629+0000","last_change":"2024-09-12T00:10:03.274423+0000","last_active":"2024-09-12T02:06:44.121629+0000","last_peered":"2024-09-12T02:06:44.121629+0000","last_clean":"2024-09-12T02:06:44.121629+0000","last_became_active":"2024-09-12T00:10:03.271281+0000","last_became_peered":"2024-09-12T00:10:03.271281+0000","last_unstale":"2024-09-12T02:06:44.121629+0000","last_undegraded":"2024-09-12T02:06:44.121629+0000","last_fullsized":"2024-09-12T02:06:44.121629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:31.849595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"266'147","reported_seq":728,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.946308+0000","last_change":"2024-09-12T00:10:05.363280+0000","last_active":"2024-09-12T02:02:38.946308+0000","last_peered":"2024-09-12T02:02:38.946308+0000","last_clean":"2024-09-12T02:02:38.946308+0000","last_became_active":"2024-09-12T00:10:05.362449+0000","last_became_peered":"2024-09-12T00:10:05.362449+0000","last_unstale":"2024-09-12T02:02:38.946308+0000","last_undegraded":"2024-09-12T02:02:38.946308+0000","last_fullsized":"2024-09-12T02:02:38.946308+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:21.556082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"266'764","reported_seq":3346,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.015394+0000","last_change":"2024-09-12T00:10:07.319650+0000","last_active":"2024-09-12T02:06:47.015394+0000","last_peered":"2024-09-12T02:06:47.015394+0000","last_clean":"2024-09-12T02:06:47.015394+0000","last_became_active":"2024-09-12T00:10:07.318566+0000","last_became_peered":"2024-09-12T00:10:07.318566+0000","last_unstale":"2024-09-12T02:06:47.015394+0000","last_undegraded":"2024-09-12T02:06:47.015394+0000","last_fullsized":"2024-09-12T02:06:47.015394+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:17.997457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"266'180","reported_seq":711,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.523007+0000","last_change":"2024-09-12T00:10:09.353927+0000","last_active":"2024-09-12T02:04:57.523007+0000","last_peered":"2024-09-12T02:04:57.523007+0000","last_clean":"2024-09-12T02:04:57.523007+0000","last_became_active":"2024-09-12T00:10:09.353213+0000","last_became_peered":"2024-09-12T00:10:09.353213+0000","last_unstale":"2024-09-12T02:04:57.523007+0000","last_undegraded":"2024-09-12T02:04:57.523007+0000","last_fullsized":"2024-09-12T02:04:57.523007+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:39.991544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":410,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"266'436","reported_seq":1987,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.686240+0000","last_change":"2024-09-12T00:10:01.256672+0000","last_active":"2024-09-12T02:03:03.686240+0000","last_peered":"2024-09-12T02:03:03.686240+0000","last_clean":"2024-09-12T02:03:03.686240+0000","last_became_active":"2024-09-12T00:10:01.256287+0000","last_became_peered":"2024-09-12T00:10:01.256287+0000","last_unstale":"2024-09-12T02:03:03.686240+0000","last_undegraded":"2024-09-12T02:03:03.686240+0000","last_fullsized":"2024-09-12T02:03:03.686240+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:39.690690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2163,"num_write":523,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"266'451","reported_seq":1389,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.475693+0000","last_change":"2024-09-12T00:10:31.169004+0000","last_active":"2024-09-12T02:06:47.475693+0000","last_peered":"2024-09-12T02:06:47.475693+0000","last_clean":"2024-09-12T02:06:47.475693+0000","last_became_active":"2024-09-12T00:10:31.168654+0000","last_became_peered":"2024-09-12T00:10:31.168654+0000","last_unstale":"2024-09-12T02:06:47.475693+0000","last_undegraded":"2024-09-12T02:06:47.475693+0000","last_fullsized":"2024-09-12T02:06:47.475693+0000","mapping_epoch":38,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:25.883597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777138,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1245,"num_read_kb":67964,"num_write":1343,"num_write_kb":19763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733393+0000","last_change":"2024-09-12T00:10:03.273199+0000","last_active":"2024-09-12T02:02:33.733393+0000","last_peered":"2024-09-12T02:02:33.733393+0000","last_clean":"2024-09-12T02:02:33.733393+0000","last_became_active":"2024-09-12T00:10:03.272284+0000","last_became_peered":"2024-09-12T00:10:03.272284+0000","last_unstale":"2024-09-12T02:02:33.733393+0000","last_undegraded":"2024-09-12T02:02:33.733393+0000","last_fullsized":"2024-09-12T02:02:33.733393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:34.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"266'536","reported_seq":1218,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.153112+0000","last_change":"2024-09-12T00:10:05.301341+0000","last_active":"2024-09-12T02:06:47.153112+0000","last_peered":"2024-09-12T02:06:47.153112+0000","last_clean":"2024-09-12T02:06:47.153112+0000","last_became_active":"2024-09-12T00:10:05.300354+0000","last_became_peered":"2024-09-12T00:10:05.300354+0000","last_unstale":"2024-09-12T02:06:47.153112+0000","last_undegraded":"2024-09-12T02:06:47.153112+0000","last_fullsized":"2024-09-12T02:06:47.153112+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:12.920116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54476,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1438,"num_read_kb":1976,"num_write":2042,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.703060+0000","last_change":"2024-09-12T00:10:07.340586+0000","last_active":"2024-09-12T02:02:38.703060+0000","last_peered":"2024-09-12T02:02:38.703060+0000","last_clean":"2024-09-12T02:02:38.703060+0000","last_became_active":"2024-09-12T00:10:07.340008+0000","last_became_peered":"2024-09-12T00:10:07.340008+0000","last_unstale":"2024-09-12T02:02:38.703060+0000","last_undegraded":"2024-09-12T02:02:38.703060+0000","last_fullsized":"2024-09-12T02:02:38.703060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:10.322035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"266'137","reported_seq":681,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709447+0000","last_change":"2024-09-12T00:10:09.373165+0000","last_active":"2024-09-12T02:04:43.709447+0000","last_peered":"2024-09-12T02:04:43.709447+0000","last_clean":"2024-09-12T02:04:43.709447+0000","last_became_active":"2024-09-12T00:10:09.372231+0000","last_became_peered":"2024-09-12T00:10:09.372231+0000","last_unstale":"2024-09-12T02:04:43.709447+0000","last_undegraded":"2024-09-12T02:04:43.709447+0000","last_fullsized":"2024-09-12T02:04:43.709447+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:27.875059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"266'755","reported_seq":2305,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.708542+0000","last_change":"2024-09-12T00:10:01.263233+0000","last_active":"2024-09-12T02:03:03.708542+0000","last_peered":"2024-09-12T02:03:03.708542+0000","last_clean":"2024-09-12T02:03:03.708542+0000","last_became_active":"2024-09-12T00:10:01.262490+0000","last_became_peered":"2024-09-12T00:10:01.262490+0000","last_unstale":"2024-09-12T02:03:03.708542+0000","last_undegraded":"2024-09-12T02:03:03.708542+0000","last_fullsized":"2024-09-12T02:03:03.708542+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:53.059969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3216,"num_write":966,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.749663+0000","last_change":"2024-09-12T00:09:40.226824+0000","last_active":"2024-09-12T02:04:08.749663+0000","last_peered":"2024-09-12T02:04:08.749663+0000","last_clean":"2024-09-12T02:04:08.749663+0000","last_became_active":"2024-09-12T00:09:40.224430+0000","last_became_peered":"2024-09-12T00:09:40.224430+0000","last_unstale":"2024-09-12T02:04:08.749663+0000","last_undegraded":"2024-09-12T02:04:08.749663+0000","last_fullsized":"2024-09-12T02:04:08.749663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:39.068560+0000","last_clean_scrub_stamp":"2024-09-12T00:09:39.068560+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.078225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":557,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:24.749088+0000","last_change":"2024-09-12T00:09:48.187085+0000","last_active":"2024-09-12T02:04:24.749088+0000","last_peered":"2024-09-12T02:04:24.749088+0000","last_clean":"2024-09-12T02:04:24.749088+0000","last_became_active":"2024-09-12T00:09:46.162330+0000","last_became_peered":"2024-09-12T00:09:46.162330+0000","last_unstale":"2024-09-12T02:04:24.749088+0000","last_undegraded":"2024-09-12T02:04:24.749088+0000","last_fullsized":"2024-09-12T02:04:24.749088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:31.598024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090615300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"266'321","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.508407+0000","last_change":"2024-09-12T00:09:59.310501+0000","last_active":"2024-09-12T02:06:47.508407+0000","last_peered":"2024-09-12T02:06:47.508407+0000","last_clean":"2024-09-12T02:06:47.508407+0000","last_became_active":"2024-09-12T00:09:59.310092+0000","last_became_peered":"2024-09-12T00:09:59.310092+0000","last_unstale":"2024-09-12T02:06:47.508407+0000","last_undegraded":"2024-09-12T02:06:47.508407+0000","last_fullsized":"2024-09-12T02:06:47.508407+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:33.851016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306611,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":13893,"num_write":1018,"num_write_kb":29182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"37'5","reported_seq":1010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.107035+0000","last_change":"2024-09-12T00:10:03.266852+0000","last_active":"2024-09-12T02:06:44.107035+0000","last_peered":"2024-09-12T02:06:44.107035+0000","last_clean":"2024-09-12T02:06:44.107035+0000","last_became_active":"2024-09-12T00:10:03.261183+0000","last_became_peered":"2024-09-12T00:10:03.261183+0000","last_unstale":"2024-09-12T02:06:44.107035+0000","last_undegraded":"2024-09-12T02:06:44.107035+0000","last_fullsized":"2024-09-12T02:06:44.107035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:03.208998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"266'807","reported_seq":1561,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.329385+0000","last_change":"2024-09-12T00:10:05.294884+0000","last_active":"2024-09-12T02:06:47.329385+0000","last_peered":"2024-09-12T02:06:47.329385+0000","last_clean":"2024-09-12T02:06:47.329385+0000","last_became_active":"2024-09-12T00:10:05.294267+0000","last_became_peered":"2024-09-12T00:10:05.294267+0000","last_unstale":"2024-09-12T02:06:47.329385+0000","last_undegraded":"2024-09-12T02:06:47.329385+0000","last_fullsized":"2024-09-12T02:06:47.329385+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:05.135490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156191,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1567,"num_read_kb":3456,"num_write":1540,"num_write_kb":1367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.720998+0000","last_change":"2024-09-12T00:10:07.324124+0000","last_active":"2024-09-12T02:02:48.720998+0000","last_peered":"2024-09-12T02:02:48.720998+0000","last_clean":"2024-09-12T02:02:48.720998+0000","last_became_active":"2024-09-12T00:10:07.323398+0000","last_became_peered":"2024-09-12T00:10:07.323398+0000","last_unstale":"2024-09-12T02:02:48.720998+0000","last_undegraded":"2024-09-12T02:02:48.720998+0000","last_fullsized":"2024-09-12T02:02:48.720998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:42.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"266'247","reported_seq":998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.733816+0000","last_change":"2024-09-12T00:10:09.374413+0000","last_active":"2024-09-12T02:04:58.733816+0000","last_peered":"2024-09-12T02:04:58.733816+0000","last_clean":"2024-09-12T02:04:58.733816+0000","last_became_active":"2024-09-12T00:10:09.373661+0000","last_became_peered":"2024-09-12T00:10:09.373661+0000","last_unstale":"2024-09-12T02:04:58.733816+0000","last_undegraded":"2024-09-12T02:04:58.733816+0000","last_fullsized":"2024-09-12T02:04:58.733816+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.718166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":498,"num_write":430,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"266'1252","reported_seq":3052,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.719612+0000","last_change":"2024-09-12T00:10:31.472451+0000","last_active":"2024-09-12T02:02:43.719612+0000","last_peered":"2024-09-12T02:02:43.719612+0000","last_clean":"2024-09-12T02:02:43.719612+0000","last_became_active":"2024-09-12T00:10:31.471885+0000","last_became_peered":"2024-09-12T00:10:31.471885+0000","last_unstale":"2024-09-12T02:02:43.719612+0000","last_undegraded":"2024-09-12T02:02:43.719612+0000","last_fullsized":"2024-09-12T02:02:43.719612+0000","mapping_epoch":38,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:24.536885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6022,"num_read_kb":5329,"num_write":1728,"num_write_kb":723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.750901+0000","last_change":"2024-09-12T00:09:48.283186+0000","last_active":"2024-09-12T02:04:13.750901+0000","last_peered":"2024-09-12T02:04:13.750901+0000","last_clean":"2024-09-12T02:04:13.750901+0000","last_became_active":"2024-09-12T00:09:46.164248+0000","last_became_peered":"2024-09-12T00:09:46.164248+0000","last_unstale":"2024-09-12T02:04:13.750901+0000","last_undegraded":"2024-09-12T02:04:13.750901+0000","last_fullsized":"2024-09-12T02:04:13.750901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:55.257275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099742600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"266'334","reported_seq":990,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.535461+0000","last_change":"2024-09-12T02:06:53.535461+0000","last_active":"2024-09-12T02:06:53.535461+0000","last_peered":"2024-09-12T02:06:53.535461+0000","last_clean":"2024-09-12T02:06:53.535461+0000","last_became_active":"2024-09-12T00:09:59.293880+0000","last_became_peered":"2024-09-12T00:09:59.293880+0000","last_unstale":"2024-09-12T02:06:53.535461+0000","last_undegraded":"2024-09-12T02:06:53.535461+0000","last_fullsized":"2024-09-12T02:06:53.535461+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'334","last_scrub_stamp":"2024-09-12T02:06:53.535293+0000","last_deep_scrub":"266'334","last_deep_scrub_stamp":"2024-09-12T02:06:53.535293+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.535293+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:40.126937+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5590248,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":16782,"num_write":1093,"num_write_kb":42263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726532+0000","last_change":"2024-09-12T00:10:03.273620+0000","last_active":"2024-09-12T02:02:44.726532+0000","last_peered":"2024-09-12T02:02:44.726532+0000","last_clean":"2024-09-12T02:02:44.726532+0000","last_became_active":"2024-09-12T00:10:03.271454+0000","last_became_peered":"2024-09-12T00:10:03.271454+0000","last_unstale":"2024-09-12T02:02:44.726532+0000","last_undegraded":"2024-09-12T02:02:44.726532+0000","last_fullsized":"2024-09-12T02:02:44.726532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:12.327352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"266'1452","reported_seq":3847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.569225+0000","last_change":"2024-09-12T00:10:05.295762+0000","last_active":"2024-09-12T02:06:47.569225+0000","last_peered":"2024-09-12T02:06:47.569225+0000","last_clean":"2024-09-12T02:06:47.569225+0000","last_became_active":"2024-09-12T00:10:05.295058+0000","last_became_peered":"2024-09-12T00:10:05.295058+0000","last_unstale":"2024-09-12T02:06:47.569225+0000","last_undegraded":"2024-09-12T02:06:47.569225+0000","last_fullsized":"2024-09-12T02:06:47.569225+0000","mapping_epoch":31,"log_start":"266'1400","ondisk_log_start":"266'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":1400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:03.236457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161189,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2280,"num_read_kb":4238,"num_write":1386,"num_write_kb":1157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.734237+0000","last_change":"2024-09-12T00:10:07.320656+0000","last_active":"2024-09-12T02:03:03.734237+0000","last_peered":"2024-09-12T02:03:03.734237+0000","last_clean":"2024-09-12T02:03:03.734237+0000","last_became_active":"2024-09-12T00:10:07.319957+0000","last_became_peered":"2024-09-12T00:10:07.319957+0000","last_unstale":"2024-09-12T02:03:03.734237+0000","last_undegraded":"2024-09-12T02:03:03.734237+0000","last_fullsized":"2024-09-12T02:03:03.734237+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:05.134552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"266'86","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.689469+0000","last_change":"2024-09-12T00:10:09.431550+0000","last_active":"2024-09-12T02:03:18.689469+0000","last_peered":"2024-09-12T02:03:18.689469+0000","last_clean":"2024-09-12T02:03:18.689469+0000","last_became_active":"2024-09-12T00:10:09.430727+0000","last_became_peered":"2024-09-12T00:10:09.430727+0000","last_unstale":"2024-09-12T02:03:18.689469+0000","last_undegraded":"2024-09-12T02:03:18.689469+0000","last_fullsized":"2024-09-12T02:03:18.689469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:34.946722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"266'638","reported_seq":2418,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681419+0000","last_change":"2024-09-12T00:10:01.277654+0000","last_active":"2024-09-12T02:02:43.681419+0000","last_peered":"2024-09-12T02:02:43.681419+0000","last_clean":"2024-09-12T02:02:43.681419+0000","last_became_active":"2024-09-12T00:10:01.277302+0000","last_became_peered":"2024-09-12T00:10:01.277302+0000","last_unstale":"2024-09-12T02:02:43.681419+0000","last_undegraded":"2024-09-12T02:02:43.681419+0000","last_fullsized":"2024-09-12T02:02:43.681419+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:08.220111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3369,"num_read_kb":3119,"num_write":789,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":562,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.645702+0000","last_change":"2024-09-12T02:06:53.645702+0000","last_active":"2024-09-12T02:06:53.645702+0000","last_peered":"2024-09-12T02:06:53.645702+0000","last_clean":"2024-09-12T02:06:53.645702+0000","last_became_active":"2024-09-12T00:09:46.179853+0000","last_became_peered":"2024-09-12T00:09:46.179853+0000","last_unstale":"2024-09-12T02:06:53.645702+0000","last_undegraded":"2024-09-12T02:06:53.645702+0000","last_fullsized":"2024-09-12T02:06:53.645702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:53.645611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:53.645611+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.645611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:10.578130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056473999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"266'337","reported_seq":1043,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.554732+0000","last_change":"2024-09-12T00:09:59.317598+0000","last_active":"2024-09-12T02:06:47.554732+0000","last_peered":"2024-09-12T02:06:47.554732+0000","last_clean":"2024-09-12T02:06:47.554732+0000","last_became_active":"2024-09-12T00:09:59.317172+0000","last_became_peered":"2024-09-12T00:09:59.317172+0000","last_unstale":"2024-09-12T02:06:47.554732+0000","last_undegraded":"2024-09-12T02:06:47.554732+0000","last_fullsized":"2024-09-12T02:06:47.554732+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:24.166492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":79957,"num_write":1084,"num_write_kb":20693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.692067+0000","last_change":"2024-09-12T00:10:03.275174+0000","last_active":"2024-09-12T02:02:43.692067+0000","last_peered":"2024-09-12T02:02:43.692067+0000","last_clean":"2024-09-12T02:02:43.692067+0000","last_became_active":"2024-09-12T00:10:03.274519+0000","last_became_peered":"2024-09-12T00:10:03.274519+0000","last_unstale":"2024-09-12T02:02:43.692067+0000","last_undegraded":"2024-09-12T02:02:43.692067+0000","last_fullsized":"2024-09-12T02:02:43.692067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:46.889133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"266'397","reported_seq":2386,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.496951+0000","last_change":"2024-09-12T00:10:05.366148+0000","last_active":"2024-09-12T02:06:03.496951+0000","last_peered":"2024-09-12T02:06:03.496951+0000","last_clean":"2024-09-12T02:06:03.496951+0000","last_became_active":"2024-09-12T00:10:05.365417+0000","last_became_peered":"2024-09-12T00:10:05.365417+0000","last_unstale":"2024-09-12T02:06:03.496951+0000","last_undegraded":"2024-09-12T02:06:03.496951+0000","last_fullsized":"2024-09-12T02:06:03.496951+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:25.902387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":388,"num_read_kb":374,"num_write":387,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.537567+0000","last_change":"2024-09-12T00:10:07.322896+0000","last_active":"2024-09-12T02:04:43.537567+0000","last_peered":"2024-09-12T02:04:43.537567+0000","last_clean":"2024-09-12T02:04:43.537567+0000","last_became_active":"2024-09-12T00:10:07.319786+0000","last_became_peered":"2024-09-12T00:10:07.319786+0000","last_unstale":"2024-09-12T02:04:43.537567+0000","last_undegraded":"2024-09-12T02:04:43.537567+0000","last_fullsized":"2024-09-12T02:04:43.537567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:38.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"266'255","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.247959+0000","last_change":"2024-09-12T00:10:09.366267+0000","last_active":"2024-09-12T02:05:00.247959+0000","last_peered":"2024-09-12T02:05:00.247959+0000","last_clean":"2024-09-12T02:05:00.247959+0000","last_became_active":"2024-09-12T00:10:09.365558+0000","last_became_peered":"2024-09-12T00:10:09.365558+0000","last_unstale":"2024-09-12T02:05:00.247959+0000","last_undegraded":"2024-09-12T02:05:00.247959+0000","last_fullsized":"2024-09-12T02:05:00.247959+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:50.920683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":520,"num_write":557,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"266'478","reported_seq":2049,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708234+0000","last_change":"2024-09-12T00:10:01.257820+0000","last_active":"2024-09-12T02:04:38.708234+0000","last_peered":"2024-09-12T02:04:38.708234+0000","last_clean":"2024-09-12T02:04:38.708234+0000","last_became_active":"2024-09-12T00:10:01.256107+0000","last_became_peered":"2024-09-12T00:10:01.256107+0000","last_unstale":"2024-09-12T02:04:38.708234+0000","last_undegraded":"2024-09-12T02:04:38.708234+0000","last_fullsized":"2024-09-12T02:04:38.708234+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:11.113107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2517,"num_read_kb":2366,"num_write":564,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":567,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.713155+0000","last_change":"2024-09-12T02:06:54.713155+0000","last_active":"2024-09-12T02:06:54.713155+0000","last_peered":"2024-09-12T02:06:54.713155+0000","last_clean":"2024-09-12T02:06:54.713155+0000","last_became_active":"2024-09-12T00:09:46.161046+0000","last_became_peered":"2024-09-12T00:09:46.161046+0000","last_unstale":"2024-09-12T02:06:54.713155+0000","last_undegraded":"2024-09-12T02:06:54.713155+0000","last_fullsized":"2024-09-12T02:06:54.713155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:06:54.712965+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:06:54.712965+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.712965+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:06.136484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022130560000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"266'390","reported_seq":1053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.642552+0000","last_change":"2024-09-12T02:06:52.642552+0000","last_active":"2024-09-12T02:06:52.642552+0000","last_peered":"2024-09-12T02:06:52.642552+0000","last_clean":"2024-09-12T02:06:52.642552+0000","last_became_active":"2024-09-12T00:10:31.473891+0000","last_became_peered":"2024-09-12T00:10:31.473891+0000","last_unstale":"2024-09-12T02:06:52.642552+0000","last_undegraded":"2024-09-12T02:06:52.642552+0000","last_fullsized":"2024-09-12T02:06:52.642552+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:06:52.642445+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:06:52.642445+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.642445+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:58.116732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1728219,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":35036,"num_write":1225,"num_write_kb":35348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.724461+0000","last_change":"2024-09-12T00:10:03.265946+0000","last_active":"2024-09-12T02:03:03.724461+0000","last_peered":"2024-09-12T02:03:03.724461+0000","last_clean":"2024-09-12T02:03:03.724461+0000","last_became_active":"2024-09-12T00:10:03.264991+0000","last_became_peered":"2024-09-12T00:10:03.264991+0000","last_unstale":"2024-09-12T02:03:03.724461+0000","last_undegraded":"2024-09-12T02:03:03.724461+0000","last_fullsized":"2024-09-12T02:03:03.724461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:41.880299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"266'207","reported_seq":818,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.945244+0000","last_change":"2024-09-12T00:10:05.287107+0000","last_active":"2024-09-12T02:06:03.945244+0000","last_peered":"2024-09-12T02:06:03.945244+0000","last_clean":"2024-09-12T02:06:03.945244+0000","last_became_active":"2024-09-12T00:10:05.286433+0000","last_became_peered":"2024-09-12T00:10:05.286433+0000","last_unstale":"2024-09-12T02:06:03.945244+0000","last_undegraded":"2024-09-12T02:06:03.945244+0000","last_fullsized":"2024-09-12T02:06:03.945244+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:16.708268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":276,"num_read_kb":269,"num_write":202,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:48.705489+0000","last_change":"2024-09-12T00:10:07.331079+0000","last_active":"2024-09-12T02:02:48.705489+0000","last_peered":"2024-09-12T02:02:48.705489+0000","last_clean":"2024-09-12T02:02:48.705489+0000","last_became_active":"2024-09-12T00:10:07.329823+0000","last_became_peered":"2024-09-12T00:10:07.329823+0000","last_unstale":"2024-09-12T02:02:48.705489+0000","last_undegraded":"2024-09-12T02:02:48.705489+0000","last_fullsized":"2024-09-12T02:02:48.705489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:01.018430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"266'101","reported_seq":681,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.757399+0000","last_change":"2024-09-12T00:10:09.368892+0000","last_active":"2024-09-12T02:04:59.757399+0000","last_peered":"2024-09-12T02:04:59.757399+0000","last_clean":"2024-09-12T02:04:59.757399+0000","last_became_active":"2024-09-12T00:10:09.368176+0000","last_became_peered":"2024-09-12T00:10:09.368176+0000","last_unstale":"2024-09-12T02:04:59.757399+0000","last_undegraded":"2024-09-12T02:04:59.757399+0000","last_fullsized":"2024-09-12T02:04:59.757399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:23.692773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":222,"num_read_kb":212,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"266'444","reported_seq":2071,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708133+0000","last_change":"2024-09-12T00:10:01.276074+0000","last_active":"2024-09-12T02:04:38.708133+0000","last_peered":"2024-09-12T02:04:38.708133+0000","last_clean":"2024-09-12T02:04:38.708133+0000","last_became_active":"2024-09-12T00:10:01.275794+0000","last_became_peered":"2024-09-12T00:10:01.275794+0000","last_unstale":"2024-09-12T02:04:38.708133+0000","last_undegraded":"2024-09-12T02:04:38.708133+0000","last_fullsized":"2024-09-12T02:04:38.708133+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:44.490041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":509,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"266'358","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.538166+0000","last_change":"2024-09-12T00:09:59.264987+0000","last_active":"2024-09-12T02:06:47.538166+0000","last_peered":"2024-09-12T02:06:47.538166+0000","last_clean":"2024-09-12T02:06:47.538166+0000","last_became_active":"2024-09-12T00:09:59.262793+0000","last_became_peered":"2024-09-12T00:09:59.262793+0000","last_unstale":"2024-09-12T02:06:47.538166+0000","last_undegraded":"2024-09-12T02:06:47.538166+0000","last_fullsized":"2024-09-12T02:06:47.538166+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1952053,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":559,"num_read_kb":23144,"num_write":1133,"num_write_kb":26459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":560,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.602572+0000","last_change":"2024-09-12T02:06:52.602572+0000","last_active":"2024-09-12T02:06:52.602572+0000","last_peered":"2024-09-12T02:06:52.602572+0000","last_clean":"2024-09-12T02:06:52.602572+0000","last_became_active":"2024-09-12T00:09:46.178541+0000","last_became_peered":"2024-09-12T00:09:46.178541+0000","last_unstale":"2024-09-12T02:06:52.602572+0000","last_undegraded":"2024-09-12T02:06:52.602572+0000","last_fullsized":"2024-09-12T02:06:52.602572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:52.602473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:52.602473+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.602473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:51.748160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00107328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536250+0000","last_change":"2024-09-12T00:10:03.258979+0000","last_active":"2024-09-12T02:04:38.536250+0000","last_peered":"2024-09-12T02:04:38.536250+0000","last_clean":"2024-09-12T02:04:38.536250+0000","last_became_active":"2024-09-12T00:10:03.258209+0000","last_became_peered":"2024-09-12T00:10:03.258209+0000","last_unstale":"2024-09-12T02:04:38.536250+0000","last_undegraded":"2024-09-12T02:04:38.536250+0000","last_fullsized":"2024-09-12T02:04:38.536250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:09.760649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"266'731","reported_seq":1480,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.734931+0000","last_change":"2024-09-12T00:10:05.292028+0000","last_active":"2024-09-12T02:06:46.734931+0000","last_peered":"2024-09-12T02:06:46.734931+0000","last_clean":"2024-09-12T02:06:46.734931+0000","last_became_active":"2024-09-12T00:10:05.289058+0000","last_became_peered":"2024-09-12T00:10:05.289058+0000","last_unstale":"2024-09-12T02:06:46.734931+0000","last_undegraded":"2024-09-12T02:06:46.734931+0000","last_fullsized":"2024-09-12T02:06:46.734931+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:22.158935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92166,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1168,"num_read_kb":2300,"num_write":1050,"num_write_kb":783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.762388+0000","last_change":"2024-09-12T00:10:07.327012+0000","last_active":"2024-09-12T02:04:43.762388+0000","last_peered":"2024-09-12T02:04:43.762388+0000","last_clean":"2024-09-12T02:04:43.762388+0000","last_became_active":"2024-09-12T00:10:07.326146+0000","last_became_peered":"2024-09-12T00:10:07.326146+0000","last_unstale":"2024-09-12T02:04:43.762388+0000","last_undegraded":"2024-09-12T02:04:43.762388+0000","last_fullsized":"2024-09-12T02:04:43.762388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:31.757093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"266'134","reported_seq":658,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.013228+0000","last_change":"2024-09-12T00:10:09.434271+0000","last_active":"2024-09-12T02:04:59.013228+0000","last_peered":"2024-09-12T02:04:59.013228+0000","last_clean":"2024-09-12T02:04:59.013228+0000","last_became_active":"2024-09-12T00:10:09.433444+0000","last_became_peered":"2024-09-12T00:10:09.433444+0000","last_unstale":"2024-09-12T02:04:59.013228+0000","last_undegraded":"2024-09-12T02:04:59.013228+0000","last_fullsized":"2024-09-12T02:04:59.013228+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:56.732745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"266'402","reported_seq":1906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536207+0000","last_change":"2024-09-12T00:10:01.282757+0000","last_active":"2024-09-12T02:04:38.536207+0000","last_peered":"2024-09-12T02:04:38.536207+0000","last_clean":"2024-09-12T02:04:38.536207+0000","last_became_active":"2024-09-12T00:10:01.282373+0000","last_became_peered":"2024-09-12T00:10:01.282373+0000","last_unstale":"2024-09-12T02:04:38.536207+0000","last_undegraded":"2024-09-12T02:04:38.536207+0000","last_fullsized":"2024-09-12T02:04:38.536207+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:40.586380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2068,"num_read_kb":1970,"num_write":460,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"266'417","reported_seq":1197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.490091+0000","last_change":"2024-09-12T00:09:59.251699+0000","last_active":"2024-09-12T02:06:47.490091+0000","last_peered":"2024-09-12T02:06:47.490091+0000","last_clean":"2024-09-12T02:06:47.490091+0000","last_became_active":"2024-09-12T00:09:59.251235+0000","last_became_peered":"2024-09-12T00:09:59.251235+0000","last_unstale":"2024-09-12T02:06:47.490091+0000","last_undegraded":"2024-09-12T02:06:47.490091+0000","last_fullsized":"2024-09-12T02:06:47.490091+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:43.287785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":866,"num_read_kb":78676,"num_write":1275,"num_write_kb":36022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.759885+0000","last_change":"2024-09-12T00:09:48.283460+0000","last_active":"2024-09-12T02:04:48.759885+0000","last_peered":"2024-09-12T02:04:48.759885+0000","last_clean":"2024-09-12T02:04:48.759885+0000","last_became_active":"2024-09-12T00:09:46.177603+0000","last_became_peered":"2024-09-12T00:09:46.177603+0000","last_unstale":"2024-09-12T02:04:48.759885+0000","last_undegraded":"2024-09-12T02:04:48.759885+0000","last_fullsized":"2024-09-12T02:04:48.759885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:26.898658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729177+0000","last_change":"2024-09-12T00:10:03.259727+0000","last_active":"2024-09-12T02:04:38.729177+0000","last_peered":"2024-09-12T02:04:38.729177+0000","last_clean":"2024-09-12T02:04:38.729177+0000","last_became_active":"2024-09-12T00:10:03.258944+0000","last_became_peered":"2024-09-12T00:10:03.258944+0000","last_unstale":"2024-09-12T02:04:38.729177+0000","last_undegraded":"2024-09-12T02:04:38.729177+0000","last_fullsized":"2024-09-12T02:04:38.729177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:58.686752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"266'257","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709373+0000","last_change":"2024-09-12T00:10:05.367281+0000","last_active":"2024-09-12T02:04:43.709373+0000","last_peered":"2024-09-12T02:04:43.709373+0000","last_clean":"2024-09-12T02:04:43.709373+0000","last_became_active":"2024-09-12T00:10:05.366757+0000","last_became_peered":"2024-09-12T00:10:05.366757+0000","last_unstale":"2024-09-12T02:04:43.709373+0000","last_undegraded":"2024-09-12T02:04:43.709373+0000","last_fullsized":"2024-09-12T02:04:43.709373+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:45.057953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":341,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"266'827","reported_seq":5675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.342888+0000","last_change":"2024-09-12T00:10:07.314520+0000","last_active":"2024-09-12T02:06:46.342888+0000","last_peered":"2024-09-12T02:06:46.342888+0000","last_clean":"2024-09-12T02:06:46.342888+0000","last_became_active":"2024-09-12T00:10:07.313773+0000","last_became_peered":"2024-09-12T00:10:07.313773+0000","last_unstale":"2024-09-12T02:06:46.342888+0000","last_undegraded":"2024-09-12T02:06:46.342888+0000","last_fullsized":"2024-09-12T02:06:46.342888+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:32.654308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"266'129","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.986570+0000","last_change":"2024-09-12T00:10:09.431402+0000","last_active":"2024-09-12T02:05:08.986570+0000","last_peered":"2024-09-12T02:05:08.986570+0000","last_clean":"2024-09-12T02:05:08.986570+0000","last_became_active":"2024-09-12T00:10:09.430396+0000","last_became_peered":"2024-09-12T00:10:09.430396+0000","last_unstale":"2024-09-12T02:05:08.986570+0000","last_undegraded":"2024-09-12T02:05:08.986570+0000","last_fullsized":"2024-09-12T02:05:08.986570+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:54.666346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"266'481","reported_seq":2194,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.725448+0000","last_change":"2024-09-12T00:10:01.261429+0000","last_active":"2024-09-12T02:04:59.725448+0000","last_peered":"2024-09-12T02:04:59.725448+0000","last_clean":"2024-09-12T02:04:59.725448+0000","last_became_active":"2024-09-12T00:10:01.261139+0000","last_became_peered":"2024-09-12T00:10:01.261139+0000","last_unstale":"2024-09-12T02:04:59.725448+0000","last_undegraded":"2024-09-12T02:04:59.725448+0000","last_fullsized":"2024-09-12T02:04:59.725448+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:23.775837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2740,"num_read_kb":2607,"num_write":578,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"266'402","reported_seq":1218,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.867885+0000","last_change":"2024-09-12T02:06:53.867885+0000","last_active":"2024-09-12T02:06:53.867885+0000","last_peered":"2024-09-12T02:06:53.867885+0000","last_clean":"2024-09-12T02:06:53.867885+0000","last_became_active":"2024-09-12T00:09:59.280008+0000","last_became_peered":"2024-09-12T00:09:59.280008+0000","last_unstale":"2024-09-12T02:06:53.867885+0000","last_undegraded":"2024-09-12T02:06:53.867885+0000","last_fullsized":"2024-09-12T02:06:53.867885+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'402","last_scrub_stamp":"2024-09-12T02:06:53.867624+0000","last_deep_scrub":"266'402","last_deep_scrub_stamp":"2024-09-12T02:06:53.867624+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.867624+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:13.357536+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137185,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":708,"num_read_kb":14008,"num_write":1294,"num_write_kb":38960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.553213+0000","last_change":"2024-09-12T02:06:53.553213+0000","last_active":"2024-09-12T02:06:53.553213+0000","last_peered":"2024-09-12T02:06:53.553213+0000","last_clean":"2024-09-12T02:06:53.553213+0000","last_became_active":"2024-09-12T00:09:46.162309+0000","last_became_peered":"2024-09-12T00:09:46.162309+0000","last_unstale":"2024-09-12T02:06:53.553213+0000","last_undegraded":"2024-09-12T02:06:53.553213+0000","last_fullsized":"2024-09-12T02:06:53.553213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:53.553124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:53.553124+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.553124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:47.235429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010860449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.761245+0000","last_change":"2024-09-12T00:10:03.257249+0000","last_active":"2024-09-12T02:04:38.761245+0000","last_peered":"2024-09-12T02:04:38.761245+0000","last_clean":"2024-09-12T02:04:38.761245+0000","last_became_active":"2024-09-12T00:10:03.256290+0000","last_became_peered":"2024-09-12T00:10:03.256290+0000","last_unstale":"2024-09-12T02:04:38.761245+0000","last_undegraded":"2024-09-12T02:04:38.761245+0000","last_fullsized":"2024-09-12T02:04:38.761245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:00.212778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"266'177","reported_seq":785,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.762472+0000","last_change":"2024-09-12T00:10:05.294735+0000","last_active":"2024-09-12T02:04:43.762472+0000","last_peered":"2024-09-12T02:04:43.762472+0000","last_clean":"2024-09-12T02:04:43.762472+0000","last_became_active":"2024-09-12T00:10:05.293955+0000","last_became_peered":"2024-09-12T00:10:05.293955+0000","last_unstale":"2024-09-12T02:04:43.762472+0000","last_undegraded":"2024-09-12T02:04:43.762472+0000","last_fullsized":"2024-09-12T02:04:43.762472+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:54.115604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":227,"num_write":154,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"266'827","reported_seq":5158,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.575460+0000","last_change":"2024-09-12T00:10:07.334366+0000","last_active":"2024-09-12T02:06:47.575460+0000","last_peered":"2024-09-12T02:06:47.575460+0000","last_clean":"2024-09-12T02:06:47.575460+0000","last_became_active":"2024-09-12T00:10:07.333642+0000","last_became_peered":"2024-09-12T00:10:07.333642+0000","last_unstale":"2024-09-12T02:06:47.575460+0000","last_undegraded":"2024-09-12T02:06:47.575460+0000","last_fullsized":"2024-09-12T02:06:47.575460+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:25.710728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"266'301","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718365+0000","last_change":"2024-09-12T00:10:09.359415+0000","last_active":"2024-09-12T02:02:38.718365+0000","last_peered":"2024-09-12T02:02:38.718365+0000","last_clean":"2024-09-12T02:02:38.718365+0000","last_became_active":"2024-09-12T00:10:09.358708+0000","last_became_peered":"2024-09-12T00:10:09.358708+0000","last_unstale":"2024-09-12T02:02:38.718365+0000","last_undegraded":"2024-09-12T02:02:38.718365+0000","last_fullsized":"2024-09-12T02:02:38.718365+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:01.334064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":399,"num_read_kb":387,"num_write":681,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"266'1115","reported_seq":2647,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.761286+0000","last_change":"2024-09-12T00:10:01.274977+0000","last_active":"2024-09-12T02:04:38.761286+0000","last_peered":"2024-09-12T02:04:38.761286+0000","last_clean":"2024-09-12T02:04:38.761286+0000","last_became_active":"2024-09-12T00:10:01.274310+0000","last_became_peered":"2024-09-12T00:10:01.274310+0000","last_unstale":"2024-09-12T02:04:38.761286+0000","last_undegraded":"2024-09-12T02:04:38.761286+0000","last_fullsized":"2024-09-12T02:04:38.761286+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:46.070135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5066,"num_read_kb":4471,"num_write":1537,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"266'372","reported_seq":1076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.492480+0000","last_change":"2024-09-12T02:06:52.492480+0000","last_active":"2024-09-12T02:06:52.492480+0000","last_peered":"2024-09-12T02:06:52.492480+0000","last_clean":"2024-09-12T02:06:52.492480+0000","last_became_active":"2024-09-12T00:09:59.291630+0000","last_became_peered":"2024-09-12T00:09:59.291630+0000","last_unstale":"2024-09-12T02:06:52.492480+0000","last_undegraded":"2024-09-12T02:06:52.492480+0000","last_fullsized":"2024-09-12T02:06:52.492480+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'372","last_scrub_stamp":"2024-09-12T02:06:52.492329+0000","last_deep_scrub":"266'372","last_deep_scrub_stamp":"2024-09-12T02:06:52.492329+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.492329+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.589627+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306724,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":13946,"num_write":1174,"num_write_kb":43869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":553,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729253+0000","last_change":"2024-09-12T00:09:48.181937+0000","last_active":"2024-09-12T02:04:38.729253+0000","last_peered":"2024-09-12T02:04:38.729253+0000","last_clean":"2024-09-12T02:04:38.729253+0000","last_became_active":"2024-09-12T00:09:46.163643+0000","last_became_peered":"2024-09-12T00:09:46.163643+0000","last_unstale":"2024-09-12T02:04:38.729253+0000","last_undegraded":"2024-09-12T02:04:38.729253+0000","last_fullsized":"2024-09-12T02:04:38.729253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:45.135664+0000","last_clean_scrub_stamp":"2024-09-12T00:09:45.135664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:23.976934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095304600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.973403+0000","last_change":"2024-09-12T00:10:03.265795+0000","last_active":"2024-09-12T02:04:18.973403+0000","last_peered":"2024-09-12T02:04:18.973403+0000","last_clean":"2024-09-12T02:04:18.973403+0000","last_became_active":"2024-09-12T00:10:03.265087+0000","last_became_peered":"2024-09-12T00:10:03.265087+0000","last_unstale":"2024-09-12T02:04:18.973403+0000","last_undegraded":"2024-09-12T02:04:18.973403+0000","last_fullsized":"2024-09-12T02:04:18.973403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:19.906488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"266'829","reported_seq":1619,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.017176+0000","last_change":"2024-09-12T00:10:05.362216+0000","last_active":"2024-09-12T02:06:47.017176+0000","last_peered":"2024-09-12T02:06:47.017176+0000","last_clean":"2024-09-12T02:06:47.017176+0000","last_became_active":"2024-09-12T00:10:05.361458+0000","last_became_peered":"2024-09-12T00:10:05.361458+0000","last_unstale":"2024-09-12T02:06:47.017176+0000","last_undegraded":"2024-09-12T02:06:47.017176+0000","last_fullsized":"2024-09-12T02:06:47.017176+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:05.415919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1463,"num_read_kb":3339,"num_write":1180,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.980217+0000","last_change":"2024-09-12T00:10:07.341062+0000","last_active":"2024-09-12T02:04:43.980217+0000","last_peered":"2024-09-12T02:04:43.980217+0000","last_clean":"2024-09-12T02:04:43.980217+0000","last_became_active":"2024-09-12T00:10:07.333984+0000","last_became_peered":"2024-09-12T00:10:07.333984+0000","last_unstale":"2024-09-12T02:04:43.980217+0000","last_undegraded":"2024-09-12T02:04:43.980217+0000","last_fullsized":"2024-09-12T02:04:43.980217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:04.270793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"266'123","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725287+0000","last_change":"2024-09-12T00:10:09.369672+0000","last_active":"2024-09-12T02:02:39.725287+0000","last_peered":"2024-09-12T02:02:39.725287+0000","last_clean":"2024-09-12T02:02:39.725287+0000","last_became_active":"2024-09-12T00:10:09.368289+0000","last_became_peered":"2024-09-12T00:10:09.368289+0000","last_unstale":"2024-09-12T02:02:39.725287+0000","last_undegraded":"2024-09-12T02:02:39.725287+0000","last_fullsized":"2024-09-12T02:02:39.725287+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:07.697855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"266'155","reported_seq":743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.414654+0000","last_change":"2024-09-12T00:10:09.373153+0000","last_active":"2024-09-12T02:05:00.414654+0000","last_peered":"2024-09-12T02:05:00.414654+0000","last_clean":"2024-09-12T02:05:00.414654+0000","last_became_active":"2024-09-12T00:10:09.372467+0000","last_became_peered":"2024-09-12T00:10:09.372467+0000","last_unstale":"2024-09-12T02:05:00.414654+0000","last_undegraded":"2024-09-12T02:05:00.414654+0000","last_fullsized":"2024-09-12T02:05:00.414654+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:35.985971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":220,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"266'886","reported_seq":2695,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.724639+0000","last_change":"2024-09-12T00:10:01.267707+0000","last_active":"2024-09-12T02:06:05.724639+0000","last_peered":"2024-09-12T02:06:05.724639+0000","last_clean":"2024-09-12T02:06:05.724639+0000","last_became_active":"2024-09-12T00:10:01.266479+0000","last_became_peered":"2024-09-12T00:10:01.266479+0000","last_unstale":"2024-09-12T02:06:05.724639+0000","last_undegraded":"2024-09-12T02:06:05.724639+0000","last_fullsized":"2024-09-12T02:06:05.724639+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:27.980168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4439,"num_read_kb":4016,"num_write":1172,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"266'328","reported_seq":1068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.526748+0000","last_change":"2024-09-12T00:09:59.311766+0000","last_active":"2024-09-12T02:06:47.526748+0000","last_peered":"2024-09-12T02:06:47.526748+0000","last_clean":"2024-09-12T02:06:47.526748+0000","last_became_active":"2024-09-12T00:09:59.309979+0000","last_became_peered":"2024-09-12T00:09:59.309979+0000","last_unstale":"2024-09-12T02:06:47.526748+0000","last_undegraded":"2024-09-12T02:06:47.526748+0000","last_fullsized":"2024-09-12T02:06:47.526748+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:48.006276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":761,"num_read_kb":10875,"num_write":997,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.704615+0000","last_change":"2024-09-12T00:10:03.273557+0000","last_active":"2024-09-12T02:04:23.704615+0000","last_peered":"2024-09-12T02:04:23.704615+0000","last_clean":"2024-09-12T02:04:23.704615+0000","last_became_active":"2024-09-12T00:10:03.272547+0000","last_became_peered":"2024-09-12T00:10:03.272547+0000","last_unstale":"2024-09-12T02:04:23.704615+0000","last_undegraded":"2024-09-12T02:04:23.704615+0000","last_fullsized":"2024-09-12T02:04:23.704615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:14.979796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"266'331","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.484598+0000","last_change":"2024-09-12T00:10:05.293284+0000","last_active":"2024-09-12T02:06:47.484598+0000","last_peered":"2024-09-12T02:06:47.484598+0000","last_clean":"2024-09-12T02:06:47.484598+0000","last_became_active":"2024-09-12T00:10:05.292446+0000","last_became_peered":"2024-09-12T00:10:05.292446+0000","last_unstale":"2024-09-12T02:06:47.484598+0000","last_undegraded":"2024-09-12T02:06:47.484598+0000","last_fullsized":"2024-09-12T02:06:47.484598+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16245,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1009,"num_write":400,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976129+0000","last_change":"2024-09-12T00:10:07.339677+0000","last_active":"2024-09-12T02:04:28.976129+0000","last_peered":"2024-09-12T02:04:28.976129+0000","last_clean":"2024-09-12T02:04:28.976129+0000","last_became_active":"2024-09-12T00:10:07.335659+0000","last_became_peered":"2024-09-12T00:10:07.335659+0000","last_unstale":"2024-09-12T02:04:28.976129+0000","last_undegraded":"2024-09-12T02:04:28.976129+0000","last_fullsized":"2024-09-12T02:04:28.976129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:04.120142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"266'115","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.231862+0000","last_change":"2024-09-12T00:10:09.357232+0000","last_active":"2024-09-12T02:05:00.231862+0000","last_peered":"2024-09-12T02:05:00.231862+0000","last_clean":"2024-09-12T02:05:00.231862+0000","last_became_active":"2024-09-12T00:10:09.356043+0000","last_became_peered":"2024-09-12T00:10:09.356043+0000","last_unstale":"2024-09-12T02:05:00.231862+0000","last_undegraded":"2024-09-12T02:05:00.231862+0000","last_fullsized":"2024-09-12T02:05:00.231862+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:08.121957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":102,"num_write":274,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"266'481","reported_seq":2035,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.932083+0000","last_change":"2024-09-12T00:10:01.265349+0000","last_active":"2024-09-12T02:04:59.932083+0000","last_peered":"2024-09-12T02:04:59.932083+0000","last_clean":"2024-09-12T02:04:59.932083+0000","last_became_active":"2024-09-12T00:10:01.264977+0000","last_became_peered":"2024-09-12T00:10:01.264977+0000","last_unstale":"2024-09-12T02:04:59.932083+0000","last_undegraded":"2024-09-12T02:04:59.932083+0000","last_fullsized":"2024-09-12T02:04:59.932083+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:01.657689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2306,"num_write":570,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"266'380","reported_seq":1015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.464304+0000","last_change":"2024-09-12T00:09:59.300779+0000","last_active":"2024-09-12T02:06:47.464304+0000","last_peered":"2024-09-12T02:06:47.464304+0000","last_clean":"2024-09-12T02:06:47.464304+0000","last_became_active":"2024-09-12T00:09:59.300181+0000","last_became_peered":"2024-09-12T00:09:59.300181+0000","last_unstale":"2024-09-12T02:06:47.464304+0000","last_undegraded":"2024-09-12T02:06:47.464304+0000","last_fullsized":"2024-09-12T02:06:47.464304+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:30.518468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":10768,"num_write":1216,"num_write_kb":35109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.975027+0000","last_change":"2024-09-12T00:10:03.256755+0000","last_active":"2024-09-12T02:04:23.975027+0000","last_peered":"2024-09-12T02:04:23.975027+0000","last_clean":"2024-09-12T02:04:23.975027+0000","last_became_active":"2024-09-12T00:10:03.256053+0000","last_became_peered":"2024-09-12T00:10:03.256053+0000","last_unstale":"2024-09-12T02:04:23.975027+0000","last_undegraded":"2024-09-12T02:04:23.975027+0000","last_fullsized":"2024-09-12T02:04:23.975027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:53.915837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"266'74","reported_seq":615,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.954859+0000","last_change":"2024-09-12T00:10:05.289328+0000","last_active":"2024-09-12T02:04:59.954859+0000","last_peered":"2024-09-12T02:04:59.954859+0000","last_clean":"2024-09-12T02:04:59.954859+0000","last_became_active":"2024-09-12T00:10:05.288688+0000","last_became_peered":"2024-09-12T00:10:05.288688+0000","last_unstale":"2024-09-12T02:04:59.954859+0000","last_undegraded":"2024-09-12T02:04:59.954859+0000","last_fullsized":"2024-09-12T02:04:59.954859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.509523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.754653+0000","last_change":"2024-09-12T00:10:07.321379+0000","last_active":"2024-09-12T02:04:28.754653+0000","last_peered":"2024-09-12T02:04:28.754653+0000","last_clean":"2024-09-12T02:04:28.754653+0000","last_became_active":"2024-09-12T00:10:07.320729+0000","last_became_peered":"2024-09-12T00:10:07.320729+0000","last_unstale":"2024-09-12T02:04:28.754653+0000","last_undegraded":"2024-09-12T02:04:28.754653+0000","last_fullsized":"2024-09-12T02:04:28.754653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:20.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"266'204","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.570680+0000","last_change":"2024-09-12T00:10:09.362996+0000","last_active":"2024-09-12T02:04:57.570680+0000","last_peered":"2024-09-12T02:04:57.570680+0000","last_clean":"2024-09-12T02:04:57.570680+0000","last_became_active":"2024-09-12T00:10:09.362096+0000","last_became_peered":"2024-09-12T00:10:09.362096+0000","last_unstale":"2024-09-12T02:04:57.570680+0000","last_undegraded":"2024-09-12T02:04:57.570680+0000","last_fullsized":"2024-09-12T02:04:57.570680+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:36.489316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":296,"num_read_kb":291,"num_write":467,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"266'430","reported_seq":2143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.720489+0000","last_change":"2024-09-12T00:10:01.261417+0000","last_active":"2024-09-12T02:06:05.720489+0000","last_peered":"2024-09-12T02:06:05.720489+0000","last_clean":"2024-09-12T02:06:05.720489+0000","last_became_active":"2024-09-12T00:10:01.261030+0000","last_became_peered":"2024-09-12T00:10:01.261030+0000","last_unstale":"2024-09-12T02:06:05.720489+0000","last_undegraded":"2024-09-12T02:06:05.720489+0000","last_fullsized":"2024-09-12T02:06:05.720489+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:45.394167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2550,"num_read_kb":2440,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"266'384","reported_seq":1078,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.518396+0000","last_change":"2024-09-12T00:09:59.288987+0000","last_active":"2024-09-12T02:06:47.518396+0000","last_peered":"2024-09-12T02:06:47.518396+0000","last_clean":"2024-09-12T02:06:47.518396+0000","last_became_active":"2024-09-12T00:09:59.288100+0000","last_became_peered":"2024-09-12T00:09:59.288100+0000","last_unstale":"2024-09-12T02:06:47.518396+0000","last_undegraded":"2024-09-12T02:06:47.518396+0000","last_fullsized":"2024-09-12T02:06:47.518396+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:51.350979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":599,"num_read_kb":15869,"num_write":1177,"num_write_kb":23659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753274+0000","last_change":"2024-09-12T00:10:03.257101+0000","last_active":"2024-09-12T02:04:23.753274+0000","last_peered":"2024-09-12T02:04:23.753274+0000","last_clean":"2024-09-12T02:04:23.753274+0000","last_became_active":"2024-09-12T00:10:03.255669+0000","last_became_peered":"2024-09-12T00:10:03.255669+0000","last_unstale":"2024-09-12T02:04:23.753274+0000","last_undegraded":"2024-09-12T02:04:23.753274+0000","last_fullsized":"2024-09-12T02:04:23.753274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:32.002572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"266'345","reported_seq":991,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.573156+0000","last_change":"2024-09-12T00:10:05.300654+0000","last_active":"2024-09-12T02:06:46.573156+0000","last_peered":"2024-09-12T02:06:46.573156+0000","last_clean":"2024-09-12T02:06:46.573156+0000","last_became_active":"2024-09-12T00:10:05.299730+0000","last_became_peered":"2024-09-12T00:10:05.299730+0000","last_unstale":"2024-09-12T02:06:46.573156+0000","last_undegraded":"2024-09-12T02:06:46.573156+0000","last_fullsized":"2024-09-12T02:06:46.573156+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:30.946739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58900,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1109,"num_write":428,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.727089+0000","last_change":"2024-09-12T00:10:07.330541+0000","last_active":"2024-09-12T02:04:28.727089+0000","last_peered":"2024-09-12T02:04:28.727089+0000","last_clean":"2024-09-12T02:04:28.727089+0000","last_became_active":"2024-09-12T00:10:07.329741+0000","last_became_peered":"2024-09-12T00:10:07.329741+0000","last_unstale":"2024-09-12T02:04:28.727089+0000","last_undegraded":"2024-09-12T02:04:28.727089+0000","last_fullsized":"2024-09-12T02:04:28.727089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:23.412449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"266'89","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725178+0000","last_change":"2024-09-12T00:10:09.372894+0000","last_active":"2024-09-12T02:02:39.725178+0000","last_peered":"2024-09-12T02:02:39.725178+0000","last_clean":"2024-09-12T02:02:39.725178+0000","last_became_active":"2024-09-12T00:10:09.371755+0000","last_became_peered":"2024-09-12T00:10:09.371755+0000","last_unstale":"2024-09-12T02:02:39.725178+0000","last_undegraded":"2024-09-12T02:02:39.725178+0000","last_fullsized":"2024-09-12T02:02:39.725178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:18.332494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":213,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"266'805","reported_seq":2435,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974707+0000","last_change":"2024-09-12T00:10:01.259175+0000","last_active":"2024-09-12T02:04:23.974707+0000","last_peered":"2024-09-12T02:04:23.974707+0000","last_clean":"2024-09-12T02:04:23.974707+0000","last_became_active":"2024-09-12T00:10:01.258814+0000","last_became_peered":"2024-09-12T00:10:01.258814+0000","last_unstale":"2024-09-12T02:04:23.974707+0000","last_undegraded":"2024-09-12T02:04:23.974707+0000","last_fullsized":"2024-09-12T02:04:23.974707+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:34.228716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3906,"num_read_kb":3532,"num_write":1046,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"266'415","reported_seq":1079,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.547826+0000","last_change":"2024-09-12T00:09:59.263146+0000","last_active":"2024-09-12T02:06:47.547826+0000","last_peered":"2024-09-12T02:06:47.547826+0000","last_clean":"2024-09-12T02:06:47.547826+0000","last_became_active":"2024-09-12T00:09:59.262775+0000","last_became_peered":"2024-09-12T00:09:59.262775+0000","last_unstale":"2024-09-12T02:06:47.547826+0000","last_undegraded":"2024-09-12T02:06:47.547826+0000","last_fullsized":"2024-09-12T02:06:47.547826+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:27.798550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":557,"num_read_kb":527,"num_write":1329,"num_write_kb":18885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.725899+0000","last_change":"2024-09-12T00:10:03.258677+0000","last_active":"2024-09-12T02:04:23.725899+0000","last_peered":"2024-09-12T02:04:23.725899+0000","last_clean":"2024-09-12T02:04:23.725899+0000","last_became_active":"2024-09-12T00:10:03.257953+0000","last_became_peered":"2024-09-12T00:10:03.257953+0000","last_unstale":"2024-09-12T02:04:23.725899+0000","last_undegraded":"2024-09-12T02:04:23.725899+0000","last_fullsized":"2024-09-12T02:04:23.725899+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:23.465779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"266'327","reported_seq":941,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.290038+0000","last_change":"2024-09-12T00:10:05.286232+0000","last_active":"2024-09-12T02:06:46.290038+0000","last_peered":"2024-09-12T02:06:46.290038+0000","last_clean":"2024-09-12T02:06:46.290038+0000","last_became_active":"2024-09-12T00:10:05.285485+0000","last_became_peered":"2024-09-12T00:10:05.285485+0000","last_unstale":"2024-09-12T02:06:46.290038+0000","last_undegraded":"2024-09-12T02:06:46.290038+0000","last_fullsized":"2024-09-12T02:06:46.290038+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:50.842485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":1250,"num_write":446,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.533657+0000","last_change":"2024-09-12T00:10:07.326257+0000","last_active":"2024-09-12T02:04:28.533657+0000","last_peered":"2024-09-12T02:04:28.533657+0000","last_clean":"2024-09-12T02:04:28.533657+0000","last_became_active":"2024-09-12T00:10:07.325482+0000","last_became_peered":"2024-09-12T00:10:07.325482+0000","last_unstale":"2024-09-12T02:04:28.533657+0000","last_undegraded":"2024-09-12T02:04:28.533657+0000","last_fullsized":"2024-09-12T02:04:28.533657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:27.852281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"266'839","reported_seq":2400,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729315+0000","last_change":"2024-09-12T00:10:01.277544+0000","last_active":"2024-09-12T02:04:38.729315+0000","last_peered":"2024-09-12T02:04:38.729315+0000","last_clean":"2024-09-12T02:04:38.729315+0000","last_became_active":"2024-09-12T00:10:01.276906+0000","last_became_peered":"2024-09-12T00:10:01.276906+0000","last_unstale":"2024-09-12T02:04:38.729315+0000","last_undegraded":"2024-09-12T02:04:38.729315+0000","last_fullsized":"2024-09-12T02:04:38.729315+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:55.926406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3919,"num_read_kb":3507,"num_write":1092,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"266'321","reported_seq":995,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.517577+0000","last_change":"2024-09-12T00:09:59.249092+0000","last_active":"2024-09-12T02:06:47.517577+0000","last_peered":"2024-09-12T02:06:47.517577+0000","last_clean":"2024-09-12T02:06:47.517577+0000","last_became_active":"2024-09-12T00:09:59.248681+0000","last_became_peered":"2024-09-12T00:09:59.248681+0000","last_unstale":"2024-09-12T02:06:47.517577+0000","last_undegraded":"2024-09-12T02:06:47.517577+0000","last_fullsized":"2024-09-12T02:06:47.517577+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:44.662803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1398999,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":23744,"num_write":1111,"num_write_kb":29955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.536376+0000","last_change":"2024-09-12T00:10:03.261107+0000","last_active":"2024-09-12T02:04:38.536376+0000","last_peered":"2024-09-12T02:04:38.536376+0000","last_clean":"2024-09-12T02:04:38.536376+0000","last_became_active":"2024-09-12T00:10:03.260387+0000","last_became_peered":"2024-09-12T00:10:03.260387+0000","last_unstale":"2024-09-12T02:04:38.536376+0000","last_undegraded":"2024-09-12T02:04:38.536376+0000","last_fullsized":"2024-09-12T02:04:38.536376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:53.966697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"266'542","reported_seq":1220,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.173354+0000","last_change":"2024-09-12T00:10:05.301383+0000","last_active":"2024-09-12T02:06:46.173354+0000","last_peered":"2024-09-12T02:06:46.173354+0000","last_clean":"2024-09-12T02:06:46.173354+0000","last_became_active":"2024-09-12T00:10:05.300613+0000","last_became_peered":"2024-09-12T00:10:05.300613+0000","last_unstale":"2024-09-12T02:06:46.173354+0000","last_undegraded":"2024-09-12T02:06:46.173354+0000","last_fullsized":"2024-09-12T02:06:46.173354+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:48.609813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102448,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":959,"num_read_kb":2206,"num_write":818,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725243+0000","last_change":"2024-09-12T00:10:07.343479+0000","last_active":"2024-09-12T02:02:39.725243+0000","last_peered":"2024-09-12T02:02:39.725243+0000","last_clean":"2024-09-12T02:02:39.725243+0000","last_became_active":"2024-09-12T00:10:07.342700+0000","last_became_peered":"2024-09-12T00:10:07.342700+0000","last_unstale":"2024-09-12T02:02:39.725243+0000","last_undegraded":"2024-09-12T02:02:39.725243+0000","last_fullsized":"2024-09-12T02:02:39.725243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:29.670776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"266'157","reported_seq":688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976271+0000","last_change":"2024-09-12T00:10:09.436544+0000","last_active":"2024-09-12T02:04:28.976271+0000","last_peered":"2024-09-12T02:04:28.976271+0000","last_clean":"2024-09-12T02:04:28.976271+0000","last_became_active":"2024-09-12T00:10:09.435513+0000","last_became_peered":"2024-09-12T00:10:09.435513+0000","last_unstale":"2024-09-12T02:04:28.976271+0000","last_undegraded":"2024-09-12T02:04:28.976271+0000","last_fullsized":"2024-09-12T02:04:28.976271+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:42.230555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":193,"num_write":343,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"266'810","reported_seq":2368,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719876+0000","last_change":"2024-09-12T00:10:01.260517+0000","last_active":"2024-09-12T02:04:59.719876+0000","last_peered":"2024-09-12T02:04:59.719876+0000","last_clean":"2024-09-12T02:04:59.719876+0000","last_became_active":"2024-09-12T00:10:01.260115+0000","last_became_peered":"2024-09-12T00:10:01.260115+0000","last_unstale":"2024-09-12T02:04:59.719876+0000","last_undegraded":"2024-09-12T02:04:59.719876+0000","last_fullsized":"2024-09-12T02:04:59.719876+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:58.706655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3786,"num_read_kb":3403,"num_write":1061,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"266'381","reported_seq":1156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.547753+0000","last_change":"2024-09-12T00:09:59.286280+0000","last_active":"2024-09-12T02:06:47.547753+0000","last_peered":"2024-09-12T02:06:47.547753+0000","last_clean":"2024-09-12T02:06:47.547753+0000","last_became_active":"2024-09-12T00:09:59.285792+0000","last_became_peered":"2024-09-12T00:09:59.285792+0000","last_unstale":"2024-09-12T02:06:47.547753+0000","last_undegraded":"2024-09-12T02:06:47.547753+0000","last_fullsized":"2024-09-12T02:06:47.547753+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:19.960444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":739,"num_read_kb":25287,"num_write":1212,"num_write_kb":29345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729275+0000","last_change":"2024-09-12T00:10:03.258466+0000","last_active":"2024-09-12T02:04:38.729275+0000","last_peered":"2024-09-12T02:04:38.729275+0000","last_clean":"2024-09-12T02:04:38.729275+0000","last_became_active":"2024-09-12T00:10:03.257760+0000","last_became_peered":"2024-09-12T00:10:03.257760+0000","last_unstale":"2024-09-12T02:04:38.729275+0000","last_undegraded":"2024-09-12T02:04:38.729275+0000","last_fullsized":"2024-09-12T02:04:38.729275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:08.684067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"266'382","reported_seq":1028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.379891+0000","last_change":"2024-09-12T00:10:05.293759+0000","last_active":"2024-09-12T02:06:46.379891+0000","last_peered":"2024-09-12T02:06:46.379891+0000","last_clean":"2024-09-12T02:06:46.379891+0000","last_became_active":"2024-09-12T00:10:05.292902+0000","last_became_peered":"2024-09-12T00:10:05.292902+0000","last_unstale":"2024-09-12T02:06:46.379891+0000","last_undegraded":"2024-09-12T02:06:46.379891+0000","last_fullsized":"2024-09-12T02:06:46.379891+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:01.365556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":1193,"num_write":510,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679856+0000","last_change":"2024-09-12T00:10:07.322324+0000","last_active":"2024-09-12T02:02:38.679856+0000","last_peered":"2024-09-12T02:02:38.679856+0000","last_clean":"2024-09-12T02:02:38.679856+0000","last_became_active":"2024-09-12T00:10:07.321400+0000","last_became_peered":"2024-09-12T00:10:07.321400+0000","last_unstale":"2024-09-12T02:02:38.679856+0000","last_undegraded":"2024-09-12T02:02:38.679856+0000","last_fullsized":"2024-09-12T02:02:38.679856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:09.420108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"266'186","reported_seq":741,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:50.389377+0000","last_change":"2024-09-12T00:10:09.356446+0000","last_active":"2024-09-12T02:04:50.389377+0000","last_peered":"2024-09-12T02:04:50.389377+0000","last_clean":"2024-09-12T02:04:50.389377+0000","last_became_active":"2024-09-12T00:10:09.355548+0000","last_became_peered":"2024-09-12T00:10:09.355548+0000","last_unstale":"2024-09-12T02:04:50.389377+0000","last_undegraded":"2024-09-12T02:04:50.389377+0000","last_fullsized":"2024-09-12T02:04:50.389377+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:14.356852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":268,"num_write":529,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"266'393","reported_seq":1777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.725362+0000","last_change":"2024-09-12T00:10:01.257147+0000","last_active":"2024-09-12T02:04:59.725362+0000","last_peered":"2024-09-12T02:04:59.725362+0000","last_clean":"2024-09-12T02:04:59.725362+0000","last_became_active":"2024-09-12T00:10:01.256781+0000","last_became_peered":"2024-09-12T00:10:01.256781+0000","last_unstale":"2024-09-12T02:04:59.725362+0000","last_undegraded":"2024-09-12T02:04:59.725362+0000","last_fullsized":"2024-09-12T02:04:59.725362+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:08.713733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1972,"num_read_kb":1849,"num_write":456,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"266'342","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.401668+0000","last_change":"2024-09-12T00:09:59.301265+0000","last_active":"2024-09-12T02:06:47.401668+0000","last_peered":"2024-09-12T02:06:47.401668+0000","last_clean":"2024-09-12T02:06:47.401668+0000","last_became_active":"2024-09-12T00:09:59.295949+0000","last_became_peered":"2024-09-12T00:09:59.295949+0000","last_unstale":"2024-09-12T02:06:47.401668+0000","last_undegraded":"2024-09-12T02:06:47.401668+0000","last_fullsized":"2024-09-12T02:06:47.401668+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:00.402184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314586,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":1958,"num_write":1004,"num_write_kb":21693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733298+0000","last_change":"2024-09-12T00:10:03.255686+0000","last_active":"2024-09-12T02:02:33.733298+0000","last_peered":"2024-09-12T02:02:33.733298+0000","last_clean":"2024-09-12T02:02:33.733298+0000","last_became_active":"2024-09-12T00:10:03.254941+0000","last_became_peered":"2024-09-12T00:10:03.254941+0000","last_unstale":"2024-09-12T02:02:33.733298+0000","last_undegraded":"2024-09-12T02:02:33.733298+0000","last_fullsized":"2024-09-12T02:02:33.733298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:39.484405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"266'346","reported_seq":988,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.804604+0000","last_change":"2024-09-12T00:10:05.362933+0000","last_active":"2024-09-12T02:06:44.804604+0000","last_peered":"2024-09-12T02:06:44.804604+0000","last_clean":"2024-09-12T02:06:44.804604+0000","last_became_active":"2024-09-12T00:10:05.362151+0000","last_became_peered":"2024-09-12T00:10:05.362151+0000","last_unstale":"2024-09-12T02:06:44.804604+0000","last_undegraded":"2024-09-12T02:06:44.804604+0000","last_fullsized":"2024-09-12T02:06:44.804604+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:23.347759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45165,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":1204,"num_write":458,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708301+0000","last_change":"2024-09-12T00:10:07.336945+0000","last_active":"2024-09-12T02:04:38.708301+0000","last_peered":"2024-09-12T02:04:38.708301+0000","last_clean":"2024-09-12T02:04:38.708301+0000","last_became_active":"2024-09-12T00:10:07.336129+0000","last_became_peered":"2024-09-12T00:10:07.336129+0000","last_unstale":"2024-09-12T02:04:38.708301+0000","last_undegraded":"2024-09-12T02:04:38.708301+0000","last_fullsized":"2024-09-12T02:04:38.708301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:22.333025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"266'100","reported_seq":625,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.129657+0000","last_change":"2024-09-12T00:10:09.371725+0000","last_active":"2024-09-12T02:06:07.129657+0000","last_peered":"2024-09-12T02:06:07.129657+0000","last_clean":"2024-09-12T02:06:07.129657+0000","last_became_active":"2024-09-12T00:10:09.370925+0000","last_became_peered":"2024-09-12T00:10:09.370925+0000","last_unstale":"2024-09-12T02:06:07.129657+0000","last_undegraded":"2024-09-12T02:06:07.129657+0000","last_fullsized":"2024-09-12T02:06:07.129657+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:01.455208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"266'455","reported_seq":2115,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.689872+0000","last_change":"2024-09-12T00:10:01.257454+0000","last_active":"2024-09-12T02:02:33.689872+0000","last_peered":"2024-09-12T02:02:33.689872+0000","last_clean":"2024-09-12T02:02:33.689872+0000","last_became_active":"2024-09-12T00:10:01.257064+0000","last_became_peered":"2024-09-12T00:10:01.257064+0000","last_unstale":"2024-09-12T02:02:33.689872+0000","last_undegraded":"2024-09-12T02:02:33.689872+0000","last_fullsized":"2024-09-12T02:02:33.689872+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:41.782738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2638,"num_read_kb":2500,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"266'393","reported_seq":1087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.549604+0000","last_change":"2024-09-12T00:09:59.289590+0000","last_active":"2024-09-12T02:06:47.549604+0000","last_peered":"2024-09-12T02:06:47.549604+0000","last_clean":"2024-09-12T02:06:47.549604+0000","last_became_active":"2024-09-12T00:09:59.289217+0000","last_became_peered":"2024-09-12T00:09:59.289217+0000","last_unstale":"2024-09-12T02:06:47.549604+0000","last_undegraded":"2024-09-12T02:06:47.549604+0000","last_fullsized":"2024-09-12T02:06:47.549604+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:02.241515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":33363,"num_write":1255,"num_write_kb":62829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.678668+0000","last_change":"2024-09-12T00:10:03.265403+0000","last_active":"2024-09-12T02:02:33.678668+0000","last_peered":"2024-09-12T02:02:33.678668+0000","last_clean":"2024-09-12T02:02:33.678668+0000","last_became_active":"2024-09-12T00:10:03.264802+0000","last_became_peered":"2024-09-12T00:10:03.264802+0000","last_unstale":"2024-09-12T02:02:33.678668+0000","last_undegraded":"2024-09-12T02:02:33.678668+0000","last_fullsized":"2024-09-12T02:02:33.678668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:04.107888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"266'163","reported_seq":757,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.760399+0000","last_change":"2024-09-12T00:10:05.362816+0000","last_active":"2024-09-12T02:04:33.760399+0000","last_peered":"2024-09-12T02:04:33.760399+0000","last_clean":"2024-09-12T02:04:33.760399+0000","last_became_active":"2024-09-12T00:10:05.361625+0000","last_became_peered":"2024-09-12T00:10:05.361625+0000","last_unstale":"2024-09-12T02:04:33.760399+0000","last_undegraded":"2024-09-12T02:04:33.760399+0000","last_fullsized":"2024-09-12T02:04:33.760399+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:40.143219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":192,"num_write":144,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"266'764","reported_seq":3195,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.569476+0000","last_change":"2024-09-12T00:10:07.315770+0000","last_active":"2024-09-12T02:06:47.569476+0000","last_peered":"2024-09-12T02:06:47.569476+0000","last_clean":"2024-09-12T02:06:47.569476+0000","last_became_active":"2024-09-12T00:10:07.314980+0000","last_became_peered":"2024-09-12T00:10:07.314980+0000","last_unstale":"2024-09-12T02:06:47.569476+0000","last_undegraded":"2024-09-12T02:06:47.569476+0000","last_fullsized":"2024-09-12T02:06:47.569476+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:26.700418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"266'122","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.754575+0000","last_change":"2024-09-12T00:10:09.370317+0000","last_active":"2024-09-12T02:04:28.754575+0000","last_peered":"2024-09-12T02:04:28.754575+0000","last_clean":"2024-09-12T02:04:28.754575+0000","last_became_active":"2024-09-12T00:10:09.369670+0000","last_became_peered":"2024-09-12T00:10:09.369670+0000","last_unstale":"2024-09-12T02:04:28.754575+0000","last_undegraded":"2024-09-12T02:04:28.754575+0000","last_fullsized":"2024-09-12T02:04:28.754575+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:51.975587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":303,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"266'514","reported_seq":2009,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733221+0000","last_change":"2024-09-12T00:10:01.249269+0000","last_active":"2024-09-12T02:02:33.733221+0000","last_peered":"2024-09-12T02:02:33.733221+0000","last_clean":"2024-09-12T02:02:33.733221+0000","last_became_active":"2024-09-12T00:10:01.248535+0000","last_became_peered":"2024-09-12T00:10:01.248535+0000","last_unstale":"2024-09-12T02:02:33.733221+0000","last_undegraded":"2024-09-12T02:02:33.733221+0000","last_fullsized":"2024-09-12T02:02:33.733221+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:56.739255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2593,"num_read_kb":2391,"num_write":659,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"266'402","reported_seq":1101,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.451520+0000","last_change":"2024-09-12T00:09:59.297197+0000","last_active":"2024-09-12T02:06:47.451520+0000","last_peered":"2024-09-12T02:06:47.451520+0000","last_clean":"2024-09-12T02:06:47.451520+0000","last_became_active":"2024-09-12T00:09:59.296207+0000","last_became_peered":"2024-09-12T00:09:59.296207+0000","last_unstale":"2024-09-12T02:06:47.451520+0000","last_undegraded":"2024-09-12T02:06:47.451520+0000","last_fullsized":"2024-09-12T02:06:47.451520+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:59.878998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":512433,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":595,"num_read_kb":14266,"num_write":1257,"num_write_kb":35890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.727067+0000","last_change":"2024-09-12T00:10:03.260439+0000","last_active":"2024-09-12T02:02:33.727067+0000","last_peered":"2024-09-12T02:02:33.727067+0000","last_clean":"2024-09-12T02:02:33.727067+0000","last_became_active":"2024-09-12T00:10:03.259644+0000","last_became_peered":"2024-09-12T00:10:03.259644+0000","last_unstale":"2024-09-12T02:02:33.727067+0000","last_undegraded":"2024-09-12T02:02:33.727067+0000","last_fullsized":"2024-09-12T02:02:33.727067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:33.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"266'382","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.458754+0000","last_change":"2024-09-12T00:10:05.297805+0000","last_active":"2024-09-12T02:06:45.458754+0000","last_peered":"2024-09-12T02:06:45.458754+0000","last_clean":"2024-09-12T02:06:45.458754+0000","last_became_active":"2024-09-12T00:10:05.297223+0000","last_became_peered":"2024-09-12T00:10:05.297223+0000","last_unstale":"2024-09-12T02:06:45.458754+0000","last_undegraded":"2024-09-12T02:06:45.458754+0000","last_fullsized":"2024-09-12T02:06:45.458754+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:02.183020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46277,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":600,"num_read_kb":1076,"num_write":448,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.522957+0000","last_change":"2024-09-12T00:10:07.324114+0000","last_active":"2024-09-12T02:03:43.522957+0000","last_peered":"2024-09-12T02:03:43.522957+0000","last_clean":"2024-09-12T02:03:43.522957+0000","last_became_active":"2024-09-12T00:10:07.323296+0000","last_became_peered":"2024-09-12T00:10:07.323296+0000","last_unstale":"2024-09-12T02:03:43.522957+0000","last_undegraded":"2024-09-12T02:03:43.522957+0000","last_fullsized":"2024-09-12T02:03:43.522957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:17.788189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"266'145","reported_seq":669,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:52.636170+0000","last_change":"2024-09-12T00:10:09.362544+0000","last_active":"2024-09-12T02:04:52.636170+0000","last_peered":"2024-09-12T02:04:52.636170+0000","last_clean":"2024-09-12T02:04:52.636170+0000","last_became_active":"2024-09-12T00:10:09.361797+0000","last_became_peered":"2024-09-12T00:10:09.361797+0000","last_unstale":"2024-09-12T02:04:52.636170+0000","last_undegraded":"2024-09-12T02:04:52.636170+0000","last_fullsized":"2024-09-12T02:04:52.636170+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:59.618943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":153,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"266'798","reported_seq":2149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733158+0000","last_change":"2024-09-12T00:10:31.165648+0000","last_active":"2024-09-12T02:02:33.733158+0000","last_peered":"2024-09-12T02:02:33.733158+0000","last_clean":"2024-09-12T02:02:33.733158+0000","last_became_active":"2024-09-12T00:10:31.165044+0000","last_became_peered":"2024-09-12T00:10:31.165044+0000","last_unstale":"2024-09-12T02:02:33.733158+0000","last_undegraded":"2024-09-12T02:02:33.733158+0000","last_fullsized":"2024-09-12T02:02:33.733158+0000","mapping_epoch":38,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:52.001534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3606,"num_read_kb":3182,"num_write":1095,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"266'377","reported_seq":1080,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.524249+0000","last_change":"2024-09-12T00:09:59.271158+0000","last_active":"2024-09-12T02:06:47.524249+0000","last_peered":"2024-09-12T02:06:47.524249+0000","last_clean":"2024-09-12T02:06:47.524249+0000","last_became_active":"2024-09-12T00:09:59.264091+0000","last_became_peered":"2024-09-12T00:09:59.264091+0000","last_unstale":"2024-09-12T02:06:47.524249+0000","last_undegraded":"2024-09-12T02:06:47.524249+0000","last_fullsized":"2024-09-12T02:06:47.524249+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:19.196253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":673026,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":647,"num_read_kb":45982,"num_write":1108,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:34.724000+0000","last_change":"2024-09-12T00:10:03.264424+0000","last_active":"2024-09-12T02:02:34.724000+0000","last_peered":"2024-09-12T02:02:34.724000+0000","last_clean":"2024-09-12T02:02:34.724000+0000","last_became_active":"2024-09-12T00:10:03.263712+0000","last_became_peered":"2024-09-12T00:10:03.263712+0000","last_unstale":"2024-09-12T02:02:34.724000+0000","last_undegraded":"2024-09-12T02:02:34.724000+0000","last_fullsized":"2024-09-12T02:02:34.724000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:02.001466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"266'311","reported_seq":930,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.559880+0000","last_change":"2024-09-12T00:10:05.298555+0000","last_active":"2024-09-12T02:06:45.559880+0000","last_peered":"2024-09-12T02:06:45.559880+0000","last_clean":"2024-09-12T02:06:45.559880+0000","last_became_active":"2024-09-12T00:10:05.297514+0000","last_became_peered":"2024-09-12T00:10:05.297514+0000","last_unstale":"2024-09-12T02:06:45.559880+0000","last_undegraded":"2024-09-12T02:06:45.559880+0000","last_fullsized":"2024-09-12T02:06:45.559880+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:45.661380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42254,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1111,"num_write":410,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.723739+0000","last_change":"2024-09-12T00:10:07.325384+0000","last_active":"2024-09-12T02:04:13.723739+0000","last_peered":"2024-09-12T02:04:13.723739+0000","last_clean":"2024-09-12T02:04:13.723739+0000","last_became_active":"2024-09-12T00:10:07.320880+0000","last_became_peered":"2024-09-12T00:10:07.320880+0000","last_unstale":"2024-09-12T02:04:13.723739+0000","last_undegraded":"2024-09-12T02:04:13.723739+0000","last_fullsized":"2024-09-12T02:04:13.723739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:10.636128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"266'120","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.964456+0000","last_change":"2024-09-12T00:10:09.434166+0000","last_active":"2024-09-12T02:03:43.964456+0000","last_peered":"2024-09-12T02:03:43.964456+0000","last_clean":"2024-09-12T02:03:43.964456+0000","last_became_active":"2024-09-12T00:10:09.433296+0000","last_became_peered":"2024-09-12T00:10:09.433296+0000","last_unstale":"2024-09-12T02:03:43.964456+0000","last_undegraded":"2024-09-12T02:03:43.964456+0000","last_fullsized":"2024-09-12T02:03:43.964456+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:16.296420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1168,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":163,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"266'596","reported_seq":2323,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.720907+0000","last_change":"2024-09-12T00:10:01.242398+0000","last_active":"2024-09-12T02:06:05.720907+0000","last_peered":"2024-09-12T02:06:05.720907+0000","last_clean":"2024-09-12T02:06:05.720907+0000","last_became_active":"2024-09-12T00:10:01.242013+0000","last_became_peered":"2024-09-12T00:10:01.242013+0000","last_unstale":"2024-09-12T02:06:05.720907+0000","last_undegraded":"2024-09-12T02:06:05.720907+0000","last_fullsized":"2024-09-12T02:06:05.720907+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:24.130259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3158,"num_read_kb":2927,"num_write":761,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"266'355","reported_seq":1030,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.444026+0000","last_change":"2024-09-12T00:09:59.311530+0000","last_active":"2024-09-12T02:06:47.444026+0000","last_peered":"2024-09-12T02:06:47.444026+0000","last_clean":"2024-09-12T02:06:47.444026+0000","last_became_active":"2024-09-12T00:09:59.311148+0000","last_became_peered":"2024-09-12T00:09:59.311148+0000","last_unstale":"2024-09-12T02:06:47.444026+0000","last_undegraded":"2024-09-12T02:06:47.444026+0000","last_fullsized":"2024-09-12T02:06:47.444026+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:05.724347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":27101,"num_write":1127,"num_write_kb":32356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.747561+0000","last_change":"2024-09-12T00:10:03.253703+0000","last_active":"2024-09-12T02:03:38.747561+0000","last_peered":"2024-09-12T02:03:38.747561+0000","last_clean":"2024-09-12T02:03:38.747561+0000","last_became_active":"2024-09-12T00:10:03.252562+0000","last_became_peered":"2024-09-12T00:10:03.252562+0000","last_unstale":"2024-09-12T02:03:38.747561+0000","last_undegraded":"2024-09-12T02:03:38.747561+0000","last_fullsized":"2024-09-12T02:03:38.747561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:41.543603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"266'275","reported_seq":871,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.604447+0000","last_change":"2024-09-12T00:10:05.293010+0000","last_active":"2024-09-12T02:06:44.604447+0000","last_peered":"2024-09-12T02:06:44.604447+0000","last_clean":"2024-09-12T02:06:44.604447+0000","last_became_active":"2024-09-12T00:10:05.291758+0000","last_became_peered":"2024-09-12T00:10:05.291758+0000","last_unstale":"2024-09-12T02:06:44.604447+0000","last_undegraded":"2024-09-12T02:06:44.604447+0000","last_fullsized":"2024-09-12T02:06:44.604447+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:40.013931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47860,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":1100,"num_write":388,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.734558+0000","last_change":"2024-09-12T00:10:07.321987+0000","last_active":"2024-09-12T02:02:38.734558+0000","last_peered":"2024-09-12T02:02:38.734558+0000","last_clean":"2024-09-12T02:02:38.734558+0000","last_became_active":"2024-09-12T00:10:07.320509+0000","last_became_peered":"2024-09-12T00:10:07.320509+0000","last_unstale":"2024-09-12T02:02:38.734558+0000","last_undegraded":"2024-09-12T02:02:38.734558+0000","last_fullsized":"2024-09-12T02:02:38.734558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:24.557032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"266'169","reported_seq":1660,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:52.460371+0000","last_change":"2024-09-12T00:10:09.364380+0000","last_active":"2024-09-12T02:04:52.460371+0000","last_peered":"2024-09-12T02:04:52.460371+0000","last_clean":"2024-09-12T02:04:52.460371+0000","last_became_active":"2024-09-12T00:10:09.363609+0000","last_became_peered":"2024-09-12T00:10:09.363609+0000","last_unstale":"2024-09-12T02:04:52.460371+0000","last_undegraded":"2024-09-12T02:04:52.460371+0000","last_fullsized":"2024-09-12T02:04:52.460371+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:27.382248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1201,"num_read_kb":1188,"num_write":377,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"266'767","reported_seq":2292,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.935938+0000","last_change":"2024-09-12T00:10:01.255788+0000","last_active":"2024-09-12T02:04:59.935938+0000","last_peered":"2024-09-12T02:04:59.935938+0000","last_clean":"2024-09-12T02:04:59.935938+0000","last_became_active":"2024-09-12T00:10:01.255086+0000","last_became_peered":"2024-09-12T00:10:01.255086+0000","last_unstale":"2024-09-12T02:04:59.935938+0000","last_undegraded":"2024-09-12T02:04:59.935938+0000","last_fullsized":"2024-09-12T02:04:59.935938+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:14.844500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3623,"num_read_kb":3271,"num_write":1000,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"266'318","reported_seq":1019,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.479187+0000","last_change":"2024-09-12T00:09:59.294231+0000","last_active":"2024-09-12T02:06:47.479187+0000","last_peered":"2024-09-12T02:06:47.479187+0000","last_clean":"2024-09-12T02:06:47.479187+0000","last_became_active":"2024-09-12T00:09:59.293822+0000","last_became_peered":"2024-09-12T00:09:59.293822+0000","last_unstale":"2024-09-12T02:06:47.479187+0000","last_undegraded":"2024-09-12T02:06:47.479187+0000","last_fullsized":"2024-09-12T02:06:47.479187+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:58.704023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":523,"num_read_kb":10999,"num_write":984,"num_write_kb":11811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.701152+0000","last_change":"2024-09-12T00:10:03.273307+0000","last_active":"2024-09-12T02:04:08.701152+0000","last_peered":"2024-09-12T02:04:08.701152+0000","last_clean":"2024-09-12T02:04:08.701152+0000","last_became_active":"2024-09-12T00:10:03.272579+0000","last_became_peered":"2024-09-12T00:10:03.272579+0000","last_unstale":"2024-09-12T02:04:08.701152+0000","last_undegraded":"2024-09-12T02:04:08.701152+0000","last_fullsized":"2024-09-12T02:04:08.701152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:05.059545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"266'371","reported_seq":1013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.925039+0000","last_change":"2024-09-12T00:10:05.289062+0000","last_active":"2024-09-12T02:06:44.925039+0000","last_peered":"2024-09-12T02:06:44.925039+0000","last_clean":"2024-09-12T02:06:44.925039+0000","last_became_active":"2024-09-12T00:10:05.288230+0000","last_became_peered":"2024-09-12T00:10:05.288230+0000","last_unstale":"2024-09-12T02:06:44.925039+0000","last_undegraded":"2024-09-12T02:06:44.925039+0000","last_fullsized":"2024-09-12T02:06:44.925039+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:10.127963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51419,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":1309,"num_write":486,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718281+0000","last_change":"2024-09-12T00:10:07.327719+0000","last_active":"2024-09-12T02:02:38.718281+0000","last_peered":"2024-09-12T02:02:38.718281+0000","last_clean":"2024-09-12T02:02:38.718281+0000","last_became_active":"2024-09-12T00:10:07.325726+0000","last_became_peered":"2024-09-12T00:10:07.325726+0000","last_unstale":"2024-09-12T02:02:38.718281+0000","last_undegraded":"2024-09-12T02:02:38.718281+0000","last_fullsized":"2024-09-12T02:02:38.718281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:25.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"266'151","reported_seq":678,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.634814+0000","last_change":"2024-09-12T00:10:09.353828+0000","last_active":"2024-09-12T02:06:05.634814+0000","last_peered":"2024-09-12T02:06:05.634814+0000","last_clean":"2024-09-12T02:06:05.634814+0000","last_became_active":"2024-09-12T00:10:09.353036+0000","last_became_peered":"2024-09-12T00:10:09.353036+0000","last_unstale":"2024-09-12T02:06:05.634814+0000","last_undegraded":"2024-09-12T02:06:05.634814+0000","last_fullsized":"2024-09-12T02:06:05.634814+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:42.519114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":163,"num_write":387,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"266'724","reported_seq":2128,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.863697+0000","last_change":"2024-09-12T00:10:01.264074+0000","last_active":"2024-09-12T02:04:59.863697+0000","last_peered":"2024-09-12T02:04:59.863697+0000","last_clean":"2024-09-12T02:04:59.863697+0000","last_became_active":"2024-09-12T00:10:01.263786+0000","last_became_peered":"2024-09-12T00:10:01.263786+0000","last_unstale":"2024-09-12T02:04:59.863697+0000","last_undegraded":"2024-09-12T02:04:59.863697+0000","last_fullsized":"2024-09-12T02:04:59.863697+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:21.005100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3380,"num_read_kb":3030,"num_write":963,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"266'351","reported_seq":1016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.503459+0000","last_change":"2024-09-12T00:09:59.288404+0000","last_active":"2024-09-12T02:06:47.503459+0000","last_peered":"2024-09-12T02:06:47.503459+0000","last_clean":"2024-09-12T02:06:47.503459+0000","last_became_active":"2024-09-12T00:09:59.287488+0000","last_became_peered":"2024-09-12T00:09:59.287488+0000","last_unstale":"2024-09-12T02:06:47.503459+0000","last_undegraded":"2024-09-12T02:06:47.503459+0000","last_fullsized":"2024-09-12T02:06:47.503459+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:21.087354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174806,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":42853,"num_write":973,"num_write_kb":24863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"266'457","reported_seq":1949,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.867698+0000","last_change":"2024-09-12T00:10:01.258659+0000","last_active":"2024-09-12T02:04:59.867698+0000","last_peered":"2024-09-12T02:04:59.867698+0000","last_clean":"2024-09-12T02:04:59.867698+0000","last_became_active":"2024-09-12T00:10:01.258361+0000","last_became_peered":"2024-09-12T00:10:01.258361+0000","last_unstale":"2024-09-12T02:04:59.867698+0000","last_undegraded":"2024-09-12T02:04:59.867698+0000","last_fullsized":"2024-09-12T02:04:59.867698+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:18.423469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2374,"num_read_kb":2204,"num_write":589,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"266'345","reported_seq":1056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.416786+0000","last_change":"2024-09-12T00:10:31.470461+0000","last_active":"2024-09-12T02:06:47.416786+0000","last_peered":"2024-09-12T02:06:47.416786+0000","last_clean":"2024-09-12T02:06:47.416786+0000","last_became_active":"2024-09-12T00:10:31.469140+0000","last_became_peered":"2024-09-12T00:10:31.469140+0000","last_unstale":"2024-09-12T02:06:47.416786+0000","last_undegraded":"2024-09-12T02:06:47.416786+0000","last_fullsized":"2024-09-12T02:06:47.416786+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:15.566429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314842,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":558,"num_read_kb":38599,"num_write":1106,"num_write_kb":37292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"266'822","reported_seq":2507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:44.726468+0000","last_change":"2024-09-12T00:10:01.279500+0000","last_active":"2024-09-12T02:02:44.726468+0000","last_peered":"2024-09-12T02:02:44.726468+0000","last_clean":"2024-09-12T02:02:44.726468+0000","last_became_active":"2024-09-12T00:10:01.275843+0000","last_became_peered":"2024-09-12T00:10:01.275843+0000","last_unstale":"2024-09-12T02:02:44.726468+0000","last_undegraded":"2024-09-12T02:02:44.726468+0000","last_fullsized":"2024-09-12T02:02:44.726468+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:29.293928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4035,"num_read_kb":3644,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"266'347","reported_seq":1025,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.518560+0000","last_change":"2024-09-12T00:09:59.309888+0000","last_active":"2024-09-12T02:06:47.518560+0000","last_peered":"2024-09-12T02:06:47.518560+0000","last_clean":"2024-09-12T02:06:47.518560+0000","last_became_active":"2024-09-12T00:09:59.309327+0000","last_became_peered":"2024-09-12T00:09:59.309327+0000","last_unstale":"2024-09-12T02:06:47.518560+0000","last_undegraded":"2024-09-12T02:06:47.518560+0000","last_fullsized":"2024-09-12T02:06:47.518560+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:38.157743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":15469,"num_write":1110,"num_write_kb":37224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"266'496","reported_seq":2144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:43.681200+0000","last_change":"2024-09-12T00:10:01.261722+0000","last_active":"2024-09-12T02:02:43.681200+0000","last_peered":"2024-09-12T02:02:43.681200+0000","last_clean":"2024-09-12T02:02:43.681200+0000","last_became_active":"2024-09-12T00:10:01.261418+0000","last_became_peered":"2024-09-12T00:10:01.261418+0000","last_unstale":"2024-09-12T02:02:43.681200+0000","last_undegraded":"2024-09-12T02:02:43.681200+0000","last_fullsized":"2024-09-12T02:02:43.681200+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:12.125604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2751,"num_read_kb":2561,"num_write":595,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"266'353","reported_seq":1113,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.524646+0000","last_change":"2024-09-12T00:09:59.287032+0000","last_active":"2024-09-12T02:06:47.524646+0000","last_peered":"2024-09-12T02:06:47.524646+0000","last_clean":"2024-09-12T02:06:47.524646+0000","last_became_active":"2024-09-12T00:09:59.286590+0000","last_became_peered":"2024-09-12T00:09:59.286590+0000","last_unstale":"2024-09-12T02:06:47.524646+0000","last_undegraded":"2024-09-12T02:06:47.524646+0000","last_fullsized":"2024-09-12T02:06:47.524646+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:35.622983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904210,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":714,"num_read_kb":40012,"num_write":1077,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"266'1463","reported_seq":3083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.676957+0000","last_change":"2024-09-12T00:10:01.262679+0000","last_active":"2024-09-12T02:06:05.676957+0000","last_peered":"2024-09-12T02:06:05.676957+0000","last_clean":"2024-09-12T02:06:05.676957+0000","last_became_active":"2024-09-12T00:10:01.261999+0000","last_became_peered":"2024-09-12T00:10:01.261999+0000","last_unstale":"2024-09-12T02:06:05.676957+0000","last_undegraded":"2024-09-12T02:06:05.676957+0000","last_fullsized":"2024-09-12T02:06:05.676957+0000","mapping_epoch":27,"log_start":"266'1400","ondisk_log_start":"266'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":1400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:32.253175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6652,"num_read_kb":5741,"num_write":2141,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"266'381","reported_seq":1124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.519571+0000","last_change":"2024-09-12T00:09:59.286623+0000","last_active":"2024-09-12T02:06:47.519571+0000","last_peered":"2024-09-12T02:06:47.519571+0000","last_clean":"2024-09-12T02:06:47.519571+0000","last_became_active":"2024-09-12T00:09:59.286301+0000","last_became_peered":"2024-09-12T00:09:59.286301+0000","last_unstale":"2024-09-12T02:06:47.519571+0000","last_undegraded":"2024-09-12T02:06:47.519571+0000","last_fullsized":"2024-09-12T02:06:47.519571+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:46.585588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":778,"num_read_kb":8721,"num_write":1199,"num_write_kb":26143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"266'391","reported_seq":1861,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.936338+0000","last_change":"2024-09-12T00:10:01.268784+0000","last_active":"2024-09-12T02:04:59.936338+0000","last_peered":"2024-09-12T02:04:59.936338+0000","last_clean":"2024-09-12T02:04:59.936338+0000","last_became_active":"2024-09-12T00:10:01.266927+0000","last_became_peered":"2024-09-12T00:10:01.266927+0000","last_unstale":"2024-09-12T02:04:59.936338+0000","last_undegraded":"2024-09-12T02:04:59.936338+0000","last_fullsized":"2024-09-12T02:04:59.936338+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:03.258226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2147,"num_read_kb":2014,"num_write":451,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"266'355","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.550046+0000","last_change":"2024-09-12T00:09:59.252139+0000","last_active":"2024-09-12T02:06:47.550046+0000","last_peered":"2024-09-12T02:06:47.550046+0000","last_clean":"2024-09-12T02:06:47.550046+0000","last_became_active":"2024-09-12T00:09:59.251413+0000","last_became_peered":"2024-09-12T00:09:59.251413+0000","last_unstale":"2024-09-12T02:06:47.550046+0000","last_undegraded":"2024-09-12T02:06:47.550046+0000","last_fullsized":"2024-09-12T02:06:47.550046+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:50.326651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":573,"num_read_kb":23722,"num_write":1195,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"266'445","reported_seq":2119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.978719+0000","last_change":"2024-09-12T00:10:01.261639+0000","last_active":"2024-09-12T02:04:38.978719+0000","last_peered":"2024-09-12T02:04:38.978719+0000","last_clean":"2024-09-12T02:04:38.978719+0000","last_became_active":"2024-09-12T00:10:01.259942+0000","last_became_peered":"2024-09-12T00:10:01.259942+0000","last_unstale":"2024-09-12T02:04:38.978719+0000","last_undegraded":"2024-09-12T02:04:38.978719+0000","last_fullsized":"2024-09-12T02:04:38.978719+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:46.512977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2415,"num_read_kb":2305,"num_write":502,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"266'339","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.495004+0000","last_change":"2024-09-12T00:09:59.299099+0000","last_active":"2024-09-12T02:06:47.495004+0000","last_peered":"2024-09-12T02:06:47.495004+0000","last_clean":"2024-09-12T02:06:47.495004+0000","last_became_active":"2024-09-12T00:09:59.298085+0000","last_became_peered":"2024-09-12T00:09:59.298085+0000","last_unstale":"2024-09-12T02:06:47.495004+0000","last_undegraded":"2024-09-12T02:06:47.495004+0000","last_fullsized":"2024-09-12T02:06:47.495004+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:01.824707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136867,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":58646,"num_write":1165,"num_write_kb":29645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"266'499","reported_seq":2206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.729090+0000","last_change":"2024-09-12T00:10:01.256111+0000","last_active":"2024-09-12T02:04:38.729090+0000","last_peered":"2024-09-12T02:04:38.729090+0000","last_clean":"2024-09-12T02:04:38.729090+0000","last_became_active":"2024-09-12T00:10:01.255302+0000","last_became_peered":"2024-09-12T00:10:01.255302+0000","last_unstale":"2024-09-12T02:04:38.729090+0000","last_undegraded":"2024-09-12T02:04:38.729090+0000","last_fullsized":"2024-09-12T02:04:38.729090+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:49.290623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2619,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"266'347","reported_seq":1074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.537007+0000","last_change":"2024-09-12T00:09:59.286963+0000","last_active":"2024-09-12T02:06:47.537007+0000","last_peered":"2024-09-12T02:06:47.537007+0000","last_clean":"2024-09-12T02:06:47.537007+0000","last_became_active":"2024-09-12T00:09:59.286393+0000","last_became_peered":"2024-09-12T00:09:59.286393+0000","last_unstale":"2024-09-12T02:06:47.537007+0000","last_undegraded":"2024-09-12T02:06:47.537007+0000","last_fullsized":"2024-09-12T02:06:47.537007+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:52.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33187,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":4608,"num_write":1166,"num_write_kb":13882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"266'595","reported_seq":2551,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.719733+0000","last_change":"2024-09-12T00:10:01.248053+0000","last_active":"2024-09-12T02:04:59.719733+0000","last_peered":"2024-09-12T02:04:59.719733+0000","last_clean":"2024-09-12T02:04:59.719733+0000","last_became_active":"2024-09-12T00:10:01.247691+0000","last_became_peered":"2024-09-12T00:10:01.247691+0000","last_unstale":"2024-09-12T02:04:59.719733+0000","last_undegraded":"2024-09-12T02:04:59.719733+0000","last_fullsized":"2024-09-12T02:04:59.719733+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:02.948022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3679,"num_read_kb":3455,"num_write":725,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"266'359","reported_seq":1019,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.489446+0000","last_change":"2024-09-12T00:09:59.301446+0000","last_active":"2024-09-12T02:06:47.489446+0000","last_peered":"2024-09-12T02:06:47.489446+0000","last_clean":"2024-09-12T02:06:47.489446+0000","last_became_active":"2024-09-12T00:09:59.300760+0000","last_became_peered":"2024-09-12T00:09:59.300760+0000","last_unstale":"2024-09-12T02:06:47.489446+0000","last_undegraded":"2024-09-12T02:06:47.489446+0000","last_fullsized":"2024-09-12T02:06:47.489446+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:42.952819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436849,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":26981,"num_write":1171,"num_write_kb":52645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"266'957","reported_seq":2608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.758101+0000","last_change":"2024-09-12T00:10:01.239366+0000","last_active":"2024-09-12T02:04:23.758101+0000","last_peered":"2024-09-12T02:04:23.758101+0000","last_clean":"2024-09-12T02:04:23.758101+0000","last_became_active":"2024-09-12T00:10:01.238674+0000","last_became_peered":"2024-09-12T00:10:01.238674+0000","last_unstale":"2024-09-12T02:04:23.758101+0000","last_undegraded":"2024-09-12T02:04:23.758101+0000","last_fullsized":"2024-09-12T02:04:23.758101+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":900,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:27.928106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4713,"num_read_kb":4229,"num_write":1343,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"266'291","reported_seq":943,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.477150+0000","last_change":"2024-09-12T00:09:59.289360+0000","last_active":"2024-09-12T02:06:47.477150+0000","last_peered":"2024-09-12T02:06:47.477150+0000","last_clean":"2024-09-12T02:06:47.477150+0000","last_became_active":"2024-09-12T00:09:59.288260+0000","last_became_peered":"2024-09-12T00:09:59.288260+0000","last_unstale":"2024-09-12T02:06:47.477150+0000","last_undegraded":"2024-09-12T02:06:47.477150+0000","last_fullsized":"2024-09-12T02:06:47.477150+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:05.984205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":7701,"num_write":890,"num_write_kb":23188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"266'342","reported_seq":1890,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.726617+0000","last_change":"2024-09-12T00:10:01.265917+0000","last_active":"2024-09-12T02:06:05.726617+0000","last_peered":"2024-09-12T02:06:05.726617+0000","last_clean":"2024-09-12T02:06:05.726617+0000","last_became_active":"2024-09-12T00:10:01.265676+0000","last_became_peered":"2024-09-12T00:10:01.265676+0000","last_unstale":"2024-09-12T02:06:05.726617+0000","last_undegraded":"2024-09-12T02:06:05.726617+0000","last_fullsized":"2024-09-12T02:06:05.726617+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:37.696003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1939,"num_read_kb":1902,"num_write":362,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"266'308","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.443971+0000","last_change":"2024-09-12T00:09:59.311681+0000","last_active":"2024-09-12T02:06:47.443971+0000","last_peered":"2024-09-12T02:06:47.443971+0000","last_clean":"2024-09-12T02:06:47.443971+0000","last_became_active":"2024-09-12T00:09:59.311132+0000","last_became_peered":"2024-09-12T00:09:59.311132+0000","last_unstale":"2024-09-12T02:06:47.443971+0000","last_undegraded":"2024-09-12T02:06:47.443971+0000","last_fullsized":"2024-09-12T02:06:47.443971+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:34.389668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190249,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":37892,"num_write":1016,"num_write_kb":21146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"266'929","reported_seq":2547,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.499343+0000","last_change":"2024-09-12T00:10:01.256409+0000","last_active":"2024-09-12T02:04:57.499343+0000","last_peered":"2024-09-12T02:04:57.499343+0000","last_clean":"2024-09-12T02:04:57.499343+0000","last_became_active":"2024-09-12T00:10:01.255682+0000","last_became_peered":"2024-09-12T00:10:01.255682+0000","last_unstale":"2024-09-12T02:04:57.499343+0000","last_undegraded":"2024-09-12T02:04:57.499343+0000","last_fullsized":"2024-09-12T02:04:57.499343+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:22.673852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4312,"num_read_kb":3831,"num_write":1239,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"266'335","reported_seq":1018,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.481170+0000","last_change":"2024-09-12T00:09:59.301361+0000","last_active":"2024-09-12T02:06:47.481170+0000","last_peered":"2024-09-12T02:06:47.481170+0000","last_clean":"2024-09-12T02:06:47.481170+0000","last_became_active":"2024-09-12T00:09:59.300699+0000","last_became_peered":"2024-09-12T00:09:59.300699+0000","last_unstale":"2024-09-12T02:06:47.481170+0000","last_undegraded":"2024-09-12T02:06:47.481170+0000","last_fullsized":"2024-09-12T02:06:47.481170+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:17.083956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315873,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":7533,"num_write":1090,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"266'857","reported_seq":2535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.886077+0000","last_change":"2024-09-12T00:10:01.265550+0000","last_active":"2024-09-12T02:04:59.886077+0000","last_peered":"2024-09-12T02:04:59.886077+0000","last_clean":"2024-09-12T02:04:59.886077+0000","last_became_active":"2024-09-12T00:10:01.264795+0000","last_became_peered":"2024-09-12T00:10:01.264795+0000","last_unstale":"2024-09-12T02:04:59.886077+0000","last_undegraded":"2024-09-12T02:04:59.886077+0000","last_fullsized":"2024-09-12T02:04:59.886077+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:05.882685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3745,"num_write":1135,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"266'384","reported_seq":1056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.495001+0000","last_change":"2024-09-12T00:09:59.304543+0000","last_active":"2024-09-12T02:06:47.495001+0000","last_peered":"2024-09-12T02:06:47.495001+0000","last_clean":"2024-09-12T02:06:47.495001+0000","last_became_active":"2024-09-12T00:09:59.299516+0000","last_became_peered":"2024-09-12T00:09:59.299516+0000","last_unstale":"2024-09-12T02:06:47.495001+0000","last_undegraded":"2024-09-12T02:06:47.495001+0000","last_fullsized":"2024-09-12T02:06:47.495001+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:57.946312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":14945,"num_write":1232,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"266'496","reported_seq":2130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.538818+0000","last_change":"2024-09-12T00:10:01.259052+0000","last_active":"2024-09-12T02:04:48.538818+0000","last_peered":"2024-09-12T02:04:48.538818+0000","last_clean":"2024-09-12T02:04:48.538818+0000","last_became_active":"2024-09-12T00:10:01.258691+0000","last_became_peered":"2024-09-12T00:10:01.258691+0000","last_unstale":"2024-09-12T02:04:48.538818+0000","last_undegraded":"2024-09-12T02:04:48.538818+0000","last_fullsized":"2024-09-12T02:04:48.538818+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:25.573412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2775,"num_read_kb":2593,"num_write":624,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"266'376","reported_seq":1037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.451469+0000","last_change":"2024-09-12T00:09:59.314098+0000","last_active":"2024-09-12T02:06:47.451469+0000","last_peered":"2024-09-12T02:06:47.451469+0000","last_clean":"2024-09-12T02:06:47.451469+0000","last_became_active":"2024-09-12T00:09:59.313345+0000","last_became_peered":"2024-09-12T00:09:59.313345+0000","last_unstale":"2024-09-12T02:06:47.451469+0000","last_undegraded":"2024-09-12T02:06:47.451469+0000","last_fullsized":"2024-09-12T02:06:47.451469+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.271942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4483063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":14481,"num_write":1098,"num_write_kb":25771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"266'323","reported_seq":1744,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.944772+0000","last_change":"2024-09-12T00:10:01.250260+0000","last_active":"2024-09-12T02:02:33.944772+0000","last_peered":"2024-09-12T02:02:33.944772+0000","last_clean":"2024-09-12T02:02:33.944772+0000","last_became_active":"2024-09-12T00:10:01.249832+0000","last_became_peered":"2024-09-12T00:10:01.249832+0000","last_unstale":"2024-09-12T02:02:33.944772+0000","last_undegraded":"2024-09-12T02:02:33.944772+0000","last_fullsized":"2024-09-12T02:02:33.944772+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:36.961457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1802,"num_read_kb":1736,"num_write":351,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"266'317","reported_seq":1015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.435541+0000","last_change":"2024-09-12T00:09:59.311678+0000","last_active":"2024-09-12T02:06:47.435541+0000","last_peered":"2024-09-12T02:06:47.435541+0000","last_clean":"2024-09-12T02:06:47.435541+0000","last_became_active":"2024-09-12T00:09:59.311158+0000","last_became_peered":"2024-09-12T00:09:59.311158+0000","last_unstale":"2024-09-12T02:06:47.435541+0000","last_undegraded":"2024-09-12T02:06:47.435541+0000","last_fullsized":"2024-09-12T02:06:47.435541+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:56.573170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316829,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":115277,"num_write":995,"num_write_kb":39549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"266'719","reported_seq":2261,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.735208+0000","last_change":"2024-09-12T00:10:01.268377+0000","last_active":"2024-09-12T02:03:08.735208+0000","last_peered":"2024-09-12T02:03:08.735208+0000","last_clean":"2024-09-12T02:03:08.735208+0000","last_became_active":"2024-09-12T00:10:01.267027+0000","last_became_peered":"2024-09-12T00:10:01.267027+0000","last_unstale":"2024-09-12T02:03:08.735208+0000","last_undegraded":"2024-09-12T02:03:08.735208+0000","last_fullsized":"2024-09-12T02:03:08.735208+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:46.063409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3526,"num_read_kb":3200,"num_write":1050,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"266'331","reported_seq":994,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.513387+0000","last_change":"2024-09-12T00:09:59.287224+0000","last_active":"2024-09-12T02:06:47.513387+0000","last_peered":"2024-09-12T02:06:47.513387+0000","last_clean":"2024-09-12T02:06:47.513387+0000","last_became_active":"2024-09-12T00:09:59.285907+0000","last_became_peered":"2024-09-12T00:09:59.285907+0000","last_unstale":"2024-09-12T02:06:47.513387+0000","last_undegraded":"2024-09-12T02:06:47.513387+0000","last_fullsized":"2024-09-12T02:06:47.513387+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:31.224850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569458,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":44645,"num_write":951,"num_write_kb":42281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"266'334","reported_seq":1009,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.535448+0000","last_change":"2024-09-12T00:09:59.284497+0000","last_active":"2024-09-12T02:06:47.535448+0000","last_peered":"2024-09-12T02:06:47.535448+0000","last_clean":"2024-09-12T02:06:47.535448+0000","last_became_active":"2024-09-12T00:09:59.282446+0000","last_became_peered":"2024-09-12T00:09:59.282446+0000","last_unstale":"2024-09-12T02:06:47.535448+0000","last_undegraded":"2024-09-12T02:06:47.535448+0000","last_fullsized":"2024-09-12T02:06:47.535448+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:03.250241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2535841,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":492,"num_read_kb":44688,"num_write":1069,"num_write_kb":33304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"266'455","reported_seq":2028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.721307+0000","last_change":"2024-09-12T00:10:01.248091+0000","last_active":"2024-09-12T02:06:05.721307+0000","last_peered":"2024-09-12T02:06:05.721307+0000","last_clean":"2024-09-12T02:06:05.721307+0000","last_became_active":"2024-09-12T00:10:01.247767+0000","last_became_peered":"2024-09-12T00:10:01.247767+0000","last_unstale":"2024-09-12T02:06:05.721307+0000","last_undegraded":"2024-09-12T02:06:05.721307+0000","last_fullsized":"2024-09-12T02:06:05.721307+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.370640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2488,"num_read_kb":2350,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"266'350","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.468042+0000","last_change":"2024-09-12T00:10:31.168863+0000","last_active":"2024-09-12T02:06:47.468042+0000","last_peered":"2024-09-12T02:06:47.468042+0000","last_clean":"2024-09-12T02:06:47.468042+0000","last_became_active":"2024-09-12T00:10:31.168444+0000","last_became_peered":"2024-09-12T00:10:31.168444+0000","last_unstale":"2024-09-12T02:06:47.468042+0000","last_undegraded":"2024-09-12T02:06:47.468042+0000","last_fullsized":"2024-09-12T02:06:47.468042+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:09:58.208608+0000","last_clean_scrub_stamp":"2024-09-12T00:09:58.208608+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:26.977451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400029,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":20125,"num_write":1291,"num_write_kb":40521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,0],"acting":[1,4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"266'1085","reported_seq":2767,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.671979+0000","last_change":"2024-09-12T00:10:01.279860+0000","last_active":"2024-09-12T02:06:05.671979+0000","last_peered":"2024-09-12T02:06:05.671979+0000","last_clean":"2024-09-12T02:06:05.671979+0000","last_became_active":"2024-09-12T00:10:01.278762+0000","last_became_peered":"2024-09-12T00:10:01.278762+0000","last_unstale":"2024-09-12T02:06:05.671979+0000","last_undegraded":"2024-09-12T02:06:05.671979+0000","last_fullsized":"2024-09-12T02:06:05.671979+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":1000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:38.059400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5202,"num_read_kb":4573,"num_write":1592,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6060,"num_read_kb":4225,"num_write":1955,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1026,"ondisk_log_size":1026,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":15149,"num_read_kb":14793,"num_write":16764,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":434,"ondisk_log_size":434,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1579968,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":21268,"num_read_kb":40714,"num_write":17731,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2001,"ondisk_log_size":2001,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213079,"num_read_kb":194397,"num_write":55367,"num_write_kb":18884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":73602788,"num_objects":381,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":381,"num_whiteouts":0,"num_read":36353,"num_read_kb":1955827,"num_write":72080,"num_write_kb":2110952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100646912,"data_stored":100646912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3518,"ondisk_log_size":3518,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":180842,"num_write":186,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":169574,"num_write":186,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543556,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341692,"kb_used_data":17580,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94030148,"statfs":{"total":96636764160,"available":96286871552,"internally_reserved":0,"allocated":18001920,"data_stored":15991149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543556,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":18656,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":19103744,"data_stored":17151124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543562,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173100,"kb_used_data":15644,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94198740,"statfs":{"total":96636764160,"available":96459509760,"internally_reserved":0,"allocated":16019456,"data_stored":13989543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543557,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158712,"kb_used_data":15080,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94213128,"statfs":{"total":96636764160,"available":96474243072,"internally_reserved":0,"allocated":15441920,"data_stored":13515589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543559,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308428,"kb_used_data":20412,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94063412,"statfs":{"total":96636764160,"available":96320933888,"internally_reserved":0,"allocated":20901888,"data_stored":18895025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":294910407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543557,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117028,"kb_used_data":13652,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94254812,"statfs":{"total":96636764160,"available":96516927488,"internally_reserved":0,"allocated":13979648,"data_stored":12036246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543559,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195036,"kb_used_data":11212,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94176804,"statfs":{"total":96636764160,"available":96437047296,"internally_reserved":0,"allocated":11481088,"data_stored":9500646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543558,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304388,"kb_used_data":20596,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94067452,"statfs":{"total":96636764160,"available":96325070848,"internally_reserved":0,"allocated":21090304,"data_stored":19083000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16199680,"data_stored":16199680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7208960,"data_stored":7208960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9744384,"data_stored":9744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16601088,"data_stored":16601088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11227136,"data_stored":11227136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11698176,"data_stored":11698176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14860288,"data_stored":14860288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13107200,"data_stored":13107200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:06:55.335 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.335 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.335 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.335 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.336 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.336 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.336 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.336 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.336 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.336 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.336 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.336 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.336 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.337 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.337 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.337 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.337 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.337 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.337 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.337 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.337 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.337 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.337 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.338 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.338 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.338 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.338 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.338 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.338 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.338 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.338 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.338 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.339 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.339 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.339 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.339 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.339 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.339 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.339 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.339 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.339 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.340 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.340 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.340 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.340 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.340 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.340 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.340 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.340 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.340 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.341 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.341 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.341 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.341 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.341 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.341 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.341 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.341 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.341 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.342 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.342 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.342 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.342 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.342 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.342 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.342 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.342 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.342 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.342 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.343 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.343 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.343 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.343 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.343 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.343 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.343 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.343 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.343 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.344 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.344 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.344 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.344 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.344 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.344 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.344 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.344 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.345 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.345 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.345 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.345 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.345 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.345 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.345 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.345 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.345 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.346 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.346 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.346 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.346 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.346 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.346 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.346 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.346 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.346 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.346 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.347 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.347 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.347 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.347 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.347 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.347 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.347 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.347 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.348 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.348 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.348 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.348 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.348 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.348 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.348 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.348 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.348 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.349 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.349 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.349 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.349 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.349 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.349 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.349 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.349 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.349 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.350 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.350 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.350 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.350 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.350 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.350 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.350 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.350 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.351 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.351 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.351 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.351 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.351 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.351 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.351 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.351 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.351 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.352 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.352 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.352 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.352 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.352 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.352 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.352 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.352 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.352 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.353 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.353 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.353 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.353 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.353 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.353 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.353 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.353 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.353 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.354 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.354 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.354 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.354 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.354 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.354 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.354 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.355 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.355 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.355 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.355 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.355 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.355 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.355 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.356 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.356 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.356 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.356 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.356 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.356 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.356 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.356 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.357 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.357 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.357 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.357 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.357 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.357 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.357 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.357 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.358 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.358 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.358 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.358 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.358 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.358 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.358 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.359 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.359 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.359 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.359 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.359 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.359 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.359 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.359 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.360 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.360 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.360 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.360 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.360 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.360 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.361 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.361 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.361 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.361 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.361 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.361 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.361 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.361 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.362 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.362 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.362 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.362 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.362 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:09:39.068560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.362 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:09:45.135664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.362 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.363 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.363 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.363 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.363 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.363 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.363 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:09:45.135664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.363 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.364 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.364 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.364 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.364 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.364 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.364 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.365 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.365 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.365 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.365 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.365 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.365 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.365 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.366 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.366 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.366 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.366 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.367 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.367 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.367 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.367 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.367 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.367 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:09:45.135664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.368 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.368 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.368 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.368 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.368 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.368 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.368 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.368 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.369 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.369 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.369 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:09:45.135664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.369 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.369 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.369 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.369 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.369 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.369 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.370 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.370 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.370 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.370 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.370 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.370 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.370 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.370 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.370 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.371 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.371 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.371 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.371 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.371 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.371 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.371 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.371 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.371 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.372 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.372 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.372 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.372 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.372 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.372 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.372 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.372 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.372 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.373 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.373 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.373 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.373 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.373 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.373 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.373 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.373 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.373 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.374 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.374 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.374 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.374 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.374 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.374 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.374 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.374 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.374 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.374 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.375 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.375 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.375 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.375 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.375 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.375 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.375 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.375 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.375 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.376 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.376 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.376 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.376 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.376 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.376 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.376 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.376 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.376 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.377 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.377 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.377 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.377 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.377 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.377 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.377 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.377 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.377 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.378 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.378 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.378 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.378 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.378 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.378 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.378 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.378 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.378 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.378 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.379 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.379 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.379 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.379 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.379 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.379 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.379 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.379 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.379 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.380 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.380 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.380 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.380 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.380 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.380 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.380 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.380 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.380 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.381 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.381 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.381 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.381 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:09:58.208608+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=9, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.381 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:06:55.381 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:07:15.383 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:07:15.772 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-12T02:07:15.774 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":3785,"stamp":"2024-09-12T02:07:14.911307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75791055,"num_objects":883,"num_object_clones":0,"num_object_copies":2528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":294733,"num_read_kb":2563326,"num_write":164412,"num_write_kb":2404914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":49752,"num_omap_keys":195,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13173,"ondisk_log_size":13173,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1923104,"kb_used_data":132832,"kb_used_omap":12,"kb_used_meta":1790131,"kb_avail":753051616,"statfs":{"total":773094113280,"available":771124854784,"internally_reserved":0,"allocated":136019968,"data_stored":120162322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1833094704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":48867,"num_omap_keys":191,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008014"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:54.728675+0000","last_change":"2024-09-12T01:00:24.087308+0000","last_active":"2024-09-12T02:02:54.728675+0000","last_peered":"2024-09-12T02:02:54.728675+0000","last_clean":"2024-09-12T02:02:54.728675+0000","last_became_active":"2024-09-12T01:00:24.086540+0000","last_became_peered":"2024-09-12T01:00:24.086540+0000","last_unstale":"2024-09-12T02:02:54.728675+0000","last_undegraded":"2024-09-12T02:02:54.728675+0000","last_fullsized":"2024-09-12T02:02:54.728675+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:55.672405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"266'3","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:54.756292+0000","last_change":"2024-09-12T00:32:21.646660+0000","last_active":"2024-09-12T02:04:54.756292+0000","last_peered":"2024-09-12T02:04:54.756292+0000","last_clean":"2024-09-12T02:04:54.756292+0000","last_became_active":"2024-09-12T00:32:21.645757+0000","last_became_peered":"2024-09-12T00:32:21.645757+0000","last_unstale":"2024-09-12T02:04:54.756292+0000","last_undegraded":"2024-09-12T02:04:54.756292+0000","last_fullsized":"2024-09-12T02:04:54.756292+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"266'6","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.263130+0000","last_change":"2024-09-12T00:32:14.592938+0000","last_active":"2024-09-12T02:06:47.263130+0000","last_peered":"2024-09-12T02:06:47.263130+0000","last_clean":"2024-09-12T02:06:47.263130+0000","last_became_active":"2024-09-12T00:32:14.592177+0000","last_became_peered":"2024-09-12T00:32:14.592177+0000","last_unstale":"2024-09-12T02:06:47.263130+0000","last_undegraded":"2024-09-12T02:06:47.263130+0000","last_fullsized":"2024-09-12T02:06:47.263130+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8188,"num_write":6,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"266'29","reported_seq":164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.531382+0000","last_change":"2024-09-12T00:26:23.355721+0000","last_active":"2024-09-12T02:04:18.531382+0000","last_peered":"2024-09-12T02:04:18.531382+0000","last_clean":"2024-09-12T02:04:18.531382+0000","last_became_active":"2024-09-12T00:26:23.353338+0000","last_became_peered":"2024-09-12T00:26:23.353338+0000","last_unstale":"2024-09-12T02:04:18.531382+0000","last_undegraded":"2024-09-12T02:04:18.531382+0000","last_fullsized":"2024-09-12T02:04:18.531382+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.176865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.694256+0000","last_change":"2024-09-12T01:00:24.074808+0000","last_active":"2024-09-12T02:02:53.694256+0000","last_peered":"2024-09-12T02:02:53.694256+0000","last_clean":"2024-09-12T02:02:53.694256+0000","last_became_active":"2024-09-12T01:00:24.074048+0000","last_became_peered":"2024-09-12T01:00:24.074048+0000","last_unstale":"2024-09-12T02:02:53.694256+0000","last_undegraded":"2024-09-12T02:02:53.694256+0000","last_fullsized":"2024-09-12T02:02:53.694256+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:33.545173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"266'13","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.492562+0000","last_change":"2024-09-12T00:32:21.643734+0000","last_active":"2024-09-12T02:06:46.492562+0000","last_peered":"2024-09-12T02:06:46.492562+0000","last_clean":"2024-09-12T02:06:46.492562+0000","last_became_active":"2024-09-12T00:32:21.642967+0000","last_became_peered":"2024-09-12T00:32:21.642967+0000","last_unstale":"2024-09-12T02:06:46.492562+0000","last_undegraded":"2024-09-12T02:06:46.492562+0000","last_fullsized":"2024-09-12T02:06:46.492562+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:09.883461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24594,"num_write":18,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709559+0000","last_change":"2024-09-12T00:32:14.603921+0000","last_active":"2024-09-12T02:04:43.709559+0000","last_peered":"2024-09-12T02:04:43.709559+0000","last_clean":"2024-09-12T02:04:43.709559+0000","last_became_active":"2024-09-12T00:32:14.602766+0000","last_became_peered":"2024-09-12T00:32:14.602766+0000","last_unstale":"2024-09-12T02:04:43.709559+0000","last_undegraded":"2024-09-12T02:04:43.709559+0000","last_fullsized":"2024-09-12T02:04:43.709559+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"266'26","reported_seq":159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.641746+0000","last_change":"2024-09-12T02:07:13.641746+0000","last_active":"2024-09-12T02:07:13.641746+0000","last_peered":"2024-09-12T02:07:13.641746+0000","last_clean":"2024-09-12T02:07:13.641746+0000","last_became_active":"2024-09-12T00:26:23.321682+0000","last_became_peered":"2024-09-12T00:26:23.321682+0000","last_unstale":"2024-09-12T02:07:13.641746+0000","last_undegraded":"2024-09-12T02:07:13.641746+0000","last_fullsized":"2024-09-12T02:07:13.641746+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T02:07:13.641577+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T02:07:13.641577+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.641577+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:11.157660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.710738+0000","last_change":"2024-09-12T01:00:24.076714+0000","last_active":"2024-09-12T02:03:13.710738+0000","last_peered":"2024-09-12T02:03:13.710738+0000","last_clean":"2024-09-12T02:03:13.710738+0000","last_became_active":"2024-09-12T01:00:24.075719+0000","last_became_peered":"2024-09-12T01:00:24.075719+0000","last_unstale":"2024-09-12T02:03:13.710738+0000","last_undegraded":"2024-09-12T02:03:13.710738+0000","last_fullsized":"2024-09-12T02:03:13.710738+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:33.848488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"266'2","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:08.555301+0000","last_change":"2024-09-12T00:32:21.664584+0000","last_active":"2024-09-12T02:06:08.555301+0000","last_peered":"2024-09-12T02:06:08.555301+0000","last_clean":"2024-09-12T02:06:08.555301+0000","last_became_active":"2024-09-12T00:32:21.663938+0000","last_became_peered":"2024-09-12T00:32:21.663938+0000","last_unstale":"2024-09-12T02:06:08.555301+0000","last_undegraded":"2024-09-12T02:06:08.555301+0000","last_fullsized":"2024-09-12T02:06:08.555301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:56.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"266'10","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.739819+0000","last_change":"2024-09-12T00:32:14.598635+0000","last_active":"2024-09-12T02:06:38.739819+0000","last_peered":"2024-09-12T02:06:38.739819+0000","last_clean":"2024-09-12T02:06:38.739819+0000","last_became_active":"2024-09-12T00:32:14.597094+0000","last_became_peered":"2024-09-12T00:32:14.597094+0000","last_unstale":"2024-09-12T02:06:38.739819+0000","last_undegraded":"2024-09-12T02:06:38.739819+0000","last_fullsized":"2024-09-12T02:06:38.739819+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:37.960853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24574,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"266'4","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525390+0000","last_change":"2024-09-12T00:26:23.350775+0000","last_active":"2024-09-12T02:03:53.525390+0000","last_peered":"2024-09-12T02:03:53.525390+0000","last_clean":"2024-09-12T02:03:53.525390+0000","last_became_active":"2024-09-12T00:26:23.349476+0000","last_became_peered":"2024-09-12T00:26:23.349476+0000","last_unstale":"2024-09-12T02:03:53.525390+0000","last_undegraded":"2024-09-12T02:03:53.525390+0000","last_fullsized":"2024-09-12T02:03:53.525390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:55.207200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959089+0000","last_change":"2024-09-12T01:00:24.070271+0000","last_active":"2024-09-12T02:03:23.959089+0000","last_peered":"2024-09-12T02:03:23.959089+0000","last_clean":"2024-09-12T02:03:23.959089+0000","last_became_active":"2024-09-12T01:00:24.069555+0000","last_became_peered":"2024-09-12T01:00:24.069555+0000","last_unstale":"2024-09-12T02:03:23.959089+0000","last_undegraded":"2024-09-12T02:03:23.959089+0000","last_fullsized":"2024-09-12T02:03:23.959089+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:30.440481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:39.005123+0000","last_change":"2024-09-12T00:32:21.658088+0000","last_active":"2024-09-12T02:06:39.005123+0000","last_peered":"2024-09-12T02:06:39.005123+0000","last_clean":"2024-09-12T02:06:39.005123+0000","last_became_active":"2024-09-12T00:32:21.654241+0000","last_became_peered":"2024-09-12T00:32:21.654241+0000","last_unstale":"2024-09-12T02:06:39.005123+0000","last_undegraded":"2024-09-12T02:06:39.005123+0000","last_fullsized":"2024-09-12T02:06:39.005123+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:08.083982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"266'13","reported_seq":98,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.298455+0000","last_change":"2024-09-12T00:32:14.586986+0000","last_active":"2024-09-12T02:06:46.298455+0000","last_peered":"2024-09-12T02:06:46.298455+0000","last_clean":"2024-09-12T02:06:46.298455+0000","last_became_active":"2024-09-12T00:32:14.586250+0000","last_became_peered":"2024-09-12T00:32:14.586250+0000","last_unstale":"2024-09-12T02:06:46.298455+0000","last_undegraded":"2024-09-12T02:06:46.298455+0000","last_fullsized":"2024-09-12T02:06:46.298455+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.871370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":31734,"num_write":18,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"266'26","reported_seq":142,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967298+0000","last_change":"2024-09-12T00:26:23.334469+0000","last_active":"2024-09-12T02:03:53.967298+0000","last_peered":"2024-09-12T02:03:53.967298+0000","last_clean":"2024-09-12T02:03:53.967298+0000","last_became_active":"2024-09-12T00:26:23.327186+0000","last_became_peered":"2024-09-12T00:26:23.327186+0000","last_unstale":"2024-09-12T02:03:53.967298+0000","last_undegraded":"2024-09-12T02:03:53.967298+0000","last_fullsized":"2024-09-12T02:03:53.967298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:43.603716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.977562+0000","last_change":"2024-09-12T01:00:24.078700+0000","last_active":"2024-09-12T02:04:33.977562+0000","last_peered":"2024-09-12T02:04:33.977562+0000","last_clean":"2024-09-12T02:04:33.977562+0000","last_became_active":"2024-09-12T01:00:24.077651+0000","last_became_peered":"2024-09-12T01:00:24.077651+0000","last_unstale":"2024-09-12T02:04:33.977562+0000","last_undegraded":"2024-09-12T02:04:33.977562+0000","last_fullsized":"2024-09-12T02:04:33.977562+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"266'5","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.657954+0000","last_change":"2024-09-12T00:32:21.651210+0000","last_active":"2024-09-12T02:06:45.657954+0000","last_peered":"2024-09-12T02:06:45.657954+0000","last_clean":"2024-09-12T02:06:45.657954+0000","last_became_active":"2024-09-12T00:32:21.649921+0000","last_became_peered":"2024-09-12T00:32:21.649921+0000","last_unstale":"2024-09-12T02:06:45.657954+0000","last_undegraded":"2024-09-12T02:06:45.657954+0000","last_fullsized":"2024-09-12T02:06:45.657954+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:54.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.528825+0000","last_change":"2024-09-12T00:32:14.608528+0000","last_active":"2024-09-12T02:04:08.528825+0000","last_peered":"2024-09-12T02:04:08.528825+0000","last_clean":"2024-09-12T02:04:08.528825+0000","last_became_active":"2024-09-12T00:32:14.607652+0000","last_became_peered":"2024-09-12T00:32:14.607652+0000","last_unstale":"2024-09-12T02:04:08.528825+0000","last_undegraded":"2024-09-12T02:04:08.528825+0000","last_fullsized":"2024-09-12T02:04:08.528825+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:12.098399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"266'15","reported_seq":114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967169+0000","last_change":"2024-09-12T00:26:23.343440+0000","last_active":"2024-09-12T02:03:53.967169+0000","last_peered":"2024-09-12T02:03:53.967169+0000","last_clean":"2024-09-12T02:03:53.967169+0000","last_became_active":"2024-09-12T00:26:23.339416+0000","last_became_peered":"2024-09-12T00:26:23.339416+0000","last_unstale":"2024-09-12T02:03:53.967169+0000","last_undegraded":"2024-09-12T02:03:53.967169+0000","last_fullsized":"2024-09-12T02:03:53.967169+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:20.570031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.713586+0000","last_change":"2024-09-12T01:00:24.065435+0000","last_active":"2024-09-12T02:04:58.713586+0000","last_peered":"2024-09-12T02:04:58.713586+0000","last_clean":"2024-09-12T02:04:58.713586+0000","last_became_active":"2024-09-12T01:00:24.064732+0000","last_became_peered":"2024-09-12T01:00:24.064732+0000","last_unstale":"2024-09-12T02:04:58.713586+0000","last_undegraded":"2024-09-12T02:04:58.713586+0000","last_fullsized":"2024-09-12T02:04:58.713586+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"266'2","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.755847+0000","last_change":"2024-09-12T00:32:21.650109+0000","last_active":"2024-09-12T02:06:38.755847+0000","last_peered":"2024-09-12T02:06:38.755847+0000","last_clean":"2024-09-12T02:06:38.755847+0000","last_became_active":"2024-09-12T00:32:21.649260+0000","last_became_peered":"2024-09-12T00:32:21.649260+0000","last_unstale":"2024-09-12T02:06:38.755847+0000","last_undegraded":"2024-09-12T02:06:38.755847+0000","last_fullsized":"2024-09-12T02:06:38.755847+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:56.433116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'3","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.758988+0000","last_change":"2024-09-12T00:32:14.582866+0000","last_active":"2024-09-12T02:04:28.758988+0000","last_peered":"2024-09-12T02:04:28.758988+0000","last_clean":"2024-09-12T02:04:28.758988+0000","last_became_active":"2024-09-12T00:32:14.582112+0000","last_became_peered":"2024-09-12T00:32:14.582112+0000","last_unstale":"2024-09-12T02:04:28.758988+0000","last_undegraded":"2024-09-12T02:04:28.758988+0000","last_fullsized":"2024-09-12T02:04:28.758988+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"266'88","reported_seq":399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719464+0000","last_change":"2024-09-12T00:26:23.329328+0000","last_active":"2024-09-12T02:03:53.719464+0000","last_peered":"2024-09-12T02:03:53.719464+0000","last_clean":"2024-09-12T02:03:53.719464+0000","last_became_active":"2024-09-12T00:26:23.328597+0000","last_became_peered":"2024-09-12T00:26:23.328597+0000","last_unstale":"2024-09-12T02:03:53.719464+0000","last_undegraded":"2024-09-12T02:03:53.719464+0000","last_fullsized":"2024-09-12T02:03:53.719464+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:22.412755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":416,"num_write":108,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731863+0000","last_change":"2024-09-12T01:00:24.071788+0000","last_active":"2024-09-12T02:02:53.731863+0000","last_peered":"2024-09-12T02:02:53.731863+0000","last_clean":"2024-09-12T02:02:53.731863+0000","last_became_active":"2024-09-12T01:00:24.071095+0000","last_became_peered":"2024-09-12T01:00:24.071095+0000","last_unstale":"2024-09-12T02:02:53.731863+0000","last_undegraded":"2024-09-12T02:02:53.731863+0000","last_fullsized":"2024-09-12T02:02:53.731863+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:52.669721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"266'9","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.812457+0000","last_change":"2024-09-12T00:32:21.644665+0000","last_active":"2024-09-12T02:06:44.812457+0000","last_peered":"2024-09-12T02:06:44.812457+0000","last_clean":"2024-09-12T02:06:44.812457+0000","last_became_active":"2024-09-12T00:32:21.643876+0000","last_became_peered":"2024-09-12T00:32:21.643876+0000","last_unstale":"2024-09-12T02:06:44.812457+0000","last_undegraded":"2024-09-12T02:06:44.812457+0000","last_fullsized":"2024-09-12T02:06:44.812457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.090050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10236,"num_write":14,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.729779+0000","last_change":"2024-09-12T00:32:14.589458+0000","last_active":"2024-09-12T02:02:18.729779+0000","last_peered":"2024-09-12T02:02:18.729779+0000","last_clean":"2024-09-12T02:02:18.729779+0000","last_became_active":"2024-09-12T00:32:14.588375+0000","last_became_peered":"2024-09-12T00:32:14.588375+0000","last_unstale":"2024-09-12T02:02:18.729779+0000","last_undegraded":"2024-09-12T02:02:18.729779+0000","last_fullsized":"2024-09-12T02:02:18.729779+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:13.114682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7178,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"266'62","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.520452+0000","last_change":"2024-09-12T00:26:23.337872+0000","last_active":"2024-09-12T02:03:33.520452+0000","last_peered":"2024-09-12T02:03:33.520452+0000","last_clean":"2024-09-12T02:03:33.520452+0000","last_became_active":"2024-09-12T00:26:23.336278+0000","last_became_peered":"2024-09-12T00:26:23.336278+0000","last_unstale":"2024-09-12T02:03:33.520452+0000","last_undegraded":"2024-09-12T02:03:33.520452+0000","last_fullsized":"2024-09-12T02:03:33.520452+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:03.462066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":248,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731956+0000","last_change":"2024-09-12T01:00:24.078804+0000","last_active":"2024-09-12T02:02:53.731956+0000","last_peered":"2024-09-12T02:02:53.731956+0000","last_clean":"2024-09-12T02:02:53.731956+0000","last_became_active":"2024-09-12T01:00:24.078120+0000","last_became_peered":"2024-09-12T01:00:24.078120+0000","last_unstale":"2024-09-12T02:02:53.731956+0000","last_undegraded":"2024-09-12T02:02:53.731956+0000","last_fullsized":"2024-09-12T02:02:53.731956+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.036331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:23.942038+0000","last_change":"2024-09-12T00:32:21.654093+0000","last_active":"2024-09-12T02:02:23.942038+0000","last_peered":"2024-09-12T02:02:23.942038+0000","last_clean":"2024-09-12T02:02:23.942038+0000","last_became_active":"2024-09-12T00:32:21.650564+0000","last_became_peered":"2024-09-12T00:32:21.650564+0000","last_unstale":"2024-09-12T02:02:23.942038+0000","last_undegraded":"2024-09-12T02:02:23.942038+0000","last_fullsized":"2024-09-12T02:02:23.942038+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:58.696714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:18.713920+0000","last_change":"2024-09-12T00:32:14.600836+0000","last_active":"2024-09-12T02:02:18.713920+0000","last_peered":"2024-09-12T02:02:18.713920+0000","last_clean":"2024-09-12T02:02:18.713920+0000","last_became_active":"2024-09-12T00:32:14.600188+0000","last_became_peered":"2024-09-12T00:32:14.600188+0000","last_unstale":"2024-09-12T02:02:18.713920+0000","last_undegraded":"2024-09-12T02:02:18.713920+0000","last_fullsized":"2024-09-12T02:02:18.713920+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:48.215097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"266'14","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.686029+0000","last_change":"2024-09-12T00:26:23.325628+0000","last_active":"2024-09-12T02:03:03.686029+0000","last_peered":"2024-09-12T02:03:03.686029+0000","last_clean":"2024-09-12T02:03:03.686029+0000","last_became_active":"2024-09-12T00:26:23.325067+0000","last_became_peered":"2024-09-12T00:26:23.325067+0000","last_unstale":"2024-09-12T02:03:03.686029+0000","last_undegraded":"2024-09-12T02:03:03.686029+0000","last_fullsized":"2024-09-12T02:03:03.686029+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:54.348834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690730+0000","last_change":"2024-09-12T01:00:24.075536+0000","last_active":"2024-09-12T02:03:23.690730+0000","last_peered":"2024-09-12T02:03:23.690730+0000","last_clean":"2024-09-12T02:03:23.690730+0000","last_became_active":"2024-09-12T01:00:24.075148+0000","last_became_peered":"2024-09-12T01:00:24.075148+0000","last_unstale":"2024-09-12T02:03:23.690730+0000","last_undegraded":"2024-09-12T02:03:23.690730+0000","last_fullsized":"2024-09-12T02:03:23.690730+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:59.023799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"266'2","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:39.005064+0000","last_change":"2024-09-12T00:32:21.658733+0000","last_active":"2024-09-12T02:06:39.005064+0000","last_peered":"2024-09-12T02:06:39.005064+0000","last_clean":"2024-09-12T02:06:39.005064+0000","last_became_active":"2024-09-12T00:32:21.654214+0000","last_became_peered":"2024-09-12T00:32:21.654214+0000","last_unstale":"2024-09-12T02:06:39.005064+0000","last_undegraded":"2024-09-12T02:06:39.005064+0000","last_fullsized":"2024-09-12T02:06:39.005064+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.587733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'5","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735335+0000","last_change":"2024-09-12T00:32:14.586921+0000","last_active":"2024-09-12T02:03:24.735335+0000","last_peered":"2024-09-12T02:03:24.735335+0000","last_clean":"2024-09-12T02:03:24.735335+0000","last_became_active":"2024-09-12T00:32:14.586101+0000","last_became_peered":"2024-09-12T00:32:14.586101+0000","last_unstale":"2024-09-12T02:03:24.735335+0000","last_undegraded":"2024-09-12T02:03:24.735335+0000","last_fullsized":"2024-09-12T02:03:24.735335+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:16.213342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"266'18","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.724550+0000","last_change":"2024-09-12T00:26:23.351546+0000","last_active":"2024-09-12T02:03:03.724550+0000","last_peered":"2024-09-12T02:03:03.724550+0000","last_clean":"2024-09-12T02:03:03.724550+0000","last_became_active":"2024-09-12T00:26:23.338890+0000","last_became_peered":"2024-09-12T00:26:23.338890+0000","last_unstale":"2024-09-12T02:03:03.724550+0000","last_undegraded":"2024-09-12T02:03:03.724550+0000","last_fullsized":"2024-09-12T02:03:03.724550+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:29.634760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.701374+0000","last_change":"2024-09-12T01:00:24.076901+0000","last_active":"2024-09-12T02:03:23.701374+0000","last_peered":"2024-09-12T02:03:23.701374+0000","last_clean":"2024-09-12T02:03:23.701374+0000","last_became_active":"2024-09-12T01:00:24.076081+0000","last_became_peered":"2024-09-12T01:00:24.076081+0000","last_unstale":"2024-09-12T02:03:23.701374+0000","last_undegraded":"2024-09-12T02:03:23.701374+0000","last_fullsized":"2024-09-12T02:03:23.701374+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:03.511093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'5","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.962875+0000","last_change":"2024-09-12T00:32:21.665472+0000","last_active":"2024-09-12T02:03:38.962875+0000","last_peered":"2024-09-12T02:03:38.962875+0000","last_clean":"2024-09-12T02:03:38.962875+0000","last_became_active":"2024-09-12T00:32:21.659460+0000","last_became_peered":"2024-09-12T00:32:21.659460+0000","last_unstale":"2024-09-12T02:03:38.962875+0000","last_undegraded":"2024-09-12T02:03:38.962875+0000","last_fullsized":"2024-09-12T02:03:38.962875+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:34.362543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:33.784493+0000","last_change":"2024-09-12T00:32:14.595556+0000","last_active":"2024-09-12T02:06:33.784493+0000","last_peered":"2024-09-12T02:06:33.784493+0000","last_clean":"2024-09-12T02:06:33.784493+0000","last_became_active":"2024-09-12T00:32:14.594973+0000","last_became_peered":"2024-09-12T00:32:14.594973+0000","last_unstale":"2024-09-12T02:06:33.784493+0000","last_undegraded":"2024-09-12T02:06:33.784493+0000","last_fullsized":"2024-09-12T02:06:33.784493+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":200,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.953162+0000","last_change":"2024-09-12T00:26:23.344345+0000","last_active":"2024-09-12T02:03:03.953162+0000","last_peered":"2024-09-12T02:03:03.953162+0000","last_clean":"2024-09-12T02:03:03.953162+0000","last_became_active":"2024-09-12T00:26:23.338462+0000","last_became_peered":"2024-09-12T00:26:23.338462+0000","last_unstale":"2024-09-12T02:03:03.953162+0000","last_undegraded":"2024-09-12T02:03:03.953162+0000","last_fullsized":"2024-09-12T02:03:03.953162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:51.275824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":170,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738756+0000","last_change":"2024-09-12T01:00:24.077452+0000","last_active":"2024-09-12T02:03:23.738756+0000","last_peered":"2024-09-12T02:03:23.738756+0000","last_clean":"2024-09-12T02:03:23.738756+0000","last_became_active":"2024-09-12T01:00:24.070957+0000","last_became_peered":"2024-09-12T01:00:24.070957+0000","last_unstale":"2024-09-12T02:03:23.738756+0000","last_undegraded":"2024-09-12T02:03:23.738756+0000","last_fullsized":"2024-09-12T02:03:23.738756+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:02.724541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:39.005148+0000","last_change":"2024-09-12T00:32:21.665635+0000","last_active":"2024-09-12T02:06:39.005148+0000","last_peered":"2024-09-12T02:06:39.005148+0000","last_clean":"2024-09-12T02:06:39.005148+0000","last_became_active":"2024-09-12T00:32:21.665036+0000","last_became_peered":"2024-09-12T00:32:21.665036+0000","last_unstale":"2024-09-12T02:06:39.005148+0000","last_undegraded":"2024-09-12T02:06:39.005148+0000","last_fullsized":"2024-09-12T02:06:39.005148+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.207114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:28.737035+0000","last_change":"2024-09-12T00:32:14.599371+0000","last_active":"2024-09-12T02:06:28.737035+0000","last_peered":"2024-09-12T02:06:28.737035+0000","last_clean":"2024-09-12T02:06:28.737035+0000","last_became_active":"2024-09-12T00:32:14.597944+0000","last_became_peered":"2024-09-12T00:32:14.597944+0000","last_unstale":"2024-09-12T02:06:28.737035+0000","last_undegraded":"2024-09-12T02:06:28.737035+0000","last_fullsized":"2024-09-12T02:06:28.737035+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:39.404510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"266'38","reported_seq":167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.696938+0000","last_change":"2024-09-12T00:26:23.318556+0000","last_active":"2024-09-12T02:03:03.696938+0000","last_peered":"2024-09-12T02:03:03.696938+0000","last_clean":"2024-09-12T02:03:03.696938+0000","last_became_active":"2024-09-12T00:26:23.317790+0000","last_became_peered":"2024-09-12T00:26:23.317790+0000","last_unstale":"2024-09-12T02:03:03.696938+0000","last_undegraded":"2024-09-12T02:03:03.696938+0000","last_fullsized":"2024-09-12T02:03:03.696938+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:59.781401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":107,"num_write":80,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735210+0000","last_change":"2024-09-12T01:00:24.078191+0000","last_active":"2024-09-12T02:03:24.735210+0000","last_peered":"2024-09-12T02:03:24.735210+0000","last_clean":"2024-09-12T02:03:24.735210+0000","last_became_active":"2024-09-12T01:00:24.077509+0000","last_became_peered":"2024-09-12T01:00:24.077509+0000","last_unstale":"2024-09-12T02:03:24.735210+0000","last_undegraded":"2024-09-12T02:03:24.735210+0000","last_fullsized":"2024-09-12T02:03:24.735210+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.532459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"266'2","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.788301+0000","last_change":"2024-09-12T00:32:21.652772+0000","last_active":"2024-09-12T02:06:38.788301+0000","last_peered":"2024-09-12T02:06:38.788301+0000","last_clean":"2024-09-12T02:06:38.788301+0000","last_became_active":"2024-09-12T00:32:21.644753+0000","last_became_peered":"2024-09-12T00:32:21.644753+0000","last_unstale":"2024-09-12T02:06:38.788301+0000","last_undegraded":"2024-09-12T02:06:38.788301+0000","last_fullsized":"2024-09-12T02:06:38.788301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:09.209891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:33.561239+0000","last_change":"2024-09-12T00:32:14.600221+0000","last_active":"2024-09-12T02:06:33.561239+0000","last_peered":"2024-09-12T02:06:33.561239+0000","last_clean":"2024-09-12T02:06:33.561239+0000","last_became_active":"2024-09-12T00:32:14.599452+0000","last_became_peered":"2024-09-12T00:32:14.599452+0000","last_unstale":"2024-09-12T02:06:33.561239+0000","last_undegraded":"2024-09-12T02:06:33.561239+0000","last_fullsized":"2024-09-12T02:06:33.561239+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:29.978923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"266'136","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.758592+0000","last_change":"2024-09-12T00:26:23.321368+0000","last_active":"2024-09-12T02:04:43.758592+0000","last_peered":"2024-09-12T02:04:43.758592+0000","last_clean":"2024-09-12T02:04:43.758592+0000","last_became_active":"2024-09-12T00:26:23.320613+0000","last_became_peered":"2024-09-12T00:26:23.320613+0000","last_unstale":"2024-09-12T02:04:43.758592+0000","last_undegraded":"2024-09-12T02:04:43.758592+0000","last_fullsized":"2024-09-12T02:04:43.758592+0000","mapping_epoch":253,"log_start":"263'100","ondisk_log_start":"263'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":872,"num_read_kb":592,"num_write":184,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956392+0000","last_change":"2024-09-12T01:00:24.061484+0000","last_active":"2024-09-12T02:03:13.956392+0000","last_peered":"2024-09-12T02:03:13.956392+0000","last_clean":"2024-09-12T02:03:13.956392+0000","last_became_active":"2024-09-12T01:00:24.060699+0000","last_became_peered":"2024-09-12T01:00:24.060699+0000","last_unstale":"2024-09-12T02:03:13.956392+0000","last_undegraded":"2024-09-12T02:03:13.956392+0000","last_fullsized":"2024-09-12T02:03:13.956392+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:39.025638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690685+0000","last_change":"2024-09-12T00:32:21.652868+0000","last_active":"2024-09-12T02:03:23.690685+0000","last_peered":"2024-09-12T02:03:23.690685+0000","last_clean":"2024-09-12T02:03:23.690685+0000","last_became_active":"2024-09-12T00:32:21.652122+0000","last_became_peered":"2024-09-12T00:32:21.652122+0000","last_unstale":"2024-09-12T02:03:23.690685+0000","last_undegraded":"2024-09-12T02:03:23.690685+0000","last_fullsized":"2024-09-12T02:03:23.690685+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:49.993050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"266'7","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:38.774817+0000","last_change":"2024-09-12T00:32:14.592680+0000","last_active":"2024-09-12T02:05:38.774817+0000","last_peered":"2024-09-12T02:05:38.774817+0000","last_clean":"2024-09-12T02:05:38.774817+0000","last_became_active":"2024-09-12T00:32:14.591921+0000","last_became_peered":"2024-09-12T00:32:14.591921+0000","last_unstale":"2024-09-12T02:05:38.774817+0000","last_undegraded":"2024-09-12T02:05:38.774817+0000","last_fullsized":"2024-09-12T02:05:38.774817+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:15.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3114,"num_write":12,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"266'28","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753409+0000","last_change":"2024-09-12T00:26:23.323596+0000","last_active":"2024-09-12T02:04:23.753409+0000","last_peered":"2024-09-12T02:04:23.753409+0000","last_clean":"2024-09-12T02:04:23.753409+0000","last_became_active":"2024-09-12T00:26:23.322866+0000","last_became_peered":"2024-09-12T00:26:23.322866+0000","last_unstale":"2024-09-12T02:04:23.753409+0000","last_undegraded":"2024-09-12T02:04:23.753409+0000","last_fullsized":"2024-09-12T02:04:23.753409+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:51.001961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727306+0000","last_change":"2024-09-12T01:00:24.064920+0000","last_active":"2024-09-12T02:03:13.727306+0000","last_peered":"2024-09-12T02:03:13.727306+0000","last_clean":"2024-09-12T02:03:13.727306+0000","last_became_active":"2024-09-12T01:00:24.064203+0000","last_became_peered":"2024-09-12T01:00:24.064203+0000","last_unstale":"2024-09-12T02:03:13.727306+0000","last_undegraded":"2024-09-12T02:03:13.727306+0000","last_fullsized":"2024-09-12T02:03:13.727306+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:14.355731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"266'7","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.657111+0000","last_change":"2024-09-12T00:32:21.660277+0000","last_active":"2024-09-12T02:06:45.657111+0000","last_peered":"2024-09-12T02:06:45.657111+0000","last_clean":"2024-09-12T02:06:45.657111+0000","last_became_active":"2024-09-12T00:32:21.659437+0000","last_became_peered":"2024-09-12T00:32:21.659437+0000","last_unstale":"2024-09-12T02:06:45.657111+0000","last_undegraded":"2024-09-12T02:06:45.657111+0000","last_fullsized":"2024-09-12T02:06:45.657111+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:42.910621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":12,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"266'9","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:33.990232+0000","last_change":"2024-09-12T00:32:14.599370+0000","last_active":"2024-09-12T02:05:33.990232+0000","last_peered":"2024-09-12T02:05:33.990232+0000","last_clean":"2024-09-12T02:05:33.990232+0000","last_became_active":"2024-09-12T00:32:14.597986+0000","last_became_peered":"2024-09-12T00:32:14.597986+0000","last_unstale":"2024-09-12T02:05:33.990232+0000","last_undegraded":"2024-09-12T02:05:33.990232+0000","last_fullsized":"2024-09-12T02:05:33.990232+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:36.841276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"266'46","reported_seq":199,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.532349+0000","last_change":"2024-09-12T00:26:23.336761+0000","last_active":"2024-09-12T02:04:23.532349+0000","last_peered":"2024-09-12T02:04:23.532349+0000","last_clean":"2024-09-12T02:04:23.532349+0000","last_became_active":"2024-09-12T00:26:23.336010+0000","last_became_peered":"2024-09-12T00:26:23.336010+0000","last_unstale":"2024-09-12T02:04:23.532349+0000","last_undegraded":"2024-09-12T02:04:23.532349+0000","last_fullsized":"2024-09-12T02:04:23.532349+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:52.664889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.523057+0000","last_change":"2024-09-12T01:00:24.074232+0000","last_active":"2024-09-12T02:03:43.523057+0000","last_peered":"2024-09-12T02:03:43.523057+0000","last_clean":"2024-09-12T02:03:43.523057+0000","last_became_active":"2024-09-12T01:00:24.061624+0000","last_became_peered":"2024-09-12T01:00:24.061624+0000","last_unstale":"2024-09-12T02:03:43.523057+0000","last_undegraded":"2024-09-12T02:03:43.523057+0000","last_fullsized":"2024-09-12T02:03:43.523057+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:30.381075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'7","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959211+0000","last_change":"2024-09-12T00:32:21.667593+0000","last_active":"2024-09-12T02:03:23.959211+0000","last_peered":"2024-09-12T02:03:23.959211+0000","last_clean":"2024-09-12T02:03:23.959211+0000","last_became_active":"2024-09-12T00:32:21.666101+0000","last_became_peered":"2024-09-12T00:32:21.666101+0000","last_unstale":"2024-09-12T02:03:23.959211+0000","last_undegraded":"2024-09-12T02:03:23.959211+0000","last_fullsized":"2024-09-12T02:03:23.959211+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:18.302518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3603,"num_write":12,"num_write_kb":1553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"266'3","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:38.742679+0000","last_change":"2024-09-12T00:32:14.580110+0000","last_active":"2024-09-12T02:05:38.742679+0000","last_peered":"2024-09-12T02:05:38.742679+0000","last_clean":"2024-09-12T02:05:38.742679+0000","last_became_active":"2024-09-12T00:32:14.579366+0000","last_became_peered":"2024-09-12T00:32:14.579366+0000","last_unstale":"2024-09-12T02:05:38.742679+0000","last_undegraded":"2024-09-12T02:05:38.742679+0000","last_fullsized":"2024-09-12T02:05:38.742679+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.632825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'8","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.757917+0000","last_change":"2024-09-12T00:26:23.323680+0000","last_active":"2024-09-12T02:04:23.757917+0000","last_peered":"2024-09-12T02:04:23.757917+0000","last_clean":"2024-09-12T02:04:23.757917+0000","last_became_active":"2024-09-12T00:26:23.322841+0000","last_became_peered":"2024-09-12T00:26:23.322841+0000","last_unstale":"2024-09-12T02:04:23.757917+0000","last_undegraded":"2024-09-12T02:04:23.757917+0000","last_fullsized":"2024-09-12T02:04:23.757917+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956312+0000","last_change":"2024-09-12T01:00:24.060507+0000","last_active":"2024-09-12T02:03:13.956312+0000","last_peered":"2024-09-12T02:03:13.956312+0000","last_clean":"2024-09-12T02:03:13.956312+0000","last_became_active":"2024-09-12T01:00:24.057061+0000","last_became_peered":"2024-09-12T01:00:24.057061+0000","last_unstale":"2024-09-12T02:03:13.956312+0000","last_undegraded":"2024-09-12T02:03:13.956312+0000","last_fullsized":"2024-09-12T02:03:13.956312+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:07.370347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"266'6","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.497296+0000","last_change":"2024-09-12T00:32:21.647911+0000","last_active":"2024-09-12T02:06:46.497296+0000","last_peered":"2024-09-12T02:06:46.497296+0000","last_clean":"2024-09-12T02:06:46.497296+0000","last_became_active":"2024-09-12T00:32:21.646690+0000","last_became_peered":"2024-09-12T00:32:21.646690+0000","last_unstale":"2024-09-12T02:06:46.497296+0000","last_undegraded":"2024-09-12T02:06:46.497296+0000","last_fullsized":"2024-09-12T02:06:46.497296+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:03.430085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2096,"num_write":6,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:14.733091+0000","last_change":"2024-09-12T00:32:14.577083+0000","last_active":"2024-09-12T02:03:14.733091+0000","last_peered":"2024-09-12T02:03:14.733091+0000","last_clean":"2024-09-12T02:03:14.733091+0000","last_became_active":"2024-09-12T00:32:14.576353+0000","last_became_peered":"2024-09-12T00:32:14.576353+0000","last_unstale":"2024-09-12T02:03:14.733091+0000","last_undegraded":"2024-09-12T02:03:14.733091+0000","last_fullsized":"2024-09-12T02:03:14.733091+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:17.483406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"266'19","reported_seq":129,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974634+0000","last_change":"2024-09-12T00:26:23.342320+0000","last_active":"2024-09-12T02:04:23.974634+0000","last_peered":"2024-09-12T02:04:23.974634+0000","last_clean":"2024-09-12T02:04:23.974634+0000","last_became_active":"2024-09-12T00:26:23.334078+0000","last_became_peered":"2024-09-12T00:26:23.334078+0000","last_unstale":"2024-09-12T02:04:23.974634+0000","last_undegraded":"2024-09-12T02:04:23.974634+0000","last_fullsized":"2024-09-12T02:04:23.974634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.869261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":39,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:28.702468+0000","last_change":"2024-09-12T01:00:24.076331+0000","last_active":"2024-09-12T02:03:28.702468+0000","last_peered":"2024-09-12T02:03:28.702468+0000","last_clean":"2024-09-12T02:03:28.702468+0000","last_became_active":"2024-09-12T01:00:24.075944+0000","last_became_peered":"2024-09-12T01:00:24.075944+0000","last_unstale":"2024-09-12T02:03:28.702468+0000","last_undegraded":"2024-09-12T02:03:28.702468+0000","last_fullsized":"2024-09-12T02:03:28.702468+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.174854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"266'4","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.077517+0000","last_change":"2024-09-12T00:32:21.653900+0000","last_active":"2024-09-12T02:06:46.077517+0000","last_peered":"2024-09-12T02:06:46.077517+0000","last_clean":"2024-09-12T02:06:46.077517+0000","last_became_active":"2024-09-12T00:32:21.653054+0000","last_became_peered":"2024-09-12T00:32:21.653054+0000","last_unstale":"2024-09-12T02:06:46.077517+0000","last_undegraded":"2024-09-12T02:06:46.077517+0000","last_fullsized":"2024-09-12T02:06:46.077517+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8207,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"266'10","reported_seq":91,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.035102+0000","last_change":"2024-09-12T00:32:14.597055+0000","last_active":"2024-09-12T02:06:45.035102+0000","last_peered":"2024-09-12T02:06:45.035102+0000","last_clean":"2024-09-12T02:06:45.035102+0000","last_became_active":"2024-09-12T00:32:14.596393+0000","last_became_peered":"2024-09-12T00:32:14.596393+0000","last_unstale":"2024-09-12T02:06:45.035102+0000","last_undegraded":"2024-09-12T02:06:45.035102+0000","last_fullsized":"2024-09-12T02:06:45.035102+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:35.143044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9234,"num_write":10,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"266'13","reported_seq":109,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959403+0000","last_change":"2024-09-12T00:26:23.354584+0000","last_active":"2024-09-12T02:03:23.959403+0000","last_peered":"2024-09-12T02:03:23.959403+0000","last_clean":"2024-09-12T02:03:23.959403+0000","last_became_active":"2024-09-12T00:26:23.353590+0000","last_became_peered":"2024-09-12T00:26:23.353590+0000","last_unstale":"2024-09-12T02:03:23.959403+0000","last_undegraded":"2024-09-12T02:03:23.959403+0000","last_fullsized":"2024-09-12T02:03:23.959403+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:36.184285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":34,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738884+0000","last_change":"2024-09-12T01:00:24.070343+0000","last_active":"2024-09-12T02:03:23.738884+0000","last_peered":"2024-09-12T02:03:23.738884+0000","last_clean":"2024-09-12T02:03:23.738884+0000","last_became_active":"2024-09-12T01:00:24.069491+0000","last_became_peered":"2024-09-12T01:00:24.069491+0000","last_unstale":"2024-09-12T02:03:23.738884+0000","last_undegraded":"2024-09-12T02:03:23.738884+0000","last_fullsized":"2024-09-12T02:03:23.738884+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:08.859472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.978838+0000","last_change":"2024-09-12T00:32:21.668898+0000","last_active":"2024-09-12T02:04:38.978838+0000","last_peered":"2024-09-12T02:04:38.978838+0000","last_clean":"2024-09-12T02:04:38.978838+0000","last_became_active":"2024-09-12T00:32:21.668268+0000","last_became_peered":"2024-09-12T00:32:21.668268+0000","last_unstale":"2024-09-12T02:04:38.978838+0000","last_undegraded":"2024-09-12T02:04:38.978838+0000","last_fullsized":"2024-09-12T02:04:38.978838+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"266'7","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.567934+0000","last_change":"2024-09-12T00:32:14.610770+0000","last_active":"2024-09-12T02:06:45.567934+0000","last_peered":"2024-09-12T02:06:45.567934+0000","last_clean":"2024-09-12T02:06:45.567934+0000","last_became_active":"2024-09-12T00:32:14.610187+0000","last_became_peered":"2024-09-12T00:32:14.610187+0000","last_unstale":"2024-09-12T02:06:45.567934+0000","last_undegraded":"2024-09-12T02:06:45.567934+0000","last_fullsized":"2024-09-12T02:06:45.567934+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:04.103920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2577,"num_write":12,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:09.732099+0000","last_change":"2024-09-12T00:26:23.333218+0000","last_active":"2024-09-12T02:03:09.732099+0000","last_peered":"2024-09-12T02:03:09.732099+0000","last_clean":"2024-09-12T02:03:09.732099+0000","last_became_active":"2024-09-12T00:26:23.328238+0000","last_became_peered":"2024-09-12T00:26:23.328238+0000","last_unstale":"2024-09-12T02:03:09.732099+0000","last_undegraded":"2024-09-12T02:03:09.732099+0000","last_fullsized":"2024-09-12T02:03:09.732099+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:08.447428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.710796+0000","last_change":"2024-09-12T01:00:24.075014+0000","last_active":"2024-09-12T02:03:13.710796+0000","last_peered":"2024-09-12T02:03:13.710796+0000","last_clean":"2024-09-12T02:03:13.710796+0000","last_became_active":"2024-09-12T01:00:24.074237+0000","last_became_peered":"2024-09-12T01:00:24.074237+0000","last_unstale":"2024-09-12T02:03:13.710796+0000","last_undegraded":"2024-09-12T02:03:13.710796+0000","last_fullsized":"2024-09-12T02:03:13.710796+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:45.410941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.683956+0000","last_change":"2024-09-12T00:32:21.643228+0000","last_active":"2024-09-12T02:02:53.683956+0000","last_peered":"2024-09-12T02:02:53.683956+0000","last_clean":"2024-09-12T02:02:53.683956+0000","last_became_active":"2024-09-12T00:32:21.642517+0000","last_became_peered":"2024-09-12T00:32:21.642517+0000","last_unstale":"2024-09-12T02:02:53.683956+0000","last_undegraded":"2024-09-12T02:02:53.683956+0000","last_fullsized":"2024-09-12T02:02:53.683956+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:33.274779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.299857+0000","last_change":"2024-09-12T00:32:14.608254+0000","last_active":"2024-09-12T02:06:46.299857+0000","last_peered":"2024-09-12T02:06:46.299857+0000","last_clean":"2024-09-12T02:06:46.299857+0000","last_became_active":"2024-09-12T00:32:14.607520+0000","last_became_peered":"2024-09-12T00:32:14.607520+0000","last_unstale":"2024-09-12T02:06:46.299857+0000","last_undegraded":"2024-09-12T02:06:46.299857+0000","last_fullsized":"2024-09-12T02:06:46.299857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:55.311964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"266'27","reported_seq":149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.709720+0000","last_change":"2024-09-12T00:26:23.314752+0000","last_active":"2024-09-12T02:03:08.709720+0000","last_peered":"2024-09-12T02:03:08.709720+0000","last_clean":"2024-09-12T02:03:08.709720+0000","last_became_active":"2024-09-12T00:26:23.313697+0000","last_became_peered":"2024-09-12T00:26:23.313697+0000","last_unstale":"2024-09-12T02:03:08.709720+0000","last_undegraded":"2024-09-12T02:03:08.709720+0000","last_fullsized":"2024-09-12T02:03:08.709720+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:17.759882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.736399+0000","last_change":"2024-09-12T01:00:24.077672+0000","last_active":"2024-09-12T02:03:13.736399+0000","last_peered":"2024-09-12T02:03:13.736399+0000","last_clean":"2024-09-12T02:03:13.736399+0000","last_became_active":"2024-09-12T01:00:24.072931+0000","last_became_peered":"2024-09-12T01:00:24.072931+0000","last_unstale":"2024-09-12T02:03:13.736399+0000","last_undegraded":"2024-09-12T02:03:13.736399+0000","last_fullsized":"2024-09-12T02:03:13.736399+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:03.310383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.495060+0000","last_change":"2024-09-12T00:32:21.649878+0000","last_active":"2024-09-12T02:06:46.495060+0000","last_peered":"2024-09-12T02:06:46.495060+0000","last_clean":"2024-09-12T02:06:46.495060+0000","last_became_active":"2024-09-12T00:32:21.641431+0000","last_became_peered":"2024-09-12T00:32:21.641431+0000","last_unstale":"2024-09-12T02:06:46.495060+0000","last_undegraded":"2024-09-12T02:06:46.495060+0000","last_fullsized":"2024-09-12T02:06:46.495060+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20470,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.713628+0000","last_change":"2024-09-12T00:32:14.597040+0000","last_active":"2024-09-12T02:04:58.713628+0000","last_peered":"2024-09-12T02:04:58.713628+0000","last_clean":"2024-09-12T02:04:58.713628+0000","last_became_active":"2024-09-12T00:32:14.596263+0000","last_became_peered":"2024-09-12T00:32:14.596263+0000","last_unstale":"2024-09-12T02:04:58.713628+0000","last_undegraded":"2024-09-12T02:04:58.713628+0000","last_fullsized":"2024-09-12T02:04:58.713628+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"266'66","reported_seq":265,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.698119+0000","last_change":"2024-09-12T00:26:23.328307+0000","last_active":"2024-09-12T02:03:08.698119+0000","last_peered":"2024-09-12T02:03:08.698119+0000","last_clean":"2024-09-12T02:03:08.698119+0000","last_became_active":"2024-09-12T00:26:23.327784+0000","last_became_peered":"2024-09-12T00:26:23.327784+0000","last_unstale":"2024-09-12T02:03:08.698119+0000","last_undegraded":"2024-09-12T02:03:08.698119+0000","last_fullsized":"2024-09-12T02:03:08.698119+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:59.830797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":253,"num_write":117,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959347+0000","last_change":"2024-09-12T01:00:24.067841+0000","last_active":"2024-09-12T02:03:23.959347+0000","last_peered":"2024-09-12T02:03:23.959347+0000","last_clean":"2024-09-12T02:03:23.959347+0000","last_became_active":"2024-09-12T01:00:24.066842+0000","last_became_peered":"2024-09-12T01:00:24.066842+0000","last_unstale":"2024-09-12T02:03:23.959347+0000","last_undegraded":"2024-09-12T02:03:23.959347+0000","last_fullsized":"2024-09-12T02:03:23.959347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:36.376146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.744288+0000","last_change":"2024-09-12T00:32:21.667714+0000","last_active":"2024-09-12T02:03:23.744288+0000","last_peered":"2024-09-12T02:03:23.744288+0000","last_clean":"2024-09-12T02:03:23.744288+0000","last_became_active":"2024-09-12T00:32:21.667149+0000","last_became_peered":"2024-09-12T00:32:21.667149+0000","last_unstale":"2024-09-12T02:03:23.744288+0000","last_undegraded":"2024-09-12T02:03:23.744288+0000","last_fullsized":"2024-09-12T02:03:23.744288+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:34.141900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"266'3","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:28.547343+0000","last_change":"2024-09-12T00:32:14.601942+0000","last_active":"2024-09-12T02:05:28.547343+0000","last_peered":"2024-09-12T02:05:28.547343+0000","last_clean":"2024-09-12T02:05:28.547343+0000","last_became_active":"2024-09-12T00:32:14.601148+0000","last_became_peered":"2024-09-12T00:32:14.601148+0000","last_unstale":"2024-09-12T02:05:28.547343+0000","last_undegraded":"2024-09-12T02:05:28.547343+0000","last_fullsized":"2024-09-12T02:05:28.547343+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:16.003152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"266'39","reported_seq":182,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.725801+0000","last_change":"2024-09-12T00:26:23.318410+0000","last_active":"2024-09-12T02:03:08.725801+0000","last_peered":"2024-09-12T02:03:08.725801+0000","last_clean":"2024-09-12T02:03:08.725801+0000","last_became_active":"2024-09-12T00:26:23.317880+0000","last_became_peered":"2024-09-12T00:26:23.317880+0000","last_unstale":"2024-09-12T02:03:08.725801+0000","last_undegraded":"2024-09-12T02:03:08.725801+0000","last_fullsized":"2024-09-12T02:03:08.725801+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:35.423826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.742402+0000","last_change":"2024-09-12T01:00:24.086998+0000","last_active":"2024-09-12T02:03:38.742402+0000","last_peered":"2024-09-12T02:03:38.742402+0000","last_clean":"2024-09-12T02:03:38.742402+0000","last_became_active":"2024-09-12T01:00:24.086101+0000","last_became_peered":"2024-09-12T01:00:24.086101+0000","last_unstale":"2024-09-12T02:03:38.742402+0000","last_undegraded":"2024-09-12T02:03:38.742402+0000","last_fullsized":"2024-09-12T02:03:38.742402+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.433366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738790+0000","last_change":"2024-09-12T00:32:21.639641+0000","last_active":"2024-09-12T02:03:23.738790+0000","last_peered":"2024-09-12T02:03:23.738790+0000","last_clean":"2024-09-12T02:03:23.738790+0000","last_became_active":"2024-09-12T00:32:21.634440+0000","last_became_peered":"2024-09-12T00:32:21.634440+0000","last_unstale":"2024-09-12T02:03:23.738790+0000","last_undegraded":"2024-09-12T02:03:23.738790+0000","last_fullsized":"2024-09-12T02:03:23.738790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:52.190306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.770418+0000","last_change":"2024-09-12T00:32:14.596514+0000","last_active":"2024-09-12T02:06:45.770418+0000","last_peered":"2024-09-12T02:06:45.770418+0000","last_clean":"2024-09-12T02:06:45.770418+0000","last_became_active":"2024-09-12T00:32:14.595782+0000","last_became_peered":"2024-09-12T00:32:14.595782+0000","last_unstale":"2024-09-12T02:06:45.770418+0000","last_undegraded":"2024-09-12T02:06:45.770418+0000","last_fullsized":"2024-09-12T02:06:45.770418+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:40.885479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":165,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:13.750980+0000","last_change":"2024-09-12T00:26:23.324857+0000","last_active":"2024-09-12T02:04:13.750980+0000","last_peered":"2024-09-12T02:04:13.750980+0000","last_clean":"2024-09-12T02:04:13.750980+0000","last_became_active":"2024-09-12T00:26:23.324140+0000","last_became_peered":"2024-09-12T00:26:23.324140+0000","last_unstale":"2024-09-12T02:04:13.750980+0000","last_undegraded":"2024-09-12T02:04:13.750980+0000","last_fullsized":"2024-09-12T02:04:13.750980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:21.938963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":114,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738926+0000","last_change":"2024-09-12T01:00:24.081545+0000","last_active":"2024-09-12T02:03:23.738926+0000","last_peered":"2024-09-12T02:03:23.738926+0000","last_clean":"2024-09-12T02:03:23.738926+0000","last_became_active":"2024-09-12T01:00:24.080855+0000","last_became_peered":"2024-09-12T01:00:24.080855+0000","last_unstale":"2024-09-12T02:03:23.738926+0000","last_undegraded":"2024-09-12T02:03:23.738926+0000","last_fullsized":"2024-09-12T02:03:23.738926+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:06.572347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'4","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708186+0000","last_change":"2024-09-12T00:32:21.649120+0000","last_active":"2024-09-12T02:04:38.708186+0000","last_peered":"2024-09-12T02:04:38.708186+0000","last_clean":"2024-09-12T02:04:38.708186+0000","last_became_active":"2024-09-12T00:32:21.648333+0000","last_became_peered":"2024-09-12T00:32:21.648333+0000","last_unstale":"2024-09-12T02:04:38.708186+0000","last_undegraded":"2024-09-12T02:04:38.708186+0000","last_fullsized":"2024-09-12T02:04:38.708186+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"266'4","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.770058+0000","last_change":"2024-09-12T00:32:14.600607+0000","last_active":"2024-09-12T02:06:45.770058+0000","last_peered":"2024-09-12T02:06:45.770058+0000","last_clean":"2024-09-12T02:06:45.770058+0000","last_became_active":"2024-09-12T00:32:14.592875+0000","last_became_peered":"2024-09-12T00:32:14.592875+0000","last_unstale":"2024-09-12T02:06:45.770058+0000","last_undegraded":"2024-09-12T02:06:45.770058+0000","last_fullsized":"2024-09-12T02:06:45.770058+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:09.233319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"266'15","reported_seq":118,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.966977+0000","last_change":"2024-09-12T00:26:23.325693+0000","last_active":"2024-09-12T02:03:53.966977+0000","last_peered":"2024-09-12T02:03:53.966977+0000","last_clean":"2024-09-12T02:03:53.966977+0000","last_became_active":"2024-09-12T00:26:23.324884+0000","last_became_peered":"2024-09-12T00:26:23.324884+0000","last_unstale":"2024-09-12T02:03:53.966977+0000","last_undegraded":"2024-09-12T02:03:53.966977+0000","last_fullsized":"2024-09-12T02:03:53.966977+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:53.038478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.517888+0000","last_change":"2024-09-12T01:00:24.062624+0000","last_active":"2024-09-12T02:03:23.517888+0000","last_peered":"2024-09-12T02:03:23.517888+0000","last_clean":"2024-09-12T02:03:23.517888+0000","last_became_active":"2024-09-12T01:00:24.061882+0000","last_became_peered":"2024-09-12T01:00:24.061882+0000","last_unstale":"2024-09-12T02:03:23.517888+0000","last_undegraded":"2024-09-12T02:03:23.517888+0000","last_fullsized":"2024-09-12T02:03:23.517888+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:52.723554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'4","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743502+0000","last_change":"2024-09-12T00:32:21.668310+0000","last_active":"2024-09-12T02:03:43.743502+0000","last_peered":"2024-09-12T02:03:43.743502+0000","last_clean":"2024-09-12T02:03:43.743502+0000","last_became_active":"2024-09-12T00:32:21.667346+0000","last_became_peered":"2024-09-12T00:32:21.667346+0000","last_unstale":"2024-09-12T02:03:43.743502+0000","last_undegraded":"2024-09-12T02:03:43.743502+0000","last_fullsized":"2024-09-12T02:03:43.743502+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:33.558216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"266'9","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.262602+0000","last_change":"2024-09-12T00:32:14.577757+0000","last_active":"2024-09-12T02:06:47.262602+0000","last_peered":"2024-09-12T02:06:47.262602+0000","last_clean":"2024-09-12T02:06:47.262602+0000","last_became_active":"2024-09-12T00:32:14.576974+0000","last_became_peered":"2024-09-12T00:32:14.576974+0000","last_unstale":"2024-09-12T02:06:47.262602+0000","last_undegraded":"2024-09-12T02:06:47.262602+0000","last_fullsized":"2024-09-12T02:06:47.262602+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:03.910967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4127,"num_write":14,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"266'52","reported_seq":231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719368+0000","last_change":"2024-09-12T00:26:23.316961+0000","last_active":"2024-09-12T02:03:53.719368+0000","last_peered":"2024-09-12T02:03:53.719368+0000","last_clean":"2024-09-12T02:03:53.719368+0000","last_became_active":"2024-09-12T00:26:23.315633+0000","last_became_peered":"2024-09-12T00:26:23.315633+0000","last_unstale":"2024-09-12T02:03:53.719368+0000","last_undegraded":"2024-09-12T02:03:53.719368+0000","last_fullsized":"2024-09-12T02:03:53.719368+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:49.483501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":203,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.762162+0000","last_change":"2024-09-12T01:00:24.080426+0000","last_active":"2024-09-12T02:04:58.762162+0000","last_peered":"2024-09-12T02:04:58.762162+0000","last_clean":"2024-09-12T02:04:58.762162+0000","last_became_active":"2024-09-12T01:00:24.079834+0000","last_became_peered":"2024-09-12T01:00:24.079834+0000","last_unstale":"2024-09-12T02:04:58.762162+0000","last_undegraded":"2024-09-12T02:04:58.762162+0000","last_fullsized":"2024-09-12T02:04:58.762162+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.535089+0000","last_change":"2024-09-12T00:32:21.664365+0000","last_active":"2024-09-12T02:04:33.535089+0000","last_peered":"2024-09-12T02:04:33.535089+0000","last_clean":"2024-09-12T02:04:33.535089+0000","last_became_active":"2024-09-12T00:32:21.663547+0000","last_became_peered":"2024-09-12T00:32:21.663547+0000","last_unstale":"2024-09-12T02:04:33.535089+0000","last_undegraded":"2024-09-12T02:04:33.535089+0000","last_fullsized":"2024-09-12T02:04:33.535089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:42.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.747512+0000","last_change":"2024-09-12T00:32:14.596240+0000","last_active":"2024-09-12T02:03:58.747512+0000","last_peered":"2024-09-12T02:03:58.747512+0000","last_clean":"2024-09-12T02:03:58.747512+0000","last_became_active":"2024-09-12T00:32:14.593670+0000","last_became_peered":"2024-09-12T00:32:14.593670+0000","last_unstale":"2024-09-12T02:03:58.747512+0000","last_undegraded":"2024-09-12T02:03:58.747512+0000","last_fullsized":"2024-09-12T02:03:58.747512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:01.077637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'28","reported_seq":156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525498+0000","last_change":"2024-09-12T00:26:23.350883+0000","last_active":"2024-09-12T02:03:53.525498+0000","last_peered":"2024-09-12T02:03:53.525498+0000","last_clean":"2024-09-12T02:03:53.525498+0000","last_became_active":"2024-09-12T00:26:23.338248+0000","last_became_peered":"2024-09-12T00:26:23.338248+0000","last_unstale":"2024-09-12T02:03:53.525498+0000","last_undegraded":"2024-09-12T02:03:53.525498+0000","last_fullsized":"2024-09-12T02:03:53.525498+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:58.473095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.757503+0000","last_change":"2024-09-12T01:00:24.077369+0000","last_active":"2024-09-12T02:04:59.757503+0000","last_peered":"2024-09-12T02:04:59.757503+0000","last_clean":"2024-09-12T02:04:59.757503+0000","last_became_active":"2024-09-12T01:00:24.068145+0000","last_became_peered":"2024-09-12T01:00:24.068145+0000","last_unstale":"2024-09-12T02:04:59.757503+0000","last_undegraded":"2024-09-12T02:04:59.757503+0000","last_fullsized":"2024-09-12T02:04:59.757503+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.527728+0000","last_change":"2024-09-12T00:32:21.674579+0000","last_active":"2024-09-12T02:04:03.527728+0000","last_peered":"2024-09-12T02:04:03.527728+0000","last_clean":"2024-09-12T02:04:03.527728+0000","last_became_active":"2024-09-12T00:32:21.668979+0000","last_became_peered":"2024-09-12T00:32:21.668979+0000","last_unstale":"2024-09-12T02:04:03.527728+0000","last_undegraded":"2024-09-12T02:04:03.527728+0000","last_fullsized":"2024-09-12T02:04:03.527728+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:43.618228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.037358+0000","last_change":"2024-09-12T00:32:14.611138+0000","last_active":"2024-09-12T02:06:45.037358+0000","last_peered":"2024-09-12T02:06:45.037358+0000","last_clean":"2024-09-12T02:06:45.037358+0000","last_became_active":"2024-09-12T00:32:14.610414+0000","last_became_peered":"2024-09-12T00:32:14.610414+0000","last_unstale":"2024-09-12T02:06:45.037358+0000","last_undegraded":"2024-09-12T02:06:45.037358+0000","last_fullsized":"2024-09-12T02:06:45.037358+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.944085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"266'33","reported_seq":168,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.719573+0000","last_change":"2024-09-12T00:26:23.328059+0000","last_active":"2024-09-12T02:03:53.719573+0000","last_peered":"2024-09-12T02:03:53.719573+0000","last_clean":"2024-09-12T02:03:53.719573+0000","last_became_active":"2024-09-12T00:26:23.327296+0000","last_became_peered":"2024-09-12T00:26:23.327296+0000","last_unstale":"2024-09-12T02:03:53.719573+0000","last_undegraded":"2024-09-12T02:03:53.719573+0000","last_fullsized":"2024-09-12T02:03:53.719573+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:43.942150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709243+0000","last_change":"2024-09-12T01:00:24.068043+0000","last_active":"2024-09-12T02:04:43.709243+0000","last_peered":"2024-09-12T02:04:43.709243+0000","last_clean":"2024-09-12T02:04:43.709243+0000","last_became_active":"2024-09-12T01:00:24.067665+0000","last_became_peered":"2024-09-12T01:00:24.067665+0000","last_unstale":"2024-09-12T02:04:43.709243+0000","last_undegraded":"2024-09-12T02:04:43.709243+0000","last_fullsized":"2024-09-12T02:04:43.709243+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:47.648058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.739021+0000","last_change":"2024-09-12T00:32:21.645575+0000","last_active":"2024-09-12T02:03:23.739021+0000","last_peered":"2024-09-12T02:03:23.739021+0000","last_clean":"2024-09-12T02:03:23.739021+0000","last_became_active":"2024-09-12T00:32:21.644891+0000","last_became_peered":"2024-09-12T00:32:21.644891+0000","last_unstale":"2024-09-12T02:03:23.739021+0000","last_undegraded":"2024-09-12T02:03:23.739021+0000","last_fullsized":"2024-09-12T02:03:23.739021+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.537775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"266'2","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:24.763883+0000","last_change":"2024-09-12T00:32:14.599778+0000","last_active":"2024-09-12T02:05:24.763883+0000","last_peered":"2024-09-12T02:05:24.763883+0000","last_clean":"2024-09-12T02:05:24.763883+0000","last_became_active":"2024-09-12T00:32:14.598981+0000","last_became_peered":"2024-09-12T00:32:14.598981+0000","last_unstale":"2024-09-12T02:05:24.763883+0000","last_undegraded":"2024-09-12T02:05:24.763883+0000","last_fullsized":"2024-09-12T02:05:24.763883+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:06.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"266'25","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.757357+0000","last_change":"2024-09-12T00:26:23.317228+0000","last_active":"2024-09-12T02:04:38.757357+0000","last_peered":"2024-09-12T02:04:38.757357+0000","last_clean":"2024-09-12T02:04:38.757357+0000","last_became_active":"2024-09-12T00:26:23.316443+0000","last_became_peered":"2024-09-12T00:26:23.316443+0000","last_unstale":"2024-09-12T02:04:38.757357+0000","last_undegraded":"2024-09-12T02:04:38.757357+0000","last_fullsized":"2024-09-12T02:04:38.757357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:54.406238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":90,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.765981+0000","last_change":"2024-09-12T01:00:24.072339+0000","last_active":"2024-09-12T02:04:58.765981+0000","last_peered":"2024-09-12T02:04:58.765981+0000","last_clean":"2024-09-12T02:04:58.765981+0000","last_became_active":"2024-09-12T01:00:24.071428+0000","last_became_peered":"2024-09-12T01:00:24.071428+0000","last_unstale":"2024-09-12T02:04:58.765981+0000","last_undegraded":"2024-09-12T02:04:58.765981+0000","last_fullsized":"2024-09-12T02:04:58.765981+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"266'9","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.740844+0000","last_change":"2024-09-12T00:32:21.654444+0000","last_active":"2024-09-12T02:06:46.740844+0000","last_peered":"2024-09-12T02:06:46.740844+0000","last_clean":"2024-09-12T02:06:46.740844+0000","last_became_active":"2024-09-12T00:32:21.653749+0000","last_became_peered":"2024-09-12T00:32:21.653749+0000","last_unstale":"2024-09-12T02:06:46.740844+0000","last_undegraded":"2024-09-12T02:06:46.740844+0000","last_fullsized":"2024-09-12T02:06:46.740844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:33.575071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.737749+0000","last_change":"2024-09-12T00:32:14.597114+0000","last_active":"2024-09-12T02:03:18.737749+0000","last_peered":"2024-09-12T02:03:18.737749+0000","last_clean":"2024-09-12T02:03:18.737749+0000","last_became_active":"2024-09-12T00:32:14.596498+0000","last_became_peered":"2024-09-12T00:32:14.596498+0000","last_unstale":"2024-09-12T02:03:18.737749+0000","last_undegraded":"2024-09-12T02:03:18.737749+0000","last_fullsized":"2024-09-12T02:03:18.737749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:03.408422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"266'50","reported_seq":218,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.703534+0000","last_change":"2024-09-12T00:26:23.341311+0000","last_active":"2024-09-12T02:04:18.703534+0000","last_peered":"2024-09-12T02:04:18.703534+0000","last_clean":"2024-09-12T02:04:18.703534+0000","last_became_active":"2024-09-12T00:26:23.340608+0000","last_became_peered":"2024-09-12T00:26:23.340608+0000","last_unstale":"2024-09-12T02:04:18.703534+0000","last_undegraded":"2024-09-12T02:04:18.703534+0000","last_fullsized":"2024-09-12T02:04:18.703534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:24.402590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":178,"num_write":83,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.699157+0000","last_change":"2024-09-12T01:00:24.083558+0000","last_active":"2024-09-12T02:03:13.699157+0000","last_peered":"2024-09-12T02:03:13.699157+0000","last_clean":"2024-09-12T02:03:13.699157+0000","last_became_active":"2024-09-12T01:00:24.083260+0000","last_became_peered":"2024-09-12T01:00:24.083260+0000","last_unstale":"2024-09-12T02:03:13.699157+0000","last_undegraded":"2024-09-12T02:03:13.699157+0000","last_fullsized":"2024-09-12T02:03:13.699157+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:16.850258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"266'9","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:08.726835+0000","last_change":"2024-09-12T00:32:21.656599+0000","last_active":"2024-09-12T02:06:08.726835+0000","last_peered":"2024-09-12T02:06:08.726835+0000","last_clean":"2024-09-12T02:06:08.726835+0000","last_became_active":"2024-09-12T00:32:21.655849+0000","last_became_peered":"2024-09-12T00:32:21.655849+0000","last_unstale":"2024-09-12T02:06:08.726835+0000","last_undegraded":"2024-09-12T02:06:08.726835+0000","last_fullsized":"2024-09-12T02:06:08.726835+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:45.314567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15358,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.785624+0000","last_change":"2024-09-12T00:32:14.605108+0000","last_active":"2024-09-12T02:06:38.785624+0000","last_peered":"2024-09-12T02:06:38.785624+0000","last_clean":"2024-09-12T02:06:38.785624+0000","last_became_active":"2024-09-12T00:32:14.604519+0000","last_became_peered":"2024-09-12T00:32:14.604519+0000","last_unstale":"2024-09-12T02:06:38.785624+0000","last_undegraded":"2024-09-12T02:06:38.785624+0000","last_fullsized":"2024-09-12T02:06:38.785624+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:45.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":153,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:19.747660+0000","last_change":"2024-09-12T00:26:23.332950+0000","last_active":"2024-09-12T02:04:19.747660+0000","last_peered":"2024-09-12T02:04:19.747660+0000","last_clean":"2024-09-12T02:04:19.747660+0000","last_became_active":"2024-09-12T00:26:23.328187+0000","last_became_peered":"2024-09-12T00:26:23.328187+0000","last_unstale":"2024-09-12T02:04:19.747660+0000","last_undegraded":"2024-09-12T02:04:19.747660+0000","last_fullsized":"2024-09-12T02:04:19.747660+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:26.206262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":91,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727347+0000","last_change":"2024-09-12T01:00:24.063315+0000","last_active":"2024-09-12T02:03:13.727347+0000","last_peered":"2024-09-12T02:03:13.727347+0000","last_clean":"2024-09-12T02:03:13.727347+0000","last_became_active":"2024-09-12T01:00:24.062597+0000","last_became_peered":"2024-09-12T01:00:24.062597+0000","last_unstale":"2024-09-12T02:03:13.727347+0000","last_undegraded":"2024-09-12T02:03:13.727347+0000","last_fullsized":"2024-09-12T02:03:13.727347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:00.125865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:34.751341+0000","last_change":"2024-09-12T00:32:21.646859+0000","last_active":"2024-09-12T02:04:34.751341+0000","last_peered":"2024-09-12T02:04:34.751341+0000","last_clean":"2024-09-12T02:04:34.751341+0000","last_became_active":"2024-09-12T00:32:21.644950+0000","last_became_peered":"2024-09-12T00:32:21.644950+0000","last_unstale":"2024-09-12T02:04:34.751341+0000","last_undegraded":"2024-09-12T02:04:34.751341+0000","last_fullsized":"2024-09-12T02:04:34.751341+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:04.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.777079+0000","last_change":"2024-09-12T00:32:14.598048+0000","last_active":"2024-09-12T02:06:03.777079+0000","last_peered":"2024-09-12T02:06:03.777079+0000","last_clean":"2024-09-12T02:06:03.777079+0000","last_became_active":"2024-09-12T00:32:14.597376+0000","last_became_peered":"2024-09-12T00:32:14.597376+0000","last_unstale":"2024-09-12T02:06:03.777079+0000","last_undegraded":"2024-09-12T02:06:03.777079+0000","last_fullsized":"2024-09-12T02:06:03.777079+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:44.028314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"266'77","reported_seq":297,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.756664+0000","last_change":"2024-09-12T00:26:23.338797+0000","last_active":"2024-09-12T02:04:18.756664+0000","last_peered":"2024-09-12T02:04:18.756664+0000","last_clean":"2024-09-12T02:04:18.756664+0000","last_became_active":"2024-09-12T00:26:23.338274+0000","last_became_peered":"2024-09-12T00:26:23.338274+0000","last_unstale":"2024-09-12T02:04:18.756664+0000","last_undegraded":"2024-09-12T02:04:18.756664+0000","last_fullsized":"2024-09-12T02:04:18.756664+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:48.119590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":296,"num_write":117,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.541693+0000","last_change":"2024-09-12T01:00:24.054473+0000","last_active":"2024-09-12T02:04:58.541693+0000","last_peered":"2024-09-12T02:04:58.541693+0000","last_clean":"2024-09-12T02:04:58.541693+0000","last_became_active":"2024-09-12T01:00:24.053408+0000","last_became_peered":"2024-09-12T01:00:24.053408+0000","last_unstale":"2024-09-12T02:04:58.541693+0000","last_undegraded":"2024-09-12T02:04:58.541693+0000","last_fullsized":"2024-09-12T02:04:58.541693+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.721667+0000","last_change":"2024-09-12T00:32:33.790651+0000","last_active":"2024-09-12T02:04:03.721667+0000","last_peered":"2024-09-12T02:04:03.721667+0000","last_clean":"2024-09-12T02:04:03.721667+0000","last_became_active":"2024-09-12T00:32:33.790018+0000","last_became_peered":"2024-09-12T00:32:33.790018+0000","last_unstale":"2024-09-12T02:04:03.721667+0000","last_undegraded":"2024-09-12T02:04:03.721667+0000","last_fullsized":"2024-09-12T02:04:03.721667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:15.389367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.697604+0000","last_change":"2024-09-12T00:32:14.581204+0000","last_active":"2024-09-12T02:03:53.697604+0000","last_peered":"2024-09-12T02:03:53.697604+0000","last_clean":"2024-09-12T02:03:53.697604+0000","last_became_active":"2024-09-12T00:32:14.580350+0000","last_became_peered":"2024-09-12T00:32:14.580350+0000","last_unstale":"2024-09-12T02:03:53.697604+0000","last_undegraded":"2024-09-12T02:03:53.697604+0000","last_fullsized":"2024-09-12T02:03:53.697604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:27.342223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"266'23","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.724815+0000","last_change":"2024-09-12T00:26:23.327068+0000","last_active":"2024-09-12T02:04:18.724815+0000","last_peered":"2024-09-12T02:04:18.724815+0000","last_clean":"2024-09-12T02:04:18.724815+0000","last_became_active":"2024-09-12T00:26:23.318720+0000","last_became_peered":"2024-09-12T00:26:23.318720+0000","last_unstale":"2024-09-12T02:04:18.724815+0000","last_undegraded":"2024-09-12T02:04:18.724815+0000","last_fullsized":"2024-09-12T02:04:18.724815+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.176923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.735348+0000","last_change":"2024-09-12T01:00:24.074486+0000","last_active":"2024-09-12T02:03:08.735348+0000","last_peered":"2024-09-12T02:03:08.735348+0000","last_clean":"2024-09-12T02:03:08.735348+0000","last_became_active":"2024-09-12T01:00:24.072773+0000","last_became_peered":"2024-09-12T01:00:24.072773+0000","last_unstale":"2024-09-12T02:03:08.735348+0000","last_undegraded":"2024-09-12T02:03:08.735348+0000","last_fullsized":"2024-09-12T02:03:08.735348+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:12.560655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"266'8","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.466415+0000","last_change":"2024-09-12T00:32:21.644007+0000","last_active":"2024-09-12T02:06:45.466415+0000","last_peered":"2024-09-12T02:06:45.466415+0000","last_clean":"2024-09-12T02:06:45.466415+0000","last_became_active":"2024-09-12T00:32:21.643272+0000","last_became_peered":"2024-09-12T00:32:21.643272+0000","last_unstale":"2024-09-12T02:06:45.466415+0000","last_undegraded":"2024-09-12T02:06:45.466415+0000","last_fullsized":"2024-09-12T02:06:45.466415+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.420621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":18,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.720610+0000","last_change":"2024-09-12T00:32:14.580374+0000","last_active":"2024-09-12T02:03:58.720610+0000","last_peered":"2024-09-12T02:03:58.720610+0000","last_clean":"2024-09-12T02:03:58.720610+0000","last_became_active":"2024-09-12T00:32:14.579278+0000","last_became_peered":"2024-09-12T00:32:14.579278+0000","last_unstale":"2024-09-12T02:03:58.720610+0000","last_undegraded":"2024-09-12T02:03:58.720610+0000","last_fullsized":"2024-09-12T02:03:58.720610+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:01.599717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"266'19","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.758435+0000","last_change":"2024-09-12T00:26:23.306938+0000","last_active":"2024-09-12T02:04:43.758435+0000","last_peered":"2024-09-12T02:04:43.758435+0000","last_clean":"2024-09-12T02:04:43.758435+0000","last_became_active":"2024-09-12T00:26:23.306139+0000","last_became_peered":"2024-09-12T00:26:23.306139+0000","last_unstale":"2024-09-12T02:04:43.758435+0000","last_undegraded":"2024-09-12T02:04:43.758435+0000","last_fullsized":"2024-09-12T02:04:43.758435+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:31.920270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"266'329","reported_seq":1082,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.791875+0000","last_change":"2024-09-12T02:07:06.791875+0000","last_active":"2024-09-12T02:07:06.791875+0000","last_peered":"2024-09-12T02:07:06.791875+0000","last_clean":"2024-09-12T02:07:06.791875+0000","last_became_active":"2024-09-12T00:09:59.316094+0000","last_became_peered":"2024-09-12T00:09:59.316094+0000","last_unstale":"2024-09-12T02:07:06.791875+0000","last_undegraded":"2024-09-12T02:07:06.791875+0000","last_fullsized":"2024-09-12T02:07:06.791875+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'329","last_scrub_stamp":"2024-09-12T02:07:06.791586+0000","last_deep_scrub":"266'329","last_deep_scrub_stamp":"2024-09-12T02:07:06.791586+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.791586+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:12.851892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441871,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":581,"num_read_kb":103153,"num_write":998,"num_write_kb":38551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"266'996","reported_seq":2786,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.570879+0000","last_change":"2024-09-12T02:07:13.570879+0000","last_active":"2024-09-12T02:07:13.570879+0000","last_peered":"2024-09-12T02:07:13.570879+0000","last_clean":"2024-09-12T02:07:13.570879+0000","last_became_active":"2024-09-12T00:10:01.281465+0000","last_became_peered":"2024-09-12T00:10:01.281465+0000","last_unstale":"2024-09-12T02:07:13.570879+0000","last_undegraded":"2024-09-12T02:07:13.570879+0000","last_fullsized":"2024-09-12T02:07:13.570879+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'996","last_scrub_stamp":"2024-09-12T02:07:13.570650+0000","last_deep_scrub":"266'996","last_deep_scrub_stamp":"2024-09-12T02:07:13.570650+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.570650+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":900,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:50.111365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4736,"num_read_kb":4236,"num_write":1359,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"266'354","reported_seq":1056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.469755+0000","last_change":"2024-09-12T02:06:56.469755+0000","last_active":"2024-09-12T02:06:56.469755+0000","last_peered":"2024-09-12T02:06:56.469755+0000","last_clean":"2024-09-12T02:06:56.469755+0000","last_became_active":"2024-09-12T00:09:59.311178+0000","last_became_peered":"2024-09-12T00:09:59.311178+0000","last_unstale":"2024-09-12T02:06:56.469755+0000","last_undegraded":"2024-09-12T02:06:56.469755+0000","last_fullsized":"2024-09-12T02:06:56.469755+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'354","last_scrub_stamp":"2024-09-12T02:06:56.469492+0000","last_deep_scrub":"266'354","last_deep_scrub_stamp":"2024-09-12T02:06:56.469492+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.469492+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.533391+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399015,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":11355,"num_write":1177,"num_write_kb":19733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"266'878","reported_seq":2493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.857479+0000","last_change":"2024-09-12T02:07:10.857479+0000","last_active":"2024-09-12T02:07:10.857479+0000","last_peered":"2024-09-12T02:07:10.857479+0000","last_clean":"2024-09-12T02:07:10.857479+0000","last_became_active":"2024-09-12T00:10:01.268068+0000","last_became_peered":"2024-09-12T00:10:01.268068+0000","last_unstale":"2024-09-12T02:07:10.857479+0000","last_undegraded":"2024-09-12T02:07:10.857479+0000","last_fullsized":"2024-09-12T02:07:10.857479+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'878","last_scrub_stamp":"2024-09-12T02:07:10.857289+0000","last_deep_scrub":"266'878","last_deep_scrub_stamp":"2024-09-12T02:07:10.857289+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.857289+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:43.512649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4189,"num_read_kb":3768,"num_write":1161,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"266'376","reported_seq":1090,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.497550+0000","last_change":"2024-09-12T02:07:00.497550+0000","last_active":"2024-09-12T02:07:00.497550+0000","last_peered":"2024-09-12T02:07:00.497550+0000","last_clean":"2024-09-12T02:07:00.497550+0000","last_became_active":"2024-09-12T00:09:59.296557+0000","last_became_peered":"2024-09-12T00:09:59.296557+0000","last_unstale":"2024-09-12T02:07:00.497550+0000","last_undegraded":"2024-09-12T02:07:00.497550+0000","last_fullsized":"2024-09-12T02:07:00.497550+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'376","last_scrub_stamp":"2024-09-12T02:07:00.497323+0000","last_deep_scrub":"266'376","last_deep_scrub_stamp":"2024-09-12T02:07:00.497323+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.497323+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.306173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653297,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":575,"num_read_kb":57177,"num_write":1185,"num_write_kb":38522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1197","reported_seq":2917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.068672+0000","last_change":"2024-09-12T02:07:13.068672+0000","last_active":"2024-09-12T02:07:13.068672+0000","last_peered":"2024-09-12T02:07:13.068672+0000","last_clean":"2024-09-12T02:07:13.068672+0000","last_became_active":"2024-09-12T00:10:01.251038+0000","last_became_peered":"2024-09-12T00:10:01.251038+0000","last_unstale":"2024-09-12T02:07:13.068672+0000","last_undegraded":"2024-09-12T02:07:13.068672+0000","last_fullsized":"2024-09-12T02:07:13.068672+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1197","last_scrub_stamp":"2024-09-12T02:07:13.068485+0000","last_deep_scrub":"266'1197","last_deep_scrub_stamp":"2024-09-12T02:07:13.068485+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.068485+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:34.941751+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5594,"num_read_kb":4965,"num_write":1641,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"266'307","reported_seq":964,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.585374+0000","last_change":"2024-09-12T02:07:06.585374+0000","last_active":"2024-09-12T02:07:06.585374+0000","last_peered":"2024-09-12T02:07:06.585374+0000","last_clean":"2024-09-12T02:07:06.585374+0000","last_became_active":"2024-09-12T00:09:59.278426+0000","last_became_peered":"2024-09-12T00:09:59.278426+0000","last_unstale":"2024-09-12T02:07:06.585374+0000","last_undegraded":"2024-09-12T02:07:06.585374+0000","last_fullsized":"2024-09-12T02:07:06.585374+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'307","last_scrub_stamp":"2024-09-12T02:07:06.585161+0000","last_deep_scrub":"266'307","last_deep_scrub_stamp":"2024-09-12T02:07:06.585161+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.585161+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:20.322727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":431,"num_read_kb":8612,"num_write":1021,"num_write_kb":32048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"266'443","reported_seq":1956,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.553353+0000","last_change":"2024-09-12T02:07:10.553353+0000","last_active":"2024-09-12T02:07:10.553353+0000","last_peered":"2024-09-12T02:07:10.553353+0000","last_clean":"2024-09-12T02:07:10.553353+0000","last_became_active":"2024-09-12T00:10:01.247807+0000","last_became_peered":"2024-09-12T00:10:01.247807+0000","last_unstale":"2024-09-12T02:07:10.553353+0000","last_undegraded":"2024-09-12T02:07:10.553353+0000","last_fullsized":"2024-09-12T02:07:10.553353+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'443","last_scrub_stamp":"2024-09-12T02:07:10.553061+0000","last_deep_scrub":"266'443","last_deep_scrub_stamp":"2024-09-12T02:07:10.553061+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.553061+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:25.618102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2317,"num_read_kb":2164,"num_write":517,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"266'312","reported_seq":1029,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.785461+0000","last_change":"2024-09-12T02:07:04.785461+0000","last_active":"2024-09-12T02:07:04.785461+0000","last_peered":"2024-09-12T02:07:04.785461+0000","last_clean":"2024-09-12T02:07:04.785461+0000","last_became_active":"2024-09-12T00:09:59.314222+0000","last_became_peered":"2024-09-12T00:09:59.314222+0000","last_unstale":"2024-09-12T02:07:04.785461+0000","last_undegraded":"2024-09-12T02:07:04.785461+0000","last_fullsized":"2024-09-12T02:07:04.785461+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'312","last_scrub_stamp":"2024-09-12T02:07:04.785112+0000","last_deep_scrub":"266'312","last_deep_scrub_stamp":"2024-09-12T02:07:04.785112+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.785112+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:19.854594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":10075,"num_write":947,"num_write_kb":41375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"266'517","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.092162+0000","last_change":"2024-09-12T02:07:05.092162+0000","last_active":"2024-09-12T02:07:05.092162+0000","last_peered":"2024-09-12T02:07:05.092162+0000","last_clean":"2024-09-12T02:07:05.092162+0000","last_became_active":"2024-09-12T00:10:01.256253+0000","last_became_peered":"2024-09-12T00:10:01.256253+0000","last_unstale":"2024-09-12T02:07:05.092162+0000","last_undegraded":"2024-09-12T02:07:05.092162+0000","last_fullsized":"2024-09-12T02:07:05.092162+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'517","last_scrub_stamp":"2024-09-12T02:07:05.091915+0000","last_deep_scrub":"266'517","last_deep_scrub_stamp":"2024-09-12T02:07:05.091915+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.091915+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:58.529971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2461,"num_read_kb":2278,"num_write":611,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"266'342","reported_seq":1004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.574196+0000","last_change":"2024-09-12T02:07:05.574196+0000","last_active":"2024-09-12T02:07:05.574196+0000","last_peered":"2024-09-12T02:07:05.574196+0000","last_clean":"2024-09-12T02:07:05.574196+0000","last_became_active":"2024-09-12T00:09:59.297821+0000","last_became_peered":"2024-09-12T00:09:59.297821+0000","last_unstale":"2024-09-12T02:07:05.574196+0000","last_undegraded":"2024-09-12T02:07:05.574196+0000","last_fullsized":"2024-09-12T02:07:05.574196+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'342","last_scrub_stamp":"2024-09-12T02:07:05.573973+0000","last_deep_scrub":"266'342","last_deep_scrub_stamp":"2024-09-12T02:07:05.573973+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.573973+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:17.466383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":489,"num_read_kb":14780,"num_write":963,"num_write_kb":35747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"266'380","reported_seq":1853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.056835+0000","last_change":"2024-09-12T02:07:12.056835+0000","last_active":"2024-09-12T02:07:12.056835+0000","last_peered":"2024-09-12T02:07:12.056835+0000","last_clean":"2024-09-12T02:07:12.056835+0000","last_became_active":"2024-09-12T00:10:01.250663+0000","last_became_peered":"2024-09-12T00:10:01.250663+0000","last_unstale":"2024-09-12T02:07:12.056835+0000","last_undegraded":"2024-09-12T02:07:12.056835+0000","last_fullsized":"2024-09-12T02:07:12.056835+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T02:07:12.056652+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T02:07:12.056652+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.056652+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.942975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2078,"num_read_kb":1972,"num_write":422,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"266'353","reported_seq":1131,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.810726+0000","last_change":"2024-09-12T02:07:03.810726+0000","last_active":"2024-09-12T02:07:03.810726+0000","last_peered":"2024-09-12T02:07:03.810726+0000","last_clean":"2024-09-12T02:07:03.810726+0000","last_became_active":"2024-09-12T00:09:59.311825+0000","last_became_peered":"2024-09-12T00:09:59.311825+0000","last_unstale":"2024-09-12T02:07:03.810726+0000","last_undegraded":"2024-09-12T02:07:03.810726+0000","last_fullsized":"2024-09-12T02:07:03.810726+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'353","last_scrub_stamp":"2024-09-12T02:07:03.810476+0000","last_deep_scrub":"266'353","last_deep_scrub_stamp":"2024-09-12T02:07:03.810476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.810476+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.639688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399264,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":842,"num_read_kb":88204,"num_write":1135,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"266'422","reported_seq":1892,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.571407+0000","last_change":"2024-09-12T02:07:14.571407+0000","last_active":"2024-09-12T02:07:14.571407+0000","last_peered":"2024-09-12T02:07:14.571407+0000","last_clean":"2024-09-12T02:07:14.571407+0000","last_became_active":"2024-09-12T00:10:01.274405+0000","last_became_peered":"2024-09-12T00:10:01.274405+0000","last_unstale":"2024-09-12T02:07:14.571407+0000","last_undegraded":"2024-09-12T02:07:14.571407+0000","last_fullsized":"2024-09-12T02:07:14.571407+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'422","last_scrub_stamp":"2024-09-12T02:07:14.571149+0000","last_deep_scrub":"266'422","last_deep_scrub_stamp":"2024-09-12T02:07:14.571149+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.571149+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:55.197355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2137,"num_read_kb":2003,"num_write":477,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"266'378","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.950263+0000","last_change":"2024-09-12T02:07:12.950263+0000","last_active":"2024-09-12T02:07:12.950263+0000","last_peered":"2024-09-12T02:07:12.950263+0000","last_clean":"2024-09-12T02:07:12.950263+0000","last_became_active":"2024-09-12T00:09:59.248750+0000","last_became_peered":"2024-09-12T00:09:59.248750+0000","last_unstale":"2024-09-12T02:07:12.950263+0000","last_undegraded":"2024-09-12T02:07:12.950263+0000","last_fullsized":"2024-09-12T02:07:12.950263+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'378","last_scrub_stamp":"2024-09-12T02:07:12.949940+0000","last_deep_scrub":"266'378","last_deep_scrub_stamp":"2024-09-12T02:07:12.949940+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.949940+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:49.263377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4478894,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":698,"num_read_kb":26164,"num_write":1140,"num_write_kb":31035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"266'820","reported_seq":2453,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.639619+0000","last_change":"2024-09-12T02:06:57.639619+0000","last_active":"2024-09-12T02:06:57.639619+0000","last_peered":"2024-09-12T02:06:57.639619+0000","last_clean":"2024-09-12T02:06:57.639619+0000","last_became_active":"2024-09-12T00:10:01.249016+0000","last_became_peered":"2024-09-12T00:10:01.249016+0000","last_unstale":"2024-09-12T02:06:57.639619+0000","last_undegraded":"2024-09-12T02:06:57.639619+0000","last_fullsized":"2024-09-12T02:06:57.639619+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'820","last_scrub_stamp":"2024-09-12T02:06:57.639429+0000","last_deep_scrub":"266'820","last_deep_scrub_stamp":"2024-09-12T02:06:57.639429+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.639429+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:20.206412+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3841,"num_read_kb":3467,"num_write":1075,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"266'628","reported_seq":2390,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.056138+0000","last_change":"2024-09-12T02:07:10.056138+0000","last_active":"2024-09-12T02:07:10.056138+0000","last_peered":"2024-09-12T02:07:10.056138+0000","last_clean":"2024-09-12T02:07:10.056138+0000","last_became_active":"2024-09-12T00:10:01.252790+0000","last_became_peered":"2024-09-12T00:10:01.252790+0000","last_unstale":"2024-09-12T02:07:10.056138+0000","last_undegraded":"2024-09-12T02:07:10.056138+0000","last_fullsized":"2024-09-12T02:07:10.056138+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'628","last_scrub_stamp":"2024-09-12T02:07:10.055950+0000","last_deep_scrub":"266'628","last_deep_scrub_stamp":"2024-09-12T02:07:10.055950+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.055950+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:28.740887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2892,"num_write":772,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"266'411","reported_seq":1116,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.820593+0000","last_change":"2024-09-12T02:07:05.820593+0000","last_active":"2024-09-12T02:07:05.820593+0000","last_peered":"2024-09-12T02:07:05.820593+0000","last_clean":"2024-09-12T02:07:05.820593+0000","last_became_active":"2024-09-12T00:09:59.285279+0000","last_became_peered":"2024-09-12T00:09:59.285279+0000","last_unstale":"2024-09-12T02:07:05.820593+0000","last_undegraded":"2024-09-12T02:07:05.820593+0000","last_fullsized":"2024-09-12T02:07:05.820593+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'411","last_scrub_stamp":"2024-09-12T02:07:05.820309+0000","last_deep_scrub":"266'411","last_deep_scrub_stamp":"2024-09-12T02:07:05.820309+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.820309+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:56.300299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569417,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":647,"num_read_kb":33158,"num_write":1312,"num_write_kb":40723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"266'387","reported_seq":2068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.862281+0000","last_change":"2024-09-12T02:07:09.862281+0000","last_active":"2024-09-12T02:07:09.862281+0000","last_peered":"2024-09-12T02:07:09.862281+0000","last_clean":"2024-09-12T02:07:09.862281+0000","last_became_active":"2024-09-12T00:10:01.269235+0000","last_became_peered":"2024-09-12T00:10:01.269235+0000","last_unstale":"2024-09-12T02:07:09.862281+0000","last_undegraded":"2024-09-12T02:07:09.862281+0000","last_fullsized":"2024-09-12T02:07:09.862281+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'387","last_scrub_stamp":"2024-09-12T02:07:09.862094+0000","last_deep_scrub":"266'387","last_deep_scrub_stamp":"2024-09-12T02:07:09.862094+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.862094+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:04.979312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2516,"num_read_kb":2424,"num_write":449,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2781,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"266'351","reported_seq":1000,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.080909+0000","last_change":"2024-09-12T02:07:07.080909+0000","last_active":"2024-09-12T02:07:07.080909+0000","last_peered":"2024-09-12T02:07:07.080909+0000","last_clean":"2024-09-12T02:07:07.080909+0000","last_became_active":"2024-09-12T00:09:59.298975+0000","last_became_peered":"2024-09-12T00:09:59.298975+0000","last_unstale":"2024-09-12T02:07:07.080909+0000","last_undegraded":"2024-09-12T02:07:07.080909+0000","last_fullsized":"2024-09-12T02:07:07.080909+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'351","last_scrub_stamp":"2024-09-12T02:07:07.080684+0000","last_deep_scrub":"266'351","last_deep_scrub_stamp":"2024-09-12T02:07:07.080684+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.080684+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:09.511021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":20543,"num_write":987,"num_write_kb":37808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"266'1149","reported_seq":2691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.622569+0000","last_change":"2024-09-12T02:07:10.622569+0000","last_active":"2024-09-12T02:07:10.622569+0000","last_peered":"2024-09-12T02:07:10.622569+0000","last_clean":"2024-09-12T02:07:10.622569+0000","last_became_active":"2024-09-12T00:10:01.270566+0000","last_became_peered":"2024-09-12T00:10:01.270566+0000","last_unstale":"2024-09-12T02:07:10.622569+0000","last_undegraded":"2024-09-12T02:07:10.622569+0000","last_fullsized":"2024-09-12T02:07:10.622569+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1149","last_scrub_stamp":"2024-09-12T02:07:10.622387+0000","last_deep_scrub":"266'1149","last_deep_scrub_stamp":"2024-09-12T02:07:10.622387+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.622387+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":1100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:22.452419+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5146,"num_read_kb":4532,"num_write":1573,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"266'328","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.640773+0000","last_change":"2024-09-12T02:07:00.640773+0000","last_active":"2024-09-12T02:07:00.640773+0000","last_peered":"2024-09-12T02:07:00.640773+0000","last_clean":"2024-09-12T02:07:00.640773+0000","last_became_active":"2024-09-12T00:10:31.475207+0000","last_became_peered":"2024-09-12T00:10:31.475207+0000","last_unstale":"2024-09-12T02:07:00.640773+0000","last_undegraded":"2024-09-12T02:07:00.640773+0000","last_fullsized":"2024-09-12T02:07:00.640773+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'328","last_scrub_stamp":"2024-09-12T02:07:00.640512+0000","last_deep_scrub":"266'328","last_deep_scrub_stamp":"2024-09-12T02:07:00.640512+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.640512+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:25.664541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35516,"num_write":1077,"num_write_kb":27332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"266'425","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.618646+0000","last_change":"2024-09-12T02:07:02.618646+0000","last_active":"2024-09-12T02:07:02.618646+0000","last_peered":"2024-09-12T02:07:02.618646+0000","last_clean":"2024-09-12T02:07:02.618646+0000","last_became_active":"2024-09-12T00:10:01.249060+0000","last_became_peered":"2024-09-12T00:10:01.249060+0000","last_unstale":"2024-09-12T02:07:02.618646+0000","last_undegraded":"2024-09-12T02:07:02.618646+0000","last_fullsized":"2024-09-12T02:07:02.618646+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'425","last_scrub_stamp":"2024-09-12T02:07:02.618429+0000","last_deep_scrub":"266'425","last_deep_scrub_stamp":"2024-09-12T02:07:02.618429+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.618429+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:02.382238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2301,"num_write":498,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"266'349","reported_seq":1022,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.046073+0000","last_change":"2024-09-12T02:06:58.046073+0000","last_active":"2024-09-12T02:06:58.046073+0000","last_peered":"2024-09-12T02:06:58.046073+0000","last_clean":"2024-09-12T02:06:58.046073+0000","last_became_active":"2024-09-12T00:09:59.308979+0000","last_became_peered":"2024-09-12T00:09:59.308979+0000","last_unstale":"2024-09-12T02:06:58.046073+0000","last_undegraded":"2024-09-12T02:06:58.046073+0000","last_fullsized":"2024-09-12T02:06:58.046073+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T02:06:58.045671+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T02:06:58.045671+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.045671+0000","objects_scrubbed":11,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:32.257450+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9921950,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":33875,"num_write":1037,"num_write_kb":29129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"266'441","reported_seq":1933,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.611005+0000","last_change":"2024-09-12T02:06:59.611005+0000","last_active":"2024-09-12T02:06:59.611005+0000","last_peered":"2024-09-12T02:06:59.611005+0000","last_clean":"2024-09-12T02:06:59.611005+0000","last_became_active":"2024-09-12T00:10:01.238251+0000","last_became_peered":"2024-09-12T00:10:01.238251+0000","last_unstale":"2024-09-12T02:06:59.611005+0000","last_undegraded":"2024-09-12T02:06:59.611005+0000","last_fullsized":"2024-09-12T02:06:59.611005+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'441","last_scrub_stamp":"2024-09-12T02:06:59.610833+0000","last_deep_scrub":"266'441","last_deep_scrub_stamp":"2024-09-12T02:06:59.610833+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.610833+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:13.031338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2194,"num_read_kb":2058,"num_write":515,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"266'313","reported_seq":968,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.896306+0000","last_change":"2024-09-12T02:07:00.896306+0000","last_active":"2024-09-12T02:07:00.896306+0000","last_peered":"2024-09-12T02:07:00.896306+0000","last_clean":"2024-09-12T02:07:00.896306+0000","last_became_active":"2024-09-12T00:09:59.262666+0000","last_became_peered":"2024-09-12T00:09:59.262666+0000","last_unstale":"2024-09-12T02:07:00.896306+0000","last_undegraded":"2024-09-12T02:07:00.896306+0000","last_fullsized":"2024-09-12T02:07:00.896306+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'313","last_scrub_stamp":"2024-09-12T02:07:00.896081+0000","last_deep_scrub":"266'313","last_deep_scrub_stamp":"2024-09-12T02:07:00.896081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.896081+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:49.352670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433326,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":422,"num_read_kb":23030,"num_write":985,"num_write_kb":39870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"266'663","reported_seq":2190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.095132+0000","last_change":"2024-09-12T02:07:11.095132+0000","last_active":"2024-09-12T02:07:11.095132+0000","last_peered":"2024-09-12T02:07:11.095132+0000","last_clean":"2024-09-12T02:07:11.095132+0000","last_became_active":"2024-09-12T00:10:01.257792+0000","last_became_peered":"2024-09-12T00:10:01.257792+0000","last_unstale":"2024-09-12T02:07:11.095132+0000","last_undegraded":"2024-09-12T02:07:11.095132+0000","last_fullsized":"2024-09-12T02:07:11.095132+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'663","last_scrub_stamp":"2024-09-12T02:07:11.094919+0000","last_deep_scrub":"266'663","last_deep_scrub_stamp":"2024-09-12T02:07:11.094919+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.094919+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":600,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:28.585837+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3304,"num_read_kb":2964,"num_write":919,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1227,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"266'329","reported_seq":995,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.452573+0000","last_change":"2024-09-12T02:07:01.452411+0000","last_active":"2024-09-12T02:07:01.452573+0000","last_peered":"2024-09-12T02:07:01.452573+0000","last_clean":"2024-09-12T02:07:01.452573+0000","last_became_active":"2024-09-12T00:09:59.293921+0000","last_became_peered":"2024-09-12T00:09:59.293921+0000","last_unstale":"2024-09-12T02:07:01.452573+0000","last_undegraded":"2024-09-12T02:07:01.452573+0000","last_fullsized":"2024-09-12T02:07:01.452573+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'329","last_scrub_stamp":"2024-09-12T02:07:01.452129+0000","last_deep_scrub":"266'329","last_deep_scrub_stamp":"2024-09-12T02:07:01.452129+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.452129+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:18.604057+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262199,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":482,"num_read_kb":35722,"num_write":1084,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"266'142","reported_seq":678,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.114050+0000","last_change":"2024-09-12T00:10:09.356862+0000","last_active":"2024-09-12T02:06:07.114050+0000","last_peered":"2024-09-12T02:06:07.114050+0000","last_clean":"2024-09-12T02:06:07.114050+0000","last_became_active":"2024-09-12T00:10:09.356144+0000","last_became_peered":"2024-09-12T00:10:09.356144+0000","last_unstale":"2024-09-12T02:06:07.114050+0000","last_undegraded":"2024-09-12T02:06:07.114050+0000","last_fullsized":"2024-09-12T02:06:07.114050+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:09.813648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":339,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"266'787","reported_seq":2344,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.925510+0000","last_change":"2024-09-12T02:07:05.925510+0000","last_active":"2024-09-12T02:07:05.925510+0000","last_peered":"2024-09-12T02:07:05.925510+0000","last_clean":"2024-09-12T02:07:05.925510+0000","last_became_active":"2024-09-12T00:10:01.259053+0000","last_became_peered":"2024-09-12T00:10:01.259053+0000","last_unstale":"2024-09-12T02:07:05.925510+0000","last_undegraded":"2024-09-12T02:07:05.925510+0000","last_fullsized":"2024-09-12T02:07:05.925510+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'787","last_scrub_stamp":"2024-09-12T02:07:05.925325+0000","last_deep_scrub":"266'787","last_deep_scrub_stamp":"2024-09-12T02:07:05.925325+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.925325+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:04.831866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3705,"num_read_kb":3341,"num_write":1024,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"266'390","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.742097+0000","last_change":"2024-09-12T02:07:00.742097+0000","last_active":"2024-09-12T02:07:00.742097+0000","last_peered":"2024-09-12T02:07:00.742097+0000","last_clean":"2024-09-12T02:07:00.742097+0000","last_became_active":"2024-09-12T00:09:59.310643+0000","last_became_peered":"2024-09-12T00:09:59.310643+0000","last_unstale":"2024-09-12T02:07:00.742097+0000","last_undegraded":"2024-09-12T02:07:00.742097+0000","last_fullsized":"2024-09-12T02:07:00.742097+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:07:00.741744+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:07:00.741744+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.741744+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:30.067710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136934,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":31265,"num_write":1302,"num_write_kb":60174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.738969+0000","last_change":"2024-09-12T00:10:03.273556+0000","last_active":"2024-09-12T02:03:39.738969+0000","last_peered":"2024-09-12T02:03:39.738969+0000","last_clean":"2024-09-12T02:03:39.738969+0000","last_became_active":"2024-09-12T00:10:03.271233+0000","last_became_peered":"2024-09-12T00:10:03.271233+0000","last_unstale":"2024-09-12T02:03:39.738969+0000","last_undegraded":"2024-09-12T02:03:39.738969+0000","last_fullsized":"2024-09-12T02:03:39.738969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:53.667695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"266'375","reported_seq":1034,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.087115+0000","last_change":"2024-09-12T00:10:05.286196+0000","last_active":"2024-09-12T02:06:47.087115+0000","last_peered":"2024-09-12T02:06:47.087115+0000","last_clean":"2024-09-12T02:06:47.087115+0000","last_became_active":"2024-09-12T00:10:05.285417+0000","last_became_peered":"2024-09-12T00:10:05.285417+0000","last_unstale":"2024-09-12T02:06:47.087115+0000","last_undegraded":"2024-09-12T02:06:47.087115+0000","last_fullsized":"2024-09-12T02:06:47.087115+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.508820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47464,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1152,"num_write":460,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743886+0000","last_change":"2024-09-12T00:10:07.318948+0000","last_active":"2024-09-12T02:03:43.743886+0000","last_peered":"2024-09-12T02:03:43.743886+0000","last_clean":"2024-09-12T02:03:43.743886+0000","last_became_active":"2024-09-12T00:10:07.318114+0000","last_became_peered":"2024-09-12T00:10:07.318114+0000","last_unstale":"2024-09-12T02:03:43.743886+0000","last_undegraded":"2024-09-12T02:03:43.743886+0000","last_fullsized":"2024-09-12T02:03:43.743886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:24.177651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"266'2464","reported_seq":4396,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.745617+0000","last_change":"2024-09-12T00:10:09.371782+0000","last_active":"2024-09-12T02:04:59.745617+0000","last_peered":"2024-09-12T02:04:59.745617+0000","last_clean":"2024-09-12T02:04:59.745617+0000","last_became_active":"2024-09-12T00:10:09.370949+0000","last_became_peered":"2024-09-12T00:10:09.370949+0000","last_unstale":"2024-09-12T02:04:59.745617+0000","last_undegraded":"2024-09-12T02:04:59.745617+0000","last_fullsized":"2024-09-12T02:04:59.745617+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:02.640276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6210,"num_read_kb":6193,"num_write":4929,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"266'416","reported_seq":1962,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.578930+0000","last_change":"2024-09-12T02:07:09.578930+0000","last_active":"2024-09-12T02:07:09.578930+0000","last_peered":"2024-09-12T02:07:09.578930+0000","last_clean":"2024-09-12T02:07:09.578930+0000","last_became_active":"2024-09-12T00:10:01.274710+0000","last_became_peered":"2024-09-12T00:10:01.274710+0000","last_unstale":"2024-09-12T02:07:09.578930+0000","last_undegraded":"2024-09-12T02:07:09.578930+0000","last_fullsized":"2024-09-12T02:07:09.578930+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'416","last_scrub_stamp":"2024-09-12T02:07:09.578701+0000","last_deep_scrub":"266'416","last_deep_scrub_stamp":"2024-09-12T02:07:09.578701+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.578701+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:42.665393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2273,"num_read_kb":2145,"num_write":493,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"266'407","reported_seq":1136,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.555841+0000","last_change":"2024-09-12T02:06:57.555841+0000","last_active":"2024-09-12T02:06:57.555841+0000","last_peered":"2024-09-12T02:06:57.555841+0000","last_clean":"2024-09-12T02:06:57.555841+0000","last_became_active":"2024-09-12T00:09:59.282228+0000","last_became_peered":"2024-09-12T00:09:59.282228+0000","last_unstale":"2024-09-12T02:06:57.555841+0000","last_undegraded":"2024-09-12T02:06:57.555841+0000","last_fullsized":"2024-09-12T02:06:57.555841+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'407","last_scrub_stamp":"2024-09-12T02:06:57.555604+0000","last_deep_scrub":"266'407","last_deep_scrub_stamp":"2024-09-12T02:06:57.555604+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.555604+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:18.445365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":89139,"num_write":1493,"num_write_kb":44201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.972701+0000","last_change":"2024-09-12T02:07:13.972701+0000","last_active":"2024-09-12T02:07:13.972701+0000","last_peered":"2024-09-12T02:07:13.972701+0000","last_clean":"2024-09-12T02:07:13.972701+0000","last_became_active":"2024-09-12T00:10:03.254006+0000","last_became_peered":"2024-09-12T00:10:03.254006+0000","last_unstale":"2024-09-12T02:07:13.972701+0000","last_undegraded":"2024-09-12T02:07:13.972701+0000","last_fullsized":"2024-09-12T02:07:13.972701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.972525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.972525+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.972525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:24.718065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"266'138","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.748930+0000","last_change":"2024-09-12T00:10:05.280695+0000","last_active":"2024-09-12T02:03:43.748930+0000","last_peered":"2024-09-12T02:03:43.748930+0000","last_clean":"2024-09-12T02:03:43.748930+0000","last_became_active":"2024-09-12T00:10:05.279990+0000","last_became_peered":"2024-09-12T00:10:05.279990+0000","last_unstale":"2024-09-12T02:03:43.748930+0000","last_undegraded":"2024-09-12T02:03:43.748930+0000","last_fullsized":"2024-09-12T02:03:43.748930+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:32.073641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.748898+0000","last_change":"2024-09-12T00:10:07.310717+0000","last_active":"2024-09-12T02:03:43.748898+0000","last_peered":"2024-09-12T02:03:43.748898+0000","last_clean":"2024-09-12T02:03:43.748898+0000","last_became_active":"2024-09-12T00:10:07.309927+0000","last_became_peered":"2024-09-12T00:10:07.309927+0000","last_unstale":"2024-09-12T02:03:43.748898+0000","last_undegraded":"2024-09-12T02:03:43.748898+0000","last_fullsized":"2024-09-12T02:03:43.748898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:30.558288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"266'102","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718247+0000","last_change":"2024-09-12T00:10:09.365676+0000","last_active":"2024-09-12T02:02:38.718247+0000","last_peered":"2024-09-12T02:02:38.718247+0000","last_clean":"2024-09-12T02:02:38.718247+0000","last_became_active":"2024-09-12T00:10:09.364927+0000","last_became_peered":"2024-09-12T00:10:09.364927+0000","last_unstale":"2024-09-12T02:02:38.718247+0000","last_undegraded":"2024-09-12T02:02:38.718247+0000","last_fullsized":"2024-09-12T02:02:38.718247+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.618632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":243,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"266'382","reported_seq":1920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.543265+0000","last_change":"2024-09-12T02:07:05.543265+0000","last_active":"2024-09-12T02:07:05.543265+0000","last_peered":"2024-09-12T02:07:05.543265+0000","last_clean":"2024-09-12T02:07:05.543265+0000","last_became_active":"2024-09-12T00:10:01.246633+0000","last_became_peered":"2024-09-12T00:10:01.246633+0000","last_unstale":"2024-09-12T02:07:05.543265+0000","last_undegraded":"2024-09-12T02:07:05.543265+0000","last_fullsized":"2024-09-12T02:07:05.543265+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'382","last_scrub_stamp":"2024-09-12T02:07:05.543080+0000","last_deep_scrub":"266'382","last_deep_scrub_stamp":"2024-09-12T02:07:05.543080+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.543080+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:54.983427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2031,"num_read_kb":1954,"num_write":422,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"266'322","reported_seq":980,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.653422+0000","last_change":"2024-09-12T02:06:55.653280+0000","last_active":"2024-09-12T02:06:55.653422+0000","last_peered":"2024-09-12T02:06:55.653422+0000","last_clean":"2024-09-12T02:06:55.653422+0000","last_became_active":"2024-09-12T00:10:31.472231+0000","last_became_peered":"2024-09-12T00:10:31.472231+0000","last_unstale":"2024-09-12T02:06:55.653422+0000","last_undegraded":"2024-09-12T02:06:55.653422+0000","last_fullsized":"2024-09-12T02:06:55.653422+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'322","last_scrub_stamp":"2024-09-12T02:06:55.653042+0000","last_deep_scrub":"266'322","last_deep_scrub_stamp":"2024-09-12T02:06:55.653042+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.653042+0000","objects_scrubbed":10,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:59.726925+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536061,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":478,"num_read_kb":34994,"num_write":999,"num_write_kb":46604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"37'3","reported_seq":1006,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.109449+0000","last_change":"2024-09-12T00:10:03.266585+0000","last_active":"2024-09-12T02:06:44.109449+0000","last_peered":"2024-09-12T02:06:44.109449+0000","last_clean":"2024-09-12T02:06:44.109449+0000","last_became_active":"2024-09-12T00:10:03.265816+0000","last_became_peered":"2024-09-12T00:10:03.265816+0000","last_unstale":"2024-09-12T02:06:44.109449+0000","last_undegraded":"2024-09-12T02:06:44.109449+0000","last_fullsized":"2024-09-12T02:06:44.109449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:06.126620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"266'196","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.644390+0000","last_change":"2024-09-12T02:07:12.644244+0000","last_active":"2024-09-12T02:07:12.644390+0000","last_peered":"2024-09-12T02:07:12.644390+0000","last_clean":"2024-09-12T02:07:12.644390+0000","last_became_active":"2024-09-12T00:10:05.275499+0000","last_became_peered":"2024-09-12T00:10:05.275499+0000","last_unstale":"2024-09-12T02:07:12.644390+0000","last_undegraded":"2024-09-12T02:07:12.644390+0000","last_fullsized":"2024-09-12T02:07:12.644390+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T02:07:12.643996+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T02:07:12.643996+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.643996+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:07.730489+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":245,"num_read_kb":237,"num_write":164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"266'774","reported_seq":3030,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.967482+0000","last_change":"2024-09-12T00:10:07.319071+0000","last_active":"2024-09-12T02:06:46.967482+0000","last_peered":"2024-09-12T02:06:46.967482+0000","last_clean":"2024-09-12T02:06:46.967482+0000","last_became_active":"2024-09-12T00:10:07.318302+0000","last_became_peered":"2024-09-12T00:10:07.318302+0000","last_unstale":"2024-09-12T02:06:46.967482+0000","last_undegraded":"2024-09-12T02:06:46.967482+0000","last_fullsized":"2024-09-12T02:06:46.967482+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:04.659101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"266'205","reported_seq":1059,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.365691+0000","last_change":"2024-09-12T00:10:09.433574+0000","last_active":"2024-09-12T02:06:05.365691+0000","last_peered":"2024-09-12T02:06:05.365691+0000","last_clean":"2024-09-12T02:06:05.365691+0000","last_became_active":"2024-09-12T00:10:09.433045+0000","last_became_peered":"2024-09-12T00:10:09.433045+0000","last_unstale":"2024-09-12T02:06:05.365691+0000","last_undegraded":"2024-09-12T02:06:05.365691+0000","last_fullsized":"2024-09-12T02:06:05.365691+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:02.345129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":620,"num_write":453,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"266'392","reported_seq":1970,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.916035+0000","last_change":"2024-09-12T02:07:03.916035+0000","last_active":"2024-09-12T02:07:03.916035+0000","last_peered":"2024-09-12T02:07:03.916035+0000","last_clean":"2024-09-12T02:07:03.916035+0000","last_became_active":"2024-09-12T00:10:01.261217+0000","last_became_peered":"2024-09-12T00:10:01.261217+0000","last_unstale":"2024-09-12T02:07:03.916035+0000","last_undegraded":"2024-09-12T02:07:03.916035+0000","last_fullsized":"2024-09-12T02:07:03.916035+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T02:07:03.915856+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T02:07:03.915856+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.915856+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:20.348940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2298,"num_read_kb":2187,"num_write":432,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2545,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"266'343","reported_seq":1006,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.195668+0000","last_change":"2024-09-12T02:06:56.195668+0000","last_active":"2024-09-12T02:06:56.195668+0000","last_peered":"2024-09-12T02:06:56.195668+0000","last_clean":"2024-09-12T02:06:56.195668+0000","last_became_active":"2024-09-12T00:09:59.281330+0000","last_became_peered":"2024-09-12T00:09:59.281330+0000","last_unstale":"2024-09-12T02:06:56.195668+0000","last_undegraded":"2024-09-12T02:06:56.195668+0000","last_fullsized":"2024-09-12T02:06:56.195668+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'343","last_scrub_stamp":"2024-09-12T02:06:56.195432+0000","last_deep_scrub":"266'343","last_deep_scrub_stamp":"2024-09-12T02:06:56.195432+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.195432+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:40.190762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":6619,"num_write":1099,"num_write_kb":41386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:39.739031+0000","last_change":"2024-09-12T00:10:03.273556+0000","last_active":"2024-09-12T02:03:39.739031+0000","last_peered":"2024-09-12T02:03:39.739031+0000","last_clean":"2024-09-12T02:03:39.739031+0000","last_became_active":"2024-09-12T00:10:03.271292+0000","last_became_peered":"2024-09-12T00:10:03.271292+0000","last_unstale":"2024-09-12T02:03:39.739031+0000","last_undegraded":"2024-09-12T02:03:39.739031+0000","last_fullsized":"2024-09-12T02:03:39.739031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:46.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"266'320","reported_seq":938,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.659989+0000","last_change":"2024-09-12T00:10:05.363194+0000","last_active":"2024-09-12T02:06:46.659989+0000","last_peered":"2024-09-12T02:06:46.659989+0000","last_clean":"2024-09-12T02:06:46.659989+0000","last_became_active":"2024-09-12T00:10:05.361419+0000","last_became_peered":"2024-09-12T00:10:05.361419+0000","last_unstale":"2024-09-12T02:06:46.659989+0000","last_undegraded":"2024-09-12T02:06:46.659989+0000","last_fullsized":"2024-09-12T02:06:46.659989+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:25.749053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":523,"num_read_kb":1153,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"266'826","reported_seq":3122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.576381+0000","last_change":"2024-09-12T00:10:07.335921+0000","last_active":"2024-09-12T02:06:47.576381+0000","last_peered":"2024-09-12T02:06:47.576381+0000","last_clean":"2024-09-12T02:06:47.576381+0000","last_became_active":"2024-09-12T00:10:07.335181+0000","last_became_peered":"2024-09-12T00:10:07.335181+0000","last_unstale":"2024-09-12T02:06:47.576381+0000","last_undegraded":"2024-09-12T02:06:47.576381+0000","last_fullsized":"2024-09-12T02:06:47.576381+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"266'423","reported_seq":1883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.631654+0000","last_change":"2024-09-12T02:07:08.631654+0000","last_active":"2024-09-12T02:07:08.631654+0000","last_peered":"2024-09-12T02:07:08.631654+0000","last_clean":"2024-09-12T02:07:08.631654+0000","last_became_active":"2024-09-12T00:10:01.266204+0000","last_became_peered":"2024-09-12T00:10:01.266204+0000","last_unstale":"2024-09-12T02:07:08.631654+0000","last_undegraded":"2024-09-12T02:07:08.631654+0000","last_fullsized":"2024-09-12T02:07:08.631654+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T02:07:08.631455+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T02:07:08.631455+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.631455+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:50.621125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2063,"num_read_kb":1939,"num_write":461,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"266'375","reported_seq":1039,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.748793+0000","last_change":"2024-09-12T02:06:59.748793+0000","last_active":"2024-09-12T02:06:59.748793+0000","last_peered":"2024-09-12T02:06:59.748793+0000","last_clean":"2024-09-12T02:06:59.748793+0000","last_became_active":"2024-09-12T00:09:59.307481+0000","last_became_peered":"2024-09-12T00:09:59.307481+0000","last_unstale":"2024-09-12T02:06:59.748793+0000","last_undegraded":"2024-09-12T02:06:59.748793+0000","last_fullsized":"2024-09-12T02:06:59.748793+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'375","last_scrub_stamp":"2024-09-12T02:06:59.748525+0000","last_deep_scrub":"266'375","last_deep_scrub_stamp":"2024-09-12T02:06:59.748525+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.748525+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:19.336128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":11316,"num_write":1196,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.894687+0000","last_change":"2024-09-12T02:07:12.894687+0000","last_active":"2024-09-12T02:07:12.894687+0000","last_peered":"2024-09-12T02:07:12.894687+0000","last_clean":"2024-09-12T02:07:12.894687+0000","last_became_active":"2024-09-12T00:10:03.258601+0000","last_became_peered":"2024-09-12T00:10:03.258601+0000","last_unstale":"2024-09-12T02:07:12.894687+0000","last_undegraded":"2024-09-12T02:07:12.894687+0000","last_fullsized":"2024-09-12T02:07:12.894687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.894507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.894507+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.894507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:09.932960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"266'477","reported_seq":1179,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.421855+0000","last_change":"2024-09-12T00:10:05.362098+0000","last_active":"2024-09-12T02:06:47.421855+0000","last_peered":"2024-09-12T02:06:47.421855+0000","last_clean":"2024-09-12T02:06:47.421855+0000","last_became_active":"2024-09-12T00:10:05.361273+0000","last_became_peered":"2024-09-12T00:10:05.361273+0000","last_unstale":"2024-09-12T02:06:47.421855+0000","last_undegraded":"2024-09-12T02:06:47.421855+0000","last_fullsized":"2024-09-12T02:06:47.421855+0000","mapping_epoch":31,"log_start":"266'400","ondisk_log_start":"266'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:08.958275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46961,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":773,"num_read_kb":1424,"num_write":592,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.370591+0000","last_change":"2024-09-12T02:07:09.370591+0000","last_active":"2024-09-12T02:07:09.370591+0000","last_peered":"2024-09-12T02:07:09.370591+0000","last_clean":"2024-09-12T02:07:09.370591+0000","last_became_active":"2024-09-12T00:10:07.316670+0000","last_became_peered":"2024-09-12T00:10:07.316670+0000","last_unstale":"2024-09-12T02:07:09.370591+0000","last_undegraded":"2024-09-12T02:07:09.370591+0000","last_fullsized":"2024-09-12T02:07:09.370591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.370411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.370411+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.370411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:33.487199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"266'599","reported_seq":1441,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.124549+0000","last_change":"2024-09-12T00:10:09.368828+0000","last_active":"2024-09-12T02:06:07.124549+0000","last_peered":"2024-09-12T02:06:07.124549+0000","last_clean":"2024-09-12T02:06:07.124549+0000","last_became_active":"2024-09-12T00:10:09.368091+0000","last_became_peered":"2024-09-12T00:10:09.368091+0000","last_unstale":"2024-09-12T02:06:07.124549+0000","last_undegraded":"2024-09-12T02:06:07.124549+0000","last_fullsized":"2024-09-12T02:06:07.124549+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:38.890638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1323,"num_read_kb":1320,"num_write":1284,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"266'478","reported_seq":2146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.004942+0000","last_change":"2024-09-12T02:06:59.004792+0000","last_active":"2024-09-12T02:06:59.004942+0000","last_peered":"2024-09-12T02:06:59.004942+0000","last_clean":"2024-09-12T02:06:59.004942+0000","last_became_active":"2024-09-12T00:10:01.257821+0000","last_became_peered":"2024-09-12T00:10:01.257821+0000","last_unstale":"2024-09-12T02:06:59.004942+0000","last_undegraded":"2024-09-12T02:06:59.004942+0000","last_fullsized":"2024-09-12T02:06:59.004942+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T02:06:59.004587+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T02:06:59.004587+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.004587+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:37.594672+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2372,"num_write":561,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"266'348","reported_seq":1005,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.746366+0000","last_change":"2024-09-12T02:06:58.746131+0000","last_active":"2024-09-12T02:06:58.746366+0000","last_peered":"2024-09-12T02:06:58.746366+0000","last_clean":"2024-09-12T02:06:58.746366+0000","last_became_active":"2024-09-12T00:09:59.308185+0000","last_became_peered":"2024-09-12T00:09:59.308185+0000","last_unstale":"2024-09-12T02:06:58.746366+0000","last_undegraded":"2024-09-12T02:06:58.746366+0000","last_fullsized":"2024-09-12T02:06:58.746366+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'348","last_scrub_stamp":"2024-09-12T02:06:58.745829+0000","last_deep_scrub":"266'348","last_deep_scrub_stamp":"2024-09-12T02:06:58.745829+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.745829+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:55.531829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":32387,"num_write":1082,"num_write_kb":39559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.633879+0000","last_change":"2024-09-12T02:07:03.633737+0000","last_active":"2024-09-12T02:07:03.633879+0000","last_peered":"2024-09-12T02:07:03.633879+0000","last_clean":"2024-09-12T02:07:03.633879+0000","last_became_active":"2024-09-12T00:10:03.250360+0000","last_became_peered":"2024-09-12T00:10:03.250360+0000","last_unstale":"2024-09-12T02:07:03.633879+0000","last_undegraded":"2024-09-12T02:07:03.633879+0000","last_fullsized":"2024-09-12T02:07:03.633879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:03.633514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:03.633514+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.633514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:58.442879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"266'309","reported_seq":935,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.652422+0000","last_change":"2024-09-12T00:10:05.292211+0000","last_active":"2024-09-12T02:06:45.652422+0000","last_peered":"2024-09-12T02:06:45.652422+0000","last_clean":"2024-09-12T02:06:45.652422+0000","last_became_active":"2024-09-12T00:10:05.288035+0000","last_became_peered":"2024-09-12T00:10:05.288035+0000","last_unstale":"2024-09-12T02:06:45.652422+0000","last_undegraded":"2024-09-12T02:06:45.652422+0000","last_fullsized":"2024-09-12T02:06:45.652422+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51853,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1112,"num_write":408,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.952988+0000","last_change":"2024-09-12T00:10:07.340807+0000","last_active":"2024-09-12T02:03:03.952988+0000","last_peered":"2024-09-12T02:03:03.952988+0000","last_clean":"2024-09-12T02:03:03.952988+0000","last_became_active":"2024-09-12T00:10:07.340248+0000","last_became_peered":"2024-09-12T00:10:07.340248+0000","last_unstale":"2024-09-12T02:03:03.952988+0000","last_undegraded":"2024-09-12T02:03:03.952988+0000","last_fullsized":"2024-09-12T02:03:03.952988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.585478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"266'116","reported_seq":643,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:13.737132+0000","last_change":"2024-09-12T00:10:09.361661+0000","last_active":"2024-09-12T02:05:13.737132+0000","last_peered":"2024-09-12T02:05:13.737132+0000","last_clean":"2024-09-12T02:05:13.737132+0000","last_became_active":"2024-09-12T00:10:09.359663+0000","last_became_peered":"2024-09-12T00:10:09.359663+0000","last_unstale":"2024-09-12T02:05:13.737132+0000","last_undegraded":"2024-09-12T02:05:13.737132+0000","last_fullsized":"2024-09-12T02:05:13.737132+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:19.918840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":110,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"266'1044","reported_seq":2844,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.040796+0000","last_change":"2024-09-12T02:07:02.040796+0000","last_active":"2024-09-12T02:07:02.040796+0000","last_peered":"2024-09-12T02:07:02.040796+0000","last_clean":"2024-09-12T02:07:02.040796+0000","last_became_active":"2024-09-12T00:10:01.263012+0000","last_became_peered":"2024-09-12T00:10:01.263012+0000","last_unstale":"2024-09-12T02:07:02.040796+0000","last_undegraded":"2024-09-12T02:07:02.040796+0000","last_fullsized":"2024-09-12T02:07:02.040796+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1044","last_scrub_stamp":"2024-09-12T02:07:02.040566+0000","last_deep_scrub":"266'1044","last_deep_scrub_stamp":"2024-09-12T02:07:02.040566+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.040566+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":1000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:28.934270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4917,"num_read_kb":4393,"num_write":1427,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"266'301","reported_seq":930,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.605147+0000","last_change":"2024-09-12T02:07:01.605147+0000","last_active":"2024-09-12T02:07:01.605147+0000","last_peered":"2024-09-12T02:07:01.605147+0000","last_clean":"2024-09-12T02:07:01.605147+0000","last_became_active":"2024-09-12T00:10:31.477934+0000","last_became_peered":"2024-09-12T00:10:31.477934+0000","last_unstale":"2024-09-12T02:07:01.605147+0000","last_undegraded":"2024-09-12T02:07:01.605147+0000","last_fullsized":"2024-09-12T02:07:01.605147+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'301","last_scrub_stamp":"2024-09-12T02:07:01.604849+0000","last_deep_scrub":"266'301","last_deep_scrub_stamp":"2024-09-12T02:07:01.604849+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.604849+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.155816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":400,"num_read_kb":33911,"num_write":938,"num_write_kb":31727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.745903+0000","last_change":"2024-09-12T02:07:07.745903+0000","last_active":"2024-09-12T02:07:07.745903+0000","last_peered":"2024-09-12T02:07:07.745903+0000","last_clean":"2024-09-12T02:07:07.745903+0000","last_became_active":"2024-09-12T00:10:03.254328+0000","last_became_peered":"2024-09-12T00:10:03.254328+0000","last_unstale":"2024-09-12T02:07:07.745903+0000","last_undegraded":"2024-09-12T02:07:07.745903+0000","last_fullsized":"2024-09-12T02:07:07.745903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.745700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.745700+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.745700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:02.537185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"266'397","reported_seq":1063,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.566817+0000","last_change":"2024-09-12T00:10:05.286921+0000","last_active":"2024-09-12T02:06:47.566817+0000","last_peered":"2024-09-12T02:06:47.566817+0000","last_clean":"2024-09-12T02:06:47.566817+0000","last_became_active":"2024-09-12T00:10:05.285616+0000","last_became_peered":"2024-09-12T00:10:05.285616+0000","last_unstale":"2024-09-12T02:06:47.566817+0000","last_undegraded":"2024-09-12T02:06:47.566817+0000","last_fullsized":"2024-09-12T02:06:47.566817+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44989,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":1221,"num_write":494,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"266'803","reported_seq":3293,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.577375+0000","last_change":"2024-09-12T00:10:07.320523+0000","last_active":"2024-09-12T02:06:47.577375+0000","last_peered":"2024-09-12T02:06:47.577375+0000","last_clean":"2024-09-12T02:06:47.577375+0000","last_became_active":"2024-09-12T00:10:07.319708+0000","last_became_peered":"2024-09-12T00:10:07.319708+0000","last_unstale":"2024-09-12T02:06:47.577375+0000","last_undegraded":"2024-09-12T02:06:47.577375+0000","last_fullsized":"2024-09-12T02:06:47.577375+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"266'112","reported_seq":639,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.685568+0000","last_change":"2024-09-12T00:10:09.358471+0000","last_active":"2024-09-12T02:06:05.685568+0000","last_peered":"2024-09-12T02:06:05.685568+0000","last_clean":"2024-09-12T02:06:05.685568+0000","last_became_active":"2024-09-12T00:10:09.357682+0000","last_became_peered":"2024-09-12T00:10:09.357682+0000","last_unstale":"2024-09-12T02:06:05.685568+0000","last_undegraded":"2024-09-12T02:06:05.685568+0000","last_fullsized":"2024-09-12T02:06:05.685568+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":265,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"266'779","reported_seq":2348,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.499361+0000","last_change":"2024-09-12T02:07:04.499361+0000","last_active":"2024-09-12T02:07:04.499361+0000","last_peered":"2024-09-12T02:07:04.499361+0000","last_clean":"2024-09-12T02:07:04.499361+0000","last_became_active":"2024-09-12T00:10:01.258536+0000","last_became_peered":"2024-09-12T00:10:01.258536+0000","last_unstale":"2024-09-12T02:07:04.499361+0000","last_undegraded":"2024-09-12T02:07:04.499361+0000","last_fullsized":"2024-09-12T02:07:04.499361+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'779","last_scrub_stamp":"2024-09-12T02:07:04.499174+0000","last_deep_scrub":"266'779","last_deep_scrub_stamp":"2024-09-12T02:07:04.499174+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.499174+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:49.045153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3854,"num_read_kb":3489,"num_write":1035,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"266'390","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.676263+0000","last_change":"2024-09-12T02:06:58.676117+0000","last_active":"2024-09-12T02:06:58.676263+0000","last_peered":"2024-09-12T02:06:58.676263+0000","last_clean":"2024-09-12T02:06:58.676263+0000","last_became_active":"2024-09-12T00:09:59.283882+0000","last_became_peered":"2024-09-12T00:09:59.283882+0000","last_unstale":"2024-09-12T02:06:58.676263+0000","last_undegraded":"2024-09-12T02:06:58.676263+0000","last_fullsized":"2024-09-12T02:06:58.676263+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:06:58.675891+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:06:58.675891+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.675891+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.972022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":25090,"num_write":1213,"num_write_kb":35310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.707659+0000","last_change":"2024-09-12T02:07:05.707659+0000","last_active":"2024-09-12T02:07:05.707659+0000","last_peered":"2024-09-12T02:07:05.707659+0000","last_clean":"2024-09-12T02:07:05.707659+0000","last_became_active":"2024-09-12T00:10:03.250840+0000","last_became_peered":"2024-09-12T00:10:03.250840+0000","last_unstale":"2024-09-12T02:07:05.707659+0000","last_undegraded":"2024-09-12T02:07:05.707659+0000","last_fullsized":"2024-09-12T02:07:05.707659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.707476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.707476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.707476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:17.730653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"266'538","reported_seq":1231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.954310+0000","last_change":"2024-09-12T00:10:05.287261+0000","last_active":"2024-09-12T02:06:45.954310+0000","last_peered":"2024-09-12T02:06:45.954310+0000","last_clean":"2024-09-12T02:06:45.954310+0000","last_became_active":"2024-09-12T00:10:05.285823+0000","last_became_peered":"2024-09-12T00:10:05.285823+0000","last_unstale":"2024-09-12T02:06:45.954310+0000","last_undegraded":"2024-09-12T02:06:45.954310+0000","last_fullsized":"2024-09-12T02:06:45.954310+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96632,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":936,"num_read_kb":2160,"num_write":758,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.666557+0000","last_change":"2024-09-12T02:07:09.666557+0000","last_active":"2024-09-12T02:07:09.666557+0000","last_peered":"2024-09-12T02:07:09.666557+0000","last_clean":"2024-09-12T02:07:09.666557+0000","last_became_active":"2024-09-12T00:10:07.321180+0000","last_became_peered":"2024-09-12T00:10:07.321180+0000","last_unstale":"2024-09-12T02:07:09.666557+0000","last_undegraded":"2024-09-12T02:07:09.666557+0000","last_fullsized":"2024-09-12T02:07:09.666557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.666383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.666383+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.666383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:09.668378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"266'133","reported_seq":711,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.713693+0000","last_change":"2024-09-12T00:10:09.361110+0000","last_active":"2024-09-12T02:04:58.713693+0000","last_peered":"2024-09-12T02:04:58.713693+0000","last_clean":"2024-09-12T02:04:58.713693+0000","last_became_active":"2024-09-12T00:10:09.359011+0000","last_became_peered":"2024-09-12T00:10:09.359011+0000","last_unstale":"2024-09-12T02:04:58.713693+0000","last_undegraded":"2024-09-12T02:04:58.713693+0000","last_fullsized":"2024-09-12T02:04:58.713693+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":320,"num_read_kb":272,"num_write":321,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"266'1105","reported_seq":2654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.037747+0000","last_change":"2024-09-12T02:07:00.037591+0000","last_active":"2024-09-12T02:07:00.037747+0000","last_peered":"2024-09-12T02:07:00.037747+0000","last_clean":"2024-09-12T02:07:00.037747+0000","last_became_active":"2024-09-12T00:10:01.248297+0000","last_became_peered":"2024-09-12T00:10:01.248297+0000","last_unstale":"2024-09-12T02:07:00.037747+0000","last_undegraded":"2024-09-12T02:07:00.037747+0000","last_fullsized":"2024-09-12T02:07:00.037747+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1105","last_scrub_stamp":"2024-09-12T02:07:00.037413+0000","last_deep_scrub":"266'1105","last_deep_scrub_stamp":"2024-09-12T02:07:00.037413+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.037413+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.519559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4909,"num_read_kb":4337,"num_write":1501,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"266'325","reported_seq":988,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.848958+0000","last_change":"2024-09-12T02:06:57.848683+0000","last_active":"2024-09-12T02:06:57.848958+0000","last_peered":"2024-09-12T02:06:57.848958+0000","last_clean":"2024-09-12T02:06:57.848958+0000","last_became_active":"2024-09-12T00:10:31.165905+0000","last_became_peered":"2024-09-12T00:10:31.165905+0000","last_unstale":"2024-09-12T02:06:57.848958+0000","last_undegraded":"2024-09-12T02:06:57.848958+0000","last_fullsized":"2024-09-12T02:06:57.848958+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'325","last_scrub_stamp":"2024-09-12T02:06:57.848241+0000","last_deep_scrub":"266'325","last_deep_scrub_stamp":"2024-09-12T02:06:57.848241+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.848241+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:33.677094+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273693,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":433,"num_read_kb":2613,"num_write":1035,"num_write_kb":17332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,7],"acting":[3,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.710647+0000","last_change":"2024-09-12T02:07:08.710647+0000","last_active":"2024-09-12T02:07:08.710647+0000","last_peered":"2024-09-12T02:07:08.710647+0000","last_clean":"2024-09-12T02:07:08.710647+0000","last_became_active":"2024-09-12T00:10:03.254056+0000","last_became_peered":"2024-09-12T00:10:03.254056+0000","last_unstale":"2024-09-12T02:07:08.710647+0000","last_undegraded":"2024-09-12T02:07:08.710647+0000","last_fullsized":"2024-09-12T02:07:08.710647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:08.710471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:08.710471+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.710471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:45.641565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"266'379","reported_seq":1017,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.070272+0000","last_change":"2024-09-12T00:10:05.300463+0000","last_active":"2024-09-12T02:06:46.070272+0000","last_peered":"2024-09-12T02:06:46.070272+0000","last_clean":"2024-09-12T02:06:46.070272+0000","last_became_active":"2024-09-12T00:10:05.299568+0000","last_became_peered":"2024-09-12T00:10:05.299568+0000","last_unstale":"2024-09-12T02:06:46.070272+0000","last_undegraded":"2024-09-12T02:06:46.070272+0000","last_fullsized":"2024-09-12T02:06:46.070272+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":635,"num_read_kb":1318,"num_write":554,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:08.726007+0000","last_change":"2024-09-12T00:10:07.335273+0000","last_active":"2024-09-12T02:03:08.726007+0000","last_peered":"2024-09-12T02:03:08.726007+0000","last_clean":"2024-09-12T02:03:08.726007+0000","last_became_active":"2024-09-12T00:10:07.334527+0000","last_became_peered":"2024-09-12T00:10:07.334527+0000","last_unstale":"2024-09-12T02:03:08.726007+0000","last_undegraded":"2024-09-12T02:03:08.726007+0000","last_fullsized":"2024-09-12T02:03:08.726007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:58.243181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"266'171","reported_seq":743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:53.394855+0000","last_change":"2024-09-12T00:10:09.373893+0000","last_active":"2024-09-12T02:05:53.394855+0000","last_peered":"2024-09-12T02:05:53.394855+0000","last_clean":"2024-09-12T02:05:53.394855+0000","last_became_active":"2024-09-12T00:10:09.373318+0000","last_became_peered":"2024-09-12T00:10:09.373318+0000","last_unstale":"2024-09-12T02:05:53.394855+0000","last_undegraded":"2024-09-12T02:05:53.394855+0000","last_fullsized":"2024-09-12T02:05:53.394855+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:12.690531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":275,"num_write":406,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"266'793","reported_seq":2426,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.049441+0000","last_change":"2024-09-12T02:07:01.049290+0000","last_active":"2024-09-12T02:07:01.049441+0000","last_peered":"2024-09-12T02:07:01.049441+0000","last_clean":"2024-09-12T02:07:01.049441+0000","last_became_active":"2024-09-12T00:10:01.242213+0000","last_became_peered":"2024-09-12T00:10:01.242213+0000","last_unstale":"2024-09-12T02:07:01.049441+0000","last_undegraded":"2024-09-12T02:07:01.049441+0000","last_fullsized":"2024-09-12T02:07:01.049441+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'793","last_scrub_stamp":"2024-09-12T02:07:01.049091+0000","last_deep_scrub":"266'793","last_deep_scrub_stamp":"2024-09-12T02:07:01.049091+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.049091+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:47.730275+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3776,"num_read_kb":3427,"num_write":1023,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"266'387","reported_seq":1086,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.183396+0000","last_change":"2024-09-12T02:06:57.183396+0000","last_active":"2024-09-12T02:06:57.183396+0000","last_peered":"2024-09-12T02:06:57.183396+0000","last_clean":"2024-09-12T02:06:57.183396+0000","last_became_active":"2024-09-12T00:09:59.298986+0000","last_became_peered":"2024-09-12T00:09:59.298986+0000","last_unstale":"2024-09-12T02:06:57.183396+0000","last_undegraded":"2024-09-12T02:06:57.183396+0000","last_fullsized":"2024-09-12T02:06:57.183396+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'387","last_scrub_stamp":"2024-09-12T02:06:57.183120+0000","last_deep_scrub":"266'387","last_deep_scrub_stamp":"2024-09-12T02:06:57.183120+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.183120+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:28.858130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":586,"num_read_kb":16563,"num_write":1186,"num_write_kb":29581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.329996+0000","last_change":"2024-09-12T02:07:06.329996+0000","last_active":"2024-09-12T02:07:06.329996+0000","last_peered":"2024-09-12T02:07:06.329996+0000","last_clean":"2024-09-12T02:07:06.329996+0000","last_became_active":"2024-09-12T00:10:03.262121+0000","last_became_peered":"2024-09-12T00:10:03.262121+0000","last_unstale":"2024-09-12T02:07:06.329996+0000","last_undegraded":"2024-09-12T02:07:06.329996+0000","last_fullsized":"2024-09-12T02:07:06.329996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:06.329806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:06.329806+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.329806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:06.288745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"266'396","reported_seq":1059,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.650583+0000","last_change":"2024-09-12T02:07:11.650583+0000","last_active":"2024-09-12T02:07:11.650583+0000","last_peered":"2024-09-12T02:07:11.650583+0000","last_clean":"2024-09-12T02:07:11.650583+0000","last_became_active":"2024-09-12T00:10:05.294629+0000","last_became_peered":"2024-09-12T00:10:05.294629+0000","last_unstale":"2024-09-12T02:07:11.650583+0000","last_undegraded":"2024-09-12T02:07:11.650583+0000","last_fullsized":"2024-09-12T02:07:11.650583+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'396","last_scrub_stamp":"2024-09-12T02:07:11.650372+0000","last_deep_scrub":"266'396","last_deep_scrub_stamp":"2024-09-12T02:07:11.650372+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.650372+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:14.428526+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46543,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":631,"num_read_kb":1251,"num_write":492,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"266'749","reported_seq":3296,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.619689+0000","last_change":"2024-09-12T02:07:10.619689+0000","last_active":"2024-09-12T02:07:10.619689+0000","last_peered":"2024-09-12T02:07:10.619689+0000","last_clean":"2024-09-12T02:07:10.619689+0000","last_became_active":"2024-09-12T00:10:07.314777+0000","last_became_peered":"2024-09-12T00:10:07.314777+0000","last_unstale":"2024-09-12T02:07:10.619689+0000","last_undegraded":"2024-09-12T02:07:10.619689+0000","last_fullsized":"2024-09-12T02:07:10.619689+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'749","last_scrub_stamp":"2024-09-12T02:07:10.619509+0000","last_deep_scrub":"266'749","last_deep_scrub_stamp":"2024-09-12T02:07:10.619509+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.619509+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:06.239730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"266'132","reported_seq":670,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.682437+0000","last_change":"2024-09-12T00:10:09.347267+0000","last_active":"2024-09-12T02:04:57.682437+0000","last_peered":"2024-09-12T02:04:57.682437+0000","last_clean":"2024-09-12T02:04:57.682437+0000","last_became_active":"2024-09-12T00:10:09.346452+0000","last_became_peered":"2024-09-12T00:10:09.346452+0000","last_unstale":"2024-09-12T02:04:57.682437+0000","last_undegraded":"2024-09-12T02:04:57.682437+0000","last_fullsized":"2024-09-12T02:04:57.682437+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:11.712124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":133,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"266'1061","reported_seq":2659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.049484+0000","last_change":"2024-09-12T02:07:02.049238+0000","last_active":"2024-09-12T02:07:02.049484+0000","last_peered":"2024-09-12T02:07:02.049484+0000","last_clean":"2024-09-12T02:07:02.049484+0000","last_became_active":"2024-09-12T00:10:01.264718+0000","last_became_peered":"2024-09-12T00:10:01.264718+0000","last_unstale":"2024-09-12T02:07:02.049484+0000","last_undegraded":"2024-09-12T02:07:02.049484+0000","last_fullsized":"2024-09-12T02:07:02.049484+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1061","last_scrub_stamp":"2024-09-12T02:07:02.049006+0000","last_deep_scrub":"266'1061","last_deep_scrub_stamp":"2024-09-12T02:07:02.049006+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.049006+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":1000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:54.290718+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4853,"num_read_kb":4249,"num_write":1477,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1148,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"266'417","reported_seq":1122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.038069+0000","last_change":"2024-09-12T02:06:54.037809+0000","last_active":"2024-09-12T02:06:54.038069+0000","last_peered":"2024-09-12T02:06:54.038069+0000","last_clean":"2024-09-12T02:06:54.038069+0000","last_became_active":"2024-09-12T00:09:59.301303+0000","last_became_peered":"2024-09-12T00:09:59.301303+0000","last_unstale":"2024-09-12T02:06:54.038069+0000","last_undegraded":"2024-09-12T02:06:54.038069+0000","last_fullsized":"2024-09-12T02:06:54.038069+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'417","last_scrub_stamp":"2024-09-12T02:06:54.037420+0000","last_deep_scrub":"266'417","last_deep_scrub_stamp":"2024-09-12T02:06:54.037420+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.037420+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:35.287042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443899,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":39523,"num_write":1279,"num_write_kb":37758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.121629+0000","last_change":"2024-09-12T00:10:03.274423+0000","last_active":"2024-09-12T02:06:44.121629+0000","last_peered":"2024-09-12T02:06:44.121629+0000","last_clean":"2024-09-12T02:06:44.121629+0000","last_became_active":"2024-09-12T00:10:03.271281+0000","last_became_peered":"2024-09-12T00:10:03.271281+0000","last_unstale":"2024-09-12T02:06:44.121629+0000","last_undegraded":"2024-09-12T02:06:44.121629+0000","last_fullsized":"2024-09-12T02:06:44.121629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:31.849595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"266'147","reported_seq":729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:53.983393+0000","last_change":"2024-09-12T00:10:05.363280+0000","last_active":"2024-09-12T02:04:53.983393+0000","last_peered":"2024-09-12T02:04:53.983393+0000","last_clean":"2024-09-12T02:04:53.983393+0000","last_became_active":"2024-09-12T00:10:05.362449+0000","last_became_peered":"2024-09-12T00:10:05.362449+0000","last_unstale":"2024-09-12T02:04:53.983393+0000","last_undegraded":"2024-09-12T02:04:53.983393+0000","last_fullsized":"2024-09-12T02:04:53.983393+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"266'764","reported_seq":3355,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.068319+0000","last_change":"2024-09-12T02:07:11.068319+0000","last_active":"2024-09-12T02:07:11.068319+0000","last_peered":"2024-09-12T02:07:11.068319+0000","last_clean":"2024-09-12T02:07:11.068319+0000","last_became_active":"2024-09-12T00:10:07.318566+0000","last_became_peered":"2024-09-12T00:10:07.318566+0000","last_unstale":"2024-09-12T02:07:11.068319+0000","last_undegraded":"2024-09-12T02:07:11.068319+0000","last_fullsized":"2024-09-12T02:07:11.068319+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'764","last_scrub_stamp":"2024-09-12T02:07:11.068113+0000","last_deep_scrub":"266'764","last_deep_scrub_stamp":"2024-09-12T02:07:11.068113+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.068113+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:47.655491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"266'180","reported_seq":711,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.523007+0000","last_change":"2024-09-12T00:10:09.353927+0000","last_active":"2024-09-12T02:04:57.523007+0000","last_peered":"2024-09-12T02:04:57.523007+0000","last_clean":"2024-09-12T02:04:57.523007+0000","last_became_active":"2024-09-12T00:10:09.353213+0000","last_became_peered":"2024-09-12T00:10:09.353213+0000","last_unstale":"2024-09-12T02:04:57.523007+0000","last_undegraded":"2024-09-12T02:04:57.523007+0000","last_fullsized":"2024-09-12T02:04:57.523007+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:39.991544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":410,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"266'439","reported_seq":1998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.417624+0000","last_change":"2024-09-12T02:07:00.417624+0000","last_active":"2024-09-12T02:07:00.417624+0000","last_peered":"2024-09-12T02:07:00.417624+0000","last_clean":"2024-09-12T02:07:00.417624+0000","last_became_active":"2024-09-12T00:10:01.256287+0000","last_became_peered":"2024-09-12T00:10:01.256287+0000","last_unstale":"2024-09-12T02:07:00.417624+0000","last_undegraded":"2024-09-12T02:07:00.417624+0000","last_fullsized":"2024-09-12T02:07:00.417624+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'439","last_scrub_stamp":"2024-09-12T02:07:00.417437+0000","last_deep_scrub":"266'439","last_deep_scrub_stamp":"2024-09-12T02:07:00.417437+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.417437+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:35.069664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2163,"num_write":523,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"266'451","reported_seq":1398,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.877423+0000","last_change":"2024-09-12T02:06:54.877268+0000","last_active":"2024-09-12T02:06:54.877423+0000","last_peered":"2024-09-12T02:06:54.877423+0000","last_clean":"2024-09-12T02:06:54.877423+0000","last_became_active":"2024-09-12T00:10:31.168654+0000","last_became_peered":"2024-09-12T00:10:31.168654+0000","last_unstale":"2024-09-12T02:06:54.877423+0000","last_undegraded":"2024-09-12T02:06:54.877423+0000","last_fullsized":"2024-09-12T02:06:54.877423+0000","mapping_epoch":38,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'451","last_scrub_stamp":"2024-09-12T02:06:54.877036+0000","last_deep_scrub":"266'451","last_deep_scrub_stamp":"2024-09-12T02:06:54.877036+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.877036+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.689710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777138,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1245,"num_read_kb":67964,"num_write":1343,"num_write_kb":19763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.763898+0000","last_change":"2024-09-12T00:10:03.273199+0000","last_active":"2024-09-12T02:04:48.763898+0000","last_peered":"2024-09-12T02:04:48.763898+0000","last_clean":"2024-09-12T02:04:48.763898+0000","last_became_active":"2024-09-12T00:10:03.272284+0000","last_became_peered":"2024-09-12T00:10:03.272284+0000","last_unstale":"2024-09-12T02:04:48.763898+0000","last_undegraded":"2024-09-12T02:04:48.763898+0000","last_fullsized":"2024-09-12T02:04:48.763898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"266'536","reported_seq":1219,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.153986+0000","last_change":"2024-09-12T00:10:05.301341+0000","last_active":"2024-09-12T02:06:47.153986+0000","last_peered":"2024-09-12T02:06:47.153986+0000","last_clean":"2024-09-12T02:06:47.153986+0000","last_became_active":"2024-09-12T00:10:05.300354+0000","last_became_peered":"2024-09-12T00:10:05.300354+0000","last_unstale":"2024-09-12T02:06:47.153986+0000","last_undegraded":"2024-09-12T02:06:47.153986+0000","last_fullsized":"2024-09-12T02:06:47.153986+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54476,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1438,"num_read_kb":1976,"num_write":2042,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.072344+0000","last_change":"2024-09-12T02:07:12.072344+0000","last_active":"2024-09-12T02:07:12.072344+0000","last_peered":"2024-09-12T02:07:12.072344+0000","last_clean":"2024-09-12T02:07:12.072344+0000","last_became_active":"2024-09-12T00:10:07.340008+0000","last_became_peered":"2024-09-12T00:10:07.340008+0000","last_unstale":"2024-09-12T02:07:12.072344+0000","last_undegraded":"2024-09-12T02:07:12.072344+0000","last_fullsized":"2024-09-12T02:07:12.072344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.072166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.072166+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.072166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:29.623883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"266'137","reported_seq":681,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.709447+0000","last_change":"2024-09-12T00:10:09.373165+0000","last_active":"2024-09-12T02:04:43.709447+0000","last_peered":"2024-09-12T02:04:43.709447+0000","last_clean":"2024-09-12T02:04:43.709447+0000","last_became_active":"2024-09-12T00:10:09.372231+0000","last_became_peered":"2024-09-12T00:10:09.372231+0000","last_unstale":"2024-09-12T02:04:43.709447+0000","last_undegraded":"2024-09-12T02:04:43.709447+0000","last_fullsized":"2024-09-12T02:04:43.709447+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:27.875059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"266'757","reported_seq":2316,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.070990+0000","last_change":"2024-09-12T02:07:01.070708+0000","last_active":"2024-09-12T02:07:01.070990+0000","last_peered":"2024-09-12T02:07:01.070990+0000","last_clean":"2024-09-12T02:07:01.070990+0000","last_became_active":"2024-09-12T00:10:01.262490+0000","last_became_peered":"2024-09-12T00:10:01.262490+0000","last_unstale":"2024-09-12T02:07:01.070990+0000","last_undegraded":"2024-09-12T02:07:01.070990+0000","last_fullsized":"2024-09-12T02:07:01.070990+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'757","last_scrub_stamp":"2024-09-12T02:07:01.070499+0000","last_deep_scrub":"266'757","last_deep_scrub_stamp":"2024-09-12T02:07:01.070499+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.070499+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:21.203677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3216,"num_write":966,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.772265+0000","last_change":"2024-09-12T02:06:55.772265+0000","last_active":"2024-09-12T02:06:55.772265+0000","last_peered":"2024-09-12T02:06:55.772265+0000","last_clean":"2024-09-12T02:06:55.772265+0000","last_became_active":"2024-09-12T00:09:40.224430+0000","last_became_peered":"2024-09-12T00:09:40.224430+0000","last_unstale":"2024-09-12T02:06:55.772265+0000","last_undegraded":"2024-09-12T02:06:55.772265+0000","last_fullsized":"2024-09-12T02:06:55.772265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T02:06:55.772071+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T02:06:55.772071+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.772071+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:02.200479+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":566,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.755705+0000","last_change":"2024-09-12T02:06:55.755705+0000","last_active":"2024-09-12T02:06:55.755705+0000","last_peered":"2024-09-12T02:06:55.755705+0000","last_clean":"2024-09-12T02:06:55.755705+0000","last_became_active":"2024-09-12T00:09:46.162330+0000","last_became_peered":"2024-09-12T00:09:46.162330+0000","last_unstale":"2024-09-12T02:06:55.755705+0000","last_undegraded":"2024-09-12T02:06:55.755705+0000","last_fullsized":"2024-09-12T02:06:55.755705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:06:55.755515+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:06:55.755515+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.755515+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:19.877569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090615300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"266'321","reported_seq":992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.871360+0000","last_change":"2024-09-12T02:06:55.871360+0000","last_active":"2024-09-12T02:06:55.871360+0000","last_peered":"2024-09-12T02:06:55.871360+0000","last_clean":"2024-09-12T02:06:55.871360+0000","last_became_active":"2024-09-12T00:09:59.310092+0000","last_became_peered":"2024-09-12T00:09:59.310092+0000","last_unstale":"2024-09-12T02:06:55.871360+0000","last_undegraded":"2024-09-12T02:06:55.871360+0000","last_fullsized":"2024-09-12T02:06:55.871360+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'321","last_scrub_stamp":"2024-09-12T02:06:55.871078+0000","last_deep_scrub":"266'321","last_deep_scrub_stamp":"2024-09-12T02:06:55.871078+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.871078+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:49.767328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306611,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":13893,"num_write":1018,"num_write_kb":29182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"266'6","reported_seq":1019,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.875218+0000","last_change":"2024-09-12T02:07:11.875218+0000","last_active":"2024-09-12T02:07:11.875218+0000","last_peered":"2024-09-12T02:07:11.875218+0000","last_clean":"2024-09-12T02:07:11.875218+0000","last_became_active":"2024-09-12T00:10:03.261183+0000","last_became_peered":"2024-09-12T00:10:03.261183+0000","last_unstale":"2024-09-12T02:07:11.875218+0000","last_undegraded":"2024-09-12T02:07:11.875218+0000","last_fullsized":"2024-09-12T02:07:11.875218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T02:07:11.875038+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T02:07:11.875038+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.875038+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:02.168922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"266'807","reported_seq":1562,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.330269+0000","last_change":"2024-09-12T00:10:05.294884+0000","last_active":"2024-09-12T02:06:47.330269+0000","last_peered":"2024-09-12T02:06:47.330269+0000","last_clean":"2024-09-12T02:06:47.330269+0000","last_became_active":"2024-09-12T00:10:05.294267+0000","last_became_peered":"2024-09-12T00:10:05.294267+0000","last_unstale":"2024-09-12T02:06:47.330269+0000","last_undegraded":"2024-09-12T02:06:47.330269+0000","last_fullsized":"2024-09-12T02:06:47.330269+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156191,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1567,"num_read_kb":3456,"num_write":1540,"num_write_kb":1367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.541770+0000","last_change":"2024-09-12T00:10:07.324124+0000","last_active":"2024-09-12T02:04:58.541770+0000","last_peered":"2024-09-12T02:04:58.541770+0000","last_clean":"2024-09-12T02:04:58.541770+0000","last_became_active":"2024-09-12T00:10:07.323398+0000","last_became_peered":"2024-09-12T00:10:07.323398+0000","last_unstale":"2024-09-12T02:04:58.541770+0000","last_undegraded":"2024-09-12T02:04:58.541770+0000","last_fullsized":"2024-09-12T02:04:58.541770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"266'247","reported_seq":999,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.012230+0000","last_change":"2024-09-12T00:10:09.374413+0000","last_active":"2024-09-12T02:05:00.012230+0000","last_peered":"2024-09-12T02:05:00.012230+0000","last_clean":"2024-09-12T02:05:00.012230+0000","last_became_active":"2024-09-12T00:10:09.373661+0000","last_became_peered":"2024-09-12T00:10:09.373661+0000","last_unstale":"2024-09-12T02:05:00.012230+0000","last_undegraded":"2024-09-12T02:05:00.012230+0000","last_fullsized":"2024-09-12T02:05:00.012230+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":498,"num_write":430,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"266'1255","reported_seq":3064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.482860+0000","last_change":"2024-09-12T02:07:03.482730+0000","last_active":"2024-09-12T02:07:03.482860+0000","last_peered":"2024-09-12T02:07:03.482860+0000","last_clean":"2024-09-12T02:07:03.482860+0000","last_became_active":"2024-09-12T00:10:31.471885+0000","last_became_peered":"2024-09-12T00:10:31.471885+0000","last_unstale":"2024-09-12T02:07:03.482860+0000","last_undegraded":"2024-09-12T02:07:03.482860+0000","last_fullsized":"2024-09-12T02:07:03.482860+0000","mapping_epoch":38,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1255","last_scrub_stamp":"2024-09-12T02:07:03.482543+0000","last_deep_scrub":"266'1255","last_deep_scrub_stamp":"2024-09-12T02:07:03.482543+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.482543+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:26.888676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6022,"num_read_kb":5329,"num_write":1728,"num_write_kb":723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5360,"num_omap_keys":21,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":560,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.756739+0000","last_change":"2024-09-12T02:06:56.756739+0000","last_active":"2024-09-12T02:06:56.756739+0000","last_peered":"2024-09-12T02:06:56.756739+0000","last_clean":"2024-09-12T02:06:56.756739+0000","last_became_active":"2024-09-12T00:09:46.164248+0000","last_became_peered":"2024-09-12T00:09:46.164248+0000","last_unstale":"2024-09-12T02:06:56.756739+0000","last_undegraded":"2024-09-12T02:06:56.756739+0000","last_fullsized":"2024-09-12T02:06:56.756739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:56.756558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:56.756558+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.756558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:24.410460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099742600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"266'334","reported_seq":990,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.535461+0000","last_change":"2024-09-12T02:06:53.535461+0000","last_active":"2024-09-12T02:06:53.535461+0000","last_peered":"2024-09-12T02:06:53.535461+0000","last_clean":"2024-09-12T02:06:53.535461+0000","last_became_active":"2024-09-12T00:09:59.293880+0000","last_became_peered":"2024-09-12T00:09:59.293880+0000","last_unstale":"2024-09-12T02:06:53.535461+0000","last_undegraded":"2024-09-12T02:06:53.535461+0000","last_fullsized":"2024-09-12T02:06:53.535461+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'334","last_scrub_stamp":"2024-09-12T02:06:53.535293+0000","last_deep_scrub":"266'334","last_deep_scrub_stamp":"2024-09-12T02:06:53.535293+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.535293+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:40.126937+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5590248,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":16782,"num_write":1093,"num_write_kb":42263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:54.756467+0000","last_change":"2024-09-12T00:10:03.273620+0000","last_active":"2024-09-12T02:04:54.756467+0000","last_peered":"2024-09-12T02:04:54.756467+0000","last_clean":"2024-09-12T02:04:54.756467+0000","last_became_active":"2024-09-12T00:10:03.271454+0000","last_became_peered":"2024-09-12T00:10:03.271454+0000","last_unstale":"2024-09-12T02:04:54.756467+0000","last_undegraded":"2024-09-12T02:04:54.756467+0000","last_fullsized":"2024-09-12T02:04:54.756467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"266'1460","reported_seq":3863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.403647+0000","last_change":"2024-09-12T02:07:13.403647+0000","last_active":"2024-09-12T02:07:13.403647+0000","last_peered":"2024-09-12T02:07:13.403647+0000","last_clean":"2024-09-12T02:07:13.403647+0000","last_became_active":"2024-09-12T00:10:05.295058+0000","last_became_peered":"2024-09-12T00:10:05.295058+0000","last_unstale":"2024-09-12T02:07:13.403647+0000","last_undegraded":"2024-09-12T02:07:13.403647+0000","last_fullsized":"2024-09-12T02:07:13.403647+0000","mapping_epoch":31,"log_start":"266'1400","ondisk_log_start":"266'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1460","last_scrub_stamp":"2024-09-12T02:07:13.403437+0000","last_deep_scrub":"266'1460","last_deep_scrub_stamp":"2024-09-12T02:07:13.403437+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.403437+0000","objects_scrubbed":12,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:33.536505+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161189,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2280,"num_read_kb":4238,"num_write":1386,"num_write_kb":1157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.764552+0000","last_change":"2024-09-12T00:10:07.320656+0000","last_active":"2024-09-12T02:05:08.764552+0000","last_peered":"2024-09-12T02:05:08.764552+0000","last_clean":"2024-09-12T02:05:08.764552+0000","last_became_active":"2024-09-12T00:10:07.319957+0000","last_became_peered":"2024-09-12T00:10:07.319957+0000","last_unstale":"2024-09-12T02:05:08.764552+0000","last_undegraded":"2024-09-12T02:05:08.764552+0000","last_fullsized":"2024-09-12T02:05:08.764552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"266'86","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.689469+0000","last_change":"2024-09-12T00:10:09.431550+0000","last_active":"2024-09-12T02:03:18.689469+0000","last_peered":"2024-09-12T02:03:18.689469+0000","last_clean":"2024-09-12T02:03:18.689469+0000","last_became_active":"2024-09-12T00:10:09.430727+0000","last_became_peered":"2024-09-12T00:10:09.430727+0000","last_unstale":"2024-09-12T02:03:18.689469+0000","last_undegraded":"2024-09-12T02:03:18.689469+0000","last_fullsized":"2024-09-12T02:03:18.689469+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:34.946722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"266'639","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.450994+0000","last_change":"2024-09-12T02:06:58.450831+0000","last_active":"2024-09-12T02:06:58.450994+0000","last_peered":"2024-09-12T02:06:58.450994+0000","last_clean":"2024-09-12T02:06:58.450994+0000","last_became_active":"2024-09-12T00:10:01.277302+0000","last_became_peered":"2024-09-12T00:10:01.277302+0000","last_unstale":"2024-09-12T02:06:58.450994+0000","last_undegraded":"2024-09-12T02:06:58.450994+0000","last_fullsized":"2024-09-12T02:06:58.450994+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'639","last_scrub_stamp":"2024-09-12T02:06:58.450656+0000","last_deep_scrub":"266'639","last_deep_scrub_stamp":"2024-09-12T02:06:58.450656+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.450656+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:52.660098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3369,"num_read_kb":3119,"num_write":789,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":562,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.645702+0000","last_change":"2024-09-12T02:06:53.645702+0000","last_active":"2024-09-12T02:06:53.645702+0000","last_peered":"2024-09-12T02:06:53.645702+0000","last_clean":"2024-09-12T02:06:53.645702+0000","last_became_active":"2024-09-12T00:09:46.179853+0000","last_became_peered":"2024-09-12T00:09:46.179853+0000","last_unstale":"2024-09-12T02:06:53.645702+0000","last_undegraded":"2024-09-12T02:06:53.645702+0000","last_fullsized":"2024-09-12T02:06:53.645702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:53.645611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:53.645611+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.645611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:10.578130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056473999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"266'337","reported_seq":1051,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.539651+0000","last_change":"2024-09-12T02:06:54.539651+0000","last_active":"2024-09-12T02:06:54.539651+0000","last_peered":"2024-09-12T02:06:54.539651+0000","last_clean":"2024-09-12T02:06:54.539651+0000","last_became_active":"2024-09-12T00:09:59.317172+0000","last_became_peered":"2024-09-12T00:09:59.317172+0000","last_unstale":"2024-09-12T02:06:54.539651+0000","last_undegraded":"2024-09-12T02:06:54.539651+0000","last_fullsized":"2024-09-12T02:06:54.539651+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'337","last_scrub_stamp":"2024-09-12T02:06:54.539255+0000","last_deep_scrub":"266'337","last_deep_scrub_stamp":"2024-09-12T02:06:54.539255+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.539255+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:20.701196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":79957,"num_write":1084,"num_write_kb":20693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":538,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.747793+0000","last_change":"2024-09-12T02:07:06.747793+0000","last_active":"2024-09-12T02:07:06.747793+0000","last_peered":"2024-09-12T02:07:06.747793+0000","last_clean":"2024-09-12T02:07:06.747793+0000","last_became_active":"2024-09-12T00:10:03.274519+0000","last_became_peered":"2024-09-12T00:10:03.274519+0000","last_unstale":"2024-09-12T02:07:06.747793+0000","last_undegraded":"2024-09-12T02:07:06.747793+0000","last_fullsized":"2024-09-12T02:07:06.747793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:06.747613+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:06.747613+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.747613+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:42.645385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"266'397","reported_seq":2387,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.323092+0000","last_change":"2024-09-12T00:10:05.366148+0000","last_active":"2024-09-12T02:06:07.323092+0000","last_peered":"2024-09-12T02:06:07.323092+0000","last_clean":"2024-09-12T02:06:07.323092+0000","last_became_active":"2024-09-12T00:10:05.365417+0000","last_became_peered":"2024-09-12T00:10:05.365417+0000","last_unstale":"2024-09-12T02:06:07.323092+0000","last_undegraded":"2024-09-12T02:06:07.323092+0000","last_fullsized":"2024-09-12T02:06:07.323092+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":388,"num_read_kb":374,"num_write":387,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.537567+0000","last_change":"2024-09-12T00:10:07.322896+0000","last_active":"2024-09-12T02:04:43.537567+0000","last_peered":"2024-09-12T02:04:43.537567+0000","last_clean":"2024-09-12T02:04:43.537567+0000","last_became_active":"2024-09-12T00:10:07.319786+0000","last_became_peered":"2024-09-12T00:10:07.319786+0000","last_unstale":"2024-09-12T02:04:43.537567+0000","last_undegraded":"2024-09-12T02:04:43.537567+0000","last_fullsized":"2024-09-12T02:04:43.537567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:38.776438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"266'255","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.504619+0000","last_change":"2024-09-12T00:10:09.366267+0000","last_active":"2024-09-12T02:05:00.504619+0000","last_peered":"2024-09-12T02:05:00.504619+0000","last_clean":"2024-09-12T02:05:00.504619+0000","last_became_active":"2024-09-12T00:10:09.365558+0000","last_became_peered":"2024-09-12T00:10:09.365558+0000","last_unstale":"2024-09-12T02:05:00.504619+0000","last_undegraded":"2024-09-12T02:05:00.504619+0000","last_fullsized":"2024-09-12T02:05:00.504619+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":520,"num_write":557,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"266'479","reported_seq":2058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.377367+0000","last_change":"2024-09-12T02:07:01.377367+0000","last_active":"2024-09-12T02:07:01.377367+0000","last_peered":"2024-09-12T02:07:01.377367+0000","last_clean":"2024-09-12T02:07:01.377367+0000","last_became_active":"2024-09-12T00:10:01.256107+0000","last_became_peered":"2024-09-12T00:10:01.256107+0000","last_unstale":"2024-09-12T02:07:01.377367+0000","last_undegraded":"2024-09-12T02:07:01.377367+0000","last_fullsized":"2024-09-12T02:07:01.377367+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'479","last_scrub_stamp":"2024-09-12T02:07:01.377182+0000","last_deep_scrub":"266'479","last_deep_scrub_stamp":"2024-09-12T02:07:01.377182+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.377182+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:21.624019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2517,"num_read_kb":2366,"num_write":564,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":567,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.713155+0000","last_change":"2024-09-12T02:06:54.713155+0000","last_active":"2024-09-12T02:06:54.713155+0000","last_peered":"2024-09-12T02:06:54.713155+0000","last_clean":"2024-09-12T02:06:54.713155+0000","last_became_active":"2024-09-12T00:09:46.161046+0000","last_became_peered":"2024-09-12T00:09:46.161046+0000","last_unstale":"2024-09-12T02:06:54.713155+0000","last_undegraded":"2024-09-12T02:06:54.713155+0000","last_fullsized":"2024-09-12T02:06:54.713155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:06:54.712965+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:06:54.712965+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.712965+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:06.136484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022130560000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"266'390","reported_seq":1054,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.642627+0000","last_change":"2024-09-12T02:06:52.642552+0000","last_active":"2024-09-12T02:06:52.642627+0000","last_peered":"2024-09-12T02:06:52.642627+0000","last_clean":"2024-09-12T02:06:52.642627+0000","last_became_active":"2024-09-12T00:10:31.473891+0000","last_became_peered":"2024-09-12T00:10:31.473891+0000","last_unstale":"2024-09-12T02:06:52.642627+0000","last_undegraded":"2024-09-12T02:06:52.642627+0000","last_fullsized":"2024-09-12T02:06:52.642627+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:06:52.642445+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:06:52.642445+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.642445+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:58.116732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1728219,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":35036,"num_write":1225,"num_write_kb":35348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.597228+0000","last_change":"2024-09-12T02:07:11.597228+0000","last_active":"2024-09-12T02:07:11.597228+0000","last_peered":"2024-09-12T02:07:11.597228+0000","last_clean":"2024-09-12T02:07:11.597228+0000","last_became_active":"2024-09-12T00:10:03.264991+0000","last_became_peered":"2024-09-12T00:10:03.264991+0000","last_unstale":"2024-09-12T02:07:11.597228+0000","last_undegraded":"2024-09-12T02:07:11.597228+0000","last_fullsized":"2024-09-12T02:07:11.597228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:11.597020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:11.597020+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.597020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:58.686303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"266'207","reported_seq":819,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.335365+0000","last_change":"2024-09-12T00:10:05.287107+0000","last_active":"2024-09-12T02:06:07.335365+0000","last_peered":"2024-09-12T02:06:07.335365+0000","last_clean":"2024-09-12T02:06:07.335365+0000","last_became_active":"2024-09-12T00:10:05.286433+0000","last_became_peered":"2024-09-12T00:10:05.286433+0000","last_unstale":"2024-09-12T02:06:07.335365+0000","last_undegraded":"2024-09-12T02:06:07.335365+0000","last_fullsized":"2024-09-12T02:06:07.335365+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":276,"num_read_kb":269,"num_write":202,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.733943+0000","last_change":"2024-09-12T00:10:07.331079+0000","last_active":"2024-09-12T02:04:58.733943+0000","last_peered":"2024-09-12T02:04:58.733943+0000","last_clean":"2024-09-12T02:04:58.733943+0000","last_became_active":"2024-09-12T00:10:07.329823+0000","last_became_peered":"2024-09-12T00:10:07.329823+0000","last_unstale":"2024-09-12T02:04:58.733943+0000","last_undegraded":"2024-09-12T02:04:58.733943+0000","last_fullsized":"2024-09-12T02:04:58.733943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"266'101","reported_seq":682,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.912020+0000","last_change":"2024-09-12T00:10:09.368892+0000","last_active":"2024-09-12T02:04:59.912020+0000","last_peered":"2024-09-12T02:04:59.912020+0000","last_clean":"2024-09-12T02:04:59.912020+0000","last_became_active":"2024-09-12T00:10:09.368176+0000","last_became_peered":"2024-09-12T00:10:09.368176+0000","last_unstale":"2024-09-12T02:04:59.912020+0000","last_undegraded":"2024-09-12T02:04:59.912020+0000","last_fullsized":"2024-09-12T02:04:59.912020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":222,"num_read_kb":212,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"266'448","reported_seq":2083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.466851+0000","last_change":"2024-09-12T02:06:59.466851+0000","last_active":"2024-09-12T02:06:59.466851+0000","last_peered":"2024-09-12T02:06:59.466851+0000","last_clean":"2024-09-12T02:06:59.466851+0000","last_became_active":"2024-09-12T00:10:01.275794+0000","last_became_peered":"2024-09-12T00:10:01.275794+0000","last_unstale":"2024-09-12T02:06:59.466851+0000","last_undegraded":"2024-09-12T02:06:59.466851+0000","last_fullsized":"2024-09-12T02:06:59.466851+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'448","last_scrub_stamp":"2024-09-12T02:06:59.466676+0000","last_deep_scrub":"266'448","last_deep_scrub_stamp":"2024-09-12T02:06:59.466676+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.466676+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:34.269252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":509,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"266'358","reported_seq":1072,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.725876+0000","last_change":"2024-09-12T02:06:56.725876+0000","last_active":"2024-09-12T02:06:56.725876+0000","last_peered":"2024-09-12T02:06:56.725876+0000","last_clean":"2024-09-12T02:06:56.725876+0000","last_became_active":"2024-09-12T00:09:59.262793+0000","last_became_peered":"2024-09-12T00:09:59.262793+0000","last_unstale":"2024-09-12T02:06:56.725876+0000","last_undegraded":"2024-09-12T02:06:56.725876+0000","last_fullsized":"2024-09-12T02:06:56.725876+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'358","last_scrub_stamp":"2024-09-12T02:06:56.725610+0000","last_deep_scrub":"266'358","last_deep_scrub_stamp":"2024-09-12T02:06:56.725610+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.725610+0000","objects_scrubbed":11,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.475621+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1952053,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":559,"num_read_kb":23144,"num_write":1133,"num_write_kb":26459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":560,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.602572+0000","last_change":"2024-09-12T02:06:52.602572+0000","last_active":"2024-09-12T02:06:52.602572+0000","last_peered":"2024-09-12T02:06:52.602572+0000","last_clean":"2024-09-12T02:06:52.602572+0000","last_became_active":"2024-09-12T00:09:46.178541+0000","last_became_peered":"2024-09-12T00:09:46.178541+0000","last_unstale":"2024-09-12T02:06:52.602572+0000","last_undegraded":"2024-09-12T02:06:52.602572+0000","last_fullsized":"2024-09-12T02:06:52.602572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:52.602473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:52.602473+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.602473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:51.748160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00107328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.543069+0000","last_change":"2024-09-12T02:07:13.543069+0000","last_active":"2024-09-12T02:07:13.543069+0000","last_peered":"2024-09-12T02:07:13.543069+0000","last_clean":"2024-09-12T02:07:13.543069+0000","last_became_active":"2024-09-12T00:10:03.258209+0000","last_became_peered":"2024-09-12T00:10:03.258209+0000","last_unstale":"2024-09-12T02:07:13.543069+0000","last_undegraded":"2024-09-12T02:07:13.543069+0000","last_fullsized":"2024-09-12T02:07:13.543069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.542886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.542886+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.542886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:53.684122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"266'731","reported_seq":1480,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.734931+0000","last_change":"2024-09-12T00:10:05.292028+0000","last_active":"2024-09-12T02:06:46.734931+0000","last_peered":"2024-09-12T02:06:46.734931+0000","last_clean":"2024-09-12T02:06:46.734931+0000","last_became_active":"2024-09-12T00:10:05.289058+0000","last_became_peered":"2024-09-12T00:10:05.289058+0000","last_unstale":"2024-09-12T02:06:46.734931+0000","last_undegraded":"2024-09-12T02:06:46.734931+0000","last_fullsized":"2024-09-12T02:06:46.734931+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:22.158935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92166,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1168,"num_read_kb":2300,"num_write":1050,"num_write_kb":783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.762388+0000","last_change":"2024-09-12T00:10:07.327012+0000","last_active":"2024-09-12T02:04:43.762388+0000","last_peered":"2024-09-12T02:04:43.762388+0000","last_clean":"2024-09-12T02:04:43.762388+0000","last_became_active":"2024-09-12T00:10:07.326146+0000","last_became_peered":"2024-09-12T00:10:07.326146+0000","last_unstale":"2024-09-12T02:04:43.762388+0000","last_undegraded":"2024-09-12T02:04:43.762388+0000","last_fullsized":"2024-09-12T02:04:43.762388+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:31.757093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"266'134","reported_seq":659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.895559+0000","last_change":"2024-09-12T00:10:09.434271+0000","last_active":"2024-09-12T02:04:59.895559+0000","last_peered":"2024-09-12T02:04:59.895559+0000","last_clean":"2024-09-12T02:04:59.895559+0000","last_became_active":"2024-09-12T00:10:09.433444+0000","last_became_peered":"2024-09-12T00:10:09.433444+0000","last_unstale":"2024-09-12T02:04:59.895559+0000","last_undegraded":"2024-09-12T02:04:59.895559+0000","last_fullsized":"2024-09-12T02:04:59.895559+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"266'404","reported_seq":1916,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.480294+0000","last_change":"2024-09-12T02:07:02.480294+0000","last_active":"2024-09-12T02:07:02.480294+0000","last_peered":"2024-09-12T02:07:02.480294+0000","last_clean":"2024-09-12T02:07:02.480294+0000","last_became_active":"2024-09-12T00:10:01.282373+0000","last_became_peered":"2024-09-12T00:10:01.282373+0000","last_unstale":"2024-09-12T02:07:02.480294+0000","last_undegraded":"2024-09-12T02:07:02.480294+0000","last_fullsized":"2024-09-12T02:07:02.480294+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'404","last_scrub_stamp":"2024-09-12T02:07:02.480109+0000","last_deep_scrub":"266'404","last_deep_scrub_stamp":"2024-09-12T02:07:02.480109+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.480109+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:10.168566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2068,"num_read_kb":1970,"num_write":460,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"266'417","reported_seq":1205,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.505109+0000","last_change":"2024-09-12T02:06:55.505109+0000","last_active":"2024-09-12T02:06:55.505109+0000","last_peered":"2024-09-12T02:06:55.505109+0000","last_clean":"2024-09-12T02:06:55.505109+0000","last_became_active":"2024-09-12T00:09:59.251235+0000","last_became_peered":"2024-09-12T00:09:59.251235+0000","last_unstale":"2024-09-12T02:06:55.505109+0000","last_undegraded":"2024-09-12T02:06:55.505109+0000","last_fullsized":"2024-09-12T02:06:55.505109+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'417","last_scrub_stamp":"2024-09-12T02:06:55.504820+0000","last_deep_scrub":"266'417","last_deep_scrub_stamp":"2024-09-12T02:06:55.504820+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.504820+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:06.749291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":866,"num_read_kb":78676,"num_write":1275,"num_write_kb":36022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.781724+0000","last_change":"2024-09-12T02:06:57.781724+0000","last_active":"2024-09-12T02:06:57.781724+0000","last_peered":"2024-09-12T02:06:57.781724+0000","last_clean":"2024-09-12T02:06:57.781724+0000","last_became_active":"2024-09-12T00:09:46.177603+0000","last_became_peered":"2024-09-12T00:09:46.177603+0000","last_unstale":"2024-09-12T02:06:57.781724+0000","last_undegraded":"2024-09-12T02:06:57.781724+0000","last_fullsized":"2024-09-12T02:06:57.781724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:57.781540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:57.781540+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.781540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:12.770956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":539,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.051317+0000","last_change":"2024-09-12T02:07:04.051317+0000","last_active":"2024-09-12T02:07:04.051317+0000","last_peered":"2024-09-12T02:07:04.051317+0000","last_clean":"2024-09-12T02:07:04.051317+0000","last_became_active":"2024-09-12T00:10:03.258944+0000","last_became_peered":"2024-09-12T00:10:03.258944+0000","last_unstale":"2024-09-12T02:07:04.051317+0000","last_undegraded":"2024-09-12T02:07:04.051317+0000","last_fullsized":"2024-09-12T02:07:04.051317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.051138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.051138+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.051138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:03.444640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"266'265","reported_seq":917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.403890+0000","last_change":"2024-09-12T02:07:11.403890+0000","last_active":"2024-09-12T02:07:11.403890+0000","last_peered":"2024-09-12T02:07:11.403890+0000","last_clean":"2024-09-12T02:07:11.403890+0000","last_became_active":"2024-09-12T00:10:05.366757+0000","last_became_peered":"2024-09-12T00:10:05.366757+0000","last_unstale":"2024-09-12T02:07:11.403890+0000","last_undegraded":"2024-09-12T02:07:11.403890+0000","last_fullsized":"2024-09-12T02:07:11.403890+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'265","last_scrub_stamp":"2024-09-12T02:07:11.403703+0000","last_deep_scrub":"266'265","last_deep_scrub_stamp":"2024-09-12T02:07:11.403703+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.403703+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:13.743145+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":341,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"266'827","reported_seq":5675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.342888+0000","last_change":"2024-09-12T00:10:07.314520+0000","last_active":"2024-09-12T02:06:46.342888+0000","last_peered":"2024-09-12T02:06:46.342888+0000","last_clean":"2024-09-12T02:06:46.342888+0000","last_became_active":"2024-09-12T00:10:07.313773+0000","last_became_peered":"2024-09-12T00:10:07.313773+0000","last_unstale":"2024-09-12T02:06:46.342888+0000","last_undegraded":"2024-09-12T02:06:46.342888+0000","last_fullsized":"2024-09-12T02:06:46.342888+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:32.654308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"266'129","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:08.986570+0000","last_change":"2024-09-12T00:10:09.431402+0000","last_active":"2024-09-12T02:05:08.986570+0000","last_peered":"2024-09-12T02:05:08.986570+0000","last_clean":"2024-09-12T02:05:08.986570+0000","last_became_active":"2024-09-12T00:10:09.430396+0000","last_became_peered":"2024-09-12T00:10:09.430396+0000","last_unstale":"2024-09-12T02:05:08.986570+0000","last_undegraded":"2024-09-12T02:05:08.986570+0000","last_fullsized":"2024-09-12T02:05:08.986570+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:54.666346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"266'483","reported_seq":2204,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.924708+0000","last_change":"2024-09-12T02:07:11.924708+0000","last_active":"2024-09-12T02:07:11.924708+0000","last_peered":"2024-09-12T02:07:11.924708+0000","last_clean":"2024-09-12T02:07:11.924708+0000","last_became_active":"2024-09-12T00:10:01.261139+0000","last_became_peered":"2024-09-12T00:10:01.261139+0000","last_unstale":"2024-09-12T02:07:11.924708+0000","last_undegraded":"2024-09-12T02:07:11.924708+0000","last_fullsized":"2024-09-12T02:07:11.924708+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'483","last_scrub_stamp":"2024-09-12T02:07:11.924498+0000","last_deep_scrub":"266'483","last_deep_scrub_stamp":"2024-09-12T02:07:11.924498+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.924498+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:56.731333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2740,"num_read_kb":2607,"num_write":578,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"266'402","reported_seq":1219,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.868030+0000","last_change":"2024-09-12T02:06:53.867885+0000","last_active":"2024-09-12T02:06:53.868030+0000","last_peered":"2024-09-12T02:06:53.868030+0000","last_clean":"2024-09-12T02:06:53.868030+0000","last_became_active":"2024-09-12T00:09:59.280008+0000","last_became_peered":"2024-09-12T00:09:59.280008+0000","last_unstale":"2024-09-12T02:06:53.868030+0000","last_undegraded":"2024-09-12T02:06:53.868030+0000","last_fullsized":"2024-09-12T02:06:53.868030+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'402","last_scrub_stamp":"2024-09-12T02:06:53.867624+0000","last_deep_scrub":"266'402","last_deep_scrub_stamp":"2024-09-12T02:06:53.867624+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.867624+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:13.357536+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137185,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":708,"num_read_kb":14008,"num_write":1294,"num_write_kb":38960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.553213+0000","last_change":"2024-09-12T02:06:53.553213+0000","last_active":"2024-09-12T02:06:53.553213+0000","last_peered":"2024-09-12T02:06:53.553213+0000","last_clean":"2024-09-12T02:06:53.553213+0000","last_became_active":"2024-09-12T00:09:46.162309+0000","last_became_peered":"2024-09-12T00:09:46.162309+0000","last_unstale":"2024-09-12T02:06:53.553213+0000","last_undegraded":"2024-09-12T02:06:53.553213+0000","last_fullsized":"2024-09-12T02:06:53.553213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:53.553124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:53.553124+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.553124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:47.235429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010860449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.761245+0000","last_change":"2024-09-12T00:10:03.257249+0000","last_active":"2024-09-12T02:04:38.761245+0000","last_peered":"2024-09-12T02:04:38.761245+0000","last_clean":"2024-09-12T02:04:38.761245+0000","last_became_active":"2024-09-12T00:10:03.256290+0000","last_became_peered":"2024-09-12T00:10:03.256290+0000","last_unstale":"2024-09-12T02:04:38.761245+0000","last_undegraded":"2024-09-12T02:04:38.761245+0000","last_fullsized":"2024-09-12T02:04:38.761245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:00.212778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"266'177","reported_seq":785,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.762472+0000","last_change":"2024-09-12T00:10:05.294735+0000","last_active":"2024-09-12T02:04:43.762472+0000","last_peered":"2024-09-12T02:04:43.762472+0000","last_clean":"2024-09-12T02:04:43.762472+0000","last_became_active":"2024-09-12T00:10:05.293955+0000","last_became_peered":"2024-09-12T00:10:05.293955+0000","last_unstale":"2024-09-12T02:04:43.762472+0000","last_undegraded":"2024-09-12T02:04:43.762472+0000","last_fullsized":"2024-09-12T02:04:43.762472+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:54.115604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":227,"num_write":154,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"266'827","reported_seq":5158,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.575460+0000","last_change":"2024-09-12T00:10:07.334366+0000","last_active":"2024-09-12T02:06:47.575460+0000","last_peered":"2024-09-12T02:06:47.575460+0000","last_clean":"2024-09-12T02:06:47.575460+0000","last_became_active":"2024-09-12T00:10:07.333642+0000","last_became_peered":"2024-09-12T00:10:07.333642+0000","last_unstale":"2024-09-12T02:06:47.575460+0000","last_undegraded":"2024-09-12T02:06:47.575460+0000","last_fullsized":"2024-09-12T02:06:47.575460+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:25.710728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"266'301","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:53.540473+0000","last_change":"2024-09-12T00:10:09.359415+0000","last_active":"2024-09-12T02:04:53.540473+0000","last_peered":"2024-09-12T02:04:53.540473+0000","last_clean":"2024-09-12T02:04:53.540473+0000","last_became_active":"2024-09-12T00:10:09.358708+0000","last_became_peered":"2024-09-12T00:10:09.358708+0000","last_unstale":"2024-09-12T02:04:53.540473+0000","last_undegraded":"2024-09-12T02:04:53.540473+0000","last_fullsized":"2024-09-12T02:04:53.540473+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":399,"num_read_kb":387,"num_write":681,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"266'1118","reported_seq":2658,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.998245+0000","last_change":"2024-09-12T02:06:56.998245+0000","last_active":"2024-09-12T02:06:56.998245+0000","last_peered":"2024-09-12T02:06:56.998245+0000","last_clean":"2024-09-12T02:06:56.998245+0000","last_became_active":"2024-09-12T00:10:01.274310+0000","last_became_peered":"2024-09-12T00:10:01.274310+0000","last_unstale":"2024-09-12T02:06:56.998245+0000","last_undegraded":"2024-09-12T02:06:56.998245+0000","last_fullsized":"2024-09-12T02:06:56.998245+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1118","last_scrub_stamp":"2024-09-12T02:06:56.998048+0000","last_deep_scrub":"266'1118","last_deep_scrub_stamp":"2024-09-12T02:06:56.998048+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.998048+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":1100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:33.714167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5066,"num_read_kb":4471,"num_write":1537,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"266'372","reported_seq":1077,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.492593+0000","last_change":"2024-09-12T02:06:52.492480+0000","last_active":"2024-09-12T02:06:52.492593+0000","last_peered":"2024-09-12T02:06:52.492593+0000","last_clean":"2024-09-12T02:06:52.492593+0000","last_became_active":"2024-09-12T00:09:59.291630+0000","last_became_peered":"2024-09-12T00:09:59.291630+0000","last_unstale":"2024-09-12T02:06:52.492593+0000","last_undegraded":"2024-09-12T02:06:52.492593+0000","last_fullsized":"2024-09-12T02:06:52.492593+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'372","last_scrub_stamp":"2024-09-12T02:06:52.492329+0000","last_deep_scrub":"266'372","last_deep_scrub_stamp":"2024-09-12T02:06:52.492329+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.492329+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.589627+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306724,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":13946,"num_write":1174,"num_write_kb":43869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":561,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.202278+0000","last_change":"2024-09-12T02:06:55.202278+0000","last_active":"2024-09-12T02:06:55.202278+0000","last_peered":"2024-09-12T02:06:55.202278+0000","last_clean":"2024-09-12T02:06:55.202278+0000","last_became_active":"2024-09-12T00:09:46.163643+0000","last_became_peered":"2024-09-12T00:09:46.163643+0000","last_unstale":"2024-09-12T02:06:55.202278+0000","last_undegraded":"2024-09-12T02:06:55.202278+0000","last_fullsized":"2024-09-12T02:06:55.202278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:55.202103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:55.202103+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.202103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:46.554637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00095304600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.973403+0000","last_change":"2024-09-12T00:10:03.265795+0000","last_active":"2024-09-12T02:04:18.973403+0000","last_peered":"2024-09-12T02:04:18.973403+0000","last_clean":"2024-09-12T02:04:18.973403+0000","last_became_active":"2024-09-12T00:10:03.265087+0000","last_became_peered":"2024-09-12T00:10:03.265087+0000","last_unstale":"2024-09-12T02:04:18.973403+0000","last_undegraded":"2024-09-12T02:04:18.973403+0000","last_fullsized":"2024-09-12T02:04:18.973403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:19.906488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"266'829","reported_seq":1619,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.017176+0000","last_change":"2024-09-12T00:10:05.362216+0000","last_active":"2024-09-12T02:06:47.017176+0000","last_peered":"2024-09-12T02:06:47.017176+0000","last_clean":"2024-09-12T02:06:47.017176+0000","last_became_active":"2024-09-12T00:10:05.361458+0000","last_became_peered":"2024-09-12T00:10:05.361458+0000","last_unstale":"2024-09-12T02:06:47.017176+0000","last_undegraded":"2024-09-12T02:06:47.017176+0000","last_fullsized":"2024-09-12T02:06:47.017176+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:05.415919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1463,"num_read_kb":3339,"num_write":1180,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.980217+0000","last_change":"2024-09-12T00:10:07.341062+0000","last_active":"2024-09-12T02:04:43.980217+0000","last_peered":"2024-09-12T02:04:43.980217+0000","last_clean":"2024-09-12T02:04:43.980217+0000","last_became_active":"2024-09-12T00:10:07.333984+0000","last_became_peered":"2024-09-12T00:10:07.333984+0000","last_unstale":"2024-09-12T02:04:43.980217+0000","last_undegraded":"2024-09-12T02:04:43.980217+0000","last_fullsized":"2024-09-12T02:04:43.980217+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:04.270793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"266'123","reported_seq":646,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:54.756318+0000","last_change":"2024-09-12T00:10:09.369672+0000","last_active":"2024-09-12T02:04:54.756318+0000","last_peered":"2024-09-12T02:04:54.756318+0000","last_clean":"2024-09-12T02:04:54.756318+0000","last_became_active":"2024-09-12T00:10:09.368289+0000","last_became_peered":"2024-09-12T00:10:09.368289+0000","last_unstale":"2024-09-12T02:04:54.756318+0000","last_undegraded":"2024-09-12T02:04:54.756318+0000","last_fullsized":"2024-09-12T02:04:54.756318+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"266'155","reported_seq":743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.414654+0000","last_change":"2024-09-12T00:10:09.373153+0000","last_active":"2024-09-12T02:05:00.414654+0000","last_peered":"2024-09-12T02:05:00.414654+0000","last_clean":"2024-09-12T02:05:00.414654+0000","last_became_active":"2024-09-12T00:10:09.372467+0000","last_became_peered":"2024-09-12T00:10:09.372467+0000","last_unstale":"2024-09-12T02:05:00.414654+0000","last_undegraded":"2024-09-12T02:05:00.414654+0000","last_fullsized":"2024-09-12T02:05:00.414654+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:35.985971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":220,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"266'889","reported_seq":2706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.066271+0000","last_change":"2024-09-12T02:07:03.066271+0000","last_active":"2024-09-12T02:07:03.066271+0000","last_peered":"2024-09-12T02:07:03.066271+0000","last_clean":"2024-09-12T02:07:03.066271+0000","last_became_active":"2024-09-12T00:10:01.266479+0000","last_became_peered":"2024-09-12T00:10:01.266479+0000","last_unstale":"2024-09-12T02:07:03.066271+0000","last_undegraded":"2024-09-12T02:07:03.066271+0000","last_fullsized":"2024-09-12T02:07:03.066271+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'889","last_scrub_stamp":"2024-09-12T02:07:03.066081+0000","last_deep_scrub":"266'889","last_deep_scrub_stamp":"2024-09-12T02:07:03.066081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.066081+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:36.910267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4439,"num_read_kb":4016,"num_write":1172,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1578,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"266'328","reported_seq":1077,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.041051+0000","last_change":"2024-09-12T02:06:56.040868+0000","last_active":"2024-09-12T02:06:56.041051+0000","last_peered":"2024-09-12T02:06:56.041051+0000","last_clean":"2024-09-12T02:06:56.041051+0000","last_became_active":"2024-09-12T00:09:59.309979+0000","last_became_peered":"2024-09-12T00:09:59.309979+0000","last_unstale":"2024-09-12T02:06:56.041051+0000","last_undegraded":"2024-09-12T02:06:56.041051+0000","last_fullsized":"2024-09-12T02:06:56.041051+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'328","last_scrub_stamp":"2024-09-12T02:06:56.040661+0000","last_deep_scrub":"266'328","last_deep_scrub_stamp":"2024-09-12T02:06:56.040661+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.040661+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:55.878202+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":761,"num_read_kb":10875,"num_write":997,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.359965+0000","last_change":"2024-09-12T02:07:07.359965+0000","last_active":"2024-09-12T02:07:07.359965+0000","last_peered":"2024-09-12T02:07:07.359965+0000","last_clean":"2024-09-12T02:07:07.359965+0000","last_became_active":"2024-09-12T00:10:03.272547+0000","last_became_peered":"2024-09-12T00:10:03.272547+0000","last_unstale":"2024-09-12T02:07:07.359965+0000","last_undegraded":"2024-09-12T02:07:07.359965+0000","last_fullsized":"2024-09-12T02:07:07.359965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.359774+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.359774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:58.266703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"266'331","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.484598+0000","last_change":"2024-09-12T00:10:05.293284+0000","last_active":"2024-09-12T02:06:47.484598+0000","last_peered":"2024-09-12T02:06:47.484598+0000","last_clean":"2024-09-12T02:06:47.484598+0000","last_became_active":"2024-09-12T00:10:05.292446+0000","last_became_peered":"2024-09-12T00:10:05.292446+0000","last_unstale":"2024-09-12T02:06:47.484598+0000","last_undegraded":"2024-09-12T02:06:47.484598+0000","last_fullsized":"2024-09-12T02:06:47.484598+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16245,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1009,"num_write":400,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976129+0000","last_change":"2024-09-12T00:10:07.339677+0000","last_active":"2024-09-12T02:04:28.976129+0000","last_peered":"2024-09-12T02:04:28.976129+0000","last_clean":"2024-09-12T02:04:28.976129+0000","last_became_active":"2024-09-12T00:10:07.335659+0000","last_became_peered":"2024-09-12T00:10:07.335659+0000","last_unstale":"2024-09-12T02:04:28.976129+0000","last_undegraded":"2024-09-12T02:04:28.976129+0000","last_fullsized":"2024-09-12T02:04:28.976129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:04.120142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"266'115","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.231862+0000","last_change":"2024-09-12T00:10:09.357232+0000","last_active":"2024-09-12T02:05:00.231862+0000","last_peered":"2024-09-12T02:05:00.231862+0000","last_clean":"2024-09-12T02:05:00.231862+0000","last_became_active":"2024-09-12T00:10:09.356043+0000","last_became_peered":"2024-09-12T00:10:09.356043+0000","last_unstale":"2024-09-12T02:05:00.231862+0000","last_undegraded":"2024-09-12T02:05:00.231862+0000","last_fullsized":"2024-09-12T02:05:00.231862+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:08.121957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":102,"num_write":274,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"266'484","reported_seq":2046,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.337781+0000","last_change":"2024-09-12T02:07:04.337781+0000","last_active":"2024-09-12T02:07:04.337781+0000","last_peered":"2024-09-12T02:07:04.337781+0000","last_clean":"2024-09-12T02:07:04.337781+0000","last_became_active":"2024-09-12T00:10:01.264977+0000","last_became_peered":"2024-09-12T00:10:01.264977+0000","last_unstale":"2024-09-12T02:07:04.337781+0000","last_undegraded":"2024-09-12T02:07:04.337781+0000","last_fullsized":"2024-09-12T02:07:04.337781+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'484","last_scrub_stamp":"2024-09-12T02:07:04.337573+0000","last_deep_scrub":"266'484","last_deep_scrub_stamp":"2024-09-12T02:07:04.337573+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.337573+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.524170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2306,"num_write":570,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"266'380","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.767936+0000","last_change":"2024-09-12T02:07:01.767936+0000","last_active":"2024-09-12T02:07:01.767936+0000","last_peered":"2024-09-12T02:07:01.767936+0000","last_clean":"2024-09-12T02:07:01.767936+0000","last_became_active":"2024-09-12T00:09:59.300181+0000","last_became_peered":"2024-09-12T00:09:59.300181+0000","last_unstale":"2024-09-12T02:07:01.767936+0000","last_undegraded":"2024-09-12T02:07:01.767936+0000","last_fullsized":"2024-09-12T02:07:01.767936+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T02:07:01.767612+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T02:07:01.767612+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.767612+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:31.745878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":10768,"num_write":1216,"num_write_kb":35109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.975027+0000","last_change":"2024-09-12T00:10:03.256755+0000","last_active":"2024-09-12T02:04:23.975027+0000","last_peered":"2024-09-12T02:04:23.975027+0000","last_clean":"2024-09-12T02:04:23.975027+0000","last_became_active":"2024-09-12T00:10:03.256053+0000","last_became_peered":"2024-09-12T00:10:03.256053+0000","last_unstale":"2024-09-12T02:04:23.975027+0000","last_undegraded":"2024-09-12T02:04:23.975027+0000","last_fullsized":"2024-09-12T02:04:23.975027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:53.915837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"266'74","reported_seq":615,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.954859+0000","last_change":"2024-09-12T00:10:05.289328+0000","last_active":"2024-09-12T02:04:59.954859+0000","last_peered":"2024-09-12T02:04:59.954859+0000","last_clean":"2024-09-12T02:04:59.954859+0000","last_became_active":"2024-09-12T00:10:05.288688+0000","last_became_peered":"2024-09-12T00:10:05.288688+0000","last_unstale":"2024-09-12T02:04:59.954859+0000","last_undegraded":"2024-09-12T02:04:59.954859+0000","last_fullsized":"2024-09-12T02:04:59.954859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.509523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.754653+0000","last_change":"2024-09-12T00:10:07.321379+0000","last_active":"2024-09-12T02:04:28.754653+0000","last_peered":"2024-09-12T02:04:28.754653+0000","last_clean":"2024-09-12T02:04:28.754653+0000","last_became_active":"2024-09-12T00:10:07.320729+0000","last_became_peered":"2024-09-12T00:10:07.320729+0000","last_unstale":"2024-09-12T02:04:28.754653+0000","last_undegraded":"2024-09-12T02:04:28.754653+0000","last_fullsized":"2024-09-12T02:04:28.754653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:20.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"266'204","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:57.570680+0000","last_change":"2024-09-12T00:10:09.362996+0000","last_active":"2024-09-12T02:04:57.570680+0000","last_peered":"2024-09-12T02:04:57.570680+0000","last_clean":"2024-09-12T02:04:57.570680+0000","last_became_active":"2024-09-12T00:10:09.362096+0000","last_became_peered":"2024-09-12T00:10:09.362096+0000","last_unstale":"2024-09-12T02:04:57.570680+0000","last_undegraded":"2024-09-12T02:04:57.570680+0000","last_fullsized":"2024-09-12T02:04:57.570680+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:36.489316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":296,"num_read_kb":291,"num_write":467,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"266'433","reported_seq":2154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.964744+0000","last_change":"2024-09-12T02:07:04.964744+0000","last_active":"2024-09-12T02:07:04.964744+0000","last_peered":"2024-09-12T02:07:04.964744+0000","last_clean":"2024-09-12T02:07:04.964744+0000","last_became_active":"2024-09-12T00:10:01.261030+0000","last_became_peered":"2024-09-12T00:10:01.261030+0000","last_unstale":"2024-09-12T02:07:04.964744+0000","last_undegraded":"2024-09-12T02:07:04.964744+0000","last_fullsized":"2024-09-12T02:07:04.964744+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'433","last_scrub_stamp":"2024-09-12T02:07:04.964572+0000","last_deep_scrub":"266'433","last_deep_scrub_stamp":"2024-09-12T02:07:04.964572+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.964572+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:57.148348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2550,"num_read_kb":2440,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2736,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"266'384","reported_seq":1086,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.676078+0000","last_change":"2024-09-12T02:06:57.676078+0000","last_active":"2024-09-12T02:06:57.676078+0000","last_peered":"2024-09-12T02:06:57.676078+0000","last_clean":"2024-09-12T02:06:57.676078+0000","last_became_active":"2024-09-12T00:09:59.288100+0000","last_became_peered":"2024-09-12T00:09:59.288100+0000","last_unstale":"2024-09-12T02:06:57.676078+0000","last_undegraded":"2024-09-12T02:06:57.676078+0000","last_fullsized":"2024-09-12T02:06:57.676078+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'384","last_scrub_stamp":"2024-09-12T02:06:57.675785+0000","last_deep_scrub":"266'384","last_deep_scrub_stamp":"2024-09-12T02:06:57.675785+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.675785+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:31.989566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":599,"num_read_kb":15869,"num_write":1177,"num_write_kb":23659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.753274+0000","last_change":"2024-09-12T00:10:03.257101+0000","last_active":"2024-09-12T02:04:23.753274+0000","last_peered":"2024-09-12T02:04:23.753274+0000","last_clean":"2024-09-12T02:04:23.753274+0000","last_became_active":"2024-09-12T00:10:03.255669+0000","last_became_peered":"2024-09-12T00:10:03.255669+0000","last_unstale":"2024-09-12T02:04:23.753274+0000","last_undegraded":"2024-09-12T02:04:23.753274+0000","last_fullsized":"2024-09-12T02:04:23.753274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:32.002572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"266'345","reported_seq":991,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.573156+0000","last_change":"2024-09-12T00:10:05.300654+0000","last_active":"2024-09-12T02:06:46.573156+0000","last_peered":"2024-09-12T02:06:46.573156+0000","last_clean":"2024-09-12T02:06:46.573156+0000","last_became_active":"2024-09-12T00:10:05.299730+0000","last_became_peered":"2024-09-12T00:10:05.299730+0000","last_unstale":"2024-09-12T02:06:46.573156+0000","last_undegraded":"2024-09-12T02:06:46.573156+0000","last_fullsized":"2024-09-12T02:06:46.573156+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:30.946739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58900,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1109,"num_write":428,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.084311+0000","last_change":"2024-09-12T02:07:13.084311+0000","last_active":"2024-09-12T02:07:13.084311+0000","last_peered":"2024-09-12T02:07:13.084311+0000","last_clean":"2024-09-12T02:07:13.084311+0000","last_became_active":"2024-09-12T00:10:07.329741+0000","last_became_peered":"2024-09-12T00:10:07.329741+0000","last_unstale":"2024-09-12T02:07:13.084311+0000","last_undegraded":"2024-09-12T02:07:13.084311+0000","last_fullsized":"2024-09-12T02:07:13.084311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.084128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.084128+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.084128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:04.189686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"266'89","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725178+0000","last_change":"2024-09-12T00:10:09.372894+0000","last_active":"2024-09-12T02:02:39.725178+0000","last_peered":"2024-09-12T02:02:39.725178+0000","last_clean":"2024-09-12T02:02:39.725178+0000","last_became_active":"2024-09-12T00:10:09.371755+0000","last_became_peered":"2024-09-12T00:10:09.371755+0000","last_unstale":"2024-09-12T02:02:39.725178+0000","last_undegraded":"2024-09-12T02:02:39.725178+0000","last_fullsized":"2024-09-12T02:02:39.725178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:18.332494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":213,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"266'805","reported_seq":2435,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974707+0000","last_change":"2024-09-12T00:10:01.259175+0000","last_active":"2024-09-12T02:04:23.974707+0000","last_peered":"2024-09-12T02:04:23.974707+0000","last_clean":"2024-09-12T02:04:23.974707+0000","last_became_active":"2024-09-12T00:10:01.258814+0000","last_became_peered":"2024-09-12T00:10:01.258814+0000","last_unstale":"2024-09-12T02:04:23.974707+0000","last_undegraded":"2024-09-12T02:04:23.974707+0000","last_fullsized":"2024-09-12T02:04:23.974707+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:34.228716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3906,"num_read_kb":3532,"num_write":1046,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"266'415","reported_seq":1087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.547391+0000","last_change":"2024-09-12T02:06:56.547391+0000","last_active":"2024-09-12T02:06:56.547391+0000","last_peered":"2024-09-12T02:06:56.547391+0000","last_clean":"2024-09-12T02:06:56.547391+0000","last_became_active":"2024-09-12T00:09:59.262775+0000","last_became_peered":"2024-09-12T00:09:59.262775+0000","last_unstale":"2024-09-12T02:06:56.547391+0000","last_undegraded":"2024-09-12T02:06:56.547391+0000","last_fullsized":"2024-09-12T02:06:56.547391+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'415","last_scrub_stamp":"2024-09-12T02:06:56.547179+0000","last_deep_scrub":"266'415","last_deep_scrub_stamp":"2024-09-12T02:06:56.547179+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.547179+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.608245+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":557,"num_read_kb":527,"num_write":1329,"num_write_kb":18885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.038234+0000","last_change":"2024-09-12T02:07:08.038234+0000","last_active":"2024-09-12T02:07:08.038234+0000","last_peered":"2024-09-12T02:07:08.038234+0000","last_clean":"2024-09-12T02:07:08.038234+0000","last_became_active":"2024-09-12T00:10:03.257953+0000","last_became_peered":"2024-09-12T00:10:03.257953+0000","last_unstale":"2024-09-12T02:07:08.038234+0000","last_undegraded":"2024-09-12T02:07:08.038234+0000","last_fullsized":"2024-09-12T02:07:08.038234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:08.038057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:08.038057+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.038057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:22.867531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"266'327","reported_seq":941,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.290038+0000","last_change":"2024-09-12T00:10:05.286232+0000","last_active":"2024-09-12T02:06:46.290038+0000","last_peered":"2024-09-12T02:06:46.290038+0000","last_clean":"2024-09-12T02:06:46.290038+0000","last_became_active":"2024-09-12T00:10:05.285485+0000","last_became_peered":"2024-09-12T00:10:05.285485+0000","last_unstale":"2024-09-12T02:06:46.290038+0000","last_undegraded":"2024-09-12T02:06:46.290038+0000","last_fullsized":"2024-09-12T02:06:46.290038+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:50.842485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":1250,"num_write":446,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.533657+0000","last_change":"2024-09-12T00:10:07.326257+0000","last_active":"2024-09-12T02:04:28.533657+0000","last_peered":"2024-09-12T02:04:28.533657+0000","last_clean":"2024-09-12T02:04:28.533657+0000","last_became_active":"2024-09-12T00:10:07.325482+0000","last_became_peered":"2024-09-12T00:10:07.325482+0000","last_unstale":"2024-09-12T02:04:28.533657+0000","last_undegraded":"2024-09-12T02:04:28.533657+0000","last_fullsized":"2024-09-12T02:04:28.533657+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:27.852281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"266'842","reported_seq":2411,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.057496+0000","last_change":"2024-09-12T02:07:06.057496+0000","last_active":"2024-09-12T02:07:06.057496+0000","last_peered":"2024-09-12T02:07:06.057496+0000","last_clean":"2024-09-12T02:07:06.057496+0000","last_became_active":"2024-09-12T00:10:01.276906+0000","last_became_peered":"2024-09-12T00:10:01.276906+0000","last_unstale":"2024-09-12T02:07:06.057496+0000","last_undegraded":"2024-09-12T02:07:06.057496+0000","last_fullsized":"2024-09-12T02:07:06.057496+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'842","last_scrub_stamp":"2024-09-12T02:07:06.057301+0000","last_deep_scrub":"266'842","last_deep_scrub_stamp":"2024-09-12T02:07:06.057301+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.057301+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:30.646553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3919,"num_read_kb":3507,"num_write":1092,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"266'321","reported_seq":1003,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.854948+0000","last_change":"2024-09-12T02:06:58.854948+0000","last_active":"2024-09-12T02:06:58.854948+0000","last_peered":"2024-09-12T02:06:58.854948+0000","last_clean":"2024-09-12T02:06:58.854948+0000","last_became_active":"2024-09-12T00:09:59.248681+0000","last_became_peered":"2024-09-12T00:09:59.248681+0000","last_unstale":"2024-09-12T02:06:58.854948+0000","last_undegraded":"2024-09-12T02:06:58.854948+0000","last_fullsized":"2024-09-12T02:06:58.854948+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'321","last_scrub_stamp":"2024-09-12T02:06:58.854706+0000","last_deep_scrub":"266'321","last_deep_scrub_stamp":"2024-09-12T02:06:58.854706+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.854706+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:53.988034+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1398999,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":23744,"num_write":1111,"num_write_kb":29955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":537,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.562161+0000","last_change":"2024-09-12T02:07:12.562161+0000","last_active":"2024-09-12T02:07:12.562161+0000","last_peered":"2024-09-12T02:07:12.562161+0000","last_clean":"2024-09-12T02:07:12.562161+0000","last_became_active":"2024-09-12T00:10:03.260387+0000","last_became_peered":"2024-09-12T00:10:03.260387+0000","last_unstale":"2024-09-12T02:07:12.562161+0000","last_undegraded":"2024-09-12T02:07:12.562161+0000","last_fullsized":"2024-09-12T02:07:12.562161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.561935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.561935+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.561935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:15.815479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"266'542","reported_seq":1220,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.173354+0000","last_change":"2024-09-12T00:10:05.301383+0000","last_active":"2024-09-12T02:06:46.173354+0000","last_peered":"2024-09-12T02:06:46.173354+0000","last_clean":"2024-09-12T02:06:46.173354+0000","last_became_active":"2024-09-12T00:10:05.300613+0000","last_became_peered":"2024-09-12T00:10:05.300613+0000","last_unstale":"2024-09-12T02:06:46.173354+0000","last_undegraded":"2024-09-12T02:06:46.173354+0000","last_fullsized":"2024-09-12T02:06:46.173354+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:48.609813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102448,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":959,"num_read_kb":2206,"num_write":818,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:39.725243+0000","last_change":"2024-09-12T00:10:07.343479+0000","last_active":"2024-09-12T02:02:39.725243+0000","last_peered":"2024-09-12T02:02:39.725243+0000","last_clean":"2024-09-12T02:02:39.725243+0000","last_became_active":"2024-09-12T00:10:07.342700+0000","last_became_peered":"2024-09-12T00:10:07.342700+0000","last_unstale":"2024-09-12T02:02:39.725243+0000","last_undegraded":"2024-09-12T02:02:39.725243+0000","last_fullsized":"2024-09-12T02:02:39.725243+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:29.670776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"266'157","reported_seq":688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976271+0000","last_change":"2024-09-12T00:10:09.436544+0000","last_active":"2024-09-12T02:04:28.976271+0000","last_peered":"2024-09-12T02:04:28.976271+0000","last_clean":"2024-09-12T02:04:28.976271+0000","last_became_active":"2024-09-12T00:10:09.435513+0000","last_became_peered":"2024-09-12T00:10:09.435513+0000","last_unstale":"2024-09-12T02:04:28.976271+0000","last_undegraded":"2024-09-12T02:04:28.976271+0000","last_fullsized":"2024-09-12T02:04:28.976271+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:42.230555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":193,"num_write":343,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"266'812","reported_seq":2378,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.541839+0000","last_change":"2024-09-12T02:07:06.541839+0000","last_active":"2024-09-12T02:07:06.541839+0000","last_peered":"2024-09-12T02:07:06.541839+0000","last_clean":"2024-09-12T02:07:06.541839+0000","last_became_active":"2024-09-12T00:10:01.260115+0000","last_became_peered":"2024-09-12T00:10:01.260115+0000","last_unstale":"2024-09-12T02:07:06.541839+0000","last_undegraded":"2024-09-12T02:07:06.541839+0000","last_fullsized":"2024-09-12T02:07:06.541839+0000","mapping_epoch":27,"log_start":"266'801","ondisk_log_start":"266'801","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'812","last_scrub_stamp":"2024-09-12T02:07:06.541653+0000","last_deep_scrub":"266'812","last_deep_scrub_stamp":"2024-09-12T02:07:06.541653+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.541653+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":801,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:47.466063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3786,"num_read_kb":3403,"num_write":1061,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"266'381","reported_seq":1164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.433070+0000","last_change":"2024-09-12T02:06:57.433070+0000","last_active":"2024-09-12T02:06:57.433070+0000","last_peered":"2024-09-12T02:06:57.433070+0000","last_clean":"2024-09-12T02:06:57.433070+0000","last_became_active":"2024-09-12T00:09:59.285792+0000","last_became_peered":"2024-09-12T00:09:59.285792+0000","last_unstale":"2024-09-12T02:06:57.433070+0000","last_undegraded":"2024-09-12T02:06:57.433070+0000","last_fullsized":"2024-09-12T02:06:57.433070+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:06:57.432824+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:06:57.432824+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.432824+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:51.237303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":739,"num_read_kb":25287,"num_write":1212,"num_write_kb":29345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":539,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.050934+0000","last_change":"2024-09-12T02:07:09.050934+0000","last_active":"2024-09-12T02:07:09.050934+0000","last_peered":"2024-09-12T02:07:09.050934+0000","last_clean":"2024-09-12T02:07:09.050934+0000","last_became_active":"2024-09-12T00:10:03.257760+0000","last_became_peered":"2024-09-12T00:10:03.257760+0000","last_unstale":"2024-09-12T02:07:09.050934+0000","last_undegraded":"2024-09-12T02:07:09.050934+0000","last_fullsized":"2024-09-12T02:07:09.050934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.050754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.050754+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.050754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"266'382","reported_seq":1028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.379891+0000","last_change":"2024-09-12T00:10:05.293759+0000","last_active":"2024-09-12T02:06:46.379891+0000","last_peered":"2024-09-12T02:06:46.379891+0000","last_clean":"2024-09-12T02:06:46.379891+0000","last_became_active":"2024-09-12T00:10:05.292902+0000","last_became_peered":"2024-09-12T00:10:05.292902+0000","last_unstale":"2024-09-12T02:06:46.379891+0000","last_undegraded":"2024-09-12T02:06:46.379891+0000","last_fullsized":"2024-09-12T02:06:46.379891+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:01.365556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":1193,"num_write":510,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.679856+0000","last_change":"2024-09-12T00:10:07.322324+0000","last_active":"2024-09-12T02:02:38.679856+0000","last_peered":"2024-09-12T02:02:38.679856+0000","last_clean":"2024-09-12T02:02:38.679856+0000","last_became_active":"2024-09-12T00:10:07.321400+0000","last_became_peered":"2024-09-12T00:10:07.321400+0000","last_unstale":"2024-09-12T02:02:38.679856+0000","last_undegraded":"2024-09-12T02:02:38.679856+0000","last_fullsized":"2024-09-12T02:02:38.679856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:09.420108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"266'186","reported_seq":741,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:50.389377+0000","last_change":"2024-09-12T00:10:09.356446+0000","last_active":"2024-09-12T02:04:50.389377+0000","last_peered":"2024-09-12T02:04:50.389377+0000","last_clean":"2024-09-12T02:04:50.389377+0000","last_became_active":"2024-09-12T00:10:09.355548+0000","last_became_peered":"2024-09-12T00:10:09.355548+0000","last_unstale":"2024-09-12T02:04:50.389377+0000","last_undegraded":"2024-09-12T02:04:50.389377+0000","last_fullsized":"2024-09-12T02:04:50.389377+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:14.356852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":268,"num_write":529,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"266'396","reported_seq":1788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.971585+0000","last_change":"2024-09-12T02:07:09.971585+0000","last_active":"2024-09-12T02:07:09.971585+0000","last_peered":"2024-09-12T02:07:09.971585+0000","last_clean":"2024-09-12T02:07:09.971585+0000","last_became_active":"2024-09-12T00:10:01.256781+0000","last_became_peered":"2024-09-12T00:10:01.256781+0000","last_unstale":"2024-09-12T02:07:09.971585+0000","last_undegraded":"2024-09-12T02:07:09.971585+0000","last_fullsized":"2024-09-12T02:07:09.971585+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'396","last_scrub_stamp":"2024-09-12T02:07:09.971392+0000","last_deep_scrub":"266'396","last_deep_scrub_stamp":"2024-09-12T02:07:09.971392+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.971392+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:53.393957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1972,"num_read_kb":1849,"num_write":456,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"266'342","reported_seq":992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.004394+0000","last_change":"2024-09-12T02:06:55.004394+0000","last_active":"2024-09-12T02:06:55.004394+0000","last_peered":"2024-09-12T02:06:55.004394+0000","last_clean":"2024-09-12T02:06:55.004394+0000","last_became_active":"2024-09-12T00:09:59.295949+0000","last_became_peered":"2024-09-12T00:09:59.295949+0000","last_unstale":"2024-09-12T02:06:55.004394+0000","last_undegraded":"2024-09-12T02:06:55.004394+0000","last_fullsized":"2024-09-12T02:06:55.004394+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'342","last_scrub_stamp":"2024-09-12T02:06:55.004131+0000","last_deep_scrub":"266'342","last_deep_scrub_stamp":"2024-09-12T02:06:55.004131+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.004131+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:24.111205+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314586,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":1958,"num_write":1004,"num_write_kb":21693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.733298+0000","last_change":"2024-09-12T00:10:03.255686+0000","last_active":"2024-09-12T02:02:33.733298+0000","last_peered":"2024-09-12T02:02:33.733298+0000","last_clean":"2024-09-12T02:02:33.733298+0000","last_became_active":"2024-09-12T00:10:03.254941+0000","last_became_peered":"2024-09-12T00:10:03.254941+0000","last_unstale":"2024-09-12T02:02:33.733298+0000","last_undegraded":"2024-09-12T02:02:33.733298+0000","last_fullsized":"2024-09-12T02:02:33.733298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:39.484405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"266'346","reported_seq":988,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.804604+0000","last_change":"2024-09-12T00:10:05.362933+0000","last_active":"2024-09-12T02:06:44.804604+0000","last_peered":"2024-09-12T02:06:44.804604+0000","last_clean":"2024-09-12T02:06:44.804604+0000","last_became_active":"2024-09-12T00:10:05.362151+0000","last_became_peered":"2024-09-12T00:10:05.362151+0000","last_unstale":"2024-09-12T02:06:44.804604+0000","last_undegraded":"2024-09-12T02:06:44.804604+0000","last_fullsized":"2024-09-12T02:06:44.804604+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:23.347759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45165,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":1204,"num_write":458,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.708301+0000","last_change":"2024-09-12T00:10:07.336945+0000","last_active":"2024-09-12T02:04:38.708301+0000","last_peered":"2024-09-12T02:04:38.708301+0000","last_clean":"2024-09-12T02:04:38.708301+0000","last_became_active":"2024-09-12T00:10:07.336129+0000","last_became_peered":"2024-09-12T00:10:07.336129+0000","last_unstale":"2024-09-12T02:04:38.708301+0000","last_undegraded":"2024-09-12T02:04:38.708301+0000","last_fullsized":"2024-09-12T02:04:38.708301+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:22.333025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"266'100","reported_seq":625,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:07.129657+0000","last_change":"2024-09-12T00:10:09.371725+0000","last_active":"2024-09-12T02:06:07.129657+0000","last_peered":"2024-09-12T02:06:07.129657+0000","last_clean":"2024-09-12T02:06:07.129657+0000","last_became_active":"2024-09-12T00:10:09.370925+0000","last_became_peered":"2024-09-12T00:10:09.370925+0000","last_unstale":"2024-09-12T02:06:07.129657+0000","last_undegraded":"2024-09-12T02:06:07.129657+0000","last_fullsized":"2024-09-12T02:06:07.129657+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:01.455208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"266'457","reported_seq":2125,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.672207+0000","last_change":"2024-09-12T02:06:56.672207+0000","last_active":"2024-09-12T02:06:56.672207+0000","last_peered":"2024-09-12T02:06:56.672207+0000","last_clean":"2024-09-12T02:06:56.672207+0000","last_became_active":"2024-09-12T00:10:01.257064+0000","last_became_peered":"2024-09-12T00:10:01.257064+0000","last_unstale":"2024-09-12T02:06:56.672207+0000","last_undegraded":"2024-09-12T02:06:56.672207+0000","last_fullsized":"2024-09-12T02:06:56.672207+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T02:06:56.672031+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T02:06:56.672031+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.672031+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:43.653119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2638,"num_read_kb":2500,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"266'393","reported_seq":1095,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.544339+0000","last_change":"2024-09-12T02:06:54.544339+0000","last_active":"2024-09-12T02:06:54.544339+0000","last_peered":"2024-09-12T02:06:54.544339+0000","last_clean":"2024-09-12T02:06:54.544339+0000","last_became_active":"2024-09-12T00:09:59.289217+0000","last_became_peered":"2024-09-12T00:09:59.289217+0000","last_unstale":"2024-09-12T02:06:54.544339+0000","last_undegraded":"2024-09-12T02:06:54.544339+0000","last_fullsized":"2024-09-12T02:06:54.544339+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T02:06:54.544232+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T02:06:54.544232+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.544232+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:13.653204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":33363,"num_write":1255,"num_write_kb":62829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.427491+0000","last_change":"2024-09-12T02:07:12.427491+0000","last_active":"2024-09-12T02:07:12.427491+0000","last_peered":"2024-09-12T02:07:12.427491+0000","last_clean":"2024-09-12T02:07:12.427491+0000","last_became_active":"2024-09-12T00:10:03.264802+0000","last_became_peered":"2024-09-12T00:10:03.264802+0000","last_unstale":"2024-09-12T02:07:12.427491+0000","last_undegraded":"2024-09-12T02:07:12.427491+0000","last_fullsized":"2024-09-12T02:07:12.427491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.427300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.427300+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.427300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:12.086674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"266'163","reported_seq":757,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.760399+0000","last_change":"2024-09-12T00:10:05.362816+0000","last_active":"2024-09-12T02:04:33.760399+0000","last_peered":"2024-09-12T02:04:33.760399+0000","last_clean":"2024-09-12T02:04:33.760399+0000","last_became_active":"2024-09-12T00:10:05.361625+0000","last_became_peered":"2024-09-12T00:10:05.361625+0000","last_unstale":"2024-09-12T02:04:33.760399+0000","last_undegraded":"2024-09-12T02:04:33.760399+0000","last_fullsized":"2024-09-12T02:04:33.760399+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:40.143219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":192,"num_write":144,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"266'764","reported_seq":3195,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.569476+0000","last_change":"2024-09-12T00:10:07.315770+0000","last_active":"2024-09-12T02:06:47.569476+0000","last_peered":"2024-09-12T02:06:47.569476+0000","last_clean":"2024-09-12T02:06:47.569476+0000","last_became_active":"2024-09-12T00:10:07.314980+0000","last_became_peered":"2024-09-12T00:10:07.314980+0000","last_unstale":"2024-09-12T02:06:47.569476+0000","last_undegraded":"2024-09-12T02:06:47.569476+0000","last_fullsized":"2024-09-12T02:06:47.569476+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:26.700418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"266'122","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.754575+0000","last_change":"2024-09-12T00:10:09.370317+0000","last_active":"2024-09-12T02:04:28.754575+0000","last_peered":"2024-09-12T02:04:28.754575+0000","last_clean":"2024-09-12T02:04:28.754575+0000","last_became_active":"2024-09-12T00:10:09.369670+0000","last_became_peered":"2024-09-12T00:10:09.369670+0000","last_unstale":"2024-09-12T02:04:28.754575+0000","last_undegraded":"2024-09-12T02:04:28.754575+0000","last_fullsized":"2024-09-12T02:04:28.754575+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:51.975587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":303,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"266'517","reported_seq":2020,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.025188+0000","last_change":"2024-09-12T02:07:05.025188+0000","last_active":"2024-09-12T02:07:05.025188+0000","last_peered":"2024-09-12T02:07:05.025188+0000","last_clean":"2024-09-12T02:07:05.025188+0000","last_became_active":"2024-09-12T00:10:01.248535+0000","last_became_peered":"2024-09-12T00:10:01.248535+0000","last_unstale":"2024-09-12T02:07:05.025188+0000","last_undegraded":"2024-09-12T02:07:05.025188+0000","last_fullsized":"2024-09-12T02:07:05.025188+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'517","last_scrub_stamp":"2024-09-12T02:07:05.024997+0000","last_deep_scrub":"266'517","last_deep_scrub_stamp":"2024-09-12T02:07:05.024997+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.024997+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.426432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2593,"num_read_kb":2391,"num_write":659,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"266'402","reported_seq":1109,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.658106+0000","last_change":"2024-09-12T02:06:59.658106+0000","last_active":"2024-09-12T02:06:59.658106+0000","last_peered":"2024-09-12T02:06:59.658106+0000","last_clean":"2024-09-12T02:06:59.658106+0000","last_became_active":"2024-09-12T00:09:59.296207+0000","last_became_peered":"2024-09-12T00:09:59.296207+0000","last_unstale":"2024-09-12T02:06:59.658106+0000","last_undegraded":"2024-09-12T02:06:59.658106+0000","last_fullsized":"2024-09-12T02:06:59.658106+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'402","last_scrub_stamp":"2024-09-12T02:06:59.657782+0000","last_deep_scrub":"266'402","last_deep_scrub_stamp":"2024-09-12T02:06:59.657782+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.657782+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:49.546487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":512433,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":595,"num_read_kb":14266,"num_write":1257,"num_write_kb":35890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:33.727067+0000","last_change":"2024-09-12T00:10:03.260439+0000","last_active":"2024-09-12T02:02:33.727067+0000","last_peered":"2024-09-12T02:02:33.727067+0000","last_clean":"2024-09-12T02:02:33.727067+0000","last_became_active":"2024-09-12T00:10:03.259644+0000","last_became_peered":"2024-09-12T00:10:03.259644+0000","last_unstale":"2024-09-12T02:02:33.727067+0000","last_undegraded":"2024-09-12T02:02:33.727067+0000","last_fullsized":"2024-09-12T02:02:33.727067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:33.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"266'382","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.458754+0000","last_change":"2024-09-12T00:10:05.297805+0000","last_active":"2024-09-12T02:06:45.458754+0000","last_peered":"2024-09-12T02:06:45.458754+0000","last_clean":"2024-09-12T02:06:45.458754+0000","last_became_active":"2024-09-12T00:10:05.297223+0000","last_became_peered":"2024-09-12T00:10:05.297223+0000","last_unstale":"2024-09-12T02:06:45.458754+0000","last_undegraded":"2024-09-12T02:06:45.458754+0000","last_fullsized":"2024-09-12T02:06:45.458754+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:02.183020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46277,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":600,"num_read_kb":1076,"num_write":448,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.522957+0000","last_change":"2024-09-12T00:10:07.324114+0000","last_active":"2024-09-12T02:03:43.522957+0000","last_peered":"2024-09-12T02:03:43.522957+0000","last_clean":"2024-09-12T02:03:43.522957+0000","last_became_active":"2024-09-12T00:10:07.323296+0000","last_became_peered":"2024-09-12T00:10:07.323296+0000","last_unstale":"2024-09-12T02:03:43.522957+0000","last_undegraded":"2024-09-12T02:03:43.522957+0000","last_fullsized":"2024-09-12T02:03:43.522957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:17.788189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"266'145","reported_seq":669,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:52.636170+0000","last_change":"2024-09-12T00:10:09.362544+0000","last_active":"2024-09-12T02:04:52.636170+0000","last_peered":"2024-09-12T02:04:52.636170+0000","last_clean":"2024-09-12T02:04:52.636170+0000","last_became_active":"2024-09-12T00:10:09.361797+0000","last_became_peered":"2024-09-12T00:10:09.361797+0000","last_unstale":"2024-09-12T02:04:52.636170+0000","last_undegraded":"2024-09-12T02:04:52.636170+0000","last_fullsized":"2024-09-12T02:04:52.636170+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:59.618943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":153,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"266'799","reported_seq":2158,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.040735+0000","last_change":"2024-09-12T02:07:06.040735+0000","last_active":"2024-09-12T02:07:06.040735+0000","last_peered":"2024-09-12T02:07:06.040735+0000","last_clean":"2024-09-12T02:07:06.040735+0000","last_became_active":"2024-09-12T00:10:31.165044+0000","last_became_peered":"2024-09-12T00:10:31.165044+0000","last_unstale":"2024-09-12T02:07:06.040735+0000","last_undegraded":"2024-09-12T02:07:06.040735+0000","last_fullsized":"2024-09-12T02:07:06.040735+0000","mapping_epoch":38,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'799","last_scrub_stamp":"2024-09-12T02:07:06.040541+0000","last_deep_scrub":"266'799","last_deep_scrub_stamp":"2024-09-12T02:07:06.040541+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.040541+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:23.943825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3606,"num_read_kb":3182,"num_write":1095,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"266'377","reported_seq":1088,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.666038+0000","last_change":"2024-09-12T02:07:02.666038+0000","last_active":"2024-09-12T02:07:02.666038+0000","last_peered":"2024-09-12T02:07:02.666038+0000","last_clean":"2024-09-12T02:07:02.666038+0000","last_became_active":"2024-09-12T00:09:59.264091+0000","last_became_peered":"2024-09-12T00:09:59.264091+0000","last_unstale":"2024-09-12T02:07:02.666038+0000","last_undegraded":"2024-09-12T02:07:02.666038+0000","last_fullsized":"2024-09-12T02:07:02.666038+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'377","last_scrub_stamp":"2024-09-12T02:07:02.665688+0000","last_deep_scrub":"266'377","last_deep_scrub_stamp":"2024-09-12T02:07:02.665688+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.665688+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:35.183095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":673026,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":647,"num_read_kb":45982,"num_write":1108,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:34.724000+0000","last_change":"2024-09-12T00:10:03.264424+0000","last_active":"2024-09-12T02:02:34.724000+0000","last_peered":"2024-09-12T02:02:34.724000+0000","last_clean":"2024-09-12T02:02:34.724000+0000","last_became_active":"2024-09-12T00:10:03.263712+0000","last_became_peered":"2024-09-12T00:10:03.263712+0000","last_unstale":"2024-09-12T02:02:34.724000+0000","last_undegraded":"2024-09-12T02:02:34.724000+0000","last_fullsized":"2024-09-12T02:02:34.724000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:02.001466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"266'311","reported_seq":930,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.559880+0000","last_change":"2024-09-12T00:10:05.298555+0000","last_active":"2024-09-12T02:06:45.559880+0000","last_peered":"2024-09-12T02:06:45.559880+0000","last_clean":"2024-09-12T02:06:45.559880+0000","last_became_active":"2024-09-12T00:10:05.297514+0000","last_became_peered":"2024-09-12T00:10:05.297514+0000","last_unstale":"2024-09-12T02:06:45.559880+0000","last_undegraded":"2024-09-12T02:06:45.559880+0000","last_fullsized":"2024-09-12T02:06:45.559880+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:45.661380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42254,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1111,"num_write":410,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.078944+0000","last_change":"2024-09-12T02:07:10.078944+0000","last_active":"2024-09-12T02:07:10.078944+0000","last_peered":"2024-09-12T02:07:10.078944+0000","last_clean":"2024-09-12T02:07:10.078944+0000","last_became_active":"2024-09-12T00:10:07.320880+0000","last_became_peered":"2024-09-12T00:10:07.320880+0000","last_unstale":"2024-09-12T02:07:10.078944+0000","last_undegraded":"2024-09-12T02:07:10.078944+0000","last_fullsized":"2024-09-12T02:07:10.078944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:10.078696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:10.078696+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.078696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:20.691685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"266'120","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.964456+0000","last_change":"2024-09-12T00:10:09.434166+0000","last_active":"2024-09-12T02:03:43.964456+0000","last_peered":"2024-09-12T02:03:43.964456+0000","last_clean":"2024-09-12T02:03:43.964456+0000","last_became_active":"2024-09-12T00:10:09.433296+0000","last_became_peered":"2024-09-12T00:10:09.433296+0000","last_unstale":"2024-09-12T02:03:43.964456+0000","last_undegraded":"2024-09-12T02:03:43.964456+0000","last_fullsized":"2024-09-12T02:03:43.964456+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:16.296420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1168,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":163,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"266'599","reported_seq":2334,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.896330+0000","last_change":"2024-09-12T02:07:06.896330+0000","last_active":"2024-09-12T02:07:06.896330+0000","last_peered":"2024-09-12T02:07:06.896330+0000","last_clean":"2024-09-12T02:07:06.896330+0000","last_became_active":"2024-09-12T00:10:01.242013+0000","last_became_peered":"2024-09-12T00:10:01.242013+0000","last_unstale":"2024-09-12T02:07:06.896330+0000","last_undegraded":"2024-09-12T02:07:06.896330+0000","last_fullsized":"2024-09-12T02:07:06.896330+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'599","last_scrub_stamp":"2024-09-12T02:07:06.896120+0000","last_deep_scrub":"266'599","last_deep_scrub_stamp":"2024-09-12T02:07:06.896120+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.896120+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:25.178488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3158,"num_read_kb":2927,"num_write":761,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"266'355","reported_seq":1038,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.836056+0000","last_change":"2024-09-12T02:06:56.836056+0000","last_active":"2024-09-12T02:06:56.836056+0000","last_peered":"2024-09-12T02:06:56.836056+0000","last_clean":"2024-09-12T02:06:56.836056+0000","last_became_active":"2024-09-12T00:09:59.311148+0000","last_became_peered":"2024-09-12T00:09:59.311148+0000","last_unstale":"2024-09-12T02:06:56.836056+0000","last_undegraded":"2024-09-12T02:06:56.836056+0000","last_fullsized":"2024-09-12T02:06:56.836056+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'355","last_scrub_stamp":"2024-09-12T02:06:56.835868+0000","last_deep_scrub":"266'355","last_deep_scrub_stamp":"2024-09-12T02:06:56.835868+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.835868+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:27.439194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":27101,"num_write":1127,"num_write_kb":32356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.747561+0000","last_change":"2024-09-12T00:10:03.253703+0000","last_active":"2024-09-12T02:03:38.747561+0000","last_peered":"2024-09-12T02:03:38.747561+0000","last_clean":"2024-09-12T02:03:38.747561+0000","last_became_active":"2024-09-12T00:10:03.252562+0000","last_became_peered":"2024-09-12T00:10:03.252562+0000","last_unstale":"2024-09-12T02:03:38.747561+0000","last_undegraded":"2024-09-12T02:03:38.747561+0000","last_fullsized":"2024-09-12T02:03:38.747561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:02.222452+0000","last_clean_scrub_stamp":"2024-09-12T00:10:02.222452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:41.543603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"266'275","reported_seq":871,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.604447+0000","last_change":"2024-09-12T00:10:05.293010+0000","last_active":"2024-09-12T02:06:44.604447+0000","last_peered":"2024-09-12T02:06:44.604447+0000","last_clean":"2024-09-12T02:06:44.604447+0000","last_became_active":"2024-09-12T00:10:05.291758+0000","last_became_peered":"2024-09-12T00:10:05.291758+0000","last_unstale":"2024-09-12T02:06:44.604447+0000","last_undegraded":"2024-09-12T02:06:44.604447+0000","last_fullsized":"2024-09-12T02:06:44.604447+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:40.013931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47860,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":1100,"num_write":388,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.734558+0000","last_change":"2024-09-12T00:10:07.321987+0000","last_active":"2024-09-12T02:02:38.734558+0000","last_peered":"2024-09-12T02:02:38.734558+0000","last_clean":"2024-09-12T02:02:38.734558+0000","last_became_active":"2024-09-12T00:10:07.320509+0000","last_became_peered":"2024-09-12T00:10:07.320509+0000","last_unstale":"2024-09-12T02:02:38.734558+0000","last_undegraded":"2024-09-12T02:02:38.734558+0000","last_fullsized":"2024-09-12T02:02:38.734558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:24.557032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"266'169","reported_seq":1660,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:52.460371+0000","last_change":"2024-09-12T00:10:09.364380+0000","last_active":"2024-09-12T02:04:52.460371+0000","last_peered":"2024-09-12T02:04:52.460371+0000","last_clean":"2024-09-12T02:04:52.460371+0000","last_became_active":"2024-09-12T00:10:09.363609+0000","last_became_peered":"2024-09-12T00:10:09.363609+0000","last_unstale":"2024-09-12T02:04:52.460371+0000","last_undegraded":"2024-09-12T02:04:52.460371+0000","last_fullsized":"2024-09-12T02:04:52.460371+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:27.382248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1201,"num_read_kb":1188,"num_write":377,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"266'769","reported_seq":2302,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.063112+0000","last_change":"2024-09-12T02:07:04.063112+0000","last_active":"2024-09-12T02:07:04.063112+0000","last_peered":"2024-09-12T02:07:04.063112+0000","last_clean":"2024-09-12T02:07:04.063112+0000","last_became_active":"2024-09-12T00:10:01.255086+0000","last_became_peered":"2024-09-12T00:10:01.255086+0000","last_unstale":"2024-09-12T02:07:04.063112+0000","last_undegraded":"2024-09-12T02:07:04.063112+0000","last_fullsized":"2024-09-12T02:07:04.063112+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'769","last_scrub_stamp":"2024-09-12T02:07:04.062933+0000","last_deep_scrub":"266'769","last_deep_scrub_stamp":"2024-09-12T02:07:04.062933+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.062933+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:11.242416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3623,"num_read_kb":3271,"num_write":1000,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"266'318","reported_seq":1027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.532324+0000","last_change":"2024-09-12T02:06:55.532324+0000","last_active":"2024-09-12T02:06:55.532324+0000","last_peered":"2024-09-12T02:06:55.532324+0000","last_clean":"2024-09-12T02:06:55.532324+0000","last_became_active":"2024-09-12T00:09:59.293822+0000","last_became_peered":"2024-09-12T00:09:59.293822+0000","last_unstale":"2024-09-12T02:06:55.532324+0000","last_undegraded":"2024-09-12T02:06:55.532324+0000","last_fullsized":"2024-09-12T02:06:55.532324+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'318","last_scrub_stamp":"2024-09-12T02:06:55.532061+0000","last_deep_scrub":"266'318","last_deep_scrub_stamp":"2024-09-12T02:06:55.532061+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.532061+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:37.599521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":523,"num_read_kb":10999,"num_write":984,"num_write_kb":11811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"266'2","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.390356+0000","last_change":"2024-09-12T02:07:08.390356+0000","last_active":"2024-09-12T02:07:08.390356+0000","last_peered":"2024-09-12T02:07:08.390356+0000","last_clean":"2024-09-12T02:07:08.390356+0000","last_became_active":"2024-09-12T00:10:03.272579+0000","last_became_peered":"2024-09-12T00:10:03.272579+0000","last_unstale":"2024-09-12T02:07:08.390356+0000","last_undegraded":"2024-09-12T02:07:08.390356+0000","last_fullsized":"2024-09-12T02:07:08.390356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:08.390169+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:08.390169+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.390169+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:30.745777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"266'371","reported_seq":1013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:44.925039+0000","last_change":"2024-09-12T00:10:05.289062+0000","last_active":"2024-09-12T02:06:44.925039+0000","last_peered":"2024-09-12T02:06:44.925039+0000","last_clean":"2024-09-12T02:06:44.925039+0000","last_became_active":"2024-09-12T00:10:05.288230+0000","last_became_peered":"2024-09-12T00:10:05.288230+0000","last_unstale":"2024-09-12T02:06:44.925039+0000","last_undegraded":"2024-09-12T02:06:44.925039+0000","last_fullsized":"2024-09-12T02:06:44.925039+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:04.244753+0000","last_clean_scrub_stamp":"2024-09-12T00:10:04.244753+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:10.127963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51419,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":1309,"num_write":486,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:38.718281+0000","last_change":"2024-09-12T00:10:07.327719+0000","last_active":"2024-09-12T02:02:38.718281+0000","last_peered":"2024-09-12T02:02:38.718281+0000","last_clean":"2024-09-12T02:02:38.718281+0000","last_became_active":"2024-09-12T00:10:07.325726+0000","last_became_peered":"2024-09-12T00:10:07.325726+0000","last_unstale":"2024-09-12T02:02:38.718281+0000","last_undegraded":"2024-09-12T02:02:38.718281+0000","last_fullsized":"2024-09-12T02:02:38.718281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:25.525431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"266'151","reported_seq":679,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:05.748249+0000","last_change":"2024-09-12T00:10:09.353828+0000","last_active":"2024-09-12T02:06:05.748249+0000","last_peered":"2024-09-12T02:06:05.748249+0000","last_clean":"2024-09-12T02:06:05.748249+0000","last_became_active":"2024-09-12T00:10:09.353036+0000","last_became_peered":"2024-09-12T00:10:09.353036+0000","last_unstale":"2024-09-12T02:06:05.748249+0000","last_undegraded":"2024-09-12T02:06:05.748249+0000","last_fullsized":"2024-09-12T02:06:05.748249+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":163,"num_write":387,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"266'725","reported_seq":2138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.391036+0000","last_change":"2024-09-12T02:07:10.391036+0000","last_active":"2024-09-12T02:07:10.391036+0000","last_peered":"2024-09-12T02:07:10.391036+0000","last_clean":"2024-09-12T02:07:10.391036+0000","last_became_active":"2024-09-12T00:10:01.263786+0000","last_became_peered":"2024-09-12T00:10:01.263786+0000","last_unstale":"2024-09-12T02:07:10.391036+0000","last_undegraded":"2024-09-12T02:07:10.391036+0000","last_fullsized":"2024-09-12T02:07:10.391036+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'725","last_scrub_stamp":"2024-09-12T02:07:10.390853+0000","last_deep_scrub":"266'725","last_deep_scrub_stamp":"2024-09-12T02:07:10.390853+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.390853+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:24.901710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3380,"num_read_kb":3030,"num_write":963,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"266'351","reported_seq":1024,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.152813+0000","last_change":"2024-09-12T02:06:58.152813+0000","last_active":"2024-09-12T02:06:58.152813+0000","last_peered":"2024-09-12T02:06:58.152813+0000","last_clean":"2024-09-12T02:06:58.152813+0000","last_became_active":"2024-09-12T00:09:59.287488+0000","last_became_peered":"2024-09-12T00:09:59.287488+0000","last_unstale":"2024-09-12T02:06:58.152813+0000","last_undegraded":"2024-09-12T02:06:58.152813+0000","last_fullsized":"2024-09-12T02:06:58.152813+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'351","last_scrub_stamp":"2024-09-12T02:06:58.152595+0000","last_deep_scrub":"266'351","last_deep_scrub_stamp":"2024-09-12T02:06:58.152595+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.152595+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:00.499623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174806,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":42853,"num_write":973,"num_write_kb":24863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"266'457","reported_seq":1950,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.931903+0000","last_change":"2024-09-12T00:10:01.258659+0000","last_active":"2024-09-12T02:04:59.931903+0000","last_peered":"2024-09-12T02:04:59.931903+0000","last_clean":"2024-09-12T02:04:59.931903+0000","last_became_active":"2024-09-12T00:10:01.258361+0000","last_became_peered":"2024-09-12T00:10:01.258361+0000","last_unstale":"2024-09-12T02:04:59.931903+0000","last_undegraded":"2024-09-12T02:04:59.931903+0000","last_fullsized":"2024-09-12T02:04:59.931903+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:00.216198+0000","last_clean_scrub_stamp":"2024-09-12T00:10:00.216198+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2374,"num_read_kb":2204,"num_write":589,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"266'345","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.603030+0000","last_change":"2024-09-12T02:06:58.603030+0000","last_active":"2024-09-12T02:06:58.603030+0000","last_peered":"2024-09-12T02:06:58.603030+0000","last_clean":"2024-09-12T02:06:58.603030+0000","last_became_active":"2024-09-12T00:10:31.469140+0000","last_became_peered":"2024-09-12T00:10:31.469140+0000","last_unstale":"2024-09-12T02:06:58.603030+0000","last_undegraded":"2024-09-12T02:06:58.603030+0000","last_fullsized":"2024-09-12T02:06:58.603030+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'345","last_scrub_stamp":"2024-09-12T02:06:58.602735+0000","last_deep_scrub":"266'345","last_deep_scrub_stamp":"2024-09-12T02:06:58.602735+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.602735+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:27.793298+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314842,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":558,"num_read_kb":38599,"num_write":1106,"num_write_kb":37292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"266'827","reported_seq":2521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.622206+0000","last_change":"2024-09-12T02:07:11.622206+0000","last_active":"2024-09-12T02:07:11.622206+0000","last_peered":"2024-09-12T02:07:11.622206+0000","last_clean":"2024-09-12T02:07:11.622206+0000","last_became_active":"2024-09-12T00:10:01.275843+0000","last_became_peered":"2024-09-12T00:10:01.275843+0000","last_unstale":"2024-09-12T02:07:11.622206+0000","last_undegraded":"2024-09-12T02:07:11.622206+0000","last_fullsized":"2024-09-12T02:07:11.622206+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'827","last_scrub_stamp":"2024-09-12T02:07:11.621963+0000","last_deep_scrub":"266'827","last_deep_scrub_stamp":"2024-09-12T02:07:11.621963+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.621963+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:54.952629+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4035,"num_read_kb":3644,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":697,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"266'347","reported_seq":1033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.635699+0000","last_change":"2024-09-12T02:07:01.635699+0000","last_active":"2024-09-12T02:07:01.635699+0000","last_peered":"2024-09-12T02:07:01.635699+0000","last_clean":"2024-09-12T02:07:01.635699+0000","last_became_active":"2024-09-12T00:09:59.309327+0000","last_became_peered":"2024-09-12T00:09:59.309327+0000","last_unstale":"2024-09-12T02:07:01.635699+0000","last_undegraded":"2024-09-12T02:07:01.635699+0000","last_fullsized":"2024-09-12T02:07:01.635699+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'347","last_scrub_stamp":"2024-09-12T02:07:01.635456+0000","last_deep_scrub":"266'347","last_deep_scrub_stamp":"2024-09-12T02:07:01.635456+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.635456+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:44.139239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":15469,"num_write":1110,"num_write_kb":37224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"266'499","reported_seq":2156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.362179+0000","last_change":"2024-09-12T02:07:03.362000+0000","last_active":"2024-09-12T02:07:03.362179+0000","last_peered":"2024-09-12T02:07:03.362179+0000","last_clean":"2024-09-12T02:07:03.362179+0000","last_became_active":"2024-09-12T00:10:01.261418+0000","last_became_peered":"2024-09-12T00:10:01.261418+0000","last_unstale":"2024-09-12T02:07:03.362179+0000","last_undegraded":"2024-09-12T02:07:03.362179+0000","last_fullsized":"2024-09-12T02:07:03.362179+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T02:07:03.361825+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T02:07:03.361825+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.361825+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:03.935407+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2751,"num_read_kb":2561,"num_write":595,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"266'353","reported_seq":1122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.570841+0000","last_change":"2024-09-12T02:06:58.570841+0000","last_active":"2024-09-12T02:06:58.570841+0000","last_peered":"2024-09-12T02:06:58.570841+0000","last_clean":"2024-09-12T02:06:58.570841+0000","last_became_active":"2024-09-12T00:09:59.286590+0000","last_became_peered":"2024-09-12T00:09:59.286590+0000","last_unstale":"2024-09-12T02:06:58.570841+0000","last_undegraded":"2024-09-12T02:06:58.570841+0000","last_fullsized":"2024-09-12T02:06:58.570841+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'353","last_scrub_stamp":"2024-09-12T02:06:58.570616+0000","last_deep_scrub":"266'353","last_deep_scrub_stamp":"2024-09-12T02:06:58.570616+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.570616+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.488449+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904210,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":714,"num_read_kb":40012,"num_write":1077,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"266'1464","reported_seq":3093,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.937516+0000","last_change":"2024-09-12T02:07:07.937516+0000","last_active":"2024-09-12T02:07:07.937516+0000","last_peered":"2024-09-12T02:07:07.937516+0000","last_clean":"2024-09-12T02:07:07.937516+0000","last_became_active":"2024-09-12T00:10:01.261999+0000","last_became_peered":"2024-09-12T00:10:01.261999+0000","last_unstale":"2024-09-12T02:07:07.937516+0000","last_undegraded":"2024-09-12T02:07:07.937516+0000","last_fullsized":"2024-09-12T02:07:07.937516+0000","mapping_epoch":27,"log_start":"266'1400","ondisk_log_start":"266'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1464","last_scrub_stamp":"2024-09-12T02:07:07.937335+0000","last_deep_scrub":"266'1464","last_deep_scrub_stamp":"2024-09-12T02:07:07.937335+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.937335+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":1400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:48.762109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6652,"num_read_kb":5741,"num_write":2141,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"266'381","reported_seq":1133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.879266+0000","last_change":"2024-09-12T02:06:59.879266+0000","last_active":"2024-09-12T02:06:59.879266+0000","last_peered":"2024-09-12T02:06:59.879266+0000","last_clean":"2024-09-12T02:06:59.879266+0000","last_became_active":"2024-09-12T00:09:59.286301+0000","last_became_peered":"2024-09-12T00:09:59.286301+0000","last_unstale":"2024-09-12T02:06:59.879266+0000","last_undegraded":"2024-09-12T02:06:59.879266+0000","last_fullsized":"2024-09-12T02:06:59.879266+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:06:59.879029+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:06:59.879029+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.879029+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:40.618134+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":778,"num_read_kb":8721,"num_write":1199,"num_write_kb":26143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"266'392","reported_seq":1870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.077047+0000","last_change":"2024-09-12T02:07:07.077047+0000","last_active":"2024-09-12T02:07:07.077047+0000","last_peered":"2024-09-12T02:07:07.077047+0000","last_clean":"2024-09-12T02:07:07.077047+0000","last_became_active":"2024-09-12T00:10:01.266927+0000","last_became_peered":"2024-09-12T00:10:01.266927+0000","last_unstale":"2024-09-12T02:07:07.077047+0000","last_undegraded":"2024-09-12T02:07:07.077047+0000","last_fullsized":"2024-09-12T02:07:07.077047+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T02:07:07.076807+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T02:07:07.076807+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.076807+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:03.913347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2147,"num_read_kb":2014,"num_write":451,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"266'355","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.339949+0000","last_change":"2024-09-12T02:07:05.339949+0000","last_active":"2024-09-12T02:07:05.339949+0000","last_peered":"2024-09-12T02:07:05.339949+0000","last_clean":"2024-09-12T02:07:05.339949+0000","last_became_active":"2024-09-12T00:09:59.251413+0000","last_became_peered":"2024-09-12T00:09:59.251413+0000","last_unstale":"2024-09-12T02:07:05.339949+0000","last_undegraded":"2024-09-12T02:07:05.339949+0000","last_fullsized":"2024-09-12T02:07:05.339949+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'355","last_scrub_stamp":"2024-09-12T02:07:05.339718+0000","last_deep_scrub":"266'355","last_deep_scrub_stamp":"2024-09-12T02:07:05.339718+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.339718+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:18.042053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":573,"num_read_kb":23722,"num_write":1195,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"266'450","reported_seq":2132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.930253+0000","last_change":"2024-09-12T02:07:08.930253+0000","last_active":"2024-09-12T02:07:08.930253+0000","last_peered":"2024-09-12T02:07:08.930253+0000","last_clean":"2024-09-12T02:07:08.930253+0000","last_became_active":"2024-09-12T00:10:01.259942+0000","last_became_peered":"2024-09-12T00:10:01.259942+0000","last_unstale":"2024-09-12T02:07:08.930253+0000","last_undegraded":"2024-09-12T02:07:08.930253+0000","last_fullsized":"2024-09-12T02:07:08.930253+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'450","last_scrub_stamp":"2024-09-12T02:07:08.930001+0000","last_deep_scrub":"266'450","last_deep_scrub_stamp":"2024-09-12T02:07:08.930001+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.930001+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:29.281113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2415,"num_read_kb":2305,"num_write":502,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"266'339","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.102179+0000","last_change":"2024-09-12T02:07:00.102179+0000","last_active":"2024-09-12T02:07:00.102179+0000","last_peered":"2024-09-12T02:07:00.102179+0000","last_clean":"2024-09-12T02:07:00.102179+0000","last_became_active":"2024-09-12T00:09:59.298085+0000","last_became_peered":"2024-09-12T00:09:59.298085+0000","last_unstale":"2024-09-12T02:07:00.102179+0000","last_undegraded":"2024-09-12T02:07:00.102179+0000","last_fullsized":"2024-09-12T02:07:00.102179+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'339","last_scrub_stamp":"2024-09-12T02:07:00.101803+0000","last_deep_scrub":"266'339","last_deep_scrub_stamp":"2024-09-12T02:07:00.101803+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.101803+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:33.009729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136867,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":58646,"num_write":1165,"num_write_kb":29645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"266'501","reported_seq":2216,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.040683+0000","last_change":"2024-09-12T02:07:03.040683+0000","last_active":"2024-09-12T02:07:03.040683+0000","last_peered":"2024-09-12T02:07:03.040683+0000","last_clean":"2024-09-12T02:07:03.040683+0000","last_became_active":"2024-09-12T00:10:01.255302+0000","last_became_peered":"2024-09-12T00:10:01.255302+0000","last_unstale":"2024-09-12T02:07:03.040683+0000","last_undegraded":"2024-09-12T02:07:03.040683+0000","last_fullsized":"2024-09-12T02:07:03.040683+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'501","last_scrub_stamp":"2024-09-12T02:07:03.040505+0000","last_deep_scrub":"266'501","last_deep_scrub_stamp":"2024-09-12T02:07:03.040505+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.040505+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:52.725447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2619,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"266'347","reported_seq":1083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.927866+0000","last_change":"2024-09-12T02:07:01.927866+0000","last_active":"2024-09-12T02:07:01.927866+0000","last_peered":"2024-09-12T02:07:01.927866+0000","last_clean":"2024-09-12T02:07:01.927866+0000","last_became_active":"2024-09-12T00:09:59.286393+0000","last_became_peered":"2024-09-12T00:09:59.286393+0000","last_unstale":"2024-09-12T02:07:01.927866+0000","last_undegraded":"2024-09-12T02:07:01.927866+0000","last_fullsized":"2024-09-12T02:07:01.927866+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'347","last_scrub_stamp":"2024-09-12T02:07:01.927667+0000","last_deep_scrub":"266'347","last_deep_scrub_stamp":"2024-09-12T02:07:01.927667+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.927667+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:21.933493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33187,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":4608,"num_write":1166,"num_write_kb":13882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"266'600","reported_seq":2564,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.495857+0000","last_change":"2024-09-12T02:07:07.495857+0000","last_active":"2024-09-12T02:07:07.495857+0000","last_peered":"2024-09-12T02:07:07.495857+0000","last_clean":"2024-09-12T02:07:07.495857+0000","last_became_active":"2024-09-12T00:10:01.247691+0000","last_became_peered":"2024-09-12T00:10:01.247691+0000","last_unstale":"2024-09-12T02:07:07.495857+0000","last_undegraded":"2024-09-12T02:07:07.495857+0000","last_fullsized":"2024-09-12T02:07:07.495857+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'600","last_scrub_stamp":"2024-09-12T02:07:07.495627+0000","last_deep_scrub":"266'600","last_deep_scrub_stamp":"2024-09-12T02:07:07.495627+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.495627+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":500,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:17.862827+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3679,"num_read_kb":3455,"num_write":725,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4760,"num_omap_keys":19,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"266'359","reported_seq":1028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.622685+0000","last_change":"2024-09-12T02:07:00.622538+0000","last_active":"2024-09-12T02:07:00.622685+0000","last_peered":"2024-09-12T02:07:00.622685+0000","last_clean":"2024-09-12T02:07:00.622685+0000","last_became_active":"2024-09-12T00:09:59.300760+0000","last_became_peered":"2024-09-12T00:09:59.300760+0000","last_unstale":"2024-09-12T02:07:00.622685+0000","last_undegraded":"2024-09-12T02:07:00.622685+0000","last_fullsized":"2024-09-12T02:07:00.622685+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'359","last_scrub_stamp":"2024-09-12T02:07:00.622302+0000","last_deep_scrub":"266'359","last_deep_scrub_stamp":"2024-09-12T02:07:00.622302+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.622302+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:23.067734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436849,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":26981,"num_write":1171,"num_write_kb":52645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"266'958","reported_seq":2617,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.103295+0000","last_change":"2024-09-12T02:07:09.103295+0000","last_active":"2024-09-12T02:07:09.103295+0000","last_peered":"2024-09-12T02:07:09.103295+0000","last_clean":"2024-09-12T02:07:09.103295+0000","last_became_active":"2024-09-12T00:10:01.238674+0000","last_became_peered":"2024-09-12T00:10:01.238674+0000","last_unstale":"2024-09-12T02:07:09.103295+0000","last_undegraded":"2024-09-12T02:07:09.103295+0000","last_fullsized":"2024-09-12T02:07:09.103295+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'958","last_scrub_stamp":"2024-09-12T02:07:09.103056+0000","last_deep_scrub":"266'958","last_deep_scrub_stamp":"2024-09-12T02:07:09.103056+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.103056+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":900,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:04.336294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4713,"num_read_kb":4229,"num_write":1343,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"266'291","reported_seq":952,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.962261+0000","last_change":"2024-09-12T02:07:02.962261+0000","last_active":"2024-09-12T02:07:02.962261+0000","last_peered":"2024-09-12T02:07:02.962261+0000","last_clean":"2024-09-12T02:07:02.962261+0000","last_became_active":"2024-09-12T00:09:59.288260+0000","last_became_peered":"2024-09-12T00:09:59.288260+0000","last_unstale":"2024-09-12T02:07:02.962261+0000","last_undegraded":"2024-09-12T02:07:02.962261+0000","last_fullsized":"2024-09-12T02:07:02.962261+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'291","last_scrub_stamp":"2024-09-12T02:07:02.961949+0000","last_deep_scrub":"266'291","last_deep_scrub_stamp":"2024-09-12T02:07:02.961949+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.961949+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:11.825052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":7701,"num_write":890,"num_write_kb":23188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"266'343","reported_seq":1899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.665101+0000","last_change":"2024-09-12T02:07:04.665101+0000","last_active":"2024-09-12T02:07:04.665101+0000","last_peered":"2024-09-12T02:07:04.665101+0000","last_clean":"2024-09-12T02:07:04.665101+0000","last_became_active":"2024-09-12T00:10:01.265676+0000","last_became_peered":"2024-09-12T00:10:01.265676+0000","last_unstale":"2024-09-12T02:07:04.665101+0000","last_undegraded":"2024-09-12T02:07:04.665101+0000","last_fullsized":"2024-09-12T02:07:04.665101+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'343","last_scrub_stamp":"2024-09-12T02:07:04.664920+0000","last_deep_scrub":"266'343","last_deep_scrub_stamp":"2024-09-12T02:07:04.664920+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.664920+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:06.623311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1939,"num_read_kb":1902,"num_write":362,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"266'308","reported_seq":975,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.656753+0000","last_change":"2024-09-12T02:07:03.656753+0000","last_active":"2024-09-12T02:07:03.656753+0000","last_peered":"2024-09-12T02:07:03.656753+0000","last_clean":"2024-09-12T02:07:03.656753+0000","last_became_active":"2024-09-12T00:09:59.311132+0000","last_became_peered":"2024-09-12T00:09:59.311132+0000","last_unstale":"2024-09-12T02:07:03.656753+0000","last_undegraded":"2024-09-12T02:07:03.656753+0000","last_fullsized":"2024-09-12T02:07:03.656753+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'308","last_scrub_stamp":"2024-09-12T02:07:03.656539+0000","last_deep_scrub":"266'308","last_deep_scrub_stamp":"2024-09-12T02:07:03.656539+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.656539+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:24.830436+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190249,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":37892,"num_write":1016,"num_write_kb":21146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"266'932","reported_seq":2559,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.117490+0000","last_change":"2024-09-12T02:07:08.117490+0000","last_active":"2024-09-12T02:07:08.117490+0000","last_peered":"2024-09-12T02:07:08.117490+0000","last_clean":"2024-09-12T02:07:08.117490+0000","last_became_active":"2024-09-12T00:10:01.255682+0000","last_became_peered":"2024-09-12T00:10:01.255682+0000","last_unstale":"2024-09-12T02:07:08.117490+0000","last_undegraded":"2024-09-12T02:07:08.117490+0000","last_fullsized":"2024-09-12T02:07:08.117490+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'932","last_scrub_stamp":"2024-09-12T02:07:08.117306+0000","last_deep_scrub":"266'932","last_deep_scrub_stamp":"2024-09-12T02:07:08.117306+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.117306+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":900,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:01.030752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4312,"num_read_kb":3831,"num_write":1239,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"266'335","reported_seq":1027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.528788+0000","last_change":"2024-09-12T02:06:59.528788+0000","last_active":"2024-09-12T02:06:59.528788+0000","last_peered":"2024-09-12T02:06:59.528788+0000","last_clean":"2024-09-12T02:06:59.528788+0000","last_became_active":"2024-09-12T00:09:59.300699+0000","last_became_peered":"2024-09-12T00:09:59.300699+0000","last_unstale":"2024-09-12T02:06:59.528788+0000","last_undegraded":"2024-09-12T02:06:59.528788+0000","last_fullsized":"2024-09-12T02:06:59.528788+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'335","last_scrub_stamp":"2024-09-12T02:06:59.528507+0000","last_deep_scrub":"266'335","last_deep_scrub_stamp":"2024-09-12T02:06:59.528507+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.528507+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:11.541603+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315873,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":7533,"num_write":1090,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"266'859","reported_seq":2546,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.819973+0000","last_change":"2024-09-12T02:07:08.819973+0000","last_active":"2024-09-12T02:07:08.819973+0000","last_peered":"2024-09-12T02:07:08.819973+0000","last_clean":"2024-09-12T02:07:08.819973+0000","last_became_active":"2024-09-12T00:10:01.264795+0000","last_became_peered":"2024-09-12T00:10:01.264795+0000","last_unstale":"2024-09-12T02:07:08.819973+0000","last_undegraded":"2024-09-12T02:07:08.819973+0000","last_fullsized":"2024-09-12T02:07:08.819973+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'859","last_scrub_stamp":"2024-09-12T02:07:08.819764+0000","last_deep_scrub":"266'859","last_deep_scrub_stamp":"2024-09-12T02:07:08.819764+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.819764+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:26.975796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3745,"num_write":1135,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"266'384","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.144719+0000","last_change":"2024-09-12T02:06:59.144719+0000","last_active":"2024-09-12T02:06:59.144719+0000","last_peered":"2024-09-12T02:06:59.144719+0000","last_clean":"2024-09-12T02:06:59.144719+0000","last_became_active":"2024-09-12T00:09:59.299516+0000","last_became_peered":"2024-09-12T00:09:59.299516+0000","last_unstale":"2024-09-12T02:06:59.144719+0000","last_undegraded":"2024-09-12T02:06:59.144719+0000","last_fullsized":"2024-09-12T02:06:59.144719+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'384","last_scrub_stamp":"2024-09-12T02:06:59.144457+0000","last_deep_scrub":"266'384","last_deep_scrub_stamp":"2024-09-12T02:06:59.144457+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.144457+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:38.499358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":14945,"num_write":1232,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"266'500","reported_seq":2143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.526816+0000","last_change":"2024-09-12T02:07:08.526816+0000","last_active":"2024-09-12T02:07:08.526816+0000","last_peered":"2024-09-12T02:07:08.526816+0000","last_clean":"2024-09-12T02:07:08.526816+0000","last_became_active":"2024-09-12T00:10:01.258691+0000","last_became_peered":"2024-09-12T00:10:01.258691+0000","last_unstale":"2024-09-12T02:07:08.526816+0000","last_undegraded":"2024-09-12T02:07:08.526816+0000","last_fullsized":"2024-09-12T02:07:08.526816+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'500","last_scrub_stamp":"2024-09-12T02:07:08.526620+0000","last_deep_scrub":"266'500","last_deep_scrub_stamp":"2024-09-12T02:07:08.526620+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.526620+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:10.056735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2775,"num_read_kb":2593,"num_write":624,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"266'376","reported_seq":1045,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.800570+0000","last_change":"2024-09-12T02:07:02.800570+0000","last_active":"2024-09-12T02:07:02.800570+0000","last_peered":"2024-09-12T02:07:02.800570+0000","last_clean":"2024-09-12T02:07:02.800570+0000","last_became_active":"2024-09-12T00:09:59.313345+0000","last_became_peered":"2024-09-12T00:09:59.313345+0000","last_unstale":"2024-09-12T02:07:02.800570+0000","last_undegraded":"2024-09-12T02:07:02.800570+0000","last_fullsized":"2024-09-12T02:07:02.800570+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'376","last_scrub_stamp":"2024-09-12T02:07:02.800345+0000","last_deep_scrub":"266'376","last_deep_scrub_stamp":"2024-09-12T02:07:02.800345+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.800345+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:51.023798+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4483063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":14481,"num_write":1098,"num_write_kb":25771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"266'326","reported_seq":1756,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.927377+0000","last_change":"2024-09-12T02:07:10.927377+0000","last_active":"2024-09-12T02:07:10.927377+0000","last_peered":"2024-09-12T02:07:10.927377+0000","last_clean":"2024-09-12T02:07:10.927377+0000","last_became_active":"2024-09-12T00:10:01.249832+0000","last_became_peered":"2024-09-12T00:10:01.249832+0000","last_unstale":"2024-09-12T02:07:10.927377+0000","last_undegraded":"2024-09-12T02:07:10.927377+0000","last_fullsized":"2024-09-12T02:07:10.927377+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'326","last_scrub_stamp":"2024-09-12T02:07:10.927188+0000","last_deep_scrub":"266'326","last_deep_scrub_stamp":"2024-09-12T02:07:10.927188+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.927188+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:40.299799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1802,"num_read_kb":1736,"num_write":351,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"266'317","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.657601+0000","last_change":"2024-09-12T02:06:54.657601+0000","last_active":"2024-09-12T02:06:54.657601+0000","last_peered":"2024-09-12T02:06:54.657601+0000","last_clean":"2024-09-12T02:06:54.657601+0000","last_became_active":"2024-09-12T00:09:59.311158+0000","last_became_peered":"2024-09-12T00:09:59.311158+0000","last_unstale":"2024-09-12T02:06:54.657601+0000","last_undegraded":"2024-09-12T02:06:54.657601+0000","last_fullsized":"2024-09-12T02:06:54.657601+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'317","last_scrub_stamp":"2024-09-12T02:06:54.657499+0000","last_deep_scrub":"266'317","last_deep_scrub_stamp":"2024-09-12T02:06:54.657499+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.657499+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:41.120241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316829,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":115277,"num_write":995,"num_write_kb":39549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"266'721","reported_seq":2271,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.820396+0000","last_change":"2024-09-12T02:07:07.820396+0000","last_active":"2024-09-12T02:07:07.820396+0000","last_peered":"2024-09-12T02:07:07.820396+0000","last_clean":"2024-09-12T02:07:07.820396+0000","last_became_active":"2024-09-12T00:10:01.267027+0000","last_became_peered":"2024-09-12T00:10:01.267027+0000","last_unstale":"2024-09-12T02:07:07.820396+0000","last_undegraded":"2024-09-12T02:07:07.820396+0000","last_fullsized":"2024-09-12T02:07:07.820396+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'721","last_scrub_stamp":"2024-09-12T02:07:07.820152+0000","last_deep_scrub":"266'721","last_deep_scrub_stamp":"2024-09-12T02:07:07.820152+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.820152+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:54.864599+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3526,"num_read_kb":3200,"num_write":1050,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"266'331","reported_seq":1002,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.617366+0000","last_change":"2024-09-12T02:07:04.617366+0000","last_active":"2024-09-12T02:07:04.617366+0000","last_peered":"2024-09-12T02:07:04.617366+0000","last_clean":"2024-09-12T02:07:04.617366+0000","last_became_active":"2024-09-12T00:09:59.285907+0000","last_became_peered":"2024-09-12T00:09:59.285907+0000","last_unstale":"2024-09-12T02:07:04.617366+0000","last_undegraded":"2024-09-12T02:07:04.617366+0000","last_fullsized":"2024-09-12T02:07:04.617366+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'331","last_scrub_stamp":"2024-09-12T02:07:04.617081+0000","last_deep_scrub":"266'331","last_deep_scrub_stamp":"2024-09-12T02:07:04.617081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.617081+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:36.016645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569458,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":44645,"num_write":951,"num_write_kb":42281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"266'334","reported_seq":1017,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.598905+0000","last_change":"2024-09-12T02:07:07.598905+0000","last_active":"2024-09-12T02:07:07.598905+0000","last_peered":"2024-09-12T02:07:07.598905+0000","last_clean":"2024-09-12T02:07:07.598905+0000","last_became_active":"2024-09-12T00:09:59.282446+0000","last_became_peered":"2024-09-12T00:09:59.282446+0000","last_unstale":"2024-09-12T02:07:07.598905+0000","last_undegraded":"2024-09-12T02:07:07.598905+0000","last_fullsized":"2024-09-12T02:07:07.598905+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'334","last_scrub_stamp":"2024-09-12T02:07:07.598535+0000","last_deep_scrub":"266'334","last_deep_scrub_stamp":"2024-09-12T02:07:07.598535+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.598535+0000","objects_scrubbed":10,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:11.077428+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2535841,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":492,"num_read_kb":44688,"num_write":1069,"num_write_kb":33304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"266'458","reported_seq":2039,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.548533+0000","last_change":"2024-09-12T02:07:09.548533+0000","last_active":"2024-09-12T02:07:09.548533+0000","last_peered":"2024-09-12T02:07:09.548533+0000","last_clean":"2024-09-12T02:07:09.548533+0000","last_became_active":"2024-09-12T00:10:01.247767+0000","last_became_peered":"2024-09-12T00:10:01.247767+0000","last_unstale":"2024-09-12T02:07:09.548533+0000","last_undegraded":"2024-09-12T02:07:09.548533+0000","last_fullsized":"2024-09-12T02:07:09.548533+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T02:07:09.548332+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T02:07:09.548332+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.548332+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:46.662531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2488,"num_read_kb":2350,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"266'350","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.349649+0000","last_change":"2024-09-12T02:07:02.349649+0000","last_active":"2024-09-12T02:07:02.349649+0000","last_peered":"2024-09-12T02:07:02.349649+0000","last_clean":"2024-09-12T02:07:02.349649+0000","last_became_active":"2024-09-12T00:10:31.168444+0000","last_became_peered":"2024-09-12T00:10:31.168444+0000","last_unstale":"2024-09-12T02:07:02.349649+0000","last_undegraded":"2024-09-12T02:07:02.349649+0000","last_fullsized":"2024-09-12T02:07:02.349649+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'350","last_scrub_stamp":"2024-09-12T02:07:02.349335+0000","last_deep_scrub":"266'350","last_deep_scrub_stamp":"2024-09-12T02:07:02.349335+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.349335+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:22.134489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400029,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":20125,"num_write":1291,"num_write_kb":40521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,0],"acting":[1,4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"266'1090","reported_seq":2780,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.583557+0000","last_change":"2024-09-12T02:07:12.583557+0000","last_active":"2024-09-12T02:07:12.583557+0000","last_peered":"2024-09-12T02:07:12.583557+0000","last_clean":"2024-09-12T02:07:12.583557+0000","last_became_active":"2024-09-12T00:10:01.278762+0000","last_became_peered":"2024-09-12T00:10:01.278762+0000","last_unstale":"2024-09-12T02:07:12.583557+0000","last_undegraded":"2024-09-12T02:07:12.583557+0000","last_fullsized":"2024-09-12T02:07:12.583557+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1090","last_scrub_stamp":"2024-09-12T02:07:12.583390+0000","last_deep_scrub":"266'1090","last_deep_scrub_stamp":"2024-09-12T02:07:12.583390+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.583390+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":1000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:04.451087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5202,"num_read_kb":4573,"num_write":1592,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6060,"num_read_kb":4225,"num_write":1955,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1026,"ondisk_log_size":1026,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":15149,"num_read_kb":14793,"num_write":16764,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":434,"ondisk_log_size":434,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1579968,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":21268,"num_read_kb":40714,"num_write":17731,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2030,"ondisk_log_size":2030,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213079,"num_read_kb":194397,"num_write":55367,"num_write_kb":18884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43514,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3931,"ondisk_log_size":3931,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":73602788,"num_objects":381,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":381,"num_whiteouts":0,"num_read":36353,"num_read_kb":1955827,"num_write":72080,"num_write_kb":2110952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100646912,"data_stored":100646912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3518,"ondisk_log_size":3518,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":180842,"num_write":186,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":169574,"num_write":186,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543560,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341692,"kb_used_data":17580,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94030148,"statfs":{"total":96636764160,"available":96286871552,"internally_reserved":0,"allocated":18001920,"data_stored":15991149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543560,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306672,"kb_used_data":18656,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94065168,"statfs":{"total":96636764160,"available":96322732032,"internally_reserved":0,"allocated":19103744,"data_stored":17151124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294910406},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543566,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191148,"kb_used_data":15644,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94180692,"statfs":{"total":96636764160,"available":96441028608,"internally_reserved":0,"allocated":16019456,"data_stored":13989543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543561,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158712,"kb_used_data":15080,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94213128,"statfs":{"total":96636764160,"available":96474243072,"internally_reserved":0,"allocated":15441920,"data_stored":13515589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543563,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308428,"kb_used_data":20412,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94063412,"statfs":{"total":96636764160,"available":96320933888,"internally_reserved":0,"allocated":20901888,"data_stored":18895025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":294910407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543561,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117028,"kb_used_data":13652,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94254812,"statfs":{"total":96636764160,"available":96516927488,"internally_reserved":0,"allocated":13979648,"data_stored":12036246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543563,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195036,"kb_used_data":11212,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94176804,"statfs":{"total":96636764160,"available":96437047296,"internally_reserved":0,"allocated":11481088,"data_stored":9500646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543562,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304388,"kb_used_data":20596,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94067452,"statfs":{"total":96636764160,"available":96325070848,"internally_reserved":0,"allocated":21090304,"data_stored":19083000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16199680,"data_stored":16199680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7208960,"data_stored":7208960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9744384,"data_stored":9744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16601088,"data_stored":16601088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11227136,"data_stored":11227136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11698176,"data_stored":11698176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14860288,"data_stored":14860288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13107200,"data_stored":13107200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:15.852 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.852 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.852 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.852 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.852 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.853 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.853 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.853 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.853 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.853 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.853 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.853 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.854 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.854 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.854 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.854 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.854 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.855 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.855 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.855 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.855 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.855 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.855 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.855 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.855 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.856 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.856 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.856 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.856 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.856 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.856 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.856 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.856 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.856 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.857 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.857 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.857 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.857 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.857 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.857 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.857 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.857 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.857 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.857 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.858 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.858 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.858 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.858 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.858 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.858 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.858 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.858 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.858 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.859 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.859 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.859 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.859 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.859 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.859 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.859 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.859 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.859 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.859 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.860 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.860 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.860 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.860 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.860 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.860 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.860 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.861 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.861 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.861 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.861 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.861 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.861 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.861 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.861 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.862 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.862 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.862 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.862 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.862 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.862 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.863 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.863 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.863 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.863 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.863 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.863 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.863 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.864 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.864 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.864 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.864 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.864 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.864 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.864 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.864 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.864 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.865 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.865 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.865 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.865 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.865 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.865 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.866 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.866 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.866 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.866 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.866 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.866 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.866 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.866 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.867 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.867 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.867 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.867 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.867 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.867 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.867 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.867 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.867 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.867 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.868 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.868 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.868 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.868 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.868 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.868 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.869 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.869 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.869 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.869 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.869 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.869 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.869 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.869 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.870 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.870 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.870 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.870 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.870 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.871 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.871 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.871 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.871 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.871 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.871 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.871 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.871 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.872 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.872 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.872 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.872 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.872 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.872 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.872 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.872 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.873 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.873 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.873 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.873 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.873 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.873 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.873 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.873 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.874 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.874 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.874 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.874 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.874 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.874 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.874 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.874 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.875 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.875 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.875 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.875 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.875 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.875 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.876 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.876 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.876 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.876 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.876 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.877 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.877 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.877 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.877 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.877 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.877 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.877 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.878 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.878 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.878 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.878 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.878 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.878 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.878 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.878 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.878 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.879 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.879 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.879 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.879 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.879 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.879 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.880 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.880 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.880 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.880 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.880 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.880 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.880 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.881 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.881 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.881 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.881 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.881 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.881 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:10:02.222452+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.881 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.881 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.882 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.882 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:10:04.244753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.882 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.882 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.882 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:10:00.216198+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:15.882 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:07:35.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:36.247 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:07:36.261 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-12T02:07:36.266 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":3795,"stamp":"2024-09-12T02:07:34.925621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75791055,"num_objects":883,"num_object_clones":0,"num_object_copies":2528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":294733,"num_read_kb":2563326,"num_write":164412,"num_write_kb":2404914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725116,"num_omap_keys":1771,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13149,"ondisk_log_size":13149,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1931424,"kb_used_data":132832,"kb_used_omap":12,"kb_used_meta":1798451,"kb_avail":753043296,"statfs":{"total":773094113280,"available":771116335104,"internally_reserved":0,"allocated":136019968,"data_stored":120162322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1841614384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":632618,"num_omap_keys":1481,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007955"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:54.728675+0000","last_change":"2024-09-12T01:00:24.087308+0000","last_active":"2024-09-12T02:02:54.728675+0000","last_peered":"2024-09-12T02:02:54.728675+0000","last_clean":"2024-09-12T02:02:54.728675+0000","last_became_active":"2024-09-12T01:00:24.086540+0000","last_became_peered":"2024-09-12T01:00:24.086540+0000","last_unstale":"2024-09-12T02:02:54.728675+0000","last_undegraded":"2024-09-12T02:02:54.728675+0000","last_fullsized":"2024-09-12T02:02:54.728675+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:55.672405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"266'3","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.658583+0000","last_change":"2024-09-12T00:32:21.646660+0000","last_active":"2024-09-12T02:06:45.658583+0000","last_peered":"2024-09-12T02:06:45.658583+0000","last_clean":"2024-09-12T02:06:45.658583+0000","last_became_active":"2024-09-12T00:32:21.645757+0000","last_became_peered":"2024-09-12T00:32:21.645757+0000","last_unstale":"2024-09-12T02:06:45.658583+0000","last_undegraded":"2024-09-12T02:06:45.658583+0000","last_fullsized":"2024-09-12T02:06:45.658583+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"266'6","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.263130+0000","last_change":"2024-09-12T00:32:14.592938+0000","last_active":"2024-09-12T02:06:47.263130+0000","last_peered":"2024-09-12T02:06:47.263130+0000","last_clean":"2024-09-12T02:06:47.263130+0000","last_became_active":"2024-09-12T00:32:14.592177+0000","last_became_peered":"2024-09-12T00:32:14.592177+0000","last_unstale":"2024-09-12T02:06:47.263130+0000","last_undegraded":"2024-09-12T02:06:47.263130+0000","last_fullsized":"2024-09-12T02:06:47.263130+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8188,"num_write":6,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"266'29","reported_seq":164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:18.531382+0000","last_change":"2024-09-12T00:26:23.355721+0000","last_active":"2024-09-12T02:04:18.531382+0000","last_peered":"2024-09-12T02:04:18.531382+0000","last_clean":"2024-09-12T02:04:18.531382+0000","last_became_active":"2024-09-12T00:26:23.353338+0000","last_became_peered":"2024-09-12T00:26:23.353338+0000","last_unstale":"2024-09-12T02:04:18.531382+0000","last_undegraded":"2024-09-12T02:04:18.531382+0000","last_fullsized":"2024-09-12T02:04:18.531382+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:52.176865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.603682+0000","last_change":"2024-09-12T02:07:19.603682+0000","last_active":"2024-09-12T02:07:19.603682+0000","last_peered":"2024-09-12T02:07:19.603682+0000","last_clean":"2024-09-12T02:07:19.603682+0000","last_became_active":"2024-09-12T01:00:24.074048+0000","last_became_peered":"2024-09-12T01:00:24.074048+0000","last_unstale":"2024-09-12T02:07:19.603682+0000","last_undegraded":"2024-09-12T02:07:19.603682+0000","last_fullsized":"2024-09-12T02:07:19.603682+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:19.603508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:19.603508+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.603508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:29.733337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"266'13","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.740779+0000","last_change":"2024-09-12T00:32:21.643734+0000","last_active":"2024-09-12T02:06:46.740779+0000","last_peered":"2024-09-12T02:06:46.740779+0000","last_clean":"2024-09-12T02:06:46.740779+0000","last_became_active":"2024-09-12T00:32:21.642967+0000","last_became_peered":"2024-09-12T00:32:21.642967+0000","last_unstale":"2024-09-12T02:06:46.740779+0000","last_undegraded":"2024-09-12T02:06:46.740779+0000","last_fullsized":"2024-09-12T02:06:46.740779+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24594,"num_write":18,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.630593+0000","last_change":"2024-09-12T02:07:32.630593+0000","last_active":"2024-09-12T02:07:32.630593+0000","last_peered":"2024-09-12T02:07:32.630593+0000","last_clean":"2024-09-12T02:07:32.630593+0000","last_became_active":"2024-09-12T00:32:14.602766+0000","last_became_peered":"2024-09-12T00:32:14.602766+0000","last_unstale":"2024-09-12T02:07:32.630593+0000","last_undegraded":"2024-09-12T02:07:32.630593+0000","last_fullsized":"2024-09-12T02:07:32.630593+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:32.630411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:32.630411+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.630411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:11.014809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"266'26","reported_seq":159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.641746+0000","last_change":"2024-09-12T02:07:13.641746+0000","last_active":"2024-09-12T02:07:13.641746+0000","last_peered":"2024-09-12T02:07:13.641746+0000","last_clean":"2024-09-12T02:07:13.641746+0000","last_became_active":"2024-09-12T00:26:23.321682+0000","last_became_peered":"2024-09-12T00:26:23.321682+0000","last_unstale":"2024-09-12T02:07:13.641746+0000","last_undegraded":"2024-09-12T02:07:13.641746+0000","last_fullsized":"2024-09-12T02:07:13.641746+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T02:07:13.641577+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T02:07:13.641577+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.641577+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:11.157660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.038572+0000","last_change":"2024-09-12T02:07:31.038572+0000","last_active":"2024-09-12T02:07:31.038572+0000","last_peered":"2024-09-12T02:07:31.038572+0000","last_clean":"2024-09-12T02:07:31.038572+0000","last_became_active":"2024-09-12T01:00:24.075719+0000","last_became_peered":"2024-09-12T01:00:24.075719+0000","last_unstale":"2024-09-12T02:07:31.038572+0000","last_undegraded":"2024-09-12T02:07:31.038572+0000","last_fullsized":"2024-09-12T02:07:31.038572+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:31.038391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:31.038391+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.038391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:19.895065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"266'2","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:08.555301+0000","last_change":"2024-09-12T00:32:21.664584+0000","last_active":"2024-09-12T02:06:08.555301+0000","last_peered":"2024-09-12T02:06:08.555301+0000","last_clean":"2024-09-12T02:06:08.555301+0000","last_became_active":"2024-09-12T00:32:21.663938+0000","last_became_peered":"2024-09-12T00:32:21.663938+0000","last_unstale":"2024-09-12T02:06:08.555301+0000","last_undegraded":"2024-09-12T02:06:08.555301+0000","last_fullsized":"2024-09-12T02:06:08.555301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:56.468320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"266'10","reported_seq":103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.591891+0000","last_change":"2024-09-12T02:07:16.591891+0000","last_active":"2024-09-12T02:07:16.591891+0000","last_peered":"2024-09-12T02:07:16.591891+0000","last_clean":"2024-09-12T02:07:16.591891+0000","last_became_active":"2024-09-12T00:32:14.597094+0000","last_became_peered":"2024-09-12T00:32:14.597094+0000","last_unstale":"2024-09-12T02:07:16.591891+0000","last_undegraded":"2024-09-12T02:07:16.591891+0000","last_fullsized":"2024-09-12T02:07:16.591891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T02:07:16.591704+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T02:07:16.591704+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.591704+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:05.717857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24574,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"266'4","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525390+0000","last_change":"2024-09-12T00:26:23.350775+0000","last_active":"2024-09-12T02:03:53.525390+0000","last_peered":"2024-09-12T02:03:53.525390+0000","last_clean":"2024-09-12T02:03:53.525390+0000","last_became_active":"2024-09-12T00:26:23.349476+0000","last_became_peered":"2024-09-12T00:26:23.349476+0000","last_unstale":"2024-09-12T02:03:53.525390+0000","last_undegraded":"2024-09-12T02:03:53.525390+0000","last_fullsized":"2024-09-12T02:03:53.525390+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:55.207200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959089+0000","last_change":"2024-09-12T01:00:24.070271+0000","last_active":"2024-09-12T02:03:23.959089+0000","last_peered":"2024-09-12T02:03:23.959089+0000","last_clean":"2024-09-12T02:03:23.959089+0000","last_became_active":"2024-09-12T01:00:24.069555+0000","last_became_peered":"2024-09-12T01:00:24.069555+0000","last_unstale":"2024-09-12T02:03:23.959089+0000","last_undegraded":"2024-09-12T02:03:23.959089+0000","last_fullsized":"2024-09-12T02:03:23.959089+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:30.440481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:39.005123+0000","last_change":"2024-09-12T00:32:21.658088+0000","last_active":"2024-09-12T02:06:39.005123+0000","last_peered":"2024-09-12T02:06:39.005123+0000","last_clean":"2024-09-12T02:06:39.005123+0000","last_became_active":"2024-09-12T00:32:21.654241+0000","last_became_peered":"2024-09-12T00:32:21.654241+0000","last_unstale":"2024-09-12T02:06:39.005123+0000","last_undegraded":"2024-09-12T02:06:39.005123+0000","last_fullsized":"2024-09-12T02:06:39.005123+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:08.083982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"266'13","reported_seq":98,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.298455+0000","last_change":"2024-09-12T00:32:14.586986+0000","last_active":"2024-09-12T02:06:46.298455+0000","last_peered":"2024-09-12T02:06:46.298455+0000","last_clean":"2024-09-12T02:06:46.298455+0000","last_became_active":"2024-09-12T00:32:14.586250+0000","last_became_peered":"2024-09-12T00:32:14.586250+0000","last_unstale":"2024-09-12T02:06:46.298455+0000","last_undegraded":"2024-09-12T02:06:46.298455+0000","last_fullsized":"2024-09-12T02:06:46.298455+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.871370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":31734,"num_write":18,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"266'26","reported_seq":142,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967298+0000","last_change":"2024-09-12T00:26:23.334469+0000","last_active":"2024-09-12T02:03:53.967298+0000","last_peered":"2024-09-12T02:03:53.967298+0000","last_clean":"2024-09-12T02:03:53.967298+0000","last_became_active":"2024-09-12T00:26:23.327186+0000","last_became_peered":"2024-09-12T00:26:23.327186+0000","last_unstale":"2024-09-12T02:03:53.967298+0000","last_undegraded":"2024-09-12T02:03:53.967298+0000","last_fullsized":"2024-09-12T02:03:53.967298+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:43.603716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.977562+0000","last_change":"2024-09-12T01:00:24.078700+0000","last_active":"2024-09-12T02:04:33.977562+0000","last_peered":"2024-09-12T02:04:33.977562+0000","last_clean":"2024-09-12T02:04:33.977562+0000","last_became_active":"2024-09-12T01:00:24.077651+0000","last_became_peered":"2024-09-12T01:00:24.077651+0000","last_unstale":"2024-09-12T02:04:33.977562+0000","last_undegraded":"2024-09-12T02:04:33.977562+0000","last_fullsized":"2024-09-12T02:04:33.977562+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"266'5","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.657954+0000","last_change":"2024-09-12T00:32:21.651210+0000","last_active":"2024-09-12T02:06:45.657954+0000","last_peered":"2024-09-12T02:06:45.657954+0000","last_clean":"2024-09-12T02:06:45.657954+0000","last_became_active":"2024-09-12T00:32:21.649921+0000","last_became_peered":"2024-09-12T00:32:21.649921+0000","last_unstale":"2024-09-12T02:06:45.657954+0000","last_undegraded":"2024-09-12T02:06:45.657954+0000","last_fullsized":"2024-09-12T02:06:45.657954+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:54.485675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:08.528825+0000","last_change":"2024-09-12T00:32:14.608528+0000","last_active":"2024-09-12T02:04:08.528825+0000","last_peered":"2024-09-12T02:04:08.528825+0000","last_clean":"2024-09-12T02:04:08.528825+0000","last_became_active":"2024-09-12T00:32:14.607652+0000","last_became_peered":"2024-09-12T00:32:14.607652+0000","last_unstale":"2024-09-12T02:04:08.528825+0000","last_undegraded":"2024-09-12T02:04:08.528825+0000","last_fullsized":"2024-09-12T02:04:08.528825+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:12.098399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"266'15","reported_seq":114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.967169+0000","last_change":"2024-09-12T00:26:23.343440+0000","last_active":"2024-09-12T02:03:53.967169+0000","last_peered":"2024-09-12T02:03:53.967169+0000","last_clean":"2024-09-12T02:03:53.967169+0000","last_became_active":"2024-09-12T00:26:23.339416+0000","last_became_peered":"2024-09-12T00:26:23.339416+0000","last_unstale":"2024-09-12T02:03:53.967169+0000","last_undegraded":"2024-09-12T02:03:53.967169+0000","last_fullsized":"2024-09-12T02:03:53.967169+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:20.570031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.713586+0000","last_change":"2024-09-12T01:00:24.065435+0000","last_active":"2024-09-12T02:04:58.713586+0000","last_peered":"2024-09-12T02:04:58.713586+0000","last_clean":"2024-09-12T02:04:58.713586+0000","last_became_active":"2024-09-12T01:00:24.064732+0000","last_became_peered":"2024-09-12T01:00:24.064732+0000","last_unstale":"2024-09-12T02:04:58.713586+0000","last_undegraded":"2024-09-12T02:04:58.713586+0000","last_fullsized":"2024-09-12T02:04:58.713586+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.059543+0000","last_change":"2024-09-12T02:07:28.059543+0000","last_active":"2024-09-12T02:07:28.059543+0000","last_peered":"2024-09-12T02:07:28.059543+0000","last_clean":"2024-09-12T02:07:28.059543+0000","last_became_active":"2024-09-12T00:32:21.649260+0000","last_became_peered":"2024-09-12T00:32:21.649260+0000","last_unstale":"2024-09-12T02:07:28.059543+0000","last_undegraded":"2024-09-12T02:07:28.059543+0000","last_fullsized":"2024-09-12T02:07:28.059543+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:28.059317+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:28.059317+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.059317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:55.872980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'3","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.122988+0000","last_change":"2024-09-12T02:07:32.122988+0000","last_active":"2024-09-12T02:07:32.122988+0000","last_peered":"2024-09-12T02:07:32.122988+0000","last_clean":"2024-09-12T02:07:32.122988+0000","last_became_active":"2024-09-12T00:32:14.582112+0000","last_became_peered":"2024-09-12T00:32:14.582112+0000","last_unstale":"2024-09-12T02:07:32.122988+0000","last_undegraded":"2024-09-12T02:07:32.122988+0000","last_fullsized":"2024-09-12T02:07:32.122988+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T02:07:32.122794+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T02:07:32.122794+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.122794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:51.853305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"266'89","reported_seq":408,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.124608+0000","last_change":"2024-09-12T02:07:23.124608+0000","last_active":"2024-09-12T02:07:23.124608+0000","last_peered":"2024-09-12T02:07:23.124608+0000","last_clean":"2024-09-12T02:07:23.124608+0000","last_became_active":"2024-09-12T00:26:23.328597+0000","last_became_peered":"2024-09-12T00:26:23.328597+0000","last_unstale":"2024-09-12T02:07:23.124608+0000","last_undegraded":"2024-09-12T02:07:23.124608+0000","last_fullsized":"2024-09-12T02:07:23.124608+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'89","last_scrub_stamp":"2024-09-12T02:07:23.124434+0000","last_deep_scrub":"266'89","last_deep_scrub_stamp":"2024-09-12T02:07:23.124434+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.124434+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:13.201981+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":416,"num_write":108,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2480,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731863+0000","last_change":"2024-09-12T01:00:24.071788+0000","last_active":"2024-09-12T02:02:53.731863+0000","last_peered":"2024-09-12T02:02:53.731863+0000","last_clean":"2024-09-12T02:02:53.731863+0000","last_became_active":"2024-09-12T01:00:24.071095+0000","last_became_peered":"2024-09-12T01:00:24.071095+0000","last_unstale":"2024-09-12T02:02:53.731863+0000","last_undegraded":"2024-09-12T02:02:53.731863+0000","last_fullsized":"2024-09-12T02:02:53.731863+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:52.669721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"266'9","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.049495+0000","last_change":"2024-09-12T02:07:30.049495+0000","last_active":"2024-09-12T02:07:30.049495+0000","last_peered":"2024-09-12T02:07:30.049495+0000","last_clean":"2024-09-12T02:07:30.049495+0000","last_became_active":"2024-09-12T00:32:21.643876+0000","last_became_peered":"2024-09-12T00:32:21.643876+0000","last_unstale":"2024-09-12T02:07:30.049495+0000","last_undegraded":"2024-09-12T02:07:30.049495+0000","last_fullsized":"2024-09-12T02:07:30.049495+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:30.049304+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:30.049304+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.049304+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:28.552406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10236,"num_write":14,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":88,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.152111+0000","last_change":"2024-09-12T02:07:33.152111+0000","last_active":"2024-09-12T02:07:33.152111+0000","last_peered":"2024-09-12T02:07:33.152111+0000","last_clean":"2024-09-12T02:07:33.152111+0000","last_became_active":"2024-09-12T00:32:14.588375+0000","last_became_peered":"2024-09-12T00:32:14.588375+0000","last_unstale":"2024-09-12T02:07:33.152111+0000","last_undegraded":"2024-09-12T02:07:33.152111+0000","last_fullsized":"2024-09-12T02:07:33.152111+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T02:07:33.151911+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T02:07:33.151911+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.151911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:18.994536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7178,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"266'62","reported_seq":248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:33.520452+0000","last_change":"2024-09-12T00:26:23.337872+0000","last_active":"2024-09-12T02:03:33.520452+0000","last_peered":"2024-09-12T02:03:33.520452+0000","last_clean":"2024-09-12T02:03:33.520452+0000","last_became_active":"2024-09-12T00:26:23.336278+0000","last_became_peered":"2024-09-12T00:26:23.336278+0000","last_unstale":"2024-09-12T02:03:33.520452+0000","last_undegraded":"2024-09-12T02:03:33.520452+0000","last_fullsized":"2024-09-12T02:03:33.520452+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:03.462066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":248,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:02:53.731956+0000","last_change":"2024-09-12T01:00:24.078804+0000","last_active":"2024-09-12T02:02:53.731956+0000","last_peered":"2024-09-12T02:02:53.731956+0000","last_clean":"2024-09-12T02:02:53.731956+0000","last_became_active":"2024-09-12T01:00:24.078120+0000","last_became_peered":"2024-09-12T01:00:24.078120+0000","last_unstale":"2024-09-12T02:02:53.731956+0000","last_undegraded":"2024-09-12T02:02:53.731956+0000","last_fullsized":"2024-09-12T02:02:53.731956+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:07.036331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:53.983205+0000","last_change":"2024-09-12T00:32:21.654093+0000","last_active":"2024-09-12T02:04:53.983205+0000","last_peered":"2024-09-12T02:04:53.983205+0000","last_clean":"2024-09-12T02:04:53.983205+0000","last_became_active":"2024-09-12T00:32:21.650564+0000","last_became_peered":"2024-09-12T00:32:21.650564+0000","last_unstale":"2024-09-12T02:04:53.983205+0000","last_undegraded":"2024-09-12T02:04:53.983205+0000","last_fullsized":"2024-09-12T02:04:53.983205+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'2","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:48.538892+0000","last_change":"2024-09-12T00:32:14.600836+0000","last_active":"2024-09-12T02:04:48.538892+0000","last_peered":"2024-09-12T02:04:48.538892+0000","last_clean":"2024-09-12T02:04:48.538892+0000","last_became_active":"2024-09-12T00:32:14.600188+0000","last_became_peered":"2024-09-12T00:32:14.600188+0000","last_unstale":"2024-09-12T02:04:48.538892+0000","last_undegraded":"2024-09-12T02:04:48.538892+0000","last_fullsized":"2024-09-12T02:04:48.538892+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"266'14","reported_seq":120,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.570835+0000","last_change":"2024-09-12T02:07:22.570835+0000","last_active":"2024-09-12T02:07:22.570835+0000","last_peered":"2024-09-12T02:07:22.570835+0000","last_clean":"2024-09-12T02:07:22.570835+0000","last_became_active":"2024-09-12T00:26:23.325067+0000","last_became_peered":"2024-09-12T00:26:23.325067+0000","last_unstale":"2024-09-12T02:07:22.570835+0000","last_undegraded":"2024-09-12T02:07:22.570835+0000","last_fullsized":"2024-09-12T02:07:22.570835+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'14","last_scrub_stamp":"2024-09-12T02:07:22.570644+0000","last_deep_scrub":"266'14","last_deep_scrub_stamp":"2024-09-12T02:07:22.570644+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.570644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:26.839587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.690730+0000","last_change":"2024-09-12T01:00:24.075536+0000","last_active":"2024-09-12T02:03:23.690730+0000","last_peered":"2024-09-12T02:03:23.690730+0000","last_clean":"2024-09-12T02:03:23.690730+0000","last_became_active":"2024-09-12T01:00:24.075148+0000","last_became_peered":"2024-09-12T01:00:24.075148+0000","last_unstale":"2024-09-12T02:03:23.690730+0000","last_undegraded":"2024-09-12T02:03:23.690730+0000","last_fullsized":"2024-09-12T02:03:23.690730+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:59.023799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"266'2","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:39.005064+0000","last_change":"2024-09-12T00:32:21.658733+0000","last_active":"2024-09-12T02:06:39.005064+0000","last_peered":"2024-09-12T02:06:39.005064+0000","last_clean":"2024-09-12T02:06:39.005064+0000","last_became_active":"2024-09-12T00:32:21.654214+0000","last_became_peered":"2024-09-12T00:32:21.654214+0000","last_unstale":"2024-09-12T02:06:39.005064+0000","last_undegraded":"2024-09-12T02:06:39.005064+0000","last_fullsized":"2024-09-12T02:06:39.005064+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.587733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'5","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.742982+0000","last_change":"2024-09-12T02:07:33.742982+0000","last_active":"2024-09-12T02:07:33.742982+0000","last_peered":"2024-09-12T02:07:33.742982+0000","last_clean":"2024-09-12T02:07:33.742982+0000","last_became_active":"2024-09-12T00:32:14.586101+0000","last_became_peered":"2024-09-12T00:32:14.586101+0000","last_unstale":"2024-09-12T02:07:33.742982+0000","last_undegraded":"2024-09-12T02:07:33.742982+0000","last_fullsized":"2024-09-12T02:07:33.742982+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T02:07:33.742797+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T02:07:33.742797+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.742797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:03.994396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"266'18","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.724550+0000","last_change":"2024-09-12T00:26:23.351546+0000","last_active":"2024-09-12T02:03:03.724550+0000","last_peered":"2024-09-12T02:03:03.724550+0000","last_clean":"2024-09-12T02:03:03.724550+0000","last_became_active":"2024-09-12T00:26:23.338890+0000","last_became_peered":"2024-09-12T00:26:23.338890+0000","last_unstale":"2024-09-12T02:03:03.724550+0000","last_undegraded":"2024-09-12T02:03:03.724550+0000","last_fullsized":"2024-09-12T02:03:03.724550+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:29.634760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.617072+0000","last_change":"2024-09-12T02:07:21.617072+0000","last_active":"2024-09-12T02:07:21.617072+0000","last_peered":"2024-09-12T02:07:21.617072+0000","last_clean":"2024-09-12T02:07:21.617072+0000","last_became_active":"2024-09-12T01:00:24.076081+0000","last_became_peered":"2024-09-12T01:00:24.076081+0000","last_unstale":"2024-09-12T02:07:21.617072+0000","last_undegraded":"2024-09-12T02:07:21.617072+0000","last_fullsized":"2024-09-12T02:07:21.617072+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:21.616889+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:21.616889+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.616889+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:11.136708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'5","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.962875+0000","last_change":"2024-09-12T00:32:21.665472+0000","last_active":"2024-09-12T02:03:38.962875+0000","last_peered":"2024-09-12T02:03:38.962875+0000","last_clean":"2024-09-12T02:03:38.962875+0000","last_became_active":"2024-09-12T00:32:21.659460+0000","last_became_peered":"2024-09-12T00:32:21.659460+0000","last_unstale":"2024-09-12T02:03:38.962875+0000","last_undegraded":"2024-09-12T02:03:38.962875+0000","last_fullsized":"2024-09-12T02:03:38.962875+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:34.362543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:33.784493+0000","last_change":"2024-09-12T00:32:14.595556+0000","last_active":"2024-09-12T02:06:33.784493+0000","last_peered":"2024-09-12T02:06:33.784493+0000","last_clean":"2024-09-12T02:06:33.784493+0000","last_became_active":"2024-09-12T00:32:14.594973+0000","last_became_peered":"2024-09-12T00:32:14.594973+0000","last_unstale":"2024-09-12T02:06:33.784493+0000","last_undegraded":"2024-09-12T02:06:33.784493+0000","last_fullsized":"2024-09-12T02:06:33.784493+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:18.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":200,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:03.953162+0000","last_change":"2024-09-12T00:26:23.344345+0000","last_active":"2024-09-12T02:03:03.953162+0000","last_peered":"2024-09-12T02:03:03.953162+0000","last_clean":"2024-09-12T02:03:03.953162+0000","last_became_active":"2024-09-12T00:26:23.338462+0000","last_became_peered":"2024-09-12T00:26:23.338462+0000","last_unstale":"2024-09-12T02:03:03.953162+0000","last_undegraded":"2024-09-12T02:03:03.953162+0000","last_fullsized":"2024-09-12T02:03:03.953162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:51.275824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":170,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738756+0000","last_change":"2024-09-12T01:00:24.077452+0000","last_active":"2024-09-12T02:03:23.738756+0000","last_peered":"2024-09-12T02:03:23.738756+0000","last_clean":"2024-09-12T02:03:23.738756+0000","last_became_active":"2024-09-12T01:00:24.070957+0000","last_became_peered":"2024-09-12T01:00:24.070957+0000","last_unstale":"2024-09-12T02:03:23.738756+0000","last_undegraded":"2024-09-12T02:03:23.738756+0000","last_fullsized":"2024-09-12T02:03:23.738756+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:02.724541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:39.005148+0000","last_change":"2024-09-12T00:32:21.665635+0000","last_active":"2024-09-12T02:06:39.005148+0000","last_peered":"2024-09-12T02:06:39.005148+0000","last_clean":"2024-09-12T02:06:39.005148+0000","last_became_active":"2024-09-12T00:32:21.665036+0000","last_became_peered":"2024-09-12T00:32:21.665036+0000","last_unstale":"2024-09-12T02:06:39.005148+0000","last_undegraded":"2024-09-12T02:06:39.005148+0000","last_fullsized":"2024-09-12T02:06:39.005148+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:03.207114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"266'2","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.642601+0000","last_change":"2024-09-12T02:07:14.642601+0000","last_active":"2024-09-12T02:07:14.642601+0000","last_peered":"2024-09-12T02:07:14.642601+0000","last_clean":"2024-09-12T02:07:14.642601+0000","last_became_active":"2024-09-12T00:32:14.597944+0000","last_became_peered":"2024-09-12T00:32:14.597944+0000","last_unstale":"2024-09-12T02:07:14.642601+0000","last_undegraded":"2024-09-12T02:07:14.642601+0000","last_fullsized":"2024-09-12T02:07:14.642601+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:14.642408+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:14.642408+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.642408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:49.542161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"266'38","reported_seq":175,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.604302+0000","last_change":"2024-09-12T02:07:15.604302+0000","last_active":"2024-09-12T02:07:15.604302+0000","last_peered":"2024-09-12T02:07:15.604302+0000","last_clean":"2024-09-12T02:07:15.604302+0000","last_became_active":"2024-09-12T00:26:23.317790+0000","last_became_peered":"2024-09-12T00:26:23.317790+0000","last_unstale":"2024-09-12T02:07:15.604302+0000","last_undegraded":"2024-09-12T02:07:15.604302+0000","last_fullsized":"2024-09-12T02:07:15.604302+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'38","last_scrub_stamp":"2024-09-12T02:07:15.604109+0000","last_deep_scrub":"266'38","last_deep_scrub_stamp":"2024-09-12T02:07:15.604109+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.604109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:50.183161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":107,"num_write":80,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:24.735210+0000","last_change":"2024-09-12T01:00:24.078191+0000","last_active":"2024-09-12T02:03:24.735210+0000","last_peered":"2024-09-12T02:03:24.735210+0000","last_clean":"2024-09-12T02:03:24.735210+0000","last_became_active":"2024-09-12T01:00:24.077509+0000","last_became_peered":"2024-09-12T01:00:24.077509+0000","last_unstale":"2024-09-12T02:03:24.735210+0000","last_undegraded":"2024-09-12T02:03:24.735210+0000","last_fullsized":"2024-09-12T02:03:24.735210+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:14.532459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"266'2","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:38.788301+0000","last_change":"2024-09-12T00:32:21.652772+0000","last_active":"2024-09-12T02:06:38.788301+0000","last_peered":"2024-09-12T02:06:38.788301+0000","last_clean":"2024-09-12T02:06:38.788301+0000","last_became_active":"2024-09-12T00:32:21.644753+0000","last_became_peered":"2024-09-12T00:32:21.644753+0000","last_unstale":"2024-09-12T02:06:38.788301+0000","last_undegraded":"2024-09-12T02:06:38.788301+0000","last_fullsized":"2024-09-12T02:06:38.788301+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:09.209891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:33.561239+0000","last_change":"2024-09-12T00:32:14.600221+0000","last_active":"2024-09-12T02:06:33.561239+0000","last_peered":"2024-09-12T02:06:33.561239+0000","last_clean":"2024-09-12T02:06:33.561239+0000","last_became_active":"2024-09-12T00:32:14.599452+0000","last_became_peered":"2024-09-12T00:32:14.599452+0000","last_unstale":"2024-09-12T02:06:33.561239+0000","last_undegraded":"2024-09-12T02:06:33.561239+0000","last_fullsized":"2024-09-12T02:06:33.561239+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:29.978923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"266'136","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:43.758592+0000","last_change":"2024-09-12T00:26:23.321368+0000","last_active":"2024-09-12T02:04:43.758592+0000","last_peered":"2024-09-12T02:04:43.758592+0000","last_clean":"2024-09-12T02:04:43.758592+0000","last_became_active":"2024-09-12T00:26:23.320613+0000","last_became_peered":"2024-09-12T00:26:23.320613+0000","last_unstale":"2024-09-12T02:04:43.758592+0000","last_undegraded":"2024-09-12T02:04:43.758592+0000","last_fullsized":"2024-09-12T02:04:43.758592+0000","mapping_epoch":253,"log_start":"263'100","ondisk_log_start":"263'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":872,"num_read_kb":592,"num_write":184,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956392+0000","last_change":"2024-09-12T01:00:24.061484+0000","last_active":"2024-09-12T02:03:13.956392+0000","last_peered":"2024-09-12T02:03:13.956392+0000","last_clean":"2024-09-12T02:03:13.956392+0000","last_became_active":"2024-09-12T01:00:24.060699+0000","last_became_peered":"2024-09-12T01:00:24.060699+0000","last_unstale":"2024-09-12T02:03:13.956392+0000","last_undegraded":"2024-09-12T02:03:13.956392+0000","last_fullsized":"2024-09-12T02:03:13.956392+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:39.025638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.582613+0000","last_change":"2024-09-12T02:07:29.582613+0000","last_active":"2024-09-12T02:07:29.582613+0000","last_peered":"2024-09-12T02:07:29.582613+0000","last_clean":"2024-09-12T02:07:29.582613+0000","last_became_active":"2024-09-12T00:32:21.652122+0000","last_became_peered":"2024-09-12T00:32:21.652122+0000","last_unstale":"2024-09-12T02:07:29.582613+0000","last_undegraded":"2024-09-12T02:07:29.582613+0000","last_fullsized":"2024-09-12T02:07:29.582613+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:29.582419+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:29.582419+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:16.256601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"266'7","reported_seq":90,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.088721+0000","last_change":"2024-09-12T02:07:31.088721+0000","last_active":"2024-09-12T02:07:31.088721+0000","last_peered":"2024-09-12T02:07:31.088721+0000","last_clean":"2024-09-12T02:07:31.088721+0000","last_became_active":"2024-09-12T00:32:14.591921+0000","last_became_peered":"2024-09-12T00:32:14.591921+0000","last_unstale":"2024-09-12T02:07:31.088721+0000","last_undegraded":"2024-09-12T02:07:31.088721+0000","last_fullsized":"2024-09-12T02:07:31.088721+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T02:07:31.088545+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T02:07:31.088545+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.088545+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:31.900675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3114,"num_write":12,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"266'28","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.849349+0000","last_change":"2024-09-12T02:07:31.849349+0000","last_active":"2024-09-12T02:07:31.849349+0000","last_peered":"2024-09-12T02:07:31.849349+0000","last_clean":"2024-09-12T02:07:31.849349+0000","last_became_active":"2024-09-12T00:26:23.322866+0000","last_became_peered":"2024-09-12T00:26:23.322866+0000","last_unstale":"2024-09-12T02:07:31.849349+0000","last_undegraded":"2024-09-12T02:07:31.849349+0000","last_fullsized":"2024-09-12T02:07:31.849349+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'28","last_scrub_stamp":"2024-09-12T02:07:31.849167+0000","last_deep_scrub":"266'28","last_deep_scrub_stamp":"2024-09-12T02:07:31.849167+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.849167+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:56.195167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.727306+0000","last_change":"2024-09-12T01:00:24.064920+0000","last_active":"2024-09-12T02:03:13.727306+0000","last_peered":"2024-09-12T02:03:13.727306+0000","last_clean":"2024-09-12T02:03:13.727306+0000","last_became_active":"2024-09-12T01:00:24.064203+0000","last_became_peered":"2024-09-12T01:00:24.064203+0000","last_unstale":"2024-09-12T02:03:13.727306+0000","last_undegraded":"2024-09-12T02:03:13.727306+0000","last_fullsized":"2024-09-12T02:03:13.727306+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:14.355731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"266'7","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.600714+0000","last_change":"2024-09-12T02:07:30.600714+0000","last_active":"2024-09-12T02:07:30.600714+0000","last_peered":"2024-09-12T02:07:30.600714+0000","last_clean":"2024-09-12T02:07:30.600714+0000","last_became_active":"2024-09-12T00:32:21.659437+0000","last_became_peered":"2024-09-12T00:32:21.659437+0000","last_unstale":"2024-09-12T02:07:30.600714+0000","last_undegraded":"2024-09-12T02:07:30.600714+0000","last_fullsized":"2024-09-12T02:07:30.600714+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T02:07:30.600531+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T02:07:30.600531+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.600531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:40.120724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":12,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"266'9","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:33.990232+0000","last_change":"2024-09-12T00:32:14.599370+0000","last_active":"2024-09-12T02:05:33.990232+0000","last_peered":"2024-09-12T02:05:33.990232+0000","last_clean":"2024-09-12T02:05:33.990232+0000","last_became_active":"2024-09-12T00:32:14.597986+0000","last_became_peered":"2024-09-12T00:32:14.597986+0000","last_unstale":"2024-09-12T02:05:33.990232+0000","last_undegraded":"2024-09-12T02:05:33.990232+0000","last_fullsized":"2024-09-12T02:05:33.990232+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:36.841276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"266'46","reported_seq":207,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.510217+0000","last_change":"2024-09-12T02:07:33.510217+0000","last_active":"2024-09-12T02:07:33.510217+0000","last_peered":"2024-09-12T02:07:33.510217+0000","last_clean":"2024-09-12T02:07:33.510217+0000","last_became_active":"2024-09-12T00:26:23.336010+0000","last_became_peered":"2024-09-12T00:26:23.336010+0000","last_unstale":"2024-09-12T02:07:33.510217+0000","last_undegraded":"2024-09-12T02:07:33.510217+0000","last_fullsized":"2024-09-12T02:07:33.510217+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'46","last_scrub_stamp":"2024-09-12T02:07:33.510010+0000","last_deep_scrub":"266'46","last_deep_scrub_stamp":"2024-09-12T02:07:33.510010+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.510010+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:50.663625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.523057+0000","last_change":"2024-09-12T01:00:24.074232+0000","last_active":"2024-09-12T02:03:43.523057+0000","last_peered":"2024-09-12T02:03:43.523057+0000","last_clean":"2024-09-12T02:03:43.523057+0000","last_became_active":"2024-09-12T01:00:24.061624+0000","last_became_peered":"2024-09-12T01:00:24.061624+0000","last_unstale":"2024-09-12T02:03:43.523057+0000","last_undegraded":"2024-09-12T02:03:43.523057+0000","last_fullsized":"2024-09-12T02:03:43.523057+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:30.381075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'7","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959211+0000","last_change":"2024-09-12T00:32:21.667593+0000","last_active":"2024-09-12T02:03:23.959211+0000","last_peered":"2024-09-12T02:03:23.959211+0000","last_clean":"2024-09-12T02:03:23.959211+0000","last_became_active":"2024-09-12T00:32:21.666101+0000","last_became_peered":"2024-09-12T00:32:21.666101+0000","last_unstale":"2024-09-12T02:03:23.959211+0000","last_undegraded":"2024-09-12T02:03:23.959211+0000","last_fullsized":"2024-09-12T02:03:23.959211+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:18.302518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3603,"num_write":12,"num_write_kb":1553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"266'3","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.145297+0000","last_change":"2024-09-12T02:07:25.145297+0000","last_active":"2024-09-12T02:07:25.145297+0000","last_peered":"2024-09-12T02:07:25.145297+0000","last_clean":"2024-09-12T02:07:25.145297+0000","last_became_active":"2024-09-12T00:32:14.579366+0000","last_became_peered":"2024-09-12T00:32:14.579366+0000","last_unstale":"2024-09-12T02:07:25.145297+0000","last_undegraded":"2024-09-12T02:07:25.145297+0000","last_fullsized":"2024-09-12T02:07:25.145297+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:07:25.145121+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:07:25.145121+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.145121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:45.409885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'8","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.757917+0000","last_change":"2024-09-12T00:26:23.323680+0000","last_active":"2024-09-12T02:04:23.757917+0000","last_peered":"2024-09-12T02:04:23.757917+0000","last_clean":"2024-09-12T02:04:23.757917+0000","last_became_active":"2024-09-12T00:26:23.322841+0000","last_became_peered":"2024-09-12T00:26:23.322841+0000","last_unstale":"2024-09-12T02:04:23.757917+0000","last_undegraded":"2024-09-12T02:04:23.757917+0000","last_fullsized":"2024-09-12T02:04:23.757917+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.099803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956312+0000","last_change":"2024-09-12T01:00:24.060507+0000","last_active":"2024-09-12T02:03:13.956312+0000","last_peered":"2024-09-12T02:03:13.956312+0000","last_clean":"2024-09-12T02:03:13.956312+0000","last_became_active":"2024-09-12T01:00:24.057061+0000","last_became_peered":"2024-09-12T01:00:24.057061+0000","last_unstale":"2024-09-12T02:03:13.956312+0000","last_undegraded":"2024-09-12T02:03:13.956312+0000","last_fullsized":"2024-09-12T02:03:13.956312+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:07.370347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"266'6","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.089539+0000","last_change":"2024-09-12T02:07:27.089539+0000","last_active":"2024-09-12T02:07:27.089539+0000","last_peered":"2024-09-12T02:07:27.089539+0000","last_clean":"2024-09-12T02:07:27.089539+0000","last_became_active":"2024-09-12T00:32:21.646690+0000","last_became_peered":"2024-09-12T00:32:21.646690+0000","last_unstale":"2024-09-12T02:07:27.089539+0000","last_undegraded":"2024-09-12T02:07:27.089539+0000","last_fullsized":"2024-09-12T02:07:27.089539+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T02:07:27.089348+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T02:07:27.089348+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.089348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:05.354347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2096,"num_write":6,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.744231+0000","last_change":"2024-09-12T02:07:34.744231+0000","last_active":"2024-09-12T02:07:34.744231+0000","last_peered":"2024-09-12T02:07:34.744231+0000","last_clean":"2024-09-12T02:07:34.744231+0000","last_became_active":"2024-09-12T00:32:14.576353+0000","last_became_peered":"2024-09-12T00:32:14.576353+0000","last_unstale":"2024-09-12T02:07:34.744231+0000","last_undegraded":"2024-09-12T02:07:34.744231+0000","last_fullsized":"2024-09-12T02:07:34.744231+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:34.744053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:34.744053+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.744053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:05.248712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"266'19","reported_seq":129,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:23.974634+0000","last_change":"2024-09-12T00:26:23.342320+0000","last_active":"2024-09-12T02:04:23.974634+0000","last_peered":"2024-09-12T02:04:23.974634+0000","last_clean":"2024-09-12T02:04:23.974634+0000","last_became_active":"2024-09-12T00:26:23.334078+0000","last_became_peered":"2024-09-12T00:26:23.334078+0000","last_unstale":"2024-09-12T02:04:23.974634+0000","last_undegraded":"2024-09-12T02:04:23.974634+0000","last_fullsized":"2024-09-12T02:04:23.974634+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.869261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":39,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.612766+0000","last_change":"2024-09-12T02:07:20.612766+0000","last_active":"2024-09-12T02:07:20.612766+0000","last_peered":"2024-09-12T02:07:20.612766+0000","last_clean":"2024-09-12T02:07:20.612766+0000","last_became_active":"2024-09-12T01:00:24.075944+0000","last_became_peered":"2024-09-12T01:00:24.075944+0000","last_unstale":"2024-09-12T02:07:20.612766+0000","last_undegraded":"2024-09-12T02:07:20.612766+0000","last_fullsized":"2024-09-12T02:07:20.612766+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:20.612542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:20.612542+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.612542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:41.556751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"266'4","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.077517+0000","last_change":"2024-09-12T00:32:21.653900+0000","last_active":"2024-09-12T02:06:46.077517+0000","last_peered":"2024-09-12T02:06:46.077517+0000","last_clean":"2024-09-12T02:06:46.077517+0000","last_became_active":"2024-09-12T00:32:21.653054+0000","last_became_peered":"2024-09-12T00:32:21.653054+0000","last_unstale":"2024-09-12T02:06:46.077517+0000","last_undegraded":"2024-09-12T02:06:46.077517+0000","last_fullsized":"2024-09-12T02:06:46.077517+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8207,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"266'10","reported_seq":91,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.035102+0000","last_change":"2024-09-12T00:32:14.597055+0000","last_active":"2024-09-12T02:06:45.035102+0000","last_peered":"2024-09-12T02:06:45.035102+0000","last_clean":"2024-09-12T02:06:45.035102+0000","last_became_active":"2024-09-12T00:32:14.596393+0000","last_became_peered":"2024-09-12T00:32:14.596393+0000","last_unstale":"2024-09-12T02:06:45.035102+0000","last_undegraded":"2024-09-12T02:06:45.035102+0000","last_fullsized":"2024-09-12T02:06:45.035102+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:35.143044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9234,"num_write":10,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"266'13","reported_seq":109,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959403+0000","last_change":"2024-09-12T00:26:23.354584+0000","last_active":"2024-09-12T02:03:23.959403+0000","last_peered":"2024-09-12T02:03:23.959403+0000","last_clean":"2024-09-12T02:03:23.959403+0000","last_became_active":"2024-09-12T00:26:23.353590+0000","last_became_peered":"2024-09-12T00:26:23.353590+0000","last_unstale":"2024-09-12T02:03:23.959403+0000","last_undegraded":"2024-09-12T02:03:23.959403+0000","last_fullsized":"2024-09-12T02:03:23.959403+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:36.184285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":34,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738884+0000","last_change":"2024-09-12T01:00:24.070343+0000","last_active":"2024-09-12T02:03:23.738884+0000","last_peered":"2024-09-12T02:03:23.738884+0000","last_clean":"2024-09-12T02:03:23.738884+0000","last_became_active":"2024-09-12T01:00:24.069491+0000","last_became_peered":"2024-09-12T01:00:24.069491+0000","last_unstale":"2024-09-12T02:03:23.738884+0000","last_undegraded":"2024-09-12T02:03:23.738884+0000","last_fullsized":"2024-09-12T02:03:23.738884+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:08.859472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:38.978838+0000","last_change":"2024-09-12T00:32:21.668898+0000","last_active":"2024-09-12T02:04:38.978838+0000","last_peered":"2024-09-12T02:04:38.978838+0000","last_clean":"2024-09-12T02:04:38.978838+0000","last_became_active":"2024-09-12T00:32:21.668268+0000","last_became_peered":"2024-09-12T00:32:21.668268+0000","last_unstale":"2024-09-12T02:04:38.978838+0000","last_undegraded":"2024-09-12T02:04:38.978838+0000","last_fullsized":"2024-09-12T02:04:38.978838+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"266'7","reported_seq":90,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.638164+0000","last_change":"2024-09-12T02:07:22.638164+0000","last_active":"2024-09-12T02:07:22.638164+0000","last_peered":"2024-09-12T02:07:22.638164+0000","last_clean":"2024-09-12T02:07:22.638164+0000","last_became_active":"2024-09-12T00:32:14.610187+0000","last_became_peered":"2024-09-12T00:32:14.610187+0000","last_unstale":"2024-09-12T02:07:22.638164+0000","last_undegraded":"2024-09-12T02:07:22.638164+0000","last_fullsized":"2024-09-12T02:07:22.638164+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T02:07:22.637960+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T02:07:22.637960+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.637960+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:41.204403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2577,"num_write":12,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.709990+0000","last_change":"2024-09-12T02:07:32.709990+0000","last_active":"2024-09-12T02:07:32.709990+0000","last_peered":"2024-09-12T02:07:32.709990+0000","last_clean":"2024-09-12T02:07:32.709990+0000","last_became_active":"2024-09-12T00:26:23.328238+0000","last_became_peered":"2024-09-12T00:26:23.328238+0000","last_unstale":"2024-09-12T02:07:32.709990+0000","last_undegraded":"2024-09-12T02:07:32.709990+0000","last_fullsized":"2024-09-12T02:07:32.709990+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:32.709812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:32.709812+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.709812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:20.834850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.064254+0000","last_change":"2024-09-12T02:07:29.064110+0000","last_active":"2024-09-12T02:07:29.064254+0000","last_peered":"2024-09-12T02:07:29.064254+0000","last_clean":"2024-09-12T02:07:29.064254+0000","last_became_active":"2024-09-12T01:00:24.074237+0000","last_became_peered":"2024-09-12T01:00:24.074237+0000","last_unstale":"2024-09-12T02:07:29.064254+0000","last_undegraded":"2024-09-12T02:07:29.064254+0000","last_fullsized":"2024-09-12T02:07:29.064254+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:29.063929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:29.063929+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.063929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:37.168116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.595430+0000","last_change":"2024-09-12T02:07:28.595430+0000","last_active":"2024-09-12T02:07:28.595430+0000","last_peered":"2024-09-12T02:07:28.595430+0000","last_clean":"2024-09-12T02:07:28.595430+0000","last_became_active":"2024-09-12T00:32:21.642517+0000","last_became_peered":"2024-09-12T00:32:21.642517+0000","last_unstale":"2024-09-12T02:07:28.595430+0000","last_undegraded":"2024-09-12T02:07:28.595430+0000","last_fullsized":"2024-09-12T02:07:28.595430+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:28.595242+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:28.595242+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.595242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:54.726633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.299857+0000","last_change":"2024-09-12T00:32:14.608254+0000","last_active":"2024-09-12T02:06:46.299857+0000","last_peered":"2024-09-12T02:06:46.299857+0000","last_clean":"2024-09-12T02:06:46.299857+0000","last_became_active":"2024-09-12T00:32:14.607520+0000","last_became_peered":"2024-09-12T00:32:14.607520+0000","last_unstale":"2024-09-12T02:06:46.299857+0000","last_undegraded":"2024-09-12T02:06:46.299857+0000","last_fullsized":"2024-09-12T02:06:46.299857+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:55.311964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"266'27","reported_seq":157,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.133881+0000","last_change":"2024-09-12T02:07:22.133881+0000","last_active":"2024-09-12T02:07:22.133881+0000","last_peered":"2024-09-12T02:07:22.133881+0000","last_clean":"2024-09-12T02:07:22.133881+0000","last_became_active":"2024-09-12T00:26:23.313697+0000","last_became_peered":"2024-09-12T00:26:23.313697+0000","last_unstale":"2024-09-12T02:07:22.133881+0000","last_undegraded":"2024-09-12T02:07:22.133881+0000","last_fullsized":"2024-09-12T02:07:22.133881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'27","last_scrub_stamp":"2024-09-12T02:07:22.133702+0000","last_deep_scrub":"266'27","last_deep_scrub_stamp":"2024-09-12T02:07:22.133702+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.133702+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:37.305108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.767788+0000","last_change":"2024-09-12T01:00:24.077672+0000","last_active":"2024-09-12T02:05:23.767788+0000","last_peered":"2024-09-12T02:05:23.767788+0000","last_clean":"2024-09-12T02:05:23.767788+0000","last_became_active":"2024-09-12T01:00:24.072931+0000","last_became_peered":"2024-09-12T01:00:24.072931+0000","last_unstale":"2024-09-12T02:05:23.767788+0000","last_undegraded":"2024-09-12T02:05:23.767788+0000","last_fullsized":"2024-09-12T02:05:23.767788+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.495060+0000","last_change":"2024-09-12T00:32:21.649878+0000","last_active":"2024-09-12T02:06:46.495060+0000","last_peered":"2024-09-12T02:06:46.495060+0000","last_clean":"2024-09-12T02:06:46.495060+0000","last_became_active":"2024-09-12T00:32:21.641431+0000","last_became_peered":"2024-09-12T00:32:21.641431+0000","last_unstale":"2024-09-12T02:06:46.495060+0000","last_undegraded":"2024-09-12T02:06:46.495060+0000","last_fullsized":"2024-09-12T02:06:46.495060+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20470,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.566676+0000","last_change":"2024-09-12T02:07:27.566676+0000","last_active":"2024-09-12T02:07:27.566676+0000","last_peered":"2024-09-12T02:07:27.566676+0000","last_clean":"2024-09-12T02:07:27.566676+0000","last_became_active":"2024-09-12T00:32:14.596263+0000","last_became_peered":"2024-09-12T00:32:14.596263+0000","last_unstale":"2024-09-12T02:07:27.566676+0000","last_undegraded":"2024-09-12T02:07:27.566676+0000","last_fullsized":"2024-09-12T02:07:27.566676+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:27.566497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:27.566497+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.566497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:36.193123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"266'66","reported_seq":273,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.604600+0000","last_change":"2024-09-12T02:07:23.604600+0000","last_active":"2024-09-12T02:07:23.604600+0000","last_peered":"2024-09-12T02:07:23.604600+0000","last_clean":"2024-09-12T02:07:23.604600+0000","last_became_active":"2024-09-12T00:26:23.327784+0000","last_became_peered":"2024-09-12T00:26:23.327784+0000","last_unstale":"2024-09-12T02:07:23.604600+0000","last_undegraded":"2024-09-12T02:07:23.604600+0000","last_fullsized":"2024-09-12T02:07:23.604600+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'66","last_scrub_stamp":"2024-09-12T02:07:23.604415+0000","last_deep_scrub":"266'66","last_deep_scrub_stamp":"2024-09-12T02:07:23.604415+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.604415+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:50.232583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":253,"num_write":117,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959347+0000","last_change":"2024-09-12T01:00:24.067841+0000","last_active":"2024-09-12T02:03:23.959347+0000","last_peered":"2024-09-12T02:03:23.959347+0000","last_clean":"2024-09-12T02:03:23.959347+0000","last_became_active":"2024-09-12T01:00:24.066842+0000","last_became_peered":"2024-09-12T01:00:24.066842+0000","last_unstale":"2024-09-12T02:03:23.959347+0000","last_undegraded":"2024-09-12T02:03:23.959347+0000","last_fullsized":"2024-09-12T02:03:23.959347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:36.376146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.744288+0000","last_change":"2024-09-12T00:32:21.667714+0000","last_active":"2024-09-12T02:03:23.744288+0000","last_peered":"2024-09-12T02:03:23.744288+0000","last_clean":"2024-09-12T02:03:23.744288+0000","last_became_active":"2024-09-12T00:32:21.667149+0000","last_became_peered":"2024-09-12T00:32:21.667149+0000","last_unstale":"2024-09-12T02:03:23.744288+0000","last_undegraded":"2024-09-12T02:03:23.744288+0000","last_fullsized":"2024-09-12T02:03:23.744288+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:34.141900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"266'3","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:28.547343+0000","last_change":"2024-09-12T00:32:14.601942+0000","last_active":"2024-09-12T02:05:28.547343+0000","last_peered":"2024-09-12T02:05:28.547343+0000","last_clean":"2024-09-12T02:05:28.547343+0000","last_became_active":"2024-09-12T00:32:14.601148+0000","last_became_peered":"2024-09-12T00:32:14.601148+0000","last_unstale":"2024-09-12T02:05:28.547343+0000","last_undegraded":"2024-09-12T02:05:28.547343+0000","last_fullsized":"2024-09-12T02:05:28.547343+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:16.003152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"266'39","reported_seq":190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.529036+0000","last_change":"2024-09-12T02:07:32.529036+0000","last_active":"2024-09-12T02:07:32.529036+0000","last_peered":"2024-09-12T02:07:32.529036+0000","last_clean":"2024-09-12T02:07:32.529036+0000","last_became_active":"2024-09-12T00:26:23.317880+0000","last_became_peered":"2024-09-12T00:26:23.317880+0000","last_unstale":"2024-09-12T02:07:32.529036+0000","last_undegraded":"2024-09-12T02:07:32.529036+0000","last_fullsized":"2024-09-12T02:07:32.529036+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'39","last_scrub_stamp":"2024-09-12T02:07:32.528820+0000","last_deep_scrub":"266'39","last_deep_scrub_stamp":"2024-09-12T02:07:32.528820+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.528820+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:00.224353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:38.742402+0000","last_change":"2024-09-12T01:00:24.086998+0000","last_active":"2024-09-12T02:03:38.742402+0000","last_peered":"2024-09-12T02:03:38.742402+0000","last_clean":"2024-09-12T02:03:38.742402+0000","last_became_active":"2024-09-12T01:00:24.086101+0000","last_became_peered":"2024-09-12T01:00:24.086101+0000","last_unstale":"2024-09-12T02:03:38.742402+0000","last_undegraded":"2024-09-12T02:03:38.742402+0000","last_fullsized":"2024-09-12T02:03:38.742402+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:22.433366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738790+0000","last_change":"2024-09-12T00:32:21.639641+0000","last_active":"2024-09-12T02:03:23.738790+0000","last_peered":"2024-09-12T02:03:23.738790+0000","last_clean":"2024-09-12T02:03:23.738790+0000","last_became_active":"2024-09-12T00:32:21.634440+0000","last_became_peered":"2024-09-12T00:32:21.634440+0000","last_unstale":"2024-09-12T02:03:23.738790+0000","last_undegraded":"2024-09-12T02:03:23.738790+0000","last_fullsized":"2024-09-12T02:03:23.738790+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:52.190306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.554839+0000","last_change":"2024-09-12T02:07:23.554546+0000","last_active":"2024-09-12T02:07:23.554839+0000","last_peered":"2024-09-12T02:07:23.554839+0000","last_clean":"2024-09-12T02:07:23.554839+0000","last_became_active":"2024-09-12T00:32:14.595782+0000","last_became_peered":"2024-09-12T00:32:14.595782+0000","last_unstale":"2024-09-12T02:07:23.554839+0000","last_undegraded":"2024-09-12T02:07:23.554839+0000","last_fullsized":"2024-09-12T02:07:23.554839+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T02:07:23.554267+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T02:07:23.554267+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.554267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:11.127050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":173,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.803187+0000","last_change":"2024-09-12T02:07:30.803187+0000","last_active":"2024-09-12T02:07:30.803187+0000","last_peered":"2024-09-12T02:07:30.803187+0000","last_clean":"2024-09-12T02:07:30.803187+0000","last_became_active":"2024-09-12T00:26:23.324140+0000","last_became_peered":"2024-09-12T00:26:23.324140+0000","last_unstale":"2024-09-12T02:07:30.803187+0000","last_undegraded":"2024-09-12T02:07:30.803187+0000","last_fullsized":"2024-09-12T02:07:30.803187+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T02:07:30.802991+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T02:07:30.802991+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.802991+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:52.322242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":114,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.738926+0000","last_change":"2024-09-12T01:00:24.081545+0000","last_active":"2024-09-12T02:03:23.738926+0000","last_peered":"2024-09-12T02:03:23.738926+0000","last_clean":"2024-09-12T02:03:23.738926+0000","last_became_active":"2024-09-12T01:00:24.080855+0000","last_became_peered":"2024-09-12T01:00:24.080855+0000","last_unstale":"2024-09-12T02:03:23.738926+0000","last_undegraded":"2024-09-12T02:03:23.738926+0000","last_fullsized":"2024-09-12T02:03:23.738926+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:06.572347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'4","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.616543+0000","last_change":"2024-09-12T02:07:31.616543+0000","last_active":"2024-09-12T02:07:31.616543+0000","last_peered":"2024-09-12T02:07:31.616543+0000","last_clean":"2024-09-12T02:07:31.616543+0000","last_became_active":"2024-09-12T00:32:21.648333+0000","last_became_peered":"2024-09-12T00:32:21.648333+0000","last_unstale":"2024-09-12T02:07:31.616543+0000","last_undegraded":"2024-09-12T02:07:31.616543+0000","last_fullsized":"2024-09-12T02:07:31.616543+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T02:07:31.616358+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T02:07:31.616358+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.616358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:20.964624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"266'4","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.770058+0000","last_change":"2024-09-12T00:32:14.600607+0000","last_active":"2024-09-12T02:06:45.770058+0000","last_peered":"2024-09-12T02:06:45.770058+0000","last_clean":"2024-09-12T02:06:45.770058+0000","last_became_active":"2024-09-12T00:32:14.592875+0000","last_became_peered":"2024-09-12T00:32:14.592875+0000","last_unstale":"2024-09-12T02:06:45.770058+0000","last_undegraded":"2024-09-12T02:06:45.770058+0000","last_fullsized":"2024-09-12T02:06:45.770058+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:09.233319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"266'15","reported_seq":126,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.982261+0000","last_change":"2024-09-12T02:07:29.982261+0000","last_active":"2024-09-12T02:07:29.982261+0000","last_peered":"2024-09-12T02:07:29.982261+0000","last_clean":"2024-09-12T02:07:29.982261+0000","last_became_active":"2024-09-12T00:26:23.324884+0000","last_became_peered":"2024-09-12T00:26:23.324884+0000","last_unstale":"2024-09-12T02:07:29.982261+0000","last_undegraded":"2024-09-12T02:07:29.982261+0000","last_fullsized":"2024-09-12T02:07:29.982261+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'15","last_scrub_stamp":"2024-09-12T02:07:29.982054+0000","last_deep_scrub":"266'15","last_deep_scrub_stamp":"2024-09-12T02:07:29.982054+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.982054+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:20.636440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.517888+0000","last_change":"2024-09-12T01:00:24.062624+0000","last_active":"2024-09-12T02:03:23.517888+0000","last_peered":"2024-09-12T02:03:23.517888+0000","last_clean":"2024-09-12T02:03:23.517888+0000","last_became_active":"2024-09-12T01:00:24.061882+0000","last_became_peered":"2024-09-12T01:00:24.061882+0000","last_unstale":"2024-09-12T02:03:23.517888+0000","last_undegraded":"2024-09-12T02:03:23.517888+0000","last_fullsized":"2024-09-12T02:03:23.517888+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:52.723554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'4","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:43.743502+0000","last_change":"2024-09-12T00:32:21.668310+0000","last_active":"2024-09-12T02:03:43.743502+0000","last_peered":"2024-09-12T02:03:43.743502+0000","last_clean":"2024-09-12T02:03:43.743502+0000","last_became_active":"2024-09-12T00:32:21.667346+0000","last_became_peered":"2024-09-12T00:32:21.667346+0000","last_unstale":"2024-09-12T02:03:43.743502+0000","last_undegraded":"2024-09-12T02:03:43.743502+0000","last_fullsized":"2024-09-12T02:03:43.743502+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:33.558216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"266'9","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.262602+0000","last_change":"2024-09-12T00:32:14.577757+0000","last_active":"2024-09-12T02:06:47.262602+0000","last_peered":"2024-09-12T02:06:47.262602+0000","last_clean":"2024-09-12T02:06:47.262602+0000","last_became_active":"2024-09-12T00:32:14.576974+0000","last_became_peered":"2024-09-12T00:32:14.576974+0000","last_unstale":"2024-09-12T02:06:47.262602+0000","last_undegraded":"2024-09-12T02:06:47.262602+0000","last_fullsized":"2024-09-12T02:06:47.262602+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:03.910967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4127,"num_write":14,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"266'52","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.133235+0000","last_change":"2024-09-12T02:07:21.133235+0000","last_active":"2024-09-12T02:07:21.133235+0000","last_peered":"2024-09-12T02:07:21.133235+0000","last_clean":"2024-09-12T02:07:21.133235+0000","last_became_active":"2024-09-12T00:26:23.315633+0000","last_became_peered":"2024-09-12T00:26:23.315633+0000","last_unstale":"2024-09-12T02:07:21.133235+0000","last_undegraded":"2024-09-12T02:07:21.133235+0000","last_fullsized":"2024-09-12T02:07:21.133235+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'52","last_scrub_stamp":"2024-09-12T02:07:21.133042+0000","last_deep_scrub":"266'52","last_deep_scrub_stamp":"2024-09-12T02:07:21.133042+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.133042+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:25.001126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":203,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.762162+0000","last_change":"2024-09-12T01:00:24.080426+0000","last_active":"2024-09-12T02:04:58.762162+0000","last_peered":"2024-09-12T02:04:58.762162+0000","last_clean":"2024-09-12T02:04:58.762162+0000","last_became_active":"2024-09-12T01:00:24.079834+0000","last_became_peered":"2024-09-12T01:00:24.079834+0000","last_unstale":"2024-09-12T02:04:58.762162+0000","last_undegraded":"2024-09-12T02:04:58.762162+0000","last_fullsized":"2024-09-12T02:04:58.762162+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.535089+0000","last_change":"2024-09-12T00:32:21.664365+0000","last_active":"2024-09-12T02:04:33.535089+0000","last_peered":"2024-09-12T02:04:33.535089+0000","last_clean":"2024-09-12T02:04:33.535089+0000","last_became_active":"2024-09-12T00:32:21.663547+0000","last_became_peered":"2024-09-12T00:32:21.663547+0000","last_unstale":"2024-09-12T02:04:33.535089+0000","last_undegraded":"2024-09-12T02:04:33.535089+0000","last_fullsized":"2024-09-12T02:04:33.535089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:42.840209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:58.747512+0000","last_change":"2024-09-12T00:32:14.596240+0000","last_active":"2024-09-12T02:03:58.747512+0000","last_peered":"2024-09-12T02:03:58.747512+0000","last_clean":"2024-09-12T02:03:58.747512+0000","last_became_active":"2024-09-12T00:32:14.593670+0000","last_became_peered":"2024-09-12T00:32:14.593670+0000","last_unstale":"2024-09-12T02:03:58.747512+0000","last_undegraded":"2024-09-12T02:03:58.747512+0000","last_fullsized":"2024-09-12T02:03:58.747512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:01.077637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'28","reported_seq":156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:53.525498+0000","last_change":"2024-09-12T00:26:23.350883+0000","last_active":"2024-09-12T02:03:53.525498+0000","last_peered":"2024-09-12T02:03:53.525498+0000","last_clean":"2024-09-12T02:03:53.525498+0000","last_became_active":"2024-09-12T00:26:23.338248+0000","last_became_peered":"2024-09-12T00:26:23.338248+0000","last_unstale":"2024-09-12T02:03:53.525498+0000","last_undegraded":"2024-09-12T02:03:53.525498+0000","last_fullsized":"2024-09-12T02:03:53.525498+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:22.274372+0000","last_clean_scrub_stamp":"2024-09-12T00:26:22.274372+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:58.473095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.757503+0000","last_change":"2024-09-12T01:00:24.077369+0000","last_active":"2024-09-12T02:04:59.757503+0000","last_peered":"2024-09-12T02:04:59.757503+0000","last_clean":"2024-09-12T02:04:59.757503+0000","last_became_active":"2024-09-12T01:00:24.068145+0000","last_became_peered":"2024-09-12T01:00:24.068145+0000","last_unstale":"2024-09-12T02:04:59.757503+0000","last_undegraded":"2024-09-12T02:04:59.757503+0000","last_fullsized":"2024-09-12T02:04:59.757503+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:03.527728+0000","last_change":"2024-09-12T00:32:21.674579+0000","last_active":"2024-09-12T02:04:03.527728+0000","last_peered":"2024-09-12T02:04:03.527728+0000","last_clean":"2024-09-12T02:04:03.527728+0000","last_became_active":"2024-09-12T00:32:21.668979+0000","last_became_peered":"2024-09-12T00:32:21.668979+0000","last_unstale":"2024-09-12T02:04:03.527728+0000","last_undegraded":"2024-09-12T02:04:03.527728+0000","last_fullsized":"2024-09-12T02:04:03.527728+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:43.618228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.568449+0000","last_change":"2024-09-12T02:07:18.568449+0000","last_active":"2024-09-12T02:07:18.568449+0000","last_peered":"2024-09-12T02:07:18.568449+0000","last_clean":"2024-09-12T02:07:18.568449+0000","last_became_active":"2024-09-12T00:32:14.610414+0000","last_became_peered":"2024-09-12T00:32:14.610414+0000","last_unstale":"2024-09-12T02:07:18.568449+0000","last_undegraded":"2024-09-12T02:07:18.568449+0000","last_fullsized":"2024-09-12T02:07:18.568449+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:18.568255+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:18.568255+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.568255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:36.781285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"266'33","reported_seq":176,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.127247+0000","last_change":"2024-09-12T02:07:20.127247+0000","last_active":"2024-09-12T02:07:20.127247+0000","last_peered":"2024-09-12T02:07:20.127247+0000","last_clean":"2024-09-12T02:07:20.127247+0000","last_became_active":"2024-09-12T00:26:23.327296+0000","last_became_peered":"2024-09-12T00:26:23.327296+0000","last_unstale":"2024-09-12T02:07:20.127247+0000","last_undegraded":"2024-09-12T02:07:20.127247+0000","last_fullsized":"2024-09-12T02:07:20.127247+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T02:07:20.127030+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T02:07:20.127030+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.127030+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:58.191456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.644535+0000","last_change":"2024-09-12T02:07:33.644535+0000","last_active":"2024-09-12T02:07:33.644535+0000","last_peered":"2024-09-12T02:07:33.644535+0000","last_clean":"2024-09-12T02:07:33.644535+0000","last_became_active":"2024-09-12T01:00:24.067665+0000","last_became_peered":"2024-09-12T01:00:24.067665+0000","last_unstale":"2024-09-12T02:07:33.644535+0000","last_undegraded":"2024-09-12T02:07:33.644535+0000","last_fullsized":"2024-09-12T02:07:33.644535+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:33.644363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:33.644363+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.644363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:33.974614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.739021+0000","last_change":"2024-09-12T00:32:21.645575+0000","last_active":"2024-09-12T02:03:23.739021+0000","last_peered":"2024-09-12T02:03:23.739021+0000","last_clean":"2024-09-12T02:03:23.739021+0000","last_became_active":"2024-09-12T00:32:21.644891+0000","last_became_peered":"2024-09-12T00:32:21.644891+0000","last_unstale":"2024-09-12T02:03:23.739021+0000","last_undegraded":"2024-09-12T02:03:23.739021+0000","last_fullsized":"2024-09-12T02:03:23.739021+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:34.537775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"266'2","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.658316+0000","last_change":"2024-09-12T00:32:14.599778+0000","last_active":"2024-09-12T02:06:45.658316+0000","last_peered":"2024-09-12T02:06:45.658316+0000","last_clean":"2024-09-12T02:06:45.658316+0000","last_became_active":"2024-09-12T00:32:14.598981+0000","last_became_peered":"2024-09-12T00:32:14.598981+0000","last_unstale":"2024-09-12T02:06:45.658316+0000","last_undegraded":"2024-09-12T02:06:45.658316+0000","last_fullsized":"2024-09-12T02:06:45.658316+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"266'25","reported_seq":160,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.824747+0000","last_change":"2024-09-12T02:07:29.824747+0000","last_active":"2024-09-12T02:07:29.824747+0000","last_peered":"2024-09-12T02:07:29.824747+0000","last_clean":"2024-09-12T02:07:29.824747+0000","last_became_active":"2024-09-12T00:26:23.316443+0000","last_became_peered":"2024-09-12T00:26:23.316443+0000","last_unstale":"2024-09-12T02:07:29.824747+0000","last_undegraded":"2024-09-12T02:07:29.824747+0000","last_fullsized":"2024-09-12T02:07:29.824747+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'25","last_scrub_stamp":"2024-09-12T02:07:29.824565+0000","last_deep_scrub":"266'25","last_deep_scrub_stamp":"2024-09-12T02:07:29.824565+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.824565+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:22.429912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":90,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.765981+0000","last_change":"2024-09-12T01:00:24.072339+0000","last_active":"2024-09-12T02:04:58.765981+0000","last_peered":"2024-09-12T02:04:58.765981+0000","last_clean":"2024-09-12T02:04:58.765981+0000","last_became_active":"2024-09-12T01:00:24.071428+0000","last_became_peered":"2024-09-12T01:00:24.071428+0000","last_unstale":"2024-09-12T02:04:58.765981+0000","last_undegraded":"2024-09-12T02:04:58.765981+0000","last_fullsized":"2024-09-12T02:04:58.765981+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"266'9","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:46.740844+0000","last_change":"2024-09-12T00:32:21.654444+0000","last_active":"2024-09-12T02:06:46.740844+0000","last_peered":"2024-09-12T02:06:46.740844+0000","last_clean":"2024-09-12T02:06:46.740844+0000","last_became_active":"2024-09-12T00:32:21.653749+0000","last_became_peered":"2024-09-12T00:32:21.653749+0000","last_unstale":"2024-09-12T02:06:46.740844+0000","last_undegraded":"2024-09-12T02:06:46.740844+0000","last_fullsized":"2024-09-12T02:06:46.740844+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:33.575071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:18.737749+0000","last_change":"2024-09-12T00:32:14.597114+0000","last_active":"2024-09-12T02:03:18.737749+0000","last_peered":"2024-09-12T02:03:18.737749+0000","last_clean":"2024-09-12T02:03:18.737749+0000","last_became_active":"2024-09-12T00:32:14.596498+0000","last_became_peered":"2024-09-12T00:32:14.596498+0000","last_unstale":"2024-09-12T02:03:18.737749+0000","last_undegraded":"2024-09-12T02:03:18.737749+0000","last_fullsized":"2024-09-12T02:03:18.737749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:03.408422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"266'50","reported_seq":226,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.528784+0000","last_change":"2024-09-12T02:07:24.528784+0000","last_active":"2024-09-12T02:07:24.528784+0000","last_peered":"2024-09-12T02:07:24.528784+0000","last_clean":"2024-09-12T02:07:24.528784+0000","last_became_active":"2024-09-12T00:26:23.340608+0000","last_became_peered":"2024-09-12T00:26:23.340608+0000","last_unstale":"2024-09-12T02:07:24.528784+0000","last_undegraded":"2024-09-12T02:07:24.528784+0000","last_fullsized":"2024-09-12T02:07:24.528784+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'50","last_scrub_stamp":"2024-09-12T02:07:24.528600+0000","last_deep_scrub":"266'50","last_deep_scrub_stamp":"2024-09-12T02:07:24.528600+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.528600+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.621123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":178,"num_write":83,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'2","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.587035+0000","last_change":"2024-09-12T02:07:17.586891+0000","last_active":"2024-09-12T02:07:17.587035+0000","last_peered":"2024-09-12T02:07:17.587035+0000","last_clean":"2024-09-12T02:07:17.587035+0000","last_became_active":"2024-09-12T01:00:24.083260+0000","last_became_peered":"2024-09-12T01:00:24.083260+0000","last_unstale":"2024-09-12T02:07:17.587035+0000","last_undegraded":"2024-09-12T02:07:17.587035+0000","last_fullsized":"2024-09-12T02:07:17.587035+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:17.586703+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:17.586703+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.586703+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:52.599255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"266'9","reported_seq":94,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.522415+0000","last_change":"2024-09-12T02:07:26.522415+0000","last_active":"2024-09-12T02:07:26.522415+0000","last_peered":"2024-09-12T02:07:26.522415+0000","last_clean":"2024-09-12T02:07:26.522415+0000","last_became_active":"2024-09-12T00:32:21.655849+0000","last_became_peered":"2024-09-12T00:32:21.655849+0000","last_unstale":"2024-09-12T02:07:26.522415+0000","last_undegraded":"2024-09-12T02:07:26.522415+0000","last_fullsized":"2024-09-12T02:07:26.522415+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:26.522238+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:26.522238+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.522238+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:41.615137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15358,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.838345+0000","last_change":"2024-09-12T02:07:32.838345+0000","last_active":"2024-09-12T02:07:32.838345+0000","last_peered":"2024-09-12T02:07:32.838345+0000","last_clean":"2024-09-12T02:07:32.838345+0000","last_became_active":"2024-09-12T00:32:14.604519+0000","last_became_peered":"2024-09-12T00:32:14.604519+0000","last_unstale":"2024-09-12T02:07:32.838345+0000","last_undegraded":"2024-09-12T02:07:32.838345+0000","last_fullsized":"2024-09-12T02:07:32.838345+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:32.838163+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:32.838163+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.838163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:04.803343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.655363+0000","last_change":"2024-09-12T02:07:30.655363+0000","last_active":"2024-09-12T02:07:30.655363+0000","last_peered":"2024-09-12T02:07:30.655363+0000","last_clean":"2024-09-12T02:07:30.655363+0000","last_became_active":"2024-09-12T00:26:23.328187+0000","last_became_peered":"2024-09-12T00:26:23.328187+0000","last_unstale":"2024-09-12T02:07:30.655363+0000","last_undegraded":"2024-09-12T02:07:30.655363+0000","last_fullsized":"2024-09-12T02:07:30.655363+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T02:07:30.655180+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T02:07:30.655180+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.655180+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:13.153302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":91,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:23.546753+0000","last_change":"2024-09-12T01:00:24.063315+0000","last_active":"2024-09-12T02:05:23.546753+0000","last_peered":"2024-09-12T02:05:23.546753+0000","last_clean":"2024-09-12T02:05:23.546753+0000","last_became_active":"2024-09-12T01:00:24.062597+0000","last_became_peered":"2024-09-12T01:00:24.062597+0000","last_unstale":"2024-09-12T02:05:23.546753+0000","last_undegraded":"2024-09-12T02:05:23.546753+0000","last_fullsized":"2024-09-12T02:05:23.546753+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:34.751341+0000","last_change":"2024-09-12T00:32:21.646859+0000","last_active":"2024-09-12T02:04:34.751341+0000","last_peered":"2024-09-12T02:04:34.751341+0000","last_clean":"2024-09-12T02:04:34.751341+0000","last_became_active":"2024-09-12T00:32:21.644950+0000","last_became_peered":"2024-09-12T00:32:21.644950+0000","last_unstale":"2024-09-12T02:04:34.751341+0000","last_undegraded":"2024-09-12T02:04:34.751341+0000","last_fullsized":"2024-09-12T02:04:34.751341+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:04.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:03.777079+0000","last_change":"2024-09-12T00:32:14.598048+0000","last_active":"2024-09-12T02:06:03.777079+0000","last_peered":"2024-09-12T02:06:03.777079+0000","last_clean":"2024-09-12T02:06:03.777079+0000","last_became_active":"2024-09-12T00:32:14.597376+0000","last_became_peered":"2024-09-12T00:32:14.597376+0000","last_unstale":"2024-09-12T02:06:03.777079+0000","last_undegraded":"2024-09-12T02:06:03.777079+0000","last_fullsized":"2024-09-12T02:06:03.777079+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:13.543194+0000","last_clean_scrub_stamp":"2024-09-12T00:32:13.543194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:44.028314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"266'77","reported_seq":305,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.110227+0000","last_change":"2024-09-12T02:07:29.110227+0000","last_active":"2024-09-12T02:07:29.110227+0000","last_peered":"2024-09-12T02:07:29.110227+0000","last_clean":"2024-09-12T02:07:29.110227+0000","last_became_active":"2024-09-12T00:26:23.338274+0000","last_became_peered":"2024-09-12T00:26:23.338274+0000","last_unstale":"2024-09-12T02:07:29.110227+0000","last_undegraded":"2024-09-12T02:07:29.110227+0000","last_fullsized":"2024-09-12T02:07:29.110227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'77","last_scrub_stamp":"2024-09-12T02:07:29.110050+0000","last_deep_scrub":"266'77","last_deep_scrub_stamp":"2024-09-12T02:07:29.110050+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.110050+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:17.917808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":296,"num_write":117,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:58.541693+0000","last_change":"2024-09-12T01:00:24.054473+0000","last_active":"2024-09-12T02:04:58.541693+0000","last_peered":"2024-09-12T02:04:58.541693+0000","last_clean":"2024-09-12T02:04:58.541693+0000","last_became_active":"2024-09-12T01:00:24.053408+0000","last_became_peered":"2024-09-12T01:00:24.053408+0000","last_unstale":"2024-09-12T02:04:58.541693+0000","last_undegraded":"2024-09-12T02:04:58.541693+0000","last_fullsized":"2024-09-12T02:04:58.541693+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.131404+0000","last_change":"2024-09-12T02:07:26.131404+0000","last_active":"2024-09-12T02:07:26.131404+0000","last_peered":"2024-09-12T02:07:26.131404+0000","last_clean":"2024-09-12T02:07:26.131404+0000","last_became_active":"2024-09-12T00:32:33.790018+0000","last_became_peered":"2024-09-12T00:32:33.790018+0000","last_unstale":"2024-09-12T02:07:26.131404+0000","last_undegraded":"2024-09-12T02:07:26.131404+0000","last_fullsized":"2024-09-12T02:07:26.131404+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:26.131217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:26.131217+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.131217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:43.818640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.561731+0000","last_change":"2024-09-12T02:07:25.561731+0000","last_active":"2024-09-12T02:07:25.561731+0000","last_peered":"2024-09-12T02:07:25.561731+0000","last_clean":"2024-09-12T02:07:25.561731+0000","last_became_active":"2024-09-12T00:32:14.580350+0000","last_became_peered":"2024-09-12T00:32:14.580350+0000","last_unstale":"2024-09-12T02:07:25.561731+0000","last_undegraded":"2024-09-12T02:07:25.561731+0000","last_fullsized":"2024-09-12T02:07:25.561731+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.561549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.561549+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.561549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:44.815598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"266'23","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.156871+0000","last_change":"2024-09-12T02:07:19.156871+0000","last_active":"2024-09-12T02:07:19.156871+0000","last_peered":"2024-09-12T02:07:19.156871+0000","last_clean":"2024-09-12T02:07:19.156871+0000","last_became_active":"2024-09-12T00:26:23.318720+0000","last_became_peered":"2024-09-12T00:26:23.318720+0000","last_unstale":"2024-09-12T02:07:19.156871+0000","last_undegraded":"2024-09-12T02:07:19.156871+0000","last_fullsized":"2024-09-12T02:07:19.156871+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'23","last_scrub_stamp":"2024-09-12T02:07:19.156669+0000","last_deep_scrub":"266'23","last_deep_scrub_stamp":"2024-09-12T02:07:19.156669+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.156669+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:19.367324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:13.765648+0000","last_change":"2024-09-12T01:00:24.074486+0000","last_active":"2024-09-12T02:05:13.765648+0000","last_peered":"2024-09-12T02:05:13.765648+0000","last_clean":"2024-09-12T02:05:13.765648+0000","last_became_active":"2024-09-12T01:00:24.072773+0000","last_became_peered":"2024-09-12T01:00:24.072773+0000","last_unstale":"2024-09-12T02:05:13.765648+0000","last_undegraded":"2024-09-12T02:05:13.765648+0000","last_fullsized":"2024-09-12T02:05:13.765648+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"266'8","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:45.466415+0000","last_change":"2024-09-12T00:32:21.644007+0000","last_active":"2024-09-12T02:06:45.466415+0000","last_peered":"2024-09-12T02:06:45.466415+0000","last_clean":"2024-09-12T02:06:45.466415+0000","last_became_active":"2024-09-12T00:32:21.643272+0000","last_became_peered":"2024-09-12T00:32:21.643272+0000","last_unstale":"2024-09-12T02:06:45.466415+0000","last_undegraded":"2024-09-12T02:06:45.466415+0000","last_fullsized":"2024-09-12T02:06:45.466415+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:20.594235+0000","last_clean_scrub_stamp":"2024-09-12T00:32:20.594235+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:10.420621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":18,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.165654+0000","last_change":"2024-09-12T02:07:24.165654+0000","last_active":"2024-09-12T02:07:24.165654+0000","last_peered":"2024-09-12T02:07:24.165654+0000","last_clean":"2024-09-12T02:07:24.165654+0000","last_became_active":"2024-09-12T00:32:14.579278+0000","last_became_peered":"2024-09-12T00:32:14.579278+0000","last_unstale":"2024-09-12T02:07:24.165654+0000","last_undegraded":"2024-09-12T02:07:24.165654+0000","last_fullsized":"2024-09-12T02:07:24.165654+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.165470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.165470+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.165470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:02.815712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"266'19","reported_seq":145,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.838234+0000","last_change":"2024-09-12T02:07:27.838234+0000","last_active":"2024-09-12T02:07:27.838234+0000","last_peered":"2024-09-12T02:07:27.838234+0000","last_clean":"2024-09-12T02:07:27.838234+0000","last_became_active":"2024-09-12T00:26:23.306139+0000","last_became_peered":"2024-09-12T00:26:23.306139+0000","last_unstale":"2024-09-12T02:07:27.838234+0000","last_undegraded":"2024-09-12T02:07:27.838234+0000","last_fullsized":"2024-09-12T02:07:27.838234+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T02:07:27.838004+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T02:07:27.838004+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.838004+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:31.033055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"266'329","reported_seq":1082,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.791875+0000","last_change":"2024-09-12T02:07:06.791875+0000","last_active":"2024-09-12T02:07:06.791875+0000","last_peered":"2024-09-12T02:07:06.791875+0000","last_clean":"2024-09-12T02:07:06.791875+0000","last_became_active":"2024-09-12T00:09:59.316094+0000","last_became_peered":"2024-09-12T00:09:59.316094+0000","last_unstale":"2024-09-12T02:07:06.791875+0000","last_undegraded":"2024-09-12T02:07:06.791875+0000","last_fullsized":"2024-09-12T02:07:06.791875+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'329","last_scrub_stamp":"2024-09-12T02:07:06.791586+0000","last_deep_scrub":"266'329","last_deep_scrub_stamp":"2024-09-12T02:07:06.791586+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.791586+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:12.851892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441871,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":581,"num_read_kb":103153,"num_write":998,"num_write_kb":38551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"266'996","reported_seq":2787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.571015+0000","last_change":"2024-09-12T02:07:13.570879+0000","last_active":"2024-09-12T02:07:13.571015+0000","last_peered":"2024-09-12T02:07:13.571015+0000","last_clean":"2024-09-12T02:07:13.571015+0000","last_became_active":"2024-09-12T00:10:01.281465+0000","last_became_peered":"2024-09-12T00:10:01.281465+0000","last_unstale":"2024-09-12T02:07:13.571015+0000","last_undegraded":"2024-09-12T02:07:13.571015+0000","last_fullsized":"2024-09-12T02:07:13.571015+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'996","last_scrub_stamp":"2024-09-12T02:07:13.570650+0000","last_deep_scrub":"266'996","last_deep_scrub_stamp":"2024-09-12T02:07:13.570650+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.570650+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":900,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:50.111365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4736,"num_read_kb":4236,"num_write":1359,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"266'354","reported_seq":1056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.469755+0000","last_change":"2024-09-12T02:06:56.469755+0000","last_active":"2024-09-12T02:06:56.469755+0000","last_peered":"2024-09-12T02:06:56.469755+0000","last_clean":"2024-09-12T02:06:56.469755+0000","last_became_active":"2024-09-12T00:09:59.311178+0000","last_became_peered":"2024-09-12T00:09:59.311178+0000","last_unstale":"2024-09-12T02:06:56.469755+0000","last_undegraded":"2024-09-12T02:06:56.469755+0000","last_fullsized":"2024-09-12T02:06:56.469755+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'354","last_scrub_stamp":"2024-09-12T02:06:56.469492+0000","last_deep_scrub":"266'354","last_deep_scrub_stamp":"2024-09-12T02:06:56.469492+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.469492+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.533391+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399015,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":11355,"num_write":1177,"num_write_kb":19733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"266'878","reported_seq":2494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.857628+0000","last_change":"2024-09-12T02:07:10.857479+0000","last_active":"2024-09-12T02:07:10.857628+0000","last_peered":"2024-09-12T02:07:10.857628+0000","last_clean":"2024-09-12T02:07:10.857628+0000","last_became_active":"2024-09-12T00:10:01.268068+0000","last_became_peered":"2024-09-12T00:10:01.268068+0000","last_unstale":"2024-09-12T02:07:10.857628+0000","last_undegraded":"2024-09-12T02:07:10.857628+0000","last_fullsized":"2024-09-12T02:07:10.857628+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'878","last_scrub_stamp":"2024-09-12T02:07:10.857289+0000","last_deep_scrub":"266'878","last_deep_scrub_stamp":"2024-09-12T02:07:10.857289+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.857289+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:43.512649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4189,"num_read_kb":3768,"num_write":1161,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"266'376","reported_seq":1090,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.497550+0000","last_change":"2024-09-12T02:07:00.497550+0000","last_active":"2024-09-12T02:07:00.497550+0000","last_peered":"2024-09-12T02:07:00.497550+0000","last_clean":"2024-09-12T02:07:00.497550+0000","last_became_active":"2024-09-12T00:09:59.296557+0000","last_became_peered":"2024-09-12T00:09:59.296557+0000","last_unstale":"2024-09-12T02:07:00.497550+0000","last_undegraded":"2024-09-12T02:07:00.497550+0000","last_fullsized":"2024-09-12T02:07:00.497550+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'376","last_scrub_stamp":"2024-09-12T02:07:00.497323+0000","last_deep_scrub":"266'376","last_deep_scrub_stamp":"2024-09-12T02:07:00.497323+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.497323+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.306173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653297,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":575,"num_read_kb":57177,"num_write":1185,"num_write_kb":38522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1197","reported_seq":2918,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.068852+0000","last_change":"2024-09-12T02:07:13.068672+0000","last_active":"2024-09-12T02:07:13.068852+0000","last_peered":"2024-09-12T02:07:13.068852+0000","last_clean":"2024-09-12T02:07:13.068852+0000","last_became_active":"2024-09-12T00:10:01.251038+0000","last_became_peered":"2024-09-12T00:10:01.251038+0000","last_unstale":"2024-09-12T02:07:13.068852+0000","last_undegraded":"2024-09-12T02:07:13.068852+0000","last_fullsized":"2024-09-12T02:07:13.068852+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1197","last_scrub_stamp":"2024-09-12T02:07:13.068485+0000","last_deep_scrub":"266'1197","last_deep_scrub_stamp":"2024-09-12T02:07:13.068485+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.068485+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:34.941751+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5594,"num_read_kb":4965,"num_write":1641,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"266'307","reported_seq":964,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.585374+0000","last_change":"2024-09-12T02:07:06.585374+0000","last_active":"2024-09-12T02:07:06.585374+0000","last_peered":"2024-09-12T02:07:06.585374+0000","last_clean":"2024-09-12T02:07:06.585374+0000","last_became_active":"2024-09-12T00:09:59.278426+0000","last_became_peered":"2024-09-12T00:09:59.278426+0000","last_unstale":"2024-09-12T02:07:06.585374+0000","last_undegraded":"2024-09-12T02:07:06.585374+0000","last_fullsized":"2024-09-12T02:07:06.585374+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'307","last_scrub_stamp":"2024-09-12T02:07:06.585161+0000","last_deep_scrub":"266'307","last_deep_scrub_stamp":"2024-09-12T02:07:06.585161+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.585161+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:20.322727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":431,"num_read_kb":8612,"num_write":1021,"num_write_kb":32048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"266'443","reported_seq":1957,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.553617+0000","last_change":"2024-09-12T02:07:10.553353+0000","last_active":"2024-09-12T02:07:10.553617+0000","last_peered":"2024-09-12T02:07:10.553617+0000","last_clean":"2024-09-12T02:07:10.553617+0000","last_became_active":"2024-09-12T00:10:01.247807+0000","last_became_peered":"2024-09-12T00:10:01.247807+0000","last_unstale":"2024-09-12T02:07:10.553617+0000","last_undegraded":"2024-09-12T02:07:10.553617+0000","last_fullsized":"2024-09-12T02:07:10.553617+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'443","last_scrub_stamp":"2024-09-12T02:07:10.553061+0000","last_deep_scrub":"266'443","last_deep_scrub_stamp":"2024-09-12T02:07:10.553061+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.553061+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:25.618102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2317,"num_read_kb":2164,"num_write":517,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"266'312","reported_seq":1030,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.785609+0000","last_change":"2024-09-12T02:07:04.785461+0000","last_active":"2024-09-12T02:07:04.785609+0000","last_peered":"2024-09-12T02:07:04.785609+0000","last_clean":"2024-09-12T02:07:04.785609+0000","last_became_active":"2024-09-12T00:09:59.314222+0000","last_became_peered":"2024-09-12T00:09:59.314222+0000","last_unstale":"2024-09-12T02:07:04.785609+0000","last_undegraded":"2024-09-12T02:07:04.785609+0000","last_fullsized":"2024-09-12T02:07:04.785609+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'312","last_scrub_stamp":"2024-09-12T02:07:04.785112+0000","last_deep_scrub":"266'312","last_deep_scrub_stamp":"2024-09-12T02:07:04.785112+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.785112+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:19.854594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":10075,"num_write":947,"num_write_kb":41375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"266'517","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.092162+0000","last_change":"2024-09-12T02:07:05.092162+0000","last_active":"2024-09-12T02:07:05.092162+0000","last_peered":"2024-09-12T02:07:05.092162+0000","last_clean":"2024-09-12T02:07:05.092162+0000","last_became_active":"2024-09-12T00:10:01.256253+0000","last_became_peered":"2024-09-12T00:10:01.256253+0000","last_unstale":"2024-09-12T02:07:05.092162+0000","last_undegraded":"2024-09-12T02:07:05.092162+0000","last_fullsized":"2024-09-12T02:07:05.092162+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'517","last_scrub_stamp":"2024-09-12T02:07:05.091915+0000","last_deep_scrub":"266'517","last_deep_scrub_stamp":"2024-09-12T02:07:05.091915+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.091915+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:58.529971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2461,"num_read_kb":2278,"num_write":611,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"266'342","reported_seq":1005,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.574347+0000","last_change":"2024-09-12T02:07:05.574196+0000","last_active":"2024-09-12T02:07:05.574347+0000","last_peered":"2024-09-12T02:07:05.574347+0000","last_clean":"2024-09-12T02:07:05.574347+0000","last_became_active":"2024-09-12T00:09:59.297821+0000","last_became_peered":"2024-09-12T00:09:59.297821+0000","last_unstale":"2024-09-12T02:07:05.574347+0000","last_undegraded":"2024-09-12T02:07:05.574347+0000","last_fullsized":"2024-09-12T02:07:05.574347+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'342","last_scrub_stamp":"2024-09-12T02:07:05.573973+0000","last_deep_scrub":"266'342","last_deep_scrub_stamp":"2024-09-12T02:07:05.573973+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.573973+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:17.466383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":489,"num_read_kb":14780,"num_write":963,"num_write_kb":35747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"266'380","reported_seq":1853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.056835+0000","last_change":"2024-09-12T02:07:12.056835+0000","last_active":"2024-09-12T02:07:12.056835+0000","last_peered":"2024-09-12T02:07:12.056835+0000","last_clean":"2024-09-12T02:07:12.056835+0000","last_became_active":"2024-09-12T00:10:01.250663+0000","last_became_peered":"2024-09-12T00:10:01.250663+0000","last_unstale":"2024-09-12T02:07:12.056835+0000","last_undegraded":"2024-09-12T02:07:12.056835+0000","last_fullsized":"2024-09-12T02:07:12.056835+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T02:07:12.056652+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T02:07:12.056652+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.056652+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.942975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2078,"num_read_kb":1972,"num_write":422,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"266'353","reported_seq":1132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.810880+0000","last_change":"2024-09-12T02:07:03.810726+0000","last_active":"2024-09-12T02:07:03.810880+0000","last_peered":"2024-09-12T02:07:03.810880+0000","last_clean":"2024-09-12T02:07:03.810880+0000","last_became_active":"2024-09-12T00:09:59.311825+0000","last_became_peered":"2024-09-12T00:09:59.311825+0000","last_unstale":"2024-09-12T02:07:03.810880+0000","last_undegraded":"2024-09-12T02:07:03.810880+0000","last_fullsized":"2024-09-12T02:07:03.810880+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'353","last_scrub_stamp":"2024-09-12T02:07:03.810476+0000","last_deep_scrub":"266'353","last_deep_scrub_stamp":"2024-09-12T02:07:03.810476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.810476+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.639688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399264,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":842,"num_read_kb":88204,"num_write":1135,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"266'422","reported_seq":1892,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.571407+0000","last_change":"2024-09-12T02:07:14.571407+0000","last_active":"2024-09-12T02:07:14.571407+0000","last_peered":"2024-09-12T02:07:14.571407+0000","last_clean":"2024-09-12T02:07:14.571407+0000","last_became_active":"2024-09-12T00:10:01.274405+0000","last_became_peered":"2024-09-12T00:10:01.274405+0000","last_unstale":"2024-09-12T02:07:14.571407+0000","last_undegraded":"2024-09-12T02:07:14.571407+0000","last_fullsized":"2024-09-12T02:07:14.571407+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'422","last_scrub_stamp":"2024-09-12T02:07:14.571149+0000","last_deep_scrub":"266'422","last_deep_scrub_stamp":"2024-09-12T02:07:14.571149+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.571149+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:55.197355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2137,"num_read_kb":2003,"num_write":477,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"266'378","reported_seq":1074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.950434+0000","last_change":"2024-09-12T02:07:12.950263+0000","last_active":"2024-09-12T02:07:12.950434+0000","last_peered":"2024-09-12T02:07:12.950434+0000","last_clean":"2024-09-12T02:07:12.950434+0000","last_became_active":"2024-09-12T00:09:59.248750+0000","last_became_peered":"2024-09-12T00:09:59.248750+0000","last_unstale":"2024-09-12T02:07:12.950434+0000","last_undegraded":"2024-09-12T02:07:12.950434+0000","last_fullsized":"2024-09-12T02:07:12.950434+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'378","last_scrub_stamp":"2024-09-12T02:07:12.949940+0000","last_deep_scrub":"266'378","last_deep_scrub_stamp":"2024-09-12T02:07:12.949940+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.949940+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:49.263377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4478894,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":698,"num_read_kb":26164,"num_write":1140,"num_write_kb":31035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"266'820","reported_seq":2453,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.639619+0000","last_change":"2024-09-12T02:06:57.639619+0000","last_active":"2024-09-12T02:06:57.639619+0000","last_peered":"2024-09-12T02:06:57.639619+0000","last_clean":"2024-09-12T02:06:57.639619+0000","last_became_active":"2024-09-12T00:10:01.249016+0000","last_became_peered":"2024-09-12T00:10:01.249016+0000","last_unstale":"2024-09-12T02:06:57.639619+0000","last_undegraded":"2024-09-12T02:06:57.639619+0000","last_fullsized":"2024-09-12T02:06:57.639619+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'820","last_scrub_stamp":"2024-09-12T02:06:57.639429+0000","last_deep_scrub":"266'820","last_deep_scrub_stamp":"2024-09-12T02:06:57.639429+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.639429+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:20.206412+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3841,"num_read_kb":3467,"num_write":1075,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"266'628","reported_seq":2390,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.056138+0000","last_change":"2024-09-12T02:07:10.056138+0000","last_active":"2024-09-12T02:07:10.056138+0000","last_peered":"2024-09-12T02:07:10.056138+0000","last_clean":"2024-09-12T02:07:10.056138+0000","last_became_active":"2024-09-12T00:10:01.252790+0000","last_became_peered":"2024-09-12T00:10:01.252790+0000","last_unstale":"2024-09-12T02:07:10.056138+0000","last_undegraded":"2024-09-12T02:07:10.056138+0000","last_fullsized":"2024-09-12T02:07:10.056138+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'628","last_scrub_stamp":"2024-09-12T02:07:10.055950+0000","last_deep_scrub":"266'628","last_deep_scrub_stamp":"2024-09-12T02:07:10.055950+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.055950+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:28.740887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2892,"num_write":772,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"266'411","reported_seq":1116,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.820593+0000","last_change":"2024-09-12T02:07:05.820593+0000","last_active":"2024-09-12T02:07:05.820593+0000","last_peered":"2024-09-12T02:07:05.820593+0000","last_clean":"2024-09-12T02:07:05.820593+0000","last_became_active":"2024-09-12T00:09:59.285279+0000","last_became_peered":"2024-09-12T00:09:59.285279+0000","last_unstale":"2024-09-12T02:07:05.820593+0000","last_undegraded":"2024-09-12T02:07:05.820593+0000","last_fullsized":"2024-09-12T02:07:05.820593+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'411","last_scrub_stamp":"2024-09-12T02:07:05.820309+0000","last_deep_scrub":"266'411","last_deep_scrub_stamp":"2024-09-12T02:07:05.820309+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.820309+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:56.300299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569417,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":647,"num_read_kb":33158,"num_write":1312,"num_write_kb":40723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"266'387","reported_seq":2068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.862281+0000","last_change":"2024-09-12T02:07:09.862281+0000","last_active":"2024-09-12T02:07:09.862281+0000","last_peered":"2024-09-12T02:07:09.862281+0000","last_clean":"2024-09-12T02:07:09.862281+0000","last_became_active":"2024-09-12T00:10:01.269235+0000","last_became_peered":"2024-09-12T00:10:01.269235+0000","last_unstale":"2024-09-12T02:07:09.862281+0000","last_undegraded":"2024-09-12T02:07:09.862281+0000","last_fullsized":"2024-09-12T02:07:09.862281+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'387","last_scrub_stamp":"2024-09-12T02:07:09.862094+0000","last_deep_scrub":"266'387","last_deep_scrub_stamp":"2024-09-12T02:07:09.862094+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.862094+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:04.979312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2516,"num_read_kb":2424,"num_write":449,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2781,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"266'351","reported_seq":1000,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.080909+0000","last_change":"2024-09-12T02:07:07.080909+0000","last_active":"2024-09-12T02:07:07.080909+0000","last_peered":"2024-09-12T02:07:07.080909+0000","last_clean":"2024-09-12T02:07:07.080909+0000","last_became_active":"2024-09-12T00:09:59.298975+0000","last_became_peered":"2024-09-12T00:09:59.298975+0000","last_unstale":"2024-09-12T02:07:07.080909+0000","last_undegraded":"2024-09-12T02:07:07.080909+0000","last_fullsized":"2024-09-12T02:07:07.080909+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'351","last_scrub_stamp":"2024-09-12T02:07:07.080684+0000","last_deep_scrub":"266'351","last_deep_scrub_stamp":"2024-09-12T02:07:07.080684+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.080684+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:09.511021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":20543,"num_write":987,"num_write_kb":37808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"266'1149","reported_seq":2691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.622569+0000","last_change":"2024-09-12T02:07:10.622569+0000","last_active":"2024-09-12T02:07:10.622569+0000","last_peered":"2024-09-12T02:07:10.622569+0000","last_clean":"2024-09-12T02:07:10.622569+0000","last_became_active":"2024-09-12T00:10:01.270566+0000","last_became_peered":"2024-09-12T00:10:01.270566+0000","last_unstale":"2024-09-12T02:07:10.622569+0000","last_undegraded":"2024-09-12T02:07:10.622569+0000","last_fullsized":"2024-09-12T02:07:10.622569+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1149","last_scrub_stamp":"2024-09-12T02:07:10.622387+0000","last_deep_scrub":"266'1149","last_deep_scrub_stamp":"2024-09-12T02:07:10.622387+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.622387+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":1100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:22.452419+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5146,"num_read_kb":4532,"num_write":1573,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"266'328","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.640773+0000","last_change":"2024-09-12T02:07:00.640773+0000","last_active":"2024-09-12T02:07:00.640773+0000","last_peered":"2024-09-12T02:07:00.640773+0000","last_clean":"2024-09-12T02:07:00.640773+0000","last_became_active":"2024-09-12T00:10:31.475207+0000","last_became_peered":"2024-09-12T00:10:31.475207+0000","last_unstale":"2024-09-12T02:07:00.640773+0000","last_undegraded":"2024-09-12T02:07:00.640773+0000","last_fullsized":"2024-09-12T02:07:00.640773+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'328","last_scrub_stamp":"2024-09-12T02:07:00.640512+0000","last_deep_scrub":"266'328","last_deep_scrub_stamp":"2024-09-12T02:07:00.640512+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.640512+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:25.664541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35516,"num_write":1077,"num_write_kb":27332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"266'425","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.618646+0000","last_change":"2024-09-12T02:07:02.618646+0000","last_active":"2024-09-12T02:07:02.618646+0000","last_peered":"2024-09-12T02:07:02.618646+0000","last_clean":"2024-09-12T02:07:02.618646+0000","last_became_active":"2024-09-12T00:10:01.249060+0000","last_became_peered":"2024-09-12T00:10:01.249060+0000","last_unstale":"2024-09-12T02:07:02.618646+0000","last_undegraded":"2024-09-12T02:07:02.618646+0000","last_fullsized":"2024-09-12T02:07:02.618646+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'425","last_scrub_stamp":"2024-09-12T02:07:02.618429+0000","last_deep_scrub":"266'425","last_deep_scrub_stamp":"2024-09-12T02:07:02.618429+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.618429+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:02.382238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2301,"num_write":498,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"266'349","reported_seq":1022,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.046073+0000","last_change":"2024-09-12T02:06:58.046073+0000","last_active":"2024-09-12T02:06:58.046073+0000","last_peered":"2024-09-12T02:06:58.046073+0000","last_clean":"2024-09-12T02:06:58.046073+0000","last_became_active":"2024-09-12T00:09:59.308979+0000","last_became_peered":"2024-09-12T00:09:59.308979+0000","last_unstale":"2024-09-12T02:06:58.046073+0000","last_undegraded":"2024-09-12T02:06:58.046073+0000","last_fullsized":"2024-09-12T02:06:58.046073+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T02:06:58.045671+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T02:06:58.045671+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.045671+0000","objects_scrubbed":11,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:32.257450+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9921950,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":33875,"num_write":1037,"num_write_kb":29129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"266'441","reported_seq":1933,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.611005+0000","last_change":"2024-09-12T02:06:59.611005+0000","last_active":"2024-09-12T02:06:59.611005+0000","last_peered":"2024-09-12T02:06:59.611005+0000","last_clean":"2024-09-12T02:06:59.611005+0000","last_became_active":"2024-09-12T00:10:01.238251+0000","last_became_peered":"2024-09-12T00:10:01.238251+0000","last_unstale":"2024-09-12T02:06:59.611005+0000","last_undegraded":"2024-09-12T02:06:59.611005+0000","last_fullsized":"2024-09-12T02:06:59.611005+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'441","last_scrub_stamp":"2024-09-12T02:06:59.610833+0000","last_deep_scrub":"266'441","last_deep_scrub_stamp":"2024-09-12T02:06:59.610833+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.610833+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:13.031338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2194,"num_read_kb":2058,"num_write":515,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"266'313","reported_seq":968,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.896306+0000","last_change":"2024-09-12T02:07:00.896306+0000","last_active":"2024-09-12T02:07:00.896306+0000","last_peered":"2024-09-12T02:07:00.896306+0000","last_clean":"2024-09-12T02:07:00.896306+0000","last_became_active":"2024-09-12T00:09:59.262666+0000","last_became_peered":"2024-09-12T00:09:59.262666+0000","last_unstale":"2024-09-12T02:07:00.896306+0000","last_undegraded":"2024-09-12T02:07:00.896306+0000","last_fullsized":"2024-09-12T02:07:00.896306+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'313","last_scrub_stamp":"2024-09-12T02:07:00.896081+0000","last_deep_scrub":"266'313","last_deep_scrub_stamp":"2024-09-12T02:07:00.896081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.896081+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:49.352670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433326,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":422,"num_read_kb":23030,"num_write":985,"num_write_kb":39870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"266'663","reported_seq":2190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.095132+0000","last_change":"2024-09-12T02:07:11.095132+0000","last_active":"2024-09-12T02:07:11.095132+0000","last_peered":"2024-09-12T02:07:11.095132+0000","last_clean":"2024-09-12T02:07:11.095132+0000","last_became_active":"2024-09-12T00:10:01.257792+0000","last_became_peered":"2024-09-12T00:10:01.257792+0000","last_unstale":"2024-09-12T02:07:11.095132+0000","last_undegraded":"2024-09-12T02:07:11.095132+0000","last_fullsized":"2024-09-12T02:07:11.095132+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'663","last_scrub_stamp":"2024-09-12T02:07:11.094919+0000","last_deep_scrub":"266'663","last_deep_scrub_stamp":"2024-09-12T02:07:11.094919+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.094919+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":600,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:28.585837+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3304,"num_read_kb":2964,"num_write":919,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1227,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"266'329","reported_seq":995,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.452573+0000","last_change":"2024-09-12T02:07:01.452411+0000","last_active":"2024-09-12T02:07:01.452573+0000","last_peered":"2024-09-12T02:07:01.452573+0000","last_clean":"2024-09-12T02:07:01.452573+0000","last_became_active":"2024-09-12T00:09:59.293921+0000","last_became_peered":"2024-09-12T00:09:59.293921+0000","last_unstale":"2024-09-12T02:07:01.452573+0000","last_undegraded":"2024-09-12T02:07:01.452573+0000","last_fullsized":"2024-09-12T02:07:01.452573+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'329","last_scrub_stamp":"2024-09-12T02:07:01.452129+0000","last_deep_scrub":"266'329","last_deep_scrub_stamp":"2024-09-12T02:07:01.452129+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.452129+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:18.604057+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262199,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":482,"num_read_kb":35722,"num_write":1084,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"266'144","reported_seq":688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.111301+0000","last_change":"2024-09-12T02:07:28.111301+0000","last_active":"2024-09-12T02:07:28.111301+0000","last_peered":"2024-09-12T02:07:28.111301+0000","last_clean":"2024-09-12T02:07:28.111301+0000","last_became_active":"2024-09-12T00:10:09.356144+0000","last_became_peered":"2024-09-12T00:10:09.356144+0000","last_unstale":"2024-09-12T02:07:28.111301+0000","last_undegraded":"2024-09-12T02:07:28.111301+0000","last_fullsized":"2024-09-12T02:07:28.111301+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'144","last_scrub_stamp":"2024-09-12T02:07:28.111105+0000","last_deep_scrub":"266'144","last_deep_scrub_stamp":"2024-09-12T02:07:28.111105+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.111105+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.381630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":339,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"266'787","reported_seq":2344,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.925510+0000","last_change":"2024-09-12T02:07:05.925510+0000","last_active":"2024-09-12T02:07:05.925510+0000","last_peered":"2024-09-12T02:07:05.925510+0000","last_clean":"2024-09-12T02:07:05.925510+0000","last_became_active":"2024-09-12T00:10:01.259053+0000","last_became_peered":"2024-09-12T00:10:01.259053+0000","last_unstale":"2024-09-12T02:07:05.925510+0000","last_undegraded":"2024-09-12T02:07:05.925510+0000","last_fullsized":"2024-09-12T02:07:05.925510+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'787","last_scrub_stamp":"2024-09-12T02:07:05.925325+0000","last_deep_scrub":"266'787","last_deep_scrub_stamp":"2024-09-12T02:07:05.925325+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.925325+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:04.831866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3705,"num_read_kb":3341,"num_write":1024,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"266'390","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.742097+0000","last_change":"2024-09-12T02:07:00.742097+0000","last_active":"2024-09-12T02:07:00.742097+0000","last_peered":"2024-09-12T02:07:00.742097+0000","last_clean":"2024-09-12T02:07:00.742097+0000","last_became_active":"2024-09-12T00:09:59.310643+0000","last_became_peered":"2024-09-12T00:09:59.310643+0000","last_unstale":"2024-09-12T02:07:00.742097+0000","last_undegraded":"2024-09-12T02:07:00.742097+0000","last_fullsized":"2024-09-12T02:07:00.742097+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:07:00.741744+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:07:00.741744+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.741744+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:30.067710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136934,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":31265,"num_write":1302,"num_write_kb":60174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.567418+0000","last_change":"2024-09-12T02:07:16.567418+0000","last_active":"2024-09-12T02:07:16.567418+0000","last_peered":"2024-09-12T02:07:16.567418+0000","last_clean":"2024-09-12T02:07:16.567418+0000","last_became_active":"2024-09-12T00:10:03.271233+0000","last_became_peered":"2024-09-12T00:10:03.271233+0000","last_unstale":"2024-09-12T02:07:16.567418+0000","last_undegraded":"2024-09-12T02:07:16.567418+0000","last_fullsized":"2024-09-12T02:07:16.567418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:16.567230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:16.567230+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.567230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:20.643320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"266'381","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.545873+0000","last_change":"2024-09-12T02:07:19.545873+0000","last_active":"2024-09-12T02:07:19.545873+0000","last_peered":"2024-09-12T02:07:19.545873+0000","last_clean":"2024-09-12T02:07:19.545873+0000","last_became_active":"2024-09-12T00:10:05.285417+0000","last_became_peered":"2024-09-12T00:10:05.285417+0000","last_unstale":"2024-09-12T02:07:19.545873+0000","last_undegraded":"2024-09-12T02:07:19.545873+0000","last_fullsized":"2024-09-12T02:07:19.545873+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:07:19.545684+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:07:19.545684+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.545684+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:24.365440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47464,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1152,"num_write":460,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.871914+0000","last_change":"2024-09-12T02:07:23.871914+0000","last_active":"2024-09-12T02:07:23.871914+0000","last_peered":"2024-09-12T02:07:23.871914+0000","last_clean":"2024-09-12T02:07:23.871914+0000","last_became_active":"2024-09-12T00:10:07.318114+0000","last_became_peered":"2024-09-12T00:10:07.318114+0000","last_unstale":"2024-09-12T02:07:23.871914+0000","last_undegraded":"2024-09-12T02:07:23.871914+0000","last_fullsized":"2024-09-12T02:07:23.871914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:23.871689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:23.871689+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.871689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:41.246339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"266'2464","reported_seq":4396,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:59.745617+0000","last_change":"2024-09-12T00:10:09.371782+0000","last_active":"2024-09-12T02:04:59.745617+0000","last_peered":"2024-09-12T02:04:59.745617+0000","last_clean":"2024-09-12T02:04:59.745617+0000","last_became_active":"2024-09-12T00:10:09.370949+0000","last_became_peered":"2024-09-12T00:10:09.370949+0000","last_unstale":"2024-09-12T02:04:59.745617+0000","last_undegraded":"2024-09-12T02:04:59.745617+0000","last_fullsized":"2024-09-12T02:04:59.745617+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:02.640276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6210,"num_read_kb":6193,"num_write":4929,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"266'416","reported_seq":1962,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.578930+0000","last_change":"2024-09-12T02:07:09.578930+0000","last_active":"2024-09-12T02:07:09.578930+0000","last_peered":"2024-09-12T02:07:09.578930+0000","last_clean":"2024-09-12T02:07:09.578930+0000","last_became_active":"2024-09-12T00:10:01.274710+0000","last_became_peered":"2024-09-12T00:10:01.274710+0000","last_unstale":"2024-09-12T02:07:09.578930+0000","last_undegraded":"2024-09-12T02:07:09.578930+0000","last_fullsized":"2024-09-12T02:07:09.578930+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'416","last_scrub_stamp":"2024-09-12T02:07:09.578701+0000","last_deep_scrub":"266'416","last_deep_scrub_stamp":"2024-09-12T02:07:09.578701+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.578701+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:42.665393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2273,"num_read_kb":2145,"num_write":493,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"266'407","reported_seq":1136,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.555841+0000","last_change":"2024-09-12T02:06:57.555841+0000","last_active":"2024-09-12T02:06:57.555841+0000","last_peered":"2024-09-12T02:06:57.555841+0000","last_clean":"2024-09-12T02:06:57.555841+0000","last_became_active":"2024-09-12T00:09:59.282228+0000","last_became_peered":"2024-09-12T00:09:59.282228+0000","last_unstale":"2024-09-12T02:06:57.555841+0000","last_undegraded":"2024-09-12T02:06:57.555841+0000","last_fullsized":"2024-09-12T02:06:57.555841+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'407","last_scrub_stamp":"2024-09-12T02:06:57.555604+0000","last_deep_scrub":"266'407","last_deep_scrub_stamp":"2024-09-12T02:06:57.555604+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.555604+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:18.445365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":89139,"num_write":1493,"num_write_kb":44201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.972701+0000","last_change":"2024-09-12T02:07:13.972701+0000","last_active":"2024-09-12T02:07:13.972701+0000","last_peered":"2024-09-12T02:07:13.972701+0000","last_clean":"2024-09-12T02:07:13.972701+0000","last_became_active":"2024-09-12T00:10:03.254006+0000","last_became_peered":"2024-09-12T00:10:03.254006+0000","last_unstale":"2024-09-12T02:07:13.972701+0000","last_undegraded":"2024-09-12T02:07:13.972701+0000","last_fullsized":"2024-09-12T02:07:13.972701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.972525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.972525+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.972525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:24.718065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"266'142","reported_seq":726,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.052180+0000","last_change":"2024-09-12T02:07:20.052180+0000","last_active":"2024-09-12T02:07:20.052180+0000","last_peered":"2024-09-12T02:07:20.052180+0000","last_clean":"2024-09-12T02:07:20.052180+0000","last_became_active":"2024-09-12T00:10:05.279990+0000","last_became_peered":"2024-09-12T00:10:05.279990+0000","last_unstale":"2024-09-12T02:07:20.052180+0000","last_undegraded":"2024-09-12T02:07:20.052180+0000","last_fullsized":"2024-09-12T02:07:20.052180+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'142","last_scrub_stamp":"2024-09-12T02:07:20.051980+0000","last_deep_scrub":"266'142","last_deep_scrub_stamp":"2024-09-12T02:07:20.051980+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.051980+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:51.476200+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.082003+0000","last_change":"2024-09-12T02:07:24.082003+0000","last_active":"2024-09-12T02:07:24.082003+0000","last_peered":"2024-09-12T02:07:24.082003+0000","last_clean":"2024-09-12T02:07:24.082003+0000","last_became_active":"2024-09-12T00:10:07.309927+0000","last_became_peered":"2024-09-12T00:10:07.309927+0000","last_unstale":"2024-09-12T02:07:24.082003+0000","last_undegraded":"2024-09-12T02:07:24.082003+0000","last_fullsized":"2024-09-12T02:07:24.082003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.081817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.081817+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.081817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:55.034002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"266'107","reported_seq":635,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.538642+0000","last_change":"2024-09-12T02:07:27.538642+0000","last_active":"2024-09-12T02:07:27.538642+0000","last_peered":"2024-09-12T02:07:27.538642+0000","last_clean":"2024-09-12T02:07:27.538642+0000","last_became_active":"2024-09-12T00:10:09.364927+0000","last_became_peered":"2024-09-12T00:10:09.364927+0000","last_unstale":"2024-09-12T02:07:27.538642+0000","last_undegraded":"2024-09-12T02:07:27.538642+0000","last_fullsized":"2024-09-12T02:07:27.538642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'107","last_scrub_stamp":"2024-09-12T02:07:27.538445+0000","last_deep_scrub":"266'107","last_deep_scrub_stamp":"2024-09-12T02:07:27.538445+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.538445+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.515707+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":243,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"266'382","reported_seq":1920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.543265+0000","last_change":"2024-09-12T02:07:05.543265+0000","last_active":"2024-09-12T02:07:05.543265+0000","last_peered":"2024-09-12T02:07:05.543265+0000","last_clean":"2024-09-12T02:07:05.543265+0000","last_became_active":"2024-09-12T00:10:01.246633+0000","last_became_peered":"2024-09-12T00:10:01.246633+0000","last_unstale":"2024-09-12T02:07:05.543265+0000","last_undegraded":"2024-09-12T02:07:05.543265+0000","last_fullsized":"2024-09-12T02:07:05.543265+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'382","last_scrub_stamp":"2024-09-12T02:07:05.543080+0000","last_deep_scrub":"266'382","last_deep_scrub_stamp":"2024-09-12T02:07:05.543080+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.543080+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:54.983427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2031,"num_read_kb":1954,"num_write":422,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"266'322","reported_seq":980,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.653422+0000","last_change":"2024-09-12T02:06:55.653280+0000","last_active":"2024-09-12T02:06:55.653422+0000","last_peered":"2024-09-12T02:06:55.653422+0000","last_clean":"2024-09-12T02:06:55.653422+0000","last_became_active":"2024-09-12T00:10:31.472231+0000","last_became_peered":"2024-09-12T00:10:31.472231+0000","last_unstale":"2024-09-12T02:06:55.653422+0000","last_undegraded":"2024-09-12T02:06:55.653422+0000","last_fullsized":"2024-09-12T02:06:55.653422+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'322","last_scrub_stamp":"2024-09-12T02:06:55.653042+0000","last_deep_scrub":"266'322","last_deep_scrub_stamp":"2024-09-12T02:06:55.653042+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.653042+0000","objects_scrubbed":10,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:59.726925+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536061,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":478,"num_read_kb":34994,"num_write":999,"num_write_kb":46604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"266'4","reported_seq":1015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.999979+0000","last_change":"2024-09-12T02:07:18.999979+0000","last_active":"2024-09-12T02:07:18.999979+0000","last_peered":"2024-09-12T02:07:18.999979+0000","last_clean":"2024-09-12T02:07:18.999979+0000","last_became_active":"2024-09-12T00:10:03.265816+0000","last_became_peered":"2024-09-12T00:10:03.265816+0000","last_unstale":"2024-09-12T02:07:18.999979+0000","last_undegraded":"2024-09-12T02:07:18.999979+0000","last_fullsized":"2024-09-12T02:07:18.999979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:18.999783+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:18.999783+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.999783+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:39.516415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"266'196","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.644390+0000","last_change":"2024-09-12T02:07:12.644244+0000","last_active":"2024-09-12T02:07:12.644390+0000","last_peered":"2024-09-12T02:07:12.644390+0000","last_clean":"2024-09-12T02:07:12.644390+0000","last_became_active":"2024-09-12T00:10:05.275499+0000","last_became_peered":"2024-09-12T00:10:05.275499+0000","last_unstale":"2024-09-12T02:07:12.644390+0000","last_undegraded":"2024-09-12T02:07:12.644390+0000","last_fullsized":"2024-09-12T02:07:12.644390+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T02:07:12.643996+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T02:07:12.643996+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.643996+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:07.730489+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":245,"num_read_kb":237,"num_write":164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"266'775","reported_seq":3039,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.840916+0000","last_change":"2024-09-12T02:07:22.840916+0000","last_active":"2024-09-12T02:07:22.840916+0000","last_peered":"2024-09-12T02:07:22.840916+0000","last_clean":"2024-09-12T02:07:22.840916+0000","last_became_active":"2024-09-12T00:10:07.318302+0000","last_became_peered":"2024-09-12T00:10:07.318302+0000","last_unstale":"2024-09-12T02:07:22.840916+0000","last_undegraded":"2024-09-12T02:07:22.840916+0000","last_fullsized":"2024-09-12T02:07:22.840916+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'775","last_scrub_stamp":"2024-09-12T02:07:22.840736+0000","last_deep_scrub":"266'775","last_deep_scrub_stamp":"2024-09-12T02:07:22.840736+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.840736+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:58.453710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"266'207","reported_seq":1069,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.115383+0000","last_change":"2024-09-12T02:07:30.115383+0000","last_active":"2024-09-12T02:07:30.115383+0000","last_peered":"2024-09-12T02:07:30.115383+0000","last_clean":"2024-09-12T02:07:30.115383+0000","last_became_active":"2024-09-12T00:10:09.433045+0000","last_became_peered":"2024-09-12T00:10:09.433045+0000","last_unstale":"2024-09-12T02:07:30.115383+0000","last_undegraded":"2024-09-12T02:07:30.115383+0000","last_fullsized":"2024-09-12T02:07:30.115383+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'207","last_scrub_stamp":"2024-09-12T02:07:30.115201+0000","last_deep_scrub":"266'207","last_deep_scrub_stamp":"2024-09-12T02:07:30.115201+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.115201+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:51.345596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":620,"num_write":453,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"266'392","reported_seq":1970,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.916035+0000","last_change":"2024-09-12T02:07:03.916035+0000","last_active":"2024-09-12T02:07:03.916035+0000","last_peered":"2024-09-12T02:07:03.916035+0000","last_clean":"2024-09-12T02:07:03.916035+0000","last_became_active":"2024-09-12T00:10:01.261217+0000","last_became_peered":"2024-09-12T00:10:01.261217+0000","last_unstale":"2024-09-12T02:07:03.916035+0000","last_undegraded":"2024-09-12T02:07:03.916035+0000","last_fullsized":"2024-09-12T02:07:03.916035+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T02:07:03.915856+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T02:07:03.915856+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.915856+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:20.348940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2298,"num_read_kb":2187,"num_write":432,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2545,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"266'343","reported_seq":1006,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.195668+0000","last_change":"2024-09-12T02:06:56.195668+0000","last_active":"2024-09-12T02:06:56.195668+0000","last_peered":"2024-09-12T02:06:56.195668+0000","last_clean":"2024-09-12T02:06:56.195668+0000","last_became_active":"2024-09-12T00:09:59.281330+0000","last_became_peered":"2024-09-12T00:09:59.281330+0000","last_unstale":"2024-09-12T02:06:56.195668+0000","last_undegraded":"2024-09-12T02:06:56.195668+0000","last_fullsized":"2024-09-12T02:06:56.195668+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'343","last_scrub_stamp":"2024-09-12T02:06:56.195432+0000","last_deep_scrub":"266'343","last_deep_scrub_stamp":"2024-09-12T02:06:56.195432+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.195432+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:40.190762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":6619,"num_write":1099,"num_write_kb":41386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.561158+0000","last_change":"2024-09-12T02:07:17.561158+0000","last_active":"2024-09-12T02:07:17.561158+0000","last_peered":"2024-09-12T02:07:17.561158+0000","last_clean":"2024-09-12T02:07:17.561158+0000","last_became_active":"2024-09-12T00:10:03.271292+0000","last_became_peered":"2024-09-12T00:10:03.271292+0000","last_unstale":"2024-09-12T02:07:17.561158+0000","last_undegraded":"2024-09-12T02:07:17.561158+0000","last_fullsized":"2024-09-12T02:07:17.561158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:17.560974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:17.560974+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.560974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:50.417667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"266'325","reported_seq":951,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.857988+0000","last_change":"2024-09-12T02:07:19.857988+0000","last_active":"2024-09-12T02:07:19.857988+0000","last_peered":"2024-09-12T02:07:19.857988+0000","last_clean":"2024-09-12T02:07:19.857988+0000","last_became_active":"2024-09-12T00:10:05.361419+0000","last_became_peered":"2024-09-12T00:10:05.361419+0000","last_unstale":"2024-09-12T02:07:19.857988+0000","last_undegraded":"2024-09-12T02:07:19.857988+0000","last_fullsized":"2024-09-12T02:07:19.857988+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'325","last_scrub_stamp":"2024-09-12T02:07:19.857782+0000","last_deep_scrub":"266'325","last_deep_scrub_stamp":"2024-09-12T02:07:19.857782+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.857782+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:54.271134+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":523,"num_read_kb":1153,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"266'827","reported_seq":3131,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.989364+0000","last_change":"2024-09-12T02:07:26.989364+0000","last_active":"2024-09-12T02:07:26.989364+0000","last_peered":"2024-09-12T02:07:26.989364+0000","last_clean":"2024-09-12T02:07:26.989364+0000","last_became_active":"2024-09-12T00:10:07.335181+0000","last_became_peered":"2024-09-12T00:10:07.335181+0000","last_unstale":"2024-09-12T02:07:26.989364+0000","last_undegraded":"2024-09-12T02:07:26.989364+0000","last_fullsized":"2024-09-12T02:07:26.989364+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'827","last_scrub_stamp":"2024-09-12T02:07:26.989178+0000","last_deep_scrub":"266'827","last_deep_scrub_stamp":"2024-09-12T02:07:26.989178+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.989178+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:22.733341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"266'423","reported_seq":1883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.631654+0000","last_change":"2024-09-12T02:07:08.631654+0000","last_active":"2024-09-12T02:07:08.631654+0000","last_peered":"2024-09-12T02:07:08.631654+0000","last_clean":"2024-09-12T02:07:08.631654+0000","last_became_active":"2024-09-12T00:10:01.266204+0000","last_became_peered":"2024-09-12T00:10:01.266204+0000","last_unstale":"2024-09-12T02:07:08.631654+0000","last_undegraded":"2024-09-12T02:07:08.631654+0000","last_fullsized":"2024-09-12T02:07:08.631654+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T02:07:08.631455+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T02:07:08.631455+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.631455+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:50.621125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2063,"num_read_kb":1939,"num_write":461,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"266'375","reported_seq":1040,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.749038+0000","last_change":"2024-09-12T02:06:59.748793+0000","last_active":"2024-09-12T02:06:59.749038+0000","last_peered":"2024-09-12T02:06:59.749038+0000","last_clean":"2024-09-12T02:06:59.749038+0000","last_became_active":"2024-09-12T00:09:59.307481+0000","last_became_peered":"2024-09-12T00:09:59.307481+0000","last_unstale":"2024-09-12T02:06:59.749038+0000","last_undegraded":"2024-09-12T02:06:59.749038+0000","last_fullsized":"2024-09-12T02:06:59.749038+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'375","last_scrub_stamp":"2024-09-12T02:06:59.748525+0000","last_deep_scrub":"266'375","last_deep_scrub_stamp":"2024-09-12T02:06:59.748525+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.748525+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:19.336128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":11316,"num_write":1196,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.894687+0000","last_change":"2024-09-12T02:07:12.894687+0000","last_active":"2024-09-12T02:07:12.894687+0000","last_peered":"2024-09-12T02:07:12.894687+0000","last_clean":"2024-09-12T02:07:12.894687+0000","last_became_active":"2024-09-12T00:10:03.258601+0000","last_became_peered":"2024-09-12T00:10:03.258601+0000","last_unstale":"2024-09-12T02:07:12.894687+0000","last_undegraded":"2024-09-12T02:07:12.894687+0000","last_fullsized":"2024-09-12T02:07:12.894687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.894507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.894507+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.894507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:09.932960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"266'487","reported_seq":1198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.603541+0000","last_change":"2024-09-12T02:07:21.603383+0000","last_active":"2024-09-12T02:07:21.603541+0000","last_peered":"2024-09-12T02:07:21.603541+0000","last_clean":"2024-09-12T02:07:21.603541+0000","last_became_active":"2024-09-12T00:10:05.361273+0000","last_became_peered":"2024-09-12T00:10:05.361273+0000","last_unstale":"2024-09-12T02:07:21.603541+0000","last_undegraded":"2024-09-12T02:07:21.603541+0000","last_fullsized":"2024-09-12T02:07:21.603541+0000","mapping_epoch":31,"log_start":"266'400","ondisk_log_start":"266'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'487","last_scrub_stamp":"2024-09-12T02:07:21.603162+0000","last_deep_scrub":"266'487","last_deep_scrub_stamp":"2024-09-12T02:07:21.603162+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.603162+0000","objects_scrubbed":10,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:05.657227+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46961,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":773,"num_read_kb":1424,"num_write":592,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.370591+0000","last_change":"2024-09-12T02:07:09.370591+0000","last_active":"2024-09-12T02:07:09.370591+0000","last_peered":"2024-09-12T02:07:09.370591+0000","last_clean":"2024-09-12T02:07:09.370591+0000","last_became_active":"2024-09-12T00:10:07.316670+0000","last_became_peered":"2024-09-12T00:10:07.316670+0000","last_unstale":"2024-09-12T02:07:09.370591+0000","last_undegraded":"2024-09-12T02:07:09.370591+0000","last_fullsized":"2024-09-12T02:07:09.370591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.370411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.370411+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.370411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:33.487199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"266'603","reported_seq":1453,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.649492+0000","last_change":"2024-09-12T02:07:26.649492+0000","last_active":"2024-09-12T02:07:26.649492+0000","last_peered":"2024-09-12T02:07:26.649492+0000","last_clean":"2024-09-12T02:07:26.649492+0000","last_became_active":"2024-09-12T00:10:09.368091+0000","last_became_peered":"2024-09-12T00:10:09.368091+0000","last_unstale":"2024-09-12T02:07:26.649492+0000","last_undegraded":"2024-09-12T02:07:26.649492+0000","last_fullsized":"2024-09-12T02:07:26.649492+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'603","last_scrub_stamp":"2024-09-12T02:07:26.649300+0000","last_deep_scrub":"266'603","last_deep_scrub_stamp":"2024-09-12T02:07:26.649300+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.649300+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:49.249973+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1323,"num_read_kb":1320,"num_write":1284,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"266'478","reported_seq":2146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.004942+0000","last_change":"2024-09-12T02:06:59.004792+0000","last_active":"2024-09-12T02:06:59.004942+0000","last_peered":"2024-09-12T02:06:59.004942+0000","last_clean":"2024-09-12T02:06:59.004942+0000","last_became_active":"2024-09-12T00:10:01.257821+0000","last_became_peered":"2024-09-12T00:10:01.257821+0000","last_unstale":"2024-09-12T02:06:59.004942+0000","last_undegraded":"2024-09-12T02:06:59.004942+0000","last_fullsized":"2024-09-12T02:06:59.004942+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T02:06:59.004587+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T02:06:59.004587+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.004587+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:37.594672+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2372,"num_write":561,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"266'348","reported_seq":1005,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.746366+0000","last_change":"2024-09-12T02:06:58.746131+0000","last_active":"2024-09-12T02:06:58.746366+0000","last_peered":"2024-09-12T02:06:58.746366+0000","last_clean":"2024-09-12T02:06:58.746366+0000","last_became_active":"2024-09-12T00:09:59.308185+0000","last_became_peered":"2024-09-12T00:09:59.308185+0000","last_unstale":"2024-09-12T02:06:58.746366+0000","last_undegraded":"2024-09-12T02:06:58.746366+0000","last_fullsized":"2024-09-12T02:06:58.746366+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'348","last_scrub_stamp":"2024-09-12T02:06:58.745829+0000","last_deep_scrub":"266'348","last_deep_scrub_stamp":"2024-09-12T02:06:58.745829+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.745829+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:55.531829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":32387,"num_write":1082,"num_write_kb":39559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.633879+0000","last_change":"2024-09-12T02:07:03.633737+0000","last_active":"2024-09-12T02:07:03.633879+0000","last_peered":"2024-09-12T02:07:03.633879+0000","last_clean":"2024-09-12T02:07:03.633879+0000","last_became_active":"2024-09-12T00:10:03.250360+0000","last_became_peered":"2024-09-12T00:10:03.250360+0000","last_unstale":"2024-09-12T02:07:03.633879+0000","last_undegraded":"2024-09-12T02:07:03.633879+0000","last_fullsized":"2024-09-12T02:07:03.633879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:03.633514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:03.633514+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.633514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:58.442879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"266'314","reported_seq":948,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.008699+0000","last_change":"2024-09-12T02:07:23.008699+0000","last_active":"2024-09-12T02:07:23.008699+0000","last_peered":"2024-09-12T02:07:23.008699+0000","last_clean":"2024-09-12T02:07:23.008699+0000","last_became_active":"2024-09-12T00:10:05.288035+0000","last_became_peered":"2024-09-12T00:10:05.288035+0000","last_unstale":"2024-09-12T02:07:23.008699+0000","last_undegraded":"2024-09-12T02:07:23.008699+0000","last_fullsized":"2024-09-12T02:07:23.008699+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'314","last_scrub_stamp":"2024-09-12T02:07:23.008515+0000","last_deep_scrub":"266'314","last_deep_scrub_stamp":"2024-09-12T02:07:23.008515+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.008515+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:13.204707+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51853,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1112,"num_write":408,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.956571+0000","last_change":"2024-09-12T02:07:23.956414+0000","last_active":"2024-09-12T02:07:23.956571+0000","last_peered":"2024-09-12T02:07:23.956571+0000","last_clean":"2024-09-12T02:07:23.956571+0000","last_became_active":"2024-09-12T00:10:07.340248+0000","last_became_peered":"2024-09-12T00:10:07.340248+0000","last_unstale":"2024-09-12T02:07:23.956571+0000","last_undegraded":"2024-09-12T02:07:23.956571+0000","last_fullsized":"2024-09-12T02:07:23.956571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:23.956228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:23.956228+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.956228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:23.703295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"266'117","reported_seq":653,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.126059+0000","last_change":"2024-09-12T02:07:16.125890+0000","last_active":"2024-09-12T02:07:16.126059+0000","last_peered":"2024-09-12T02:07:16.126059+0000","last_clean":"2024-09-12T02:07:16.126059+0000","last_became_active":"2024-09-12T00:10:09.359663+0000","last_became_peered":"2024-09-12T00:10:09.359663+0000","last_unstale":"2024-09-12T02:07:16.126059+0000","last_undegraded":"2024-09-12T02:07:16.126059+0000","last_fullsized":"2024-09-12T02:07:16.126059+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'117","last_scrub_stamp":"2024-09-12T02:07:16.125715+0000","last_deep_scrub":"266'117","last_deep_scrub_stamp":"2024-09-12T02:07:16.125715+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.125715+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:39.824814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":110,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"266'1044","reported_seq":2845,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.041016+0000","last_change":"2024-09-12T02:07:02.040796+0000","last_active":"2024-09-12T02:07:02.041016+0000","last_peered":"2024-09-12T02:07:02.041016+0000","last_clean":"2024-09-12T02:07:02.041016+0000","last_became_active":"2024-09-12T00:10:01.263012+0000","last_became_peered":"2024-09-12T00:10:01.263012+0000","last_unstale":"2024-09-12T02:07:02.041016+0000","last_undegraded":"2024-09-12T02:07:02.041016+0000","last_fullsized":"2024-09-12T02:07:02.041016+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1044","last_scrub_stamp":"2024-09-12T02:07:02.040566+0000","last_deep_scrub":"266'1044","last_deep_scrub_stamp":"2024-09-12T02:07:02.040566+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.040566+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":1000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:28.934270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4917,"num_read_kb":4393,"num_write":1427,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"266'301","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.605434+0000","last_change":"2024-09-12T02:07:01.605147+0000","last_active":"2024-09-12T02:07:01.605434+0000","last_peered":"2024-09-12T02:07:01.605434+0000","last_clean":"2024-09-12T02:07:01.605434+0000","last_became_active":"2024-09-12T00:10:31.477934+0000","last_became_peered":"2024-09-12T00:10:31.477934+0000","last_unstale":"2024-09-12T02:07:01.605434+0000","last_undegraded":"2024-09-12T02:07:01.605434+0000","last_fullsized":"2024-09-12T02:07:01.605434+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'301","last_scrub_stamp":"2024-09-12T02:07:01.604849+0000","last_deep_scrub":"266'301","last_deep_scrub_stamp":"2024-09-12T02:07:01.604849+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.604849+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.155816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":400,"num_read_kb":33911,"num_write":938,"num_write_kb":31727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.745903+0000","last_change":"2024-09-12T02:07:07.745903+0000","last_active":"2024-09-12T02:07:07.745903+0000","last_peered":"2024-09-12T02:07:07.745903+0000","last_clean":"2024-09-12T02:07:07.745903+0000","last_became_active":"2024-09-12T00:10:03.254328+0000","last_became_peered":"2024-09-12T00:10:03.254328+0000","last_unstale":"2024-09-12T02:07:07.745903+0000","last_undegraded":"2024-09-12T02:07:07.745903+0000","last_fullsized":"2024-09-12T02:07:07.745903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.745700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.745700+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.745700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:02.537185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"266'406","reported_seq":1080,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.814460+0000","last_change":"2024-09-12T02:07:17.814460+0000","last_active":"2024-09-12T02:07:17.814460+0000","last_peered":"2024-09-12T02:07:17.814460+0000","last_clean":"2024-09-12T02:07:17.814460+0000","last_became_active":"2024-09-12T00:10:05.285616+0000","last_became_peered":"2024-09-12T00:10:05.285616+0000","last_unstale":"2024-09-12T02:07:17.814460+0000","last_undegraded":"2024-09-12T02:07:17.814460+0000","last_fullsized":"2024-09-12T02:07:17.814460+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'406","last_scrub_stamp":"2024-09-12T02:07:17.814268+0000","last_deep_scrub":"266'406","last_deep_scrub_stamp":"2024-09-12T02:07:17.814268+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.814268+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:26.930072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44989,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":1221,"num_write":494,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"266'804","reported_seq":3302,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.577881+0000","last_change":"2024-09-12T02:07:20.577881+0000","last_active":"2024-09-12T02:07:20.577881+0000","last_peered":"2024-09-12T02:07:20.577881+0000","last_clean":"2024-09-12T02:07:20.577881+0000","last_became_active":"2024-09-12T00:10:07.319708+0000","last_became_peered":"2024-09-12T00:10:07.319708+0000","last_unstale":"2024-09-12T02:07:20.577881+0000","last_undegraded":"2024-09-12T02:07:20.577881+0000","last_fullsized":"2024-09-12T02:07:20.577881+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'804","last_scrub_stamp":"2024-09-12T02:07:20.577711+0000","last_deep_scrub":"266'804","last_deep_scrub_stamp":"2024-09-12T02:07:20.577711+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.577711+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:31.700028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"266'113","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.544103+0000","last_change":"2024-09-12T02:07:26.544103+0000","last_active":"2024-09-12T02:07:26.544103+0000","last_peered":"2024-09-12T02:07:26.544103+0000","last_clean":"2024-09-12T02:07:26.544103+0000","last_became_active":"2024-09-12T00:10:09.357682+0000","last_became_peered":"2024-09-12T00:10:09.357682+0000","last_unstale":"2024-09-12T02:07:26.544103+0000","last_undegraded":"2024-09-12T02:07:26.544103+0000","last_fullsized":"2024-09-12T02:07:26.544103+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'113","last_scrub_stamp":"2024-09-12T02:07:26.543887+0000","last_deep_scrub":"266'113","last_deep_scrub_stamp":"2024-09-12T02:07:26.543887+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.543887+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:23.602052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":265,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"266'779","reported_seq":2348,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.499361+0000","last_change":"2024-09-12T02:07:04.499361+0000","last_active":"2024-09-12T02:07:04.499361+0000","last_peered":"2024-09-12T02:07:04.499361+0000","last_clean":"2024-09-12T02:07:04.499361+0000","last_became_active":"2024-09-12T00:10:01.258536+0000","last_became_peered":"2024-09-12T00:10:01.258536+0000","last_unstale":"2024-09-12T02:07:04.499361+0000","last_undegraded":"2024-09-12T02:07:04.499361+0000","last_fullsized":"2024-09-12T02:07:04.499361+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'779","last_scrub_stamp":"2024-09-12T02:07:04.499174+0000","last_deep_scrub":"266'779","last_deep_scrub_stamp":"2024-09-12T02:07:04.499174+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.499174+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:49.045153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3854,"num_read_kb":3489,"num_write":1035,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"266'390","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.676263+0000","last_change":"2024-09-12T02:06:58.676117+0000","last_active":"2024-09-12T02:06:58.676263+0000","last_peered":"2024-09-12T02:06:58.676263+0000","last_clean":"2024-09-12T02:06:58.676263+0000","last_became_active":"2024-09-12T00:09:59.283882+0000","last_became_peered":"2024-09-12T00:09:59.283882+0000","last_unstale":"2024-09-12T02:06:58.676263+0000","last_undegraded":"2024-09-12T02:06:58.676263+0000","last_fullsized":"2024-09-12T02:06:58.676263+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:06:58.675891+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:06:58.675891+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.675891+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.972022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":25090,"num_write":1213,"num_write_kb":35310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.707801+0000","last_change":"2024-09-12T02:07:05.707659+0000","last_active":"2024-09-12T02:07:05.707801+0000","last_peered":"2024-09-12T02:07:05.707801+0000","last_clean":"2024-09-12T02:07:05.707801+0000","last_became_active":"2024-09-12T00:10:03.250840+0000","last_became_peered":"2024-09-12T00:10:03.250840+0000","last_unstale":"2024-09-12T02:07:05.707801+0000","last_undegraded":"2024-09-12T02:07:05.707801+0000","last_fullsized":"2024-09-12T02:07:05.707801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.707476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.707476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.707476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:17.730653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"266'545","reported_seq":1246,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.544969+0000","last_change":"2024-09-12T02:07:16.544969+0000","last_active":"2024-09-12T02:07:16.544969+0000","last_peered":"2024-09-12T02:07:16.544969+0000","last_clean":"2024-09-12T02:07:16.544969+0000","last_became_active":"2024-09-12T00:10:05.285823+0000","last_became_peered":"2024-09-12T00:10:05.285823+0000","last_unstale":"2024-09-12T02:07:16.544969+0000","last_undegraded":"2024-09-12T02:07:16.544969+0000","last_fullsized":"2024-09-12T02:07:16.544969+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'545","last_scrub_stamp":"2024-09-12T02:07:16.544864+0000","last_deep_scrub":"266'545","last_deep_scrub_stamp":"2024-09-12T02:07:16.544864+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.544864+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:16.677319+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96632,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":936,"num_read_kb":2160,"num_write":758,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.666557+0000","last_change":"2024-09-12T02:07:09.666557+0000","last_active":"2024-09-12T02:07:09.666557+0000","last_peered":"2024-09-12T02:07:09.666557+0000","last_clean":"2024-09-12T02:07:09.666557+0000","last_became_active":"2024-09-12T00:10:07.321180+0000","last_became_peered":"2024-09-12T00:10:07.321180+0000","last_unstale":"2024-09-12T02:07:09.666557+0000","last_undegraded":"2024-09-12T02:07:09.666557+0000","last_fullsized":"2024-09-12T02:07:09.666557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.666383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.666383+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.666383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:09.668378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"266'136","reported_seq":722,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.504910+0000","last_change":"2024-09-12T02:07:20.504910+0000","last_active":"2024-09-12T02:07:20.504910+0000","last_peered":"2024-09-12T02:07:20.504910+0000","last_clean":"2024-09-12T02:07:20.504910+0000","last_became_active":"2024-09-12T00:10:09.359011+0000","last_became_peered":"2024-09-12T00:10:09.359011+0000","last_unstale":"2024-09-12T02:07:20.504910+0000","last_undegraded":"2024-09-12T02:07:20.504910+0000","last_fullsized":"2024-09-12T02:07:20.504910+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'136","last_scrub_stamp":"2024-09-12T02:07:20.504684+0000","last_deep_scrub":"266'136","last_deep_scrub_stamp":"2024-09-12T02:07:20.504684+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.504684+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:40.032140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":320,"num_read_kb":272,"num_write":321,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"266'1105","reported_seq":2654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.037747+0000","last_change":"2024-09-12T02:07:00.037591+0000","last_active":"2024-09-12T02:07:00.037747+0000","last_peered":"2024-09-12T02:07:00.037747+0000","last_clean":"2024-09-12T02:07:00.037747+0000","last_became_active":"2024-09-12T00:10:01.248297+0000","last_became_peered":"2024-09-12T00:10:01.248297+0000","last_unstale":"2024-09-12T02:07:00.037747+0000","last_undegraded":"2024-09-12T02:07:00.037747+0000","last_fullsized":"2024-09-12T02:07:00.037747+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1105","last_scrub_stamp":"2024-09-12T02:07:00.037413+0000","last_deep_scrub":"266'1105","last_deep_scrub_stamp":"2024-09-12T02:07:00.037413+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.037413+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.519559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4909,"num_read_kb":4337,"num_write":1501,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"266'325","reported_seq":988,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.848958+0000","last_change":"2024-09-12T02:06:57.848683+0000","last_active":"2024-09-12T02:06:57.848958+0000","last_peered":"2024-09-12T02:06:57.848958+0000","last_clean":"2024-09-12T02:06:57.848958+0000","last_became_active":"2024-09-12T00:10:31.165905+0000","last_became_peered":"2024-09-12T00:10:31.165905+0000","last_unstale":"2024-09-12T02:06:57.848958+0000","last_undegraded":"2024-09-12T02:06:57.848958+0000","last_fullsized":"2024-09-12T02:06:57.848958+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'325","last_scrub_stamp":"2024-09-12T02:06:57.848241+0000","last_deep_scrub":"266'325","last_deep_scrub_stamp":"2024-09-12T02:06:57.848241+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.848241+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:33.677094+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273693,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":433,"num_read_kb":2613,"num_write":1035,"num_write_kb":17332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,7],"acting":[3,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.710647+0000","last_change":"2024-09-12T02:07:08.710647+0000","last_active":"2024-09-12T02:07:08.710647+0000","last_peered":"2024-09-12T02:07:08.710647+0000","last_clean":"2024-09-12T02:07:08.710647+0000","last_became_active":"2024-09-12T00:10:03.254056+0000","last_became_peered":"2024-09-12T00:10:03.254056+0000","last_unstale":"2024-09-12T02:07:08.710647+0000","last_undegraded":"2024-09-12T02:07:08.710647+0000","last_fullsized":"2024-09-12T02:07:08.710647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:08.710471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:08.710471+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.710471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:45.641565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"266'386","reported_seq":1032,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.005724+0000","last_change":"2024-09-12T02:07:19.005724+0000","last_active":"2024-09-12T02:07:19.005724+0000","last_peered":"2024-09-12T02:07:19.005724+0000","last_clean":"2024-09-12T02:07:19.005724+0000","last_became_active":"2024-09-12T00:10:05.299568+0000","last_became_peered":"2024-09-12T00:10:05.299568+0000","last_unstale":"2024-09-12T02:07:19.005724+0000","last_undegraded":"2024-09-12T02:07:19.005724+0000","last_fullsized":"2024-09-12T02:07:19.005724+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'386","last_scrub_stamp":"2024-09-12T02:07:19.005515+0000","last_deep_scrub":"266'386","last_deep_scrub_stamp":"2024-09-12T02:07:19.005515+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.005515+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:06.836073+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":635,"num_read_kb":1318,"num_write":554,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.636915+0000","last_change":"2024-09-12T02:07:22.636915+0000","last_active":"2024-09-12T02:07:22.636915+0000","last_peered":"2024-09-12T02:07:22.636915+0000","last_clean":"2024-09-12T02:07:22.636915+0000","last_became_active":"2024-09-12T00:10:07.334527+0000","last_became_peered":"2024-09-12T00:10:07.334527+0000","last_unstale":"2024-09-12T02:07:22.636915+0000","last_undegraded":"2024-09-12T02:07:22.636915+0000","last_fullsized":"2024-09-12T02:07:22.636915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:22.636687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:22.636687+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.636687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:15.135340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"266'175","reported_seq":755,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.964268+0000","last_change":"2024-09-12T02:07:32.964268+0000","last_active":"2024-09-12T02:07:32.964268+0000","last_peered":"2024-09-12T02:07:32.964268+0000","last_clean":"2024-09-12T02:07:32.964268+0000","last_became_active":"2024-09-12T00:10:09.373318+0000","last_became_peered":"2024-09-12T00:10:09.373318+0000","last_unstale":"2024-09-12T02:07:32.964268+0000","last_undegraded":"2024-09-12T02:07:32.964268+0000","last_fullsized":"2024-09-12T02:07:32.964268+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'175","last_scrub_stamp":"2024-09-12T02:07:32.964072+0000","last_deep_scrub":"266'175","last_deep_scrub_stamp":"2024-09-12T02:07:32.964072+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.964072+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:45.058830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":275,"num_write":406,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"266'793","reported_seq":2426,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.049441+0000","last_change":"2024-09-12T02:07:01.049290+0000","last_active":"2024-09-12T02:07:01.049441+0000","last_peered":"2024-09-12T02:07:01.049441+0000","last_clean":"2024-09-12T02:07:01.049441+0000","last_became_active":"2024-09-12T00:10:01.242213+0000","last_became_peered":"2024-09-12T00:10:01.242213+0000","last_unstale":"2024-09-12T02:07:01.049441+0000","last_undegraded":"2024-09-12T02:07:01.049441+0000","last_fullsized":"2024-09-12T02:07:01.049441+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'793","last_scrub_stamp":"2024-09-12T02:07:01.049091+0000","last_deep_scrub":"266'793","last_deep_scrub_stamp":"2024-09-12T02:07:01.049091+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.049091+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:47.730275+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3776,"num_read_kb":3427,"num_write":1023,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"266'387","reported_seq":1087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.183542+0000","last_change":"2024-09-12T02:06:57.183396+0000","last_active":"2024-09-12T02:06:57.183542+0000","last_peered":"2024-09-12T02:06:57.183542+0000","last_clean":"2024-09-12T02:06:57.183542+0000","last_became_active":"2024-09-12T00:09:59.298986+0000","last_became_peered":"2024-09-12T00:09:59.298986+0000","last_unstale":"2024-09-12T02:06:57.183542+0000","last_undegraded":"2024-09-12T02:06:57.183542+0000","last_fullsized":"2024-09-12T02:06:57.183542+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'387","last_scrub_stamp":"2024-09-12T02:06:57.183120+0000","last_deep_scrub":"266'387","last_deep_scrub_stamp":"2024-09-12T02:06:57.183120+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.183120+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:28.858130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":586,"num_read_kb":16563,"num_write":1186,"num_write_kb":29581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.329996+0000","last_change":"2024-09-12T02:07:06.329996+0000","last_active":"2024-09-12T02:07:06.329996+0000","last_peered":"2024-09-12T02:07:06.329996+0000","last_clean":"2024-09-12T02:07:06.329996+0000","last_became_active":"2024-09-12T00:10:03.262121+0000","last_became_peered":"2024-09-12T00:10:03.262121+0000","last_unstale":"2024-09-12T02:07:06.329996+0000","last_undegraded":"2024-09-12T02:07:06.329996+0000","last_fullsized":"2024-09-12T02:07:06.329996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:06.329806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:06.329806+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.329806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:06.288745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"266'396","reported_seq":1060,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.650731+0000","last_change":"2024-09-12T02:07:11.650583+0000","last_active":"2024-09-12T02:07:11.650731+0000","last_peered":"2024-09-12T02:07:11.650731+0000","last_clean":"2024-09-12T02:07:11.650731+0000","last_became_active":"2024-09-12T00:10:05.294629+0000","last_became_peered":"2024-09-12T00:10:05.294629+0000","last_unstale":"2024-09-12T02:07:11.650731+0000","last_undegraded":"2024-09-12T02:07:11.650731+0000","last_fullsized":"2024-09-12T02:07:11.650731+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'396","last_scrub_stamp":"2024-09-12T02:07:11.650372+0000","last_deep_scrub":"266'396","last_deep_scrub_stamp":"2024-09-12T02:07:11.650372+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.650372+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:14.428526+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46543,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":631,"num_read_kb":1251,"num_write":492,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"266'749","reported_seq":3296,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.619689+0000","last_change":"2024-09-12T02:07:10.619689+0000","last_active":"2024-09-12T02:07:10.619689+0000","last_peered":"2024-09-12T02:07:10.619689+0000","last_clean":"2024-09-12T02:07:10.619689+0000","last_became_active":"2024-09-12T00:10:07.314777+0000","last_became_peered":"2024-09-12T00:10:07.314777+0000","last_unstale":"2024-09-12T02:07:10.619689+0000","last_undegraded":"2024-09-12T02:07:10.619689+0000","last_fullsized":"2024-09-12T02:07:10.619689+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'749","last_scrub_stamp":"2024-09-12T02:07:10.619509+0000","last_deep_scrub":"266'749","last_deep_scrub_stamp":"2024-09-12T02:07:10.619509+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.619509+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:06.239730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"266'138","reported_seq":684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.467280+0000","last_change":"2024-09-12T02:07:17.467280+0000","last_active":"2024-09-12T02:07:17.467280+0000","last_peered":"2024-09-12T02:07:17.467280+0000","last_clean":"2024-09-12T02:07:17.467280+0000","last_became_active":"2024-09-12T00:10:09.346452+0000","last_became_peered":"2024-09-12T00:10:09.346452+0000","last_unstale":"2024-09-12T02:07:17.467280+0000","last_undegraded":"2024-09-12T02:07:17.467280+0000","last_fullsized":"2024-09-12T02:07:17.467280+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'138","last_scrub_stamp":"2024-09-12T02:07:17.467075+0000","last_deep_scrub":"266'138","last_deep_scrub_stamp":"2024-09-12T02:07:17.467075+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.467075+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:51.463617+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":133,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"266'1061","reported_seq":2659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.049484+0000","last_change":"2024-09-12T02:07:02.049238+0000","last_active":"2024-09-12T02:07:02.049484+0000","last_peered":"2024-09-12T02:07:02.049484+0000","last_clean":"2024-09-12T02:07:02.049484+0000","last_became_active":"2024-09-12T00:10:01.264718+0000","last_became_peered":"2024-09-12T00:10:01.264718+0000","last_unstale":"2024-09-12T02:07:02.049484+0000","last_undegraded":"2024-09-12T02:07:02.049484+0000","last_fullsized":"2024-09-12T02:07:02.049484+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1061","last_scrub_stamp":"2024-09-12T02:07:02.049006+0000","last_deep_scrub":"266'1061","last_deep_scrub_stamp":"2024-09-12T02:07:02.049006+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.049006+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":1000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:54.290718+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4853,"num_read_kb":4249,"num_write":1477,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1148,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"266'417","reported_seq":1122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.038069+0000","last_change":"2024-09-12T02:06:54.037809+0000","last_active":"2024-09-12T02:06:54.038069+0000","last_peered":"2024-09-12T02:06:54.038069+0000","last_clean":"2024-09-12T02:06:54.038069+0000","last_became_active":"2024-09-12T00:09:59.301303+0000","last_became_peered":"2024-09-12T00:09:59.301303+0000","last_unstale":"2024-09-12T02:06:54.038069+0000","last_undegraded":"2024-09-12T02:06:54.038069+0000","last_fullsized":"2024-09-12T02:06:54.038069+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'417","last_scrub_stamp":"2024-09-12T02:06:54.037420+0000","last_deep_scrub":"266'417","last_deep_scrub_stamp":"2024-09-12T02:06:54.037420+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.037420+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:35.287042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443899,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":39523,"num_write":1279,"num_write_kb":37758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.556793+0000","last_change":"2024-09-12T02:07:19.556652+0000","last_active":"2024-09-12T02:07:19.556793+0000","last_peered":"2024-09-12T02:07:19.556793+0000","last_clean":"2024-09-12T02:07:19.556793+0000","last_became_active":"2024-09-12T00:10:03.271281+0000","last_became_peered":"2024-09-12T00:10:03.271281+0000","last_unstale":"2024-09-12T02:07:19.556793+0000","last_undegraded":"2024-09-12T02:07:19.556793+0000","last_fullsized":"2024-09-12T02:07:19.556793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:19.556476+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:19.556476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.556476+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:33.140789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"266'152","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.960004+0000","last_change":"2024-09-12T02:07:16.960004+0000","last_active":"2024-09-12T02:07:16.960004+0000","last_peered":"2024-09-12T02:07:16.960004+0000","last_clean":"2024-09-12T02:07:16.960004+0000","last_became_active":"2024-09-12T00:10:05.362449+0000","last_became_peered":"2024-09-12T00:10:05.362449+0000","last_unstale":"2024-09-12T02:07:16.960004+0000","last_undegraded":"2024-09-12T02:07:16.960004+0000","last_fullsized":"2024-09-12T02:07:16.960004+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'152","last_scrub_stamp":"2024-09-12T02:07:16.959823+0000","last_deep_scrub":"266'152","last_deep_scrub_stamp":"2024-09-12T02:07:16.959823+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.959823+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:57.960409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"266'764","reported_seq":3355,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.068319+0000","last_change":"2024-09-12T02:07:11.068319+0000","last_active":"2024-09-12T02:07:11.068319+0000","last_peered":"2024-09-12T02:07:11.068319+0000","last_clean":"2024-09-12T02:07:11.068319+0000","last_became_active":"2024-09-12T00:10:07.318566+0000","last_became_peered":"2024-09-12T00:10:07.318566+0000","last_unstale":"2024-09-12T02:07:11.068319+0000","last_undegraded":"2024-09-12T02:07:11.068319+0000","last_fullsized":"2024-09-12T02:07:11.068319+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'764","last_scrub_stamp":"2024-09-12T02:07:11.068113+0000","last_deep_scrub":"266'764","last_deep_scrub_stamp":"2024-09-12T02:07:11.068113+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.068113+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:47.655491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"266'182","reported_seq":721,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.123207+0000","last_change":"2024-09-12T02:07:26.123207+0000","last_active":"2024-09-12T02:07:26.123207+0000","last_peered":"2024-09-12T02:07:26.123207+0000","last_clean":"2024-09-12T02:07:26.123207+0000","last_became_active":"2024-09-12T00:10:09.353213+0000","last_became_peered":"2024-09-12T00:10:09.353213+0000","last_unstale":"2024-09-12T02:07:26.123207+0000","last_undegraded":"2024-09-12T02:07:26.123207+0000","last_fullsized":"2024-09-12T02:07:26.123207+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T02:07:26.123006+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T02:07:26.123006+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.123006+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:26.036216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":410,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"266'439","reported_seq":1999,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.417775+0000","last_change":"2024-09-12T02:07:00.417624+0000","last_active":"2024-09-12T02:07:00.417775+0000","last_peered":"2024-09-12T02:07:00.417775+0000","last_clean":"2024-09-12T02:07:00.417775+0000","last_became_active":"2024-09-12T00:10:01.256287+0000","last_became_peered":"2024-09-12T00:10:01.256287+0000","last_unstale":"2024-09-12T02:07:00.417775+0000","last_undegraded":"2024-09-12T02:07:00.417775+0000","last_fullsized":"2024-09-12T02:07:00.417775+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'439","last_scrub_stamp":"2024-09-12T02:07:00.417437+0000","last_deep_scrub":"266'439","last_deep_scrub_stamp":"2024-09-12T02:07:00.417437+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.417437+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:35.069664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2163,"num_write":523,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"266'451","reported_seq":1398,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.877423+0000","last_change":"2024-09-12T02:06:54.877268+0000","last_active":"2024-09-12T02:06:54.877423+0000","last_peered":"2024-09-12T02:06:54.877423+0000","last_clean":"2024-09-12T02:06:54.877423+0000","last_became_active":"2024-09-12T00:10:31.168654+0000","last_became_peered":"2024-09-12T00:10:31.168654+0000","last_unstale":"2024-09-12T02:06:54.877423+0000","last_undegraded":"2024-09-12T02:06:54.877423+0000","last_fullsized":"2024-09-12T02:06:54.877423+0000","mapping_epoch":38,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'451","last_scrub_stamp":"2024-09-12T02:06:54.877036+0000","last_deep_scrub":"266'451","last_deep_scrub_stamp":"2024-09-12T02:06:54.877036+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.877036+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.689710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777138,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1245,"num_read_kb":67964,"num_write":1343,"num_write_kb":19763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.058610+0000","last_change":"2024-09-12T02:07:15.058610+0000","last_active":"2024-09-12T02:07:15.058610+0000","last_peered":"2024-09-12T02:07:15.058610+0000","last_clean":"2024-09-12T02:07:15.058610+0000","last_became_active":"2024-09-12T00:10:03.272284+0000","last_became_peered":"2024-09-12T00:10:03.272284+0000","last_unstale":"2024-09-12T02:07:15.058610+0000","last_undegraded":"2024-09-12T02:07:15.058610+0000","last_fullsized":"2024-09-12T02:07:15.058610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.058442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.058442+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.058442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:24.721522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"266'545","reported_seq":1236,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.609582+0000","last_change":"2024-09-12T02:07:20.609582+0000","last_active":"2024-09-12T02:07:20.609582+0000","last_peered":"2024-09-12T02:07:20.609582+0000","last_clean":"2024-09-12T02:07:20.609582+0000","last_became_active":"2024-09-12T00:10:05.300354+0000","last_became_peered":"2024-09-12T00:10:05.300354+0000","last_unstale":"2024-09-12T02:07:20.609582+0000","last_undegraded":"2024-09-12T02:07:20.609582+0000","last_fullsized":"2024-09-12T02:07:20.609582+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'545","last_scrub_stamp":"2024-09-12T02:07:20.609387+0000","last_deep_scrub":"266'545","last_deep_scrub_stamp":"2024-09-12T02:07:20.609387+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.609387+0000","objects_scrubbed":9,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:45.881011+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54476,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1438,"num_read_kb":1976,"num_write":2042,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488698,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.072344+0000","last_change":"2024-09-12T02:07:12.072344+0000","last_active":"2024-09-12T02:07:12.072344+0000","last_peered":"2024-09-12T02:07:12.072344+0000","last_clean":"2024-09-12T02:07:12.072344+0000","last_became_active":"2024-09-12T00:10:07.340008+0000","last_became_peered":"2024-09-12T00:10:07.340008+0000","last_unstale":"2024-09-12T02:07:12.072344+0000","last_undegraded":"2024-09-12T02:07:12.072344+0000","last_fullsized":"2024-09-12T02:07:12.072344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.072166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.072166+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.072166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:29.623883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"266'140","reported_seq":692,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.739637+0000","last_change":"2024-09-12T02:07:19.739637+0000","last_active":"2024-09-12T02:07:19.739637+0000","last_peered":"2024-09-12T02:07:19.739637+0000","last_clean":"2024-09-12T02:07:19.739637+0000","last_became_active":"2024-09-12T00:10:09.372231+0000","last_became_peered":"2024-09-12T00:10:09.372231+0000","last_unstale":"2024-09-12T02:07:19.739637+0000","last_undegraded":"2024-09-12T02:07:19.739637+0000","last_fullsized":"2024-09-12T02:07:19.739637+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'140","last_scrub_stamp":"2024-09-12T02:07:19.739438+0000","last_deep_scrub":"266'140","last_deep_scrub_stamp":"2024-09-12T02:07:19.739438+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.739438+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:41.681859+0000","scrub_duration":211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"266'757","reported_seq":2316,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.070990+0000","last_change":"2024-09-12T02:07:01.070708+0000","last_active":"2024-09-12T02:07:01.070990+0000","last_peered":"2024-09-12T02:07:01.070990+0000","last_clean":"2024-09-12T02:07:01.070990+0000","last_became_active":"2024-09-12T00:10:01.262490+0000","last_became_peered":"2024-09-12T00:10:01.262490+0000","last_unstale":"2024-09-12T02:07:01.070990+0000","last_undegraded":"2024-09-12T02:07:01.070990+0000","last_fullsized":"2024-09-12T02:07:01.070990+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'757","last_scrub_stamp":"2024-09-12T02:07:01.070499+0000","last_deep_scrub":"266'757","last_deep_scrub_stamp":"2024-09-12T02:07:01.070499+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.070499+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:21.203677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3216,"num_write":966,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.772265+0000","last_change":"2024-09-12T02:06:55.772265+0000","last_active":"2024-09-12T02:06:55.772265+0000","last_peered":"2024-09-12T02:06:55.772265+0000","last_clean":"2024-09-12T02:06:55.772265+0000","last_became_active":"2024-09-12T00:09:40.224430+0000","last_became_peered":"2024-09-12T00:09:40.224430+0000","last_unstale":"2024-09-12T02:06:55.772265+0000","last_undegraded":"2024-09-12T02:06:55.772265+0000","last_fullsized":"2024-09-12T02:06:55.772265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T02:06:55.772071+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T02:06:55.772071+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.772071+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:02.200479+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":566,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.755705+0000","last_change":"2024-09-12T02:06:55.755705+0000","last_active":"2024-09-12T02:06:55.755705+0000","last_peered":"2024-09-12T02:06:55.755705+0000","last_clean":"2024-09-12T02:06:55.755705+0000","last_became_active":"2024-09-12T00:09:46.162330+0000","last_became_peered":"2024-09-12T00:09:46.162330+0000","last_unstale":"2024-09-12T02:06:55.755705+0000","last_undegraded":"2024-09-12T02:06:55.755705+0000","last_fullsized":"2024-09-12T02:06:55.755705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:06:55.755515+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:06:55.755515+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.755515+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:19.877569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090615300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"266'321","reported_seq":992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.871360+0000","last_change":"2024-09-12T02:06:55.871360+0000","last_active":"2024-09-12T02:06:55.871360+0000","last_peered":"2024-09-12T02:06:55.871360+0000","last_clean":"2024-09-12T02:06:55.871360+0000","last_became_active":"2024-09-12T00:09:59.310092+0000","last_became_peered":"2024-09-12T00:09:59.310092+0000","last_unstale":"2024-09-12T02:06:55.871360+0000","last_undegraded":"2024-09-12T02:06:55.871360+0000","last_fullsized":"2024-09-12T02:06:55.871360+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'321","last_scrub_stamp":"2024-09-12T02:06:55.871078+0000","last_deep_scrub":"266'321","last_deep_scrub_stamp":"2024-09-12T02:06:55.871078+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.871078+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:49.767328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306611,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":13893,"num_write":1018,"num_write_kb":29182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"266'6","reported_seq":1019,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.875218+0000","last_change":"2024-09-12T02:07:11.875218+0000","last_active":"2024-09-12T02:07:11.875218+0000","last_peered":"2024-09-12T02:07:11.875218+0000","last_clean":"2024-09-12T02:07:11.875218+0000","last_became_active":"2024-09-12T00:10:03.261183+0000","last_became_peered":"2024-09-12T00:10:03.261183+0000","last_unstale":"2024-09-12T02:07:11.875218+0000","last_undegraded":"2024-09-12T02:07:11.875218+0000","last_fullsized":"2024-09-12T02:07:11.875218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T02:07:11.875038+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T02:07:11.875038+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.875038+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:02.168922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"266'814","reported_seq":1577,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.590850+0000","last_change":"2024-09-12T02:07:22.590850+0000","last_active":"2024-09-12T02:07:22.590850+0000","last_peered":"2024-09-12T02:07:22.590850+0000","last_clean":"2024-09-12T02:07:22.590850+0000","last_became_active":"2024-09-12T00:10:05.294267+0000","last_became_peered":"2024-09-12T00:10:05.294267+0000","last_unstale":"2024-09-12T02:07:22.590850+0000","last_undegraded":"2024-09-12T02:07:22.590850+0000","last_fullsized":"2024-09-12T02:07:22.590850+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'814","last_scrub_stamp":"2024-09-12T02:07:22.590669+0000","last_deep_scrub":"266'814","last_deep_scrub_stamp":"2024-09-12T02:07:22.590669+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.590669+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.111026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156191,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1567,"num_read_kb":3456,"num_write":1540,"num_write_kb":1367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107552,"num_omap_keys":260,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.612361+0000","last_change":"2024-09-12T02:07:21.612361+0000","last_active":"2024-09-12T02:07:21.612361+0000","last_peered":"2024-09-12T02:07:21.612361+0000","last_clean":"2024-09-12T02:07:21.612361+0000","last_became_active":"2024-09-12T00:10:07.323398+0000","last_became_peered":"2024-09-12T00:10:07.323398+0000","last_unstale":"2024-09-12T02:07:21.612361+0000","last_undegraded":"2024-09-12T02:07:21.612361+0000","last_fullsized":"2024-09-12T02:07:21.612361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:21.612192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:21.612192+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.612192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:53.420420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"266'249","reported_seq":1009,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.092694+0000","last_change":"2024-09-12T02:07:14.092694+0000","last_active":"2024-09-12T02:07:14.092694+0000","last_peered":"2024-09-12T02:07:14.092694+0000","last_clean":"2024-09-12T02:07:14.092694+0000","last_became_active":"2024-09-12T00:10:09.373661+0000","last_became_peered":"2024-09-12T00:10:09.373661+0000","last_unstale":"2024-09-12T02:07:14.092694+0000","last_undegraded":"2024-09-12T02:07:14.092694+0000","last_fullsized":"2024-09-12T02:07:14.092694+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'249","last_scrub_stamp":"2024-09-12T02:07:14.092461+0000","last_deep_scrub":"266'249","last_deep_scrub_stamp":"2024-09-12T02:07:14.092461+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.092461+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:24.522987+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":498,"num_write":430,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"266'1255","reported_seq":3064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.482860+0000","last_change":"2024-09-12T02:07:03.482730+0000","last_active":"2024-09-12T02:07:03.482860+0000","last_peered":"2024-09-12T02:07:03.482860+0000","last_clean":"2024-09-12T02:07:03.482860+0000","last_became_active":"2024-09-12T00:10:31.471885+0000","last_became_peered":"2024-09-12T00:10:31.471885+0000","last_unstale":"2024-09-12T02:07:03.482860+0000","last_undegraded":"2024-09-12T02:07:03.482860+0000","last_fullsized":"2024-09-12T02:07:03.482860+0000","mapping_epoch":38,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1255","last_scrub_stamp":"2024-09-12T02:07:03.482543+0000","last_deep_scrub":"266'1255","last_deep_scrub_stamp":"2024-09-12T02:07:03.482543+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.482543+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:26.888676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6022,"num_read_kb":5329,"num_write":1728,"num_write_kb":723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5360,"num_omap_keys":21,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":560,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.756739+0000","last_change":"2024-09-12T02:06:56.756739+0000","last_active":"2024-09-12T02:06:56.756739+0000","last_peered":"2024-09-12T02:06:56.756739+0000","last_clean":"2024-09-12T02:06:56.756739+0000","last_became_active":"2024-09-12T00:09:46.164248+0000","last_became_peered":"2024-09-12T00:09:46.164248+0000","last_unstale":"2024-09-12T02:06:56.756739+0000","last_undegraded":"2024-09-12T02:06:56.756739+0000","last_fullsized":"2024-09-12T02:06:56.756739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:56.756558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:56.756558+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.756558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:24.410460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099742600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"266'334","reported_seq":990,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.535461+0000","last_change":"2024-09-12T02:06:53.535461+0000","last_active":"2024-09-12T02:06:53.535461+0000","last_peered":"2024-09-12T02:06:53.535461+0000","last_clean":"2024-09-12T02:06:53.535461+0000","last_became_active":"2024-09-12T00:09:59.293880+0000","last_became_peered":"2024-09-12T00:09:59.293880+0000","last_unstale":"2024-09-12T02:06:53.535461+0000","last_undegraded":"2024-09-12T02:06:53.535461+0000","last_fullsized":"2024-09-12T02:06:53.535461+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'334","last_scrub_stamp":"2024-09-12T02:06:53.535293+0000","last_deep_scrub":"266'334","last_deep_scrub_stamp":"2024-09-12T02:06:53.535293+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.535293+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:40.126937+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5590248,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":16782,"num_write":1093,"num_write_kb":42263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.530675+0000","last_change":"2024-09-12T02:07:15.530675+0000","last_active":"2024-09-12T02:07:15.530675+0000","last_peered":"2024-09-12T02:07:15.530675+0000","last_clean":"2024-09-12T02:07:15.530675+0000","last_became_active":"2024-09-12T00:10:03.271454+0000","last_became_peered":"2024-09-12T00:10:03.271454+0000","last_unstale":"2024-09-12T02:07:15.530675+0000","last_undegraded":"2024-09-12T02:07:15.530675+0000","last_fullsized":"2024-09-12T02:07:15.530675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.530503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.530503+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.530503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:09.506727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"266'1460","reported_seq":3863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.403647+0000","last_change":"2024-09-12T02:07:13.403647+0000","last_active":"2024-09-12T02:07:13.403647+0000","last_peered":"2024-09-12T02:07:13.403647+0000","last_clean":"2024-09-12T02:07:13.403647+0000","last_became_active":"2024-09-12T00:10:05.295058+0000","last_became_peered":"2024-09-12T00:10:05.295058+0000","last_unstale":"2024-09-12T02:07:13.403647+0000","last_undegraded":"2024-09-12T02:07:13.403647+0000","last_fullsized":"2024-09-12T02:07:13.403647+0000","mapping_epoch":31,"log_start":"266'1400","ondisk_log_start":"266'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1460","last_scrub_stamp":"2024-09-12T02:07:13.403437+0000","last_deep_scrub":"266'1460","last_deep_scrub_stamp":"2024-09-12T02:07:13.403437+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.403437+0000","objects_scrubbed":12,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:33.536505+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161189,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2280,"num_read_kb":4238,"num_write":1386,"num_write_kb":1157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.882797+0000","last_change":"2024-09-12T02:07:24.882797+0000","last_active":"2024-09-12T02:07:24.882797+0000","last_peered":"2024-09-12T02:07:24.882797+0000","last_clean":"2024-09-12T02:07:24.882797+0000","last_became_active":"2024-09-12T00:10:07.319957+0000","last_became_peered":"2024-09-12T00:10:07.319957+0000","last_unstale":"2024-09-12T02:07:24.882797+0000","last_undegraded":"2024-09-12T02:07:24.882797+0000","last_fullsized":"2024-09-12T02:07:24.882797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.882615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.882615+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.882615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.172228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"266'87","reported_seq":618,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.537631+0000","last_change":"2024-09-12T02:07:21.537631+0000","last_active":"2024-09-12T02:07:21.537631+0000","last_peered":"2024-09-12T02:07:21.537631+0000","last_clean":"2024-09-12T02:07:21.537631+0000","last_became_active":"2024-09-12T00:10:09.430727+0000","last_became_peered":"2024-09-12T00:10:09.430727+0000","last_unstale":"2024-09-12T02:07:21.537631+0000","last_undegraded":"2024-09-12T02:07:21.537631+0000","last_fullsized":"2024-09-12T02:07:21.537631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'87","last_scrub_stamp":"2024-09-12T02:07:21.537445+0000","last_deep_scrub":"266'87","last_deep_scrub_stamp":"2024-09-12T02:07:21.537445+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.537445+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:02.227142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"266'639","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.450994+0000","last_change":"2024-09-12T02:06:58.450831+0000","last_active":"2024-09-12T02:06:58.450994+0000","last_peered":"2024-09-12T02:06:58.450994+0000","last_clean":"2024-09-12T02:06:58.450994+0000","last_became_active":"2024-09-12T00:10:01.277302+0000","last_became_peered":"2024-09-12T00:10:01.277302+0000","last_unstale":"2024-09-12T02:06:58.450994+0000","last_undegraded":"2024-09-12T02:06:58.450994+0000","last_fullsized":"2024-09-12T02:06:58.450994+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'639","last_scrub_stamp":"2024-09-12T02:06:58.450656+0000","last_deep_scrub":"266'639","last_deep_scrub_stamp":"2024-09-12T02:06:58.450656+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.450656+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:52.660098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3369,"num_read_kb":3119,"num_write":789,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":562,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.645702+0000","last_change":"2024-09-12T02:06:53.645702+0000","last_active":"2024-09-12T02:06:53.645702+0000","last_peered":"2024-09-12T02:06:53.645702+0000","last_clean":"2024-09-12T02:06:53.645702+0000","last_became_active":"2024-09-12T00:09:46.179853+0000","last_became_peered":"2024-09-12T00:09:46.179853+0000","last_unstale":"2024-09-12T02:06:53.645702+0000","last_undegraded":"2024-09-12T02:06:53.645702+0000","last_fullsized":"2024-09-12T02:06:53.645702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:53.645611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:53.645611+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.645611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:10.578130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056473999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"266'337","reported_seq":1051,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.539651+0000","last_change":"2024-09-12T02:06:54.539651+0000","last_active":"2024-09-12T02:06:54.539651+0000","last_peered":"2024-09-12T02:06:54.539651+0000","last_clean":"2024-09-12T02:06:54.539651+0000","last_became_active":"2024-09-12T00:09:59.317172+0000","last_became_peered":"2024-09-12T00:09:59.317172+0000","last_unstale":"2024-09-12T02:06:54.539651+0000","last_undegraded":"2024-09-12T02:06:54.539651+0000","last_fullsized":"2024-09-12T02:06:54.539651+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'337","last_scrub_stamp":"2024-09-12T02:06:54.539255+0000","last_deep_scrub":"266'337","last_deep_scrub_stamp":"2024-09-12T02:06:54.539255+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.539255+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:20.701196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":79957,"num_write":1084,"num_write_kb":20693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":538,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.747793+0000","last_change":"2024-09-12T02:07:06.747793+0000","last_active":"2024-09-12T02:07:06.747793+0000","last_peered":"2024-09-12T02:07:06.747793+0000","last_clean":"2024-09-12T02:07:06.747793+0000","last_became_active":"2024-09-12T00:10:03.274519+0000","last_became_peered":"2024-09-12T00:10:03.274519+0000","last_unstale":"2024-09-12T02:07:06.747793+0000","last_undegraded":"2024-09-12T02:07:06.747793+0000","last_fullsized":"2024-09-12T02:07:06.747793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:06.747613+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:06.747613+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.747613+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:42.645385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"266'406","reported_seq":2404,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.836963+0000","last_change":"2024-09-12T02:07:16.836963+0000","last_active":"2024-09-12T02:07:16.836963+0000","last_peered":"2024-09-12T02:07:16.836963+0000","last_clean":"2024-09-12T02:07:16.836963+0000","last_became_active":"2024-09-12T00:10:05.365417+0000","last_became_peered":"2024-09-12T00:10:05.365417+0000","last_unstale":"2024-09-12T02:07:16.836963+0000","last_undegraded":"2024-09-12T02:07:16.836963+0000","last_fullsized":"2024-09-12T02:07:16.836963+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'406","last_scrub_stamp":"2024-09-12T02:07:16.836746+0000","last_deep_scrub":"266'406","last_deep_scrub_stamp":"2024-09-12T02:07:16.836746+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.836746+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:37.314941+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":388,"num_read_kb":374,"num_write":387,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.563429+0000","last_change":"2024-09-12T02:07:18.563429+0000","last_active":"2024-09-12T02:07:18.563429+0000","last_peered":"2024-09-12T02:07:18.563429+0000","last_clean":"2024-09-12T02:07:18.563429+0000","last_became_active":"2024-09-12T00:10:07.319786+0000","last_became_peered":"2024-09-12T00:10:07.319786+0000","last_unstale":"2024-09-12T02:07:18.563429+0000","last_undegraded":"2024-09-12T02:07:18.563429+0000","last_fullsized":"2024-09-12T02:07:18.563429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:18.563252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:18.563252+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.563252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:27.472116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"266'255","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:00.504619+0000","last_change":"2024-09-12T00:10:09.366267+0000","last_active":"2024-09-12T02:05:00.504619+0000","last_peered":"2024-09-12T02:05:00.504619+0000","last_clean":"2024-09-12T02:05:00.504619+0000","last_became_active":"2024-09-12T00:10:09.365558+0000","last_became_peered":"2024-09-12T00:10:09.365558+0000","last_unstale":"2024-09-12T02:05:00.504619+0000","last_undegraded":"2024-09-12T02:05:00.504619+0000","last_fullsized":"2024-09-12T02:05:00.504619+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":520,"num_write":557,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"266'479","reported_seq":2058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.377367+0000","last_change":"2024-09-12T02:07:01.377367+0000","last_active":"2024-09-12T02:07:01.377367+0000","last_peered":"2024-09-12T02:07:01.377367+0000","last_clean":"2024-09-12T02:07:01.377367+0000","last_became_active":"2024-09-12T00:10:01.256107+0000","last_became_peered":"2024-09-12T00:10:01.256107+0000","last_unstale":"2024-09-12T02:07:01.377367+0000","last_undegraded":"2024-09-12T02:07:01.377367+0000","last_fullsized":"2024-09-12T02:07:01.377367+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'479","last_scrub_stamp":"2024-09-12T02:07:01.377182+0000","last_deep_scrub":"266'479","last_deep_scrub_stamp":"2024-09-12T02:07:01.377182+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.377182+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:21.624019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2517,"num_read_kb":2366,"num_write":564,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":567,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.713155+0000","last_change":"2024-09-12T02:06:54.713155+0000","last_active":"2024-09-12T02:06:54.713155+0000","last_peered":"2024-09-12T02:06:54.713155+0000","last_clean":"2024-09-12T02:06:54.713155+0000","last_became_active":"2024-09-12T00:09:46.161046+0000","last_became_peered":"2024-09-12T00:09:46.161046+0000","last_unstale":"2024-09-12T02:06:54.713155+0000","last_undegraded":"2024-09-12T02:06:54.713155+0000","last_fullsized":"2024-09-12T02:06:54.713155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:06:54.712965+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:06:54.712965+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.712965+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:06.136484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022130560000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"266'390","reported_seq":1054,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.642627+0000","last_change":"2024-09-12T02:06:52.642552+0000","last_active":"2024-09-12T02:06:52.642627+0000","last_peered":"2024-09-12T02:06:52.642627+0000","last_clean":"2024-09-12T02:06:52.642627+0000","last_became_active":"2024-09-12T00:10:31.473891+0000","last_became_peered":"2024-09-12T00:10:31.473891+0000","last_unstale":"2024-09-12T02:06:52.642627+0000","last_undegraded":"2024-09-12T02:06:52.642627+0000","last_fullsized":"2024-09-12T02:06:52.642627+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:06:52.642445+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:06:52.642445+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.642445+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:58.116732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1728219,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":35036,"num_write":1225,"num_write_kb":35348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.597469+0000","last_change":"2024-09-12T02:07:11.597228+0000","last_active":"2024-09-12T02:07:11.597469+0000","last_peered":"2024-09-12T02:07:11.597469+0000","last_clean":"2024-09-12T02:07:11.597469+0000","last_became_active":"2024-09-12T00:10:03.264991+0000","last_became_peered":"2024-09-12T00:10:03.264991+0000","last_unstale":"2024-09-12T02:07:11.597469+0000","last_undegraded":"2024-09-12T02:07:11.597469+0000","last_fullsized":"2024-09-12T02:07:11.597469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:11.597020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:11.597020+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.597020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:58.686303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"266'214","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.998971+0000","last_change":"2024-09-12T02:07:21.998971+0000","last_active":"2024-09-12T02:07:21.998971+0000","last_peered":"2024-09-12T02:07:21.998971+0000","last_clean":"2024-09-12T02:07:21.998971+0000","last_became_active":"2024-09-12T00:10:05.286433+0000","last_became_peered":"2024-09-12T00:10:05.286433+0000","last_unstale":"2024-09-12T02:07:21.998971+0000","last_undegraded":"2024-09-12T02:07:21.998971+0000","last_fullsized":"2024-09-12T02:07:21.998971+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'214","last_scrub_stamp":"2024-09-12T02:07:21.998706+0000","last_deep_scrub":"266'214","last_deep_scrub_stamp":"2024-09-12T02:07:21.998706+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.998706+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:58.514298+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":276,"num_read_kb":269,"num_write":202,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.113674+0000","last_change":"2024-09-12T02:07:15.113674+0000","last_active":"2024-09-12T02:07:15.113674+0000","last_peered":"2024-09-12T02:07:15.113674+0000","last_clean":"2024-09-12T02:07:15.113674+0000","last_became_active":"2024-09-12T00:10:07.329823+0000","last_became_peered":"2024-09-12T00:10:07.329823+0000","last_unstale":"2024-09-12T02:07:15.113674+0000","last_undegraded":"2024-09-12T02:07:15.113674+0000","last_fullsized":"2024-09-12T02:07:15.113674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.113498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.113498+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.113498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:56.771935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"266'102","reported_seq":691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.652236+0000","last_change":"2024-09-12T02:07:28.652236+0000","last_active":"2024-09-12T02:07:28.652236+0000","last_peered":"2024-09-12T02:07:28.652236+0000","last_clean":"2024-09-12T02:07:28.652236+0000","last_became_active":"2024-09-12T00:10:09.368176+0000","last_became_peered":"2024-09-12T00:10:09.368176+0000","last_unstale":"2024-09-12T02:07:28.652236+0000","last_undegraded":"2024-09-12T02:07:28.652236+0000","last_fullsized":"2024-09-12T02:07:28.652236+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'102","last_scrub_stamp":"2024-09-12T02:07:28.652064+0000","last_deep_scrub":"266'102","last_deep_scrub_stamp":"2024-09-12T02:07:28.652064+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.652064+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:15.298710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":222,"num_read_kb":212,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"266'448","reported_seq":2083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.466851+0000","last_change":"2024-09-12T02:06:59.466851+0000","last_active":"2024-09-12T02:06:59.466851+0000","last_peered":"2024-09-12T02:06:59.466851+0000","last_clean":"2024-09-12T02:06:59.466851+0000","last_became_active":"2024-09-12T00:10:01.275794+0000","last_became_peered":"2024-09-12T00:10:01.275794+0000","last_unstale":"2024-09-12T02:06:59.466851+0000","last_undegraded":"2024-09-12T02:06:59.466851+0000","last_fullsized":"2024-09-12T02:06:59.466851+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'448","last_scrub_stamp":"2024-09-12T02:06:59.466676+0000","last_deep_scrub":"266'448","last_deep_scrub_stamp":"2024-09-12T02:06:59.466676+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.466676+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:34.269252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":509,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"266'358","reported_seq":1072,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.725876+0000","last_change":"2024-09-12T02:06:56.725876+0000","last_active":"2024-09-12T02:06:56.725876+0000","last_peered":"2024-09-12T02:06:56.725876+0000","last_clean":"2024-09-12T02:06:56.725876+0000","last_became_active":"2024-09-12T00:09:59.262793+0000","last_became_peered":"2024-09-12T00:09:59.262793+0000","last_unstale":"2024-09-12T02:06:56.725876+0000","last_undegraded":"2024-09-12T02:06:56.725876+0000","last_fullsized":"2024-09-12T02:06:56.725876+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'358","last_scrub_stamp":"2024-09-12T02:06:56.725610+0000","last_deep_scrub":"266'358","last_deep_scrub_stamp":"2024-09-12T02:06:56.725610+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.725610+0000","objects_scrubbed":11,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.475621+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1952053,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":559,"num_read_kb":23144,"num_write":1133,"num_write_kb":26459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":560,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.602572+0000","last_change":"2024-09-12T02:06:52.602572+0000","last_active":"2024-09-12T02:06:52.602572+0000","last_peered":"2024-09-12T02:06:52.602572+0000","last_clean":"2024-09-12T02:06:52.602572+0000","last_became_active":"2024-09-12T00:09:46.178541+0000","last_became_peered":"2024-09-12T00:09:46.178541+0000","last_unstale":"2024-09-12T02:06:52.602572+0000","last_undegraded":"2024-09-12T02:06:52.602572+0000","last_fullsized":"2024-09-12T02:06:52.602572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:52.602473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:52.602473+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.602473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:51.748160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00107328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.543069+0000","last_change":"2024-09-12T02:07:13.543069+0000","last_active":"2024-09-12T02:07:13.543069+0000","last_peered":"2024-09-12T02:07:13.543069+0000","last_clean":"2024-09-12T02:07:13.543069+0000","last_became_active":"2024-09-12T00:10:03.258209+0000","last_became_peered":"2024-09-12T00:10:03.258209+0000","last_unstale":"2024-09-12T02:07:13.543069+0000","last_undegraded":"2024-09-12T02:07:13.543069+0000","last_fullsized":"2024-09-12T02:07:13.543069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.542886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.542886+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.542886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:53.684122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"266'741","reported_seq":1498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.557356+0000","last_change":"2024-09-12T02:07:15.557356+0000","last_active":"2024-09-12T02:07:15.557356+0000","last_peered":"2024-09-12T02:07:15.557356+0000","last_clean":"2024-09-12T02:07:15.557356+0000","last_became_active":"2024-09-12T00:10:05.289058+0000","last_became_peered":"2024-09-12T00:10:05.289058+0000","last_unstale":"2024-09-12T02:07:15.557356+0000","last_undegraded":"2024-09-12T02:07:15.557356+0000","last_fullsized":"2024-09-12T02:07:15.557356+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'741","last_scrub_stamp":"2024-09-12T02:07:15.557266+0000","last_deep_scrub":"266'741","last_deep_scrub_stamp":"2024-09-12T02:07:15.557266+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.557266+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:10.918921+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92166,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1168,"num_read_kb":2300,"num_write":1050,"num_write_kb":783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.073632+0000","last_change":"2024-09-12T02:07:22.073632+0000","last_active":"2024-09-12T02:07:22.073632+0000","last_peered":"2024-09-12T02:07:22.073632+0000","last_clean":"2024-09-12T02:07:22.073632+0000","last_became_active":"2024-09-12T00:10:07.326146+0000","last_became_peered":"2024-09-12T00:10:07.326146+0000","last_unstale":"2024-09-12T02:07:22.073632+0000","last_undegraded":"2024-09-12T02:07:22.073632+0000","last_fullsized":"2024-09-12T02:07:22.073632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:22.073451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:22.073451+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.073451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:54.639155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"266'139","reported_seq":672,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.571361+0000","last_change":"2024-09-12T02:07:30.571361+0000","last_active":"2024-09-12T02:07:30.571361+0000","last_peered":"2024-09-12T02:07:30.571361+0000","last_clean":"2024-09-12T02:07:30.571361+0000","last_became_active":"2024-09-12T00:10:09.433444+0000","last_became_peered":"2024-09-12T00:10:09.433444+0000","last_unstale":"2024-09-12T02:07:30.571361+0000","last_undegraded":"2024-09-12T02:07:30.571361+0000","last_fullsized":"2024-09-12T02:07:30.571361+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'139","last_scrub_stamp":"2024-09-12T02:07:30.571141+0000","last_deep_scrub":"266'139","last_deep_scrub_stamp":"2024-09-12T02:07:30.571141+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.571141+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:47.539180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"266'404","reported_seq":1916,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.480294+0000","last_change":"2024-09-12T02:07:02.480294+0000","last_active":"2024-09-12T02:07:02.480294+0000","last_peered":"2024-09-12T02:07:02.480294+0000","last_clean":"2024-09-12T02:07:02.480294+0000","last_became_active":"2024-09-12T00:10:01.282373+0000","last_became_peered":"2024-09-12T00:10:01.282373+0000","last_unstale":"2024-09-12T02:07:02.480294+0000","last_undegraded":"2024-09-12T02:07:02.480294+0000","last_fullsized":"2024-09-12T02:07:02.480294+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'404","last_scrub_stamp":"2024-09-12T02:07:02.480109+0000","last_deep_scrub":"266'404","last_deep_scrub_stamp":"2024-09-12T02:07:02.480109+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.480109+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:10.168566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2068,"num_read_kb":1970,"num_write":460,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"266'417","reported_seq":1205,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.505109+0000","last_change":"2024-09-12T02:06:55.505109+0000","last_active":"2024-09-12T02:06:55.505109+0000","last_peered":"2024-09-12T02:06:55.505109+0000","last_clean":"2024-09-12T02:06:55.505109+0000","last_became_active":"2024-09-12T00:09:59.251235+0000","last_became_peered":"2024-09-12T00:09:59.251235+0000","last_unstale":"2024-09-12T02:06:55.505109+0000","last_undegraded":"2024-09-12T02:06:55.505109+0000","last_fullsized":"2024-09-12T02:06:55.505109+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'417","last_scrub_stamp":"2024-09-12T02:06:55.504820+0000","last_deep_scrub":"266'417","last_deep_scrub_stamp":"2024-09-12T02:06:55.504820+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.504820+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:06.749291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":866,"num_read_kb":78676,"num_write":1275,"num_write_kb":36022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.781724+0000","last_change":"2024-09-12T02:06:57.781724+0000","last_active":"2024-09-12T02:06:57.781724+0000","last_peered":"2024-09-12T02:06:57.781724+0000","last_clean":"2024-09-12T02:06:57.781724+0000","last_became_active":"2024-09-12T00:09:46.177603+0000","last_became_peered":"2024-09-12T00:09:46.177603+0000","last_unstale":"2024-09-12T02:06:57.781724+0000","last_undegraded":"2024-09-12T02:06:57.781724+0000","last_fullsized":"2024-09-12T02:06:57.781724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:57.781540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:57.781540+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.781540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:12.770956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":539,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.051317+0000","last_change":"2024-09-12T02:07:04.051317+0000","last_active":"2024-09-12T02:07:04.051317+0000","last_peered":"2024-09-12T02:07:04.051317+0000","last_clean":"2024-09-12T02:07:04.051317+0000","last_became_active":"2024-09-12T00:10:03.258944+0000","last_became_peered":"2024-09-12T00:10:03.258944+0000","last_unstale":"2024-09-12T02:07:04.051317+0000","last_undegraded":"2024-09-12T02:07:04.051317+0000","last_fullsized":"2024-09-12T02:07:04.051317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.051138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.051138+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.051138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:03.444640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"266'265","reported_seq":917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.403890+0000","last_change":"2024-09-12T02:07:11.403890+0000","last_active":"2024-09-12T02:07:11.403890+0000","last_peered":"2024-09-12T02:07:11.403890+0000","last_clean":"2024-09-12T02:07:11.403890+0000","last_became_active":"2024-09-12T00:10:05.366757+0000","last_became_peered":"2024-09-12T00:10:05.366757+0000","last_unstale":"2024-09-12T02:07:11.403890+0000","last_undegraded":"2024-09-12T02:07:11.403890+0000","last_fullsized":"2024-09-12T02:07:11.403890+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'265","last_scrub_stamp":"2024-09-12T02:07:11.403703+0000","last_deep_scrub":"266'265","last_deep_scrub_stamp":"2024-09-12T02:07:11.403703+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.403703+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:13.743145+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":341,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"266'828","reported_seq":5684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.571003+0000","last_change":"2024-09-12T02:07:23.571003+0000","last_active":"2024-09-12T02:07:23.571003+0000","last_peered":"2024-09-12T02:07:23.571003+0000","last_clean":"2024-09-12T02:07:23.571003+0000","last_became_active":"2024-09-12T00:10:07.313773+0000","last_became_peered":"2024-09-12T00:10:07.313773+0000","last_unstale":"2024-09-12T02:07:23.571003+0000","last_undegraded":"2024-09-12T02:07:23.571003+0000","last_fullsized":"2024-09-12T02:07:23.571003+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'828","last_scrub_stamp":"2024-09-12T02:07:23.570826+0000","last_deep_scrub":"266'828","last_deep_scrub_stamp":"2024-09-12T02:07:23.570826+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.570826+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:31.624121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"266'132","reported_seq":667,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.938654+0000","last_change":"2024-09-12T02:07:30.938654+0000","last_active":"2024-09-12T02:07:30.938654+0000","last_peered":"2024-09-12T02:07:30.938654+0000","last_clean":"2024-09-12T02:07:30.938654+0000","last_became_active":"2024-09-12T00:10:09.430396+0000","last_became_peered":"2024-09-12T00:10:09.430396+0000","last_unstale":"2024-09-12T02:07:30.938654+0000","last_undegraded":"2024-09-12T02:07:30.938654+0000","last_fullsized":"2024-09-12T02:07:30.938654+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'132","last_scrub_stamp":"2024-09-12T02:07:30.938468+0000","last_deep_scrub":"266'132","last_deep_scrub_stamp":"2024-09-12T02:07:30.938468+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.938468+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.269375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"266'483","reported_seq":2204,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.924708+0000","last_change":"2024-09-12T02:07:11.924708+0000","last_active":"2024-09-12T02:07:11.924708+0000","last_peered":"2024-09-12T02:07:11.924708+0000","last_clean":"2024-09-12T02:07:11.924708+0000","last_became_active":"2024-09-12T00:10:01.261139+0000","last_became_peered":"2024-09-12T00:10:01.261139+0000","last_unstale":"2024-09-12T02:07:11.924708+0000","last_undegraded":"2024-09-12T02:07:11.924708+0000","last_fullsized":"2024-09-12T02:07:11.924708+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'483","last_scrub_stamp":"2024-09-12T02:07:11.924498+0000","last_deep_scrub":"266'483","last_deep_scrub_stamp":"2024-09-12T02:07:11.924498+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.924498+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:56.731333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2740,"num_read_kb":2607,"num_write":578,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"266'402","reported_seq":1219,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.868030+0000","last_change":"2024-09-12T02:06:53.867885+0000","last_active":"2024-09-12T02:06:53.868030+0000","last_peered":"2024-09-12T02:06:53.868030+0000","last_clean":"2024-09-12T02:06:53.868030+0000","last_became_active":"2024-09-12T00:09:59.280008+0000","last_became_peered":"2024-09-12T00:09:59.280008+0000","last_unstale":"2024-09-12T02:06:53.868030+0000","last_undegraded":"2024-09-12T02:06:53.868030+0000","last_fullsized":"2024-09-12T02:06:53.868030+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'402","last_scrub_stamp":"2024-09-12T02:06:53.867624+0000","last_deep_scrub":"266'402","last_deep_scrub_stamp":"2024-09-12T02:06:53.867624+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.867624+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:13.357536+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137185,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":708,"num_read_kb":14008,"num_write":1294,"num_write_kb":38960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.553213+0000","last_change":"2024-09-12T02:06:53.553213+0000","last_active":"2024-09-12T02:06:53.553213+0000","last_peered":"2024-09-12T02:06:53.553213+0000","last_clean":"2024-09-12T02:06:53.553213+0000","last_became_active":"2024-09-12T00:09:46.162309+0000","last_became_peered":"2024-09-12T00:09:46.162309+0000","last_unstale":"2024-09-12T02:06:53.553213+0000","last_undegraded":"2024-09-12T02:06:53.553213+0000","last_fullsized":"2024-09-12T02:06:53.553213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:53.553124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:53.553124+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.553124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:47.235429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010860449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":538,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.045962+0000","last_change":"2024-09-12T02:07:14.045962+0000","last_active":"2024-09-12T02:07:14.045962+0000","last_peered":"2024-09-12T02:07:14.045962+0000","last_clean":"2024-09-12T02:07:14.045962+0000","last_became_active":"2024-09-12T00:10:03.256290+0000","last_became_peered":"2024-09-12T00:10:03.256290+0000","last_unstale":"2024-09-12T02:07:14.045962+0000","last_undegraded":"2024-09-12T02:07:14.045962+0000","last_fullsized":"2024-09-12T02:07:14.045962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:14.045784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:14.045784+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.045784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:25.603999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"266'183","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.989414+0000","last_change":"2024-09-12T02:07:17.989414+0000","last_active":"2024-09-12T02:07:17.989414+0000","last_peered":"2024-09-12T02:07:17.989414+0000","last_clean":"2024-09-12T02:07:17.989414+0000","last_became_active":"2024-09-12T00:10:05.293955+0000","last_became_peered":"2024-09-12T00:10:05.293955+0000","last_unstale":"2024-09-12T02:07:17.989414+0000","last_undegraded":"2024-09-12T02:07:17.989414+0000","last_fullsized":"2024-09-12T02:07:17.989414+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'183","last_scrub_stamp":"2024-09-12T02:07:17.989219+0000","last_deep_scrub":"266'183","last_deep_scrub_stamp":"2024-09-12T02:07:17.989219+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.989219+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:50.640511+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":227,"num_write":154,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"266'827","reported_seq":5158,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:47.575460+0000","last_change":"2024-09-12T00:10:07.334366+0000","last_active":"2024-09-12T02:06:47.575460+0000","last_peered":"2024-09-12T02:06:47.575460+0000","last_clean":"2024-09-12T02:06:47.575460+0000","last_became_active":"2024-09-12T00:10:07.333642+0000","last_became_peered":"2024-09-12T00:10:07.333642+0000","last_unstale":"2024-09-12T02:06:47.575460+0000","last_undegraded":"2024-09-12T02:06:47.575460+0000","last_fullsized":"2024-09-12T02:06:47.575460+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:06.274702+0000","last_clean_scrub_stamp":"2024-09-12T00:10:06.274702+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:25.710728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"266'304","reported_seq":869,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.531909+0000","last_change":"2024-09-12T02:07:28.531909+0000","last_active":"2024-09-12T02:07:28.531909+0000","last_peered":"2024-09-12T02:07:28.531909+0000","last_clean":"2024-09-12T02:07:28.531909+0000","last_became_active":"2024-09-12T00:10:09.358708+0000","last_became_peered":"2024-09-12T00:10:09.358708+0000","last_unstale":"2024-09-12T02:07:28.531909+0000","last_undegraded":"2024-09-12T02:07:28.531909+0000","last_fullsized":"2024-09-12T02:07:28.531909+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'304","last_scrub_stamp":"2024-09-12T02:07:28.531729+0000","last_deep_scrub":"266'304","last_deep_scrub_stamp":"2024-09-12T02:07:28.531729+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.531729+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:25.701926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":399,"num_read_kb":387,"num_write":681,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"266'1118","reported_seq":2658,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.998245+0000","last_change":"2024-09-12T02:06:56.998245+0000","last_active":"2024-09-12T02:06:56.998245+0000","last_peered":"2024-09-12T02:06:56.998245+0000","last_clean":"2024-09-12T02:06:56.998245+0000","last_became_active":"2024-09-12T00:10:01.274310+0000","last_became_peered":"2024-09-12T00:10:01.274310+0000","last_unstale":"2024-09-12T02:06:56.998245+0000","last_undegraded":"2024-09-12T02:06:56.998245+0000","last_fullsized":"2024-09-12T02:06:56.998245+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1118","last_scrub_stamp":"2024-09-12T02:06:56.998048+0000","last_deep_scrub":"266'1118","last_deep_scrub_stamp":"2024-09-12T02:06:56.998048+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.998048+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":1100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:33.714167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5066,"num_read_kb":4471,"num_write":1537,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"266'372","reported_seq":1077,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.492593+0000","last_change":"2024-09-12T02:06:52.492480+0000","last_active":"2024-09-12T02:06:52.492593+0000","last_peered":"2024-09-12T02:06:52.492593+0000","last_clean":"2024-09-12T02:06:52.492593+0000","last_became_active":"2024-09-12T00:09:59.291630+0000","last_became_peered":"2024-09-12T00:09:59.291630+0000","last_unstale":"2024-09-12T02:06:52.492593+0000","last_undegraded":"2024-09-12T02:06:52.492593+0000","last_fullsized":"2024-09-12T02:06:52.492593+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'372","last_scrub_stamp":"2024-09-12T02:06:52.492329+0000","last_deep_scrub":"266'372","last_deep_scrub_stamp":"2024-09-12T02:06:52.492329+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.492329+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.589627+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306724,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":13946,"num_write":1174,"num_write_kb":43869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":561,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.202278+0000","last_change":"2024-09-12T02:06:55.202278+0000","last_active":"2024-09-12T02:06:55.202278+0000","last_peered":"2024-09-12T02:06:55.202278+0000","last_clean":"2024-09-12T02:06:55.202278+0000","last_became_active":"2024-09-12T00:09:46.163643+0000","last_became_peered":"2024-09-12T00:09:46.163643+0000","last_unstale":"2024-09-12T02:06:55.202278+0000","last_undegraded":"2024-09-12T02:06:55.202278+0000","last_fullsized":"2024-09-12T02:06:55.202278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:55.202103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:55.202103+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.202103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:46.554637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00095304600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":540,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.995648+0000","last_change":"2024-09-12T02:07:19.995648+0000","last_active":"2024-09-12T02:07:19.995648+0000","last_peered":"2024-09-12T02:07:19.995648+0000","last_clean":"2024-09-12T02:07:19.995648+0000","last_became_active":"2024-09-12T00:10:03.265087+0000","last_became_peered":"2024-09-12T00:10:03.265087+0000","last_unstale":"2024-09-12T02:07:19.995648+0000","last_undegraded":"2024-09-12T02:07:19.995648+0000","last_fullsized":"2024-09-12T02:07:19.995648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:19.995464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:19.995464+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.995464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:01.752957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"266'836","reported_seq":1634,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.867397+0000","last_change":"2024-09-12T02:07:15.867397+0000","last_active":"2024-09-12T02:07:15.867397+0000","last_peered":"2024-09-12T02:07:15.867397+0000","last_clean":"2024-09-12T02:07:15.867397+0000","last_became_active":"2024-09-12T00:10:05.361458+0000","last_became_peered":"2024-09-12T00:10:05.361458+0000","last_unstale":"2024-09-12T02:07:15.867397+0000","last_undegraded":"2024-09-12T02:07:15.867397+0000","last_fullsized":"2024-09-12T02:07:15.867397+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'836","last_scrub_stamp":"2024-09-12T02:07:15.867197+0000","last_deep_scrub":"266'836","last_deep_scrub_stamp":"2024-09-12T02:07:15.867197+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.867197+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.678521+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1463,"num_read_kb":3339,"num_write":1180,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.020129+0000","last_change":"2024-09-12T02:07:21.020129+0000","last_active":"2024-09-12T02:07:21.020129+0000","last_peered":"2024-09-12T02:07:21.020129+0000","last_clean":"2024-09-12T02:07:21.020129+0000","last_became_active":"2024-09-12T00:10:07.333984+0000","last_became_peered":"2024-09-12T00:10:07.333984+0000","last_unstale":"2024-09-12T02:07:21.020129+0000","last_undegraded":"2024-09-12T02:07:21.020129+0000","last_fullsized":"2024-09-12T02:07:21.020129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:21.019946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:21.019946+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.019946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:59.638445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"266'126","reported_seq":657,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.615767+0000","last_change":"2024-09-12T02:07:27.615767+0000","last_active":"2024-09-12T02:07:27.615767+0000","last_peered":"2024-09-12T02:07:27.615767+0000","last_clean":"2024-09-12T02:07:27.615767+0000","last_became_active":"2024-09-12T00:10:09.368289+0000","last_became_peered":"2024-09-12T00:10:09.368289+0000","last_unstale":"2024-09-12T02:07:27.615767+0000","last_undegraded":"2024-09-12T02:07:27.615767+0000","last_fullsized":"2024-09-12T02:07:27.615767+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'126","last_scrub_stamp":"2024-09-12T02:07:27.615559+0000","last_deep_scrub":"266'126","last_deep_scrub_stamp":"2024-09-12T02:07:27.615559+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.615559+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:04.535479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"266'158","reported_seq":754,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.561193+0000","last_change":"2024-09-12T02:07:31.561193+0000","last_active":"2024-09-12T02:07:31.561193+0000","last_peered":"2024-09-12T02:07:31.561193+0000","last_clean":"2024-09-12T02:07:31.561193+0000","last_became_active":"2024-09-12T00:10:09.372467+0000","last_became_peered":"2024-09-12T00:10:09.372467+0000","last_unstale":"2024-09-12T02:07:31.561193+0000","last_undegraded":"2024-09-12T02:07:31.561193+0000","last_fullsized":"2024-09-12T02:07:31.561193+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'158","last_scrub_stamp":"2024-09-12T02:07:31.561001+0000","last_deep_scrub":"266'158","last_deep_scrub_stamp":"2024-09-12T02:07:31.561001+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.561001+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:34.171025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":220,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"266'889","reported_seq":2706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.066271+0000","last_change":"2024-09-12T02:07:03.066271+0000","last_active":"2024-09-12T02:07:03.066271+0000","last_peered":"2024-09-12T02:07:03.066271+0000","last_clean":"2024-09-12T02:07:03.066271+0000","last_became_active":"2024-09-12T00:10:01.266479+0000","last_became_peered":"2024-09-12T00:10:01.266479+0000","last_unstale":"2024-09-12T02:07:03.066271+0000","last_undegraded":"2024-09-12T02:07:03.066271+0000","last_fullsized":"2024-09-12T02:07:03.066271+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'889","last_scrub_stamp":"2024-09-12T02:07:03.066081+0000","last_deep_scrub":"266'889","last_deep_scrub_stamp":"2024-09-12T02:07:03.066081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.066081+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:36.910267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4439,"num_read_kb":4016,"num_write":1172,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1578,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"266'328","reported_seq":1077,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.041051+0000","last_change":"2024-09-12T02:06:56.040868+0000","last_active":"2024-09-12T02:06:56.041051+0000","last_peered":"2024-09-12T02:06:56.041051+0000","last_clean":"2024-09-12T02:06:56.041051+0000","last_became_active":"2024-09-12T00:09:59.309979+0000","last_became_peered":"2024-09-12T00:09:59.309979+0000","last_unstale":"2024-09-12T02:06:56.041051+0000","last_undegraded":"2024-09-12T02:06:56.041051+0000","last_fullsized":"2024-09-12T02:06:56.041051+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'328","last_scrub_stamp":"2024-09-12T02:06:56.040661+0000","last_deep_scrub":"266'328","last_deep_scrub_stamp":"2024-09-12T02:06:56.040661+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.040661+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:55.878202+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":761,"num_read_kb":10875,"num_write":997,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.359965+0000","last_change":"2024-09-12T02:07:07.359965+0000","last_active":"2024-09-12T02:07:07.359965+0000","last_peered":"2024-09-12T02:07:07.359965+0000","last_clean":"2024-09-12T02:07:07.359965+0000","last_became_active":"2024-09-12T00:10:03.272547+0000","last_became_peered":"2024-09-12T00:10:03.272547+0000","last_unstale":"2024-09-12T02:07:07.359965+0000","last_undegraded":"2024-09-12T02:07:07.359965+0000","last_fullsized":"2024-09-12T02:07:07.359965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.359774+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.359774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:58.266703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"266'337","reported_seq":980,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.984776+0000","last_change":"2024-09-12T02:07:17.984776+0000","last_active":"2024-09-12T02:07:17.984776+0000","last_peered":"2024-09-12T02:07:17.984776+0000","last_clean":"2024-09-12T02:07:17.984776+0000","last_became_active":"2024-09-12T00:10:05.292446+0000","last_became_peered":"2024-09-12T00:10:05.292446+0000","last_unstale":"2024-09-12T02:07:17.984776+0000","last_undegraded":"2024-09-12T02:07:17.984776+0000","last_fullsized":"2024-09-12T02:07:17.984776+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'337","last_scrub_stamp":"2024-09-12T02:07:17.984572+0000","last_deep_scrub":"266'337","last_deep_scrub_stamp":"2024-09-12T02:07:17.984572+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.984572+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:22.772151+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16245,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1009,"num_write":400,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.990819+0000","last_change":"2024-09-12T02:07:25.990819+0000","last_active":"2024-09-12T02:07:25.990819+0000","last_peered":"2024-09-12T02:07:25.990819+0000","last_clean":"2024-09-12T02:07:25.990819+0000","last_became_active":"2024-09-12T00:10:07.335659+0000","last_became_peered":"2024-09-12T00:10:07.335659+0000","last_unstale":"2024-09-12T02:07:25.990819+0000","last_undegraded":"2024-09-12T02:07:25.990819+0000","last_fullsized":"2024-09-12T02:07:25.990819+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.990613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.990613+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.990613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:39.556676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"266'117","reported_seq":651,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.985674+0000","last_change":"2024-09-12T02:07:31.985674+0000","last_active":"2024-09-12T02:07:31.985674+0000","last_peered":"2024-09-12T02:07:31.985674+0000","last_clean":"2024-09-12T02:07:31.985674+0000","last_became_active":"2024-09-12T00:10:09.356043+0000","last_became_peered":"2024-09-12T00:10:09.356043+0000","last_unstale":"2024-09-12T02:07:31.985674+0000","last_undegraded":"2024-09-12T02:07:31.985674+0000","last_fullsized":"2024-09-12T02:07:31.985674+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'117","last_scrub_stamp":"2024-09-12T02:07:31.985481+0000","last_deep_scrub":"266'117","last_deep_scrub_stamp":"2024-09-12T02:07:31.985481+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.985481+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:17.328350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":102,"num_write":274,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"266'484","reported_seq":2046,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.337781+0000","last_change":"2024-09-12T02:07:04.337781+0000","last_active":"2024-09-12T02:07:04.337781+0000","last_peered":"2024-09-12T02:07:04.337781+0000","last_clean":"2024-09-12T02:07:04.337781+0000","last_became_active":"2024-09-12T00:10:01.264977+0000","last_became_peered":"2024-09-12T00:10:01.264977+0000","last_unstale":"2024-09-12T02:07:04.337781+0000","last_undegraded":"2024-09-12T02:07:04.337781+0000","last_fullsized":"2024-09-12T02:07:04.337781+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'484","last_scrub_stamp":"2024-09-12T02:07:04.337573+0000","last_deep_scrub":"266'484","last_deep_scrub_stamp":"2024-09-12T02:07:04.337573+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.337573+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.524170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2306,"num_write":570,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"266'380","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.767936+0000","last_change":"2024-09-12T02:07:01.767936+0000","last_active":"2024-09-12T02:07:01.767936+0000","last_peered":"2024-09-12T02:07:01.767936+0000","last_clean":"2024-09-12T02:07:01.767936+0000","last_became_active":"2024-09-12T00:09:59.300181+0000","last_became_peered":"2024-09-12T00:09:59.300181+0000","last_unstale":"2024-09-12T02:07:01.767936+0000","last_undegraded":"2024-09-12T02:07:01.767936+0000","last_fullsized":"2024-09-12T02:07:01.767936+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T02:07:01.767612+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T02:07:01.767612+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.767612+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:31.745878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":10768,"num_write":1216,"num_write_kb":35109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.965571+0000","last_change":"2024-09-12T02:07:15.965571+0000","last_active":"2024-09-12T02:07:15.965571+0000","last_peered":"2024-09-12T02:07:15.965571+0000","last_clean":"2024-09-12T02:07:15.965571+0000","last_became_active":"2024-09-12T00:10:03.256053+0000","last_became_peered":"2024-09-12T00:10:03.256053+0000","last_unstale":"2024-09-12T02:07:15.965571+0000","last_undegraded":"2024-09-12T02:07:15.965571+0000","last_fullsized":"2024-09-12T02:07:15.965571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.965361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.965361+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.965361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:34.211984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"266'77","reported_seq":626,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.583569+0000","last_change":"2024-09-12T02:07:14.583569+0000","last_active":"2024-09-12T02:07:14.583569+0000","last_peered":"2024-09-12T02:07:14.583569+0000","last_clean":"2024-09-12T02:07:14.583569+0000","last_became_active":"2024-09-12T00:10:05.288688+0000","last_became_peered":"2024-09-12T00:10:05.288688+0000","last_unstale":"2024-09-12T02:07:14.583569+0000","last_undegraded":"2024-09-12T02:07:14.583569+0000","last_fullsized":"2024-09-12T02:07:14.583569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'77","last_scrub_stamp":"2024-09-12T02:07:14.583337+0000","last_deep_scrub":"266'77","last_deep_scrub_stamp":"2024-09-12T02:07:14.583337+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.583337+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:04.333383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.832765+0000","last_change":"2024-09-12T02:07:21.832765+0000","last_active":"2024-09-12T02:07:21.832765+0000","last_peered":"2024-09-12T02:07:21.832765+0000","last_clean":"2024-09-12T02:07:21.832765+0000","last_became_active":"2024-09-12T00:10:07.320729+0000","last_became_peered":"2024-09-12T00:10:07.320729+0000","last_unstale":"2024-09-12T02:07:21.832765+0000","last_undegraded":"2024-09-12T02:07:21.832765+0000","last_fullsized":"2024-09-12T02:07:21.832765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:21.832583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:21.832583+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.832583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:12.758498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"266'205","reported_seq":751,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.523524+0000","last_change":"2024-09-12T02:07:29.523524+0000","last_active":"2024-09-12T02:07:29.523524+0000","last_peered":"2024-09-12T02:07:29.523524+0000","last_clean":"2024-09-12T02:07:29.523524+0000","last_became_active":"2024-09-12T00:10:09.362096+0000","last_became_peered":"2024-09-12T00:10:09.362096+0000","last_unstale":"2024-09-12T02:07:29.523524+0000","last_undegraded":"2024-09-12T02:07:29.523524+0000","last_fullsized":"2024-09-12T02:07:29.523524+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T02:07:29.523340+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T02:07:29.523340+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.523340+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:29.658240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":296,"num_read_kb":291,"num_write":467,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"266'433","reported_seq":2154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.964744+0000","last_change":"2024-09-12T02:07:04.964744+0000","last_active":"2024-09-12T02:07:04.964744+0000","last_peered":"2024-09-12T02:07:04.964744+0000","last_clean":"2024-09-12T02:07:04.964744+0000","last_became_active":"2024-09-12T00:10:01.261030+0000","last_became_peered":"2024-09-12T00:10:01.261030+0000","last_unstale":"2024-09-12T02:07:04.964744+0000","last_undegraded":"2024-09-12T02:07:04.964744+0000","last_fullsized":"2024-09-12T02:07:04.964744+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'433","last_scrub_stamp":"2024-09-12T02:07:04.964572+0000","last_deep_scrub":"266'433","last_deep_scrub_stamp":"2024-09-12T02:07:04.964572+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.964572+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:57.148348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2550,"num_read_kb":2440,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2736,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"266'384","reported_seq":1086,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.676078+0000","last_change":"2024-09-12T02:06:57.676078+0000","last_active":"2024-09-12T02:06:57.676078+0000","last_peered":"2024-09-12T02:06:57.676078+0000","last_clean":"2024-09-12T02:06:57.676078+0000","last_became_active":"2024-09-12T00:09:59.288100+0000","last_became_peered":"2024-09-12T00:09:59.288100+0000","last_unstale":"2024-09-12T02:06:57.676078+0000","last_undegraded":"2024-09-12T02:06:57.676078+0000","last_fullsized":"2024-09-12T02:06:57.676078+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'384","last_scrub_stamp":"2024-09-12T02:06:57.675785+0000","last_deep_scrub":"266'384","last_deep_scrub_stamp":"2024-09-12T02:06:57.675785+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.675785+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:31.989566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":599,"num_read_kb":15869,"num_write":1177,"num_write_kb":23659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.856047+0000","last_change":"2024-09-12T02:07:13.856047+0000","last_active":"2024-09-12T02:07:13.856047+0000","last_peered":"2024-09-12T02:07:13.856047+0000","last_clean":"2024-09-12T02:07:13.856047+0000","last_became_active":"2024-09-12T00:10:03.255669+0000","last_became_peered":"2024-09-12T00:10:03.255669+0000","last_unstale":"2024-09-12T02:07:13.856047+0000","last_undegraded":"2024-09-12T02:07:13.856047+0000","last_fullsized":"2024-09-12T02:07:13.856047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.855842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.855842+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.855842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:48.988845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"266'350","reported_seq":1004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.991907+0000","last_change":"2024-09-12T02:07:27.991907+0000","last_active":"2024-09-12T02:07:27.991907+0000","last_peered":"2024-09-12T02:07:27.991907+0000","last_clean":"2024-09-12T02:07:27.991907+0000","last_became_active":"2024-09-12T00:10:05.299730+0000","last_became_peered":"2024-09-12T00:10:05.299730+0000","last_unstale":"2024-09-12T02:07:27.991907+0000","last_undegraded":"2024-09-12T02:07:27.991907+0000","last_fullsized":"2024-09-12T02:07:27.991907+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'350","last_scrub_stamp":"2024-09-12T02:07:27.991701+0000","last_deep_scrub":"266'350","last_deep_scrub_stamp":"2024-09-12T02:07:27.991701+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.991701+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:15.725731+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58900,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1109,"num_write":428,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.084311+0000","last_change":"2024-09-12T02:07:13.084311+0000","last_active":"2024-09-12T02:07:13.084311+0000","last_peered":"2024-09-12T02:07:13.084311+0000","last_clean":"2024-09-12T02:07:13.084311+0000","last_became_active":"2024-09-12T00:10:07.329741+0000","last_became_peered":"2024-09-12T00:10:07.329741+0000","last_unstale":"2024-09-12T02:07:13.084311+0000","last_undegraded":"2024-09-12T02:07:13.084311+0000","last_fullsized":"2024-09-12T02:07:13.084311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.084128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.084128+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.084128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:04.189686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"266'91","reported_seq":631,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.671249+0000","last_change":"2024-09-12T02:07:29.671249+0000","last_active":"2024-09-12T02:07:29.671249+0000","last_peered":"2024-09-12T02:07:29.671249+0000","last_clean":"2024-09-12T02:07:29.671249+0000","last_became_active":"2024-09-12T00:10:09.371755+0000","last_became_peered":"2024-09-12T00:10:09.371755+0000","last_unstale":"2024-09-12T02:07:29.671249+0000","last_undegraded":"2024-09-12T02:07:29.671249+0000","last_fullsized":"2024-09-12T02:07:29.671249+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'91","last_scrub_stamp":"2024-09-12T02:07:29.671047+0000","last_deep_scrub":"266'91","last_deep_scrub_stamp":"2024-09-12T02:07:29.671047+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.671047+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:47.726332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":213,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"266'805","reported_seq":2443,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.987469+0000","last_change":"2024-09-12T02:07:14.987469+0000","last_active":"2024-09-12T02:07:14.987469+0000","last_peered":"2024-09-12T02:07:14.987469+0000","last_clean":"2024-09-12T02:07:14.987469+0000","last_became_active":"2024-09-12T00:10:01.258814+0000","last_became_peered":"2024-09-12T00:10:01.258814+0000","last_unstale":"2024-09-12T02:07:14.987469+0000","last_undegraded":"2024-09-12T02:07:14.987469+0000","last_fullsized":"2024-09-12T02:07:14.987469+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'805","last_scrub_stamp":"2024-09-12T02:07:14.987293+0000","last_deep_scrub":"266'805","last_deep_scrub_stamp":"2024-09-12T02:07:14.987293+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.987293+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:04.316537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3906,"num_read_kb":3532,"num_write":1046,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"266'415","reported_seq":1087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.547391+0000","last_change":"2024-09-12T02:06:56.547391+0000","last_active":"2024-09-12T02:06:56.547391+0000","last_peered":"2024-09-12T02:06:56.547391+0000","last_clean":"2024-09-12T02:06:56.547391+0000","last_became_active":"2024-09-12T00:09:59.262775+0000","last_became_peered":"2024-09-12T00:09:59.262775+0000","last_unstale":"2024-09-12T02:06:56.547391+0000","last_undegraded":"2024-09-12T02:06:56.547391+0000","last_fullsized":"2024-09-12T02:06:56.547391+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'415","last_scrub_stamp":"2024-09-12T02:06:56.547179+0000","last_deep_scrub":"266'415","last_deep_scrub_stamp":"2024-09-12T02:06:56.547179+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.547179+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.608245+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":557,"num_read_kb":527,"num_write":1329,"num_write_kb":18885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.038234+0000","last_change":"2024-09-12T02:07:08.038234+0000","last_active":"2024-09-12T02:07:08.038234+0000","last_peered":"2024-09-12T02:07:08.038234+0000","last_clean":"2024-09-12T02:07:08.038234+0000","last_became_active":"2024-09-12T00:10:03.257953+0000","last_became_peered":"2024-09-12T00:10:03.257953+0000","last_unstale":"2024-09-12T02:07:08.038234+0000","last_undegraded":"2024-09-12T02:07:08.038234+0000","last_fullsized":"2024-09-12T02:07:08.038234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:08.038057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:08.038057+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.038057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:22.867531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"266'331","reported_seq":953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.855409+0000","last_change":"2024-09-12T02:07:18.855409+0000","last_active":"2024-09-12T02:07:18.855409+0000","last_peered":"2024-09-12T02:07:18.855409+0000","last_clean":"2024-09-12T02:07:18.855409+0000","last_became_active":"2024-09-12T00:10:05.285485+0000","last_became_peered":"2024-09-12T00:10:05.285485+0000","last_unstale":"2024-09-12T02:07:18.855409+0000","last_undegraded":"2024-09-12T02:07:18.855409+0000","last_fullsized":"2024-09-12T02:07:18.855409+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'331","last_scrub_stamp":"2024-09-12T02:07:18.855228+0000","last_deep_scrub":"266'331","last_deep_scrub_stamp":"2024-09-12T02:07:18.855228+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.855228+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:33.365002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":1250,"num_write":446,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.616188+0000","last_change":"2024-09-12T02:07:23.616188+0000","last_active":"2024-09-12T02:07:23.616188+0000","last_peered":"2024-09-12T02:07:23.616188+0000","last_clean":"2024-09-12T02:07:23.616188+0000","last_became_active":"2024-09-12T00:10:07.325482+0000","last_became_peered":"2024-09-12T00:10:07.325482+0000","last_unstale":"2024-09-12T02:07:23.616188+0000","last_undegraded":"2024-09-12T02:07:23.616188+0000","last_fullsized":"2024-09-12T02:07:23.616188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:23.616016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:23.616016+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.616016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:14.088072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"266'842","reported_seq":2411,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.057496+0000","last_change":"2024-09-12T02:07:06.057496+0000","last_active":"2024-09-12T02:07:06.057496+0000","last_peered":"2024-09-12T02:07:06.057496+0000","last_clean":"2024-09-12T02:07:06.057496+0000","last_became_active":"2024-09-12T00:10:01.276906+0000","last_became_peered":"2024-09-12T00:10:01.276906+0000","last_unstale":"2024-09-12T02:07:06.057496+0000","last_undegraded":"2024-09-12T02:07:06.057496+0000","last_fullsized":"2024-09-12T02:07:06.057496+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'842","last_scrub_stamp":"2024-09-12T02:07:06.057301+0000","last_deep_scrub":"266'842","last_deep_scrub_stamp":"2024-09-12T02:07:06.057301+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.057301+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:30.646553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3919,"num_read_kb":3507,"num_write":1092,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"266'321","reported_seq":1003,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.854948+0000","last_change":"2024-09-12T02:06:58.854948+0000","last_active":"2024-09-12T02:06:58.854948+0000","last_peered":"2024-09-12T02:06:58.854948+0000","last_clean":"2024-09-12T02:06:58.854948+0000","last_became_active":"2024-09-12T00:09:59.248681+0000","last_became_peered":"2024-09-12T00:09:59.248681+0000","last_unstale":"2024-09-12T02:06:58.854948+0000","last_undegraded":"2024-09-12T02:06:58.854948+0000","last_fullsized":"2024-09-12T02:06:58.854948+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'321","last_scrub_stamp":"2024-09-12T02:06:58.854706+0000","last_deep_scrub":"266'321","last_deep_scrub_stamp":"2024-09-12T02:06:58.854706+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.854706+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:53.988034+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1398999,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":23744,"num_write":1111,"num_write_kb":29955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":537,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.562161+0000","last_change":"2024-09-12T02:07:12.562161+0000","last_active":"2024-09-12T02:07:12.562161+0000","last_peered":"2024-09-12T02:07:12.562161+0000","last_clean":"2024-09-12T02:07:12.562161+0000","last_became_active":"2024-09-12T00:10:03.260387+0000","last_became_peered":"2024-09-12T00:10:03.260387+0000","last_unstale":"2024-09-12T02:07:12.562161+0000","last_undegraded":"2024-09-12T02:07:12.562161+0000","last_fullsized":"2024-09-12T02:07:12.562161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.561935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.561935+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.561935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:15.815479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"266'548","reported_seq":1234,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.430071+0000","last_change":"2024-09-12T02:07:15.430071+0000","last_active":"2024-09-12T02:07:15.430071+0000","last_peered":"2024-09-12T02:07:15.430071+0000","last_clean":"2024-09-12T02:07:15.430071+0000","last_became_active":"2024-09-12T00:10:05.300613+0000","last_became_peered":"2024-09-12T00:10:05.300613+0000","last_unstale":"2024-09-12T02:07:15.430071+0000","last_undegraded":"2024-09-12T02:07:15.430071+0000","last_fullsized":"2024-09-12T02:07:15.430071+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'548","last_scrub_stamp":"2024-09-12T02:07:15.429949+0000","last_deep_scrub":"266'548","last_deep_scrub_stamp":"2024-09-12T02:07:15.429949+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.429949+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:50.425830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102448,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":959,"num_read_kb":2206,"num_write":818,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.588181+0000","last_change":"2024-09-12T02:07:24.588181+0000","last_active":"2024-09-12T02:07:24.588181+0000","last_peered":"2024-09-12T02:07:24.588181+0000","last_clean":"2024-09-12T02:07:24.588181+0000","last_became_active":"2024-09-12T00:10:07.342700+0000","last_became_peered":"2024-09-12T00:10:07.342700+0000","last_unstale":"2024-09-12T02:07:24.588181+0000","last_undegraded":"2024-09-12T02:07:24.588181+0000","last_fullsized":"2024-09-12T02:07:24.588181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.588000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.588000+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.588000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:15.029488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"266'157","reported_seq":688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:28.976271+0000","last_change":"2024-09-12T00:10:09.436544+0000","last_active":"2024-09-12T02:04:28.976271+0000","last_peered":"2024-09-12T02:04:28.976271+0000","last_clean":"2024-09-12T02:04:28.976271+0000","last_became_active":"2024-09-12T00:10:09.435513+0000","last_became_peered":"2024-09-12T00:10:09.435513+0000","last_unstale":"2024-09-12T02:04:28.976271+0000","last_undegraded":"2024-09-12T02:04:28.976271+0000","last_fullsized":"2024-09-12T02:04:28.976271+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:10:08.314628+0000","last_clean_scrub_stamp":"2024-09-12T00:10:08.314628+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:42.230555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":193,"num_write":343,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"266'812","reported_seq":2378,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.541839+0000","last_change":"2024-09-12T02:07:06.541839+0000","last_active":"2024-09-12T02:07:06.541839+0000","last_peered":"2024-09-12T02:07:06.541839+0000","last_clean":"2024-09-12T02:07:06.541839+0000","last_became_active":"2024-09-12T00:10:01.260115+0000","last_became_peered":"2024-09-12T00:10:01.260115+0000","last_unstale":"2024-09-12T02:07:06.541839+0000","last_undegraded":"2024-09-12T02:07:06.541839+0000","last_fullsized":"2024-09-12T02:07:06.541839+0000","mapping_epoch":27,"log_start":"266'801","ondisk_log_start":"266'801","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'812","last_scrub_stamp":"2024-09-12T02:07:06.541653+0000","last_deep_scrub":"266'812","last_deep_scrub_stamp":"2024-09-12T02:07:06.541653+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.541653+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":801,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:47.466063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3786,"num_read_kb":3403,"num_write":1061,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"266'381","reported_seq":1164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.433070+0000","last_change":"2024-09-12T02:06:57.433070+0000","last_active":"2024-09-12T02:06:57.433070+0000","last_peered":"2024-09-12T02:06:57.433070+0000","last_clean":"2024-09-12T02:06:57.433070+0000","last_became_active":"2024-09-12T00:09:59.285792+0000","last_became_peered":"2024-09-12T00:09:59.285792+0000","last_unstale":"2024-09-12T02:06:57.433070+0000","last_undegraded":"2024-09-12T02:06:57.433070+0000","last_fullsized":"2024-09-12T02:06:57.433070+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:06:57.432824+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:06:57.432824+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.432824+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:51.237303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":739,"num_read_kb":25287,"num_write":1212,"num_write_kb":29345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":539,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.050934+0000","last_change":"2024-09-12T02:07:09.050934+0000","last_active":"2024-09-12T02:07:09.050934+0000","last_peered":"2024-09-12T02:07:09.050934+0000","last_clean":"2024-09-12T02:07:09.050934+0000","last_became_active":"2024-09-12T00:10:03.257760+0000","last_became_peered":"2024-09-12T00:10:03.257760+0000","last_unstale":"2024-09-12T02:07:09.050934+0000","last_undegraded":"2024-09-12T02:07:09.050934+0000","last_fullsized":"2024-09-12T02:07:09.050934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.050754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.050754+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.050754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"266'390","reported_seq":1044,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.818678+0000","last_change":"2024-09-12T02:07:20.818678+0000","last_active":"2024-09-12T02:07:20.818678+0000","last_peered":"2024-09-12T02:07:20.818678+0000","last_clean":"2024-09-12T02:07:20.818678+0000","last_became_active":"2024-09-12T00:10:05.292902+0000","last_became_peered":"2024-09-12T00:10:05.292902+0000","last_unstale":"2024-09-12T02:07:20.818678+0000","last_undegraded":"2024-09-12T02:07:20.818678+0000","last_fullsized":"2024-09-12T02:07:20.818678+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:07:20.818372+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:07:20.818372+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.818372+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:37.386926+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":1193,"num_write":510,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.506402+0000","last_change":"2024-09-12T02:07:18.506402+0000","last_active":"2024-09-12T02:07:18.506402+0000","last_peered":"2024-09-12T02:07:18.506402+0000","last_clean":"2024-09-12T02:07:18.506402+0000","last_became_active":"2024-09-12T00:10:07.321400+0000","last_became_peered":"2024-09-12T00:10:07.321400+0000","last_unstale":"2024-09-12T02:07:18.506402+0000","last_undegraded":"2024-09-12T02:07:18.506402+0000","last_fullsized":"2024-09-12T02:07:18.506402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:18.506178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:18.506178+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.506178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:58.545356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"266'192","reported_seq":755,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.089900+0000","last_change":"2024-09-12T02:07:17.089900+0000","last_active":"2024-09-12T02:07:17.089900+0000","last_peered":"2024-09-12T02:07:17.089900+0000","last_clean":"2024-09-12T02:07:17.089900+0000","last_became_active":"2024-09-12T00:10:09.355548+0000","last_became_peered":"2024-09-12T00:10:09.355548+0000","last_unstale":"2024-09-12T02:07:17.089900+0000","last_undegraded":"2024-09-12T02:07:17.089900+0000","last_fullsized":"2024-09-12T02:07:17.089900+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'192","last_scrub_stamp":"2024-09-12T02:07:17.089680+0000","last_deep_scrub":"266'192","last_deep_scrub_stamp":"2024-09-12T02:07:17.089680+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.089680+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:17.343686+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":268,"num_write":529,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"266'396","reported_seq":1789,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.971760+0000","last_change":"2024-09-12T02:07:09.971585+0000","last_active":"2024-09-12T02:07:09.971760+0000","last_peered":"2024-09-12T02:07:09.971760+0000","last_clean":"2024-09-12T02:07:09.971760+0000","last_became_active":"2024-09-12T00:10:01.256781+0000","last_became_peered":"2024-09-12T00:10:01.256781+0000","last_unstale":"2024-09-12T02:07:09.971760+0000","last_undegraded":"2024-09-12T02:07:09.971760+0000","last_fullsized":"2024-09-12T02:07:09.971760+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'396","last_scrub_stamp":"2024-09-12T02:07:09.971392+0000","last_deep_scrub":"266'396","last_deep_scrub_stamp":"2024-09-12T02:07:09.971392+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.971392+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:53.393957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1972,"num_read_kb":1849,"num_write":456,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"266'342","reported_seq":993,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.004650+0000","last_change":"2024-09-12T02:06:55.004394+0000","last_active":"2024-09-12T02:06:55.004650+0000","last_peered":"2024-09-12T02:06:55.004650+0000","last_clean":"2024-09-12T02:06:55.004650+0000","last_became_active":"2024-09-12T00:09:59.295949+0000","last_became_peered":"2024-09-12T00:09:59.295949+0000","last_unstale":"2024-09-12T02:06:55.004650+0000","last_undegraded":"2024-09-12T02:06:55.004650+0000","last_fullsized":"2024-09-12T02:06:55.004650+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'342","last_scrub_stamp":"2024-09-12T02:06:55.004131+0000","last_deep_scrub":"266'342","last_deep_scrub_stamp":"2024-09-12T02:06:55.004131+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.004131+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:24.111205+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314586,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":1958,"num_write":1004,"num_write_kb":21693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.015988+0000","last_change":"2024-09-12T02:07:17.015850+0000","last_active":"2024-09-12T02:07:17.015988+0000","last_peered":"2024-09-12T02:07:17.015988+0000","last_clean":"2024-09-12T02:07:17.015988+0000","last_became_active":"2024-09-12T00:10:03.254941+0000","last_became_peered":"2024-09-12T00:10:03.254941+0000","last_unstale":"2024-09-12T02:07:17.015988+0000","last_undegraded":"2024-09-12T02:07:17.015988+0000","last_fullsized":"2024-09-12T02:07:17.015988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:17.015656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:17.015656+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.015656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:35.259126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"266'352","reported_seq":1002,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.005634+0000","last_change":"2024-09-12T02:07:25.005634+0000","last_active":"2024-09-12T02:07:25.005634+0000","last_peered":"2024-09-12T02:07:25.005634+0000","last_clean":"2024-09-12T02:07:25.005634+0000","last_became_active":"2024-09-12T00:10:05.362151+0000","last_became_peered":"2024-09-12T00:10:05.362151+0000","last_unstale":"2024-09-12T02:07:25.005634+0000","last_undegraded":"2024-09-12T02:07:25.005634+0000","last_fullsized":"2024-09-12T02:07:25.005634+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'352","last_scrub_stamp":"2024-09-12T02:07:25.005436+0000","last_deep_scrub":"266'352","last_deep_scrub_stamp":"2024-09-12T02:07:25.005436+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.005436+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:16.267655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45165,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":1204,"num_write":458,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.414408+0000","last_change":"2024-09-12T02:07:16.414408+0000","last_active":"2024-09-12T02:07:16.414408+0000","last_peered":"2024-09-12T02:07:16.414408+0000","last_clean":"2024-09-12T02:07:16.414408+0000","last_became_active":"2024-09-12T00:10:07.336129+0000","last_became_peered":"2024-09-12T00:10:07.336129+0000","last_unstale":"2024-09-12T02:07:16.414408+0000","last_undegraded":"2024-09-12T02:07:16.414408+0000","last_fullsized":"2024-09-12T02:07:16.414408+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:16.414226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:16.414226+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.414226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:38.943116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"266'103","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.691163+0000","last_change":"2024-09-12T02:07:31.691163+0000","last_active":"2024-09-12T02:07:31.691163+0000","last_peered":"2024-09-12T02:07:31.691163+0000","last_clean":"2024-09-12T02:07:31.691163+0000","last_became_active":"2024-09-12T00:10:09.370925+0000","last_became_peered":"2024-09-12T00:10:09.370925+0000","last_unstale":"2024-09-12T02:07:31.691163+0000","last_undegraded":"2024-09-12T02:07:31.691163+0000","last_fullsized":"2024-09-12T02:07:31.691163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'103","last_scrub_stamp":"2024-09-12T02:07:31.690971+0000","last_deep_scrub":"266'103","last_deep_scrub_stamp":"2024-09-12T02:07:31.690971+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.690971+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:30.808146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"266'457","reported_seq":2126,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.672348+0000","last_change":"2024-09-12T02:06:56.672207+0000","last_active":"2024-09-12T02:06:56.672348+0000","last_peered":"2024-09-12T02:06:56.672348+0000","last_clean":"2024-09-12T02:06:56.672348+0000","last_became_active":"2024-09-12T00:10:01.257064+0000","last_became_peered":"2024-09-12T00:10:01.257064+0000","last_unstale":"2024-09-12T02:06:56.672348+0000","last_undegraded":"2024-09-12T02:06:56.672348+0000","last_fullsized":"2024-09-12T02:06:56.672348+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T02:06:56.672031+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T02:06:56.672031+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.672031+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:43.653119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2638,"num_read_kb":2500,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"266'393","reported_seq":1096,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.544401+0000","last_change":"2024-09-12T02:06:54.544339+0000","last_active":"2024-09-12T02:06:54.544401+0000","last_peered":"2024-09-12T02:06:54.544401+0000","last_clean":"2024-09-12T02:06:54.544401+0000","last_became_active":"2024-09-12T00:09:59.289217+0000","last_became_peered":"2024-09-12T00:09:59.289217+0000","last_unstale":"2024-09-12T02:06:54.544401+0000","last_undegraded":"2024-09-12T02:06:54.544401+0000","last_fullsized":"2024-09-12T02:06:54.544401+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T02:06:54.544232+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T02:06:54.544232+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.544232+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:13.653204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":33363,"num_write":1255,"num_write_kb":62829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.427645+0000","last_change":"2024-09-12T02:07:12.427491+0000","last_active":"2024-09-12T02:07:12.427645+0000","last_peered":"2024-09-12T02:07:12.427645+0000","last_clean":"2024-09-12T02:07:12.427645+0000","last_became_active":"2024-09-12T00:10:03.264802+0000","last_became_peered":"2024-09-12T00:10:03.264802+0000","last_unstale":"2024-09-12T02:07:12.427645+0000","last_undegraded":"2024-09-12T02:07:12.427645+0000","last_fullsized":"2024-09-12T02:07:12.427645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.427300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.427300+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.427300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:12.086674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"266'170","reported_seq":772,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.049420+0000","last_change":"2024-09-12T02:07:23.049420+0000","last_active":"2024-09-12T02:07:23.049420+0000","last_peered":"2024-09-12T02:07:23.049420+0000","last_clean":"2024-09-12T02:07:23.049420+0000","last_became_active":"2024-09-12T00:10:05.361625+0000","last_became_peered":"2024-09-12T00:10:05.361625+0000","last_unstale":"2024-09-12T02:07:23.049420+0000","last_undegraded":"2024-09-12T02:07:23.049420+0000","last_fullsized":"2024-09-12T02:07:23.049420+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'170","last_scrub_stamp":"2024-09-12T02:07:23.049225+0000","last_deep_scrub":"266'170","last_deep_scrub_stamp":"2024-09-12T02:07:23.049225+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.049225+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:36.389861+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":192,"num_write":144,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"266'765","reported_seq":3204,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.111797+0000","last_change":"2024-09-12T02:07:18.111797+0000","last_active":"2024-09-12T02:07:18.111797+0000","last_peered":"2024-09-12T02:07:18.111797+0000","last_clean":"2024-09-12T02:07:18.111797+0000","last_became_active":"2024-09-12T00:10:07.314980+0000","last_became_peered":"2024-09-12T00:10:07.314980+0000","last_unstale":"2024-09-12T02:07:18.111797+0000","last_undegraded":"2024-09-12T02:07:18.111797+0000","last_fullsized":"2024-09-12T02:07:18.111797+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'765","last_scrub_stamp":"2024-09-12T02:07:18.111612+0000","last_deep_scrub":"266'765","last_deep_scrub_stamp":"2024-09-12T02:07:18.111612+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.111612+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.698620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"266'122","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.863060+0000","last_change":"2024-09-12T02:07:25.863060+0000","last_active":"2024-09-12T02:07:25.863060+0000","last_peered":"2024-09-12T02:07:25.863060+0000","last_clean":"2024-09-12T02:07:25.863060+0000","last_became_active":"2024-09-12T00:10:09.369670+0000","last_became_peered":"2024-09-12T00:10:09.369670+0000","last_unstale":"2024-09-12T02:07:25.863060+0000","last_undegraded":"2024-09-12T02:07:25.863060+0000","last_fullsized":"2024-09-12T02:07:25.863060+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'122","last_scrub_stamp":"2024-09-12T02:07:25.862873+0000","last_deep_scrub":"266'122","last_deep_scrub_stamp":"2024-09-12T02:07:25.862873+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.862873+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:58.331730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":303,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"266'517","reported_seq":2021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.025361+0000","last_change":"2024-09-12T02:07:05.025188+0000","last_active":"2024-09-12T02:07:05.025361+0000","last_peered":"2024-09-12T02:07:05.025361+0000","last_clean":"2024-09-12T02:07:05.025361+0000","last_became_active":"2024-09-12T00:10:01.248535+0000","last_became_peered":"2024-09-12T00:10:01.248535+0000","last_unstale":"2024-09-12T02:07:05.025361+0000","last_undegraded":"2024-09-12T02:07:05.025361+0000","last_fullsized":"2024-09-12T02:07:05.025361+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'517","last_scrub_stamp":"2024-09-12T02:07:05.024997+0000","last_deep_scrub":"266'517","last_deep_scrub_stamp":"2024-09-12T02:07:05.024997+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.024997+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.426432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2593,"num_read_kb":2391,"num_write":659,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"266'402","reported_seq":1110,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.658383+0000","last_change":"2024-09-12T02:06:59.658106+0000","last_active":"2024-09-12T02:06:59.658383+0000","last_peered":"2024-09-12T02:06:59.658383+0000","last_clean":"2024-09-12T02:06:59.658383+0000","last_became_active":"2024-09-12T00:09:59.296207+0000","last_became_peered":"2024-09-12T00:09:59.296207+0000","last_unstale":"2024-09-12T02:06:59.658383+0000","last_undegraded":"2024-09-12T02:06:59.658383+0000","last_fullsized":"2024-09-12T02:06:59.658383+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'402","last_scrub_stamp":"2024-09-12T02:06:59.657782+0000","last_deep_scrub":"266'402","last_deep_scrub_stamp":"2024-09-12T02:06:59.657782+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.657782+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:49.546487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":512433,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":595,"num_read_kb":14266,"num_write":1257,"num_write_kb":35890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.829472+0000","last_change":"2024-09-12T02:07:14.829333+0000","last_active":"2024-09-12T02:07:14.829472+0000","last_peered":"2024-09-12T02:07:14.829472+0000","last_clean":"2024-09-12T02:07:14.829472+0000","last_became_active":"2024-09-12T00:10:03.259644+0000","last_became_peered":"2024-09-12T00:10:03.259644+0000","last_unstale":"2024-09-12T02:07:14.829472+0000","last_undegraded":"2024-09-12T02:07:14.829472+0000","last_fullsized":"2024-09-12T02:07:14.829472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:14.829153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:14.829153+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.829153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:55.178694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"266'393","reported_seq":1076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.646671+0000","last_change":"2024-09-12T02:07:25.646671+0000","last_active":"2024-09-12T02:07:25.646671+0000","last_peered":"2024-09-12T02:07:25.646671+0000","last_clean":"2024-09-12T02:07:25.646671+0000","last_became_active":"2024-09-12T00:10:05.297223+0000","last_became_peered":"2024-09-12T00:10:05.297223+0000","last_unstale":"2024-09-12T02:07:25.646671+0000","last_undegraded":"2024-09-12T02:07:25.646671+0000","last_fullsized":"2024-09-12T02:07:25.646671+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T02:07:25.646439+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T02:07:25.646439+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.646439+0000","objects_scrubbed":11,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:15.202173+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46277,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":600,"num_read_kb":1076,"num_write":448,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.632163+0000","last_change":"2024-09-12T02:07:24.632163+0000","last_active":"2024-09-12T02:07:24.632163+0000","last_peered":"2024-09-12T02:07:24.632163+0000","last_clean":"2024-09-12T02:07:24.632163+0000","last_became_active":"2024-09-12T00:10:07.323296+0000","last_became_peered":"2024-09-12T00:10:07.323296+0000","last_unstale":"2024-09-12T02:07:24.632163+0000","last_undegraded":"2024-09-12T02:07:24.632163+0000","last_fullsized":"2024-09-12T02:07:24.632163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.631902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.631902+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.631902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:20.809640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"266'148","reported_seq":680,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.889233+0000","last_change":"2024-09-12T02:07:26.889233+0000","last_active":"2024-09-12T02:07:26.889233+0000","last_peered":"2024-09-12T02:07:26.889233+0000","last_clean":"2024-09-12T02:07:26.889233+0000","last_became_active":"2024-09-12T00:10:09.361797+0000","last_became_peered":"2024-09-12T00:10:09.361797+0000","last_unstale":"2024-09-12T02:07:26.889233+0000","last_undegraded":"2024-09-12T02:07:26.889233+0000","last_fullsized":"2024-09-12T02:07:26.889233+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'148","last_scrub_stamp":"2024-09-12T02:07:26.889040+0000","last_deep_scrub":"266'148","last_deep_scrub_stamp":"2024-09-12T02:07:26.889040+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.889040+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:17.414450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":153,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"266'799","reported_seq":2159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.040881+0000","last_change":"2024-09-12T02:07:06.040735+0000","last_active":"2024-09-12T02:07:06.040881+0000","last_peered":"2024-09-12T02:07:06.040881+0000","last_clean":"2024-09-12T02:07:06.040881+0000","last_became_active":"2024-09-12T00:10:31.165044+0000","last_became_peered":"2024-09-12T00:10:31.165044+0000","last_unstale":"2024-09-12T02:07:06.040881+0000","last_undegraded":"2024-09-12T02:07:06.040881+0000","last_fullsized":"2024-09-12T02:07:06.040881+0000","mapping_epoch":38,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'799","last_scrub_stamp":"2024-09-12T02:07:06.040541+0000","last_deep_scrub":"266'799","last_deep_scrub_stamp":"2024-09-12T02:07:06.040541+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.040541+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:23.943825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3606,"num_read_kb":3182,"num_write":1095,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"266'377","reported_seq":1089,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.666197+0000","last_change":"2024-09-12T02:07:02.666038+0000","last_active":"2024-09-12T02:07:02.666197+0000","last_peered":"2024-09-12T02:07:02.666197+0000","last_clean":"2024-09-12T02:07:02.666197+0000","last_became_active":"2024-09-12T00:09:59.264091+0000","last_became_peered":"2024-09-12T00:09:59.264091+0000","last_unstale":"2024-09-12T02:07:02.666197+0000","last_undegraded":"2024-09-12T02:07:02.666197+0000","last_fullsized":"2024-09-12T02:07:02.666197+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'377","last_scrub_stamp":"2024-09-12T02:07:02.665688+0000","last_deep_scrub":"266'377","last_deep_scrub_stamp":"2024-09-12T02:07:02.665688+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.665688+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:35.183095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":673026,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":647,"num_read_kb":45982,"num_write":1108,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.567418+0000","last_change":"2024-09-12T02:07:18.567267+0000","last_active":"2024-09-12T02:07:18.567418+0000","last_peered":"2024-09-12T02:07:18.567418+0000","last_clean":"2024-09-12T02:07:18.567418+0000","last_became_active":"2024-09-12T00:10:03.263712+0000","last_became_peered":"2024-09-12T00:10:03.263712+0000","last_unstale":"2024-09-12T02:07:18.567418+0000","last_undegraded":"2024-09-12T02:07:18.567418+0000","last_fullsized":"2024-09-12T02:07:18.567418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:18.567082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:18.567082+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.567082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:10.276442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"266'316","reported_seq":943,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.557553+0000","last_change":"2024-09-12T02:07:17.557553+0000","last_active":"2024-09-12T02:07:17.557553+0000","last_peered":"2024-09-12T02:07:17.557553+0000","last_clean":"2024-09-12T02:07:17.557553+0000","last_became_active":"2024-09-12T00:10:05.297514+0000","last_became_peered":"2024-09-12T00:10:05.297514+0000","last_unstale":"2024-09-12T02:07:17.557553+0000","last_undegraded":"2024-09-12T02:07:17.557553+0000","last_fullsized":"2024-09-12T02:07:17.557553+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'316","last_scrub_stamp":"2024-09-12T02:07:17.557343+0000","last_deep_scrub":"266'316","last_deep_scrub_stamp":"2024-09-12T02:07:17.557343+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.557343+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:47.121784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42254,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1111,"num_write":410,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.078944+0000","last_change":"2024-09-12T02:07:10.078944+0000","last_active":"2024-09-12T02:07:10.078944+0000","last_peered":"2024-09-12T02:07:10.078944+0000","last_clean":"2024-09-12T02:07:10.078944+0000","last_became_active":"2024-09-12T00:10:07.320880+0000","last_became_peered":"2024-09-12T00:10:07.320880+0000","last_unstale":"2024-09-12T02:07:10.078944+0000","last_undegraded":"2024-09-12T02:07:10.078944+0000","last_fullsized":"2024-09-12T02:07:10.078944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:10.078696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:10.078696+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.078696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:20.691685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"266'123","reported_seq":676,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.998611+0000","last_change":"2024-09-12T02:07:28.998611+0000","last_active":"2024-09-12T02:07:28.998611+0000","last_peered":"2024-09-12T02:07:28.998611+0000","last_clean":"2024-09-12T02:07:28.998611+0000","last_became_active":"2024-09-12T00:10:09.433296+0000","last_became_peered":"2024-09-12T00:10:09.433296+0000","last_unstale":"2024-09-12T02:07:28.998611+0000","last_undegraded":"2024-09-12T02:07:28.998611+0000","last_fullsized":"2024-09-12T02:07:28.998611+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'123","last_scrub_stamp":"2024-09-12T02:07:28.998417+0000","last_deep_scrub":"266'123","last_deep_scrub_stamp":"2024-09-12T02:07:28.998417+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.998417+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:29.865905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1168,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":163,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"266'599","reported_seq":2334,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.896330+0000","last_change":"2024-09-12T02:07:06.896330+0000","last_active":"2024-09-12T02:07:06.896330+0000","last_peered":"2024-09-12T02:07:06.896330+0000","last_clean":"2024-09-12T02:07:06.896330+0000","last_became_active":"2024-09-12T00:10:01.242013+0000","last_became_peered":"2024-09-12T00:10:01.242013+0000","last_unstale":"2024-09-12T02:07:06.896330+0000","last_undegraded":"2024-09-12T02:07:06.896330+0000","last_fullsized":"2024-09-12T02:07:06.896330+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'599","last_scrub_stamp":"2024-09-12T02:07:06.896120+0000","last_deep_scrub":"266'599","last_deep_scrub_stamp":"2024-09-12T02:07:06.896120+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.896120+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:25.178488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3158,"num_read_kb":2927,"num_write":761,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"266'355","reported_seq":1038,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.836056+0000","last_change":"2024-09-12T02:06:56.836056+0000","last_active":"2024-09-12T02:06:56.836056+0000","last_peered":"2024-09-12T02:06:56.836056+0000","last_clean":"2024-09-12T02:06:56.836056+0000","last_became_active":"2024-09-12T00:09:59.311148+0000","last_became_peered":"2024-09-12T00:09:59.311148+0000","last_unstale":"2024-09-12T02:06:56.836056+0000","last_undegraded":"2024-09-12T02:06:56.836056+0000","last_fullsized":"2024-09-12T02:06:56.836056+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'355","last_scrub_stamp":"2024-09-12T02:06:56.835868+0000","last_deep_scrub":"266'355","last_deep_scrub_stamp":"2024-09-12T02:06:56.835868+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.835868+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:27.439194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":27101,"num_write":1127,"num_write_kb":32356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.016537+0000","last_change":"2024-09-12T02:07:16.016537+0000","last_active":"2024-09-12T02:07:16.016537+0000","last_peered":"2024-09-12T02:07:16.016537+0000","last_clean":"2024-09-12T02:07:16.016537+0000","last_became_active":"2024-09-12T00:10:03.252562+0000","last_became_peered":"2024-09-12T00:10:03.252562+0000","last_unstale":"2024-09-12T02:07:16.016537+0000","last_undegraded":"2024-09-12T02:07:16.016537+0000","last_fullsized":"2024-09-12T02:07:16.016537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:16.016357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:16.016357+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.016357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:39.102112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"266'278","reported_seq":882,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.965149+0000","last_change":"2024-09-12T02:07:33.965149+0000","last_active":"2024-09-12T02:07:33.965149+0000","last_peered":"2024-09-12T02:07:33.965149+0000","last_clean":"2024-09-12T02:07:33.965149+0000","last_became_active":"2024-09-12T00:10:05.291758+0000","last_became_peered":"2024-09-12T00:10:05.291758+0000","last_unstale":"2024-09-12T02:07:33.965149+0000","last_undegraded":"2024-09-12T02:07:33.965149+0000","last_fullsized":"2024-09-12T02:07:33.965149+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'278","last_scrub_stamp":"2024-09-12T02:07:33.964974+0000","last_deep_scrub":"266'278","last_deep_scrub_stamp":"2024-09-12T02:07:33.964974+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.964974+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:02.059751+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47860,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":1100,"num_write":388,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.126678+0000","last_change":"2024-09-12T02:07:25.126678+0000","last_active":"2024-09-12T02:07:25.126678+0000","last_peered":"2024-09-12T02:07:25.126678+0000","last_clean":"2024-09-12T02:07:25.126678+0000","last_became_active":"2024-09-12T00:10:07.320509+0000","last_became_peered":"2024-09-12T00:10:07.320509+0000","last_unstale":"2024-09-12T02:07:25.126678+0000","last_undegraded":"2024-09-12T02:07:25.126678+0000","last_fullsized":"2024-09-12T02:07:25.126678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.126495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.126495+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.126495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:09.265720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"266'174","reported_seq":1673,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.868839+0000","last_change":"2024-09-12T02:07:28.868839+0000","last_active":"2024-09-12T02:07:28.868839+0000","last_peered":"2024-09-12T02:07:28.868839+0000","last_clean":"2024-09-12T02:07:28.868839+0000","last_became_active":"2024-09-12T00:10:09.363609+0000","last_became_peered":"2024-09-12T00:10:09.363609+0000","last_unstale":"2024-09-12T02:07:28.868839+0000","last_undegraded":"2024-09-12T02:07:28.868839+0000","last_fullsized":"2024-09-12T02:07:28.868839+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'174","last_scrub_stamp":"2024-09-12T02:07:28.868656+0000","last_deep_scrub":"266'174","last_deep_scrub_stamp":"2024-09-12T02:07:28.868656+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.868656+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:27.970633+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1201,"num_read_kb":1188,"num_write":377,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"266'769","reported_seq":2302,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.063112+0000","last_change":"2024-09-12T02:07:04.063112+0000","last_active":"2024-09-12T02:07:04.063112+0000","last_peered":"2024-09-12T02:07:04.063112+0000","last_clean":"2024-09-12T02:07:04.063112+0000","last_became_active":"2024-09-12T00:10:01.255086+0000","last_became_peered":"2024-09-12T00:10:01.255086+0000","last_unstale":"2024-09-12T02:07:04.063112+0000","last_undegraded":"2024-09-12T02:07:04.063112+0000","last_fullsized":"2024-09-12T02:07:04.063112+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'769","last_scrub_stamp":"2024-09-12T02:07:04.062933+0000","last_deep_scrub":"266'769","last_deep_scrub_stamp":"2024-09-12T02:07:04.062933+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.062933+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:11.242416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3623,"num_read_kb":3271,"num_write":1000,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"266'318","reported_seq":1027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.532324+0000","last_change":"2024-09-12T02:06:55.532324+0000","last_active":"2024-09-12T02:06:55.532324+0000","last_peered":"2024-09-12T02:06:55.532324+0000","last_clean":"2024-09-12T02:06:55.532324+0000","last_became_active":"2024-09-12T00:09:59.293822+0000","last_became_peered":"2024-09-12T00:09:59.293822+0000","last_unstale":"2024-09-12T02:06:55.532324+0000","last_undegraded":"2024-09-12T02:06:55.532324+0000","last_fullsized":"2024-09-12T02:06:55.532324+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'318","last_scrub_stamp":"2024-09-12T02:06:55.532061+0000","last_deep_scrub":"266'318","last_deep_scrub_stamp":"2024-09-12T02:06:55.532061+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.532061+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:37.599521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":523,"num_read_kb":10999,"num_write":984,"num_write_kb":11811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"266'2","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.390356+0000","last_change":"2024-09-12T02:07:08.390356+0000","last_active":"2024-09-12T02:07:08.390356+0000","last_peered":"2024-09-12T02:07:08.390356+0000","last_clean":"2024-09-12T02:07:08.390356+0000","last_became_active":"2024-09-12T00:10:03.272579+0000","last_became_peered":"2024-09-12T00:10:03.272579+0000","last_unstale":"2024-09-12T02:07:08.390356+0000","last_undegraded":"2024-09-12T02:07:08.390356+0000","last_fullsized":"2024-09-12T02:07:08.390356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:08.390169+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:08.390169+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.390169+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:30.745777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"266'377","reported_seq":1027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.087405+0000","last_change":"2024-09-12T02:07:21.087405+0000","last_active":"2024-09-12T02:07:21.087405+0000","last_peered":"2024-09-12T02:07:21.087405+0000","last_clean":"2024-09-12T02:07:21.087405+0000","last_became_active":"2024-09-12T00:10:05.288230+0000","last_became_peered":"2024-09-12T00:10:05.288230+0000","last_unstale":"2024-09-12T02:07:21.087405+0000","last_undegraded":"2024-09-12T02:07:21.087405+0000","last_fullsized":"2024-09-12T02:07:21.087405+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'377","last_scrub_stamp":"2024-09-12T02:07:21.087191+0000","last_deep_scrub":"266'377","last_deep_scrub_stamp":"2024-09-12T02:07:21.087191+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.087191+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:47.013440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51419,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":1309,"num_write":486,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.587084+0000","last_change":"2024-09-12T02:07:25.587084+0000","last_active":"2024-09-12T02:07:25.587084+0000","last_peered":"2024-09-12T02:07:25.587084+0000","last_clean":"2024-09-12T02:07:25.587084+0000","last_became_active":"2024-09-12T00:10:07.325726+0000","last_became_peered":"2024-09-12T00:10:07.325726+0000","last_unstale":"2024-09-12T02:07:25.587084+0000","last_undegraded":"2024-09-12T02:07:25.587084+0000","last_fullsized":"2024-09-12T02:07:25.587084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.586903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.586903+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.586903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:59.223671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"266'153","reported_seq":689,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.097100+0000","last_change":"2024-09-12T02:07:27.097100+0000","last_active":"2024-09-12T02:07:27.097100+0000","last_peered":"2024-09-12T02:07:27.097100+0000","last_clean":"2024-09-12T02:07:27.097100+0000","last_became_active":"2024-09-12T00:10:09.353036+0000","last_became_peered":"2024-09-12T00:10:09.353036+0000","last_unstale":"2024-09-12T02:07:27.097100+0000","last_undegraded":"2024-09-12T02:07:27.097100+0000","last_fullsized":"2024-09-12T02:07:27.097100+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'153","last_scrub_stamp":"2024-09-12T02:07:27.096879+0000","last_deep_scrub":"266'153","last_deep_scrub_stamp":"2024-09-12T02:07:27.096879+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.096879+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:36.888055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":163,"num_write":387,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"266'725","reported_seq":2138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.391036+0000","last_change":"2024-09-12T02:07:10.391036+0000","last_active":"2024-09-12T02:07:10.391036+0000","last_peered":"2024-09-12T02:07:10.391036+0000","last_clean":"2024-09-12T02:07:10.391036+0000","last_became_active":"2024-09-12T00:10:01.263786+0000","last_became_peered":"2024-09-12T00:10:01.263786+0000","last_unstale":"2024-09-12T02:07:10.391036+0000","last_undegraded":"2024-09-12T02:07:10.391036+0000","last_fullsized":"2024-09-12T02:07:10.391036+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'725","last_scrub_stamp":"2024-09-12T02:07:10.390853+0000","last_deep_scrub":"266'725","last_deep_scrub_stamp":"2024-09-12T02:07:10.390853+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.390853+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:24.901710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3380,"num_read_kb":3030,"num_write":963,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"266'351","reported_seq":1024,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.152813+0000","last_change":"2024-09-12T02:06:58.152813+0000","last_active":"2024-09-12T02:06:58.152813+0000","last_peered":"2024-09-12T02:06:58.152813+0000","last_clean":"2024-09-12T02:06:58.152813+0000","last_became_active":"2024-09-12T00:09:59.287488+0000","last_became_peered":"2024-09-12T00:09:59.287488+0000","last_unstale":"2024-09-12T02:06:58.152813+0000","last_undegraded":"2024-09-12T02:06:58.152813+0000","last_fullsized":"2024-09-12T02:06:58.152813+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'351","last_scrub_stamp":"2024-09-12T02:06:58.152595+0000","last_deep_scrub":"266'351","last_deep_scrub_stamp":"2024-09-12T02:06:58.152595+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.152595+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:00.499623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174806,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":42853,"num_write":973,"num_write_kb":24863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"266'458","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.419572+0000","last_change":"2024-09-12T02:07:14.419572+0000","last_active":"2024-09-12T02:07:14.419572+0000","last_peered":"2024-09-12T02:07:14.419572+0000","last_clean":"2024-09-12T02:07:14.419572+0000","last_became_active":"2024-09-12T00:10:01.258361+0000","last_became_peered":"2024-09-12T00:10:01.258361+0000","last_unstale":"2024-09-12T02:07:14.419572+0000","last_undegraded":"2024-09-12T02:07:14.419572+0000","last_fullsized":"2024-09-12T02:07:14.419572+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T02:07:14.419394+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T02:07:14.419394+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.419394+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:23.617226+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2374,"num_read_kb":2204,"num_write":589,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"266'345","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.603030+0000","last_change":"2024-09-12T02:06:58.603030+0000","last_active":"2024-09-12T02:06:58.603030+0000","last_peered":"2024-09-12T02:06:58.603030+0000","last_clean":"2024-09-12T02:06:58.603030+0000","last_became_active":"2024-09-12T00:10:31.469140+0000","last_became_peered":"2024-09-12T00:10:31.469140+0000","last_unstale":"2024-09-12T02:06:58.603030+0000","last_undegraded":"2024-09-12T02:06:58.603030+0000","last_fullsized":"2024-09-12T02:06:58.603030+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'345","last_scrub_stamp":"2024-09-12T02:06:58.602735+0000","last_deep_scrub":"266'345","last_deep_scrub_stamp":"2024-09-12T02:06:58.602735+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.602735+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:27.793298+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314842,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":558,"num_read_kb":38599,"num_write":1106,"num_write_kb":37292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"266'827","reported_seq":2521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.622206+0000","last_change":"2024-09-12T02:07:11.622206+0000","last_active":"2024-09-12T02:07:11.622206+0000","last_peered":"2024-09-12T02:07:11.622206+0000","last_clean":"2024-09-12T02:07:11.622206+0000","last_became_active":"2024-09-12T00:10:01.275843+0000","last_became_peered":"2024-09-12T00:10:01.275843+0000","last_unstale":"2024-09-12T02:07:11.622206+0000","last_undegraded":"2024-09-12T02:07:11.622206+0000","last_fullsized":"2024-09-12T02:07:11.622206+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'827","last_scrub_stamp":"2024-09-12T02:07:11.621963+0000","last_deep_scrub":"266'827","last_deep_scrub_stamp":"2024-09-12T02:07:11.621963+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.621963+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:54.952629+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4035,"num_read_kb":3644,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":697,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"266'347","reported_seq":1033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.635699+0000","last_change":"2024-09-12T02:07:01.635699+0000","last_active":"2024-09-12T02:07:01.635699+0000","last_peered":"2024-09-12T02:07:01.635699+0000","last_clean":"2024-09-12T02:07:01.635699+0000","last_became_active":"2024-09-12T00:09:59.309327+0000","last_became_peered":"2024-09-12T00:09:59.309327+0000","last_unstale":"2024-09-12T02:07:01.635699+0000","last_undegraded":"2024-09-12T02:07:01.635699+0000","last_fullsized":"2024-09-12T02:07:01.635699+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'347","last_scrub_stamp":"2024-09-12T02:07:01.635456+0000","last_deep_scrub":"266'347","last_deep_scrub_stamp":"2024-09-12T02:07:01.635456+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.635456+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:44.139239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":15469,"num_write":1110,"num_write_kb":37224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"266'499","reported_seq":2156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.362179+0000","last_change":"2024-09-12T02:07:03.362000+0000","last_active":"2024-09-12T02:07:03.362179+0000","last_peered":"2024-09-12T02:07:03.362179+0000","last_clean":"2024-09-12T02:07:03.362179+0000","last_became_active":"2024-09-12T00:10:01.261418+0000","last_became_peered":"2024-09-12T00:10:01.261418+0000","last_unstale":"2024-09-12T02:07:03.362179+0000","last_undegraded":"2024-09-12T02:07:03.362179+0000","last_fullsized":"2024-09-12T02:07:03.362179+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T02:07:03.361825+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T02:07:03.361825+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.361825+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:03.935407+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2751,"num_read_kb":2561,"num_write":595,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"266'353","reported_seq":1122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.570841+0000","last_change":"2024-09-12T02:06:58.570841+0000","last_active":"2024-09-12T02:06:58.570841+0000","last_peered":"2024-09-12T02:06:58.570841+0000","last_clean":"2024-09-12T02:06:58.570841+0000","last_became_active":"2024-09-12T00:09:59.286590+0000","last_became_peered":"2024-09-12T00:09:59.286590+0000","last_unstale":"2024-09-12T02:06:58.570841+0000","last_undegraded":"2024-09-12T02:06:58.570841+0000","last_fullsized":"2024-09-12T02:06:58.570841+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'353","last_scrub_stamp":"2024-09-12T02:06:58.570616+0000","last_deep_scrub":"266'353","last_deep_scrub_stamp":"2024-09-12T02:06:58.570616+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.570616+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.488449+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904210,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":714,"num_read_kb":40012,"num_write":1077,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"266'1464","reported_seq":3093,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.937516+0000","last_change":"2024-09-12T02:07:07.937516+0000","last_active":"2024-09-12T02:07:07.937516+0000","last_peered":"2024-09-12T02:07:07.937516+0000","last_clean":"2024-09-12T02:07:07.937516+0000","last_became_active":"2024-09-12T00:10:01.261999+0000","last_became_peered":"2024-09-12T00:10:01.261999+0000","last_unstale":"2024-09-12T02:07:07.937516+0000","last_undegraded":"2024-09-12T02:07:07.937516+0000","last_fullsized":"2024-09-12T02:07:07.937516+0000","mapping_epoch":27,"log_start":"266'1400","ondisk_log_start":"266'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1464","last_scrub_stamp":"2024-09-12T02:07:07.937335+0000","last_deep_scrub":"266'1464","last_deep_scrub_stamp":"2024-09-12T02:07:07.937335+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.937335+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":1400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:48.762109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6652,"num_read_kb":5741,"num_write":2141,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"266'381","reported_seq":1133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.879266+0000","last_change":"2024-09-12T02:06:59.879266+0000","last_active":"2024-09-12T02:06:59.879266+0000","last_peered":"2024-09-12T02:06:59.879266+0000","last_clean":"2024-09-12T02:06:59.879266+0000","last_became_active":"2024-09-12T00:09:59.286301+0000","last_became_peered":"2024-09-12T00:09:59.286301+0000","last_unstale":"2024-09-12T02:06:59.879266+0000","last_undegraded":"2024-09-12T02:06:59.879266+0000","last_fullsized":"2024-09-12T02:06:59.879266+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:06:59.879029+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:06:59.879029+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.879029+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:40.618134+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":778,"num_read_kb":8721,"num_write":1199,"num_write_kb":26143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"266'392","reported_seq":1870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.077047+0000","last_change":"2024-09-12T02:07:07.077047+0000","last_active":"2024-09-12T02:07:07.077047+0000","last_peered":"2024-09-12T02:07:07.077047+0000","last_clean":"2024-09-12T02:07:07.077047+0000","last_became_active":"2024-09-12T00:10:01.266927+0000","last_became_peered":"2024-09-12T00:10:01.266927+0000","last_unstale":"2024-09-12T02:07:07.077047+0000","last_undegraded":"2024-09-12T02:07:07.077047+0000","last_fullsized":"2024-09-12T02:07:07.077047+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T02:07:07.076807+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T02:07:07.076807+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.076807+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:03.913347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2147,"num_read_kb":2014,"num_write":451,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"266'355","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.339949+0000","last_change":"2024-09-12T02:07:05.339949+0000","last_active":"2024-09-12T02:07:05.339949+0000","last_peered":"2024-09-12T02:07:05.339949+0000","last_clean":"2024-09-12T02:07:05.339949+0000","last_became_active":"2024-09-12T00:09:59.251413+0000","last_became_peered":"2024-09-12T00:09:59.251413+0000","last_unstale":"2024-09-12T02:07:05.339949+0000","last_undegraded":"2024-09-12T02:07:05.339949+0000","last_fullsized":"2024-09-12T02:07:05.339949+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'355","last_scrub_stamp":"2024-09-12T02:07:05.339718+0000","last_deep_scrub":"266'355","last_deep_scrub_stamp":"2024-09-12T02:07:05.339718+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.339718+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:18.042053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":573,"num_read_kb":23722,"num_write":1195,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"266'450","reported_seq":2132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.930253+0000","last_change":"2024-09-12T02:07:08.930253+0000","last_active":"2024-09-12T02:07:08.930253+0000","last_peered":"2024-09-12T02:07:08.930253+0000","last_clean":"2024-09-12T02:07:08.930253+0000","last_became_active":"2024-09-12T00:10:01.259942+0000","last_became_peered":"2024-09-12T00:10:01.259942+0000","last_unstale":"2024-09-12T02:07:08.930253+0000","last_undegraded":"2024-09-12T02:07:08.930253+0000","last_fullsized":"2024-09-12T02:07:08.930253+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'450","last_scrub_stamp":"2024-09-12T02:07:08.930001+0000","last_deep_scrub":"266'450","last_deep_scrub_stamp":"2024-09-12T02:07:08.930001+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.930001+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:29.281113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2415,"num_read_kb":2305,"num_write":502,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"266'339","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.102179+0000","last_change":"2024-09-12T02:07:00.102179+0000","last_active":"2024-09-12T02:07:00.102179+0000","last_peered":"2024-09-12T02:07:00.102179+0000","last_clean":"2024-09-12T02:07:00.102179+0000","last_became_active":"2024-09-12T00:09:59.298085+0000","last_became_peered":"2024-09-12T00:09:59.298085+0000","last_unstale":"2024-09-12T02:07:00.102179+0000","last_undegraded":"2024-09-12T02:07:00.102179+0000","last_fullsized":"2024-09-12T02:07:00.102179+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'339","last_scrub_stamp":"2024-09-12T02:07:00.101803+0000","last_deep_scrub":"266'339","last_deep_scrub_stamp":"2024-09-12T02:07:00.101803+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.101803+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:33.009729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136867,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":58646,"num_write":1165,"num_write_kb":29645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"266'501","reported_seq":2216,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.040683+0000","last_change":"2024-09-12T02:07:03.040683+0000","last_active":"2024-09-12T02:07:03.040683+0000","last_peered":"2024-09-12T02:07:03.040683+0000","last_clean":"2024-09-12T02:07:03.040683+0000","last_became_active":"2024-09-12T00:10:01.255302+0000","last_became_peered":"2024-09-12T00:10:01.255302+0000","last_unstale":"2024-09-12T02:07:03.040683+0000","last_undegraded":"2024-09-12T02:07:03.040683+0000","last_fullsized":"2024-09-12T02:07:03.040683+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'501","last_scrub_stamp":"2024-09-12T02:07:03.040505+0000","last_deep_scrub":"266'501","last_deep_scrub_stamp":"2024-09-12T02:07:03.040505+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.040505+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:52.725447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2619,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"266'347","reported_seq":1083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.927866+0000","last_change":"2024-09-12T02:07:01.927866+0000","last_active":"2024-09-12T02:07:01.927866+0000","last_peered":"2024-09-12T02:07:01.927866+0000","last_clean":"2024-09-12T02:07:01.927866+0000","last_became_active":"2024-09-12T00:09:59.286393+0000","last_became_peered":"2024-09-12T00:09:59.286393+0000","last_unstale":"2024-09-12T02:07:01.927866+0000","last_undegraded":"2024-09-12T02:07:01.927866+0000","last_fullsized":"2024-09-12T02:07:01.927866+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'347","last_scrub_stamp":"2024-09-12T02:07:01.927667+0000","last_deep_scrub":"266'347","last_deep_scrub_stamp":"2024-09-12T02:07:01.927667+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.927667+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:21.933493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33187,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":4608,"num_write":1166,"num_write_kb":13882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"266'600","reported_seq":2564,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.495857+0000","last_change":"2024-09-12T02:07:07.495857+0000","last_active":"2024-09-12T02:07:07.495857+0000","last_peered":"2024-09-12T02:07:07.495857+0000","last_clean":"2024-09-12T02:07:07.495857+0000","last_became_active":"2024-09-12T00:10:01.247691+0000","last_became_peered":"2024-09-12T00:10:01.247691+0000","last_unstale":"2024-09-12T02:07:07.495857+0000","last_undegraded":"2024-09-12T02:07:07.495857+0000","last_fullsized":"2024-09-12T02:07:07.495857+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'600","last_scrub_stamp":"2024-09-12T02:07:07.495627+0000","last_deep_scrub":"266'600","last_deep_scrub_stamp":"2024-09-12T02:07:07.495627+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.495627+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":500,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:17.862827+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3679,"num_read_kb":3455,"num_write":725,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4760,"num_omap_keys":19,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"266'359","reported_seq":1028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.622685+0000","last_change":"2024-09-12T02:07:00.622538+0000","last_active":"2024-09-12T02:07:00.622685+0000","last_peered":"2024-09-12T02:07:00.622685+0000","last_clean":"2024-09-12T02:07:00.622685+0000","last_became_active":"2024-09-12T00:09:59.300760+0000","last_became_peered":"2024-09-12T00:09:59.300760+0000","last_unstale":"2024-09-12T02:07:00.622685+0000","last_undegraded":"2024-09-12T02:07:00.622685+0000","last_fullsized":"2024-09-12T02:07:00.622685+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'359","last_scrub_stamp":"2024-09-12T02:07:00.622302+0000","last_deep_scrub":"266'359","last_deep_scrub_stamp":"2024-09-12T02:07:00.622302+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.622302+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:23.067734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436849,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":26981,"num_write":1171,"num_write_kb":52645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"266'958","reported_seq":2617,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.103295+0000","last_change":"2024-09-12T02:07:09.103295+0000","last_active":"2024-09-12T02:07:09.103295+0000","last_peered":"2024-09-12T02:07:09.103295+0000","last_clean":"2024-09-12T02:07:09.103295+0000","last_became_active":"2024-09-12T00:10:01.238674+0000","last_became_peered":"2024-09-12T00:10:01.238674+0000","last_unstale":"2024-09-12T02:07:09.103295+0000","last_undegraded":"2024-09-12T02:07:09.103295+0000","last_fullsized":"2024-09-12T02:07:09.103295+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'958","last_scrub_stamp":"2024-09-12T02:07:09.103056+0000","last_deep_scrub":"266'958","last_deep_scrub_stamp":"2024-09-12T02:07:09.103056+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.103056+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":900,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:04.336294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4713,"num_read_kb":4229,"num_write":1343,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"266'291","reported_seq":952,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.962261+0000","last_change":"2024-09-12T02:07:02.962261+0000","last_active":"2024-09-12T02:07:02.962261+0000","last_peered":"2024-09-12T02:07:02.962261+0000","last_clean":"2024-09-12T02:07:02.962261+0000","last_became_active":"2024-09-12T00:09:59.288260+0000","last_became_peered":"2024-09-12T00:09:59.288260+0000","last_unstale":"2024-09-12T02:07:02.962261+0000","last_undegraded":"2024-09-12T02:07:02.962261+0000","last_fullsized":"2024-09-12T02:07:02.962261+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'291","last_scrub_stamp":"2024-09-12T02:07:02.961949+0000","last_deep_scrub":"266'291","last_deep_scrub_stamp":"2024-09-12T02:07:02.961949+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.961949+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:11.825052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":7701,"num_write":890,"num_write_kb":23188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"266'343","reported_seq":1900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.665257+0000","last_change":"2024-09-12T02:07:04.665101+0000","last_active":"2024-09-12T02:07:04.665257+0000","last_peered":"2024-09-12T02:07:04.665257+0000","last_clean":"2024-09-12T02:07:04.665257+0000","last_became_active":"2024-09-12T00:10:01.265676+0000","last_became_peered":"2024-09-12T00:10:01.265676+0000","last_unstale":"2024-09-12T02:07:04.665257+0000","last_undegraded":"2024-09-12T02:07:04.665257+0000","last_fullsized":"2024-09-12T02:07:04.665257+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'343","last_scrub_stamp":"2024-09-12T02:07:04.664920+0000","last_deep_scrub":"266'343","last_deep_scrub_stamp":"2024-09-12T02:07:04.664920+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.664920+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:06.623311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1939,"num_read_kb":1902,"num_write":362,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"266'308","reported_seq":975,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.656753+0000","last_change":"2024-09-12T02:07:03.656753+0000","last_active":"2024-09-12T02:07:03.656753+0000","last_peered":"2024-09-12T02:07:03.656753+0000","last_clean":"2024-09-12T02:07:03.656753+0000","last_became_active":"2024-09-12T00:09:59.311132+0000","last_became_peered":"2024-09-12T00:09:59.311132+0000","last_unstale":"2024-09-12T02:07:03.656753+0000","last_undegraded":"2024-09-12T02:07:03.656753+0000","last_fullsized":"2024-09-12T02:07:03.656753+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'308","last_scrub_stamp":"2024-09-12T02:07:03.656539+0000","last_deep_scrub":"266'308","last_deep_scrub_stamp":"2024-09-12T02:07:03.656539+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.656539+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:24.830436+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190249,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":37892,"num_write":1016,"num_write_kb":21146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"266'932","reported_seq":2559,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.117490+0000","last_change":"2024-09-12T02:07:08.117490+0000","last_active":"2024-09-12T02:07:08.117490+0000","last_peered":"2024-09-12T02:07:08.117490+0000","last_clean":"2024-09-12T02:07:08.117490+0000","last_became_active":"2024-09-12T00:10:01.255682+0000","last_became_peered":"2024-09-12T00:10:01.255682+0000","last_unstale":"2024-09-12T02:07:08.117490+0000","last_undegraded":"2024-09-12T02:07:08.117490+0000","last_fullsized":"2024-09-12T02:07:08.117490+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'932","last_scrub_stamp":"2024-09-12T02:07:08.117306+0000","last_deep_scrub":"266'932","last_deep_scrub_stamp":"2024-09-12T02:07:08.117306+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.117306+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":900,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:01.030752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4312,"num_read_kb":3831,"num_write":1239,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"266'335","reported_seq":1027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.528788+0000","last_change":"2024-09-12T02:06:59.528788+0000","last_active":"2024-09-12T02:06:59.528788+0000","last_peered":"2024-09-12T02:06:59.528788+0000","last_clean":"2024-09-12T02:06:59.528788+0000","last_became_active":"2024-09-12T00:09:59.300699+0000","last_became_peered":"2024-09-12T00:09:59.300699+0000","last_unstale":"2024-09-12T02:06:59.528788+0000","last_undegraded":"2024-09-12T02:06:59.528788+0000","last_fullsized":"2024-09-12T02:06:59.528788+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'335","last_scrub_stamp":"2024-09-12T02:06:59.528507+0000","last_deep_scrub":"266'335","last_deep_scrub_stamp":"2024-09-12T02:06:59.528507+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.528507+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:11.541603+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315873,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":7533,"num_write":1090,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"266'859","reported_seq":2546,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.819973+0000","last_change":"2024-09-12T02:07:08.819973+0000","last_active":"2024-09-12T02:07:08.819973+0000","last_peered":"2024-09-12T02:07:08.819973+0000","last_clean":"2024-09-12T02:07:08.819973+0000","last_became_active":"2024-09-12T00:10:01.264795+0000","last_became_peered":"2024-09-12T00:10:01.264795+0000","last_unstale":"2024-09-12T02:07:08.819973+0000","last_undegraded":"2024-09-12T02:07:08.819973+0000","last_fullsized":"2024-09-12T02:07:08.819973+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'859","last_scrub_stamp":"2024-09-12T02:07:08.819764+0000","last_deep_scrub":"266'859","last_deep_scrub_stamp":"2024-09-12T02:07:08.819764+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.819764+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:26.975796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3745,"num_write":1135,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"266'384","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.144719+0000","last_change":"2024-09-12T02:06:59.144719+0000","last_active":"2024-09-12T02:06:59.144719+0000","last_peered":"2024-09-12T02:06:59.144719+0000","last_clean":"2024-09-12T02:06:59.144719+0000","last_became_active":"2024-09-12T00:09:59.299516+0000","last_became_peered":"2024-09-12T00:09:59.299516+0000","last_unstale":"2024-09-12T02:06:59.144719+0000","last_undegraded":"2024-09-12T02:06:59.144719+0000","last_fullsized":"2024-09-12T02:06:59.144719+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'384","last_scrub_stamp":"2024-09-12T02:06:59.144457+0000","last_deep_scrub":"266'384","last_deep_scrub_stamp":"2024-09-12T02:06:59.144457+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.144457+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:38.499358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":14945,"num_write":1232,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"266'500","reported_seq":2143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.526816+0000","last_change":"2024-09-12T02:07:08.526816+0000","last_active":"2024-09-12T02:07:08.526816+0000","last_peered":"2024-09-12T02:07:08.526816+0000","last_clean":"2024-09-12T02:07:08.526816+0000","last_became_active":"2024-09-12T00:10:01.258691+0000","last_became_peered":"2024-09-12T00:10:01.258691+0000","last_unstale":"2024-09-12T02:07:08.526816+0000","last_undegraded":"2024-09-12T02:07:08.526816+0000","last_fullsized":"2024-09-12T02:07:08.526816+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'500","last_scrub_stamp":"2024-09-12T02:07:08.526620+0000","last_deep_scrub":"266'500","last_deep_scrub_stamp":"2024-09-12T02:07:08.526620+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.526620+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:10.056735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2775,"num_read_kb":2593,"num_write":624,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"266'376","reported_seq":1046,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.800705+0000","last_change":"2024-09-12T02:07:02.800570+0000","last_active":"2024-09-12T02:07:02.800705+0000","last_peered":"2024-09-12T02:07:02.800705+0000","last_clean":"2024-09-12T02:07:02.800705+0000","last_became_active":"2024-09-12T00:09:59.313345+0000","last_became_peered":"2024-09-12T00:09:59.313345+0000","last_unstale":"2024-09-12T02:07:02.800705+0000","last_undegraded":"2024-09-12T02:07:02.800705+0000","last_fullsized":"2024-09-12T02:07:02.800705+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'376","last_scrub_stamp":"2024-09-12T02:07:02.800345+0000","last_deep_scrub":"266'376","last_deep_scrub_stamp":"2024-09-12T02:07:02.800345+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.800345+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:51.023798+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4483063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":14481,"num_write":1098,"num_write_kb":25771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"266'326","reported_seq":1756,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.927377+0000","last_change":"2024-09-12T02:07:10.927377+0000","last_active":"2024-09-12T02:07:10.927377+0000","last_peered":"2024-09-12T02:07:10.927377+0000","last_clean":"2024-09-12T02:07:10.927377+0000","last_became_active":"2024-09-12T00:10:01.249832+0000","last_became_peered":"2024-09-12T00:10:01.249832+0000","last_unstale":"2024-09-12T02:07:10.927377+0000","last_undegraded":"2024-09-12T02:07:10.927377+0000","last_fullsized":"2024-09-12T02:07:10.927377+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'326","last_scrub_stamp":"2024-09-12T02:07:10.927188+0000","last_deep_scrub":"266'326","last_deep_scrub_stamp":"2024-09-12T02:07:10.927188+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.927188+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:40.299799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1802,"num_read_kb":1736,"num_write":351,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"266'317","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.657601+0000","last_change":"2024-09-12T02:06:54.657601+0000","last_active":"2024-09-12T02:06:54.657601+0000","last_peered":"2024-09-12T02:06:54.657601+0000","last_clean":"2024-09-12T02:06:54.657601+0000","last_became_active":"2024-09-12T00:09:59.311158+0000","last_became_peered":"2024-09-12T00:09:59.311158+0000","last_unstale":"2024-09-12T02:06:54.657601+0000","last_undegraded":"2024-09-12T02:06:54.657601+0000","last_fullsized":"2024-09-12T02:06:54.657601+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'317","last_scrub_stamp":"2024-09-12T02:06:54.657499+0000","last_deep_scrub":"266'317","last_deep_scrub_stamp":"2024-09-12T02:06:54.657499+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.657499+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:41.120241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316829,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":115277,"num_write":995,"num_write_kb":39549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"266'721","reported_seq":2272,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.820571+0000","last_change":"2024-09-12T02:07:07.820396+0000","last_active":"2024-09-12T02:07:07.820571+0000","last_peered":"2024-09-12T02:07:07.820571+0000","last_clean":"2024-09-12T02:07:07.820571+0000","last_became_active":"2024-09-12T00:10:01.267027+0000","last_became_peered":"2024-09-12T00:10:01.267027+0000","last_unstale":"2024-09-12T02:07:07.820571+0000","last_undegraded":"2024-09-12T02:07:07.820571+0000","last_fullsized":"2024-09-12T02:07:07.820571+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'721","last_scrub_stamp":"2024-09-12T02:07:07.820152+0000","last_deep_scrub":"266'721","last_deep_scrub_stamp":"2024-09-12T02:07:07.820152+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.820152+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:54.864599+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3526,"num_read_kb":3200,"num_write":1050,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"266'331","reported_seq":1002,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.617366+0000","last_change":"2024-09-12T02:07:04.617366+0000","last_active":"2024-09-12T02:07:04.617366+0000","last_peered":"2024-09-12T02:07:04.617366+0000","last_clean":"2024-09-12T02:07:04.617366+0000","last_became_active":"2024-09-12T00:09:59.285907+0000","last_became_peered":"2024-09-12T00:09:59.285907+0000","last_unstale":"2024-09-12T02:07:04.617366+0000","last_undegraded":"2024-09-12T02:07:04.617366+0000","last_fullsized":"2024-09-12T02:07:04.617366+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'331","last_scrub_stamp":"2024-09-12T02:07:04.617081+0000","last_deep_scrub":"266'331","last_deep_scrub_stamp":"2024-09-12T02:07:04.617081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.617081+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:36.016645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569458,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":44645,"num_write":951,"num_write_kb":42281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"266'334","reported_seq":1017,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.598905+0000","last_change":"2024-09-12T02:07:07.598905+0000","last_active":"2024-09-12T02:07:07.598905+0000","last_peered":"2024-09-12T02:07:07.598905+0000","last_clean":"2024-09-12T02:07:07.598905+0000","last_became_active":"2024-09-12T00:09:59.282446+0000","last_became_peered":"2024-09-12T00:09:59.282446+0000","last_unstale":"2024-09-12T02:07:07.598905+0000","last_undegraded":"2024-09-12T02:07:07.598905+0000","last_fullsized":"2024-09-12T02:07:07.598905+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'334","last_scrub_stamp":"2024-09-12T02:07:07.598535+0000","last_deep_scrub":"266'334","last_deep_scrub_stamp":"2024-09-12T02:07:07.598535+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.598535+0000","objects_scrubbed":10,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:11.077428+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2535841,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":492,"num_read_kb":44688,"num_write":1069,"num_write_kb":33304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"266'458","reported_seq":2039,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.548533+0000","last_change":"2024-09-12T02:07:09.548533+0000","last_active":"2024-09-12T02:07:09.548533+0000","last_peered":"2024-09-12T02:07:09.548533+0000","last_clean":"2024-09-12T02:07:09.548533+0000","last_became_active":"2024-09-12T00:10:01.247767+0000","last_became_peered":"2024-09-12T00:10:01.247767+0000","last_unstale":"2024-09-12T02:07:09.548533+0000","last_undegraded":"2024-09-12T02:07:09.548533+0000","last_fullsized":"2024-09-12T02:07:09.548533+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T02:07:09.548332+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T02:07:09.548332+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.548332+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:46.662531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2488,"num_read_kb":2350,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"266'350","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.349649+0000","last_change":"2024-09-12T02:07:02.349649+0000","last_active":"2024-09-12T02:07:02.349649+0000","last_peered":"2024-09-12T02:07:02.349649+0000","last_clean":"2024-09-12T02:07:02.349649+0000","last_became_active":"2024-09-12T00:10:31.168444+0000","last_became_peered":"2024-09-12T00:10:31.168444+0000","last_unstale":"2024-09-12T02:07:02.349649+0000","last_undegraded":"2024-09-12T02:07:02.349649+0000","last_fullsized":"2024-09-12T02:07:02.349649+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'350","last_scrub_stamp":"2024-09-12T02:07:02.349335+0000","last_deep_scrub":"266'350","last_deep_scrub_stamp":"2024-09-12T02:07:02.349335+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.349335+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:22.134489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400029,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":20125,"num_write":1291,"num_write_kb":40521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,0],"acting":[1,4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"266'1090","reported_seq":2780,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.583557+0000","last_change":"2024-09-12T02:07:12.583557+0000","last_active":"2024-09-12T02:07:12.583557+0000","last_peered":"2024-09-12T02:07:12.583557+0000","last_clean":"2024-09-12T02:07:12.583557+0000","last_became_active":"2024-09-12T00:10:01.278762+0000","last_became_peered":"2024-09-12T00:10:01.278762+0000","last_unstale":"2024-09-12T02:07:12.583557+0000","last_undegraded":"2024-09-12T02:07:12.583557+0000","last_fullsized":"2024-09-12T02:07:12.583557+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1090","last_scrub_stamp":"2024-09-12T02:07:12.583390+0000","last_deep_scrub":"266'1090","last_deep_scrub_stamp":"2024-09-12T02:07:12.583390+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.583390+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":1000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:04.451087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5202,"num_read_kb":4573,"num_write":1592,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6060,"num_read_kb":4225,"num_write":1955,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2480,"num_omap_keys":5,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1027,"ondisk_log_size":1027,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":15149,"num_read_kb":14793,"num_write":16764,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1330,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1963,"ondisk_log_size":1963,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1579968,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":21268,"num_read_kb":40714,"num_write":17731,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":677416,"num_omap_keys":1576,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1913,"ondisk_log_size":1913,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213079,"num_read_kb":194397,"num_write":55367,"num_write_kb":18884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43514,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3932,"ondisk_log_size":3932,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":73602788,"num_objects":381,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":381,"num_whiteouts":0,"num_read":36353,"num_read_kb":1955827,"num_write":72080,"num_write_kb":2110952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100646912,"data_stored":100646912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3518,"ondisk_log_size":3518,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":180842,"num_write":186,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":169574,"num_write":186,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543564,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341692,"kb_used_data":17580,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94030148,"statfs":{"total":96636764160,"available":96286871552,"internally_reserved":0,"allocated":18001920,"data_stored":15991149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543564,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306672,"kb_used_data":18656,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94065168,"statfs":{"total":96636764160,"available":96322732032,"internally_reserved":0,"allocated":19103744,"data_stored":17151124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294910406},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543570,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191148,"kb_used_data":15644,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94180692,"statfs":{"total":96636764160,"available":96441028608,"internally_reserved":0,"allocated":16019456,"data_stored":13989543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543565,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162872,"kb_used_data":15080,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":94208968,"statfs":{"total":96636764160,"available":96469983232,"internally_reserved":0,"allocated":15441920,"data_stored":13515589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543567,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308428,"kb_used_data":20412,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94063412,"statfs":{"total":96636764160,"available":96320933888,"internally_reserved":0,"allocated":20901888,"data_stored":18895025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":294910407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543565,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117028,"kb_used_data":13652,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94254812,"statfs":{"total":96636764160,"available":96516927488,"internally_reserved":0,"allocated":13979648,"data_stored":12036246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543567,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195036,"kb_used_data":11212,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94176804,"statfs":{"total":96636764160,"available":96437047296,"internally_reserved":0,"allocated":11481088,"data_stored":9500646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543566,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308548,"kb_used_data":20596,"kb_used_omap":1,"kb_used_meta":287934,"kb_avail":94063292,"statfs":{"total":96636764160,"available":96320811008,"internally_reserved":0,"allocated":21090304,"data_stored":19083000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294844869},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16199680,"data_stored":16199680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7208960,"data_stored":7208960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9744384,"data_stored":9744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16601088,"data_stored":16601088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11227136,"data_stored":11227136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11698176,"data_stored":11698176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14860288,"data_stored":14860288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13107200,"data_stored":13107200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:36.284 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.284 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.284 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.284 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.284 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.285 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.285 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.285 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.285 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.285 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.285 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.285 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.285 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.286 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.286 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.286 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.286 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.286 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.286 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.286 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.286 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.286 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.287 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.287 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.287 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.287 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.287 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.287 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.287 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.288 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.288 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.288 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.288 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.288 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.288 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.288 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.288 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.289 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.289 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.289 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.289 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.289 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.289 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.289 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.289 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.290 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.290 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.290 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.290 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.290 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.290 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.291 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.291 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.291 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.291 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.291 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.291 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.291 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.291 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.292 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.292 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.292 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.292 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:26:22.274372+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=22, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.292 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.292 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.292 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.292 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.293 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.293 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.293 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.293 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.293 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.293 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:32:13.543194+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.293 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.293 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.294 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:32:20.594235+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=20, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.294 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.295 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.296 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:10:06.274702+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.296 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:10:08.314628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=10, tm_sec=8, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:36.297 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:07:56.298 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:07:56.661 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:07:56.673 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-12T02:07:56.684 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":3805,"stamp":"2024-09-12T02:07:54.939651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75791055,"num_objects":883,"num_object_clones":0,"num_object_copies":2528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":294733,"num_read_kb":2563326,"num_write":164412,"num_write_kb":2404914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":730940,"num_omap_keys":1794,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13163,"ondisk_log_size":13163,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1931424,"kb_used_data":132832,"kb_used_omap":12,"kb_used_meta":1798451,"kb_avail":753043296,"statfs":{"total":773094113280,"available":771116335104,"internally_reserved":0,"allocated":136019968,"data_stored":120162322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1841614384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1757,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007763"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:42.756368+0000","last_change":"2024-09-12T02:07:42.756232+0000","last_active":"2024-09-12T02:07:42.756368+0000","last_peered":"2024-09-12T02:07:42.756368+0000","last_clean":"2024-09-12T02:07:42.756368+0000","last_became_active":"2024-09-12T01:00:24.086540+0000","last_became_peered":"2024-09-12T01:00:24.086540+0000","last_unstale":"2024-09-12T02:07:42.756368+0000","last_undegraded":"2024-09-12T02:07:42.756368+0000","last_fullsized":"2024-09-12T02:07:42.756368+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:42.756030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:42.756030+0000","last_clean_scrub_stamp":"2024-09-12T02:07:42.756030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:03.073905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"266'3","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.774725+0000","last_change":"2024-09-12T02:07:41.774725+0000","last_active":"2024-09-12T02:07:41.774725+0000","last_peered":"2024-09-12T02:07:41.774725+0000","last_clean":"2024-09-12T02:07:41.774725+0000","last_became_active":"2024-09-12T00:32:21.645757+0000","last_became_peered":"2024-09-12T00:32:21.645757+0000","last_unstale":"2024-09-12T02:07:41.774725+0000","last_undegraded":"2024-09-12T02:07:41.774725+0000","last_fullsized":"2024-09-12T02:07:41.774725+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:07:41.774549+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:07:41.774549+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.774549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:23.003873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"266'6","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:44.158000+0000","last_change":"2024-09-12T02:07:44.158000+0000","last_active":"2024-09-12T02:07:44.158000+0000","last_peered":"2024-09-12T02:07:44.158000+0000","last_clean":"2024-09-12T02:07:44.158000+0000","last_became_active":"2024-09-12T00:32:14.592177+0000","last_became_peered":"2024-09-12T00:32:14.592177+0000","last_unstale":"2024-09-12T02:07:44.158000+0000","last_undegraded":"2024-09-12T02:07:44.158000+0000","last_fullsized":"2024-09-12T02:07:44.158000+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T02:07:44.157816+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T02:07:44.157816+0000","last_clean_scrub_stamp":"2024-09-12T02:07:44.157816+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:13.802116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8188,"num_write":6,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"266'29","reported_seq":172,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:39.477466+0000","last_change":"2024-09-12T02:07:39.477466+0000","last_active":"2024-09-12T02:07:39.477466+0000","last_peered":"2024-09-12T02:07:39.477466+0000","last_clean":"2024-09-12T02:07:39.477466+0000","last_became_active":"2024-09-12T00:26:23.353338+0000","last_became_peered":"2024-09-12T00:26:23.353338+0000","last_unstale":"2024-09-12T02:07:39.477466+0000","last_undegraded":"2024-09-12T02:07:39.477466+0000","last_fullsized":"2024-09-12T02:07:39.477466+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'29","last_scrub_stamp":"2024-09-12T02:07:39.477274+0000","last_deep_scrub":"266'29","last_deep_scrub_stamp":"2024-09-12T02:07:39.477274+0000","last_clean_scrub_stamp":"2024-09-12T02:07:39.477274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:06.802116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.603840+0000","last_change":"2024-09-12T02:07:19.603682+0000","last_active":"2024-09-12T02:07:19.603840+0000","last_peered":"2024-09-12T02:07:19.603840+0000","last_clean":"2024-09-12T02:07:19.603840+0000","last_became_active":"2024-09-12T01:00:24.074048+0000","last_became_peered":"2024-09-12T01:00:24.074048+0000","last_unstale":"2024-09-12T02:07:19.603840+0000","last_undegraded":"2024-09-12T02:07:19.603840+0000","last_fullsized":"2024-09-12T02:07:19.603840+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:19.603508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:19.603508+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.603508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:29.733337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"266'13","reported_seq":93,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:40.046693+0000","last_change":"2024-09-12T02:07:40.046693+0000","last_active":"2024-09-12T02:07:40.046693+0000","last_peered":"2024-09-12T02:07:40.046693+0000","last_clean":"2024-09-12T02:07:40.046693+0000","last_became_active":"2024-09-12T00:32:21.642967+0000","last_became_peered":"2024-09-12T00:32:21.642967+0000","last_unstale":"2024-09-12T02:07:40.046693+0000","last_undegraded":"2024-09-12T02:07:40.046693+0000","last_fullsized":"2024-09-12T02:07:40.046693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'13","last_scrub_stamp":"2024-09-12T02:07:40.046510+0000","last_deep_scrub":"266'13","last_deep_scrub_stamp":"2024-09-12T02:07:40.046510+0000","last_clean_scrub_stamp":"2024-09-12T02:07:40.046510+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:42.677811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24594,"num_write":18,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.630593+0000","last_change":"2024-09-12T02:07:32.630593+0000","last_active":"2024-09-12T02:07:32.630593+0000","last_peered":"2024-09-12T02:07:32.630593+0000","last_clean":"2024-09-12T02:07:32.630593+0000","last_became_active":"2024-09-12T00:32:14.602766+0000","last_became_peered":"2024-09-12T00:32:14.602766+0000","last_unstale":"2024-09-12T02:07:32.630593+0000","last_undegraded":"2024-09-12T02:07:32.630593+0000","last_fullsized":"2024-09-12T02:07:32.630593+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:32.630411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:32.630411+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.630411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:11.014809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"266'26","reported_seq":159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.641746+0000","last_change":"2024-09-12T02:07:13.641746+0000","last_active":"2024-09-12T02:07:13.641746+0000","last_peered":"2024-09-12T02:07:13.641746+0000","last_clean":"2024-09-12T02:07:13.641746+0000","last_became_active":"2024-09-12T00:26:23.321682+0000","last_became_peered":"2024-09-12T00:26:23.321682+0000","last_unstale":"2024-09-12T02:07:13.641746+0000","last_undegraded":"2024-09-12T02:07:13.641746+0000","last_fullsized":"2024-09-12T02:07:13.641746+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T02:07:13.641577+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T02:07:13.641577+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.641577+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:11.157660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.038572+0000","last_change":"2024-09-12T02:07:31.038572+0000","last_active":"2024-09-12T02:07:31.038572+0000","last_peered":"2024-09-12T02:07:31.038572+0000","last_clean":"2024-09-12T02:07:31.038572+0000","last_became_active":"2024-09-12T01:00:24.075719+0000","last_became_peered":"2024-09-12T01:00:24.075719+0000","last_unstale":"2024-09-12T02:07:31.038572+0000","last_undegraded":"2024-09-12T02:07:31.038572+0000","last_fullsized":"2024-09-12T02:07:31.038572+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:31.038391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:31.038391+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.038391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:19.895065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"266'2","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:47.433165+0000","last_change":"2024-09-12T02:07:47.433165+0000","last_active":"2024-09-12T02:07:47.433165+0000","last_peered":"2024-09-12T02:07:47.433165+0000","last_clean":"2024-09-12T02:07:47.433165+0000","last_became_active":"2024-09-12T00:32:21.663938+0000","last_became_peered":"2024-09-12T00:32:21.663938+0000","last_unstale":"2024-09-12T02:07:47.433165+0000","last_undegraded":"2024-09-12T02:07:47.433165+0000","last_fullsized":"2024-09-12T02:07:47.433165+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:47.432953+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:47.432953+0000","last_clean_scrub_stamp":"2024-09-12T02:07:47.432953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:11.335489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"266'10","reported_seq":103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.591891+0000","last_change":"2024-09-12T02:07:16.591891+0000","last_active":"2024-09-12T02:07:16.591891+0000","last_peered":"2024-09-12T02:07:16.591891+0000","last_clean":"2024-09-12T02:07:16.591891+0000","last_became_active":"2024-09-12T00:32:14.597094+0000","last_became_peered":"2024-09-12T00:32:14.597094+0000","last_unstale":"2024-09-12T02:07:16.591891+0000","last_undegraded":"2024-09-12T02:07:16.591891+0000","last_fullsized":"2024-09-12T02:07:16.591891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T02:07:16.591704+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T02:07:16.591704+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.591704+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:05.717857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24574,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"266'4","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.460160+0000","last_change":"2024-09-12T02:07:35.460160+0000","last_active":"2024-09-12T02:07:35.460160+0000","last_peered":"2024-09-12T02:07:35.460160+0000","last_clean":"2024-09-12T02:07:35.460160+0000","last_became_active":"2024-09-12T00:26:23.349476+0000","last_became_peered":"2024-09-12T00:26:23.349476+0000","last_unstale":"2024-09-12T02:07:35.460160+0000","last_undegraded":"2024-09-12T02:07:35.460160+0000","last_fullsized":"2024-09-12T02:07:35.460160+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:35.459980+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:35.459980+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.459980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:03.773640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:23.959089+0000","last_change":"2024-09-12T01:00:24.070271+0000","last_active":"2024-09-12T02:03:23.959089+0000","last_peered":"2024-09-12T02:03:23.959089+0000","last_clean":"2024-09-12T02:03:23.959089+0000","last_became_active":"2024-09-12T01:00:24.069555+0000","last_became_peered":"2024-09-12T01:00:24.069555+0000","last_unstale":"2024-09-12T02:03:23.959089+0000","last_undegraded":"2024-09-12T02:03:23.959089+0000","last_fullsized":"2024-09-12T02:03:23.959089+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:30.440481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"266'2","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:53.134459+0000","last_change":"2024-09-12T02:07:53.134459+0000","last_active":"2024-09-12T02:07:53.134459+0000","last_peered":"2024-09-12T02:07:53.134459+0000","last_clean":"2024-09-12T02:07:53.134459+0000","last_became_active":"2024-09-12T00:32:21.654241+0000","last_became_peered":"2024-09-12T00:32:21.654241+0000","last_unstale":"2024-09-12T02:07:53.134459+0000","last_undegraded":"2024-09-12T02:07:53.134459+0000","last_fullsized":"2024-09-12T02:07:53.134459+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:53.134278+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:53.134278+0000","last_clean_scrub_stamp":"2024-09-12T02:07:53.134278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:11.124471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"266'13","reported_seq":106,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.171277+0000","last_change":"2024-09-12T02:07:34.171277+0000","last_active":"2024-09-12T02:07:34.171277+0000","last_peered":"2024-09-12T02:07:34.171277+0000","last_clean":"2024-09-12T02:07:34.171277+0000","last_became_active":"2024-09-12T00:32:14.586250+0000","last_became_peered":"2024-09-12T00:32:14.586250+0000","last_unstale":"2024-09-12T02:07:34.171277+0000","last_undegraded":"2024-09-12T02:07:34.171277+0000","last_fullsized":"2024-09-12T02:07:34.171277+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'13","last_scrub_stamp":"2024-09-12T02:07:34.171097+0000","last_deep_scrub":"266'13","last_deep_scrub_stamp":"2024-09-12T02:07:34.171097+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.171097+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:50.656809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":31734,"num_write":18,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"266'26","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.155849+0000","last_change":"2024-09-12T02:07:41.155849+0000","last_active":"2024-09-12T02:07:41.155849+0000","last_peered":"2024-09-12T02:07:41.155849+0000","last_clean":"2024-09-12T02:07:41.155849+0000","last_became_active":"2024-09-12T00:26:23.327186+0000","last_became_peered":"2024-09-12T00:26:23.327186+0000","last_unstale":"2024-09-12T02:07:41.155849+0000","last_undegraded":"2024-09-12T02:07:41.155849+0000","last_fullsized":"2024-09-12T02:07:41.155849+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T02:07:41.155665+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T02:07:41.155665+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.155665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:14.701037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:04:33.977562+0000","last_change":"2024-09-12T01:00:24.078700+0000","last_active":"2024-09-12T02:04:33.977562+0000","last_peered":"2024-09-12T02:04:33.977562+0000","last_clean":"2024-09-12T02:04:33.977562+0000","last_became_active":"2024-09-12T01:00:24.077651+0000","last_became_peered":"2024-09-12T01:00:24.077651+0000","last_unstale":"2024-09-12T02:04:33.977562+0000","last_undegraded":"2024-09-12T02:04:33.977562+0000","last_fullsized":"2024-09-12T02:04:33.977562+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.976804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"266'5","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:37.751083+0000","last_change":"2024-09-12T02:07:37.751083+0000","last_active":"2024-09-12T02:07:37.751083+0000","last_peered":"2024-09-12T02:07:37.751083+0000","last_clean":"2024-09-12T02:07:37.751083+0000","last_became_active":"2024-09-12T00:32:21.649921+0000","last_became_peered":"2024-09-12T00:32:21.649921+0000","last_unstale":"2024-09-12T02:07:37.751083+0000","last_undegraded":"2024-09-12T02:07:37.751083+0000","last_fullsized":"2024-09-12T02:07:37.751083+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T02:07:37.750900+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T02:07:37.750900+0000","last_clean_scrub_stamp":"2024-09-12T02:07:37.750900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:39.881432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'2","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.422674+0000","last_change":"2024-09-12T02:07:41.422674+0000","last_active":"2024-09-12T02:07:41.422674+0000","last_peered":"2024-09-12T02:07:41.422674+0000","last_clean":"2024-09-12T02:07:41.422674+0000","last_became_active":"2024-09-12T00:32:14.607652+0000","last_became_peered":"2024-09-12T00:32:14.607652+0000","last_unstale":"2024-09-12T02:07:41.422674+0000","last_undegraded":"2024-09-12T02:07:41.422674+0000","last_fullsized":"2024-09-12T02:07:41.422674+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:41.422393+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:41.422393+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.422393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:31.632199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"266'15","reported_seq":122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:45.197194+0000","last_change":"2024-09-12T02:07:45.197194+0000","last_active":"2024-09-12T02:07:45.197194+0000","last_peered":"2024-09-12T02:07:45.197194+0000","last_clean":"2024-09-12T02:07:45.197194+0000","last_became_active":"2024-09-12T00:26:23.339416+0000","last_became_peered":"2024-09-12T00:26:23.339416+0000","last_unstale":"2024-09-12T02:07:45.197194+0000","last_undegraded":"2024-09-12T02:07:45.197194+0000","last_fullsized":"2024-09-12T02:07:45.197194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'15","last_scrub_stamp":"2024-09-12T02:07:45.197018+0000","last_deep_scrub":"266'15","last_deep_scrub_stamp":"2024-09-12T02:07:45.197018+0000","last_clean_scrub_stamp":"2024-09-12T02:07:45.197018+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:52.283764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.625013+0000","last_change":"2024-09-12T02:07:35.625013+0000","last_active":"2024-09-12T02:07:35.625013+0000","last_peered":"2024-09-12T02:07:35.625013+0000","last_clean":"2024-09-12T02:07:35.625013+0000","last_became_active":"2024-09-12T01:00:24.064732+0000","last_became_peered":"2024-09-12T01:00:24.064732+0000","last_unstale":"2024-09-12T02:07:35.625013+0000","last_undegraded":"2024-09-12T02:07:35.625013+0000","last_fullsized":"2024-09-12T02:07:35.625013+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:35.624837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:35.624837+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.624837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:39.151157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.059543+0000","last_change":"2024-09-12T02:07:28.059543+0000","last_active":"2024-09-12T02:07:28.059543+0000","last_peered":"2024-09-12T02:07:28.059543+0000","last_clean":"2024-09-12T02:07:28.059543+0000","last_became_active":"2024-09-12T00:32:21.649260+0000","last_became_peered":"2024-09-12T00:32:21.649260+0000","last_unstale":"2024-09-12T02:07:28.059543+0000","last_undegraded":"2024-09-12T02:07:28.059543+0000","last_fullsized":"2024-09-12T02:07:28.059543+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:28.059317+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:28.059317+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.059317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:55.872980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'3","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.122988+0000","last_change":"2024-09-12T02:07:32.122988+0000","last_active":"2024-09-12T02:07:32.122988+0000","last_peered":"2024-09-12T02:07:32.122988+0000","last_clean":"2024-09-12T02:07:32.122988+0000","last_became_active":"2024-09-12T00:32:14.582112+0000","last_became_peered":"2024-09-12T00:32:14.582112+0000","last_unstale":"2024-09-12T02:07:32.122988+0000","last_undegraded":"2024-09-12T02:07:32.122988+0000","last_fullsized":"2024-09-12T02:07:32.122988+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T02:07:32.122794+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T02:07:32.122794+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.122794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:51.853305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"266'89","reported_seq":408,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.124608+0000","last_change":"2024-09-12T02:07:23.124608+0000","last_active":"2024-09-12T02:07:23.124608+0000","last_peered":"2024-09-12T02:07:23.124608+0000","last_clean":"2024-09-12T02:07:23.124608+0000","last_became_active":"2024-09-12T00:26:23.328597+0000","last_became_peered":"2024-09-12T00:26:23.328597+0000","last_unstale":"2024-09-12T02:07:23.124608+0000","last_undegraded":"2024-09-12T02:07:23.124608+0000","last_fullsized":"2024-09-12T02:07:23.124608+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'89","last_scrub_stamp":"2024-09-12T02:07:23.124434+0000","last_deep_scrub":"266'89","last_deep_scrub_stamp":"2024-09-12T02:07:23.124434+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.124434+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:13.201981+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":416,"num_write":108,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2480,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:50.979004+0000","last_change":"2024-09-12T02:07:50.978867+0000","last_active":"2024-09-12T02:07:50.979004+0000","last_peered":"2024-09-12T02:07:50.979004+0000","last_clean":"2024-09-12T02:07:50.979004+0000","last_became_active":"2024-09-12T01:00:24.071095+0000","last_became_peered":"2024-09-12T01:00:24.071095+0000","last_unstale":"2024-09-12T02:07:50.979004+0000","last_undegraded":"2024-09-12T02:07:50.979004+0000","last_fullsized":"2024-09-12T02:07:50.979004+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:50.978694+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:50.978694+0000","last_clean_scrub_stamp":"2024-09-12T02:07:50.978694+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:51.350546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"266'9","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.049495+0000","last_change":"2024-09-12T02:07:30.049495+0000","last_active":"2024-09-12T02:07:30.049495+0000","last_peered":"2024-09-12T02:07:30.049495+0000","last_clean":"2024-09-12T02:07:30.049495+0000","last_became_active":"2024-09-12T00:32:21.643876+0000","last_became_peered":"2024-09-12T00:32:21.643876+0000","last_unstale":"2024-09-12T02:07:30.049495+0000","last_undegraded":"2024-09-12T02:07:30.049495+0000","last_fullsized":"2024-09-12T02:07:30.049495+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:30.049304+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:30.049304+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.049304+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:28.552406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10236,"num_write":14,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":88,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.152111+0000","last_change":"2024-09-12T02:07:33.152111+0000","last_active":"2024-09-12T02:07:33.152111+0000","last_peered":"2024-09-12T02:07:33.152111+0000","last_clean":"2024-09-12T02:07:33.152111+0000","last_became_active":"2024-09-12T00:32:14.588375+0000","last_became_peered":"2024-09-12T00:32:14.588375+0000","last_unstale":"2024-09-12T02:07:33.152111+0000","last_undegraded":"2024-09-12T02:07:33.152111+0000","last_fullsized":"2024-09-12T02:07:33.152111+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T02:07:33.151911+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T02:07:33.151911+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.151911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:18.994536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7178,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"266'62","reported_seq":256,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:37.483303+0000","last_change":"2024-09-12T02:07:37.483303+0000","last_active":"2024-09-12T02:07:37.483303+0000","last_peered":"2024-09-12T02:07:37.483303+0000","last_clean":"2024-09-12T02:07:37.483303+0000","last_became_active":"2024-09-12T00:26:23.336278+0000","last_became_peered":"2024-09-12T00:26:23.336278+0000","last_unstale":"2024-09-12T02:07:37.483303+0000","last_undegraded":"2024-09-12T02:07:37.483303+0000","last_fullsized":"2024-09-12T02:07:37.483303+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'62","last_scrub_stamp":"2024-09-12T02:07:37.483132+0000","last_deep_scrub":"266'62","last_deep_scrub_stamp":"2024-09-12T02:07:37.483132+0000","last_clean_scrub_stamp":"2024-09-12T02:07:37.483132+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:23.010163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":248,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:49.959504+0000","last_change":"2024-09-12T02:07:49.959330+0000","last_active":"2024-09-12T02:07:49.959504+0000","last_peered":"2024-09-12T02:07:49.959504+0000","last_clean":"2024-09-12T02:07:49.959504+0000","last_became_active":"2024-09-12T01:00:24.078120+0000","last_became_peered":"2024-09-12T01:00:24.078120+0000","last_unstale":"2024-09-12T02:07:49.959504+0000","last_undegraded":"2024-09-12T02:07:49.959504+0000","last_fullsized":"2024-09-12T02:07:49.959504+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:49.959154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:49.959154+0000","last_clean_scrub_stamp":"2024-09-12T02:07:49.959154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:40.513092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:50.127718+0000","last_change":"2024-09-12T02:07:50.127718+0000","last_active":"2024-09-12T02:07:50.127718+0000","last_peered":"2024-09-12T02:07:50.127718+0000","last_clean":"2024-09-12T02:07:50.127718+0000","last_became_active":"2024-09-12T00:32:21.650564+0000","last_became_peered":"2024-09-12T00:32:21.650564+0000","last_unstale":"2024-09-12T02:07:50.127718+0000","last_undegraded":"2024-09-12T02:07:50.127718+0000","last_fullsized":"2024-09-12T02:07:50.127718+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:50.127530+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:50.127530+0000","last_clean_scrub_stamp":"2024-09-12T02:07:50.127530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:42.273868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'2","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:52.382400+0000","last_change":"2024-09-12T02:07:52.382400+0000","last_active":"2024-09-12T02:07:52.382400+0000","last_peered":"2024-09-12T02:07:52.382400+0000","last_clean":"2024-09-12T02:07:52.382400+0000","last_became_active":"2024-09-12T00:32:14.600188+0000","last_became_peered":"2024-09-12T00:32:14.600188+0000","last_unstale":"2024-09-12T02:07:52.382400+0000","last_undegraded":"2024-09-12T02:07:52.382400+0000","last_fullsized":"2024-09-12T02:07:52.382400+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:52.382201+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:52.382201+0000","last_clean_scrub_stamp":"2024-09-12T02:07:52.382201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:03.157921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"266'14","reported_seq":121,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.570999+0000","last_change":"2024-09-12T02:07:22.570835+0000","last_active":"2024-09-12T02:07:22.570999+0000","last_peered":"2024-09-12T02:07:22.570999+0000","last_clean":"2024-09-12T02:07:22.570999+0000","last_became_active":"2024-09-12T00:26:23.325067+0000","last_became_peered":"2024-09-12T00:26:23.325067+0000","last_unstale":"2024-09-12T02:07:22.570999+0000","last_undegraded":"2024-09-12T02:07:22.570999+0000","last_fullsized":"2024-09-12T02:07:22.570999+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'14","last_scrub_stamp":"2024-09-12T02:07:22.570644+0000","last_deep_scrub":"266'14","last_deep_scrub_stamp":"2024-09-12T02:07:22.570644+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.570644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:26.839587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.600652+0000","last_change":"2024-09-12T02:07:34.600652+0000","last_active":"2024-09-12T02:07:34.600652+0000","last_peered":"2024-09-12T02:07:34.600652+0000","last_clean":"2024-09-12T02:07:34.600652+0000","last_became_active":"2024-09-12T01:00:24.075148+0000","last_became_peered":"2024-09-12T01:00:24.075148+0000","last_unstale":"2024-09-12T02:07:34.600652+0000","last_undegraded":"2024-09-12T02:07:34.600652+0000","last_fullsized":"2024-09-12T02:07:34.600652+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:34.600470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:34.600470+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.600470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:26.443709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:51.082711+0000","last_change":"2024-09-12T02:07:51.082711+0000","last_active":"2024-09-12T02:07:51.082711+0000","last_peered":"2024-09-12T02:07:51.082711+0000","last_clean":"2024-09-12T02:07:51.082711+0000","last_became_active":"2024-09-12T00:32:21.654214+0000","last_became_peered":"2024-09-12T00:32:21.654214+0000","last_unstale":"2024-09-12T02:07:51.082711+0000","last_undegraded":"2024-09-12T02:07:51.082711+0000","last_fullsized":"2024-09-12T02:07:51.082711+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:51.082523+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:51.082523+0000","last_clean_scrub_stamp":"2024-09-12T02:07:51.082523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:55.708897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'5","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.742982+0000","last_change":"2024-09-12T02:07:33.742982+0000","last_active":"2024-09-12T02:07:33.742982+0000","last_peered":"2024-09-12T02:07:33.742982+0000","last_clean":"2024-09-12T02:07:33.742982+0000","last_became_active":"2024-09-12T00:32:14.586101+0000","last_became_peered":"2024-09-12T00:32:14.586101+0000","last_unstale":"2024-09-12T02:07:33.742982+0000","last_undegraded":"2024-09-12T02:07:33.742982+0000","last_fullsized":"2024-09-12T02:07:33.742982+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T02:07:33.742797+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T02:07:33.742797+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.742797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:03.994396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"266'18","reported_seq":133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:36.501690+0000","last_change":"2024-09-12T02:07:36.501554+0000","last_active":"2024-09-12T02:07:36.501690+0000","last_peered":"2024-09-12T02:07:36.501690+0000","last_clean":"2024-09-12T02:07:36.501690+0000","last_became_active":"2024-09-12T00:26:23.338890+0000","last_became_peered":"2024-09-12T00:26:23.338890+0000","last_unstale":"2024-09-12T02:07:36.501690+0000","last_undegraded":"2024-09-12T02:07:36.501690+0000","last_fullsized":"2024-09-12T02:07:36.501690+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'18","last_scrub_stamp":"2024-09-12T02:07:36.501374+0000","last_deep_scrub":"266'18","last_deep_scrub_stamp":"2024-09-12T02:07:36.501374+0000","last_clean_scrub_stamp":"2024-09-12T02:07:36.501374+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:35.375448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.617072+0000","last_change":"2024-09-12T02:07:21.617072+0000","last_active":"2024-09-12T02:07:21.617072+0000","last_peered":"2024-09-12T02:07:21.617072+0000","last_clean":"2024-09-12T02:07:21.617072+0000","last_became_active":"2024-09-12T01:00:24.076081+0000","last_became_peered":"2024-09-12T01:00:24.076081+0000","last_unstale":"2024-09-12T02:07:21.617072+0000","last_undegraded":"2024-09-12T02:07:21.617072+0000","last_fullsized":"2024-09-12T02:07:21.617072+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:21.616889+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:21.616889+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.616889+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:11.136708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'5","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:47.213226+0000","last_change":"2024-09-12T02:07:47.213226+0000","last_active":"2024-09-12T02:07:47.213226+0000","last_peered":"2024-09-12T02:07:47.213226+0000","last_clean":"2024-09-12T02:07:47.213226+0000","last_became_active":"2024-09-12T00:32:21.659460+0000","last_became_peered":"2024-09-12T00:32:21.659460+0000","last_unstale":"2024-09-12T02:07:47.213226+0000","last_undegraded":"2024-09-12T02:07:47.213226+0000","last_fullsized":"2024-09-12T02:07:47.213226+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T02:07:47.213025+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T02:07:47.213025+0000","last_clean_scrub_stamp":"2024-09-12T02:07:47.213025+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:15.024057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"266'2","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:36.829003+0000","last_change":"2024-09-12T02:07:36.829003+0000","last_active":"2024-09-12T02:07:36.829003+0000","last_peered":"2024-09-12T02:07:36.829003+0000","last_clean":"2024-09-12T02:07:36.829003+0000","last_became_active":"2024-09-12T00:32:14.594973+0000","last_became_peered":"2024-09-12T00:32:14.594973+0000","last_unstale":"2024-09-12T02:07:36.829003+0000","last_undegraded":"2024-09-12T02:07:36.829003+0000","last_fullsized":"2024-09-12T02:07:36.829003+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:36.828820+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:36.828820+0000","last_clean_scrub_stamp":"2024-09-12T02:07:36.828820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:12.619826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.950210+0000","last_change":"2024-09-12T02:07:35.950125+0000","last_active":"2024-09-12T02:07:35.950210+0000","last_peered":"2024-09-12T02:07:35.950210+0000","last_clean":"2024-09-12T02:07:35.950210+0000","last_became_active":"2024-09-12T00:26:23.338462+0000","last_became_peered":"2024-09-12T00:26:23.338462+0000","last_unstale":"2024-09-12T02:07:35.950210+0000","last_undegraded":"2024-09-12T02:07:35.950210+0000","last_fullsized":"2024-09-12T02:07:35.950210+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'46","last_scrub_stamp":"2024-09-12T02:07:35.950000+0000","last_deep_scrub":"266'46","last_deep_scrub_stamp":"2024-09-12T02:07:35.950000+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.950000+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:04.431335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":170,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:48.949202+0000","last_change":"2024-09-12T02:07:48.949202+0000","last_active":"2024-09-12T02:07:48.949202+0000","last_peered":"2024-09-12T02:07:48.949202+0000","last_clean":"2024-09-12T02:07:48.949202+0000","last_became_active":"2024-09-12T01:00:24.070957+0000","last_became_peered":"2024-09-12T01:00:24.070957+0000","last_unstale":"2024-09-12T02:07:48.949202+0000","last_undegraded":"2024-09-12T02:07:48.949202+0000","last_fullsized":"2024-09-12T02:07:48.949202+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:48.949025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:48.949025+0000","last_clean_scrub_stamp":"2024-09-12T02:07:48.949025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:21.628262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:48.186998+0000","last_change":"2024-09-12T02:07:48.186998+0000","last_active":"2024-09-12T02:07:48.186998+0000","last_peered":"2024-09-12T02:07:48.186998+0000","last_clean":"2024-09-12T02:07:48.186998+0000","last_became_active":"2024-09-12T00:32:21.665036+0000","last_became_peered":"2024-09-12T00:32:21.665036+0000","last_unstale":"2024-09-12T02:07:48.186998+0000","last_undegraded":"2024-09-12T02:07:48.186998+0000","last_fullsized":"2024-09-12T02:07:48.186998+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:48.186819+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:48.186819+0000","last_clean_scrub_stamp":"2024-09-12T02:07:48.186819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:02.358934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"266'2","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.642601+0000","last_change":"2024-09-12T02:07:14.642601+0000","last_active":"2024-09-12T02:07:14.642601+0000","last_peered":"2024-09-12T02:07:14.642601+0000","last_clean":"2024-09-12T02:07:14.642601+0000","last_became_active":"2024-09-12T00:32:14.597944+0000","last_became_peered":"2024-09-12T00:32:14.597944+0000","last_unstale":"2024-09-12T02:07:14.642601+0000","last_undegraded":"2024-09-12T02:07:14.642601+0000","last_fullsized":"2024-09-12T02:07:14.642601+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:14.642408+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:14.642408+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.642408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:49.542161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"266'38","reported_seq":176,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.604472+0000","last_change":"2024-09-12T02:07:15.604302+0000","last_active":"2024-09-12T02:07:15.604472+0000","last_peered":"2024-09-12T02:07:15.604472+0000","last_clean":"2024-09-12T02:07:15.604472+0000","last_became_active":"2024-09-12T00:26:23.317790+0000","last_became_peered":"2024-09-12T00:26:23.317790+0000","last_unstale":"2024-09-12T02:07:15.604472+0000","last_undegraded":"2024-09-12T02:07:15.604472+0000","last_fullsized":"2024-09-12T02:07:15.604472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'38","last_scrub_stamp":"2024-09-12T02:07:15.604109+0000","last_deep_scrub":"266'38","last_deep_scrub_stamp":"2024-09-12T02:07:15.604109+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.604109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:50.183161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":107,"num_write":80,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:40.735301+0000","last_change":"2024-09-12T02:07:40.735301+0000","last_active":"2024-09-12T02:07:40.735301+0000","last_peered":"2024-09-12T02:07:40.735301+0000","last_clean":"2024-09-12T02:07:40.735301+0000","last_became_active":"2024-09-12T01:00:24.077509+0000","last_became_peered":"2024-09-12T01:00:24.077509+0000","last_unstale":"2024-09-12T02:07:40.735301+0000","last_undegraded":"2024-09-12T02:07:40.735301+0000","last_fullsized":"2024-09-12T02:07:40.735301+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:40.735126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:40.735126+0000","last_clean_scrub_stamp":"2024-09-12T02:07:40.735126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:51.119161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"266'2","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.015442+0000","last_change":"2024-09-12T02:07:41.015442+0000","last_active":"2024-09-12T02:07:41.015442+0000","last_peered":"2024-09-12T02:07:41.015442+0000","last_clean":"2024-09-12T02:07:41.015442+0000","last_became_active":"2024-09-12T00:32:21.644753+0000","last_became_peered":"2024-09-12T00:32:21.644753+0000","last_unstale":"2024-09-12T02:07:41.015442+0000","last_undegraded":"2024-09-12T02:07:41.015442+0000","last_fullsized":"2024-09-12T02:07:41.015442+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:41.015256+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:41.015256+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.015256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:00.145462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"266'2","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:43.414939+0000","last_change":"2024-09-12T02:07:43.414939+0000","last_active":"2024-09-12T02:07:43.414939+0000","last_peered":"2024-09-12T02:07:43.414939+0000","last_clean":"2024-09-12T02:07:43.414939+0000","last_became_active":"2024-09-12T00:32:14.599452+0000","last_became_peered":"2024-09-12T00:32:14.599452+0000","last_unstale":"2024-09-12T02:07:43.414939+0000","last_undegraded":"2024-09-12T02:07:43.414939+0000","last_fullsized":"2024-09-12T02:07:43.414939+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:43.414759+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:43.414759+0000","last_clean_scrub_stamp":"2024-09-12T02:07:43.414759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:26.424760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"266'137","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:37.875312+0000","last_change":"2024-09-12T02:07:37.875312+0000","last_active":"2024-09-12T02:07:37.875312+0000","last_peered":"2024-09-12T02:07:37.875312+0000","last_clean":"2024-09-12T02:07:37.875312+0000","last_became_active":"2024-09-12T00:26:23.320613+0000","last_became_peered":"2024-09-12T00:26:23.320613+0000","last_unstale":"2024-09-12T02:07:37.875312+0000","last_undegraded":"2024-09-12T02:07:37.875312+0000","last_fullsized":"2024-09-12T02:07:37.875312+0000","mapping_epoch":253,"log_start":"263'100","ondisk_log_start":"263'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'137","last_scrub_stamp":"2024-09-12T02:07:37.875117+0000","last_deep_scrub":"266'137","last_deep_scrub_stamp":"2024-09-12T02:07:37.875117+0000","last_clean_scrub_stamp":"2024-09-12T02:07:37.875117+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:30.720938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":872,"num_read_kb":592,"num_write":184,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3720,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956392+0000","last_change":"2024-09-12T01:00:24.061484+0000","last_active":"2024-09-12T02:03:13.956392+0000","last_peered":"2024-09-12T02:03:13.956392+0000","last_clean":"2024-09-12T02:03:13.956392+0000","last_became_active":"2024-09-12T01:00:24.060699+0000","last_became_peered":"2024-09-12T01:00:24.060699+0000","last_unstale":"2024-09-12T02:03:13.956392+0000","last_undegraded":"2024-09-12T02:03:13.956392+0000","last_fullsized":"2024-09-12T02:03:13.956392+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:39.025638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.582613+0000","last_change":"2024-09-12T02:07:29.582613+0000","last_active":"2024-09-12T02:07:29.582613+0000","last_peered":"2024-09-12T02:07:29.582613+0000","last_clean":"2024-09-12T02:07:29.582613+0000","last_became_active":"2024-09-12T00:32:21.652122+0000","last_became_peered":"2024-09-12T00:32:21.652122+0000","last_unstale":"2024-09-12T02:07:29.582613+0000","last_undegraded":"2024-09-12T02:07:29.582613+0000","last_fullsized":"2024-09-12T02:07:29.582613+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:29.582419+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:29.582419+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:16.256601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"266'7","reported_seq":90,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.088721+0000","last_change":"2024-09-12T02:07:31.088721+0000","last_active":"2024-09-12T02:07:31.088721+0000","last_peered":"2024-09-12T02:07:31.088721+0000","last_clean":"2024-09-12T02:07:31.088721+0000","last_became_active":"2024-09-12T00:32:14.591921+0000","last_became_peered":"2024-09-12T00:32:14.591921+0000","last_unstale":"2024-09-12T02:07:31.088721+0000","last_undegraded":"2024-09-12T02:07:31.088721+0000","last_fullsized":"2024-09-12T02:07:31.088721+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T02:07:31.088545+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T02:07:31.088545+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.088545+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:31.900675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3114,"num_write":12,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"266'28","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.849349+0000","last_change":"2024-09-12T02:07:31.849349+0000","last_active":"2024-09-12T02:07:31.849349+0000","last_peered":"2024-09-12T02:07:31.849349+0000","last_clean":"2024-09-12T02:07:31.849349+0000","last_became_active":"2024-09-12T00:26:23.322866+0000","last_became_peered":"2024-09-12T00:26:23.322866+0000","last_unstale":"2024-09-12T02:07:31.849349+0000","last_undegraded":"2024-09-12T02:07:31.849349+0000","last_fullsized":"2024-09-12T02:07:31.849349+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'28","last_scrub_stamp":"2024-09-12T02:07:31.849167+0000","last_deep_scrub":"266'28","last_deep_scrub_stamp":"2024-09-12T02:07:31.849167+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.849167+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:56.195167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:51.391436+0000","last_change":"2024-09-12T02:07:51.391436+0000","last_active":"2024-09-12T02:07:51.391436+0000","last_peered":"2024-09-12T02:07:51.391436+0000","last_clean":"2024-09-12T02:07:51.391436+0000","last_became_active":"2024-09-12T01:00:24.064203+0000","last_became_peered":"2024-09-12T01:00:24.064203+0000","last_unstale":"2024-09-12T02:07:51.391436+0000","last_undegraded":"2024-09-12T02:07:51.391436+0000","last_fullsized":"2024-09-12T02:07:51.391436+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:51.391261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:51.391261+0000","last_clean_scrub_stamp":"2024-09-12T02:07:51.391261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.028682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"266'7","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.600714+0000","last_change":"2024-09-12T02:07:30.600714+0000","last_active":"2024-09-12T02:07:30.600714+0000","last_peered":"2024-09-12T02:07:30.600714+0000","last_clean":"2024-09-12T02:07:30.600714+0000","last_became_active":"2024-09-12T00:32:21.659437+0000","last_became_peered":"2024-09-12T00:32:21.659437+0000","last_unstale":"2024-09-12T02:07:30.600714+0000","last_undegraded":"2024-09-12T02:07:30.600714+0000","last_fullsized":"2024-09-12T02:07:30.600714+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T02:07:30.600531+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T02:07:30.600531+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.600531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:40.120724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":12,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"266'9","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:42.113862+0000","last_change":"2024-09-12T02:07:42.113727+0000","last_active":"2024-09-12T02:07:42.113862+0000","last_peered":"2024-09-12T02:07:42.113862+0000","last_clean":"2024-09-12T02:07:42.113862+0000","last_became_active":"2024-09-12T00:32:14.597986+0000","last_became_peered":"2024-09-12T00:32:14.597986+0000","last_unstale":"2024-09-12T02:07:42.113862+0000","last_undegraded":"2024-09-12T02:07:42.113862+0000","last_fullsized":"2024-09-12T02:07:42.113862+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:42.113473+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:42.113473+0000","last_clean_scrub_stamp":"2024-09-12T02:07:42.113473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:44.147472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"266'46","reported_seq":207,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.510217+0000","last_change":"2024-09-12T02:07:33.510217+0000","last_active":"2024-09-12T02:07:33.510217+0000","last_peered":"2024-09-12T02:07:33.510217+0000","last_clean":"2024-09-12T02:07:33.510217+0000","last_became_active":"2024-09-12T00:26:23.336010+0000","last_became_peered":"2024-09-12T00:26:23.336010+0000","last_unstale":"2024-09-12T02:07:33.510217+0000","last_undegraded":"2024-09-12T02:07:33.510217+0000","last_fullsized":"2024-09-12T02:07:33.510217+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'46","last_scrub_stamp":"2024-09-12T02:07:33.510010+0000","last_deep_scrub":"266'46","last_deep_scrub_stamp":"2024-09-12T02:07:33.510010+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.510010+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:50.663625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:50.403585+0000","last_change":"2024-09-12T02:07:50.403585+0000","last_active":"2024-09-12T02:07:50.403585+0000","last_peered":"2024-09-12T02:07:50.403585+0000","last_clean":"2024-09-12T02:07:50.403585+0000","last_became_active":"2024-09-12T01:00:24.061624+0000","last_became_peered":"2024-09-12T01:00:24.061624+0000","last_unstale":"2024-09-12T02:07:50.403585+0000","last_undegraded":"2024-09-12T02:07:50.403585+0000","last_fullsized":"2024-09-12T02:07:50.403585+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:50.403402+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:50.403402+0000","last_clean_scrub_stamp":"2024-09-12T02:07:50.403402+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:00.328977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'7","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:49.160320+0000","last_change":"2024-09-12T02:07:49.160320+0000","last_active":"2024-09-12T02:07:49.160320+0000","last_peered":"2024-09-12T02:07:49.160320+0000","last_clean":"2024-09-12T02:07:49.160320+0000","last_became_active":"2024-09-12T00:32:21.666101+0000","last_became_peered":"2024-09-12T00:32:21.666101+0000","last_unstale":"2024-09-12T02:07:49.160320+0000","last_undegraded":"2024-09-12T02:07:49.160320+0000","last_fullsized":"2024-09-12T02:07:49.160320+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T02:07:49.160123+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T02:07:49.160123+0000","last_clean_scrub_stamp":"2024-09-12T02:07:49.160123+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:53.038534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3603,"num_write":12,"num_write_kb":1553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"266'3","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.145297+0000","last_change":"2024-09-12T02:07:25.145297+0000","last_active":"2024-09-12T02:07:25.145297+0000","last_peered":"2024-09-12T02:07:25.145297+0000","last_clean":"2024-09-12T02:07:25.145297+0000","last_became_active":"2024-09-12T00:32:14.579366+0000","last_became_peered":"2024-09-12T00:32:14.579366+0000","last_unstale":"2024-09-12T02:07:25.145297+0000","last_undegraded":"2024-09-12T02:07:25.145297+0000","last_fullsized":"2024-09-12T02:07:25.145297+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:07:25.145121+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:07:25.145121+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.145121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:45.409885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'8","reported_seq":107,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:37.087226+0000","last_change":"2024-09-12T02:07:37.087226+0000","last_active":"2024-09-12T02:07:37.087226+0000","last_peered":"2024-09-12T02:07:37.087226+0000","last_clean":"2024-09-12T02:07:37.087226+0000","last_became_active":"2024-09-12T00:26:23.322841+0000","last_became_peered":"2024-09-12T00:26:23.322841+0000","last_unstale":"2024-09-12T02:07:37.087226+0000","last_undegraded":"2024-09-12T02:07:37.087226+0000","last_fullsized":"2024-09-12T02:07:37.087226+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T02:07:37.087043+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T02:07:37.087043+0000","last_clean_scrub_stamp":"2024-09-12T02:07:37.087043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:50.217818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:03:13.956312+0000","last_change":"2024-09-12T01:00:24.060507+0000","last_active":"2024-09-12T02:03:13.956312+0000","last_peered":"2024-09-12T02:03:13.956312+0000","last_clean":"2024-09-12T02:03:13.956312+0000","last_became_active":"2024-09-12T01:00:24.057061+0000","last_became_peered":"2024-09-12T01:00:24.057061+0000","last_unstale":"2024-09-12T02:03:13.956312+0000","last_undegraded":"2024-09-12T02:03:13.956312+0000","last_fullsized":"2024-09-12T02:03:13.956312+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:07.370347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"266'6","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.089539+0000","last_change":"2024-09-12T02:07:27.089539+0000","last_active":"2024-09-12T02:07:27.089539+0000","last_peered":"2024-09-12T02:07:27.089539+0000","last_clean":"2024-09-12T02:07:27.089539+0000","last_became_active":"2024-09-12T00:32:21.646690+0000","last_became_peered":"2024-09-12T00:32:21.646690+0000","last_unstale":"2024-09-12T02:07:27.089539+0000","last_undegraded":"2024-09-12T02:07:27.089539+0000","last_fullsized":"2024-09-12T02:07:27.089539+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T02:07:27.089348+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T02:07:27.089348+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.089348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:05.354347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2096,"num_write":6,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.744362+0000","last_change":"2024-09-12T02:07:34.744231+0000","last_active":"2024-09-12T02:07:34.744362+0000","last_peered":"2024-09-12T02:07:34.744362+0000","last_clean":"2024-09-12T02:07:34.744362+0000","last_became_active":"2024-09-12T00:32:14.576353+0000","last_became_peered":"2024-09-12T00:32:14.576353+0000","last_unstale":"2024-09-12T02:07:34.744362+0000","last_undegraded":"2024-09-12T02:07:34.744362+0000","last_fullsized":"2024-09-12T02:07:34.744362+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:34.744053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:34.744053+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.744053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:05.248712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"266'19","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:38.048207+0000","last_change":"2024-09-12T02:07:38.048207+0000","last_active":"2024-09-12T02:07:38.048207+0000","last_peered":"2024-09-12T02:07:38.048207+0000","last_clean":"2024-09-12T02:07:38.048207+0000","last_became_active":"2024-09-12T00:26:23.334078+0000","last_became_peered":"2024-09-12T00:26:23.334078+0000","last_unstale":"2024-09-12T02:07:38.048207+0000","last_undegraded":"2024-09-12T02:07:38.048207+0000","last_fullsized":"2024-09-12T02:07:38.048207+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T02:07:38.047968+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T02:07:38.047968+0000","last_clean_scrub_stamp":"2024-09-12T02:07:38.047968+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.034901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":39,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.612999+0000","last_change":"2024-09-12T02:07:20.612766+0000","last_active":"2024-09-12T02:07:20.612999+0000","last_peered":"2024-09-12T02:07:20.612999+0000","last_clean":"2024-09-12T02:07:20.612999+0000","last_became_active":"2024-09-12T01:00:24.075944+0000","last_became_peered":"2024-09-12T01:00:24.075944+0000","last_unstale":"2024-09-12T02:07:20.612999+0000","last_undegraded":"2024-09-12T02:07:20.612999+0000","last_fullsized":"2024-09-12T02:07:20.612999+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:20.612542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:20.612542+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.612542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:41.556751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"266'4","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:40.120709+0000","last_change":"2024-09-12T02:07:40.120709+0000","last_active":"2024-09-12T02:07:40.120709+0000","last_peered":"2024-09-12T02:07:40.120709+0000","last_clean":"2024-09-12T02:07:40.120709+0000","last_became_active":"2024-09-12T00:32:21.653054+0000","last_became_peered":"2024-09-12T00:32:21.653054+0000","last_unstale":"2024-09-12T02:07:40.120709+0000","last_undegraded":"2024-09-12T02:07:40.120709+0000","last_fullsized":"2024-09-12T02:07:40.120709+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:40.120528+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:40.120528+0000","last_clean_scrub_stamp":"2024-09-12T02:07:40.120528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:20.543677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8207,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"266'10","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:40.868716+0000","last_change":"2024-09-12T02:07:40.868716+0000","last_active":"2024-09-12T02:07:40.868716+0000","last_peered":"2024-09-12T02:07:40.868716+0000","last_clean":"2024-09-12T02:07:40.868716+0000","last_became_active":"2024-09-12T00:32:14.596393+0000","last_became_peered":"2024-09-12T00:32:14.596393+0000","last_unstale":"2024-09-12T02:07:40.868716+0000","last_undegraded":"2024-09-12T02:07:40.868716+0000","last_fullsized":"2024-09-12T02:07:40.868716+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T02:07:40.868537+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T02:07:40.868537+0000","last_clean_scrub_stamp":"2024-09-12T02:07:40.868537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:03.243876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9234,"num_write":10,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"266'13","reported_seq":118,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.978104+0000","last_change":"2024-09-12T02:07:34.977815+0000","last_active":"2024-09-12T02:07:34.978104+0000","last_peered":"2024-09-12T02:07:34.978104+0000","last_clean":"2024-09-12T02:07:34.978104+0000","last_became_active":"2024-09-12T00:26:23.353590+0000","last_became_peered":"2024-09-12T00:26:23.353590+0000","last_unstale":"2024-09-12T02:07:34.978104+0000","last_undegraded":"2024-09-12T02:07:34.978104+0000","last_fullsized":"2024-09-12T02:07:34.978104+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'13","last_scrub_stamp":"2024-09-12T02:07:34.977586+0000","last_deep_scrub":"266'13","last_deep_scrub_stamp":"2024-09-12T02:07:34.977586+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.977586+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:02.838274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":34,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:45.903041+0000","last_change":"2024-09-12T02:07:45.902858+0000","last_active":"2024-09-12T02:07:45.903041+0000","last_peered":"2024-09-12T02:07:45.903041+0000","last_clean":"2024-09-12T02:07:45.903041+0000","last_became_active":"2024-09-12T01:00:24.069491+0000","last_became_peered":"2024-09-12T01:00:24.069491+0000","last_unstale":"2024-09-12T02:07:45.903041+0000","last_undegraded":"2024-09-12T02:07:45.903041+0000","last_fullsized":"2024-09-12T02:07:45.903041+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:45.902675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:45.902675+0000","last_clean_scrub_stamp":"2024-09-12T02:07:45.902675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:37.591577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:52.108643+0000","last_change":"2024-09-12T02:07:52.108643+0000","last_active":"2024-09-12T02:07:52.108643+0000","last_peered":"2024-09-12T02:07:52.108643+0000","last_clean":"2024-09-12T02:07:52.108643+0000","last_became_active":"2024-09-12T00:32:21.668268+0000","last_became_peered":"2024-09-12T00:32:21.668268+0000","last_unstale":"2024-09-12T02:07:52.108643+0000","last_undegraded":"2024-09-12T02:07:52.108643+0000","last_fullsized":"2024-09-12T02:07:52.108643+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:52.108460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:52.108460+0000","last_clean_scrub_stamp":"2024-09-12T02:07:52.108460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:52.722764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"266'7","reported_seq":90,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.638164+0000","last_change":"2024-09-12T02:07:22.638164+0000","last_active":"2024-09-12T02:07:22.638164+0000","last_peered":"2024-09-12T02:07:22.638164+0000","last_clean":"2024-09-12T02:07:22.638164+0000","last_became_active":"2024-09-12T00:32:14.610187+0000","last_became_peered":"2024-09-12T00:32:14.610187+0000","last_unstale":"2024-09-12T02:07:22.638164+0000","last_undegraded":"2024-09-12T02:07:22.638164+0000","last_fullsized":"2024-09-12T02:07:22.638164+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T02:07:22.637960+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T02:07:22.637960+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.637960+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:41.204403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2577,"num_write":12,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":88,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.710142+0000","last_change":"2024-09-12T02:07:32.709990+0000","last_active":"2024-09-12T02:07:32.710142+0000","last_peered":"2024-09-12T02:07:32.710142+0000","last_clean":"2024-09-12T02:07:32.710142+0000","last_became_active":"2024-09-12T00:26:23.328238+0000","last_became_peered":"2024-09-12T00:26:23.328238+0000","last_unstale":"2024-09-12T02:07:32.710142+0000","last_undegraded":"2024-09-12T02:07:32.710142+0000","last_fullsized":"2024-09-12T02:07:32.710142+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:32.709812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:32.709812+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.709812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:20.834850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.064254+0000","last_change":"2024-09-12T02:07:29.064110+0000","last_active":"2024-09-12T02:07:29.064254+0000","last_peered":"2024-09-12T02:07:29.064254+0000","last_clean":"2024-09-12T02:07:29.064254+0000","last_became_active":"2024-09-12T01:00:24.074237+0000","last_became_peered":"2024-09-12T01:00:24.074237+0000","last_unstale":"2024-09-12T02:07:29.064254+0000","last_undegraded":"2024-09-12T02:07:29.064254+0000","last_fullsized":"2024-09-12T02:07:29.064254+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:29.063929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:29.063929+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.063929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:37.168116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.595430+0000","last_change":"2024-09-12T02:07:28.595430+0000","last_active":"2024-09-12T02:07:28.595430+0000","last_peered":"2024-09-12T02:07:28.595430+0000","last_clean":"2024-09-12T02:07:28.595430+0000","last_became_active":"2024-09-12T00:32:21.642517+0000","last_became_peered":"2024-09-12T00:32:21.642517+0000","last_unstale":"2024-09-12T02:07:28.595430+0000","last_undegraded":"2024-09-12T02:07:28.595430+0000","last_fullsized":"2024-09-12T02:07:28.595430+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:28.595242+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:28.595242+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.595242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:54.726633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:40.456822+0000","last_change":"2024-09-12T02:07:40.456822+0000","last_active":"2024-09-12T02:07:40.456822+0000","last_peered":"2024-09-12T02:07:40.456822+0000","last_clean":"2024-09-12T02:07:40.456822+0000","last_became_active":"2024-09-12T00:32:14.607520+0000","last_became_peered":"2024-09-12T00:32:14.607520+0000","last_unstale":"2024-09-12T02:07:40.456822+0000","last_undegraded":"2024-09-12T02:07:40.456822+0000","last_fullsized":"2024-09-12T02:07:40.456822+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:40.456583+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:40.456583+0000","last_clean_scrub_stamp":"2024-09-12T02:07:40.456583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:29.402601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"266'27","reported_seq":158,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.134013+0000","last_change":"2024-09-12T02:07:22.133881+0000","last_active":"2024-09-12T02:07:22.134013+0000","last_peered":"2024-09-12T02:07:22.134013+0000","last_clean":"2024-09-12T02:07:22.134013+0000","last_became_active":"2024-09-12T00:26:23.313697+0000","last_became_peered":"2024-09-12T00:26:23.313697+0000","last_unstale":"2024-09-12T02:07:22.134013+0000","last_undegraded":"2024-09-12T02:07:22.134013+0000","last_fullsized":"2024-09-12T02:07:22.134013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'27","last_scrub_stamp":"2024-09-12T02:07:22.133702+0000","last_deep_scrub":"266'27","last_deep_scrub_stamp":"2024-09-12T02:07:22.133702+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.133702+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:37.305108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:44.867513+0000","last_change":"2024-09-12T02:07:44.867513+0000","last_active":"2024-09-12T02:07:44.867513+0000","last_peered":"2024-09-12T02:07:44.867513+0000","last_clean":"2024-09-12T02:07:44.867513+0000","last_became_active":"2024-09-12T01:00:24.072931+0000","last_became_peered":"2024-09-12T01:00:24.072931+0000","last_unstale":"2024-09-12T02:07:44.867513+0000","last_undegraded":"2024-09-12T02:07:44.867513+0000","last_fullsized":"2024-09-12T02:07:44.867513+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:44.867339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:44.867339+0000","last_clean_scrub_stamp":"2024-09-12T02:07:44.867339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:50.192793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:46.168575+0000","last_change":"2024-09-12T02:07:46.168575+0000","last_active":"2024-09-12T02:07:46.168575+0000","last_peered":"2024-09-12T02:07:46.168575+0000","last_clean":"2024-09-12T02:07:46.168575+0000","last_became_active":"2024-09-12T00:32:21.641431+0000","last_became_peered":"2024-09-12T00:32:21.641431+0000","last_unstale":"2024-09-12T02:07:46.168575+0000","last_undegraded":"2024-09-12T02:07:46.168575+0000","last_fullsized":"2024-09-12T02:07:46.168575+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:46.168401+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:46.168401+0000","last_clean_scrub_stamp":"2024-09-12T02:07:46.168401+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:12.428906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20470,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.566676+0000","last_change":"2024-09-12T02:07:27.566676+0000","last_active":"2024-09-12T02:07:27.566676+0000","last_peered":"2024-09-12T02:07:27.566676+0000","last_clean":"2024-09-12T02:07:27.566676+0000","last_became_active":"2024-09-12T00:32:14.596263+0000","last_became_peered":"2024-09-12T00:32:14.596263+0000","last_unstale":"2024-09-12T02:07:27.566676+0000","last_undegraded":"2024-09-12T02:07:27.566676+0000","last_fullsized":"2024-09-12T02:07:27.566676+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:27.566497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:27.566497+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.566497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:36.193123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"266'66","reported_seq":274,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.604738+0000","last_change":"2024-09-12T02:07:23.604600+0000","last_active":"2024-09-12T02:07:23.604738+0000","last_peered":"2024-09-12T02:07:23.604738+0000","last_clean":"2024-09-12T02:07:23.604738+0000","last_became_active":"2024-09-12T00:26:23.327784+0000","last_became_peered":"2024-09-12T00:26:23.327784+0000","last_unstale":"2024-09-12T02:07:23.604738+0000","last_undegraded":"2024-09-12T02:07:23.604738+0000","last_fullsized":"2024-09-12T02:07:23.604738+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'66","last_scrub_stamp":"2024-09-12T02:07:23.604415+0000","last_deep_scrub":"266'66","last_deep_scrub_stamp":"2024-09-12T02:07:23.604415+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.604415+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:50.232583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":253,"num_write":117,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:05:38.990976+0000","last_change":"2024-09-12T01:00:24.067841+0000","last_active":"2024-09-12T02:05:38.990976+0000","last_peered":"2024-09-12T02:05:38.990976+0000","last_clean":"2024-09-12T02:05:38.990976+0000","last_became_active":"2024-09-12T01:00:24.066842+0000","last_became_peered":"2024-09-12T01:00:24.066842+0000","last_unstale":"2024-09-12T02:05:38.990976+0000","last_undegraded":"2024-09-12T02:05:38.990976+0000","last_fullsized":"2024-09-12T02:05:38.990976+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:00:23.014820+0000","last_clean_scrub_stamp":"2024-09-12T01:00:23.014820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:39.027222+0000","last_change":"2024-09-12T02:07:39.027069+0000","last_active":"2024-09-12T02:07:39.027222+0000","last_peered":"2024-09-12T02:07:39.027222+0000","last_clean":"2024-09-12T02:07:39.027222+0000","last_became_active":"2024-09-12T00:32:21.667149+0000","last_became_peered":"2024-09-12T00:32:21.667149+0000","last_unstale":"2024-09-12T02:07:39.027222+0000","last_undegraded":"2024-09-12T02:07:39.027222+0000","last_fullsized":"2024-09-12T02:07:39.027222+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:39.026896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:39.026896+0000","last_clean_scrub_stamp":"2024-09-12T02:07:39.026896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:09.267020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"266'3","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:38.498488+0000","last_change":"2024-09-12T02:07:38.498314+0000","last_active":"2024-09-12T02:07:38.498488+0000","last_peered":"2024-09-12T02:07:38.498488+0000","last_clean":"2024-09-12T02:07:38.498488+0000","last_became_active":"2024-09-12T00:32:14.601148+0000","last_became_peered":"2024-09-12T00:32:14.601148+0000","last_unstale":"2024-09-12T02:07:38.498488+0000","last_undegraded":"2024-09-12T02:07:38.498488+0000","last_fullsized":"2024-09-12T02:07:38.498488+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:07:38.498124+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:07:38.498124+0000","last_clean_scrub_stamp":"2024-09-12T02:07:38.498124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:46.389925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"266'39","reported_seq":191,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.529291+0000","last_change":"2024-09-12T02:07:32.529036+0000","last_active":"2024-09-12T02:07:32.529291+0000","last_peered":"2024-09-12T02:07:32.529291+0000","last_clean":"2024-09-12T02:07:32.529291+0000","last_became_active":"2024-09-12T00:26:23.317880+0000","last_became_peered":"2024-09-12T00:26:23.317880+0000","last_unstale":"2024-09-12T02:07:32.529291+0000","last_undegraded":"2024-09-12T02:07:32.529291+0000","last_fullsized":"2024-09-12T02:07:32.529291+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'39","last_scrub_stamp":"2024-09-12T02:07:32.528820+0000","last_deep_scrub":"266'39","last_deep_scrub_stamp":"2024-09-12T02:07:32.528820+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.528820+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:00.224353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:47.929301+0000","last_change":"2024-09-12T02:07:47.929301+0000","last_active":"2024-09-12T02:07:47.929301+0000","last_peered":"2024-09-12T02:07:47.929301+0000","last_clean":"2024-09-12T02:07:47.929301+0000","last_became_active":"2024-09-12T01:00:24.086101+0000","last_became_peered":"2024-09-12T01:00:24.086101+0000","last_unstale":"2024-09-12T02:07:47.929301+0000","last_undegraded":"2024-09-12T02:07:47.929301+0000","last_fullsized":"2024-09-12T02:07:47.929301+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:47.929107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:47.929107+0000","last_clean_scrub_stamp":"2024-09-12T02:07:47.929107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:50.958164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:39.867934+0000","last_change":"2024-09-12T02:07:39.867776+0000","last_active":"2024-09-12T02:07:39.867934+0000","last_peered":"2024-09-12T02:07:39.867934+0000","last_clean":"2024-09-12T02:07:39.867934+0000","last_became_active":"2024-09-12T00:32:21.634440+0000","last_became_peered":"2024-09-12T00:32:21.634440+0000","last_unstale":"2024-09-12T02:07:39.867934+0000","last_undegraded":"2024-09-12T02:07:39.867934+0000","last_fullsized":"2024-09-12T02:07:39.867934+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:39.867596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:39.867596+0000","last_clean_scrub_stamp":"2024-09-12T02:07:39.867596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:24.312250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.554839+0000","last_change":"2024-09-12T02:07:23.554546+0000","last_active":"2024-09-12T02:07:23.554839+0000","last_peered":"2024-09-12T02:07:23.554839+0000","last_clean":"2024-09-12T02:07:23.554839+0000","last_became_active":"2024-09-12T00:32:14.595782+0000","last_became_peered":"2024-09-12T00:32:14.595782+0000","last_unstale":"2024-09-12T02:07:23.554839+0000","last_undegraded":"2024-09-12T02:07:23.554839+0000","last_fullsized":"2024-09-12T02:07:23.554839+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T02:07:23.554267+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T02:07:23.554267+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.554267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:11.127050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":173,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.803187+0000","last_change":"2024-09-12T02:07:30.803187+0000","last_active":"2024-09-12T02:07:30.803187+0000","last_peered":"2024-09-12T02:07:30.803187+0000","last_clean":"2024-09-12T02:07:30.803187+0000","last_became_active":"2024-09-12T00:26:23.324140+0000","last_became_peered":"2024-09-12T00:26:23.324140+0000","last_unstale":"2024-09-12T02:07:30.803187+0000","last_undegraded":"2024-09-12T02:07:30.803187+0000","last_fullsized":"2024-09-12T02:07:30.803187+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T02:07:30.802991+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T02:07:30.802991+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.802991+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:52.322242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":114,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"266'2","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:46.956033+0000","last_change":"2024-09-12T02:07:46.955766+0000","last_active":"2024-09-12T02:07:46.956033+0000","last_peered":"2024-09-12T02:07:46.956033+0000","last_clean":"2024-09-12T02:07:46.956033+0000","last_became_active":"2024-09-12T01:00:24.080855+0000","last_became_peered":"2024-09-12T01:00:24.080855+0000","last_unstale":"2024-09-12T02:07:46.956033+0000","last_undegraded":"2024-09-12T02:07:46.956033+0000","last_fullsized":"2024-09-12T02:07:46.956033+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:46.955537+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:46.955537+0000","last_clean_scrub_stamp":"2024-09-12T02:07:46.955537+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:48.587050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'4","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.616543+0000","last_change":"2024-09-12T02:07:31.616543+0000","last_active":"2024-09-12T02:07:31.616543+0000","last_peered":"2024-09-12T02:07:31.616543+0000","last_clean":"2024-09-12T02:07:31.616543+0000","last_became_active":"2024-09-12T00:32:21.648333+0000","last_became_peered":"2024-09-12T00:32:21.648333+0000","last_unstale":"2024-09-12T02:07:31.616543+0000","last_undegraded":"2024-09-12T02:07:31.616543+0000","last_fullsized":"2024-09-12T02:07:31.616543+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T02:07:31.616358+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T02:07:31.616358+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.616358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:20.964624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"266'4","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:42.398255+0000","last_change":"2024-09-12T02:07:42.398255+0000","last_active":"2024-09-12T02:07:42.398255+0000","last_peered":"2024-09-12T02:07:42.398255+0000","last_clean":"2024-09-12T02:07:42.398255+0000","last_became_active":"2024-09-12T00:32:14.592875+0000","last_became_peered":"2024-09-12T00:32:14.592875+0000","last_unstale":"2024-09-12T02:07:42.398255+0000","last_undegraded":"2024-09-12T02:07:42.398255+0000","last_fullsized":"2024-09-12T02:07:42.398255+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:42.398041+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:42.398041+0000","last_clean_scrub_stamp":"2024-09-12T02:07:42.398041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:07.655227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"266'15","reported_seq":126,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.982261+0000","last_change":"2024-09-12T02:07:29.982261+0000","last_active":"2024-09-12T02:07:29.982261+0000","last_peered":"2024-09-12T02:07:29.982261+0000","last_clean":"2024-09-12T02:07:29.982261+0000","last_became_active":"2024-09-12T00:26:23.324884+0000","last_became_peered":"2024-09-12T00:26:23.324884+0000","last_unstale":"2024-09-12T02:07:29.982261+0000","last_undegraded":"2024-09-12T02:07:29.982261+0000","last_fullsized":"2024-09-12T02:07:29.982261+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'15","last_scrub_stamp":"2024-09-12T02:07:29.982054+0000","last_deep_scrub":"266'15","last_deep_scrub_stamp":"2024-09-12T02:07:29.982054+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.982054+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:20.636440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:46.451311+0000","last_change":"2024-09-12T02:07:46.451174+0000","last_active":"2024-09-12T02:07:46.451311+0000","last_peered":"2024-09-12T02:07:46.451311+0000","last_clean":"2024-09-12T02:07:46.451311+0000","last_became_active":"2024-09-12T01:00:24.061882+0000","last_became_peered":"2024-09-12T01:00:24.061882+0000","last_unstale":"2024-09-12T02:07:46.451311+0000","last_undegraded":"2024-09-12T02:07:46.451311+0000","last_fullsized":"2024-09-12T02:07:46.451311+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:46.450986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:46.450986+0000","last_clean_scrub_stamp":"2024-09-12T02:07:46.450986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:38.754502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'4","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.884363+0000","last_change":"2024-09-12T02:07:41.884363+0000","last_active":"2024-09-12T02:07:41.884363+0000","last_peered":"2024-09-12T02:07:41.884363+0000","last_clean":"2024-09-12T02:07:41.884363+0000","last_became_active":"2024-09-12T00:32:21.667346+0000","last_became_peered":"2024-09-12T00:32:21.667346+0000","last_unstale":"2024-09-12T02:07:41.884363+0000","last_undegraded":"2024-09-12T02:07:41.884363+0000","last_fullsized":"2024-09-12T02:07:41.884363+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T02:07:41.884137+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T02:07:41.884137+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.884137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:34.758004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"266'9","reported_seq":93,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:36.130988+0000","last_change":"2024-09-12T02:07:36.130988+0000","last_active":"2024-09-12T02:07:36.130988+0000","last_peered":"2024-09-12T02:07:36.130988+0000","last_clean":"2024-09-12T02:07:36.130988+0000","last_became_active":"2024-09-12T00:32:14.576974+0000","last_became_peered":"2024-09-12T00:32:14.576974+0000","last_unstale":"2024-09-12T02:07:36.130988+0000","last_undegraded":"2024-09-12T02:07:36.130988+0000","last_fullsized":"2024-09-12T02:07:36.130988+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:36.130774+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:36.130774+0000","last_clean_scrub_stamp":"2024-09-12T02:07:36.130774+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:04.647343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4127,"num_write":14,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"266'52","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.133235+0000","last_change":"2024-09-12T02:07:21.133235+0000","last_active":"2024-09-12T02:07:21.133235+0000","last_peered":"2024-09-12T02:07:21.133235+0000","last_clean":"2024-09-12T02:07:21.133235+0000","last_became_active":"2024-09-12T00:26:23.315633+0000","last_became_peered":"2024-09-12T00:26:23.315633+0000","last_unstale":"2024-09-12T02:07:21.133235+0000","last_undegraded":"2024-09-12T02:07:21.133235+0000","last_fullsized":"2024-09-12T02:07:21.133235+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'52","last_scrub_stamp":"2024-09-12T02:07:21.133042+0000","last_deep_scrub":"266'52","last_deep_scrub_stamp":"2024-09-12T02:07:21.133042+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.133042+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:25.001126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":203,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:43.893118+0000","last_change":"2024-09-12T02:07:43.893118+0000","last_active":"2024-09-12T02:07:43.893118+0000","last_peered":"2024-09-12T02:07:43.893118+0000","last_clean":"2024-09-12T02:07:43.893118+0000","last_became_active":"2024-09-12T01:00:24.079834+0000","last_became_peered":"2024-09-12T01:00:24.079834+0000","last_unstale":"2024-09-12T02:07:43.893118+0000","last_undegraded":"2024-09-12T02:07:43.893118+0000","last_fullsized":"2024-09-12T02:07:43.893118+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:43.892940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:43.892940+0000","last_clean_scrub_stamp":"2024-09-12T02:07:43.892940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:33.893814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:44.403855+0000","last_change":"2024-09-12T02:07:44.403855+0000","last_active":"2024-09-12T02:07:44.403855+0000","last_peered":"2024-09-12T02:07:44.403855+0000","last_clean":"2024-09-12T02:07:44.403855+0000","last_became_active":"2024-09-12T00:32:21.663547+0000","last_became_peered":"2024-09-12T00:32:21.663547+0000","last_unstale":"2024-09-12T02:07:44.403855+0000","last_undegraded":"2024-09-12T02:07:44.403855+0000","last_fullsized":"2024-09-12T02:07:44.403855+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:44.403662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:44.403662+0000","last_clean_scrub_stamp":"2024-09-12T02:07:44.403662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:54.743067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:38.879838+0000","last_change":"2024-09-12T02:07:38.879838+0000","last_active":"2024-09-12T02:07:38.879838+0000","last_peered":"2024-09-12T02:07:38.879838+0000","last_clean":"2024-09-12T02:07:38.879838+0000","last_became_active":"2024-09-12T00:32:14.593670+0000","last_became_peered":"2024-09-12T00:32:14.593670+0000","last_unstale":"2024-09-12T02:07:38.879838+0000","last_undegraded":"2024-09-12T02:07:38.879838+0000","last_fullsized":"2024-09-12T02:07:38.879838+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:38.879640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:38.879640+0000","last_clean_scrub_stamp":"2024-09-12T02:07:38.879640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:09.993819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'28","reported_seq":164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.474477+0000","last_change":"2024-09-12T02:07:34.474477+0000","last_active":"2024-09-12T02:07:34.474477+0000","last_peered":"2024-09-12T02:07:34.474477+0000","last_clean":"2024-09-12T02:07:34.474477+0000","last_became_active":"2024-09-12T00:26:23.338248+0000","last_became_peered":"2024-09-12T00:26:23.338248+0000","last_unstale":"2024-09-12T02:07:34.474477+0000","last_undegraded":"2024-09-12T02:07:34.474477+0000","last_fullsized":"2024-09-12T02:07:34.474477+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T02:07:34.474291+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T02:07:34.474291+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.474291+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:49.247433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:39.704156+0000","last_change":"2024-09-12T02:07:39.704156+0000","last_active":"2024-09-12T02:07:39.704156+0000","last_peered":"2024-09-12T02:07:39.704156+0000","last_clean":"2024-09-12T02:07:39.704156+0000","last_became_active":"2024-09-12T01:00:24.068145+0000","last_became_peered":"2024-09-12T01:00:24.068145+0000","last_unstale":"2024-09-12T02:07:39.704156+0000","last_undegraded":"2024-09-12T02:07:39.704156+0000","last_fullsized":"2024-09-12T02:07:39.704156+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:39.703977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:39.703977+0000","last_clean_scrub_stamp":"2024-09-12T02:07:39.703977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:39.366222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:45.415225+0000","last_change":"2024-09-12T02:07:45.415225+0000","last_active":"2024-09-12T02:07:45.415225+0000","last_peered":"2024-09-12T02:07:45.415225+0000","last_clean":"2024-09-12T02:07:45.415225+0000","last_became_active":"2024-09-12T00:32:21.668979+0000","last_became_peered":"2024-09-12T00:32:21.668979+0000","last_unstale":"2024-09-12T02:07:45.415225+0000","last_undegraded":"2024-09-12T02:07:45.415225+0000","last_fullsized":"2024-09-12T02:07:45.415225+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T02:07:45.415012+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T02:07:45.415012+0000","last_clean_scrub_stamp":"2024-09-12T02:07:45.415012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:58.223857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.568449+0000","last_change":"2024-09-12T02:07:18.568449+0000","last_active":"2024-09-12T02:07:18.568449+0000","last_peered":"2024-09-12T02:07:18.568449+0000","last_clean":"2024-09-12T02:07:18.568449+0000","last_became_active":"2024-09-12T00:32:14.610414+0000","last_became_peered":"2024-09-12T00:32:14.610414+0000","last_unstale":"2024-09-12T02:07:18.568449+0000","last_undegraded":"2024-09-12T02:07:18.568449+0000","last_fullsized":"2024-09-12T02:07:18.568449+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:18.568255+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:18.568255+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.568255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:36.781285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"266'33","reported_seq":176,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.127247+0000","last_change":"2024-09-12T02:07:20.127247+0000","last_active":"2024-09-12T02:07:20.127247+0000","last_peered":"2024-09-12T02:07:20.127247+0000","last_clean":"2024-09-12T02:07:20.127247+0000","last_became_active":"2024-09-12T00:26:23.327296+0000","last_became_peered":"2024-09-12T00:26:23.327296+0000","last_unstale":"2024-09-12T02:07:20.127247+0000","last_undegraded":"2024-09-12T02:07:20.127247+0000","last_fullsized":"2024-09-12T02:07:20.127247+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T02:07:20.127030+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T02:07:20.127030+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.127030+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:58.191456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.644535+0000","last_change":"2024-09-12T02:07:33.644535+0000","last_active":"2024-09-12T02:07:33.644535+0000","last_peered":"2024-09-12T02:07:33.644535+0000","last_clean":"2024-09-12T02:07:33.644535+0000","last_became_active":"2024-09-12T01:00:24.067665+0000","last_became_peered":"2024-09-12T01:00:24.067665+0000","last_unstale":"2024-09-12T02:07:33.644535+0000","last_undegraded":"2024-09-12T02:07:33.644535+0000","last_fullsized":"2024-09-12T02:07:33.644535+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:33.644363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:33.644363+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.644363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:33.974614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.854561+0000","last_change":"2024-09-12T02:07:35.854296+0000","last_active":"2024-09-12T02:07:35.854561+0000","last_peered":"2024-09-12T02:07:35.854561+0000","last_clean":"2024-09-12T02:07:35.854561+0000","last_became_active":"2024-09-12T00:32:21.644891+0000","last_became_peered":"2024-09-12T00:32:21.644891+0000","last_unstale":"2024-09-12T02:07:35.854561+0000","last_undegraded":"2024-09-12T02:07:35.854561+0000","last_fullsized":"2024-09-12T02:07:35.854561+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:35.854058+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:35.854058+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.854058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:53.155420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"266'2","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:36.708902+0000","last_change":"2024-09-12T02:07:36.708902+0000","last_active":"2024-09-12T02:07:36.708902+0000","last_peered":"2024-09-12T02:07:36.708902+0000","last_clean":"2024-09-12T02:07:36.708902+0000","last_became_active":"2024-09-12T00:32:14.598981+0000","last_became_peered":"2024-09-12T00:32:14.598981+0000","last_unstale":"2024-09-12T02:07:36.708902+0000","last_undegraded":"2024-09-12T02:07:36.708902+0000","last_fullsized":"2024-09-12T02:07:36.708902+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:36.708727+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:36.708727+0000","last_clean_scrub_stamp":"2024-09-12T02:07:36.708727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:09.874104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"266'25","reported_seq":160,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.824747+0000","last_change":"2024-09-12T02:07:29.824747+0000","last_active":"2024-09-12T02:07:29.824747+0000","last_peered":"2024-09-12T02:07:29.824747+0000","last_clean":"2024-09-12T02:07:29.824747+0000","last_became_active":"2024-09-12T00:26:23.316443+0000","last_became_peered":"2024-09-12T00:26:23.316443+0000","last_unstale":"2024-09-12T02:07:29.824747+0000","last_undegraded":"2024-09-12T02:07:29.824747+0000","last_fullsized":"2024-09-12T02:07:29.824747+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'25","last_scrub_stamp":"2024-09-12T02:07:29.824565+0000","last_deep_scrub":"266'25","last_deep_scrub_stamp":"2024-09-12T02:07:29.824565+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.824565+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:22.429912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":90,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:42.062828+0000","last_change":"2024-09-12T02:07:42.062828+0000","last_active":"2024-09-12T02:07:42.062828+0000","last_peered":"2024-09-12T02:07:42.062828+0000","last_clean":"2024-09-12T02:07:42.062828+0000","last_became_active":"2024-09-12T01:00:24.071428+0000","last_became_peered":"2024-09-12T01:00:24.071428+0000","last_unstale":"2024-09-12T02:07:42.062828+0000","last_undegraded":"2024-09-12T02:07:42.062828+0000","last_fullsized":"2024-09-12T02:07:42.062828+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:42.062643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:42.062643+0000","last_clean_scrub_stamp":"2024-09-12T02:07:42.062643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:05.754915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"266'9","reported_seq":90,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:38.050607+0000","last_change":"2024-09-12T02:07:38.050467+0000","last_active":"2024-09-12T02:07:38.050607+0000","last_peered":"2024-09-12T02:07:38.050607+0000","last_clean":"2024-09-12T02:07:38.050607+0000","last_became_active":"2024-09-12T00:32:21.653749+0000","last_became_peered":"2024-09-12T00:32:21.653749+0000","last_unstale":"2024-09-12T02:07:38.050607+0000","last_undegraded":"2024-09-12T02:07:38.050607+0000","last_fullsized":"2024-09-12T02:07:38.050607+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:38.050272+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:38.050272+0000","last_clean_scrub_stamp":"2024-09-12T02:07:38.050272+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:04.987928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.877101+0000","last_change":"2024-09-12T02:07:34.876846+0000","last_active":"2024-09-12T02:07:34.877101+0000","last_peered":"2024-09-12T02:07:34.877101+0000","last_clean":"2024-09-12T02:07:34.877101+0000","last_became_active":"2024-09-12T00:32:14.596498+0000","last_became_peered":"2024-09-12T00:32:14.596498+0000","last_unstale":"2024-09-12T02:07:34.877101+0000","last_undegraded":"2024-09-12T02:07:34.877101+0000","last_fullsized":"2024-09-12T02:07:34.877101+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:34.876556+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:34.876556+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.876556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:02.390345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"266'50","reported_seq":226,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.528784+0000","last_change":"2024-09-12T02:07:24.528784+0000","last_active":"2024-09-12T02:07:24.528784+0000","last_peered":"2024-09-12T02:07:24.528784+0000","last_clean":"2024-09-12T02:07:24.528784+0000","last_became_active":"2024-09-12T00:26:23.340608+0000","last_became_peered":"2024-09-12T00:26:23.340608+0000","last_unstale":"2024-09-12T02:07:24.528784+0000","last_undegraded":"2024-09-12T02:07:24.528784+0000","last_fullsized":"2024-09-12T02:07:24.528784+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'50","last_scrub_stamp":"2024-09-12T02:07:24.528600+0000","last_deep_scrub":"266'50","last_deep_scrub_stamp":"2024-09-12T02:07:24.528600+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.528600+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.621123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":178,"num_write":83,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'2","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.587035+0000","last_change":"2024-09-12T02:07:17.586891+0000","last_active":"2024-09-12T02:07:17.587035+0000","last_peered":"2024-09-12T02:07:17.587035+0000","last_clean":"2024-09-12T02:07:17.587035+0000","last_became_active":"2024-09-12T01:00:24.083260+0000","last_became_peered":"2024-09-12T01:00:24.083260+0000","last_unstale":"2024-09-12T02:07:17.587035+0000","last_undegraded":"2024-09-12T02:07:17.587035+0000","last_fullsized":"2024-09-12T02:07:17.587035+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:17.586703+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:17.586703+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.586703+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:52.599255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"266'9","reported_seq":94,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.522415+0000","last_change":"2024-09-12T02:07:26.522415+0000","last_active":"2024-09-12T02:07:26.522415+0000","last_peered":"2024-09-12T02:07:26.522415+0000","last_clean":"2024-09-12T02:07:26.522415+0000","last_became_active":"2024-09-12T00:32:21.655849+0000","last_became_peered":"2024-09-12T00:32:21.655849+0000","last_unstale":"2024-09-12T02:07:26.522415+0000","last_undegraded":"2024-09-12T02:07:26.522415+0000","last_fullsized":"2024-09-12T02:07:26.522415+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:26.522238+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:26.522238+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.522238+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:41.615137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15358,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.838345+0000","last_change":"2024-09-12T02:07:32.838345+0000","last_active":"2024-09-12T02:07:32.838345+0000","last_peered":"2024-09-12T02:07:32.838345+0000","last_clean":"2024-09-12T02:07:32.838345+0000","last_became_active":"2024-09-12T00:32:14.604519+0000","last_became_peered":"2024-09-12T00:32:14.604519+0000","last_unstale":"2024-09-12T02:07:32.838345+0000","last_undegraded":"2024-09-12T02:07:32.838345+0000","last_fullsized":"2024-09-12T02:07:32.838345+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:32.838163+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:32.838163+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.838163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:04.803343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.655363+0000","last_change":"2024-09-12T02:07:30.655363+0000","last_active":"2024-09-12T02:07:30.655363+0000","last_peered":"2024-09-12T02:07:30.655363+0000","last_clean":"2024-09-12T02:07:30.655363+0000","last_became_active":"2024-09-12T00:26:23.328187+0000","last_became_peered":"2024-09-12T00:26:23.328187+0000","last_unstale":"2024-09-12T02:07:30.655363+0000","last_undegraded":"2024-09-12T02:07:30.655363+0000","last_fullsized":"2024-09-12T02:07:30.655363+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T02:07:30.655180+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T02:07:30.655180+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.655180+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:13.153302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":91,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:49.393823+0000","last_change":"2024-09-12T02:07:49.393823+0000","last_active":"2024-09-12T02:07:49.393823+0000","last_peered":"2024-09-12T02:07:49.393823+0000","last_clean":"2024-09-12T02:07:49.393823+0000","last_became_active":"2024-09-12T01:00:24.062597+0000","last_became_peered":"2024-09-12T01:00:24.062597+0000","last_unstale":"2024-09-12T02:07:49.393823+0000","last_undegraded":"2024-09-12T02:07:49.393823+0000","last_fullsized":"2024-09-12T02:07:49.393823+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:49.393637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:49.393637+0000","last_clean_scrub_stamp":"2024-09-12T02:07:49.393637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.135019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:38.745756+0000","last_change":"2024-09-12T02:07:38.745756+0000","last_active":"2024-09-12T02:07:38.745756+0000","last_peered":"2024-09-12T02:07:38.745756+0000","last_clean":"2024-09-12T02:07:38.745756+0000","last_became_active":"2024-09-12T00:32:21.644950+0000","last_became_peered":"2024-09-12T00:32:21.644950+0000","last_unstale":"2024-09-12T02:07:38.745756+0000","last_undegraded":"2024-09-12T02:07:38.745756+0000","last_fullsized":"2024-09-12T02:07:38.745756+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:38.745568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:38.745568+0000","last_clean_scrub_stamp":"2024-09-12T02:07:38.745568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.026675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":90,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.887829+0000","last_change":"2024-09-12T02:07:33.887829+0000","last_active":"2024-09-12T02:07:33.887829+0000","last_peered":"2024-09-12T02:07:33.887829+0000","last_clean":"2024-09-12T02:07:33.887829+0000","last_became_active":"2024-09-12T00:32:14.597376+0000","last_became_peered":"2024-09-12T00:32:14.597376+0000","last_unstale":"2024-09-12T02:07:33.887829+0000","last_undegraded":"2024-09-12T02:07:33.887829+0000","last_fullsized":"2024-09-12T02:07:33.887829+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:33.887632+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:33.887632+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.887632+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:35.381572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"266'77","reported_seq":305,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.110227+0000","last_change":"2024-09-12T02:07:29.110227+0000","last_active":"2024-09-12T02:07:29.110227+0000","last_peered":"2024-09-12T02:07:29.110227+0000","last_clean":"2024-09-12T02:07:29.110227+0000","last_became_active":"2024-09-12T00:26:23.338274+0000","last_became_peered":"2024-09-12T00:26:23.338274+0000","last_unstale":"2024-09-12T02:07:29.110227+0000","last_undegraded":"2024-09-12T02:07:29.110227+0000","last_fullsized":"2024-09-12T02:07:29.110227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'77","last_scrub_stamp":"2024-09-12T02:07:29.110050+0000","last_deep_scrub":"266'77","last_deep_scrub_stamp":"2024-09-12T02:07:29.110050+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.110050+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:17.917808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":296,"num_write":117,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:48.407029+0000","last_change":"2024-09-12T02:07:48.407029+0000","last_active":"2024-09-12T02:07:48.407029+0000","last_peered":"2024-09-12T02:07:48.407029+0000","last_clean":"2024-09-12T02:07:48.407029+0000","last_became_active":"2024-09-12T01:00:24.053408+0000","last_became_peered":"2024-09-12T01:00:24.053408+0000","last_unstale":"2024-09-12T02:07:48.407029+0000","last_undegraded":"2024-09-12T02:07:48.407029+0000","last_fullsized":"2024-09-12T02:07:48.407029+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:48.406840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:48.406840+0000","last_clean_scrub_stamp":"2024-09-12T02:07:48.406840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:48.623885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.131404+0000","last_change":"2024-09-12T02:07:26.131404+0000","last_active":"2024-09-12T02:07:26.131404+0000","last_peered":"2024-09-12T02:07:26.131404+0000","last_clean":"2024-09-12T02:07:26.131404+0000","last_became_active":"2024-09-12T00:32:33.790018+0000","last_became_peered":"2024-09-12T00:32:33.790018+0000","last_unstale":"2024-09-12T02:07:26.131404+0000","last_undegraded":"2024-09-12T02:07:26.131404+0000","last_fullsized":"2024-09-12T02:07:26.131404+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:26.131217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:26.131217+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.131217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:43.818640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.561731+0000","last_change":"2024-09-12T02:07:25.561731+0000","last_active":"2024-09-12T02:07:25.561731+0000","last_peered":"2024-09-12T02:07:25.561731+0000","last_clean":"2024-09-12T02:07:25.561731+0000","last_became_active":"2024-09-12T00:32:14.580350+0000","last_became_peered":"2024-09-12T00:32:14.580350+0000","last_unstale":"2024-09-12T02:07:25.561731+0000","last_undegraded":"2024-09-12T02:07:25.561731+0000","last_fullsized":"2024-09-12T02:07:25.561731+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.561549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.561549+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.561549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:44.815598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"266'23","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.156871+0000","last_change":"2024-09-12T02:07:19.156871+0000","last_active":"2024-09-12T02:07:19.156871+0000","last_peered":"2024-09-12T02:07:19.156871+0000","last_clean":"2024-09-12T02:07:19.156871+0000","last_became_active":"2024-09-12T00:26:23.318720+0000","last_became_peered":"2024-09-12T00:26:23.318720+0000","last_unstale":"2024-09-12T02:07:19.156871+0000","last_undegraded":"2024-09-12T02:07:19.156871+0000","last_fullsized":"2024-09-12T02:07:19.156871+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'23","last_scrub_stamp":"2024-09-12T02:07:19.156669+0000","last_deep_scrub":"266'23","last_deep_scrub_stamp":"2024-09-12T02:07:19.156669+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.156669+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:19.367324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:42.917981+0000","last_change":"2024-09-12T02:07:42.917981+0000","last_active":"2024-09-12T02:07:42.917981+0000","last_peered":"2024-09-12T02:07:42.917981+0000","last_clean":"2024-09-12T02:07:42.917981+0000","last_became_active":"2024-09-12T01:00:24.072773+0000","last_became_peered":"2024-09-12T01:00:24.072773+0000","last_unstale":"2024-09-12T02:07:42.917981+0000","last_undegraded":"2024-09-12T02:07:42.917981+0000","last_fullsized":"2024-09-12T02:07:42.917981+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:42.917796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:42.917796+0000","last_clean_scrub_stamp":"2024-09-12T02:07:42.917796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:51.432154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"266'8","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.129491+0000","last_change":"2024-09-12T02:07:35.129491+0000","last_active":"2024-09-12T02:07:35.129491+0000","last_peered":"2024-09-12T02:07:35.129491+0000","last_clean":"2024-09-12T02:07:35.129491+0000","last_became_active":"2024-09-12T00:32:21.643272+0000","last_became_peered":"2024-09-12T00:32:21.643272+0000","last_unstale":"2024-09-12T02:07:35.129491+0000","last_undegraded":"2024-09-12T02:07:35.129491+0000","last_fullsized":"2024-09-12T02:07:35.129491+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'8","last_scrub_stamp":"2024-09-12T02:07:35.129310+0000","last_deep_scrub":"266'8","last_deep_scrub_stamp":"2024-09-12T02:07:35.129310+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.129310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:11.967835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":18,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.165654+0000","last_change":"2024-09-12T02:07:24.165654+0000","last_active":"2024-09-12T02:07:24.165654+0000","last_peered":"2024-09-12T02:07:24.165654+0000","last_clean":"2024-09-12T02:07:24.165654+0000","last_became_active":"2024-09-12T00:32:14.579278+0000","last_became_peered":"2024-09-12T00:32:14.579278+0000","last_unstale":"2024-09-12T02:07:24.165654+0000","last_undegraded":"2024-09-12T02:07:24.165654+0000","last_fullsized":"2024-09-12T02:07:24.165654+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.165470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.165470+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.165470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:02.815712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"266'19","reported_seq":145,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.838234+0000","last_change":"2024-09-12T02:07:27.838234+0000","last_active":"2024-09-12T02:07:27.838234+0000","last_peered":"2024-09-12T02:07:27.838234+0000","last_clean":"2024-09-12T02:07:27.838234+0000","last_became_active":"2024-09-12T00:26:23.306139+0000","last_became_peered":"2024-09-12T00:26:23.306139+0000","last_unstale":"2024-09-12T02:07:27.838234+0000","last_undegraded":"2024-09-12T02:07:27.838234+0000","last_fullsized":"2024-09-12T02:07:27.838234+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T02:07:27.838004+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T02:07:27.838004+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.838004+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:31.033055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"266'329","reported_seq":1082,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.791875+0000","last_change":"2024-09-12T02:07:06.791875+0000","last_active":"2024-09-12T02:07:06.791875+0000","last_peered":"2024-09-12T02:07:06.791875+0000","last_clean":"2024-09-12T02:07:06.791875+0000","last_became_active":"2024-09-12T00:09:59.316094+0000","last_became_peered":"2024-09-12T00:09:59.316094+0000","last_unstale":"2024-09-12T02:07:06.791875+0000","last_undegraded":"2024-09-12T02:07:06.791875+0000","last_fullsized":"2024-09-12T02:07:06.791875+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'329","last_scrub_stamp":"2024-09-12T02:07:06.791586+0000","last_deep_scrub":"266'329","last_deep_scrub_stamp":"2024-09-12T02:07:06.791586+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.791586+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:12.851892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441871,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":581,"num_read_kb":103153,"num_write":998,"num_write_kb":38551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"266'996","reported_seq":2787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.571015+0000","last_change":"2024-09-12T02:07:13.570879+0000","last_active":"2024-09-12T02:07:13.571015+0000","last_peered":"2024-09-12T02:07:13.571015+0000","last_clean":"2024-09-12T02:07:13.571015+0000","last_became_active":"2024-09-12T00:10:01.281465+0000","last_became_peered":"2024-09-12T00:10:01.281465+0000","last_unstale":"2024-09-12T02:07:13.571015+0000","last_undegraded":"2024-09-12T02:07:13.571015+0000","last_fullsized":"2024-09-12T02:07:13.571015+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'996","last_scrub_stamp":"2024-09-12T02:07:13.570650+0000","last_deep_scrub":"266'996","last_deep_scrub_stamp":"2024-09-12T02:07:13.570650+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.570650+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":900,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:50.111365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4736,"num_read_kb":4236,"num_write":1359,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"266'354","reported_seq":1056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.469755+0000","last_change":"2024-09-12T02:06:56.469755+0000","last_active":"2024-09-12T02:06:56.469755+0000","last_peered":"2024-09-12T02:06:56.469755+0000","last_clean":"2024-09-12T02:06:56.469755+0000","last_became_active":"2024-09-12T00:09:59.311178+0000","last_became_peered":"2024-09-12T00:09:59.311178+0000","last_unstale":"2024-09-12T02:06:56.469755+0000","last_undegraded":"2024-09-12T02:06:56.469755+0000","last_fullsized":"2024-09-12T02:06:56.469755+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'354","last_scrub_stamp":"2024-09-12T02:06:56.469492+0000","last_deep_scrub":"266'354","last_deep_scrub_stamp":"2024-09-12T02:06:56.469492+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.469492+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.533391+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399015,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":11355,"num_write":1177,"num_write_kb":19733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"266'878","reported_seq":2494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.857628+0000","last_change":"2024-09-12T02:07:10.857479+0000","last_active":"2024-09-12T02:07:10.857628+0000","last_peered":"2024-09-12T02:07:10.857628+0000","last_clean":"2024-09-12T02:07:10.857628+0000","last_became_active":"2024-09-12T00:10:01.268068+0000","last_became_peered":"2024-09-12T00:10:01.268068+0000","last_unstale":"2024-09-12T02:07:10.857628+0000","last_undegraded":"2024-09-12T02:07:10.857628+0000","last_fullsized":"2024-09-12T02:07:10.857628+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'878","last_scrub_stamp":"2024-09-12T02:07:10.857289+0000","last_deep_scrub":"266'878","last_deep_scrub_stamp":"2024-09-12T02:07:10.857289+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.857289+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:43.512649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4189,"num_read_kb":3768,"num_write":1161,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"266'376","reported_seq":1090,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.497550+0000","last_change":"2024-09-12T02:07:00.497550+0000","last_active":"2024-09-12T02:07:00.497550+0000","last_peered":"2024-09-12T02:07:00.497550+0000","last_clean":"2024-09-12T02:07:00.497550+0000","last_became_active":"2024-09-12T00:09:59.296557+0000","last_became_peered":"2024-09-12T00:09:59.296557+0000","last_unstale":"2024-09-12T02:07:00.497550+0000","last_undegraded":"2024-09-12T02:07:00.497550+0000","last_fullsized":"2024-09-12T02:07:00.497550+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'376","last_scrub_stamp":"2024-09-12T02:07:00.497323+0000","last_deep_scrub":"266'376","last_deep_scrub_stamp":"2024-09-12T02:07:00.497323+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.497323+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.306173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653297,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":575,"num_read_kb":57177,"num_write":1185,"num_write_kb":38522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1197","reported_seq":2918,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.068852+0000","last_change":"2024-09-12T02:07:13.068672+0000","last_active":"2024-09-12T02:07:13.068852+0000","last_peered":"2024-09-12T02:07:13.068852+0000","last_clean":"2024-09-12T02:07:13.068852+0000","last_became_active":"2024-09-12T00:10:01.251038+0000","last_became_peered":"2024-09-12T00:10:01.251038+0000","last_unstale":"2024-09-12T02:07:13.068852+0000","last_undegraded":"2024-09-12T02:07:13.068852+0000","last_fullsized":"2024-09-12T02:07:13.068852+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1197","last_scrub_stamp":"2024-09-12T02:07:13.068485+0000","last_deep_scrub":"266'1197","last_deep_scrub_stamp":"2024-09-12T02:07:13.068485+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.068485+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:34.941751+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5594,"num_read_kb":4965,"num_write":1641,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"266'307","reported_seq":964,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.585374+0000","last_change":"2024-09-12T02:07:06.585374+0000","last_active":"2024-09-12T02:07:06.585374+0000","last_peered":"2024-09-12T02:07:06.585374+0000","last_clean":"2024-09-12T02:07:06.585374+0000","last_became_active":"2024-09-12T00:09:59.278426+0000","last_became_peered":"2024-09-12T00:09:59.278426+0000","last_unstale":"2024-09-12T02:07:06.585374+0000","last_undegraded":"2024-09-12T02:07:06.585374+0000","last_fullsized":"2024-09-12T02:07:06.585374+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'307","last_scrub_stamp":"2024-09-12T02:07:06.585161+0000","last_deep_scrub":"266'307","last_deep_scrub_stamp":"2024-09-12T02:07:06.585161+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.585161+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:20.322727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":431,"num_read_kb":8612,"num_write":1021,"num_write_kb":32048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"266'443","reported_seq":1957,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.553617+0000","last_change":"2024-09-12T02:07:10.553353+0000","last_active":"2024-09-12T02:07:10.553617+0000","last_peered":"2024-09-12T02:07:10.553617+0000","last_clean":"2024-09-12T02:07:10.553617+0000","last_became_active":"2024-09-12T00:10:01.247807+0000","last_became_peered":"2024-09-12T00:10:01.247807+0000","last_unstale":"2024-09-12T02:07:10.553617+0000","last_undegraded":"2024-09-12T02:07:10.553617+0000","last_fullsized":"2024-09-12T02:07:10.553617+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'443","last_scrub_stamp":"2024-09-12T02:07:10.553061+0000","last_deep_scrub":"266'443","last_deep_scrub_stamp":"2024-09-12T02:07:10.553061+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.553061+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:25.618102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2317,"num_read_kb":2164,"num_write":517,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"266'312","reported_seq":1030,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.785609+0000","last_change":"2024-09-12T02:07:04.785461+0000","last_active":"2024-09-12T02:07:04.785609+0000","last_peered":"2024-09-12T02:07:04.785609+0000","last_clean":"2024-09-12T02:07:04.785609+0000","last_became_active":"2024-09-12T00:09:59.314222+0000","last_became_peered":"2024-09-12T00:09:59.314222+0000","last_unstale":"2024-09-12T02:07:04.785609+0000","last_undegraded":"2024-09-12T02:07:04.785609+0000","last_fullsized":"2024-09-12T02:07:04.785609+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'312","last_scrub_stamp":"2024-09-12T02:07:04.785112+0000","last_deep_scrub":"266'312","last_deep_scrub_stamp":"2024-09-12T02:07:04.785112+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.785112+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:19.854594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":10075,"num_write":947,"num_write_kb":41375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"266'517","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.092162+0000","last_change":"2024-09-12T02:07:05.092162+0000","last_active":"2024-09-12T02:07:05.092162+0000","last_peered":"2024-09-12T02:07:05.092162+0000","last_clean":"2024-09-12T02:07:05.092162+0000","last_became_active":"2024-09-12T00:10:01.256253+0000","last_became_peered":"2024-09-12T00:10:01.256253+0000","last_unstale":"2024-09-12T02:07:05.092162+0000","last_undegraded":"2024-09-12T02:07:05.092162+0000","last_fullsized":"2024-09-12T02:07:05.092162+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'517","last_scrub_stamp":"2024-09-12T02:07:05.091915+0000","last_deep_scrub":"266'517","last_deep_scrub_stamp":"2024-09-12T02:07:05.091915+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.091915+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:58.529971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2461,"num_read_kb":2278,"num_write":611,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"266'342","reported_seq":1005,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.574347+0000","last_change":"2024-09-12T02:07:05.574196+0000","last_active":"2024-09-12T02:07:05.574347+0000","last_peered":"2024-09-12T02:07:05.574347+0000","last_clean":"2024-09-12T02:07:05.574347+0000","last_became_active":"2024-09-12T00:09:59.297821+0000","last_became_peered":"2024-09-12T00:09:59.297821+0000","last_unstale":"2024-09-12T02:07:05.574347+0000","last_undegraded":"2024-09-12T02:07:05.574347+0000","last_fullsized":"2024-09-12T02:07:05.574347+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'342","last_scrub_stamp":"2024-09-12T02:07:05.573973+0000","last_deep_scrub":"266'342","last_deep_scrub_stamp":"2024-09-12T02:07:05.573973+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.573973+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:17.466383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":489,"num_read_kb":14780,"num_write":963,"num_write_kb":35747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"266'380","reported_seq":1853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.056835+0000","last_change":"2024-09-12T02:07:12.056835+0000","last_active":"2024-09-12T02:07:12.056835+0000","last_peered":"2024-09-12T02:07:12.056835+0000","last_clean":"2024-09-12T02:07:12.056835+0000","last_became_active":"2024-09-12T00:10:01.250663+0000","last_became_peered":"2024-09-12T00:10:01.250663+0000","last_unstale":"2024-09-12T02:07:12.056835+0000","last_undegraded":"2024-09-12T02:07:12.056835+0000","last_fullsized":"2024-09-12T02:07:12.056835+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T02:07:12.056652+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T02:07:12.056652+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.056652+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.942975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2078,"num_read_kb":1972,"num_write":422,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"266'353","reported_seq":1132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.810880+0000","last_change":"2024-09-12T02:07:03.810726+0000","last_active":"2024-09-12T02:07:03.810880+0000","last_peered":"2024-09-12T02:07:03.810880+0000","last_clean":"2024-09-12T02:07:03.810880+0000","last_became_active":"2024-09-12T00:09:59.311825+0000","last_became_peered":"2024-09-12T00:09:59.311825+0000","last_unstale":"2024-09-12T02:07:03.810880+0000","last_undegraded":"2024-09-12T02:07:03.810880+0000","last_fullsized":"2024-09-12T02:07:03.810880+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'353","last_scrub_stamp":"2024-09-12T02:07:03.810476+0000","last_deep_scrub":"266'353","last_deep_scrub_stamp":"2024-09-12T02:07:03.810476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.810476+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.639688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399264,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":842,"num_read_kb":88204,"num_write":1135,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"266'422","reported_seq":1892,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.571407+0000","last_change":"2024-09-12T02:07:14.571407+0000","last_active":"2024-09-12T02:07:14.571407+0000","last_peered":"2024-09-12T02:07:14.571407+0000","last_clean":"2024-09-12T02:07:14.571407+0000","last_became_active":"2024-09-12T00:10:01.274405+0000","last_became_peered":"2024-09-12T00:10:01.274405+0000","last_unstale":"2024-09-12T02:07:14.571407+0000","last_undegraded":"2024-09-12T02:07:14.571407+0000","last_fullsized":"2024-09-12T02:07:14.571407+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'422","last_scrub_stamp":"2024-09-12T02:07:14.571149+0000","last_deep_scrub":"266'422","last_deep_scrub_stamp":"2024-09-12T02:07:14.571149+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.571149+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:55.197355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2137,"num_read_kb":2003,"num_write":477,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"266'378","reported_seq":1074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.950434+0000","last_change":"2024-09-12T02:07:12.950263+0000","last_active":"2024-09-12T02:07:12.950434+0000","last_peered":"2024-09-12T02:07:12.950434+0000","last_clean":"2024-09-12T02:07:12.950434+0000","last_became_active":"2024-09-12T00:09:59.248750+0000","last_became_peered":"2024-09-12T00:09:59.248750+0000","last_unstale":"2024-09-12T02:07:12.950434+0000","last_undegraded":"2024-09-12T02:07:12.950434+0000","last_fullsized":"2024-09-12T02:07:12.950434+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'378","last_scrub_stamp":"2024-09-12T02:07:12.949940+0000","last_deep_scrub":"266'378","last_deep_scrub_stamp":"2024-09-12T02:07:12.949940+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.949940+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:49.263377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4478894,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":698,"num_read_kb":26164,"num_write":1140,"num_write_kb":31035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"266'820","reported_seq":2453,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.639619+0000","last_change":"2024-09-12T02:06:57.639619+0000","last_active":"2024-09-12T02:06:57.639619+0000","last_peered":"2024-09-12T02:06:57.639619+0000","last_clean":"2024-09-12T02:06:57.639619+0000","last_became_active":"2024-09-12T00:10:01.249016+0000","last_became_peered":"2024-09-12T00:10:01.249016+0000","last_unstale":"2024-09-12T02:06:57.639619+0000","last_undegraded":"2024-09-12T02:06:57.639619+0000","last_fullsized":"2024-09-12T02:06:57.639619+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'820","last_scrub_stamp":"2024-09-12T02:06:57.639429+0000","last_deep_scrub":"266'820","last_deep_scrub_stamp":"2024-09-12T02:06:57.639429+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.639429+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:20.206412+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3841,"num_read_kb":3467,"num_write":1075,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"266'628","reported_seq":2390,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.056138+0000","last_change":"2024-09-12T02:07:10.056138+0000","last_active":"2024-09-12T02:07:10.056138+0000","last_peered":"2024-09-12T02:07:10.056138+0000","last_clean":"2024-09-12T02:07:10.056138+0000","last_became_active":"2024-09-12T00:10:01.252790+0000","last_became_peered":"2024-09-12T00:10:01.252790+0000","last_unstale":"2024-09-12T02:07:10.056138+0000","last_undegraded":"2024-09-12T02:07:10.056138+0000","last_fullsized":"2024-09-12T02:07:10.056138+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'628","last_scrub_stamp":"2024-09-12T02:07:10.055950+0000","last_deep_scrub":"266'628","last_deep_scrub_stamp":"2024-09-12T02:07:10.055950+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.055950+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:28.740887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2892,"num_write":772,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"266'411","reported_seq":1116,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.820593+0000","last_change":"2024-09-12T02:07:05.820593+0000","last_active":"2024-09-12T02:07:05.820593+0000","last_peered":"2024-09-12T02:07:05.820593+0000","last_clean":"2024-09-12T02:07:05.820593+0000","last_became_active":"2024-09-12T00:09:59.285279+0000","last_became_peered":"2024-09-12T00:09:59.285279+0000","last_unstale":"2024-09-12T02:07:05.820593+0000","last_undegraded":"2024-09-12T02:07:05.820593+0000","last_fullsized":"2024-09-12T02:07:05.820593+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'411","last_scrub_stamp":"2024-09-12T02:07:05.820309+0000","last_deep_scrub":"266'411","last_deep_scrub_stamp":"2024-09-12T02:07:05.820309+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.820309+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:56.300299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569417,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":647,"num_read_kb":33158,"num_write":1312,"num_write_kb":40723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"266'387","reported_seq":2068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.862281+0000","last_change":"2024-09-12T02:07:09.862281+0000","last_active":"2024-09-12T02:07:09.862281+0000","last_peered":"2024-09-12T02:07:09.862281+0000","last_clean":"2024-09-12T02:07:09.862281+0000","last_became_active":"2024-09-12T00:10:01.269235+0000","last_became_peered":"2024-09-12T00:10:01.269235+0000","last_unstale":"2024-09-12T02:07:09.862281+0000","last_undegraded":"2024-09-12T02:07:09.862281+0000","last_fullsized":"2024-09-12T02:07:09.862281+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'387","last_scrub_stamp":"2024-09-12T02:07:09.862094+0000","last_deep_scrub":"266'387","last_deep_scrub_stamp":"2024-09-12T02:07:09.862094+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.862094+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:04.979312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2516,"num_read_kb":2424,"num_write":449,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2781,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"266'351","reported_seq":1000,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.080909+0000","last_change":"2024-09-12T02:07:07.080909+0000","last_active":"2024-09-12T02:07:07.080909+0000","last_peered":"2024-09-12T02:07:07.080909+0000","last_clean":"2024-09-12T02:07:07.080909+0000","last_became_active":"2024-09-12T00:09:59.298975+0000","last_became_peered":"2024-09-12T00:09:59.298975+0000","last_unstale":"2024-09-12T02:07:07.080909+0000","last_undegraded":"2024-09-12T02:07:07.080909+0000","last_fullsized":"2024-09-12T02:07:07.080909+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'351","last_scrub_stamp":"2024-09-12T02:07:07.080684+0000","last_deep_scrub":"266'351","last_deep_scrub_stamp":"2024-09-12T02:07:07.080684+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.080684+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:09.511021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":20543,"num_write":987,"num_write_kb":37808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"266'1149","reported_seq":2691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.622569+0000","last_change":"2024-09-12T02:07:10.622569+0000","last_active":"2024-09-12T02:07:10.622569+0000","last_peered":"2024-09-12T02:07:10.622569+0000","last_clean":"2024-09-12T02:07:10.622569+0000","last_became_active":"2024-09-12T00:10:01.270566+0000","last_became_peered":"2024-09-12T00:10:01.270566+0000","last_unstale":"2024-09-12T02:07:10.622569+0000","last_undegraded":"2024-09-12T02:07:10.622569+0000","last_fullsized":"2024-09-12T02:07:10.622569+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1149","last_scrub_stamp":"2024-09-12T02:07:10.622387+0000","last_deep_scrub":"266'1149","last_deep_scrub_stamp":"2024-09-12T02:07:10.622387+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.622387+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":1100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:22.452419+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5146,"num_read_kb":4532,"num_write":1573,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"266'328","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.640773+0000","last_change":"2024-09-12T02:07:00.640773+0000","last_active":"2024-09-12T02:07:00.640773+0000","last_peered":"2024-09-12T02:07:00.640773+0000","last_clean":"2024-09-12T02:07:00.640773+0000","last_became_active":"2024-09-12T00:10:31.475207+0000","last_became_peered":"2024-09-12T00:10:31.475207+0000","last_unstale":"2024-09-12T02:07:00.640773+0000","last_undegraded":"2024-09-12T02:07:00.640773+0000","last_fullsized":"2024-09-12T02:07:00.640773+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'328","last_scrub_stamp":"2024-09-12T02:07:00.640512+0000","last_deep_scrub":"266'328","last_deep_scrub_stamp":"2024-09-12T02:07:00.640512+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.640512+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:25.664541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35516,"num_write":1077,"num_write_kb":27332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"266'425","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.618646+0000","last_change":"2024-09-12T02:07:02.618646+0000","last_active":"2024-09-12T02:07:02.618646+0000","last_peered":"2024-09-12T02:07:02.618646+0000","last_clean":"2024-09-12T02:07:02.618646+0000","last_became_active":"2024-09-12T00:10:01.249060+0000","last_became_peered":"2024-09-12T00:10:01.249060+0000","last_unstale":"2024-09-12T02:07:02.618646+0000","last_undegraded":"2024-09-12T02:07:02.618646+0000","last_fullsized":"2024-09-12T02:07:02.618646+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'425","last_scrub_stamp":"2024-09-12T02:07:02.618429+0000","last_deep_scrub":"266'425","last_deep_scrub_stamp":"2024-09-12T02:07:02.618429+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.618429+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:02.382238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2301,"num_write":498,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"266'349","reported_seq":1022,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.046073+0000","last_change":"2024-09-12T02:06:58.046073+0000","last_active":"2024-09-12T02:06:58.046073+0000","last_peered":"2024-09-12T02:06:58.046073+0000","last_clean":"2024-09-12T02:06:58.046073+0000","last_became_active":"2024-09-12T00:09:59.308979+0000","last_became_peered":"2024-09-12T00:09:59.308979+0000","last_unstale":"2024-09-12T02:06:58.046073+0000","last_undegraded":"2024-09-12T02:06:58.046073+0000","last_fullsized":"2024-09-12T02:06:58.046073+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T02:06:58.045671+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T02:06:58.045671+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.045671+0000","objects_scrubbed":11,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:32.257450+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9921950,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":33875,"num_write":1037,"num_write_kb":29129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"266'441","reported_seq":1933,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.611005+0000","last_change":"2024-09-12T02:06:59.611005+0000","last_active":"2024-09-12T02:06:59.611005+0000","last_peered":"2024-09-12T02:06:59.611005+0000","last_clean":"2024-09-12T02:06:59.611005+0000","last_became_active":"2024-09-12T00:10:01.238251+0000","last_became_peered":"2024-09-12T00:10:01.238251+0000","last_unstale":"2024-09-12T02:06:59.611005+0000","last_undegraded":"2024-09-12T02:06:59.611005+0000","last_fullsized":"2024-09-12T02:06:59.611005+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'441","last_scrub_stamp":"2024-09-12T02:06:59.610833+0000","last_deep_scrub":"266'441","last_deep_scrub_stamp":"2024-09-12T02:06:59.610833+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.610833+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:13.031338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2194,"num_read_kb":2058,"num_write":515,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"266'313","reported_seq":968,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.896306+0000","last_change":"2024-09-12T02:07:00.896306+0000","last_active":"2024-09-12T02:07:00.896306+0000","last_peered":"2024-09-12T02:07:00.896306+0000","last_clean":"2024-09-12T02:07:00.896306+0000","last_became_active":"2024-09-12T00:09:59.262666+0000","last_became_peered":"2024-09-12T00:09:59.262666+0000","last_unstale":"2024-09-12T02:07:00.896306+0000","last_undegraded":"2024-09-12T02:07:00.896306+0000","last_fullsized":"2024-09-12T02:07:00.896306+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'313","last_scrub_stamp":"2024-09-12T02:07:00.896081+0000","last_deep_scrub":"266'313","last_deep_scrub_stamp":"2024-09-12T02:07:00.896081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.896081+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:49.352670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433326,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":422,"num_read_kb":23030,"num_write":985,"num_write_kb":39870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"266'663","reported_seq":2190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.095132+0000","last_change":"2024-09-12T02:07:11.095132+0000","last_active":"2024-09-12T02:07:11.095132+0000","last_peered":"2024-09-12T02:07:11.095132+0000","last_clean":"2024-09-12T02:07:11.095132+0000","last_became_active":"2024-09-12T00:10:01.257792+0000","last_became_peered":"2024-09-12T00:10:01.257792+0000","last_unstale":"2024-09-12T02:07:11.095132+0000","last_undegraded":"2024-09-12T02:07:11.095132+0000","last_fullsized":"2024-09-12T02:07:11.095132+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'663","last_scrub_stamp":"2024-09-12T02:07:11.094919+0000","last_deep_scrub":"266'663","last_deep_scrub_stamp":"2024-09-12T02:07:11.094919+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.094919+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":600,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:28.585837+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3304,"num_read_kb":2964,"num_write":919,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1227,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"266'329","reported_seq":995,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.452573+0000","last_change":"2024-09-12T02:07:01.452411+0000","last_active":"2024-09-12T02:07:01.452573+0000","last_peered":"2024-09-12T02:07:01.452573+0000","last_clean":"2024-09-12T02:07:01.452573+0000","last_became_active":"2024-09-12T00:09:59.293921+0000","last_became_peered":"2024-09-12T00:09:59.293921+0000","last_unstale":"2024-09-12T02:07:01.452573+0000","last_undegraded":"2024-09-12T02:07:01.452573+0000","last_fullsized":"2024-09-12T02:07:01.452573+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'329","last_scrub_stamp":"2024-09-12T02:07:01.452129+0000","last_deep_scrub":"266'329","last_deep_scrub_stamp":"2024-09-12T02:07:01.452129+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.452129+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:18.604057+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262199,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":482,"num_read_kb":35722,"num_write":1084,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"266'144","reported_seq":688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.111301+0000","last_change":"2024-09-12T02:07:28.111301+0000","last_active":"2024-09-12T02:07:28.111301+0000","last_peered":"2024-09-12T02:07:28.111301+0000","last_clean":"2024-09-12T02:07:28.111301+0000","last_became_active":"2024-09-12T00:10:09.356144+0000","last_became_peered":"2024-09-12T00:10:09.356144+0000","last_unstale":"2024-09-12T02:07:28.111301+0000","last_undegraded":"2024-09-12T02:07:28.111301+0000","last_fullsized":"2024-09-12T02:07:28.111301+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'144","last_scrub_stamp":"2024-09-12T02:07:28.111105+0000","last_deep_scrub":"266'144","last_deep_scrub_stamp":"2024-09-12T02:07:28.111105+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.111105+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.381630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":339,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"266'787","reported_seq":2344,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.925510+0000","last_change":"2024-09-12T02:07:05.925510+0000","last_active":"2024-09-12T02:07:05.925510+0000","last_peered":"2024-09-12T02:07:05.925510+0000","last_clean":"2024-09-12T02:07:05.925510+0000","last_became_active":"2024-09-12T00:10:01.259053+0000","last_became_peered":"2024-09-12T00:10:01.259053+0000","last_unstale":"2024-09-12T02:07:05.925510+0000","last_undegraded":"2024-09-12T02:07:05.925510+0000","last_fullsized":"2024-09-12T02:07:05.925510+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'787","last_scrub_stamp":"2024-09-12T02:07:05.925325+0000","last_deep_scrub":"266'787","last_deep_scrub_stamp":"2024-09-12T02:07:05.925325+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.925325+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:04.831866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3705,"num_read_kb":3341,"num_write":1024,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"266'390","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.742097+0000","last_change":"2024-09-12T02:07:00.742097+0000","last_active":"2024-09-12T02:07:00.742097+0000","last_peered":"2024-09-12T02:07:00.742097+0000","last_clean":"2024-09-12T02:07:00.742097+0000","last_became_active":"2024-09-12T00:09:59.310643+0000","last_became_peered":"2024-09-12T00:09:59.310643+0000","last_unstale":"2024-09-12T02:07:00.742097+0000","last_undegraded":"2024-09-12T02:07:00.742097+0000","last_fullsized":"2024-09-12T02:07:00.742097+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:07:00.741744+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:07:00.741744+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.741744+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:30.067710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136934,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":31265,"num_write":1302,"num_write_kb":60174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.567418+0000","last_change":"2024-09-12T02:07:16.567418+0000","last_active":"2024-09-12T02:07:16.567418+0000","last_peered":"2024-09-12T02:07:16.567418+0000","last_clean":"2024-09-12T02:07:16.567418+0000","last_became_active":"2024-09-12T00:10:03.271233+0000","last_became_peered":"2024-09-12T00:10:03.271233+0000","last_unstale":"2024-09-12T02:07:16.567418+0000","last_undegraded":"2024-09-12T02:07:16.567418+0000","last_fullsized":"2024-09-12T02:07:16.567418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:16.567230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:16.567230+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.567230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:20.643320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"266'381","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.545873+0000","last_change":"2024-09-12T02:07:19.545873+0000","last_active":"2024-09-12T02:07:19.545873+0000","last_peered":"2024-09-12T02:07:19.545873+0000","last_clean":"2024-09-12T02:07:19.545873+0000","last_became_active":"2024-09-12T00:10:05.285417+0000","last_became_peered":"2024-09-12T00:10:05.285417+0000","last_unstale":"2024-09-12T02:07:19.545873+0000","last_undegraded":"2024-09-12T02:07:19.545873+0000","last_fullsized":"2024-09-12T02:07:19.545873+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:07:19.545684+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:07:19.545684+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.545684+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:24.365440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47464,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1152,"num_write":460,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.871914+0000","last_change":"2024-09-12T02:07:23.871914+0000","last_active":"2024-09-12T02:07:23.871914+0000","last_peered":"2024-09-12T02:07:23.871914+0000","last_clean":"2024-09-12T02:07:23.871914+0000","last_became_active":"2024-09-12T00:10:07.318114+0000","last_became_peered":"2024-09-12T00:10:07.318114+0000","last_unstale":"2024-09-12T02:07:23.871914+0000","last_undegraded":"2024-09-12T02:07:23.871914+0000","last_fullsized":"2024-09-12T02:07:23.871914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:23.871689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:23.871689+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.871689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:41.246339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"266'2467","reported_seq":4407,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.762732+0000","last_change":"2024-09-12T02:07:35.762732+0000","last_active":"2024-09-12T02:07:35.762732+0000","last_peered":"2024-09-12T02:07:35.762732+0000","last_clean":"2024-09-12T02:07:35.762732+0000","last_became_active":"2024-09-12T00:10:09.370949+0000","last_became_peered":"2024-09-12T00:10:09.370949+0000","last_unstale":"2024-09-12T02:07:35.762732+0000","last_undegraded":"2024-09-12T02:07:35.762732+0000","last_fullsized":"2024-09-12T02:07:35.762732+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2467","last_scrub_stamp":"2024-09-12T02:07:35.762430+0000","last_deep_scrub":"266'2467","last_deep_scrub_stamp":"2024-09-12T02:07:35.762430+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.762430+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":2400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:11.708816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6210,"num_read_kb":6193,"num_write":4929,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"266'416","reported_seq":1962,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.578930+0000","last_change":"2024-09-12T02:07:09.578930+0000","last_active":"2024-09-12T02:07:09.578930+0000","last_peered":"2024-09-12T02:07:09.578930+0000","last_clean":"2024-09-12T02:07:09.578930+0000","last_became_active":"2024-09-12T00:10:01.274710+0000","last_became_peered":"2024-09-12T00:10:01.274710+0000","last_unstale":"2024-09-12T02:07:09.578930+0000","last_undegraded":"2024-09-12T02:07:09.578930+0000","last_fullsized":"2024-09-12T02:07:09.578930+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'416","last_scrub_stamp":"2024-09-12T02:07:09.578701+0000","last_deep_scrub":"266'416","last_deep_scrub_stamp":"2024-09-12T02:07:09.578701+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.578701+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:42.665393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2273,"num_read_kb":2145,"num_write":493,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"266'407","reported_seq":1136,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.555841+0000","last_change":"2024-09-12T02:06:57.555841+0000","last_active":"2024-09-12T02:06:57.555841+0000","last_peered":"2024-09-12T02:06:57.555841+0000","last_clean":"2024-09-12T02:06:57.555841+0000","last_became_active":"2024-09-12T00:09:59.282228+0000","last_became_peered":"2024-09-12T00:09:59.282228+0000","last_unstale":"2024-09-12T02:06:57.555841+0000","last_undegraded":"2024-09-12T02:06:57.555841+0000","last_fullsized":"2024-09-12T02:06:57.555841+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'407","last_scrub_stamp":"2024-09-12T02:06:57.555604+0000","last_deep_scrub":"266'407","last_deep_scrub_stamp":"2024-09-12T02:06:57.555604+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.555604+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:18.445365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":89139,"num_write":1493,"num_write_kb":44201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.972701+0000","last_change":"2024-09-12T02:07:13.972701+0000","last_active":"2024-09-12T02:07:13.972701+0000","last_peered":"2024-09-12T02:07:13.972701+0000","last_clean":"2024-09-12T02:07:13.972701+0000","last_became_active":"2024-09-12T00:10:03.254006+0000","last_became_peered":"2024-09-12T00:10:03.254006+0000","last_unstale":"2024-09-12T02:07:13.972701+0000","last_undegraded":"2024-09-12T02:07:13.972701+0000","last_fullsized":"2024-09-12T02:07:13.972701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.972525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.972525+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.972525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:24.718065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"266'142","reported_seq":726,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.052180+0000","last_change":"2024-09-12T02:07:20.052180+0000","last_active":"2024-09-12T02:07:20.052180+0000","last_peered":"2024-09-12T02:07:20.052180+0000","last_clean":"2024-09-12T02:07:20.052180+0000","last_became_active":"2024-09-12T00:10:05.279990+0000","last_became_peered":"2024-09-12T00:10:05.279990+0000","last_unstale":"2024-09-12T02:07:20.052180+0000","last_undegraded":"2024-09-12T02:07:20.052180+0000","last_fullsized":"2024-09-12T02:07:20.052180+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'142","last_scrub_stamp":"2024-09-12T02:07:20.051980+0000","last_deep_scrub":"266'142","last_deep_scrub_stamp":"2024-09-12T02:07:20.051980+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.051980+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:51.476200+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.082003+0000","last_change":"2024-09-12T02:07:24.082003+0000","last_active":"2024-09-12T02:07:24.082003+0000","last_peered":"2024-09-12T02:07:24.082003+0000","last_clean":"2024-09-12T02:07:24.082003+0000","last_became_active":"2024-09-12T00:10:07.309927+0000","last_became_peered":"2024-09-12T00:10:07.309927+0000","last_unstale":"2024-09-12T02:07:24.082003+0000","last_undegraded":"2024-09-12T02:07:24.082003+0000","last_fullsized":"2024-09-12T02:07:24.082003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.081817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.081817+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.081817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:55.034002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"266'107","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.538794+0000","last_change":"2024-09-12T02:07:27.538642+0000","last_active":"2024-09-12T02:07:27.538794+0000","last_peered":"2024-09-12T02:07:27.538794+0000","last_clean":"2024-09-12T02:07:27.538794+0000","last_became_active":"2024-09-12T00:10:09.364927+0000","last_became_peered":"2024-09-12T00:10:09.364927+0000","last_unstale":"2024-09-12T02:07:27.538794+0000","last_undegraded":"2024-09-12T02:07:27.538794+0000","last_fullsized":"2024-09-12T02:07:27.538794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'107","last_scrub_stamp":"2024-09-12T02:07:27.538445+0000","last_deep_scrub":"266'107","last_deep_scrub_stamp":"2024-09-12T02:07:27.538445+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.538445+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.515707+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":243,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"266'382","reported_seq":1920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.543265+0000","last_change":"2024-09-12T02:07:05.543265+0000","last_active":"2024-09-12T02:07:05.543265+0000","last_peered":"2024-09-12T02:07:05.543265+0000","last_clean":"2024-09-12T02:07:05.543265+0000","last_became_active":"2024-09-12T00:10:01.246633+0000","last_became_peered":"2024-09-12T00:10:01.246633+0000","last_unstale":"2024-09-12T02:07:05.543265+0000","last_undegraded":"2024-09-12T02:07:05.543265+0000","last_fullsized":"2024-09-12T02:07:05.543265+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'382","last_scrub_stamp":"2024-09-12T02:07:05.543080+0000","last_deep_scrub":"266'382","last_deep_scrub_stamp":"2024-09-12T02:07:05.543080+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.543080+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:54.983427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2031,"num_read_kb":1954,"num_write":422,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"266'322","reported_seq":980,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.653422+0000","last_change":"2024-09-12T02:06:55.653280+0000","last_active":"2024-09-12T02:06:55.653422+0000","last_peered":"2024-09-12T02:06:55.653422+0000","last_clean":"2024-09-12T02:06:55.653422+0000","last_became_active":"2024-09-12T00:10:31.472231+0000","last_became_peered":"2024-09-12T00:10:31.472231+0000","last_unstale":"2024-09-12T02:06:55.653422+0000","last_undegraded":"2024-09-12T02:06:55.653422+0000","last_fullsized":"2024-09-12T02:06:55.653422+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'322","last_scrub_stamp":"2024-09-12T02:06:55.653042+0000","last_deep_scrub":"266'322","last_deep_scrub_stamp":"2024-09-12T02:06:55.653042+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.653042+0000","objects_scrubbed":10,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:59.726925+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536061,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":478,"num_read_kb":34994,"num_write":999,"num_write_kb":46604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"266'4","reported_seq":1015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.999979+0000","last_change":"2024-09-12T02:07:18.999979+0000","last_active":"2024-09-12T02:07:18.999979+0000","last_peered":"2024-09-12T02:07:18.999979+0000","last_clean":"2024-09-12T02:07:18.999979+0000","last_became_active":"2024-09-12T00:10:03.265816+0000","last_became_peered":"2024-09-12T00:10:03.265816+0000","last_unstale":"2024-09-12T02:07:18.999979+0000","last_undegraded":"2024-09-12T02:07:18.999979+0000","last_fullsized":"2024-09-12T02:07:18.999979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:18.999783+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:18.999783+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.999783+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:39.516415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"266'196","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.644390+0000","last_change":"2024-09-12T02:07:12.644244+0000","last_active":"2024-09-12T02:07:12.644390+0000","last_peered":"2024-09-12T02:07:12.644390+0000","last_clean":"2024-09-12T02:07:12.644390+0000","last_became_active":"2024-09-12T00:10:05.275499+0000","last_became_peered":"2024-09-12T00:10:05.275499+0000","last_unstale":"2024-09-12T02:07:12.644390+0000","last_undegraded":"2024-09-12T02:07:12.644390+0000","last_fullsized":"2024-09-12T02:07:12.644390+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T02:07:12.643996+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T02:07:12.643996+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.643996+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:07.730489+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":245,"num_read_kb":237,"num_write":164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"266'775","reported_seq":3039,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.840916+0000","last_change":"2024-09-12T02:07:22.840916+0000","last_active":"2024-09-12T02:07:22.840916+0000","last_peered":"2024-09-12T02:07:22.840916+0000","last_clean":"2024-09-12T02:07:22.840916+0000","last_became_active":"2024-09-12T00:10:07.318302+0000","last_became_peered":"2024-09-12T00:10:07.318302+0000","last_unstale":"2024-09-12T02:07:22.840916+0000","last_undegraded":"2024-09-12T02:07:22.840916+0000","last_fullsized":"2024-09-12T02:07:22.840916+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'775","last_scrub_stamp":"2024-09-12T02:07:22.840736+0000","last_deep_scrub":"266'775","last_deep_scrub_stamp":"2024-09-12T02:07:22.840736+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.840736+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:58.453710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"266'207","reported_seq":1070,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.115514+0000","last_change":"2024-09-12T02:07:30.115383+0000","last_active":"2024-09-12T02:07:30.115514+0000","last_peered":"2024-09-12T02:07:30.115514+0000","last_clean":"2024-09-12T02:07:30.115514+0000","last_became_active":"2024-09-12T00:10:09.433045+0000","last_became_peered":"2024-09-12T00:10:09.433045+0000","last_unstale":"2024-09-12T02:07:30.115514+0000","last_undegraded":"2024-09-12T02:07:30.115514+0000","last_fullsized":"2024-09-12T02:07:30.115514+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'207","last_scrub_stamp":"2024-09-12T02:07:30.115201+0000","last_deep_scrub":"266'207","last_deep_scrub_stamp":"2024-09-12T02:07:30.115201+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.115201+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:51.345596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":620,"num_write":453,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"266'392","reported_seq":1970,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.916035+0000","last_change":"2024-09-12T02:07:03.916035+0000","last_active":"2024-09-12T02:07:03.916035+0000","last_peered":"2024-09-12T02:07:03.916035+0000","last_clean":"2024-09-12T02:07:03.916035+0000","last_became_active":"2024-09-12T00:10:01.261217+0000","last_became_peered":"2024-09-12T00:10:01.261217+0000","last_unstale":"2024-09-12T02:07:03.916035+0000","last_undegraded":"2024-09-12T02:07:03.916035+0000","last_fullsized":"2024-09-12T02:07:03.916035+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T02:07:03.915856+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T02:07:03.915856+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.915856+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:20.348940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2298,"num_read_kb":2187,"num_write":432,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2545,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"266'343","reported_seq":1006,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.195668+0000","last_change":"2024-09-12T02:06:56.195668+0000","last_active":"2024-09-12T02:06:56.195668+0000","last_peered":"2024-09-12T02:06:56.195668+0000","last_clean":"2024-09-12T02:06:56.195668+0000","last_became_active":"2024-09-12T00:09:59.281330+0000","last_became_peered":"2024-09-12T00:09:59.281330+0000","last_unstale":"2024-09-12T02:06:56.195668+0000","last_undegraded":"2024-09-12T02:06:56.195668+0000","last_fullsized":"2024-09-12T02:06:56.195668+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'343","last_scrub_stamp":"2024-09-12T02:06:56.195432+0000","last_deep_scrub":"266'343","last_deep_scrub_stamp":"2024-09-12T02:06:56.195432+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.195432+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:40.190762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":6619,"num_write":1099,"num_write_kb":41386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.561158+0000","last_change":"2024-09-12T02:07:17.561158+0000","last_active":"2024-09-12T02:07:17.561158+0000","last_peered":"2024-09-12T02:07:17.561158+0000","last_clean":"2024-09-12T02:07:17.561158+0000","last_became_active":"2024-09-12T00:10:03.271292+0000","last_became_peered":"2024-09-12T00:10:03.271292+0000","last_unstale":"2024-09-12T02:07:17.561158+0000","last_undegraded":"2024-09-12T02:07:17.561158+0000","last_fullsized":"2024-09-12T02:07:17.561158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:17.560974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:17.560974+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.560974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:50.417667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"266'325","reported_seq":951,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.857988+0000","last_change":"2024-09-12T02:07:19.857988+0000","last_active":"2024-09-12T02:07:19.857988+0000","last_peered":"2024-09-12T02:07:19.857988+0000","last_clean":"2024-09-12T02:07:19.857988+0000","last_became_active":"2024-09-12T00:10:05.361419+0000","last_became_peered":"2024-09-12T00:10:05.361419+0000","last_unstale":"2024-09-12T02:07:19.857988+0000","last_undegraded":"2024-09-12T02:07:19.857988+0000","last_fullsized":"2024-09-12T02:07:19.857988+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'325","last_scrub_stamp":"2024-09-12T02:07:19.857782+0000","last_deep_scrub":"266'325","last_deep_scrub_stamp":"2024-09-12T02:07:19.857782+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.857782+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:54.271134+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":523,"num_read_kb":1153,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"266'827","reported_seq":3131,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.989364+0000","last_change":"2024-09-12T02:07:26.989364+0000","last_active":"2024-09-12T02:07:26.989364+0000","last_peered":"2024-09-12T02:07:26.989364+0000","last_clean":"2024-09-12T02:07:26.989364+0000","last_became_active":"2024-09-12T00:10:07.335181+0000","last_became_peered":"2024-09-12T00:10:07.335181+0000","last_unstale":"2024-09-12T02:07:26.989364+0000","last_undegraded":"2024-09-12T02:07:26.989364+0000","last_fullsized":"2024-09-12T02:07:26.989364+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'827","last_scrub_stamp":"2024-09-12T02:07:26.989178+0000","last_deep_scrub":"266'827","last_deep_scrub_stamp":"2024-09-12T02:07:26.989178+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.989178+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:22.733341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"266'423","reported_seq":1883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.631654+0000","last_change":"2024-09-12T02:07:08.631654+0000","last_active":"2024-09-12T02:07:08.631654+0000","last_peered":"2024-09-12T02:07:08.631654+0000","last_clean":"2024-09-12T02:07:08.631654+0000","last_became_active":"2024-09-12T00:10:01.266204+0000","last_became_peered":"2024-09-12T00:10:01.266204+0000","last_unstale":"2024-09-12T02:07:08.631654+0000","last_undegraded":"2024-09-12T02:07:08.631654+0000","last_fullsized":"2024-09-12T02:07:08.631654+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T02:07:08.631455+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T02:07:08.631455+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.631455+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:50.621125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2063,"num_read_kb":1939,"num_write":461,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"266'375","reported_seq":1040,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.749038+0000","last_change":"2024-09-12T02:06:59.748793+0000","last_active":"2024-09-12T02:06:59.749038+0000","last_peered":"2024-09-12T02:06:59.749038+0000","last_clean":"2024-09-12T02:06:59.749038+0000","last_became_active":"2024-09-12T00:09:59.307481+0000","last_became_peered":"2024-09-12T00:09:59.307481+0000","last_unstale":"2024-09-12T02:06:59.749038+0000","last_undegraded":"2024-09-12T02:06:59.749038+0000","last_fullsized":"2024-09-12T02:06:59.749038+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'375","last_scrub_stamp":"2024-09-12T02:06:59.748525+0000","last_deep_scrub":"266'375","last_deep_scrub_stamp":"2024-09-12T02:06:59.748525+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.748525+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:19.336128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":11316,"num_write":1196,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.894687+0000","last_change":"2024-09-12T02:07:12.894687+0000","last_active":"2024-09-12T02:07:12.894687+0000","last_peered":"2024-09-12T02:07:12.894687+0000","last_clean":"2024-09-12T02:07:12.894687+0000","last_became_active":"2024-09-12T00:10:03.258601+0000","last_became_peered":"2024-09-12T00:10:03.258601+0000","last_unstale":"2024-09-12T02:07:12.894687+0000","last_undegraded":"2024-09-12T02:07:12.894687+0000","last_fullsized":"2024-09-12T02:07:12.894687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.894507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.894507+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.894507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:09.932960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"266'487","reported_seq":1198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.603541+0000","last_change":"2024-09-12T02:07:21.603383+0000","last_active":"2024-09-12T02:07:21.603541+0000","last_peered":"2024-09-12T02:07:21.603541+0000","last_clean":"2024-09-12T02:07:21.603541+0000","last_became_active":"2024-09-12T00:10:05.361273+0000","last_became_peered":"2024-09-12T00:10:05.361273+0000","last_unstale":"2024-09-12T02:07:21.603541+0000","last_undegraded":"2024-09-12T02:07:21.603541+0000","last_fullsized":"2024-09-12T02:07:21.603541+0000","mapping_epoch":31,"log_start":"266'400","ondisk_log_start":"266'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'487","last_scrub_stamp":"2024-09-12T02:07:21.603162+0000","last_deep_scrub":"266'487","last_deep_scrub_stamp":"2024-09-12T02:07:21.603162+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.603162+0000","objects_scrubbed":10,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:05.657227+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46961,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":773,"num_read_kb":1424,"num_write":592,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.370591+0000","last_change":"2024-09-12T02:07:09.370591+0000","last_active":"2024-09-12T02:07:09.370591+0000","last_peered":"2024-09-12T02:07:09.370591+0000","last_clean":"2024-09-12T02:07:09.370591+0000","last_became_active":"2024-09-12T00:10:07.316670+0000","last_became_peered":"2024-09-12T00:10:07.316670+0000","last_unstale":"2024-09-12T02:07:09.370591+0000","last_undegraded":"2024-09-12T02:07:09.370591+0000","last_fullsized":"2024-09-12T02:07:09.370591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.370411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.370411+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.370411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:33.487199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"266'603","reported_seq":1453,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.649492+0000","last_change":"2024-09-12T02:07:26.649492+0000","last_active":"2024-09-12T02:07:26.649492+0000","last_peered":"2024-09-12T02:07:26.649492+0000","last_clean":"2024-09-12T02:07:26.649492+0000","last_became_active":"2024-09-12T00:10:09.368091+0000","last_became_peered":"2024-09-12T00:10:09.368091+0000","last_unstale":"2024-09-12T02:07:26.649492+0000","last_undegraded":"2024-09-12T02:07:26.649492+0000","last_fullsized":"2024-09-12T02:07:26.649492+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'603","last_scrub_stamp":"2024-09-12T02:07:26.649300+0000","last_deep_scrub":"266'603","last_deep_scrub_stamp":"2024-09-12T02:07:26.649300+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.649300+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:49.249973+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1323,"num_read_kb":1320,"num_write":1284,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"266'478","reported_seq":2146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.004942+0000","last_change":"2024-09-12T02:06:59.004792+0000","last_active":"2024-09-12T02:06:59.004942+0000","last_peered":"2024-09-12T02:06:59.004942+0000","last_clean":"2024-09-12T02:06:59.004942+0000","last_became_active":"2024-09-12T00:10:01.257821+0000","last_became_peered":"2024-09-12T00:10:01.257821+0000","last_unstale":"2024-09-12T02:06:59.004942+0000","last_undegraded":"2024-09-12T02:06:59.004942+0000","last_fullsized":"2024-09-12T02:06:59.004942+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T02:06:59.004587+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T02:06:59.004587+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.004587+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:37.594672+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2372,"num_write":561,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"266'348","reported_seq":1005,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.746366+0000","last_change":"2024-09-12T02:06:58.746131+0000","last_active":"2024-09-12T02:06:58.746366+0000","last_peered":"2024-09-12T02:06:58.746366+0000","last_clean":"2024-09-12T02:06:58.746366+0000","last_became_active":"2024-09-12T00:09:59.308185+0000","last_became_peered":"2024-09-12T00:09:59.308185+0000","last_unstale":"2024-09-12T02:06:58.746366+0000","last_undegraded":"2024-09-12T02:06:58.746366+0000","last_fullsized":"2024-09-12T02:06:58.746366+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'348","last_scrub_stamp":"2024-09-12T02:06:58.745829+0000","last_deep_scrub":"266'348","last_deep_scrub_stamp":"2024-09-12T02:06:58.745829+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.745829+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:55.531829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":32387,"num_write":1082,"num_write_kb":39559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.633879+0000","last_change":"2024-09-12T02:07:03.633737+0000","last_active":"2024-09-12T02:07:03.633879+0000","last_peered":"2024-09-12T02:07:03.633879+0000","last_clean":"2024-09-12T02:07:03.633879+0000","last_became_active":"2024-09-12T00:10:03.250360+0000","last_became_peered":"2024-09-12T00:10:03.250360+0000","last_unstale":"2024-09-12T02:07:03.633879+0000","last_undegraded":"2024-09-12T02:07:03.633879+0000","last_fullsized":"2024-09-12T02:07:03.633879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:03.633514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:03.633514+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.633514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:58.442879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"266'314","reported_seq":948,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.008699+0000","last_change":"2024-09-12T02:07:23.008699+0000","last_active":"2024-09-12T02:07:23.008699+0000","last_peered":"2024-09-12T02:07:23.008699+0000","last_clean":"2024-09-12T02:07:23.008699+0000","last_became_active":"2024-09-12T00:10:05.288035+0000","last_became_peered":"2024-09-12T00:10:05.288035+0000","last_unstale":"2024-09-12T02:07:23.008699+0000","last_undegraded":"2024-09-12T02:07:23.008699+0000","last_fullsized":"2024-09-12T02:07:23.008699+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'314","last_scrub_stamp":"2024-09-12T02:07:23.008515+0000","last_deep_scrub":"266'314","last_deep_scrub_stamp":"2024-09-12T02:07:23.008515+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.008515+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:13.204707+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51853,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1112,"num_write":408,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.956571+0000","last_change":"2024-09-12T02:07:23.956414+0000","last_active":"2024-09-12T02:07:23.956571+0000","last_peered":"2024-09-12T02:07:23.956571+0000","last_clean":"2024-09-12T02:07:23.956571+0000","last_became_active":"2024-09-12T00:10:07.340248+0000","last_became_peered":"2024-09-12T00:10:07.340248+0000","last_unstale":"2024-09-12T02:07:23.956571+0000","last_undegraded":"2024-09-12T02:07:23.956571+0000","last_fullsized":"2024-09-12T02:07:23.956571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:23.956228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:23.956228+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.956228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:23.703295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"266'117","reported_seq":653,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.126059+0000","last_change":"2024-09-12T02:07:16.125890+0000","last_active":"2024-09-12T02:07:16.126059+0000","last_peered":"2024-09-12T02:07:16.126059+0000","last_clean":"2024-09-12T02:07:16.126059+0000","last_became_active":"2024-09-12T00:10:09.359663+0000","last_became_peered":"2024-09-12T00:10:09.359663+0000","last_unstale":"2024-09-12T02:07:16.126059+0000","last_undegraded":"2024-09-12T02:07:16.126059+0000","last_fullsized":"2024-09-12T02:07:16.126059+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'117","last_scrub_stamp":"2024-09-12T02:07:16.125715+0000","last_deep_scrub":"266'117","last_deep_scrub_stamp":"2024-09-12T02:07:16.125715+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.125715+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:39.824814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":110,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"266'1044","reported_seq":2845,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.041016+0000","last_change":"2024-09-12T02:07:02.040796+0000","last_active":"2024-09-12T02:07:02.041016+0000","last_peered":"2024-09-12T02:07:02.041016+0000","last_clean":"2024-09-12T02:07:02.041016+0000","last_became_active":"2024-09-12T00:10:01.263012+0000","last_became_peered":"2024-09-12T00:10:01.263012+0000","last_unstale":"2024-09-12T02:07:02.041016+0000","last_undegraded":"2024-09-12T02:07:02.041016+0000","last_fullsized":"2024-09-12T02:07:02.041016+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1044","last_scrub_stamp":"2024-09-12T02:07:02.040566+0000","last_deep_scrub":"266'1044","last_deep_scrub_stamp":"2024-09-12T02:07:02.040566+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.040566+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":1000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:28.934270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4917,"num_read_kb":4393,"num_write":1427,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"266'301","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.605434+0000","last_change":"2024-09-12T02:07:01.605147+0000","last_active":"2024-09-12T02:07:01.605434+0000","last_peered":"2024-09-12T02:07:01.605434+0000","last_clean":"2024-09-12T02:07:01.605434+0000","last_became_active":"2024-09-12T00:10:31.477934+0000","last_became_peered":"2024-09-12T00:10:31.477934+0000","last_unstale":"2024-09-12T02:07:01.605434+0000","last_undegraded":"2024-09-12T02:07:01.605434+0000","last_fullsized":"2024-09-12T02:07:01.605434+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'301","last_scrub_stamp":"2024-09-12T02:07:01.604849+0000","last_deep_scrub":"266'301","last_deep_scrub_stamp":"2024-09-12T02:07:01.604849+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.604849+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.155816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":400,"num_read_kb":33911,"num_write":938,"num_write_kb":31727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.745903+0000","last_change":"2024-09-12T02:07:07.745903+0000","last_active":"2024-09-12T02:07:07.745903+0000","last_peered":"2024-09-12T02:07:07.745903+0000","last_clean":"2024-09-12T02:07:07.745903+0000","last_became_active":"2024-09-12T00:10:03.254328+0000","last_became_peered":"2024-09-12T00:10:03.254328+0000","last_unstale":"2024-09-12T02:07:07.745903+0000","last_undegraded":"2024-09-12T02:07:07.745903+0000","last_fullsized":"2024-09-12T02:07:07.745903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.745700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.745700+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.745700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:02.537185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"266'406","reported_seq":1080,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.814460+0000","last_change":"2024-09-12T02:07:17.814460+0000","last_active":"2024-09-12T02:07:17.814460+0000","last_peered":"2024-09-12T02:07:17.814460+0000","last_clean":"2024-09-12T02:07:17.814460+0000","last_became_active":"2024-09-12T00:10:05.285616+0000","last_became_peered":"2024-09-12T00:10:05.285616+0000","last_unstale":"2024-09-12T02:07:17.814460+0000","last_undegraded":"2024-09-12T02:07:17.814460+0000","last_fullsized":"2024-09-12T02:07:17.814460+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'406","last_scrub_stamp":"2024-09-12T02:07:17.814268+0000","last_deep_scrub":"266'406","last_deep_scrub_stamp":"2024-09-12T02:07:17.814268+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.814268+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:26.930072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44989,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":1221,"num_write":494,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"266'804","reported_seq":3302,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.577881+0000","last_change":"2024-09-12T02:07:20.577881+0000","last_active":"2024-09-12T02:07:20.577881+0000","last_peered":"2024-09-12T02:07:20.577881+0000","last_clean":"2024-09-12T02:07:20.577881+0000","last_became_active":"2024-09-12T00:10:07.319708+0000","last_became_peered":"2024-09-12T00:10:07.319708+0000","last_unstale":"2024-09-12T02:07:20.577881+0000","last_undegraded":"2024-09-12T02:07:20.577881+0000","last_fullsized":"2024-09-12T02:07:20.577881+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'804","last_scrub_stamp":"2024-09-12T02:07:20.577711+0000","last_deep_scrub":"266'804","last_deep_scrub_stamp":"2024-09-12T02:07:20.577711+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.577711+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:31.700028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"266'113","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.544103+0000","last_change":"2024-09-12T02:07:26.544103+0000","last_active":"2024-09-12T02:07:26.544103+0000","last_peered":"2024-09-12T02:07:26.544103+0000","last_clean":"2024-09-12T02:07:26.544103+0000","last_became_active":"2024-09-12T00:10:09.357682+0000","last_became_peered":"2024-09-12T00:10:09.357682+0000","last_unstale":"2024-09-12T02:07:26.544103+0000","last_undegraded":"2024-09-12T02:07:26.544103+0000","last_fullsized":"2024-09-12T02:07:26.544103+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'113","last_scrub_stamp":"2024-09-12T02:07:26.543887+0000","last_deep_scrub":"266'113","last_deep_scrub_stamp":"2024-09-12T02:07:26.543887+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.543887+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:23.602052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":265,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"266'779","reported_seq":2348,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.499361+0000","last_change":"2024-09-12T02:07:04.499361+0000","last_active":"2024-09-12T02:07:04.499361+0000","last_peered":"2024-09-12T02:07:04.499361+0000","last_clean":"2024-09-12T02:07:04.499361+0000","last_became_active":"2024-09-12T00:10:01.258536+0000","last_became_peered":"2024-09-12T00:10:01.258536+0000","last_unstale":"2024-09-12T02:07:04.499361+0000","last_undegraded":"2024-09-12T02:07:04.499361+0000","last_fullsized":"2024-09-12T02:07:04.499361+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'779","last_scrub_stamp":"2024-09-12T02:07:04.499174+0000","last_deep_scrub":"266'779","last_deep_scrub_stamp":"2024-09-12T02:07:04.499174+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.499174+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:49.045153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3854,"num_read_kb":3489,"num_write":1035,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"266'390","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.676263+0000","last_change":"2024-09-12T02:06:58.676117+0000","last_active":"2024-09-12T02:06:58.676263+0000","last_peered":"2024-09-12T02:06:58.676263+0000","last_clean":"2024-09-12T02:06:58.676263+0000","last_became_active":"2024-09-12T00:09:59.283882+0000","last_became_peered":"2024-09-12T00:09:59.283882+0000","last_unstale":"2024-09-12T02:06:58.676263+0000","last_undegraded":"2024-09-12T02:06:58.676263+0000","last_fullsized":"2024-09-12T02:06:58.676263+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:06:58.675891+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:06:58.675891+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.675891+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.972022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":25090,"num_write":1213,"num_write_kb":35310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.707801+0000","last_change":"2024-09-12T02:07:05.707659+0000","last_active":"2024-09-12T02:07:05.707801+0000","last_peered":"2024-09-12T02:07:05.707801+0000","last_clean":"2024-09-12T02:07:05.707801+0000","last_became_active":"2024-09-12T00:10:03.250840+0000","last_became_peered":"2024-09-12T00:10:03.250840+0000","last_unstale":"2024-09-12T02:07:05.707801+0000","last_undegraded":"2024-09-12T02:07:05.707801+0000","last_fullsized":"2024-09-12T02:07:05.707801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.707476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.707476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.707476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:17.730653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"266'545","reported_seq":1246,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.544969+0000","last_change":"2024-09-12T02:07:16.544969+0000","last_active":"2024-09-12T02:07:16.544969+0000","last_peered":"2024-09-12T02:07:16.544969+0000","last_clean":"2024-09-12T02:07:16.544969+0000","last_became_active":"2024-09-12T00:10:05.285823+0000","last_became_peered":"2024-09-12T00:10:05.285823+0000","last_unstale":"2024-09-12T02:07:16.544969+0000","last_undegraded":"2024-09-12T02:07:16.544969+0000","last_fullsized":"2024-09-12T02:07:16.544969+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'545","last_scrub_stamp":"2024-09-12T02:07:16.544864+0000","last_deep_scrub":"266'545","last_deep_scrub_stamp":"2024-09-12T02:07:16.544864+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.544864+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:16.677319+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96632,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":936,"num_read_kb":2160,"num_write":758,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.666557+0000","last_change":"2024-09-12T02:07:09.666557+0000","last_active":"2024-09-12T02:07:09.666557+0000","last_peered":"2024-09-12T02:07:09.666557+0000","last_clean":"2024-09-12T02:07:09.666557+0000","last_became_active":"2024-09-12T00:10:07.321180+0000","last_became_peered":"2024-09-12T00:10:07.321180+0000","last_unstale":"2024-09-12T02:07:09.666557+0000","last_undegraded":"2024-09-12T02:07:09.666557+0000","last_fullsized":"2024-09-12T02:07:09.666557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.666383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.666383+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.666383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:09.668378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"266'136","reported_seq":722,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.504910+0000","last_change":"2024-09-12T02:07:20.504910+0000","last_active":"2024-09-12T02:07:20.504910+0000","last_peered":"2024-09-12T02:07:20.504910+0000","last_clean":"2024-09-12T02:07:20.504910+0000","last_became_active":"2024-09-12T00:10:09.359011+0000","last_became_peered":"2024-09-12T00:10:09.359011+0000","last_unstale":"2024-09-12T02:07:20.504910+0000","last_undegraded":"2024-09-12T02:07:20.504910+0000","last_fullsized":"2024-09-12T02:07:20.504910+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'136","last_scrub_stamp":"2024-09-12T02:07:20.504684+0000","last_deep_scrub":"266'136","last_deep_scrub_stamp":"2024-09-12T02:07:20.504684+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.504684+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:40.032140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":320,"num_read_kb":272,"num_write":321,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"266'1105","reported_seq":2654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.037747+0000","last_change":"2024-09-12T02:07:00.037591+0000","last_active":"2024-09-12T02:07:00.037747+0000","last_peered":"2024-09-12T02:07:00.037747+0000","last_clean":"2024-09-12T02:07:00.037747+0000","last_became_active":"2024-09-12T00:10:01.248297+0000","last_became_peered":"2024-09-12T00:10:01.248297+0000","last_unstale":"2024-09-12T02:07:00.037747+0000","last_undegraded":"2024-09-12T02:07:00.037747+0000","last_fullsized":"2024-09-12T02:07:00.037747+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1105","last_scrub_stamp":"2024-09-12T02:07:00.037413+0000","last_deep_scrub":"266'1105","last_deep_scrub_stamp":"2024-09-12T02:07:00.037413+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.037413+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.519559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4909,"num_read_kb":4337,"num_write":1501,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"266'325","reported_seq":988,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.848958+0000","last_change":"2024-09-12T02:06:57.848683+0000","last_active":"2024-09-12T02:06:57.848958+0000","last_peered":"2024-09-12T02:06:57.848958+0000","last_clean":"2024-09-12T02:06:57.848958+0000","last_became_active":"2024-09-12T00:10:31.165905+0000","last_became_peered":"2024-09-12T00:10:31.165905+0000","last_unstale":"2024-09-12T02:06:57.848958+0000","last_undegraded":"2024-09-12T02:06:57.848958+0000","last_fullsized":"2024-09-12T02:06:57.848958+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'325","last_scrub_stamp":"2024-09-12T02:06:57.848241+0000","last_deep_scrub":"266'325","last_deep_scrub_stamp":"2024-09-12T02:06:57.848241+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.848241+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:33.677094+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273693,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":433,"num_read_kb":2613,"num_write":1035,"num_write_kb":17332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,7],"acting":[3,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.710647+0000","last_change":"2024-09-12T02:07:08.710647+0000","last_active":"2024-09-12T02:07:08.710647+0000","last_peered":"2024-09-12T02:07:08.710647+0000","last_clean":"2024-09-12T02:07:08.710647+0000","last_became_active":"2024-09-12T00:10:03.254056+0000","last_became_peered":"2024-09-12T00:10:03.254056+0000","last_unstale":"2024-09-12T02:07:08.710647+0000","last_undegraded":"2024-09-12T02:07:08.710647+0000","last_fullsized":"2024-09-12T02:07:08.710647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:08.710471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:08.710471+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.710471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:45.641565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"266'386","reported_seq":1032,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.005724+0000","last_change":"2024-09-12T02:07:19.005724+0000","last_active":"2024-09-12T02:07:19.005724+0000","last_peered":"2024-09-12T02:07:19.005724+0000","last_clean":"2024-09-12T02:07:19.005724+0000","last_became_active":"2024-09-12T00:10:05.299568+0000","last_became_peered":"2024-09-12T00:10:05.299568+0000","last_unstale":"2024-09-12T02:07:19.005724+0000","last_undegraded":"2024-09-12T02:07:19.005724+0000","last_fullsized":"2024-09-12T02:07:19.005724+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'386","last_scrub_stamp":"2024-09-12T02:07:19.005515+0000","last_deep_scrub":"266'386","last_deep_scrub_stamp":"2024-09-12T02:07:19.005515+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.005515+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:06.836073+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":635,"num_read_kb":1318,"num_write":554,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.637034+0000","last_change":"2024-09-12T02:07:22.636915+0000","last_active":"2024-09-12T02:07:22.637034+0000","last_peered":"2024-09-12T02:07:22.637034+0000","last_clean":"2024-09-12T02:07:22.637034+0000","last_became_active":"2024-09-12T00:10:07.334527+0000","last_became_peered":"2024-09-12T00:10:07.334527+0000","last_unstale":"2024-09-12T02:07:22.637034+0000","last_undegraded":"2024-09-12T02:07:22.637034+0000","last_fullsized":"2024-09-12T02:07:22.637034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:22.636687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:22.636687+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.636687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:15.135340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"266'175","reported_seq":755,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.964268+0000","last_change":"2024-09-12T02:07:32.964268+0000","last_active":"2024-09-12T02:07:32.964268+0000","last_peered":"2024-09-12T02:07:32.964268+0000","last_clean":"2024-09-12T02:07:32.964268+0000","last_became_active":"2024-09-12T00:10:09.373318+0000","last_became_peered":"2024-09-12T00:10:09.373318+0000","last_unstale":"2024-09-12T02:07:32.964268+0000","last_undegraded":"2024-09-12T02:07:32.964268+0000","last_fullsized":"2024-09-12T02:07:32.964268+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'175","last_scrub_stamp":"2024-09-12T02:07:32.964072+0000","last_deep_scrub":"266'175","last_deep_scrub_stamp":"2024-09-12T02:07:32.964072+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.964072+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:45.058830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":275,"num_write":406,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"266'793","reported_seq":2426,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.049441+0000","last_change":"2024-09-12T02:07:01.049290+0000","last_active":"2024-09-12T02:07:01.049441+0000","last_peered":"2024-09-12T02:07:01.049441+0000","last_clean":"2024-09-12T02:07:01.049441+0000","last_became_active":"2024-09-12T00:10:01.242213+0000","last_became_peered":"2024-09-12T00:10:01.242213+0000","last_unstale":"2024-09-12T02:07:01.049441+0000","last_undegraded":"2024-09-12T02:07:01.049441+0000","last_fullsized":"2024-09-12T02:07:01.049441+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'793","last_scrub_stamp":"2024-09-12T02:07:01.049091+0000","last_deep_scrub":"266'793","last_deep_scrub_stamp":"2024-09-12T02:07:01.049091+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.049091+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:47.730275+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3776,"num_read_kb":3427,"num_write":1023,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"266'387","reported_seq":1087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.183542+0000","last_change":"2024-09-12T02:06:57.183396+0000","last_active":"2024-09-12T02:06:57.183542+0000","last_peered":"2024-09-12T02:06:57.183542+0000","last_clean":"2024-09-12T02:06:57.183542+0000","last_became_active":"2024-09-12T00:09:59.298986+0000","last_became_peered":"2024-09-12T00:09:59.298986+0000","last_unstale":"2024-09-12T02:06:57.183542+0000","last_undegraded":"2024-09-12T02:06:57.183542+0000","last_fullsized":"2024-09-12T02:06:57.183542+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'387","last_scrub_stamp":"2024-09-12T02:06:57.183120+0000","last_deep_scrub":"266'387","last_deep_scrub_stamp":"2024-09-12T02:06:57.183120+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.183120+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:28.858130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":586,"num_read_kb":16563,"num_write":1186,"num_write_kb":29581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.329996+0000","last_change":"2024-09-12T02:07:06.329996+0000","last_active":"2024-09-12T02:07:06.329996+0000","last_peered":"2024-09-12T02:07:06.329996+0000","last_clean":"2024-09-12T02:07:06.329996+0000","last_became_active":"2024-09-12T00:10:03.262121+0000","last_became_peered":"2024-09-12T00:10:03.262121+0000","last_unstale":"2024-09-12T02:07:06.329996+0000","last_undegraded":"2024-09-12T02:07:06.329996+0000","last_fullsized":"2024-09-12T02:07:06.329996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:06.329806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:06.329806+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.329806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:06.288745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"266'396","reported_seq":1060,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.650731+0000","last_change":"2024-09-12T02:07:11.650583+0000","last_active":"2024-09-12T02:07:11.650731+0000","last_peered":"2024-09-12T02:07:11.650731+0000","last_clean":"2024-09-12T02:07:11.650731+0000","last_became_active":"2024-09-12T00:10:05.294629+0000","last_became_peered":"2024-09-12T00:10:05.294629+0000","last_unstale":"2024-09-12T02:07:11.650731+0000","last_undegraded":"2024-09-12T02:07:11.650731+0000","last_fullsized":"2024-09-12T02:07:11.650731+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'396","last_scrub_stamp":"2024-09-12T02:07:11.650372+0000","last_deep_scrub":"266'396","last_deep_scrub_stamp":"2024-09-12T02:07:11.650372+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.650372+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:14.428526+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46543,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":631,"num_read_kb":1251,"num_write":492,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"266'749","reported_seq":3296,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.619689+0000","last_change":"2024-09-12T02:07:10.619689+0000","last_active":"2024-09-12T02:07:10.619689+0000","last_peered":"2024-09-12T02:07:10.619689+0000","last_clean":"2024-09-12T02:07:10.619689+0000","last_became_active":"2024-09-12T00:10:07.314777+0000","last_became_peered":"2024-09-12T00:10:07.314777+0000","last_unstale":"2024-09-12T02:07:10.619689+0000","last_undegraded":"2024-09-12T02:07:10.619689+0000","last_fullsized":"2024-09-12T02:07:10.619689+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'749","last_scrub_stamp":"2024-09-12T02:07:10.619509+0000","last_deep_scrub":"266'749","last_deep_scrub_stamp":"2024-09-12T02:07:10.619509+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.619509+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:06.239730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"266'138","reported_seq":684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.467280+0000","last_change":"2024-09-12T02:07:17.467280+0000","last_active":"2024-09-12T02:07:17.467280+0000","last_peered":"2024-09-12T02:07:17.467280+0000","last_clean":"2024-09-12T02:07:17.467280+0000","last_became_active":"2024-09-12T00:10:09.346452+0000","last_became_peered":"2024-09-12T00:10:09.346452+0000","last_unstale":"2024-09-12T02:07:17.467280+0000","last_undegraded":"2024-09-12T02:07:17.467280+0000","last_fullsized":"2024-09-12T02:07:17.467280+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'138","last_scrub_stamp":"2024-09-12T02:07:17.467075+0000","last_deep_scrub":"266'138","last_deep_scrub_stamp":"2024-09-12T02:07:17.467075+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.467075+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:51.463617+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":133,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"266'1061","reported_seq":2659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.049484+0000","last_change":"2024-09-12T02:07:02.049238+0000","last_active":"2024-09-12T02:07:02.049484+0000","last_peered":"2024-09-12T02:07:02.049484+0000","last_clean":"2024-09-12T02:07:02.049484+0000","last_became_active":"2024-09-12T00:10:01.264718+0000","last_became_peered":"2024-09-12T00:10:01.264718+0000","last_unstale":"2024-09-12T02:07:02.049484+0000","last_undegraded":"2024-09-12T02:07:02.049484+0000","last_fullsized":"2024-09-12T02:07:02.049484+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1061","last_scrub_stamp":"2024-09-12T02:07:02.049006+0000","last_deep_scrub":"266'1061","last_deep_scrub_stamp":"2024-09-12T02:07:02.049006+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.049006+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":1000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:54.290718+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4853,"num_read_kb":4249,"num_write":1477,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1148,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"266'417","reported_seq":1122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.038069+0000","last_change":"2024-09-12T02:06:54.037809+0000","last_active":"2024-09-12T02:06:54.038069+0000","last_peered":"2024-09-12T02:06:54.038069+0000","last_clean":"2024-09-12T02:06:54.038069+0000","last_became_active":"2024-09-12T00:09:59.301303+0000","last_became_peered":"2024-09-12T00:09:59.301303+0000","last_unstale":"2024-09-12T02:06:54.038069+0000","last_undegraded":"2024-09-12T02:06:54.038069+0000","last_fullsized":"2024-09-12T02:06:54.038069+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'417","last_scrub_stamp":"2024-09-12T02:06:54.037420+0000","last_deep_scrub":"266'417","last_deep_scrub_stamp":"2024-09-12T02:06:54.037420+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.037420+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:35.287042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443899,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":39523,"num_write":1279,"num_write_kb":37758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.556793+0000","last_change":"2024-09-12T02:07:19.556652+0000","last_active":"2024-09-12T02:07:19.556793+0000","last_peered":"2024-09-12T02:07:19.556793+0000","last_clean":"2024-09-12T02:07:19.556793+0000","last_became_active":"2024-09-12T00:10:03.271281+0000","last_became_peered":"2024-09-12T00:10:03.271281+0000","last_unstale":"2024-09-12T02:07:19.556793+0000","last_undegraded":"2024-09-12T02:07:19.556793+0000","last_fullsized":"2024-09-12T02:07:19.556793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:19.556476+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:19.556476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.556476+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:33.140789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"266'152","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.960004+0000","last_change":"2024-09-12T02:07:16.960004+0000","last_active":"2024-09-12T02:07:16.960004+0000","last_peered":"2024-09-12T02:07:16.960004+0000","last_clean":"2024-09-12T02:07:16.960004+0000","last_became_active":"2024-09-12T00:10:05.362449+0000","last_became_peered":"2024-09-12T00:10:05.362449+0000","last_unstale":"2024-09-12T02:07:16.960004+0000","last_undegraded":"2024-09-12T02:07:16.960004+0000","last_fullsized":"2024-09-12T02:07:16.960004+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'152","last_scrub_stamp":"2024-09-12T02:07:16.959823+0000","last_deep_scrub":"266'152","last_deep_scrub_stamp":"2024-09-12T02:07:16.959823+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.959823+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:57.960409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"266'764","reported_seq":3355,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.068319+0000","last_change":"2024-09-12T02:07:11.068319+0000","last_active":"2024-09-12T02:07:11.068319+0000","last_peered":"2024-09-12T02:07:11.068319+0000","last_clean":"2024-09-12T02:07:11.068319+0000","last_became_active":"2024-09-12T00:10:07.318566+0000","last_became_peered":"2024-09-12T00:10:07.318566+0000","last_unstale":"2024-09-12T02:07:11.068319+0000","last_undegraded":"2024-09-12T02:07:11.068319+0000","last_fullsized":"2024-09-12T02:07:11.068319+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'764","last_scrub_stamp":"2024-09-12T02:07:11.068113+0000","last_deep_scrub":"266'764","last_deep_scrub_stamp":"2024-09-12T02:07:11.068113+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.068113+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:47.655491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"266'182","reported_seq":721,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.123207+0000","last_change":"2024-09-12T02:07:26.123207+0000","last_active":"2024-09-12T02:07:26.123207+0000","last_peered":"2024-09-12T02:07:26.123207+0000","last_clean":"2024-09-12T02:07:26.123207+0000","last_became_active":"2024-09-12T00:10:09.353213+0000","last_became_peered":"2024-09-12T00:10:09.353213+0000","last_unstale":"2024-09-12T02:07:26.123207+0000","last_undegraded":"2024-09-12T02:07:26.123207+0000","last_fullsized":"2024-09-12T02:07:26.123207+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T02:07:26.123006+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T02:07:26.123006+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.123006+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:26.036216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":410,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"266'439","reported_seq":1999,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.417775+0000","last_change":"2024-09-12T02:07:00.417624+0000","last_active":"2024-09-12T02:07:00.417775+0000","last_peered":"2024-09-12T02:07:00.417775+0000","last_clean":"2024-09-12T02:07:00.417775+0000","last_became_active":"2024-09-12T00:10:01.256287+0000","last_became_peered":"2024-09-12T00:10:01.256287+0000","last_unstale":"2024-09-12T02:07:00.417775+0000","last_undegraded":"2024-09-12T02:07:00.417775+0000","last_fullsized":"2024-09-12T02:07:00.417775+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'439","last_scrub_stamp":"2024-09-12T02:07:00.417437+0000","last_deep_scrub":"266'439","last_deep_scrub_stamp":"2024-09-12T02:07:00.417437+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.417437+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:35.069664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2163,"num_write":523,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"266'451","reported_seq":1398,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.877423+0000","last_change":"2024-09-12T02:06:54.877268+0000","last_active":"2024-09-12T02:06:54.877423+0000","last_peered":"2024-09-12T02:06:54.877423+0000","last_clean":"2024-09-12T02:06:54.877423+0000","last_became_active":"2024-09-12T00:10:31.168654+0000","last_became_peered":"2024-09-12T00:10:31.168654+0000","last_unstale":"2024-09-12T02:06:54.877423+0000","last_undegraded":"2024-09-12T02:06:54.877423+0000","last_fullsized":"2024-09-12T02:06:54.877423+0000","mapping_epoch":38,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'451","last_scrub_stamp":"2024-09-12T02:06:54.877036+0000","last_deep_scrub":"266'451","last_deep_scrub_stamp":"2024-09-12T02:06:54.877036+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.877036+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.689710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777138,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1245,"num_read_kb":67964,"num_write":1343,"num_write_kb":19763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.058610+0000","last_change":"2024-09-12T02:07:15.058610+0000","last_active":"2024-09-12T02:07:15.058610+0000","last_peered":"2024-09-12T02:07:15.058610+0000","last_clean":"2024-09-12T02:07:15.058610+0000","last_became_active":"2024-09-12T00:10:03.272284+0000","last_became_peered":"2024-09-12T00:10:03.272284+0000","last_unstale":"2024-09-12T02:07:15.058610+0000","last_undegraded":"2024-09-12T02:07:15.058610+0000","last_fullsized":"2024-09-12T02:07:15.058610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.058442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.058442+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.058442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:24.721522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"266'545","reported_seq":1236,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.609582+0000","last_change":"2024-09-12T02:07:20.609582+0000","last_active":"2024-09-12T02:07:20.609582+0000","last_peered":"2024-09-12T02:07:20.609582+0000","last_clean":"2024-09-12T02:07:20.609582+0000","last_became_active":"2024-09-12T00:10:05.300354+0000","last_became_peered":"2024-09-12T00:10:05.300354+0000","last_unstale":"2024-09-12T02:07:20.609582+0000","last_undegraded":"2024-09-12T02:07:20.609582+0000","last_fullsized":"2024-09-12T02:07:20.609582+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'545","last_scrub_stamp":"2024-09-12T02:07:20.609387+0000","last_deep_scrub":"266'545","last_deep_scrub_stamp":"2024-09-12T02:07:20.609387+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.609387+0000","objects_scrubbed":9,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:45.881011+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54476,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1438,"num_read_kb":1976,"num_write":2042,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488698,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.072344+0000","last_change":"2024-09-12T02:07:12.072344+0000","last_active":"2024-09-12T02:07:12.072344+0000","last_peered":"2024-09-12T02:07:12.072344+0000","last_clean":"2024-09-12T02:07:12.072344+0000","last_became_active":"2024-09-12T00:10:07.340008+0000","last_became_peered":"2024-09-12T00:10:07.340008+0000","last_unstale":"2024-09-12T02:07:12.072344+0000","last_undegraded":"2024-09-12T02:07:12.072344+0000","last_fullsized":"2024-09-12T02:07:12.072344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.072166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.072166+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.072166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:29.623883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"266'140","reported_seq":692,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.739637+0000","last_change":"2024-09-12T02:07:19.739637+0000","last_active":"2024-09-12T02:07:19.739637+0000","last_peered":"2024-09-12T02:07:19.739637+0000","last_clean":"2024-09-12T02:07:19.739637+0000","last_became_active":"2024-09-12T00:10:09.372231+0000","last_became_peered":"2024-09-12T00:10:09.372231+0000","last_unstale":"2024-09-12T02:07:19.739637+0000","last_undegraded":"2024-09-12T02:07:19.739637+0000","last_fullsized":"2024-09-12T02:07:19.739637+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'140","last_scrub_stamp":"2024-09-12T02:07:19.739438+0000","last_deep_scrub":"266'140","last_deep_scrub_stamp":"2024-09-12T02:07:19.739438+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.739438+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:41.681859+0000","scrub_duration":211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"266'757","reported_seq":2316,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.070990+0000","last_change":"2024-09-12T02:07:01.070708+0000","last_active":"2024-09-12T02:07:01.070990+0000","last_peered":"2024-09-12T02:07:01.070990+0000","last_clean":"2024-09-12T02:07:01.070990+0000","last_became_active":"2024-09-12T00:10:01.262490+0000","last_became_peered":"2024-09-12T00:10:01.262490+0000","last_unstale":"2024-09-12T02:07:01.070990+0000","last_undegraded":"2024-09-12T02:07:01.070990+0000","last_fullsized":"2024-09-12T02:07:01.070990+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'757","last_scrub_stamp":"2024-09-12T02:07:01.070499+0000","last_deep_scrub":"266'757","last_deep_scrub_stamp":"2024-09-12T02:07:01.070499+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.070499+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:21.203677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3216,"num_write":966,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.772265+0000","last_change":"2024-09-12T02:06:55.772265+0000","last_active":"2024-09-12T02:06:55.772265+0000","last_peered":"2024-09-12T02:06:55.772265+0000","last_clean":"2024-09-12T02:06:55.772265+0000","last_became_active":"2024-09-12T00:09:40.224430+0000","last_became_peered":"2024-09-12T00:09:40.224430+0000","last_unstale":"2024-09-12T02:06:55.772265+0000","last_undegraded":"2024-09-12T02:06:55.772265+0000","last_fullsized":"2024-09-12T02:06:55.772265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T02:06:55.772071+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T02:06:55.772071+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.772071+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:02.200479+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":566,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.755705+0000","last_change":"2024-09-12T02:06:55.755705+0000","last_active":"2024-09-12T02:06:55.755705+0000","last_peered":"2024-09-12T02:06:55.755705+0000","last_clean":"2024-09-12T02:06:55.755705+0000","last_became_active":"2024-09-12T00:09:46.162330+0000","last_became_peered":"2024-09-12T00:09:46.162330+0000","last_unstale":"2024-09-12T02:06:55.755705+0000","last_undegraded":"2024-09-12T02:06:55.755705+0000","last_fullsized":"2024-09-12T02:06:55.755705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:06:55.755515+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:06:55.755515+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.755515+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:19.877569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090615300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"266'321","reported_seq":992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.871360+0000","last_change":"2024-09-12T02:06:55.871360+0000","last_active":"2024-09-12T02:06:55.871360+0000","last_peered":"2024-09-12T02:06:55.871360+0000","last_clean":"2024-09-12T02:06:55.871360+0000","last_became_active":"2024-09-12T00:09:59.310092+0000","last_became_peered":"2024-09-12T00:09:59.310092+0000","last_unstale":"2024-09-12T02:06:55.871360+0000","last_undegraded":"2024-09-12T02:06:55.871360+0000","last_fullsized":"2024-09-12T02:06:55.871360+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'321","last_scrub_stamp":"2024-09-12T02:06:55.871078+0000","last_deep_scrub":"266'321","last_deep_scrub_stamp":"2024-09-12T02:06:55.871078+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.871078+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:49.767328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306611,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":13893,"num_write":1018,"num_write_kb":29182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"266'6","reported_seq":1019,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.875218+0000","last_change":"2024-09-12T02:07:11.875218+0000","last_active":"2024-09-12T02:07:11.875218+0000","last_peered":"2024-09-12T02:07:11.875218+0000","last_clean":"2024-09-12T02:07:11.875218+0000","last_became_active":"2024-09-12T00:10:03.261183+0000","last_became_peered":"2024-09-12T00:10:03.261183+0000","last_unstale":"2024-09-12T02:07:11.875218+0000","last_undegraded":"2024-09-12T02:07:11.875218+0000","last_fullsized":"2024-09-12T02:07:11.875218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T02:07:11.875038+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T02:07:11.875038+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.875038+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:02.168922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"266'814","reported_seq":1577,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.590850+0000","last_change":"2024-09-12T02:07:22.590850+0000","last_active":"2024-09-12T02:07:22.590850+0000","last_peered":"2024-09-12T02:07:22.590850+0000","last_clean":"2024-09-12T02:07:22.590850+0000","last_became_active":"2024-09-12T00:10:05.294267+0000","last_became_peered":"2024-09-12T00:10:05.294267+0000","last_unstale":"2024-09-12T02:07:22.590850+0000","last_undegraded":"2024-09-12T02:07:22.590850+0000","last_fullsized":"2024-09-12T02:07:22.590850+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'814","last_scrub_stamp":"2024-09-12T02:07:22.590669+0000","last_deep_scrub":"266'814","last_deep_scrub_stamp":"2024-09-12T02:07:22.590669+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.590669+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.111026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156191,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1567,"num_read_kb":3456,"num_write":1540,"num_write_kb":1367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107552,"num_omap_keys":260,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.612361+0000","last_change":"2024-09-12T02:07:21.612361+0000","last_active":"2024-09-12T02:07:21.612361+0000","last_peered":"2024-09-12T02:07:21.612361+0000","last_clean":"2024-09-12T02:07:21.612361+0000","last_became_active":"2024-09-12T00:10:07.323398+0000","last_became_peered":"2024-09-12T00:10:07.323398+0000","last_unstale":"2024-09-12T02:07:21.612361+0000","last_undegraded":"2024-09-12T02:07:21.612361+0000","last_fullsized":"2024-09-12T02:07:21.612361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:21.612192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:21.612192+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.612192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:53.420420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"266'249","reported_seq":1009,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.092694+0000","last_change":"2024-09-12T02:07:14.092694+0000","last_active":"2024-09-12T02:07:14.092694+0000","last_peered":"2024-09-12T02:07:14.092694+0000","last_clean":"2024-09-12T02:07:14.092694+0000","last_became_active":"2024-09-12T00:10:09.373661+0000","last_became_peered":"2024-09-12T00:10:09.373661+0000","last_unstale":"2024-09-12T02:07:14.092694+0000","last_undegraded":"2024-09-12T02:07:14.092694+0000","last_fullsized":"2024-09-12T02:07:14.092694+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'249","last_scrub_stamp":"2024-09-12T02:07:14.092461+0000","last_deep_scrub":"266'249","last_deep_scrub_stamp":"2024-09-12T02:07:14.092461+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.092461+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:24.522987+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":498,"num_write":430,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"266'1255","reported_seq":3064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.482860+0000","last_change":"2024-09-12T02:07:03.482730+0000","last_active":"2024-09-12T02:07:03.482860+0000","last_peered":"2024-09-12T02:07:03.482860+0000","last_clean":"2024-09-12T02:07:03.482860+0000","last_became_active":"2024-09-12T00:10:31.471885+0000","last_became_peered":"2024-09-12T00:10:31.471885+0000","last_unstale":"2024-09-12T02:07:03.482860+0000","last_undegraded":"2024-09-12T02:07:03.482860+0000","last_fullsized":"2024-09-12T02:07:03.482860+0000","mapping_epoch":38,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1255","last_scrub_stamp":"2024-09-12T02:07:03.482543+0000","last_deep_scrub":"266'1255","last_deep_scrub_stamp":"2024-09-12T02:07:03.482543+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.482543+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:26.888676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6022,"num_read_kb":5329,"num_write":1728,"num_write_kb":723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5360,"num_omap_keys":21,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":560,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.756739+0000","last_change":"2024-09-12T02:06:56.756739+0000","last_active":"2024-09-12T02:06:56.756739+0000","last_peered":"2024-09-12T02:06:56.756739+0000","last_clean":"2024-09-12T02:06:56.756739+0000","last_became_active":"2024-09-12T00:09:46.164248+0000","last_became_peered":"2024-09-12T00:09:46.164248+0000","last_unstale":"2024-09-12T02:06:56.756739+0000","last_undegraded":"2024-09-12T02:06:56.756739+0000","last_fullsized":"2024-09-12T02:06:56.756739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:56.756558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:56.756558+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.756558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:24.410460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099742600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"266'334","reported_seq":990,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.535461+0000","last_change":"2024-09-12T02:06:53.535461+0000","last_active":"2024-09-12T02:06:53.535461+0000","last_peered":"2024-09-12T02:06:53.535461+0000","last_clean":"2024-09-12T02:06:53.535461+0000","last_became_active":"2024-09-12T00:09:59.293880+0000","last_became_peered":"2024-09-12T00:09:59.293880+0000","last_unstale":"2024-09-12T02:06:53.535461+0000","last_undegraded":"2024-09-12T02:06:53.535461+0000","last_fullsized":"2024-09-12T02:06:53.535461+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'334","last_scrub_stamp":"2024-09-12T02:06:53.535293+0000","last_deep_scrub":"266'334","last_deep_scrub_stamp":"2024-09-12T02:06:53.535293+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.535293+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:40.126937+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5590248,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":16782,"num_write":1093,"num_write_kb":42263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.530675+0000","last_change":"2024-09-12T02:07:15.530675+0000","last_active":"2024-09-12T02:07:15.530675+0000","last_peered":"2024-09-12T02:07:15.530675+0000","last_clean":"2024-09-12T02:07:15.530675+0000","last_became_active":"2024-09-12T00:10:03.271454+0000","last_became_peered":"2024-09-12T00:10:03.271454+0000","last_unstale":"2024-09-12T02:07:15.530675+0000","last_undegraded":"2024-09-12T02:07:15.530675+0000","last_fullsized":"2024-09-12T02:07:15.530675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.530503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.530503+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.530503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:09.506727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"266'1460","reported_seq":3863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.403647+0000","last_change":"2024-09-12T02:07:13.403647+0000","last_active":"2024-09-12T02:07:13.403647+0000","last_peered":"2024-09-12T02:07:13.403647+0000","last_clean":"2024-09-12T02:07:13.403647+0000","last_became_active":"2024-09-12T00:10:05.295058+0000","last_became_peered":"2024-09-12T00:10:05.295058+0000","last_unstale":"2024-09-12T02:07:13.403647+0000","last_undegraded":"2024-09-12T02:07:13.403647+0000","last_fullsized":"2024-09-12T02:07:13.403647+0000","mapping_epoch":31,"log_start":"266'1400","ondisk_log_start":"266'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1460","last_scrub_stamp":"2024-09-12T02:07:13.403437+0000","last_deep_scrub":"266'1460","last_deep_scrub_stamp":"2024-09-12T02:07:13.403437+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.403437+0000","objects_scrubbed":12,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:33.536505+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161189,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2280,"num_read_kb":4238,"num_write":1386,"num_write_kb":1157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.882797+0000","last_change":"2024-09-12T02:07:24.882797+0000","last_active":"2024-09-12T02:07:24.882797+0000","last_peered":"2024-09-12T02:07:24.882797+0000","last_clean":"2024-09-12T02:07:24.882797+0000","last_became_active":"2024-09-12T00:10:07.319957+0000","last_became_peered":"2024-09-12T00:10:07.319957+0000","last_unstale":"2024-09-12T02:07:24.882797+0000","last_undegraded":"2024-09-12T02:07:24.882797+0000","last_fullsized":"2024-09-12T02:07:24.882797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.882615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.882615+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.882615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.172228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"266'87","reported_seq":619,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.537802+0000","last_change":"2024-09-12T02:07:21.537631+0000","last_active":"2024-09-12T02:07:21.537802+0000","last_peered":"2024-09-12T02:07:21.537802+0000","last_clean":"2024-09-12T02:07:21.537802+0000","last_became_active":"2024-09-12T00:10:09.430727+0000","last_became_peered":"2024-09-12T00:10:09.430727+0000","last_unstale":"2024-09-12T02:07:21.537802+0000","last_undegraded":"2024-09-12T02:07:21.537802+0000","last_fullsized":"2024-09-12T02:07:21.537802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'87","last_scrub_stamp":"2024-09-12T02:07:21.537445+0000","last_deep_scrub":"266'87","last_deep_scrub_stamp":"2024-09-12T02:07:21.537445+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.537445+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:02.227142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"266'639","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.450994+0000","last_change":"2024-09-12T02:06:58.450831+0000","last_active":"2024-09-12T02:06:58.450994+0000","last_peered":"2024-09-12T02:06:58.450994+0000","last_clean":"2024-09-12T02:06:58.450994+0000","last_became_active":"2024-09-12T00:10:01.277302+0000","last_became_peered":"2024-09-12T00:10:01.277302+0000","last_unstale":"2024-09-12T02:06:58.450994+0000","last_undegraded":"2024-09-12T02:06:58.450994+0000","last_fullsized":"2024-09-12T02:06:58.450994+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'639","last_scrub_stamp":"2024-09-12T02:06:58.450656+0000","last_deep_scrub":"266'639","last_deep_scrub_stamp":"2024-09-12T02:06:58.450656+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.450656+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:52.660098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3369,"num_read_kb":3119,"num_write":789,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":562,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.645702+0000","last_change":"2024-09-12T02:06:53.645702+0000","last_active":"2024-09-12T02:06:53.645702+0000","last_peered":"2024-09-12T02:06:53.645702+0000","last_clean":"2024-09-12T02:06:53.645702+0000","last_became_active":"2024-09-12T00:09:46.179853+0000","last_became_peered":"2024-09-12T00:09:46.179853+0000","last_unstale":"2024-09-12T02:06:53.645702+0000","last_undegraded":"2024-09-12T02:06:53.645702+0000","last_fullsized":"2024-09-12T02:06:53.645702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:53.645611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:53.645611+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.645611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:10.578130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056473999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"266'337","reported_seq":1051,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.539651+0000","last_change":"2024-09-12T02:06:54.539651+0000","last_active":"2024-09-12T02:06:54.539651+0000","last_peered":"2024-09-12T02:06:54.539651+0000","last_clean":"2024-09-12T02:06:54.539651+0000","last_became_active":"2024-09-12T00:09:59.317172+0000","last_became_peered":"2024-09-12T00:09:59.317172+0000","last_unstale":"2024-09-12T02:06:54.539651+0000","last_undegraded":"2024-09-12T02:06:54.539651+0000","last_fullsized":"2024-09-12T02:06:54.539651+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'337","last_scrub_stamp":"2024-09-12T02:06:54.539255+0000","last_deep_scrub":"266'337","last_deep_scrub_stamp":"2024-09-12T02:06:54.539255+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.539255+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:20.701196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":79957,"num_write":1084,"num_write_kb":20693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":538,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.747793+0000","last_change":"2024-09-12T02:07:06.747793+0000","last_active":"2024-09-12T02:07:06.747793+0000","last_peered":"2024-09-12T02:07:06.747793+0000","last_clean":"2024-09-12T02:07:06.747793+0000","last_became_active":"2024-09-12T00:10:03.274519+0000","last_became_peered":"2024-09-12T00:10:03.274519+0000","last_unstale":"2024-09-12T02:07:06.747793+0000","last_undegraded":"2024-09-12T02:07:06.747793+0000","last_fullsized":"2024-09-12T02:07:06.747793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:06.747613+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:06.747613+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.747613+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:42.645385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"266'406","reported_seq":2404,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.836963+0000","last_change":"2024-09-12T02:07:16.836963+0000","last_active":"2024-09-12T02:07:16.836963+0000","last_peered":"2024-09-12T02:07:16.836963+0000","last_clean":"2024-09-12T02:07:16.836963+0000","last_became_active":"2024-09-12T00:10:05.365417+0000","last_became_peered":"2024-09-12T00:10:05.365417+0000","last_unstale":"2024-09-12T02:07:16.836963+0000","last_undegraded":"2024-09-12T02:07:16.836963+0000","last_fullsized":"2024-09-12T02:07:16.836963+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'406","last_scrub_stamp":"2024-09-12T02:07:16.836746+0000","last_deep_scrub":"266'406","last_deep_scrub_stamp":"2024-09-12T02:07:16.836746+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.836746+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:37.314941+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":388,"num_read_kb":374,"num_write":387,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.563429+0000","last_change":"2024-09-12T02:07:18.563429+0000","last_active":"2024-09-12T02:07:18.563429+0000","last_peered":"2024-09-12T02:07:18.563429+0000","last_clean":"2024-09-12T02:07:18.563429+0000","last_became_active":"2024-09-12T00:10:07.319786+0000","last_became_peered":"2024-09-12T00:10:07.319786+0000","last_unstale":"2024-09-12T02:07:18.563429+0000","last_undegraded":"2024-09-12T02:07:18.563429+0000","last_fullsized":"2024-09-12T02:07:18.563429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:18.563252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:18.563252+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.563252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:27.472116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"266'258","reported_seq":898,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:39.092409+0000","last_change":"2024-09-12T02:07:39.092409+0000","last_active":"2024-09-12T02:07:39.092409+0000","last_peered":"2024-09-12T02:07:39.092409+0000","last_clean":"2024-09-12T02:07:39.092409+0000","last_became_active":"2024-09-12T00:10:09.365558+0000","last_became_peered":"2024-09-12T00:10:09.365558+0000","last_unstale":"2024-09-12T02:07:39.092409+0000","last_undegraded":"2024-09-12T02:07:39.092409+0000","last_fullsized":"2024-09-12T02:07:39.092409+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'258","last_scrub_stamp":"2024-09-12T02:07:39.092220+0000","last_deep_scrub":"266'258","last_deep_scrub_stamp":"2024-09-12T02:07:39.092220+0000","last_clean_scrub_stamp":"2024-09-12T02:07:39.092220+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:25.445097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":520,"num_write":557,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"266'479","reported_seq":2058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.377367+0000","last_change":"2024-09-12T02:07:01.377367+0000","last_active":"2024-09-12T02:07:01.377367+0000","last_peered":"2024-09-12T02:07:01.377367+0000","last_clean":"2024-09-12T02:07:01.377367+0000","last_became_active":"2024-09-12T00:10:01.256107+0000","last_became_peered":"2024-09-12T00:10:01.256107+0000","last_unstale":"2024-09-12T02:07:01.377367+0000","last_undegraded":"2024-09-12T02:07:01.377367+0000","last_fullsized":"2024-09-12T02:07:01.377367+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'479","last_scrub_stamp":"2024-09-12T02:07:01.377182+0000","last_deep_scrub":"266'479","last_deep_scrub_stamp":"2024-09-12T02:07:01.377182+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.377182+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:21.624019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2517,"num_read_kb":2366,"num_write":564,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":567,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.713155+0000","last_change":"2024-09-12T02:06:54.713155+0000","last_active":"2024-09-12T02:06:54.713155+0000","last_peered":"2024-09-12T02:06:54.713155+0000","last_clean":"2024-09-12T02:06:54.713155+0000","last_became_active":"2024-09-12T00:09:46.161046+0000","last_became_peered":"2024-09-12T00:09:46.161046+0000","last_unstale":"2024-09-12T02:06:54.713155+0000","last_undegraded":"2024-09-12T02:06:54.713155+0000","last_fullsized":"2024-09-12T02:06:54.713155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:06:54.712965+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:06:54.712965+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.712965+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:06.136484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022130560000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"266'390","reported_seq":1054,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.642627+0000","last_change":"2024-09-12T02:06:52.642552+0000","last_active":"2024-09-12T02:06:52.642627+0000","last_peered":"2024-09-12T02:06:52.642627+0000","last_clean":"2024-09-12T02:06:52.642627+0000","last_became_active":"2024-09-12T00:10:31.473891+0000","last_became_peered":"2024-09-12T00:10:31.473891+0000","last_unstale":"2024-09-12T02:06:52.642627+0000","last_undegraded":"2024-09-12T02:06:52.642627+0000","last_fullsized":"2024-09-12T02:06:52.642627+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:06:52.642445+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:06:52.642445+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.642445+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:58.116732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1728219,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":35036,"num_write":1225,"num_write_kb":35348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.597469+0000","last_change":"2024-09-12T02:07:11.597228+0000","last_active":"2024-09-12T02:07:11.597469+0000","last_peered":"2024-09-12T02:07:11.597469+0000","last_clean":"2024-09-12T02:07:11.597469+0000","last_became_active":"2024-09-12T00:10:03.264991+0000","last_became_peered":"2024-09-12T00:10:03.264991+0000","last_unstale":"2024-09-12T02:07:11.597469+0000","last_undegraded":"2024-09-12T02:07:11.597469+0000","last_fullsized":"2024-09-12T02:07:11.597469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:11.597020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:11.597020+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.597020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:58.686303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"266'214","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.998971+0000","last_change":"2024-09-12T02:07:21.998971+0000","last_active":"2024-09-12T02:07:21.998971+0000","last_peered":"2024-09-12T02:07:21.998971+0000","last_clean":"2024-09-12T02:07:21.998971+0000","last_became_active":"2024-09-12T00:10:05.286433+0000","last_became_peered":"2024-09-12T00:10:05.286433+0000","last_unstale":"2024-09-12T02:07:21.998971+0000","last_undegraded":"2024-09-12T02:07:21.998971+0000","last_fullsized":"2024-09-12T02:07:21.998971+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'214","last_scrub_stamp":"2024-09-12T02:07:21.998706+0000","last_deep_scrub":"266'214","last_deep_scrub_stamp":"2024-09-12T02:07:21.998706+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.998706+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:58.514298+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":276,"num_read_kb":269,"num_write":202,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.113674+0000","last_change":"2024-09-12T02:07:15.113674+0000","last_active":"2024-09-12T02:07:15.113674+0000","last_peered":"2024-09-12T02:07:15.113674+0000","last_clean":"2024-09-12T02:07:15.113674+0000","last_became_active":"2024-09-12T00:10:07.329823+0000","last_became_peered":"2024-09-12T00:10:07.329823+0000","last_unstale":"2024-09-12T02:07:15.113674+0000","last_undegraded":"2024-09-12T02:07:15.113674+0000","last_fullsized":"2024-09-12T02:07:15.113674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.113498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.113498+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.113498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:56.771935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"266'102","reported_seq":691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.652236+0000","last_change":"2024-09-12T02:07:28.652236+0000","last_active":"2024-09-12T02:07:28.652236+0000","last_peered":"2024-09-12T02:07:28.652236+0000","last_clean":"2024-09-12T02:07:28.652236+0000","last_became_active":"2024-09-12T00:10:09.368176+0000","last_became_peered":"2024-09-12T00:10:09.368176+0000","last_unstale":"2024-09-12T02:07:28.652236+0000","last_undegraded":"2024-09-12T02:07:28.652236+0000","last_fullsized":"2024-09-12T02:07:28.652236+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'102","last_scrub_stamp":"2024-09-12T02:07:28.652064+0000","last_deep_scrub":"266'102","last_deep_scrub_stamp":"2024-09-12T02:07:28.652064+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.652064+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:15.298710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":222,"num_read_kb":212,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"266'448","reported_seq":2083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.466851+0000","last_change":"2024-09-12T02:06:59.466851+0000","last_active":"2024-09-12T02:06:59.466851+0000","last_peered":"2024-09-12T02:06:59.466851+0000","last_clean":"2024-09-12T02:06:59.466851+0000","last_became_active":"2024-09-12T00:10:01.275794+0000","last_became_peered":"2024-09-12T00:10:01.275794+0000","last_unstale":"2024-09-12T02:06:59.466851+0000","last_undegraded":"2024-09-12T02:06:59.466851+0000","last_fullsized":"2024-09-12T02:06:59.466851+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'448","last_scrub_stamp":"2024-09-12T02:06:59.466676+0000","last_deep_scrub":"266'448","last_deep_scrub_stamp":"2024-09-12T02:06:59.466676+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.466676+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:34.269252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":509,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"266'358","reported_seq":1072,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.725876+0000","last_change":"2024-09-12T02:06:56.725876+0000","last_active":"2024-09-12T02:06:56.725876+0000","last_peered":"2024-09-12T02:06:56.725876+0000","last_clean":"2024-09-12T02:06:56.725876+0000","last_became_active":"2024-09-12T00:09:59.262793+0000","last_became_peered":"2024-09-12T00:09:59.262793+0000","last_unstale":"2024-09-12T02:06:56.725876+0000","last_undegraded":"2024-09-12T02:06:56.725876+0000","last_fullsized":"2024-09-12T02:06:56.725876+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'358","last_scrub_stamp":"2024-09-12T02:06:56.725610+0000","last_deep_scrub":"266'358","last_deep_scrub_stamp":"2024-09-12T02:06:56.725610+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.725610+0000","objects_scrubbed":11,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.475621+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1952053,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":559,"num_read_kb":23144,"num_write":1133,"num_write_kb":26459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":560,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.602572+0000","last_change":"2024-09-12T02:06:52.602572+0000","last_active":"2024-09-12T02:06:52.602572+0000","last_peered":"2024-09-12T02:06:52.602572+0000","last_clean":"2024-09-12T02:06:52.602572+0000","last_became_active":"2024-09-12T00:09:46.178541+0000","last_became_peered":"2024-09-12T00:09:46.178541+0000","last_unstale":"2024-09-12T02:06:52.602572+0000","last_undegraded":"2024-09-12T02:06:52.602572+0000","last_fullsized":"2024-09-12T02:06:52.602572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:52.602473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:52.602473+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.602473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:51.748160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00107328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.543069+0000","last_change":"2024-09-12T02:07:13.543069+0000","last_active":"2024-09-12T02:07:13.543069+0000","last_peered":"2024-09-12T02:07:13.543069+0000","last_clean":"2024-09-12T02:07:13.543069+0000","last_became_active":"2024-09-12T00:10:03.258209+0000","last_became_peered":"2024-09-12T00:10:03.258209+0000","last_unstale":"2024-09-12T02:07:13.543069+0000","last_undegraded":"2024-09-12T02:07:13.543069+0000","last_fullsized":"2024-09-12T02:07:13.543069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.542886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.542886+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.542886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:53.684122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"266'741","reported_seq":1498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.557356+0000","last_change":"2024-09-12T02:07:15.557356+0000","last_active":"2024-09-12T02:07:15.557356+0000","last_peered":"2024-09-12T02:07:15.557356+0000","last_clean":"2024-09-12T02:07:15.557356+0000","last_became_active":"2024-09-12T00:10:05.289058+0000","last_became_peered":"2024-09-12T00:10:05.289058+0000","last_unstale":"2024-09-12T02:07:15.557356+0000","last_undegraded":"2024-09-12T02:07:15.557356+0000","last_fullsized":"2024-09-12T02:07:15.557356+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'741","last_scrub_stamp":"2024-09-12T02:07:15.557266+0000","last_deep_scrub":"266'741","last_deep_scrub_stamp":"2024-09-12T02:07:15.557266+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.557266+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:10.918921+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92166,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1168,"num_read_kb":2300,"num_write":1050,"num_write_kb":783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.073632+0000","last_change":"2024-09-12T02:07:22.073632+0000","last_active":"2024-09-12T02:07:22.073632+0000","last_peered":"2024-09-12T02:07:22.073632+0000","last_clean":"2024-09-12T02:07:22.073632+0000","last_became_active":"2024-09-12T00:10:07.326146+0000","last_became_peered":"2024-09-12T00:10:07.326146+0000","last_unstale":"2024-09-12T02:07:22.073632+0000","last_undegraded":"2024-09-12T02:07:22.073632+0000","last_fullsized":"2024-09-12T02:07:22.073632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:22.073451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:22.073451+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.073451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:54.639155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"266'139","reported_seq":672,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.571361+0000","last_change":"2024-09-12T02:07:30.571361+0000","last_active":"2024-09-12T02:07:30.571361+0000","last_peered":"2024-09-12T02:07:30.571361+0000","last_clean":"2024-09-12T02:07:30.571361+0000","last_became_active":"2024-09-12T00:10:09.433444+0000","last_became_peered":"2024-09-12T00:10:09.433444+0000","last_unstale":"2024-09-12T02:07:30.571361+0000","last_undegraded":"2024-09-12T02:07:30.571361+0000","last_fullsized":"2024-09-12T02:07:30.571361+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'139","last_scrub_stamp":"2024-09-12T02:07:30.571141+0000","last_deep_scrub":"266'139","last_deep_scrub_stamp":"2024-09-12T02:07:30.571141+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.571141+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:47.539180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"266'404","reported_seq":1916,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.480294+0000","last_change":"2024-09-12T02:07:02.480294+0000","last_active":"2024-09-12T02:07:02.480294+0000","last_peered":"2024-09-12T02:07:02.480294+0000","last_clean":"2024-09-12T02:07:02.480294+0000","last_became_active":"2024-09-12T00:10:01.282373+0000","last_became_peered":"2024-09-12T00:10:01.282373+0000","last_unstale":"2024-09-12T02:07:02.480294+0000","last_undegraded":"2024-09-12T02:07:02.480294+0000","last_fullsized":"2024-09-12T02:07:02.480294+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'404","last_scrub_stamp":"2024-09-12T02:07:02.480109+0000","last_deep_scrub":"266'404","last_deep_scrub_stamp":"2024-09-12T02:07:02.480109+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.480109+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:10.168566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2068,"num_read_kb":1970,"num_write":460,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"266'417","reported_seq":1205,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.505109+0000","last_change":"2024-09-12T02:06:55.505109+0000","last_active":"2024-09-12T02:06:55.505109+0000","last_peered":"2024-09-12T02:06:55.505109+0000","last_clean":"2024-09-12T02:06:55.505109+0000","last_became_active":"2024-09-12T00:09:59.251235+0000","last_became_peered":"2024-09-12T00:09:59.251235+0000","last_unstale":"2024-09-12T02:06:55.505109+0000","last_undegraded":"2024-09-12T02:06:55.505109+0000","last_fullsized":"2024-09-12T02:06:55.505109+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'417","last_scrub_stamp":"2024-09-12T02:06:55.504820+0000","last_deep_scrub":"266'417","last_deep_scrub_stamp":"2024-09-12T02:06:55.504820+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.504820+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:06.749291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":866,"num_read_kb":78676,"num_write":1275,"num_write_kb":36022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.781724+0000","last_change":"2024-09-12T02:06:57.781724+0000","last_active":"2024-09-12T02:06:57.781724+0000","last_peered":"2024-09-12T02:06:57.781724+0000","last_clean":"2024-09-12T02:06:57.781724+0000","last_became_active":"2024-09-12T00:09:46.177603+0000","last_became_peered":"2024-09-12T00:09:46.177603+0000","last_unstale":"2024-09-12T02:06:57.781724+0000","last_undegraded":"2024-09-12T02:06:57.781724+0000","last_fullsized":"2024-09-12T02:06:57.781724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:57.781540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:57.781540+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.781540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:12.770956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":539,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.051317+0000","last_change":"2024-09-12T02:07:04.051317+0000","last_active":"2024-09-12T02:07:04.051317+0000","last_peered":"2024-09-12T02:07:04.051317+0000","last_clean":"2024-09-12T02:07:04.051317+0000","last_became_active":"2024-09-12T00:10:03.258944+0000","last_became_peered":"2024-09-12T00:10:03.258944+0000","last_unstale":"2024-09-12T02:07:04.051317+0000","last_undegraded":"2024-09-12T02:07:04.051317+0000","last_fullsized":"2024-09-12T02:07:04.051317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.051138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.051138+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.051138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:03.444640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"266'265","reported_seq":917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.403890+0000","last_change":"2024-09-12T02:07:11.403890+0000","last_active":"2024-09-12T02:07:11.403890+0000","last_peered":"2024-09-12T02:07:11.403890+0000","last_clean":"2024-09-12T02:07:11.403890+0000","last_became_active":"2024-09-12T00:10:05.366757+0000","last_became_peered":"2024-09-12T00:10:05.366757+0000","last_unstale":"2024-09-12T02:07:11.403890+0000","last_undegraded":"2024-09-12T02:07:11.403890+0000","last_fullsized":"2024-09-12T02:07:11.403890+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'265","last_scrub_stamp":"2024-09-12T02:07:11.403703+0000","last_deep_scrub":"266'265","last_deep_scrub_stamp":"2024-09-12T02:07:11.403703+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.403703+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:13.743145+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":341,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"266'828","reported_seq":5684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.571003+0000","last_change":"2024-09-12T02:07:23.571003+0000","last_active":"2024-09-12T02:07:23.571003+0000","last_peered":"2024-09-12T02:07:23.571003+0000","last_clean":"2024-09-12T02:07:23.571003+0000","last_became_active":"2024-09-12T00:10:07.313773+0000","last_became_peered":"2024-09-12T00:10:07.313773+0000","last_unstale":"2024-09-12T02:07:23.571003+0000","last_undegraded":"2024-09-12T02:07:23.571003+0000","last_fullsized":"2024-09-12T02:07:23.571003+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'828","last_scrub_stamp":"2024-09-12T02:07:23.570826+0000","last_deep_scrub":"266'828","last_deep_scrub_stamp":"2024-09-12T02:07:23.570826+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.570826+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:31.624121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"266'132","reported_seq":667,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.938654+0000","last_change":"2024-09-12T02:07:30.938654+0000","last_active":"2024-09-12T02:07:30.938654+0000","last_peered":"2024-09-12T02:07:30.938654+0000","last_clean":"2024-09-12T02:07:30.938654+0000","last_became_active":"2024-09-12T00:10:09.430396+0000","last_became_peered":"2024-09-12T00:10:09.430396+0000","last_unstale":"2024-09-12T02:07:30.938654+0000","last_undegraded":"2024-09-12T02:07:30.938654+0000","last_fullsized":"2024-09-12T02:07:30.938654+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'132","last_scrub_stamp":"2024-09-12T02:07:30.938468+0000","last_deep_scrub":"266'132","last_deep_scrub_stamp":"2024-09-12T02:07:30.938468+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.938468+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.269375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"266'483","reported_seq":2204,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.924708+0000","last_change":"2024-09-12T02:07:11.924708+0000","last_active":"2024-09-12T02:07:11.924708+0000","last_peered":"2024-09-12T02:07:11.924708+0000","last_clean":"2024-09-12T02:07:11.924708+0000","last_became_active":"2024-09-12T00:10:01.261139+0000","last_became_peered":"2024-09-12T00:10:01.261139+0000","last_unstale":"2024-09-12T02:07:11.924708+0000","last_undegraded":"2024-09-12T02:07:11.924708+0000","last_fullsized":"2024-09-12T02:07:11.924708+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'483","last_scrub_stamp":"2024-09-12T02:07:11.924498+0000","last_deep_scrub":"266'483","last_deep_scrub_stamp":"2024-09-12T02:07:11.924498+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.924498+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:56.731333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2740,"num_read_kb":2607,"num_write":578,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"266'402","reported_seq":1219,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.868030+0000","last_change":"2024-09-12T02:06:53.867885+0000","last_active":"2024-09-12T02:06:53.868030+0000","last_peered":"2024-09-12T02:06:53.868030+0000","last_clean":"2024-09-12T02:06:53.868030+0000","last_became_active":"2024-09-12T00:09:59.280008+0000","last_became_peered":"2024-09-12T00:09:59.280008+0000","last_unstale":"2024-09-12T02:06:53.868030+0000","last_undegraded":"2024-09-12T02:06:53.868030+0000","last_fullsized":"2024-09-12T02:06:53.868030+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'402","last_scrub_stamp":"2024-09-12T02:06:53.867624+0000","last_deep_scrub":"266'402","last_deep_scrub_stamp":"2024-09-12T02:06:53.867624+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.867624+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:13.357536+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137185,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":708,"num_read_kb":14008,"num_write":1294,"num_write_kb":38960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.553213+0000","last_change":"2024-09-12T02:06:53.553213+0000","last_active":"2024-09-12T02:06:53.553213+0000","last_peered":"2024-09-12T02:06:53.553213+0000","last_clean":"2024-09-12T02:06:53.553213+0000","last_became_active":"2024-09-12T00:09:46.162309+0000","last_became_peered":"2024-09-12T00:09:46.162309+0000","last_unstale":"2024-09-12T02:06:53.553213+0000","last_undegraded":"2024-09-12T02:06:53.553213+0000","last_fullsized":"2024-09-12T02:06:53.553213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:53.553124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:53.553124+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.553124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:47.235429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010860449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":538,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.045962+0000","last_change":"2024-09-12T02:07:14.045962+0000","last_active":"2024-09-12T02:07:14.045962+0000","last_peered":"2024-09-12T02:07:14.045962+0000","last_clean":"2024-09-12T02:07:14.045962+0000","last_became_active":"2024-09-12T00:10:03.256290+0000","last_became_peered":"2024-09-12T00:10:03.256290+0000","last_unstale":"2024-09-12T02:07:14.045962+0000","last_undegraded":"2024-09-12T02:07:14.045962+0000","last_fullsized":"2024-09-12T02:07:14.045962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:14.045784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:14.045784+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.045784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:25.603999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"266'183","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.989414+0000","last_change":"2024-09-12T02:07:17.989414+0000","last_active":"2024-09-12T02:07:17.989414+0000","last_peered":"2024-09-12T02:07:17.989414+0000","last_clean":"2024-09-12T02:07:17.989414+0000","last_became_active":"2024-09-12T00:10:05.293955+0000","last_became_peered":"2024-09-12T00:10:05.293955+0000","last_unstale":"2024-09-12T02:07:17.989414+0000","last_undegraded":"2024-09-12T02:07:17.989414+0000","last_fullsized":"2024-09-12T02:07:17.989414+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'183","last_scrub_stamp":"2024-09-12T02:07:17.989219+0000","last_deep_scrub":"266'183","last_deep_scrub_stamp":"2024-09-12T02:07:17.989219+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.989219+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:50.640511+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":227,"num_write":154,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"266'828","reported_seq":5167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:37.002228+0000","last_change":"2024-09-12T02:07:37.002228+0000","last_active":"2024-09-12T02:07:37.002228+0000","last_peered":"2024-09-12T02:07:37.002228+0000","last_clean":"2024-09-12T02:07:37.002228+0000","last_became_active":"2024-09-12T00:10:07.333642+0000","last_became_peered":"2024-09-12T00:10:07.333642+0000","last_unstale":"2024-09-12T02:07:37.002228+0000","last_undegraded":"2024-09-12T02:07:37.002228+0000","last_fullsized":"2024-09-12T02:07:37.002228+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'828","last_scrub_stamp":"2024-09-12T02:07:37.002001+0000","last_deep_scrub":"266'828","last_deep_scrub_stamp":"2024-09-12T02:07:37.002001+0000","last_clean_scrub_stamp":"2024-09-12T02:07:37.002001+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:31.781328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"266'304","reported_seq":869,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.531909+0000","last_change":"2024-09-12T02:07:28.531909+0000","last_active":"2024-09-12T02:07:28.531909+0000","last_peered":"2024-09-12T02:07:28.531909+0000","last_clean":"2024-09-12T02:07:28.531909+0000","last_became_active":"2024-09-12T00:10:09.358708+0000","last_became_peered":"2024-09-12T00:10:09.358708+0000","last_unstale":"2024-09-12T02:07:28.531909+0000","last_undegraded":"2024-09-12T02:07:28.531909+0000","last_fullsized":"2024-09-12T02:07:28.531909+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'304","last_scrub_stamp":"2024-09-12T02:07:28.531729+0000","last_deep_scrub":"266'304","last_deep_scrub_stamp":"2024-09-12T02:07:28.531729+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.531729+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:25.701926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":399,"num_read_kb":387,"num_write":681,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"266'1118","reported_seq":2658,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.998245+0000","last_change":"2024-09-12T02:06:56.998245+0000","last_active":"2024-09-12T02:06:56.998245+0000","last_peered":"2024-09-12T02:06:56.998245+0000","last_clean":"2024-09-12T02:06:56.998245+0000","last_became_active":"2024-09-12T00:10:01.274310+0000","last_became_peered":"2024-09-12T00:10:01.274310+0000","last_unstale":"2024-09-12T02:06:56.998245+0000","last_undegraded":"2024-09-12T02:06:56.998245+0000","last_fullsized":"2024-09-12T02:06:56.998245+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1118","last_scrub_stamp":"2024-09-12T02:06:56.998048+0000","last_deep_scrub":"266'1118","last_deep_scrub_stamp":"2024-09-12T02:06:56.998048+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.998048+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":1100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:33.714167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5066,"num_read_kb":4471,"num_write":1537,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"266'372","reported_seq":1077,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.492593+0000","last_change":"2024-09-12T02:06:52.492480+0000","last_active":"2024-09-12T02:06:52.492593+0000","last_peered":"2024-09-12T02:06:52.492593+0000","last_clean":"2024-09-12T02:06:52.492593+0000","last_became_active":"2024-09-12T00:09:59.291630+0000","last_became_peered":"2024-09-12T00:09:59.291630+0000","last_unstale":"2024-09-12T02:06:52.492593+0000","last_undegraded":"2024-09-12T02:06:52.492593+0000","last_fullsized":"2024-09-12T02:06:52.492593+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'372","last_scrub_stamp":"2024-09-12T02:06:52.492329+0000","last_deep_scrub":"266'372","last_deep_scrub_stamp":"2024-09-12T02:06:52.492329+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.492329+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.589627+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306724,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":13946,"num_write":1174,"num_write_kb":43869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":561,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.202278+0000","last_change":"2024-09-12T02:06:55.202278+0000","last_active":"2024-09-12T02:06:55.202278+0000","last_peered":"2024-09-12T02:06:55.202278+0000","last_clean":"2024-09-12T02:06:55.202278+0000","last_became_active":"2024-09-12T00:09:46.163643+0000","last_became_peered":"2024-09-12T00:09:46.163643+0000","last_unstale":"2024-09-12T02:06:55.202278+0000","last_undegraded":"2024-09-12T02:06:55.202278+0000","last_fullsized":"2024-09-12T02:06:55.202278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:55.202103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:55.202103+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.202103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:46.554637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00095304600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":540,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.995648+0000","last_change":"2024-09-12T02:07:19.995648+0000","last_active":"2024-09-12T02:07:19.995648+0000","last_peered":"2024-09-12T02:07:19.995648+0000","last_clean":"2024-09-12T02:07:19.995648+0000","last_became_active":"2024-09-12T00:10:03.265087+0000","last_became_peered":"2024-09-12T00:10:03.265087+0000","last_unstale":"2024-09-12T02:07:19.995648+0000","last_undegraded":"2024-09-12T02:07:19.995648+0000","last_fullsized":"2024-09-12T02:07:19.995648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:19.995464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:19.995464+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.995464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:01.752957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"266'836","reported_seq":1634,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.867397+0000","last_change":"2024-09-12T02:07:15.867397+0000","last_active":"2024-09-12T02:07:15.867397+0000","last_peered":"2024-09-12T02:07:15.867397+0000","last_clean":"2024-09-12T02:07:15.867397+0000","last_became_active":"2024-09-12T00:10:05.361458+0000","last_became_peered":"2024-09-12T00:10:05.361458+0000","last_unstale":"2024-09-12T02:07:15.867397+0000","last_undegraded":"2024-09-12T02:07:15.867397+0000","last_fullsized":"2024-09-12T02:07:15.867397+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'836","last_scrub_stamp":"2024-09-12T02:07:15.867197+0000","last_deep_scrub":"266'836","last_deep_scrub_stamp":"2024-09-12T02:07:15.867197+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.867197+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.678521+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1463,"num_read_kb":3339,"num_write":1180,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.020129+0000","last_change":"2024-09-12T02:07:21.020129+0000","last_active":"2024-09-12T02:07:21.020129+0000","last_peered":"2024-09-12T02:07:21.020129+0000","last_clean":"2024-09-12T02:07:21.020129+0000","last_became_active":"2024-09-12T00:10:07.333984+0000","last_became_peered":"2024-09-12T00:10:07.333984+0000","last_unstale":"2024-09-12T02:07:21.020129+0000","last_undegraded":"2024-09-12T02:07:21.020129+0000","last_fullsized":"2024-09-12T02:07:21.020129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:21.019946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:21.019946+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.019946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:59.638445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"266'126","reported_seq":657,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.615767+0000","last_change":"2024-09-12T02:07:27.615767+0000","last_active":"2024-09-12T02:07:27.615767+0000","last_peered":"2024-09-12T02:07:27.615767+0000","last_clean":"2024-09-12T02:07:27.615767+0000","last_became_active":"2024-09-12T00:10:09.368289+0000","last_became_peered":"2024-09-12T00:10:09.368289+0000","last_unstale":"2024-09-12T02:07:27.615767+0000","last_undegraded":"2024-09-12T02:07:27.615767+0000","last_fullsized":"2024-09-12T02:07:27.615767+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'126","last_scrub_stamp":"2024-09-12T02:07:27.615559+0000","last_deep_scrub":"266'126","last_deep_scrub_stamp":"2024-09-12T02:07:27.615559+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.615559+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:04.535479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"266'158","reported_seq":754,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.561193+0000","last_change":"2024-09-12T02:07:31.561193+0000","last_active":"2024-09-12T02:07:31.561193+0000","last_peered":"2024-09-12T02:07:31.561193+0000","last_clean":"2024-09-12T02:07:31.561193+0000","last_became_active":"2024-09-12T00:10:09.372467+0000","last_became_peered":"2024-09-12T00:10:09.372467+0000","last_unstale":"2024-09-12T02:07:31.561193+0000","last_undegraded":"2024-09-12T02:07:31.561193+0000","last_fullsized":"2024-09-12T02:07:31.561193+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'158","last_scrub_stamp":"2024-09-12T02:07:31.561001+0000","last_deep_scrub":"266'158","last_deep_scrub_stamp":"2024-09-12T02:07:31.561001+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.561001+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:34.171025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":220,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"266'889","reported_seq":2706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.066271+0000","last_change":"2024-09-12T02:07:03.066271+0000","last_active":"2024-09-12T02:07:03.066271+0000","last_peered":"2024-09-12T02:07:03.066271+0000","last_clean":"2024-09-12T02:07:03.066271+0000","last_became_active":"2024-09-12T00:10:01.266479+0000","last_became_peered":"2024-09-12T00:10:01.266479+0000","last_unstale":"2024-09-12T02:07:03.066271+0000","last_undegraded":"2024-09-12T02:07:03.066271+0000","last_fullsized":"2024-09-12T02:07:03.066271+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'889","last_scrub_stamp":"2024-09-12T02:07:03.066081+0000","last_deep_scrub":"266'889","last_deep_scrub_stamp":"2024-09-12T02:07:03.066081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.066081+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:36.910267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4439,"num_read_kb":4016,"num_write":1172,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1578,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"266'328","reported_seq":1077,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.041051+0000","last_change":"2024-09-12T02:06:56.040868+0000","last_active":"2024-09-12T02:06:56.041051+0000","last_peered":"2024-09-12T02:06:56.041051+0000","last_clean":"2024-09-12T02:06:56.041051+0000","last_became_active":"2024-09-12T00:09:59.309979+0000","last_became_peered":"2024-09-12T00:09:59.309979+0000","last_unstale":"2024-09-12T02:06:56.041051+0000","last_undegraded":"2024-09-12T02:06:56.041051+0000","last_fullsized":"2024-09-12T02:06:56.041051+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'328","last_scrub_stamp":"2024-09-12T02:06:56.040661+0000","last_deep_scrub":"266'328","last_deep_scrub_stamp":"2024-09-12T02:06:56.040661+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.040661+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:55.878202+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":761,"num_read_kb":10875,"num_write":997,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.359965+0000","last_change":"2024-09-12T02:07:07.359965+0000","last_active":"2024-09-12T02:07:07.359965+0000","last_peered":"2024-09-12T02:07:07.359965+0000","last_clean":"2024-09-12T02:07:07.359965+0000","last_became_active":"2024-09-12T00:10:03.272547+0000","last_became_peered":"2024-09-12T00:10:03.272547+0000","last_unstale":"2024-09-12T02:07:07.359965+0000","last_undegraded":"2024-09-12T02:07:07.359965+0000","last_fullsized":"2024-09-12T02:07:07.359965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.359774+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.359774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:58.266703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"266'337","reported_seq":980,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.984776+0000","last_change":"2024-09-12T02:07:17.984776+0000","last_active":"2024-09-12T02:07:17.984776+0000","last_peered":"2024-09-12T02:07:17.984776+0000","last_clean":"2024-09-12T02:07:17.984776+0000","last_became_active":"2024-09-12T00:10:05.292446+0000","last_became_peered":"2024-09-12T00:10:05.292446+0000","last_unstale":"2024-09-12T02:07:17.984776+0000","last_undegraded":"2024-09-12T02:07:17.984776+0000","last_fullsized":"2024-09-12T02:07:17.984776+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'337","last_scrub_stamp":"2024-09-12T02:07:17.984572+0000","last_deep_scrub":"266'337","last_deep_scrub_stamp":"2024-09-12T02:07:17.984572+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.984572+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:22.772151+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16245,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1009,"num_write":400,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.990819+0000","last_change":"2024-09-12T02:07:25.990819+0000","last_active":"2024-09-12T02:07:25.990819+0000","last_peered":"2024-09-12T02:07:25.990819+0000","last_clean":"2024-09-12T02:07:25.990819+0000","last_became_active":"2024-09-12T00:10:07.335659+0000","last_became_peered":"2024-09-12T00:10:07.335659+0000","last_unstale":"2024-09-12T02:07:25.990819+0000","last_undegraded":"2024-09-12T02:07:25.990819+0000","last_fullsized":"2024-09-12T02:07:25.990819+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.990613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.990613+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.990613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:39.556676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"266'117","reported_seq":651,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.985674+0000","last_change":"2024-09-12T02:07:31.985674+0000","last_active":"2024-09-12T02:07:31.985674+0000","last_peered":"2024-09-12T02:07:31.985674+0000","last_clean":"2024-09-12T02:07:31.985674+0000","last_became_active":"2024-09-12T00:10:09.356043+0000","last_became_peered":"2024-09-12T00:10:09.356043+0000","last_unstale":"2024-09-12T02:07:31.985674+0000","last_undegraded":"2024-09-12T02:07:31.985674+0000","last_fullsized":"2024-09-12T02:07:31.985674+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'117","last_scrub_stamp":"2024-09-12T02:07:31.985481+0000","last_deep_scrub":"266'117","last_deep_scrub_stamp":"2024-09-12T02:07:31.985481+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.985481+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:17.328350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":102,"num_write":274,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"266'484","reported_seq":2046,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.337781+0000","last_change":"2024-09-12T02:07:04.337781+0000","last_active":"2024-09-12T02:07:04.337781+0000","last_peered":"2024-09-12T02:07:04.337781+0000","last_clean":"2024-09-12T02:07:04.337781+0000","last_became_active":"2024-09-12T00:10:01.264977+0000","last_became_peered":"2024-09-12T00:10:01.264977+0000","last_unstale":"2024-09-12T02:07:04.337781+0000","last_undegraded":"2024-09-12T02:07:04.337781+0000","last_fullsized":"2024-09-12T02:07:04.337781+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'484","last_scrub_stamp":"2024-09-12T02:07:04.337573+0000","last_deep_scrub":"266'484","last_deep_scrub_stamp":"2024-09-12T02:07:04.337573+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.337573+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.524170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2306,"num_write":570,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"266'380","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.767936+0000","last_change":"2024-09-12T02:07:01.767936+0000","last_active":"2024-09-12T02:07:01.767936+0000","last_peered":"2024-09-12T02:07:01.767936+0000","last_clean":"2024-09-12T02:07:01.767936+0000","last_became_active":"2024-09-12T00:09:59.300181+0000","last_became_peered":"2024-09-12T00:09:59.300181+0000","last_unstale":"2024-09-12T02:07:01.767936+0000","last_undegraded":"2024-09-12T02:07:01.767936+0000","last_fullsized":"2024-09-12T02:07:01.767936+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T02:07:01.767612+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T02:07:01.767612+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.767612+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:31.745878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":10768,"num_write":1216,"num_write_kb":35109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.965571+0000","last_change":"2024-09-12T02:07:15.965571+0000","last_active":"2024-09-12T02:07:15.965571+0000","last_peered":"2024-09-12T02:07:15.965571+0000","last_clean":"2024-09-12T02:07:15.965571+0000","last_became_active":"2024-09-12T00:10:03.256053+0000","last_became_peered":"2024-09-12T00:10:03.256053+0000","last_unstale":"2024-09-12T02:07:15.965571+0000","last_undegraded":"2024-09-12T02:07:15.965571+0000","last_fullsized":"2024-09-12T02:07:15.965571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.965361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.965361+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.965361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:34.211984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"266'77","reported_seq":626,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.583569+0000","last_change":"2024-09-12T02:07:14.583569+0000","last_active":"2024-09-12T02:07:14.583569+0000","last_peered":"2024-09-12T02:07:14.583569+0000","last_clean":"2024-09-12T02:07:14.583569+0000","last_became_active":"2024-09-12T00:10:05.288688+0000","last_became_peered":"2024-09-12T00:10:05.288688+0000","last_unstale":"2024-09-12T02:07:14.583569+0000","last_undegraded":"2024-09-12T02:07:14.583569+0000","last_fullsized":"2024-09-12T02:07:14.583569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'77","last_scrub_stamp":"2024-09-12T02:07:14.583337+0000","last_deep_scrub":"266'77","last_deep_scrub_stamp":"2024-09-12T02:07:14.583337+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.583337+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:04.333383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.832765+0000","last_change":"2024-09-12T02:07:21.832765+0000","last_active":"2024-09-12T02:07:21.832765+0000","last_peered":"2024-09-12T02:07:21.832765+0000","last_clean":"2024-09-12T02:07:21.832765+0000","last_became_active":"2024-09-12T00:10:07.320729+0000","last_became_peered":"2024-09-12T00:10:07.320729+0000","last_unstale":"2024-09-12T02:07:21.832765+0000","last_undegraded":"2024-09-12T02:07:21.832765+0000","last_fullsized":"2024-09-12T02:07:21.832765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:21.832583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:21.832583+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.832583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:12.758498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"266'205","reported_seq":752,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.523688+0000","last_change":"2024-09-12T02:07:29.523524+0000","last_active":"2024-09-12T02:07:29.523688+0000","last_peered":"2024-09-12T02:07:29.523688+0000","last_clean":"2024-09-12T02:07:29.523688+0000","last_became_active":"2024-09-12T00:10:09.362096+0000","last_became_peered":"2024-09-12T00:10:09.362096+0000","last_unstale":"2024-09-12T02:07:29.523688+0000","last_undegraded":"2024-09-12T02:07:29.523688+0000","last_fullsized":"2024-09-12T02:07:29.523688+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T02:07:29.523340+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T02:07:29.523340+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.523340+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:29.658240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":296,"num_read_kb":291,"num_write":467,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"266'433","reported_seq":2154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.964744+0000","last_change":"2024-09-12T02:07:04.964744+0000","last_active":"2024-09-12T02:07:04.964744+0000","last_peered":"2024-09-12T02:07:04.964744+0000","last_clean":"2024-09-12T02:07:04.964744+0000","last_became_active":"2024-09-12T00:10:01.261030+0000","last_became_peered":"2024-09-12T00:10:01.261030+0000","last_unstale":"2024-09-12T02:07:04.964744+0000","last_undegraded":"2024-09-12T02:07:04.964744+0000","last_fullsized":"2024-09-12T02:07:04.964744+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'433","last_scrub_stamp":"2024-09-12T02:07:04.964572+0000","last_deep_scrub":"266'433","last_deep_scrub_stamp":"2024-09-12T02:07:04.964572+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.964572+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:57.148348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2550,"num_read_kb":2440,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2736,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"266'384","reported_seq":1086,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.676078+0000","last_change":"2024-09-12T02:06:57.676078+0000","last_active":"2024-09-12T02:06:57.676078+0000","last_peered":"2024-09-12T02:06:57.676078+0000","last_clean":"2024-09-12T02:06:57.676078+0000","last_became_active":"2024-09-12T00:09:59.288100+0000","last_became_peered":"2024-09-12T00:09:59.288100+0000","last_unstale":"2024-09-12T02:06:57.676078+0000","last_undegraded":"2024-09-12T02:06:57.676078+0000","last_fullsized":"2024-09-12T02:06:57.676078+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'384","last_scrub_stamp":"2024-09-12T02:06:57.675785+0000","last_deep_scrub":"266'384","last_deep_scrub_stamp":"2024-09-12T02:06:57.675785+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.675785+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:31.989566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":599,"num_read_kb":15869,"num_write":1177,"num_write_kb":23659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.856047+0000","last_change":"2024-09-12T02:07:13.856047+0000","last_active":"2024-09-12T02:07:13.856047+0000","last_peered":"2024-09-12T02:07:13.856047+0000","last_clean":"2024-09-12T02:07:13.856047+0000","last_became_active":"2024-09-12T00:10:03.255669+0000","last_became_peered":"2024-09-12T00:10:03.255669+0000","last_unstale":"2024-09-12T02:07:13.856047+0000","last_undegraded":"2024-09-12T02:07:13.856047+0000","last_fullsized":"2024-09-12T02:07:13.856047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.855842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.855842+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.855842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:48.988845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"266'350","reported_seq":1004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.991907+0000","last_change":"2024-09-12T02:07:27.991907+0000","last_active":"2024-09-12T02:07:27.991907+0000","last_peered":"2024-09-12T02:07:27.991907+0000","last_clean":"2024-09-12T02:07:27.991907+0000","last_became_active":"2024-09-12T00:10:05.299730+0000","last_became_peered":"2024-09-12T00:10:05.299730+0000","last_unstale":"2024-09-12T02:07:27.991907+0000","last_undegraded":"2024-09-12T02:07:27.991907+0000","last_fullsized":"2024-09-12T02:07:27.991907+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'350","last_scrub_stamp":"2024-09-12T02:07:27.991701+0000","last_deep_scrub":"266'350","last_deep_scrub_stamp":"2024-09-12T02:07:27.991701+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.991701+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:15.725731+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58900,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1109,"num_write":428,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.084311+0000","last_change":"2024-09-12T02:07:13.084311+0000","last_active":"2024-09-12T02:07:13.084311+0000","last_peered":"2024-09-12T02:07:13.084311+0000","last_clean":"2024-09-12T02:07:13.084311+0000","last_became_active":"2024-09-12T00:10:07.329741+0000","last_became_peered":"2024-09-12T00:10:07.329741+0000","last_unstale":"2024-09-12T02:07:13.084311+0000","last_undegraded":"2024-09-12T02:07:13.084311+0000","last_fullsized":"2024-09-12T02:07:13.084311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.084128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.084128+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.084128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:04.189686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"266'91","reported_seq":632,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.671389+0000","last_change":"2024-09-12T02:07:29.671249+0000","last_active":"2024-09-12T02:07:29.671389+0000","last_peered":"2024-09-12T02:07:29.671389+0000","last_clean":"2024-09-12T02:07:29.671389+0000","last_became_active":"2024-09-12T00:10:09.371755+0000","last_became_peered":"2024-09-12T00:10:09.371755+0000","last_unstale":"2024-09-12T02:07:29.671389+0000","last_undegraded":"2024-09-12T02:07:29.671389+0000","last_fullsized":"2024-09-12T02:07:29.671389+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'91","last_scrub_stamp":"2024-09-12T02:07:29.671047+0000","last_deep_scrub":"266'91","last_deep_scrub_stamp":"2024-09-12T02:07:29.671047+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.671047+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:47.726332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":213,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"266'805","reported_seq":2443,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.987469+0000","last_change":"2024-09-12T02:07:14.987469+0000","last_active":"2024-09-12T02:07:14.987469+0000","last_peered":"2024-09-12T02:07:14.987469+0000","last_clean":"2024-09-12T02:07:14.987469+0000","last_became_active":"2024-09-12T00:10:01.258814+0000","last_became_peered":"2024-09-12T00:10:01.258814+0000","last_unstale":"2024-09-12T02:07:14.987469+0000","last_undegraded":"2024-09-12T02:07:14.987469+0000","last_fullsized":"2024-09-12T02:07:14.987469+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'805","last_scrub_stamp":"2024-09-12T02:07:14.987293+0000","last_deep_scrub":"266'805","last_deep_scrub_stamp":"2024-09-12T02:07:14.987293+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.987293+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:04.316537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3906,"num_read_kb":3532,"num_write":1046,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"266'415","reported_seq":1087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.547391+0000","last_change":"2024-09-12T02:06:56.547391+0000","last_active":"2024-09-12T02:06:56.547391+0000","last_peered":"2024-09-12T02:06:56.547391+0000","last_clean":"2024-09-12T02:06:56.547391+0000","last_became_active":"2024-09-12T00:09:59.262775+0000","last_became_peered":"2024-09-12T00:09:59.262775+0000","last_unstale":"2024-09-12T02:06:56.547391+0000","last_undegraded":"2024-09-12T02:06:56.547391+0000","last_fullsized":"2024-09-12T02:06:56.547391+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'415","last_scrub_stamp":"2024-09-12T02:06:56.547179+0000","last_deep_scrub":"266'415","last_deep_scrub_stamp":"2024-09-12T02:06:56.547179+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.547179+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.608245+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":557,"num_read_kb":527,"num_write":1329,"num_write_kb":18885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.038234+0000","last_change":"2024-09-12T02:07:08.038234+0000","last_active":"2024-09-12T02:07:08.038234+0000","last_peered":"2024-09-12T02:07:08.038234+0000","last_clean":"2024-09-12T02:07:08.038234+0000","last_became_active":"2024-09-12T00:10:03.257953+0000","last_became_peered":"2024-09-12T00:10:03.257953+0000","last_unstale":"2024-09-12T02:07:08.038234+0000","last_undegraded":"2024-09-12T02:07:08.038234+0000","last_fullsized":"2024-09-12T02:07:08.038234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:08.038057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:08.038057+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.038057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:22.867531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"266'331","reported_seq":953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.855409+0000","last_change":"2024-09-12T02:07:18.855409+0000","last_active":"2024-09-12T02:07:18.855409+0000","last_peered":"2024-09-12T02:07:18.855409+0000","last_clean":"2024-09-12T02:07:18.855409+0000","last_became_active":"2024-09-12T00:10:05.285485+0000","last_became_peered":"2024-09-12T00:10:05.285485+0000","last_unstale":"2024-09-12T02:07:18.855409+0000","last_undegraded":"2024-09-12T02:07:18.855409+0000","last_fullsized":"2024-09-12T02:07:18.855409+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'331","last_scrub_stamp":"2024-09-12T02:07:18.855228+0000","last_deep_scrub":"266'331","last_deep_scrub_stamp":"2024-09-12T02:07:18.855228+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.855228+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:33.365002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":1250,"num_write":446,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.616188+0000","last_change":"2024-09-12T02:07:23.616188+0000","last_active":"2024-09-12T02:07:23.616188+0000","last_peered":"2024-09-12T02:07:23.616188+0000","last_clean":"2024-09-12T02:07:23.616188+0000","last_became_active":"2024-09-12T00:10:07.325482+0000","last_became_peered":"2024-09-12T00:10:07.325482+0000","last_unstale":"2024-09-12T02:07:23.616188+0000","last_undegraded":"2024-09-12T02:07:23.616188+0000","last_fullsized":"2024-09-12T02:07:23.616188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:23.616016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:23.616016+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.616016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:14.088072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"266'842","reported_seq":2411,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.057496+0000","last_change":"2024-09-12T02:07:06.057496+0000","last_active":"2024-09-12T02:07:06.057496+0000","last_peered":"2024-09-12T02:07:06.057496+0000","last_clean":"2024-09-12T02:07:06.057496+0000","last_became_active":"2024-09-12T00:10:01.276906+0000","last_became_peered":"2024-09-12T00:10:01.276906+0000","last_unstale":"2024-09-12T02:07:06.057496+0000","last_undegraded":"2024-09-12T02:07:06.057496+0000","last_fullsized":"2024-09-12T02:07:06.057496+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'842","last_scrub_stamp":"2024-09-12T02:07:06.057301+0000","last_deep_scrub":"266'842","last_deep_scrub_stamp":"2024-09-12T02:07:06.057301+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.057301+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:30.646553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3919,"num_read_kb":3507,"num_write":1092,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"266'321","reported_seq":1003,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.854948+0000","last_change":"2024-09-12T02:06:58.854948+0000","last_active":"2024-09-12T02:06:58.854948+0000","last_peered":"2024-09-12T02:06:58.854948+0000","last_clean":"2024-09-12T02:06:58.854948+0000","last_became_active":"2024-09-12T00:09:59.248681+0000","last_became_peered":"2024-09-12T00:09:59.248681+0000","last_unstale":"2024-09-12T02:06:58.854948+0000","last_undegraded":"2024-09-12T02:06:58.854948+0000","last_fullsized":"2024-09-12T02:06:58.854948+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'321","last_scrub_stamp":"2024-09-12T02:06:58.854706+0000","last_deep_scrub":"266'321","last_deep_scrub_stamp":"2024-09-12T02:06:58.854706+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.854706+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:53.988034+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1398999,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":23744,"num_write":1111,"num_write_kb":29955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":537,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.562161+0000","last_change":"2024-09-12T02:07:12.562161+0000","last_active":"2024-09-12T02:07:12.562161+0000","last_peered":"2024-09-12T02:07:12.562161+0000","last_clean":"2024-09-12T02:07:12.562161+0000","last_became_active":"2024-09-12T00:10:03.260387+0000","last_became_peered":"2024-09-12T00:10:03.260387+0000","last_unstale":"2024-09-12T02:07:12.562161+0000","last_undegraded":"2024-09-12T02:07:12.562161+0000","last_fullsized":"2024-09-12T02:07:12.562161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.561935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.561935+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.561935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:15.815479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"266'548","reported_seq":1235,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.430143+0000","last_change":"2024-09-12T02:07:15.430071+0000","last_active":"2024-09-12T02:07:15.430143+0000","last_peered":"2024-09-12T02:07:15.430143+0000","last_clean":"2024-09-12T02:07:15.430143+0000","last_became_active":"2024-09-12T00:10:05.300613+0000","last_became_peered":"2024-09-12T00:10:05.300613+0000","last_unstale":"2024-09-12T02:07:15.430143+0000","last_undegraded":"2024-09-12T02:07:15.430143+0000","last_fullsized":"2024-09-12T02:07:15.430143+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'548","last_scrub_stamp":"2024-09-12T02:07:15.429949+0000","last_deep_scrub":"266'548","last_deep_scrub_stamp":"2024-09-12T02:07:15.429949+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.429949+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:50.425830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102448,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":959,"num_read_kb":2206,"num_write":818,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.588319+0000","last_change":"2024-09-12T02:07:24.588181+0000","last_active":"2024-09-12T02:07:24.588319+0000","last_peered":"2024-09-12T02:07:24.588319+0000","last_clean":"2024-09-12T02:07:24.588319+0000","last_became_active":"2024-09-12T00:10:07.342700+0000","last_became_peered":"2024-09-12T00:10:07.342700+0000","last_unstale":"2024-09-12T02:07:24.588319+0000","last_undegraded":"2024-09-12T02:07:24.588319+0000","last_fullsized":"2024-09-12T02:07:24.588319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.588000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.588000+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.588000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:15.029488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"266'160","reported_seq":699,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:43.144345+0000","last_change":"2024-09-12T02:07:43.144345+0000","last_active":"2024-09-12T02:07:43.144345+0000","last_peered":"2024-09-12T02:07:43.144345+0000","last_clean":"2024-09-12T02:07:43.144345+0000","last_became_active":"2024-09-12T00:10:09.435513+0000","last_became_peered":"2024-09-12T00:10:09.435513+0000","last_unstale":"2024-09-12T02:07:43.144345+0000","last_undegraded":"2024-09-12T02:07:43.144345+0000","last_fullsized":"2024-09-12T02:07:43.144345+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'160","last_scrub_stamp":"2024-09-12T02:07:43.144149+0000","last_deep_scrub":"266'160","last_deep_scrub_stamp":"2024-09-12T02:07:43.144149+0000","last_clean_scrub_stamp":"2024-09-12T02:07:43.144149+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:19.093423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":193,"num_write":343,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"266'812","reported_seq":2378,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.541839+0000","last_change":"2024-09-12T02:07:06.541839+0000","last_active":"2024-09-12T02:07:06.541839+0000","last_peered":"2024-09-12T02:07:06.541839+0000","last_clean":"2024-09-12T02:07:06.541839+0000","last_became_active":"2024-09-12T00:10:01.260115+0000","last_became_peered":"2024-09-12T00:10:01.260115+0000","last_unstale":"2024-09-12T02:07:06.541839+0000","last_undegraded":"2024-09-12T02:07:06.541839+0000","last_fullsized":"2024-09-12T02:07:06.541839+0000","mapping_epoch":27,"log_start":"266'801","ondisk_log_start":"266'801","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'812","last_scrub_stamp":"2024-09-12T02:07:06.541653+0000","last_deep_scrub":"266'812","last_deep_scrub_stamp":"2024-09-12T02:07:06.541653+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.541653+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":801,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:47.466063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3786,"num_read_kb":3403,"num_write":1061,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"266'381","reported_seq":1164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.433070+0000","last_change":"2024-09-12T02:06:57.433070+0000","last_active":"2024-09-12T02:06:57.433070+0000","last_peered":"2024-09-12T02:06:57.433070+0000","last_clean":"2024-09-12T02:06:57.433070+0000","last_became_active":"2024-09-12T00:09:59.285792+0000","last_became_peered":"2024-09-12T00:09:59.285792+0000","last_unstale":"2024-09-12T02:06:57.433070+0000","last_undegraded":"2024-09-12T02:06:57.433070+0000","last_fullsized":"2024-09-12T02:06:57.433070+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:06:57.432824+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:06:57.432824+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.432824+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:51.237303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":739,"num_read_kb":25287,"num_write":1212,"num_write_kb":29345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":539,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.050934+0000","last_change":"2024-09-12T02:07:09.050934+0000","last_active":"2024-09-12T02:07:09.050934+0000","last_peered":"2024-09-12T02:07:09.050934+0000","last_clean":"2024-09-12T02:07:09.050934+0000","last_became_active":"2024-09-12T00:10:03.257760+0000","last_became_peered":"2024-09-12T00:10:03.257760+0000","last_unstale":"2024-09-12T02:07:09.050934+0000","last_undegraded":"2024-09-12T02:07:09.050934+0000","last_fullsized":"2024-09-12T02:07:09.050934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.050754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.050754+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.050754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"266'390","reported_seq":1045,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.818937+0000","last_change":"2024-09-12T02:07:20.818678+0000","last_active":"2024-09-12T02:07:20.818937+0000","last_peered":"2024-09-12T02:07:20.818937+0000","last_clean":"2024-09-12T02:07:20.818937+0000","last_became_active":"2024-09-12T00:10:05.292902+0000","last_became_peered":"2024-09-12T00:10:05.292902+0000","last_unstale":"2024-09-12T02:07:20.818937+0000","last_undegraded":"2024-09-12T02:07:20.818937+0000","last_fullsized":"2024-09-12T02:07:20.818937+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:07:20.818372+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:07:20.818372+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.818372+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:37.386926+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":1193,"num_write":510,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.506561+0000","last_change":"2024-09-12T02:07:18.506402+0000","last_active":"2024-09-12T02:07:18.506561+0000","last_peered":"2024-09-12T02:07:18.506561+0000","last_clean":"2024-09-12T02:07:18.506561+0000","last_became_active":"2024-09-12T00:10:07.321400+0000","last_became_peered":"2024-09-12T00:10:07.321400+0000","last_unstale":"2024-09-12T02:07:18.506561+0000","last_undegraded":"2024-09-12T02:07:18.506561+0000","last_fullsized":"2024-09-12T02:07:18.506561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:18.506178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:18.506178+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.506178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:58.545356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"266'192","reported_seq":755,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.089900+0000","last_change":"2024-09-12T02:07:17.089900+0000","last_active":"2024-09-12T02:07:17.089900+0000","last_peered":"2024-09-12T02:07:17.089900+0000","last_clean":"2024-09-12T02:07:17.089900+0000","last_became_active":"2024-09-12T00:10:09.355548+0000","last_became_peered":"2024-09-12T00:10:09.355548+0000","last_unstale":"2024-09-12T02:07:17.089900+0000","last_undegraded":"2024-09-12T02:07:17.089900+0000","last_fullsized":"2024-09-12T02:07:17.089900+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'192","last_scrub_stamp":"2024-09-12T02:07:17.089680+0000","last_deep_scrub":"266'192","last_deep_scrub_stamp":"2024-09-12T02:07:17.089680+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.089680+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:17.343686+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":268,"num_write":529,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"266'396","reported_seq":1789,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.971760+0000","last_change":"2024-09-12T02:07:09.971585+0000","last_active":"2024-09-12T02:07:09.971760+0000","last_peered":"2024-09-12T02:07:09.971760+0000","last_clean":"2024-09-12T02:07:09.971760+0000","last_became_active":"2024-09-12T00:10:01.256781+0000","last_became_peered":"2024-09-12T00:10:01.256781+0000","last_unstale":"2024-09-12T02:07:09.971760+0000","last_undegraded":"2024-09-12T02:07:09.971760+0000","last_fullsized":"2024-09-12T02:07:09.971760+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'396","last_scrub_stamp":"2024-09-12T02:07:09.971392+0000","last_deep_scrub":"266'396","last_deep_scrub_stamp":"2024-09-12T02:07:09.971392+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.971392+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:53.393957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1972,"num_read_kb":1849,"num_write":456,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"266'342","reported_seq":993,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.004650+0000","last_change":"2024-09-12T02:06:55.004394+0000","last_active":"2024-09-12T02:06:55.004650+0000","last_peered":"2024-09-12T02:06:55.004650+0000","last_clean":"2024-09-12T02:06:55.004650+0000","last_became_active":"2024-09-12T00:09:59.295949+0000","last_became_peered":"2024-09-12T00:09:59.295949+0000","last_unstale":"2024-09-12T02:06:55.004650+0000","last_undegraded":"2024-09-12T02:06:55.004650+0000","last_fullsized":"2024-09-12T02:06:55.004650+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'342","last_scrub_stamp":"2024-09-12T02:06:55.004131+0000","last_deep_scrub":"266'342","last_deep_scrub_stamp":"2024-09-12T02:06:55.004131+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.004131+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:24.111205+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314586,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":1958,"num_write":1004,"num_write_kb":21693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.015988+0000","last_change":"2024-09-12T02:07:17.015850+0000","last_active":"2024-09-12T02:07:17.015988+0000","last_peered":"2024-09-12T02:07:17.015988+0000","last_clean":"2024-09-12T02:07:17.015988+0000","last_became_active":"2024-09-12T00:10:03.254941+0000","last_became_peered":"2024-09-12T00:10:03.254941+0000","last_unstale":"2024-09-12T02:07:17.015988+0000","last_undegraded":"2024-09-12T02:07:17.015988+0000","last_fullsized":"2024-09-12T02:07:17.015988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:17.015656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:17.015656+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.015656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:35.259126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"266'352","reported_seq":1002,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.005634+0000","last_change":"2024-09-12T02:07:25.005634+0000","last_active":"2024-09-12T02:07:25.005634+0000","last_peered":"2024-09-12T02:07:25.005634+0000","last_clean":"2024-09-12T02:07:25.005634+0000","last_became_active":"2024-09-12T00:10:05.362151+0000","last_became_peered":"2024-09-12T00:10:05.362151+0000","last_unstale":"2024-09-12T02:07:25.005634+0000","last_undegraded":"2024-09-12T02:07:25.005634+0000","last_fullsized":"2024-09-12T02:07:25.005634+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'352","last_scrub_stamp":"2024-09-12T02:07:25.005436+0000","last_deep_scrub":"266'352","last_deep_scrub_stamp":"2024-09-12T02:07:25.005436+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.005436+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:16.267655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45165,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":1204,"num_write":458,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.414408+0000","last_change":"2024-09-12T02:07:16.414408+0000","last_active":"2024-09-12T02:07:16.414408+0000","last_peered":"2024-09-12T02:07:16.414408+0000","last_clean":"2024-09-12T02:07:16.414408+0000","last_became_active":"2024-09-12T00:10:07.336129+0000","last_became_peered":"2024-09-12T00:10:07.336129+0000","last_unstale":"2024-09-12T02:07:16.414408+0000","last_undegraded":"2024-09-12T02:07:16.414408+0000","last_fullsized":"2024-09-12T02:07:16.414408+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:16.414226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:16.414226+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.414226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:38.943116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"266'103","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.691163+0000","last_change":"2024-09-12T02:07:31.691163+0000","last_active":"2024-09-12T02:07:31.691163+0000","last_peered":"2024-09-12T02:07:31.691163+0000","last_clean":"2024-09-12T02:07:31.691163+0000","last_became_active":"2024-09-12T00:10:09.370925+0000","last_became_peered":"2024-09-12T00:10:09.370925+0000","last_unstale":"2024-09-12T02:07:31.691163+0000","last_undegraded":"2024-09-12T02:07:31.691163+0000","last_fullsized":"2024-09-12T02:07:31.691163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'103","last_scrub_stamp":"2024-09-12T02:07:31.690971+0000","last_deep_scrub":"266'103","last_deep_scrub_stamp":"2024-09-12T02:07:31.690971+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.690971+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:30.808146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"266'457","reported_seq":2126,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.672348+0000","last_change":"2024-09-12T02:06:56.672207+0000","last_active":"2024-09-12T02:06:56.672348+0000","last_peered":"2024-09-12T02:06:56.672348+0000","last_clean":"2024-09-12T02:06:56.672348+0000","last_became_active":"2024-09-12T00:10:01.257064+0000","last_became_peered":"2024-09-12T00:10:01.257064+0000","last_unstale":"2024-09-12T02:06:56.672348+0000","last_undegraded":"2024-09-12T02:06:56.672348+0000","last_fullsized":"2024-09-12T02:06:56.672348+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T02:06:56.672031+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T02:06:56.672031+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.672031+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:43.653119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2638,"num_read_kb":2500,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"266'393","reported_seq":1096,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.544401+0000","last_change":"2024-09-12T02:06:54.544339+0000","last_active":"2024-09-12T02:06:54.544401+0000","last_peered":"2024-09-12T02:06:54.544401+0000","last_clean":"2024-09-12T02:06:54.544401+0000","last_became_active":"2024-09-12T00:09:59.289217+0000","last_became_peered":"2024-09-12T00:09:59.289217+0000","last_unstale":"2024-09-12T02:06:54.544401+0000","last_undegraded":"2024-09-12T02:06:54.544401+0000","last_fullsized":"2024-09-12T02:06:54.544401+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T02:06:54.544232+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T02:06:54.544232+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.544232+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:13.653204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":33363,"num_write":1255,"num_write_kb":62829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.427645+0000","last_change":"2024-09-12T02:07:12.427491+0000","last_active":"2024-09-12T02:07:12.427645+0000","last_peered":"2024-09-12T02:07:12.427645+0000","last_clean":"2024-09-12T02:07:12.427645+0000","last_became_active":"2024-09-12T00:10:03.264802+0000","last_became_peered":"2024-09-12T00:10:03.264802+0000","last_unstale":"2024-09-12T02:07:12.427645+0000","last_undegraded":"2024-09-12T02:07:12.427645+0000","last_fullsized":"2024-09-12T02:07:12.427645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.427300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.427300+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.427300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:12.086674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"266'170","reported_seq":772,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.049420+0000","last_change":"2024-09-12T02:07:23.049420+0000","last_active":"2024-09-12T02:07:23.049420+0000","last_peered":"2024-09-12T02:07:23.049420+0000","last_clean":"2024-09-12T02:07:23.049420+0000","last_became_active":"2024-09-12T00:10:05.361625+0000","last_became_peered":"2024-09-12T00:10:05.361625+0000","last_unstale":"2024-09-12T02:07:23.049420+0000","last_undegraded":"2024-09-12T02:07:23.049420+0000","last_fullsized":"2024-09-12T02:07:23.049420+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'170","last_scrub_stamp":"2024-09-12T02:07:23.049225+0000","last_deep_scrub":"266'170","last_deep_scrub_stamp":"2024-09-12T02:07:23.049225+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.049225+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:36.389861+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":192,"num_write":144,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"266'765","reported_seq":3204,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.111797+0000","last_change":"2024-09-12T02:07:18.111797+0000","last_active":"2024-09-12T02:07:18.111797+0000","last_peered":"2024-09-12T02:07:18.111797+0000","last_clean":"2024-09-12T02:07:18.111797+0000","last_became_active":"2024-09-12T00:10:07.314980+0000","last_became_peered":"2024-09-12T00:10:07.314980+0000","last_unstale":"2024-09-12T02:07:18.111797+0000","last_undegraded":"2024-09-12T02:07:18.111797+0000","last_fullsized":"2024-09-12T02:07:18.111797+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'765","last_scrub_stamp":"2024-09-12T02:07:18.111612+0000","last_deep_scrub":"266'765","last_deep_scrub_stamp":"2024-09-12T02:07:18.111612+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.111612+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.698620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"266'122","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.863060+0000","last_change":"2024-09-12T02:07:25.863060+0000","last_active":"2024-09-12T02:07:25.863060+0000","last_peered":"2024-09-12T02:07:25.863060+0000","last_clean":"2024-09-12T02:07:25.863060+0000","last_became_active":"2024-09-12T00:10:09.369670+0000","last_became_peered":"2024-09-12T00:10:09.369670+0000","last_unstale":"2024-09-12T02:07:25.863060+0000","last_undegraded":"2024-09-12T02:07:25.863060+0000","last_fullsized":"2024-09-12T02:07:25.863060+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'122","last_scrub_stamp":"2024-09-12T02:07:25.862873+0000","last_deep_scrub":"266'122","last_deep_scrub_stamp":"2024-09-12T02:07:25.862873+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.862873+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:58.331730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":303,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"266'517","reported_seq":2021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.025361+0000","last_change":"2024-09-12T02:07:05.025188+0000","last_active":"2024-09-12T02:07:05.025361+0000","last_peered":"2024-09-12T02:07:05.025361+0000","last_clean":"2024-09-12T02:07:05.025361+0000","last_became_active":"2024-09-12T00:10:01.248535+0000","last_became_peered":"2024-09-12T00:10:01.248535+0000","last_unstale":"2024-09-12T02:07:05.025361+0000","last_undegraded":"2024-09-12T02:07:05.025361+0000","last_fullsized":"2024-09-12T02:07:05.025361+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'517","last_scrub_stamp":"2024-09-12T02:07:05.024997+0000","last_deep_scrub":"266'517","last_deep_scrub_stamp":"2024-09-12T02:07:05.024997+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.024997+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.426432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2593,"num_read_kb":2391,"num_write":659,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"266'402","reported_seq":1110,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.658383+0000","last_change":"2024-09-12T02:06:59.658106+0000","last_active":"2024-09-12T02:06:59.658383+0000","last_peered":"2024-09-12T02:06:59.658383+0000","last_clean":"2024-09-12T02:06:59.658383+0000","last_became_active":"2024-09-12T00:09:59.296207+0000","last_became_peered":"2024-09-12T00:09:59.296207+0000","last_unstale":"2024-09-12T02:06:59.658383+0000","last_undegraded":"2024-09-12T02:06:59.658383+0000","last_fullsized":"2024-09-12T02:06:59.658383+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'402","last_scrub_stamp":"2024-09-12T02:06:59.657782+0000","last_deep_scrub":"266'402","last_deep_scrub_stamp":"2024-09-12T02:06:59.657782+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.657782+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:49.546487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":512433,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":595,"num_read_kb":14266,"num_write":1257,"num_write_kb":35890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.829472+0000","last_change":"2024-09-12T02:07:14.829333+0000","last_active":"2024-09-12T02:07:14.829472+0000","last_peered":"2024-09-12T02:07:14.829472+0000","last_clean":"2024-09-12T02:07:14.829472+0000","last_became_active":"2024-09-12T00:10:03.259644+0000","last_became_peered":"2024-09-12T00:10:03.259644+0000","last_unstale":"2024-09-12T02:07:14.829472+0000","last_undegraded":"2024-09-12T02:07:14.829472+0000","last_fullsized":"2024-09-12T02:07:14.829472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:14.829153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:14.829153+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.829153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:55.178694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"266'393","reported_seq":1076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.646671+0000","last_change":"2024-09-12T02:07:25.646671+0000","last_active":"2024-09-12T02:07:25.646671+0000","last_peered":"2024-09-12T02:07:25.646671+0000","last_clean":"2024-09-12T02:07:25.646671+0000","last_became_active":"2024-09-12T00:10:05.297223+0000","last_became_peered":"2024-09-12T00:10:05.297223+0000","last_unstale":"2024-09-12T02:07:25.646671+0000","last_undegraded":"2024-09-12T02:07:25.646671+0000","last_fullsized":"2024-09-12T02:07:25.646671+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T02:07:25.646439+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T02:07:25.646439+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.646439+0000","objects_scrubbed":11,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:15.202173+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46277,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":600,"num_read_kb":1076,"num_write":448,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.632163+0000","last_change":"2024-09-12T02:07:24.632163+0000","last_active":"2024-09-12T02:07:24.632163+0000","last_peered":"2024-09-12T02:07:24.632163+0000","last_clean":"2024-09-12T02:07:24.632163+0000","last_became_active":"2024-09-12T00:10:07.323296+0000","last_became_peered":"2024-09-12T00:10:07.323296+0000","last_unstale":"2024-09-12T02:07:24.632163+0000","last_undegraded":"2024-09-12T02:07:24.632163+0000","last_fullsized":"2024-09-12T02:07:24.632163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.631902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.631902+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.631902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:20.809640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"266'148","reported_seq":680,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.889233+0000","last_change":"2024-09-12T02:07:26.889233+0000","last_active":"2024-09-12T02:07:26.889233+0000","last_peered":"2024-09-12T02:07:26.889233+0000","last_clean":"2024-09-12T02:07:26.889233+0000","last_became_active":"2024-09-12T00:10:09.361797+0000","last_became_peered":"2024-09-12T00:10:09.361797+0000","last_unstale":"2024-09-12T02:07:26.889233+0000","last_undegraded":"2024-09-12T02:07:26.889233+0000","last_fullsized":"2024-09-12T02:07:26.889233+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'148","last_scrub_stamp":"2024-09-12T02:07:26.889040+0000","last_deep_scrub":"266'148","last_deep_scrub_stamp":"2024-09-12T02:07:26.889040+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.889040+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:17.414450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":153,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"266'799","reported_seq":2159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.040881+0000","last_change":"2024-09-12T02:07:06.040735+0000","last_active":"2024-09-12T02:07:06.040881+0000","last_peered":"2024-09-12T02:07:06.040881+0000","last_clean":"2024-09-12T02:07:06.040881+0000","last_became_active":"2024-09-12T00:10:31.165044+0000","last_became_peered":"2024-09-12T00:10:31.165044+0000","last_unstale":"2024-09-12T02:07:06.040881+0000","last_undegraded":"2024-09-12T02:07:06.040881+0000","last_fullsized":"2024-09-12T02:07:06.040881+0000","mapping_epoch":38,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'799","last_scrub_stamp":"2024-09-12T02:07:06.040541+0000","last_deep_scrub":"266'799","last_deep_scrub_stamp":"2024-09-12T02:07:06.040541+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.040541+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:23.943825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3606,"num_read_kb":3182,"num_write":1095,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"266'377","reported_seq":1089,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.666197+0000","last_change":"2024-09-12T02:07:02.666038+0000","last_active":"2024-09-12T02:07:02.666197+0000","last_peered":"2024-09-12T02:07:02.666197+0000","last_clean":"2024-09-12T02:07:02.666197+0000","last_became_active":"2024-09-12T00:09:59.264091+0000","last_became_peered":"2024-09-12T00:09:59.264091+0000","last_unstale":"2024-09-12T02:07:02.666197+0000","last_undegraded":"2024-09-12T02:07:02.666197+0000","last_fullsized":"2024-09-12T02:07:02.666197+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'377","last_scrub_stamp":"2024-09-12T02:07:02.665688+0000","last_deep_scrub":"266'377","last_deep_scrub_stamp":"2024-09-12T02:07:02.665688+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.665688+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:35.183095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":673026,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":647,"num_read_kb":45982,"num_write":1108,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.567418+0000","last_change":"2024-09-12T02:07:18.567267+0000","last_active":"2024-09-12T02:07:18.567418+0000","last_peered":"2024-09-12T02:07:18.567418+0000","last_clean":"2024-09-12T02:07:18.567418+0000","last_became_active":"2024-09-12T00:10:03.263712+0000","last_became_peered":"2024-09-12T00:10:03.263712+0000","last_unstale":"2024-09-12T02:07:18.567418+0000","last_undegraded":"2024-09-12T02:07:18.567418+0000","last_fullsized":"2024-09-12T02:07:18.567418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:18.567082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:18.567082+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.567082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:10.276442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"266'316","reported_seq":943,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.557553+0000","last_change":"2024-09-12T02:07:17.557553+0000","last_active":"2024-09-12T02:07:17.557553+0000","last_peered":"2024-09-12T02:07:17.557553+0000","last_clean":"2024-09-12T02:07:17.557553+0000","last_became_active":"2024-09-12T00:10:05.297514+0000","last_became_peered":"2024-09-12T00:10:05.297514+0000","last_unstale":"2024-09-12T02:07:17.557553+0000","last_undegraded":"2024-09-12T02:07:17.557553+0000","last_fullsized":"2024-09-12T02:07:17.557553+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'316","last_scrub_stamp":"2024-09-12T02:07:17.557343+0000","last_deep_scrub":"266'316","last_deep_scrub_stamp":"2024-09-12T02:07:17.557343+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.557343+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:47.121784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42254,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1111,"num_write":410,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.078944+0000","last_change":"2024-09-12T02:07:10.078944+0000","last_active":"2024-09-12T02:07:10.078944+0000","last_peered":"2024-09-12T02:07:10.078944+0000","last_clean":"2024-09-12T02:07:10.078944+0000","last_became_active":"2024-09-12T00:10:07.320880+0000","last_became_peered":"2024-09-12T00:10:07.320880+0000","last_unstale":"2024-09-12T02:07:10.078944+0000","last_undegraded":"2024-09-12T02:07:10.078944+0000","last_fullsized":"2024-09-12T02:07:10.078944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:10.078696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:10.078696+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.078696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:20.691685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"266'123","reported_seq":676,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.998611+0000","last_change":"2024-09-12T02:07:28.998611+0000","last_active":"2024-09-12T02:07:28.998611+0000","last_peered":"2024-09-12T02:07:28.998611+0000","last_clean":"2024-09-12T02:07:28.998611+0000","last_became_active":"2024-09-12T00:10:09.433296+0000","last_became_peered":"2024-09-12T00:10:09.433296+0000","last_unstale":"2024-09-12T02:07:28.998611+0000","last_undegraded":"2024-09-12T02:07:28.998611+0000","last_fullsized":"2024-09-12T02:07:28.998611+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'123","last_scrub_stamp":"2024-09-12T02:07:28.998417+0000","last_deep_scrub":"266'123","last_deep_scrub_stamp":"2024-09-12T02:07:28.998417+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.998417+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:29.865905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1168,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":163,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"266'599","reported_seq":2334,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.896330+0000","last_change":"2024-09-12T02:07:06.896330+0000","last_active":"2024-09-12T02:07:06.896330+0000","last_peered":"2024-09-12T02:07:06.896330+0000","last_clean":"2024-09-12T02:07:06.896330+0000","last_became_active":"2024-09-12T00:10:01.242013+0000","last_became_peered":"2024-09-12T00:10:01.242013+0000","last_unstale":"2024-09-12T02:07:06.896330+0000","last_undegraded":"2024-09-12T02:07:06.896330+0000","last_fullsized":"2024-09-12T02:07:06.896330+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'599","last_scrub_stamp":"2024-09-12T02:07:06.896120+0000","last_deep_scrub":"266'599","last_deep_scrub_stamp":"2024-09-12T02:07:06.896120+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.896120+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:25.178488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3158,"num_read_kb":2927,"num_write":761,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"266'355","reported_seq":1038,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.836056+0000","last_change":"2024-09-12T02:06:56.836056+0000","last_active":"2024-09-12T02:06:56.836056+0000","last_peered":"2024-09-12T02:06:56.836056+0000","last_clean":"2024-09-12T02:06:56.836056+0000","last_became_active":"2024-09-12T00:09:59.311148+0000","last_became_peered":"2024-09-12T00:09:59.311148+0000","last_unstale":"2024-09-12T02:06:56.836056+0000","last_undegraded":"2024-09-12T02:06:56.836056+0000","last_fullsized":"2024-09-12T02:06:56.836056+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'355","last_scrub_stamp":"2024-09-12T02:06:56.835868+0000","last_deep_scrub":"266'355","last_deep_scrub_stamp":"2024-09-12T02:06:56.835868+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.835868+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:27.439194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":27101,"num_write":1127,"num_write_kb":32356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.016537+0000","last_change":"2024-09-12T02:07:16.016537+0000","last_active":"2024-09-12T02:07:16.016537+0000","last_peered":"2024-09-12T02:07:16.016537+0000","last_clean":"2024-09-12T02:07:16.016537+0000","last_became_active":"2024-09-12T00:10:03.252562+0000","last_became_peered":"2024-09-12T00:10:03.252562+0000","last_unstale":"2024-09-12T02:07:16.016537+0000","last_undegraded":"2024-09-12T02:07:16.016537+0000","last_fullsized":"2024-09-12T02:07:16.016537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:16.016357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:16.016357+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.016357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:39.102112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"266'278","reported_seq":883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.965286+0000","last_change":"2024-09-12T02:07:33.965149+0000","last_active":"2024-09-12T02:07:33.965286+0000","last_peered":"2024-09-12T02:07:33.965286+0000","last_clean":"2024-09-12T02:07:33.965286+0000","last_became_active":"2024-09-12T00:10:05.291758+0000","last_became_peered":"2024-09-12T00:10:05.291758+0000","last_unstale":"2024-09-12T02:07:33.965286+0000","last_undegraded":"2024-09-12T02:07:33.965286+0000","last_fullsized":"2024-09-12T02:07:33.965286+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'278","last_scrub_stamp":"2024-09-12T02:07:33.964974+0000","last_deep_scrub":"266'278","last_deep_scrub_stamp":"2024-09-12T02:07:33.964974+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.964974+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:02.059751+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47860,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":1100,"num_write":388,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.126840+0000","last_change":"2024-09-12T02:07:25.126678+0000","last_active":"2024-09-12T02:07:25.126840+0000","last_peered":"2024-09-12T02:07:25.126840+0000","last_clean":"2024-09-12T02:07:25.126840+0000","last_became_active":"2024-09-12T00:10:07.320509+0000","last_became_peered":"2024-09-12T00:10:07.320509+0000","last_unstale":"2024-09-12T02:07:25.126840+0000","last_undegraded":"2024-09-12T02:07:25.126840+0000","last_fullsized":"2024-09-12T02:07:25.126840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.126495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.126495+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.126495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:09.265720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"266'174","reported_seq":1673,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.868839+0000","last_change":"2024-09-12T02:07:28.868839+0000","last_active":"2024-09-12T02:07:28.868839+0000","last_peered":"2024-09-12T02:07:28.868839+0000","last_clean":"2024-09-12T02:07:28.868839+0000","last_became_active":"2024-09-12T00:10:09.363609+0000","last_became_peered":"2024-09-12T00:10:09.363609+0000","last_unstale":"2024-09-12T02:07:28.868839+0000","last_undegraded":"2024-09-12T02:07:28.868839+0000","last_fullsized":"2024-09-12T02:07:28.868839+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'174","last_scrub_stamp":"2024-09-12T02:07:28.868656+0000","last_deep_scrub":"266'174","last_deep_scrub_stamp":"2024-09-12T02:07:28.868656+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.868656+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:27.970633+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1201,"num_read_kb":1188,"num_write":377,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"266'769","reported_seq":2302,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.063112+0000","last_change":"2024-09-12T02:07:04.063112+0000","last_active":"2024-09-12T02:07:04.063112+0000","last_peered":"2024-09-12T02:07:04.063112+0000","last_clean":"2024-09-12T02:07:04.063112+0000","last_became_active":"2024-09-12T00:10:01.255086+0000","last_became_peered":"2024-09-12T00:10:01.255086+0000","last_unstale":"2024-09-12T02:07:04.063112+0000","last_undegraded":"2024-09-12T02:07:04.063112+0000","last_fullsized":"2024-09-12T02:07:04.063112+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'769","last_scrub_stamp":"2024-09-12T02:07:04.062933+0000","last_deep_scrub":"266'769","last_deep_scrub_stamp":"2024-09-12T02:07:04.062933+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.062933+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:11.242416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3623,"num_read_kb":3271,"num_write":1000,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"266'318","reported_seq":1027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.532324+0000","last_change":"2024-09-12T02:06:55.532324+0000","last_active":"2024-09-12T02:06:55.532324+0000","last_peered":"2024-09-12T02:06:55.532324+0000","last_clean":"2024-09-12T02:06:55.532324+0000","last_became_active":"2024-09-12T00:09:59.293822+0000","last_became_peered":"2024-09-12T00:09:59.293822+0000","last_unstale":"2024-09-12T02:06:55.532324+0000","last_undegraded":"2024-09-12T02:06:55.532324+0000","last_fullsized":"2024-09-12T02:06:55.532324+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'318","last_scrub_stamp":"2024-09-12T02:06:55.532061+0000","last_deep_scrub":"266'318","last_deep_scrub_stamp":"2024-09-12T02:06:55.532061+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.532061+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:37.599521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":523,"num_read_kb":10999,"num_write":984,"num_write_kb":11811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"266'2","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.390356+0000","last_change":"2024-09-12T02:07:08.390356+0000","last_active":"2024-09-12T02:07:08.390356+0000","last_peered":"2024-09-12T02:07:08.390356+0000","last_clean":"2024-09-12T02:07:08.390356+0000","last_became_active":"2024-09-12T00:10:03.272579+0000","last_became_peered":"2024-09-12T00:10:03.272579+0000","last_unstale":"2024-09-12T02:07:08.390356+0000","last_undegraded":"2024-09-12T02:07:08.390356+0000","last_fullsized":"2024-09-12T02:07:08.390356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:08.390169+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:08.390169+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.390169+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:30.745777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"266'377","reported_seq":1028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.087551+0000","last_change":"2024-09-12T02:07:21.087405+0000","last_active":"2024-09-12T02:07:21.087551+0000","last_peered":"2024-09-12T02:07:21.087551+0000","last_clean":"2024-09-12T02:07:21.087551+0000","last_became_active":"2024-09-12T00:10:05.288230+0000","last_became_peered":"2024-09-12T00:10:05.288230+0000","last_unstale":"2024-09-12T02:07:21.087551+0000","last_undegraded":"2024-09-12T02:07:21.087551+0000","last_fullsized":"2024-09-12T02:07:21.087551+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'377","last_scrub_stamp":"2024-09-12T02:07:21.087191+0000","last_deep_scrub":"266'377","last_deep_scrub_stamp":"2024-09-12T02:07:21.087191+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.087191+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:47.013440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51419,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":1309,"num_write":486,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.587206+0000","last_change":"2024-09-12T02:07:25.587084+0000","last_active":"2024-09-12T02:07:25.587206+0000","last_peered":"2024-09-12T02:07:25.587206+0000","last_clean":"2024-09-12T02:07:25.587206+0000","last_became_active":"2024-09-12T00:10:07.325726+0000","last_became_peered":"2024-09-12T00:10:07.325726+0000","last_unstale":"2024-09-12T02:07:25.587206+0000","last_undegraded":"2024-09-12T02:07:25.587206+0000","last_fullsized":"2024-09-12T02:07:25.587206+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.586903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.586903+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.586903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:59.223671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"266'153","reported_seq":689,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.097100+0000","last_change":"2024-09-12T02:07:27.097100+0000","last_active":"2024-09-12T02:07:27.097100+0000","last_peered":"2024-09-12T02:07:27.097100+0000","last_clean":"2024-09-12T02:07:27.097100+0000","last_became_active":"2024-09-12T00:10:09.353036+0000","last_became_peered":"2024-09-12T00:10:09.353036+0000","last_unstale":"2024-09-12T02:07:27.097100+0000","last_undegraded":"2024-09-12T02:07:27.097100+0000","last_fullsized":"2024-09-12T02:07:27.097100+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'153","last_scrub_stamp":"2024-09-12T02:07:27.096879+0000","last_deep_scrub":"266'153","last_deep_scrub_stamp":"2024-09-12T02:07:27.096879+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.096879+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:36.888055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":163,"num_write":387,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"266'725","reported_seq":2138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.391036+0000","last_change":"2024-09-12T02:07:10.391036+0000","last_active":"2024-09-12T02:07:10.391036+0000","last_peered":"2024-09-12T02:07:10.391036+0000","last_clean":"2024-09-12T02:07:10.391036+0000","last_became_active":"2024-09-12T00:10:01.263786+0000","last_became_peered":"2024-09-12T00:10:01.263786+0000","last_unstale":"2024-09-12T02:07:10.391036+0000","last_undegraded":"2024-09-12T02:07:10.391036+0000","last_fullsized":"2024-09-12T02:07:10.391036+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'725","last_scrub_stamp":"2024-09-12T02:07:10.390853+0000","last_deep_scrub":"266'725","last_deep_scrub_stamp":"2024-09-12T02:07:10.390853+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.390853+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:24.901710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3380,"num_read_kb":3030,"num_write":963,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"266'351","reported_seq":1024,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.152813+0000","last_change":"2024-09-12T02:06:58.152813+0000","last_active":"2024-09-12T02:06:58.152813+0000","last_peered":"2024-09-12T02:06:58.152813+0000","last_clean":"2024-09-12T02:06:58.152813+0000","last_became_active":"2024-09-12T00:09:59.287488+0000","last_became_peered":"2024-09-12T00:09:59.287488+0000","last_unstale":"2024-09-12T02:06:58.152813+0000","last_undegraded":"2024-09-12T02:06:58.152813+0000","last_fullsized":"2024-09-12T02:06:58.152813+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'351","last_scrub_stamp":"2024-09-12T02:06:58.152595+0000","last_deep_scrub":"266'351","last_deep_scrub_stamp":"2024-09-12T02:06:58.152595+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.152595+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:00.499623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174806,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":42853,"num_write":973,"num_write_kb":24863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"266'458","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.419572+0000","last_change":"2024-09-12T02:07:14.419572+0000","last_active":"2024-09-12T02:07:14.419572+0000","last_peered":"2024-09-12T02:07:14.419572+0000","last_clean":"2024-09-12T02:07:14.419572+0000","last_became_active":"2024-09-12T00:10:01.258361+0000","last_became_peered":"2024-09-12T00:10:01.258361+0000","last_unstale":"2024-09-12T02:07:14.419572+0000","last_undegraded":"2024-09-12T02:07:14.419572+0000","last_fullsized":"2024-09-12T02:07:14.419572+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T02:07:14.419394+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T02:07:14.419394+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.419394+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:23.617226+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2374,"num_read_kb":2204,"num_write":589,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"266'345","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.603030+0000","last_change":"2024-09-12T02:06:58.603030+0000","last_active":"2024-09-12T02:06:58.603030+0000","last_peered":"2024-09-12T02:06:58.603030+0000","last_clean":"2024-09-12T02:06:58.603030+0000","last_became_active":"2024-09-12T00:10:31.469140+0000","last_became_peered":"2024-09-12T00:10:31.469140+0000","last_unstale":"2024-09-12T02:06:58.603030+0000","last_undegraded":"2024-09-12T02:06:58.603030+0000","last_fullsized":"2024-09-12T02:06:58.603030+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'345","last_scrub_stamp":"2024-09-12T02:06:58.602735+0000","last_deep_scrub":"266'345","last_deep_scrub_stamp":"2024-09-12T02:06:58.602735+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.602735+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:27.793298+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314842,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":558,"num_read_kb":38599,"num_write":1106,"num_write_kb":37292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"266'827","reported_seq":2521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.622206+0000","last_change":"2024-09-12T02:07:11.622206+0000","last_active":"2024-09-12T02:07:11.622206+0000","last_peered":"2024-09-12T02:07:11.622206+0000","last_clean":"2024-09-12T02:07:11.622206+0000","last_became_active":"2024-09-12T00:10:01.275843+0000","last_became_peered":"2024-09-12T00:10:01.275843+0000","last_unstale":"2024-09-12T02:07:11.622206+0000","last_undegraded":"2024-09-12T02:07:11.622206+0000","last_fullsized":"2024-09-12T02:07:11.622206+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'827","last_scrub_stamp":"2024-09-12T02:07:11.621963+0000","last_deep_scrub":"266'827","last_deep_scrub_stamp":"2024-09-12T02:07:11.621963+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.621963+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:54.952629+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4035,"num_read_kb":3644,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":697,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"266'347","reported_seq":1033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.635699+0000","last_change":"2024-09-12T02:07:01.635699+0000","last_active":"2024-09-12T02:07:01.635699+0000","last_peered":"2024-09-12T02:07:01.635699+0000","last_clean":"2024-09-12T02:07:01.635699+0000","last_became_active":"2024-09-12T00:09:59.309327+0000","last_became_peered":"2024-09-12T00:09:59.309327+0000","last_unstale":"2024-09-12T02:07:01.635699+0000","last_undegraded":"2024-09-12T02:07:01.635699+0000","last_fullsized":"2024-09-12T02:07:01.635699+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'347","last_scrub_stamp":"2024-09-12T02:07:01.635456+0000","last_deep_scrub":"266'347","last_deep_scrub_stamp":"2024-09-12T02:07:01.635456+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.635456+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:44.139239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":15469,"num_write":1110,"num_write_kb":37224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"266'499","reported_seq":2156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.362179+0000","last_change":"2024-09-12T02:07:03.362000+0000","last_active":"2024-09-12T02:07:03.362179+0000","last_peered":"2024-09-12T02:07:03.362179+0000","last_clean":"2024-09-12T02:07:03.362179+0000","last_became_active":"2024-09-12T00:10:01.261418+0000","last_became_peered":"2024-09-12T00:10:01.261418+0000","last_unstale":"2024-09-12T02:07:03.362179+0000","last_undegraded":"2024-09-12T02:07:03.362179+0000","last_fullsized":"2024-09-12T02:07:03.362179+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T02:07:03.361825+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T02:07:03.361825+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.361825+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:03.935407+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2751,"num_read_kb":2561,"num_write":595,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"266'353","reported_seq":1122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.570841+0000","last_change":"2024-09-12T02:06:58.570841+0000","last_active":"2024-09-12T02:06:58.570841+0000","last_peered":"2024-09-12T02:06:58.570841+0000","last_clean":"2024-09-12T02:06:58.570841+0000","last_became_active":"2024-09-12T00:09:59.286590+0000","last_became_peered":"2024-09-12T00:09:59.286590+0000","last_unstale":"2024-09-12T02:06:58.570841+0000","last_undegraded":"2024-09-12T02:06:58.570841+0000","last_fullsized":"2024-09-12T02:06:58.570841+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'353","last_scrub_stamp":"2024-09-12T02:06:58.570616+0000","last_deep_scrub":"266'353","last_deep_scrub_stamp":"2024-09-12T02:06:58.570616+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.570616+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.488449+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904210,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":714,"num_read_kb":40012,"num_write":1077,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"266'1464","reported_seq":3093,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.937516+0000","last_change":"2024-09-12T02:07:07.937516+0000","last_active":"2024-09-12T02:07:07.937516+0000","last_peered":"2024-09-12T02:07:07.937516+0000","last_clean":"2024-09-12T02:07:07.937516+0000","last_became_active":"2024-09-12T00:10:01.261999+0000","last_became_peered":"2024-09-12T00:10:01.261999+0000","last_unstale":"2024-09-12T02:07:07.937516+0000","last_undegraded":"2024-09-12T02:07:07.937516+0000","last_fullsized":"2024-09-12T02:07:07.937516+0000","mapping_epoch":27,"log_start":"266'1400","ondisk_log_start":"266'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1464","last_scrub_stamp":"2024-09-12T02:07:07.937335+0000","last_deep_scrub":"266'1464","last_deep_scrub_stamp":"2024-09-12T02:07:07.937335+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.937335+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":1400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:48.762109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6652,"num_read_kb":5741,"num_write":2141,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"266'381","reported_seq":1133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.879266+0000","last_change":"2024-09-12T02:06:59.879266+0000","last_active":"2024-09-12T02:06:59.879266+0000","last_peered":"2024-09-12T02:06:59.879266+0000","last_clean":"2024-09-12T02:06:59.879266+0000","last_became_active":"2024-09-12T00:09:59.286301+0000","last_became_peered":"2024-09-12T00:09:59.286301+0000","last_unstale":"2024-09-12T02:06:59.879266+0000","last_undegraded":"2024-09-12T02:06:59.879266+0000","last_fullsized":"2024-09-12T02:06:59.879266+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:06:59.879029+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:06:59.879029+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.879029+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:40.618134+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":778,"num_read_kb":8721,"num_write":1199,"num_write_kb":26143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"266'392","reported_seq":1870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.077047+0000","last_change":"2024-09-12T02:07:07.077047+0000","last_active":"2024-09-12T02:07:07.077047+0000","last_peered":"2024-09-12T02:07:07.077047+0000","last_clean":"2024-09-12T02:07:07.077047+0000","last_became_active":"2024-09-12T00:10:01.266927+0000","last_became_peered":"2024-09-12T00:10:01.266927+0000","last_unstale":"2024-09-12T02:07:07.077047+0000","last_undegraded":"2024-09-12T02:07:07.077047+0000","last_fullsized":"2024-09-12T02:07:07.077047+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T02:07:07.076807+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T02:07:07.076807+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.076807+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:03.913347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2147,"num_read_kb":2014,"num_write":451,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"266'355","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.339949+0000","last_change":"2024-09-12T02:07:05.339949+0000","last_active":"2024-09-12T02:07:05.339949+0000","last_peered":"2024-09-12T02:07:05.339949+0000","last_clean":"2024-09-12T02:07:05.339949+0000","last_became_active":"2024-09-12T00:09:59.251413+0000","last_became_peered":"2024-09-12T00:09:59.251413+0000","last_unstale":"2024-09-12T02:07:05.339949+0000","last_undegraded":"2024-09-12T02:07:05.339949+0000","last_fullsized":"2024-09-12T02:07:05.339949+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'355","last_scrub_stamp":"2024-09-12T02:07:05.339718+0000","last_deep_scrub":"266'355","last_deep_scrub_stamp":"2024-09-12T02:07:05.339718+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.339718+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:18.042053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":573,"num_read_kb":23722,"num_write":1195,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"266'450","reported_seq":2132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.930253+0000","last_change":"2024-09-12T02:07:08.930253+0000","last_active":"2024-09-12T02:07:08.930253+0000","last_peered":"2024-09-12T02:07:08.930253+0000","last_clean":"2024-09-12T02:07:08.930253+0000","last_became_active":"2024-09-12T00:10:01.259942+0000","last_became_peered":"2024-09-12T00:10:01.259942+0000","last_unstale":"2024-09-12T02:07:08.930253+0000","last_undegraded":"2024-09-12T02:07:08.930253+0000","last_fullsized":"2024-09-12T02:07:08.930253+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'450","last_scrub_stamp":"2024-09-12T02:07:08.930001+0000","last_deep_scrub":"266'450","last_deep_scrub_stamp":"2024-09-12T02:07:08.930001+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.930001+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:29.281113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2415,"num_read_kb":2305,"num_write":502,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"266'339","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.102179+0000","last_change":"2024-09-12T02:07:00.102179+0000","last_active":"2024-09-12T02:07:00.102179+0000","last_peered":"2024-09-12T02:07:00.102179+0000","last_clean":"2024-09-12T02:07:00.102179+0000","last_became_active":"2024-09-12T00:09:59.298085+0000","last_became_peered":"2024-09-12T00:09:59.298085+0000","last_unstale":"2024-09-12T02:07:00.102179+0000","last_undegraded":"2024-09-12T02:07:00.102179+0000","last_fullsized":"2024-09-12T02:07:00.102179+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'339","last_scrub_stamp":"2024-09-12T02:07:00.101803+0000","last_deep_scrub":"266'339","last_deep_scrub_stamp":"2024-09-12T02:07:00.101803+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.101803+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:33.009729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136867,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":58646,"num_write":1165,"num_write_kb":29645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"266'501","reported_seq":2216,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.040683+0000","last_change":"2024-09-12T02:07:03.040683+0000","last_active":"2024-09-12T02:07:03.040683+0000","last_peered":"2024-09-12T02:07:03.040683+0000","last_clean":"2024-09-12T02:07:03.040683+0000","last_became_active":"2024-09-12T00:10:01.255302+0000","last_became_peered":"2024-09-12T00:10:01.255302+0000","last_unstale":"2024-09-12T02:07:03.040683+0000","last_undegraded":"2024-09-12T02:07:03.040683+0000","last_fullsized":"2024-09-12T02:07:03.040683+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'501","last_scrub_stamp":"2024-09-12T02:07:03.040505+0000","last_deep_scrub":"266'501","last_deep_scrub_stamp":"2024-09-12T02:07:03.040505+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.040505+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:52.725447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2619,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"266'347","reported_seq":1083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.927866+0000","last_change":"2024-09-12T02:07:01.927866+0000","last_active":"2024-09-12T02:07:01.927866+0000","last_peered":"2024-09-12T02:07:01.927866+0000","last_clean":"2024-09-12T02:07:01.927866+0000","last_became_active":"2024-09-12T00:09:59.286393+0000","last_became_peered":"2024-09-12T00:09:59.286393+0000","last_unstale":"2024-09-12T02:07:01.927866+0000","last_undegraded":"2024-09-12T02:07:01.927866+0000","last_fullsized":"2024-09-12T02:07:01.927866+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'347","last_scrub_stamp":"2024-09-12T02:07:01.927667+0000","last_deep_scrub":"266'347","last_deep_scrub_stamp":"2024-09-12T02:07:01.927667+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.927667+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:21.933493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33187,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":4608,"num_write":1166,"num_write_kb":13882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"266'600","reported_seq":2564,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.495857+0000","last_change":"2024-09-12T02:07:07.495857+0000","last_active":"2024-09-12T02:07:07.495857+0000","last_peered":"2024-09-12T02:07:07.495857+0000","last_clean":"2024-09-12T02:07:07.495857+0000","last_became_active":"2024-09-12T00:10:01.247691+0000","last_became_peered":"2024-09-12T00:10:01.247691+0000","last_unstale":"2024-09-12T02:07:07.495857+0000","last_undegraded":"2024-09-12T02:07:07.495857+0000","last_fullsized":"2024-09-12T02:07:07.495857+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'600","last_scrub_stamp":"2024-09-12T02:07:07.495627+0000","last_deep_scrub":"266'600","last_deep_scrub_stamp":"2024-09-12T02:07:07.495627+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.495627+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":500,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:17.862827+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3679,"num_read_kb":3455,"num_write":725,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4760,"num_omap_keys":19,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"266'359","reported_seq":1028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.622685+0000","last_change":"2024-09-12T02:07:00.622538+0000","last_active":"2024-09-12T02:07:00.622685+0000","last_peered":"2024-09-12T02:07:00.622685+0000","last_clean":"2024-09-12T02:07:00.622685+0000","last_became_active":"2024-09-12T00:09:59.300760+0000","last_became_peered":"2024-09-12T00:09:59.300760+0000","last_unstale":"2024-09-12T02:07:00.622685+0000","last_undegraded":"2024-09-12T02:07:00.622685+0000","last_fullsized":"2024-09-12T02:07:00.622685+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'359","last_scrub_stamp":"2024-09-12T02:07:00.622302+0000","last_deep_scrub":"266'359","last_deep_scrub_stamp":"2024-09-12T02:07:00.622302+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.622302+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:23.067734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436849,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":26981,"num_write":1171,"num_write_kb":52645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"266'958","reported_seq":2617,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.103295+0000","last_change":"2024-09-12T02:07:09.103295+0000","last_active":"2024-09-12T02:07:09.103295+0000","last_peered":"2024-09-12T02:07:09.103295+0000","last_clean":"2024-09-12T02:07:09.103295+0000","last_became_active":"2024-09-12T00:10:01.238674+0000","last_became_peered":"2024-09-12T00:10:01.238674+0000","last_unstale":"2024-09-12T02:07:09.103295+0000","last_undegraded":"2024-09-12T02:07:09.103295+0000","last_fullsized":"2024-09-12T02:07:09.103295+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'958","last_scrub_stamp":"2024-09-12T02:07:09.103056+0000","last_deep_scrub":"266'958","last_deep_scrub_stamp":"2024-09-12T02:07:09.103056+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.103056+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":900,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:04.336294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4713,"num_read_kb":4229,"num_write":1343,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"266'291","reported_seq":952,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.962261+0000","last_change":"2024-09-12T02:07:02.962261+0000","last_active":"2024-09-12T02:07:02.962261+0000","last_peered":"2024-09-12T02:07:02.962261+0000","last_clean":"2024-09-12T02:07:02.962261+0000","last_became_active":"2024-09-12T00:09:59.288260+0000","last_became_peered":"2024-09-12T00:09:59.288260+0000","last_unstale":"2024-09-12T02:07:02.962261+0000","last_undegraded":"2024-09-12T02:07:02.962261+0000","last_fullsized":"2024-09-12T02:07:02.962261+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'291","last_scrub_stamp":"2024-09-12T02:07:02.961949+0000","last_deep_scrub":"266'291","last_deep_scrub_stamp":"2024-09-12T02:07:02.961949+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.961949+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:11.825052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":7701,"num_write":890,"num_write_kb":23188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"266'343","reported_seq":1900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.665257+0000","last_change":"2024-09-12T02:07:04.665101+0000","last_active":"2024-09-12T02:07:04.665257+0000","last_peered":"2024-09-12T02:07:04.665257+0000","last_clean":"2024-09-12T02:07:04.665257+0000","last_became_active":"2024-09-12T00:10:01.265676+0000","last_became_peered":"2024-09-12T00:10:01.265676+0000","last_unstale":"2024-09-12T02:07:04.665257+0000","last_undegraded":"2024-09-12T02:07:04.665257+0000","last_fullsized":"2024-09-12T02:07:04.665257+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'343","last_scrub_stamp":"2024-09-12T02:07:04.664920+0000","last_deep_scrub":"266'343","last_deep_scrub_stamp":"2024-09-12T02:07:04.664920+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.664920+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:06.623311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1939,"num_read_kb":1902,"num_write":362,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"266'308","reported_seq":975,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.656753+0000","last_change":"2024-09-12T02:07:03.656753+0000","last_active":"2024-09-12T02:07:03.656753+0000","last_peered":"2024-09-12T02:07:03.656753+0000","last_clean":"2024-09-12T02:07:03.656753+0000","last_became_active":"2024-09-12T00:09:59.311132+0000","last_became_peered":"2024-09-12T00:09:59.311132+0000","last_unstale":"2024-09-12T02:07:03.656753+0000","last_undegraded":"2024-09-12T02:07:03.656753+0000","last_fullsized":"2024-09-12T02:07:03.656753+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'308","last_scrub_stamp":"2024-09-12T02:07:03.656539+0000","last_deep_scrub":"266'308","last_deep_scrub_stamp":"2024-09-12T02:07:03.656539+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.656539+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:24.830436+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190249,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":37892,"num_write":1016,"num_write_kb":21146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"266'932","reported_seq":2559,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.117490+0000","last_change":"2024-09-12T02:07:08.117490+0000","last_active":"2024-09-12T02:07:08.117490+0000","last_peered":"2024-09-12T02:07:08.117490+0000","last_clean":"2024-09-12T02:07:08.117490+0000","last_became_active":"2024-09-12T00:10:01.255682+0000","last_became_peered":"2024-09-12T00:10:01.255682+0000","last_unstale":"2024-09-12T02:07:08.117490+0000","last_undegraded":"2024-09-12T02:07:08.117490+0000","last_fullsized":"2024-09-12T02:07:08.117490+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'932","last_scrub_stamp":"2024-09-12T02:07:08.117306+0000","last_deep_scrub":"266'932","last_deep_scrub_stamp":"2024-09-12T02:07:08.117306+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.117306+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":900,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:01.030752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4312,"num_read_kb":3831,"num_write":1239,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"266'335","reported_seq":1027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.528788+0000","last_change":"2024-09-12T02:06:59.528788+0000","last_active":"2024-09-12T02:06:59.528788+0000","last_peered":"2024-09-12T02:06:59.528788+0000","last_clean":"2024-09-12T02:06:59.528788+0000","last_became_active":"2024-09-12T00:09:59.300699+0000","last_became_peered":"2024-09-12T00:09:59.300699+0000","last_unstale":"2024-09-12T02:06:59.528788+0000","last_undegraded":"2024-09-12T02:06:59.528788+0000","last_fullsized":"2024-09-12T02:06:59.528788+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'335","last_scrub_stamp":"2024-09-12T02:06:59.528507+0000","last_deep_scrub":"266'335","last_deep_scrub_stamp":"2024-09-12T02:06:59.528507+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.528507+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:11.541603+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315873,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":7533,"num_write":1090,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"266'859","reported_seq":2546,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.819973+0000","last_change":"2024-09-12T02:07:08.819973+0000","last_active":"2024-09-12T02:07:08.819973+0000","last_peered":"2024-09-12T02:07:08.819973+0000","last_clean":"2024-09-12T02:07:08.819973+0000","last_became_active":"2024-09-12T00:10:01.264795+0000","last_became_peered":"2024-09-12T00:10:01.264795+0000","last_unstale":"2024-09-12T02:07:08.819973+0000","last_undegraded":"2024-09-12T02:07:08.819973+0000","last_fullsized":"2024-09-12T02:07:08.819973+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'859","last_scrub_stamp":"2024-09-12T02:07:08.819764+0000","last_deep_scrub":"266'859","last_deep_scrub_stamp":"2024-09-12T02:07:08.819764+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.819764+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:26.975796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3745,"num_write":1135,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"266'384","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.144719+0000","last_change":"2024-09-12T02:06:59.144719+0000","last_active":"2024-09-12T02:06:59.144719+0000","last_peered":"2024-09-12T02:06:59.144719+0000","last_clean":"2024-09-12T02:06:59.144719+0000","last_became_active":"2024-09-12T00:09:59.299516+0000","last_became_peered":"2024-09-12T00:09:59.299516+0000","last_unstale":"2024-09-12T02:06:59.144719+0000","last_undegraded":"2024-09-12T02:06:59.144719+0000","last_fullsized":"2024-09-12T02:06:59.144719+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'384","last_scrub_stamp":"2024-09-12T02:06:59.144457+0000","last_deep_scrub":"266'384","last_deep_scrub_stamp":"2024-09-12T02:06:59.144457+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.144457+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:38.499358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":14945,"num_write":1232,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"266'500","reported_seq":2143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.526816+0000","last_change":"2024-09-12T02:07:08.526816+0000","last_active":"2024-09-12T02:07:08.526816+0000","last_peered":"2024-09-12T02:07:08.526816+0000","last_clean":"2024-09-12T02:07:08.526816+0000","last_became_active":"2024-09-12T00:10:01.258691+0000","last_became_peered":"2024-09-12T00:10:01.258691+0000","last_unstale":"2024-09-12T02:07:08.526816+0000","last_undegraded":"2024-09-12T02:07:08.526816+0000","last_fullsized":"2024-09-12T02:07:08.526816+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'500","last_scrub_stamp":"2024-09-12T02:07:08.526620+0000","last_deep_scrub":"266'500","last_deep_scrub_stamp":"2024-09-12T02:07:08.526620+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.526620+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:10.056735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2775,"num_read_kb":2593,"num_write":624,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"266'376","reported_seq":1046,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.800705+0000","last_change":"2024-09-12T02:07:02.800570+0000","last_active":"2024-09-12T02:07:02.800705+0000","last_peered":"2024-09-12T02:07:02.800705+0000","last_clean":"2024-09-12T02:07:02.800705+0000","last_became_active":"2024-09-12T00:09:59.313345+0000","last_became_peered":"2024-09-12T00:09:59.313345+0000","last_unstale":"2024-09-12T02:07:02.800705+0000","last_undegraded":"2024-09-12T02:07:02.800705+0000","last_fullsized":"2024-09-12T02:07:02.800705+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'376","last_scrub_stamp":"2024-09-12T02:07:02.800345+0000","last_deep_scrub":"266'376","last_deep_scrub_stamp":"2024-09-12T02:07:02.800345+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.800345+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:51.023798+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4483063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":14481,"num_write":1098,"num_write_kb":25771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"266'326","reported_seq":1756,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.927377+0000","last_change":"2024-09-12T02:07:10.927377+0000","last_active":"2024-09-12T02:07:10.927377+0000","last_peered":"2024-09-12T02:07:10.927377+0000","last_clean":"2024-09-12T02:07:10.927377+0000","last_became_active":"2024-09-12T00:10:01.249832+0000","last_became_peered":"2024-09-12T00:10:01.249832+0000","last_unstale":"2024-09-12T02:07:10.927377+0000","last_undegraded":"2024-09-12T02:07:10.927377+0000","last_fullsized":"2024-09-12T02:07:10.927377+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'326","last_scrub_stamp":"2024-09-12T02:07:10.927188+0000","last_deep_scrub":"266'326","last_deep_scrub_stamp":"2024-09-12T02:07:10.927188+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.927188+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:40.299799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1802,"num_read_kb":1736,"num_write":351,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"266'317","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.657601+0000","last_change":"2024-09-12T02:06:54.657601+0000","last_active":"2024-09-12T02:06:54.657601+0000","last_peered":"2024-09-12T02:06:54.657601+0000","last_clean":"2024-09-12T02:06:54.657601+0000","last_became_active":"2024-09-12T00:09:59.311158+0000","last_became_peered":"2024-09-12T00:09:59.311158+0000","last_unstale":"2024-09-12T02:06:54.657601+0000","last_undegraded":"2024-09-12T02:06:54.657601+0000","last_fullsized":"2024-09-12T02:06:54.657601+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'317","last_scrub_stamp":"2024-09-12T02:06:54.657499+0000","last_deep_scrub":"266'317","last_deep_scrub_stamp":"2024-09-12T02:06:54.657499+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.657499+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:41.120241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316829,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":115277,"num_write":995,"num_write_kb":39549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"266'721","reported_seq":2272,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.820571+0000","last_change":"2024-09-12T02:07:07.820396+0000","last_active":"2024-09-12T02:07:07.820571+0000","last_peered":"2024-09-12T02:07:07.820571+0000","last_clean":"2024-09-12T02:07:07.820571+0000","last_became_active":"2024-09-12T00:10:01.267027+0000","last_became_peered":"2024-09-12T00:10:01.267027+0000","last_unstale":"2024-09-12T02:07:07.820571+0000","last_undegraded":"2024-09-12T02:07:07.820571+0000","last_fullsized":"2024-09-12T02:07:07.820571+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'721","last_scrub_stamp":"2024-09-12T02:07:07.820152+0000","last_deep_scrub":"266'721","last_deep_scrub_stamp":"2024-09-12T02:07:07.820152+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.820152+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:54.864599+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3526,"num_read_kb":3200,"num_write":1050,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"266'331","reported_seq":1002,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.617366+0000","last_change":"2024-09-12T02:07:04.617366+0000","last_active":"2024-09-12T02:07:04.617366+0000","last_peered":"2024-09-12T02:07:04.617366+0000","last_clean":"2024-09-12T02:07:04.617366+0000","last_became_active":"2024-09-12T00:09:59.285907+0000","last_became_peered":"2024-09-12T00:09:59.285907+0000","last_unstale":"2024-09-12T02:07:04.617366+0000","last_undegraded":"2024-09-12T02:07:04.617366+0000","last_fullsized":"2024-09-12T02:07:04.617366+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'331","last_scrub_stamp":"2024-09-12T02:07:04.617081+0000","last_deep_scrub":"266'331","last_deep_scrub_stamp":"2024-09-12T02:07:04.617081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.617081+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:36.016645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569458,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":44645,"num_write":951,"num_write_kb":42281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"266'334","reported_seq":1017,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.598905+0000","last_change":"2024-09-12T02:07:07.598905+0000","last_active":"2024-09-12T02:07:07.598905+0000","last_peered":"2024-09-12T02:07:07.598905+0000","last_clean":"2024-09-12T02:07:07.598905+0000","last_became_active":"2024-09-12T00:09:59.282446+0000","last_became_peered":"2024-09-12T00:09:59.282446+0000","last_unstale":"2024-09-12T02:07:07.598905+0000","last_undegraded":"2024-09-12T02:07:07.598905+0000","last_fullsized":"2024-09-12T02:07:07.598905+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'334","last_scrub_stamp":"2024-09-12T02:07:07.598535+0000","last_deep_scrub":"266'334","last_deep_scrub_stamp":"2024-09-12T02:07:07.598535+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.598535+0000","objects_scrubbed":10,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:11.077428+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2535841,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":492,"num_read_kb":44688,"num_write":1069,"num_write_kb":33304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"266'458","reported_seq":2039,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.548533+0000","last_change":"2024-09-12T02:07:09.548533+0000","last_active":"2024-09-12T02:07:09.548533+0000","last_peered":"2024-09-12T02:07:09.548533+0000","last_clean":"2024-09-12T02:07:09.548533+0000","last_became_active":"2024-09-12T00:10:01.247767+0000","last_became_peered":"2024-09-12T00:10:01.247767+0000","last_unstale":"2024-09-12T02:07:09.548533+0000","last_undegraded":"2024-09-12T02:07:09.548533+0000","last_fullsized":"2024-09-12T02:07:09.548533+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T02:07:09.548332+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T02:07:09.548332+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.548332+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:46.662531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2488,"num_read_kb":2350,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"266'350","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.349649+0000","last_change":"2024-09-12T02:07:02.349649+0000","last_active":"2024-09-12T02:07:02.349649+0000","last_peered":"2024-09-12T02:07:02.349649+0000","last_clean":"2024-09-12T02:07:02.349649+0000","last_became_active":"2024-09-12T00:10:31.168444+0000","last_became_peered":"2024-09-12T00:10:31.168444+0000","last_unstale":"2024-09-12T02:07:02.349649+0000","last_undegraded":"2024-09-12T02:07:02.349649+0000","last_fullsized":"2024-09-12T02:07:02.349649+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'350","last_scrub_stamp":"2024-09-12T02:07:02.349335+0000","last_deep_scrub":"266'350","last_deep_scrub_stamp":"2024-09-12T02:07:02.349335+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.349335+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:22.134489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400029,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":20125,"num_write":1291,"num_write_kb":40521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,0],"acting":[1,4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"266'1090","reported_seq":2780,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.583557+0000","last_change":"2024-09-12T02:07:12.583557+0000","last_active":"2024-09-12T02:07:12.583557+0000","last_peered":"2024-09-12T02:07:12.583557+0000","last_clean":"2024-09-12T02:07:12.583557+0000","last_became_active":"2024-09-12T00:10:01.278762+0000","last_became_peered":"2024-09-12T00:10:01.278762+0000","last_unstale":"2024-09-12T02:07:12.583557+0000","last_undegraded":"2024-09-12T02:07:12.583557+0000","last_fullsized":"2024-09-12T02:07:12.583557+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1090","last_scrub_stamp":"2024-09-12T02:07:12.583390+0000","last_deep_scrub":"266'1090","last_deep_scrub_stamp":"2024-09-12T02:07:12.583390+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.583390+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":1000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:04.451087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5202,"num_read_kb":4573,"num_write":1592,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6060,"num_read_kb":4225,"num_write":1955,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6200,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1028,"ondisk_log_size":1028,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":15149,"num_read_kb":14793,"num_write":16764,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2870,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1972,"ondisk_log_size":1972,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440,"ondisk_log_size":440,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1579968,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":21268,"num_read_kb":40714,"num_write":17731,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":677416,"num_omap_keys":1576,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1913,"ondisk_log_size":1913,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213079,"num_read_kb":194397,"num_write":55367,"num_write_kb":18884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43514,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3932,"ondisk_log_size":3932,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":73602788,"num_objects":381,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":381,"num_whiteouts":0,"num_read":36353,"num_read_kb":1955827,"num_write":72080,"num_write_kb":2110952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100646912,"data_stored":100646912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3518,"ondisk_log_size":3518,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":180842,"num_write":186,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":169574,"num_write":186,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543568,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341692,"kb_used_data":17580,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94030148,"statfs":{"total":96636764160,"available":96286871552,"internally_reserved":0,"allocated":18001920,"data_stored":15991149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543568,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306672,"kb_used_data":18656,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94065168,"statfs":{"total":96636764160,"available":96322732032,"internally_reserved":0,"allocated":19103744,"data_stored":17151124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294910406},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543574,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191148,"kb_used_data":15644,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94180692,"statfs":{"total":96636764160,"available":96441028608,"internally_reserved":0,"allocated":16019456,"data_stored":13989543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543569,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162872,"kb_used_data":15080,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":94208968,"statfs":{"total":96636764160,"available":96469983232,"internally_reserved":0,"allocated":15441920,"data_stored":13515589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543571,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308428,"kb_used_data":20412,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94063412,"statfs":{"total":96636764160,"available":96320933888,"internally_reserved":0,"allocated":20901888,"data_stored":18895025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":294910407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543569,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117028,"kb_used_data":13652,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94254812,"statfs":{"total":96636764160,"available":96516927488,"internally_reserved":0,"allocated":13979648,"data_stored":12036246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543571,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195036,"kb_used_data":11212,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94176804,"statfs":{"total":96636764160,"available":96437047296,"internally_reserved":0,"allocated":11481088,"data_stored":9500646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543570,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308548,"kb_used_data":20596,"kb_used_omap":1,"kb_used_meta":287934,"kb_avail":94063292,"statfs":{"total":96636764160,"available":96320811008,"internally_reserved":0,"allocated":21090304,"data_stored":19083000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294844869},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16199680,"data_stored":16199680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7208960,"data_stored":7208960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9744384,"data_stored":9744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16601088,"data_stored":16601088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11227136,"data_stored":11227136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11698176,"data_stored":11698176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14860288,"data_stored":14860288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13107200,"data_stored":13107200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:07:56.702 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:56.702 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:56.703 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:56.703 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:56.703 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:00:23.014820+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=0, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:07:56.707 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:08:16.708 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:08:17.074 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-12T02:08:17.088 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-12T02:08:17.102 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":3816,"stamp":"2024-09-12T02:08:16.955996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":75791055,"num_objects":883,"num_object_clones":0,"num_object_copies":2528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":294733,"num_read_kb":2563326,"num_write":164412,"num_write_kb":2404914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":212,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731128,"num_omap_keys":1796,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13164,"ondisk_log_size":13164,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1931424,"kb_used_data":132832,"kb_used_omap":12,"kb_used_meta":1798451,"kb_avail":753043296,"statfs":{"total":773094113280,"available":771116335104,"internally_reserved":0,"allocated":136019968,"data_stored":120162322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1841614384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009288"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:42.756368+0000","last_change":"2024-09-12T02:07:42.756232+0000","last_active":"2024-09-12T02:07:42.756368+0000","last_peered":"2024-09-12T02:07:42.756368+0000","last_clean":"2024-09-12T02:07:42.756368+0000","last_became_active":"2024-09-12T01:00:24.086540+0000","last_became_peered":"2024-09-12T01:00:24.086540+0000","last_unstale":"2024-09-12T02:07:42.756368+0000","last_undegraded":"2024-09-12T02:07:42.756368+0000","last_fullsized":"2024-09-12T02:07:42.756368+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:42.756030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:42.756030+0000","last_clean_scrub_stamp":"2024-09-12T02:07:42.756030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:03.073905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"266'3","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.774725+0000","last_change":"2024-09-12T02:07:41.774725+0000","last_active":"2024-09-12T02:07:41.774725+0000","last_peered":"2024-09-12T02:07:41.774725+0000","last_clean":"2024-09-12T02:07:41.774725+0000","last_became_active":"2024-09-12T00:32:21.645757+0000","last_became_peered":"2024-09-12T00:32:21.645757+0000","last_unstale":"2024-09-12T02:07:41.774725+0000","last_undegraded":"2024-09-12T02:07:41.774725+0000","last_fullsized":"2024-09-12T02:07:41.774725+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:07:41.774549+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:07:41.774549+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.774549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:23.003873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"266'6","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:44.158000+0000","last_change":"2024-09-12T02:07:44.158000+0000","last_active":"2024-09-12T02:07:44.158000+0000","last_peered":"2024-09-12T02:07:44.158000+0000","last_clean":"2024-09-12T02:07:44.158000+0000","last_became_active":"2024-09-12T00:32:14.592177+0000","last_became_peered":"2024-09-12T00:32:14.592177+0000","last_unstale":"2024-09-12T02:07:44.158000+0000","last_undegraded":"2024-09-12T02:07:44.158000+0000","last_fullsized":"2024-09-12T02:07:44.158000+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T02:07:44.157816+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T02:07:44.157816+0000","last_clean_scrub_stamp":"2024-09-12T02:07:44.157816+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:13.802116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8188,"num_write":6,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"266'29","reported_seq":172,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:39.477466+0000","last_change":"2024-09-12T02:07:39.477466+0000","last_active":"2024-09-12T02:07:39.477466+0000","last_peered":"2024-09-12T02:07:39.477466+0000","last_clean":"2024-09-12T02:07:39.477466+0000","last_became_active":"2024-09-12T00:26:23.353338+0000","last_became_peered":"2024-09-12T00:26:23.353338+0000","last_unstale":"2024-09-12T02:07:39.477466+0000","last_undegraded":"2024-09-12T02:07:39.477466+0000","last_fullsized":"2024-09-12T02:07:39.477466+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'29","last_scrub_stamp":"2024-09-12T02:07:39.477274+0000","last_deep_scrub":"266'29","last_deep_scrub_stamp":"2024-09-12T02:07:39.477274+0000","last_clean_scrub_stamp":"2024-09-12T02:07:39.477274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:06.802116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":54,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.603840+0000","last_change":"2024-09-12T02:07:19.603682+0000","last_active":"2024-09-12T02:07:19.603840+0000","last_peered":"2024-09-12T02:07:19.603840+0000","last_clean":"2024-09-12T02:07:19.603840+0000","last_became_active":"2024-09-12T01:00:24.074048+0000","last_became_peered":"2024-09-12T01:00:24.074048+0000","last_unstale":"2024-09-12T02:07:19.603840+0000","last_undegraded":"2024-09-12T02:07:19.603840+0000","last_fullsized":"2024-09-12T02:07:19.603840+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:19.603508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:19.603508+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.603508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:29.733337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"266'13","reported_seq":93,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:40.046693+0000","last_change":"2024-09-12T02:07:40.046693+0000","last_active":"2024-09-12T02:07:40.046693+0000","last_peered":"2024-09-12T02:07:40.046693+0000","last_clean":"2024-09-12T02:07:40.046693+0000","last_became_active":"2024-09-12T00:32:21.642967+0000","last_became_peered":"2024-09-12T00:32:21.642967+0000","last_unstale":"2024-09-12T02:07:40.046693+0000","last_undegraded":"2024-09-12T02:07:40.046693+0000","last_fullsized":"2024-09-12T02:07:40.046693+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'13","last_scrub_stamp":"2024-09-12T02:07:40.046510+0000","last_deep_scrub":"266'13","last_deep_scrub_stamp":"2024-09-12T02:07:40.046510+0000","last_clean_scrub_stamp":"2024-09-12T02:07:40.046510+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:42.677811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24594,"num_write":18,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.630593+0000","last_change":"2024-09-12T02:07:32.630593+0000","last_active":"2024-09-12T02:07:32.630593+0000","last_peered":"2024-09-12T02:07:32.630593+0000","last_clean":"2024-09-12T02:07:32.630593+0000","last_became_active":"2024-09-12T00:32:14.602766+0000","last_became_peered":"2024-09-12T00:32:14.602766+0000","last_unstale":"2024-09-12T02:07:32.630593+0000","last_undegraded":"2024-09-12T02:07:32.630593+0000","last_fullsized":"2024-09-12T02:07:32.630593+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:32.630411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:32.630411+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.630411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:11.014809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"266'26","reported_seq":159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.641746+0000","last_change":"2024-09-12T02:07:13.641746+0000","last_active":"2024-09-12T02:07:13.641746+0000","last_peered":"2024-09-12T02:07:13.641746+0000","last_clean":"2024-09-12T02:07:13.641746+0000","last_became_active":"2024-09-12T00:26:23.321682+0000","last_became_peered":"2024-09-12T00:26:23.321682+0000","last_unstale":"2024-09-12T02:07:13.641746+0000","last_undegraded":"2024-09-12T02:07:13.641746+0000","last_fullsized":"2024-09-12T02:07:13.641746+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T02:07:13.641577+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T02:07:13.641577+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.641577+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:11.157660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.038734+0000","last_change":"2024-09-12T02:07:31.038572+0000","last_active":"2024-09-12T02:07:31.038734+0000","last_peered":"2024-09-12T02:07:31.038734+0000","last_clean":"2024-09-12T02:07:31.038734+0000","last_became_active":"2024-09-12T01:00:24.075719+0000","last_became_peered":"2024-09-12T01:00:24.075719+0000","last_unstale":"2024-09-12T02:07:31.038734+0000","last_undegraded":"2024-09-12T02:07:31.038734+0000","last_fullsized":"2024-09-12T02:07:31.038734+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:31.038391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:31.038391+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.038391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:19.895065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"266'2","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:47.433305+0000","last_change":"2024-09-12T02:07:47.433165+0000","last_active":"2024-09-12T02:07:47.433305+0000","last_peered":"2024-09-12T02:07:47.433305+0000","last_clean":"2024-09-12T02:07:47.433305+0000","last_became_active":"2024-09-12T00:32:21.663938+0000","last_became_peered":"2024-09-12T00:32:21.663938+0000","last_unstale":"2024-09-12T02:07:47.433305+0000","last_undegraded":"2024-09-12T02:07:47.433305+0000","last_fullsized":"2024-09-12T02:07:47.433305+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:47.432953+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:47.432953+0000","last_clean_scrub_stamp":"2024-09-12T02:07:47.432953+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:11.335489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"266'10","reported_seq":103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.591891+0000","last_change":"2024-09-12T02:07:16.591891+0000","last_active":"2024-09-12T02:07:16.591891+0000","last_peered":"2024-09-12T02:07:16.591891+0000","last_clean":"2024-09-12T02:07:16.591891+0000","last_became_active":"2024-09-12T00:32:14.597094+0000","last_became_peered":"2024-09-12T00:32:14.597094+0000","last_unstale":"2024-09-12T02:07:16.591891+0000","last_undegraded":"2024-09-12T02:07:16.591891+0000","last_fullsized":"2024-09-12T02:07:16.591891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T02:07:16.591704+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T02:07:16.591704+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.591704+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:05.717857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":24574,"num_write":20,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"266'4","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.460160+0000","last_change":"2024-09-12T02:07:35.460160+0000","last_active":"2024-09-12T02:07:35.460160+0000","last_peered":"2024-09-12T02:07:35.460160+0000","last_clean":"2024-09-12T02:07:35.460160+0000","last_became_active":"2024-09-12T00:26:23.349476+0000","last_became_peered":"2024-09-12T00:26:23.349476+0000","last_unstale":"2024-09-12T02:07:35.460160+0000","last_undegraded":"2024-09-12T02:07:35.460160+0000","last_fullsized":"2024-09-12T02:07:35.460160+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:35.459980+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:35.459980+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.459980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:03.773640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":14,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:55.160833+0000","last_change":"2024-09-12T02:07:55.160701+0000","last_active":"2024-09-12T02:07:55.160833+0000","last_peered":"2024-09-12T02:07:55.160833+0000","last_clean":"2024-09-12T02:07:55.160833+0000","last_became_active":"2024-09-12T01:00:24.069555+0000","last_became_peered":"2024-09-12T01:00:24.069555+0000","last_unstale":"2024-09-12T02:07:55.160833+0000","last_undegraded":"2024-09-12T02:07:55.160833+0000","last_fullsized":"2024-09-12T02:07:55.160833+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:55.160521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:55.160521+0000","last_clean_scrub_stamp":"2024-09-12T02:07:55.160521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:28.301667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"266'2","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:53.134459+0000","last_change":"2024-09-12T02:07:53.134459+0000","last_active":"2024-09-12T02:07:53.134459+0000","last_peered":"2024-09-12T02:07:53.134459+0000","last_clean":"2024-09-12T02:07:53.134459+0000","last_became_active":"2024-09-12T00:32:21.654241+0000","last_became_peered":"2024-09-12T00:32:21.654241+0000","last_unstale":"2024-09-12T02:07:53.134459+0000","last_undegraded":"2024-09-12T02:07:53.134459+0000","last_fullsized":"2024-09-12T02:07:53.134459+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:53.134278+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:53.134278+0000","last_clean_scrub_stamp":"2024-09-12T02:07:53.134278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:11.124471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"266'13","reported_seq":107,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.171436+0000","last_change":"2024-09-12T02:07:34.171277+0000","last_active":"2024-09-12T02:07:34.171436+0000","last_peered":"2024-09-12T02:07:34.171436+0000","last_clean":"2024-09-12T02:07:34.171436+0000","last_became_active":"2024-09-12T00:32:14.586250+0000","last_became_peered":"2024-09-12T00:32:14.586250+0000","last_unstale":"2024-09-12T02:07:34.171436+0000","last_undegraded":"2024-09-12T02:07:34.171436+0000","last_fullsized":"2024-09-12T02:07:34.171436+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'13","last_scrub_stamp":"2024-09-12T02:07:34.171097+0000","last_deep_scrub":"266'13","last_deep_scrub_stamp":"2024-09-12T02:07:34.171097+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.171097+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:50.656809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":31734,"num_write":18,"num_write_kb":19452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"266'26","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.155849+0000","last_change":"2024-09-12T02:07:41.155849+0000","last_active":"2024-09-12T02:07:41.155849+0000","last_peered":"2024-09-12T02:07:41.155849+0000","last_clean":"2024-09-12T02:07:41.155849+0000","last_became_active":"2024-09-12T00:26:23.327186+0000","last_became_peered":"2024-09-12T00:26:23.327186+0000","last_unstale":"2024-09-12T02:07:41.155849+0000","last_undegraded":"2024-09-12T02:07:41.155849+0000","last_fullsized":"2024-09-12T02:07:41.155849+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T02:07:41.155665+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T02:07:41.155665+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.155665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:14.701037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:58.171924+0000","last_change":"2024-09-12T02:07:58.171924+0000","last_active":"2024-09-12T02:07:58.171924+0000","last_peered":"2024-09-12T02:07:58.171924+0000","last_clean":"2024-09-12T02:07:58.171924+0000","last_became_active":"2024-09-12T01:00:24.077651+0000","last_became_peered":"2024-09-12T01:00:24.077651+0000","last_unstale":"2024-09-12T02:07:58.171924+0000","last_undegraded":"2024-09-12T02:07:58.171924+0000","last_fullsized":"2024-09-12T02:07:58.171924+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:58.171708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:58.171708+0000","last_clean_scrub_stamp":"2024-09-12T02:07:58.171708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:18.010876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"266'5","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:37.751083+0000","last_change":"2024-09-12T02:07:37.751083+0000","last_active":"2024-09-12T02:07:37.751083+0000","last_peered":"2024-09-12T02:07:37.751083+0000","last_clean":"2024-09-12T02:07:37.751083+0000","last_became_active":"2024-09-12T00:32:21.649921+0000","last_became_peered":"2024-09-12T00:32:21.649921+0000","last_unstale":"2024-09-12T02:07:37.751083+0000","last_undegraded":"2024-09-12T02:07:37.751083+0000","last_fullsized":"2024-09-12T02:07:37.751083+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T02:07:37.750900+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T02:07:37.750900+0000","last_clean_scrub_stamp":"2024-09-12T02:07:37.750900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:39.881432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"263'2","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.422674+0000","last_change":"2024-09-12T02:07:41.422674+0000","last_active":"2024-09-12T02:07:41.422674+0000","last_peered":"2024-09-12T02:07:41.422674+0000","last_clean":"2024-09-12T02:07:41.422674+0000","last_became_active":"2024-09-12T00:32:14.607652+0000","last_became_peered":"2024-09-12T00:32:14.607652+0000","last_unstale":"2024-09-12T02:07:41.422674+0000","last_undegraded":"2024-09-12T02:07:41.422674+0000","last_fullsized":"2024-09-12T02:07:41.422674+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:41.422393+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:41.422393+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.422393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:31.632199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"266'15","reported_seq":122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:45.197194+0000","last_change":"2024-09-12T02:07:45.197194+0000","last_active":"2024-09-12T02:07:45.197194+0000","last_peered":"2024-09-12T02:07:45.197194+0000","last_clean":"2024-09-12T02:07:45.197194+0000","last_became_active":"2024-09-12T00:26:23.339416+0000","last_became_peered":"2024-09-12T00:26:23.339416+0000","last_unstale":"2024-09-12T02:07:45.197194+0000","last_undegraded":"2024-09-12T02:07:45.197194+0000","last_fullsized":"2024-09-12T02:07:45.197194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'15","last_scrub_stamp":"2024-09-12T02:07:45.197018+0000","last_deep_scrub":"266'15","last_deep_scrub_stamp":"2024-09-12T02:07:45.197018+0000","last_clean_scrub_stamp":"2024-09-12T02:07:45.197018+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:52.283764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":51,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.625013+0000","last_change":"2024-09-12T02:07:35.625013+0000","last_active":"2024-09-12T02:07:35.625013+0000","last_peered":"2024-09-12T02:07:35.625013+0000","last_clean":"2024-09-12T02:07:35.625013+0000","last_became_active":"2024-09-12T01:00:24.064732+0000","last_became_peered":"2024-09-12T01:00:24.064732+0000","last_unstale":"2024-09-12T02:07:35.625013+0000","last_undegraded":"2024-09-12T02:07:35.625013+0000","last_fullsized":"2024-09-12T02:07:35.625013+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:35.624837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:35.624837+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.624837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:39.151157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"266'2","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.059543+0000","last_change":"2024-09-12T02:07:28.059543+0000","last_active":"2024-09-12T02:07:28.059543+0000","last_peered":"2024-09-12T02:07:28.059543+0000","last_clean":"2024-09-12T02:07:28.059543+0000","last_became_active":"2024-09-12T00:32:21.649260+0000","last_became_peered":"2024-09-12T00:32:21.649260+0000","last_unstale":"2024-09-12T02:07:28.059543+0000","last_undegraded":"2024-09-12T02:07:28.059543+0000","last_fullsized":"2024-09-12T02:07:28.059543+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:28.059317+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:28.059317+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.059317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:55.872980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'3","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.122988+0000","last_change":"2024-09-12T02:07:32.122988+0000","last_active":"2024-09-12T02:07:32.122988+0000","last_peered":"2024-09-12T02:07:32.122988+0000","last_clean":"2024-09-12T02:07:32.122988+0000","last_became_active":"2024-09-12T00:32:14.582112+0000","last_became_peered":"2024-09-12T00:32:14.582112+0000","last_unstale":"2024-09-12T02:07:32.122988+0000","last_undegraded":"2024-09-12T02:07:32.122988+0000","last_fullsized":"2024-09-12T02:07:32.122988+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T02:07:32.122794+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T02:07:32.122794+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.122794+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:51.853305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"266'89","reported_seq":408,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.124608+0000","last_change":"2024-09-12T02:07:23.124608+0000","last_active":"2024-09-12T02:07:23.124608+0000","last_peered":"2024-09-12T02:07:23.124608+0000","last_clean":"2024-09-12T02:07:23.124608+0000","last_became_active":"2024-09-12T00:26:23.328597+0000","last_became_peered":"2024-09-12T00:26:23.328597+0000","last_unstale":"2024-09-12T02:07:23.124608+0000","last_undegraded":"2024-09-12T02:07:23.124608+0000","last_fullsized":"2024-09-12T02:07:23.124608+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'89","last_scrub_stamp":"2024-09-12T02:07:23.124434+0000","last_deep_scrub":"266'89","last_deep_scrub_stamp":"2024-09-12T02:07:23.124434+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.124434+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:13.201981+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":416,"num_write":108,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2480,"num_omap_keys":5,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:50.979004+0000","last_change":"2024-09-12T02:07:50.978867+0000","last_active":"2024-09-12T02:07:50.979004+0000","last_peered":"2024-09-12T02:07:50.979004+0000","last_clean":"2024-09-12T02:07:50.979004+0000","last_became_active":"2024-09-12T01:00:24.071095+0000","last_became_peered":"2024-09-12T01:00:24.071095+0000","last_unstale":"2024-09-12T02:07:50.979004+0000","last_undegraded":"2024-09-12T02:07:50.979004+0000","last_fullsized":"2024-09-12T02:07:50.979004+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:50.978694+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:50.978694+0000","last_clean_scrub_stamp":"2024-09-12T02:07:50.978694+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:51.350546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"266'9","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.049495+0000","last_change":"2024-09-12T02:07:30.049495+0000","last_active":"2024-09-12T02:07:30.049495+0000","last_peered":"2024-09-12T02:07:30.049495+0000","last_clean":"2024-09-12T02:07:30.049495+0000","last_became_active":"2024-09-12T00:32:21.643876+0000","last_became_peered":"2024-09-12T00:32:21.643876+0000","last_unstale":"2024-09-12T02:07:30.049495+0000","last_undegraded":"2024-09-12T02:07:30.049495+0000","last_fullsized":"2024-09-12T02:07:30.049495+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:30.049304+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:30.049304+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.049304+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:28.552406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10236,"num_write":14,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":88,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.152111+0000","last_change":"2024-09-12T02:07:33.152111+0000","last_active":"2024-09-12T02:07:33.152111+0000","last_peered":"2024-09-12T02:07:33.152111+0000","last_clean":"2024-09-12T02:07:33.152111+0000","last_became_active":"2024-09-12T00:32:14.588375+0000","last_became_peered":"2024-09-12T00:32:14.588375+0000","last_unstale":"2024-09-12T02:07:33.152111+0000","last_undegraded":"2024-09-12T02:07:33.152111+0000","last_fullsized":"2024-09-12T02:07:33.152111+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T02:07:33.151911+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T02:07:33.151911+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.151911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:18.994536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7178,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"266'62","reported_seq":256,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:37.483303+0000","last_change":"2024-09-12T02:07:37.483303+0000","last_active":"2024-09-12T02:07:37.483303+0000","last_peered":"2024-09-12T02:07:37.483303+0000","last_clean":"2024-09-12T02:07:37.483303+0000","last_became_active":"2024-09-12T00:26:23.336278+0000","last_became_peered":"2024-09-12T00:26:23.336278+0000","last_unstale":"2024-09-12T02:07:37.483303+0000","last_undegraded":"2024-09-12T02:07:37.483303+0000","last_fullsized":"2024-09-12T02:07:37.483303+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'62","last_scrub_stamp":"2024-09-12T02:07:37.483132+0000","last_deep_scrub":"266'62","last_deep_scrub_stamp":"2024-09-12T02:07:37.483132+0000","last_clean_scrub_stamp":"2024-09-12T02:07:37.483132+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:23.010163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":329,"num_read_kb":248,"num_write":95,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:49.959504+0000","last_change":"2024-09-12T02:07:49.959330+0000","last_active":"2024-09-12T02:07:49.959504+0000","last_peered":"2024-09-12T02:07:49.959504+0000","last_clean":"2024-09-12T02:07:49.959504+0000","last_became_active":"2024-09-12T01:00:24.078120+0000","last_became_peered":"2024-09-12T01:00:24.078120+0000","last_unstale":"2024-09-12T02:07:49.959504+0000","last_undegraded":"2024-09-12T02:07:49.959504+0000","last_fullsized":"2024-09-12T02:07:49.959504+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:49.959154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:49.959154+0000","last_clean_scrub_stamp":"2024-09-12T02:07:49.959154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:40.513092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:50.127718+0000","last_change":"2024-09-12T02:07:50.127718+0000","last_active":"2024-09-12T02:07:50.127718+0000","last_peered":"2024-09-12T02:07:50.127718+0000","last_clean":"2024-09-12T02:07:50.127718+0000","last_became_active":"2024-09-12T00:32:21.650564+0000","last_became_peered":"2024-09-12T00:32:21.650564+0000","last_unstale":"2024-09-12T02:07:50.127718+0000","last_undegraded":"2024-09-12T02:07:50.127718+0000","last_fullsized":"2024-09-12T02:07:50.127718+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:50.127530+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:50.127530+0000","last_clean_scrub_stamp":"2024-09-12T02:07:50.127530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:42.273868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"263'2","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:52.382400+0000","last_change":"2024-09-12T02:07:52.382400+0000","last_active":"2024-09-12T02:07:52.382400+0000","last_peered":"2024-09-12T02:07:52.382400+0000","last_clean":"2024-09-12T02:07:52.382400+0000","last_became_active":"2024-09-12T00:32:14.600188+0000","last_became_peered":"2024-09-12T00:32:14.600188+0000","last_unstale":"2024-09-12T02:07:52.382400+0000","last_undegraded":"2024-09-12T02:07:52.382400+0000","last_fullsized":"2024-09-12T02:07:52.382400+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:52.382201+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:52.382201+0000","last_clean_scrub_stamp":"2024-09-12T02:07:52.382201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:03.157921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"266'14","reported_seq":121,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.570999+0000","last_change":"2024-09-12T02:07:22.570835+0000","last_active":"2024-09-12T02:07:22.570999+0000","last_peered":"2024-09-12T02:07:22.570999+0000","last_clean":"2024-09-12T02:07:22.570999+0000","last_became_active":"2024-09-12T00:26:23.325067+0000","last_became_peered":"2024-09-12T00:26:23.325067+0000","last_unstale":"2024-09-12T02:07:22.570999+0000","last_undegraded":"2024-09-12T02:07:22.570999+0000","last_fullsized":"2024-09-12T02:07:22.570999+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'14","last_scrub_stamp":"2024-09-12T02:07:22.570644+0000","last_deep_scrub":"266'14","last_deep_scrub_stamp":"2024-09-12T02:07:22.570644+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.570644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:26.839587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":47,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.600789+0000","last_change":"2024-09-12T02:07:34.600652+0000","last_active":"2024-09-12T02:07:34.600789+0000","last_peered":"2024-09-12T02:07:34.600789+0000","last_clean":"2024-09-12T02:07:34.600789+0000","last_became_active":"2024-09-12T01:00:24.075148+0000","last_became_peered":"2024-09-12T01:00:24.075148+0000","last_unstale":"2024-09-12T02:07:34.600789+0000","last_undegraded":"2024-09-12T02:07:34.600789+0000","last_fullsized":"2024-09-12T02:07:34.600789+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:34.600470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:34.600470+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.600470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:26.443709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:51.082711+0000","last_change":"2024-09-12T02:07:51.082711+0000","last_active":"2024-09-12T02:07:51.082711+0000","last_peered":"2024-09-12T02:07:51.082711+0000","last_clean":"2024-09-12T02:07:51.082711+0000","last_became_active":"2024-09-12T00:32:21.654214+0000","last_became_peered":"2024-09-12T00:32:21.654214+0000","last_unstale":"2024-09-12T02:07:51.082711+0000","last_undegraded":"2024-09-12T02:07:51.082711+0000","last_fullsized":"2024-09-12T02:07:51.082711+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:51.082523+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:51.082523+0000","last_clean_scrub_stamp":"2024-09-12T02:07:51.082523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:55.708897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'5","reported_seq":88,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.743133+0000","last_change":"2024-09-12T02:07:33.742982+0000","last_active":"2024-09-12T02:07:33.743133+0000","last_peered":"2024-09-12T02:07:33.743133+0000","last_clean":"2024-09-12T02:07:33.743133+0000","last_became_active":"2024-09-12T00:32:14.586101+0000","last_became_peered":"2024-09-12T00:32:14.586101+0000","last_unstale":"2024-09-12T02:07:33.743133+0000","last_undegraded":"2024-09-12T02:07:33.743133+0000","last_fullsized":"2024-09-12T02:07:33.743133+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T02:07:33.742797+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T02:07:33.742797+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.742797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:03.994396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"266'18","reported_seq":133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:36.501690+0000","last_change":"2024-09-12T02:07:36.501554+0000","last_active":"2024-09-12T02:07:36.501690+0000","last_peered":"2024-09-12T02:07:36.501690+0000","last_clean":"2024-09-12T02:07:36.501690+0000","last_became_active":"2024-09-12T00:26:23.338890+0000","last_became_peered":"2024-09-12T00:26:23.338890+0000","last_unstale":"2024-09-12T02:07:36.501690+0000","last_undegraded":"2024-09-12T02:07:36.501690+0000","last_fullsized":"2024-09-12T02:07:36.501690+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'18","last_scrub_stamp":"2024-09-12T02:07:36.501374+0000","last_deep_scrub":"266'18","last_deep_scrub_stamp":"2024-09-12T02:07:36.501374+0000","last_clean_scrub_stamp":"2024-09-12T02:07:36.501374+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:35.375448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":63,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.617207+0000","last_change":"2024-09-12T02:07:21.617072+0000","last_active":"2024-09-12T02:07:21.617207+0000","last_peered":"2024-09-12T02:07:21.617207+0000","last_clean":"2024-09-12T02:07:21.617207+0000","last_became_active":"2024-09-12T01:00:24.076081+0000","last_became_peered":"2024-09-12T01:00:24.076081+0000","last_unstale":"2024-09-12T02:07:21.617207+0000","last_undegraded":"2024-09-12T02:07:21.617207+0000","last_fullsized":"2024-09-12T02:07:21.617207+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:21.616889+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:21.616889+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.616889+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:11.136708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'5","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:47.213226+0000","last_change":"2024-09-12T02:07:47.213226+0000","last_active":"2024-09-12T02:07:47.213226+0000","last_peered":"2024-09-12T02:07:47.213226+0000","last_clean":"2024-09-12T02:07:47.213226+0000","last_became_active":"2024-09-12T00:32:21.659460+0000","last_became_peered":"2024-09-12T00:32:21.659460+0000","last_unstale":"2024-09-12T02:07:47.213226+0000","last_undegraded":"2024-09-12T02:07:47.213226+0000","last_fullsized":"2024-09-12T02:07:47.213226+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T02:07:47.213025+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T02:07:47.213025+0000","last_clean_scrub_stamp":"2024-09-12T02:07:47.213025+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:15.024057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"266'2","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:36.829003+0000","last_change":"2024-09-12T02:07:36.829003+0000","last_active":"2024-09-12T02:07:36.829003+0000","last_peered":"2024-09-12T02:07:36.829003+0000","last_clean":"2024-09-12T02:07:36.829003+0000","last_became_active":"2024-09-12T00:32:14.594973+0000","last_became_peered":"2024-09-12T00:32:14.594973+0000","last_unstale":"2024-09-12T02:07:36.829003+0000","last_undegraded":"2024-09-12T02:07:36.829003+0000","last_fullsized":"2024-09-12T02:07:36.829003+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:36.828820+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:36.828820+0000","last_clean_scrub_stamp":"2024-09-12T02:07:36.828820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:12.619826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.950210+0000","last_change":"2024-09-12T02:07:35.950125+0000","last_active":"2024-09-12T02:07:35.950210+0000","last_peered":"2024-09-12T02:07:35.950210+0000","last_clean":"2024-09-12T02:07:35.950210+0000","last_became_active":"2024-09-12T00:26:23.338462+0000","last_became_peered":"2024-09-12T00:26:23.338462+0000","last_unstale":"2024-09-12T02:07:35.950210+0000","last_undegraded":"2024-09-12T02:07:35.950210+0000","last_fullsized":"2024-09-12T02:07:35.950210+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'46","last_scrub_stamp":"2024-09-12T02:07:35.950000+0000","last_deep_scrub":"266'46","last_deep_scrub_stamp":"2024-09-12T02:07:35.950000+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.950000+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:04.431335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":170,"num_write":91,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:48.949371+0000","last_change":"2024-09-12T02:07:48.949202+0000","last_active":"2024-09-12T02:07:48.949371+0000","last_peered":"2024-09-12T02:07:48.949371+0000","last_clean":"2024-09-12T02:07:48.949371+0000","last_became_active":"2024-09-12T01:00:24.070957+0000","last_became_peered":"2024-09-12T01:00:24.070957+0000","last_unstale":"2024-09-12T02:07:48.949371+0000","last_undegraded":"2024-09-12T02:07:48.949371+0000","last_fullsized":"2024-09-12T02:07:48.949371+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:48.949025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:48.949025+0000","last_clean_scrub_stamp":"2024-09-12T02:07:48.949025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:21.628262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:48.186998+0000","last_change":"2024-09-12T02:07:48.186998+0000","last_active":"2024-09-12T02:07:48.186998+0000","last_peered":"2024-09-12T02:07:48.186998+0000","last_clean":"2024-09-12T02:07:48.186998+0000","last_became_active":"2024-09-12T00:32:21.665036+0000","last_became_peered":"2024-09-12T00:32:21.665036+0000","last_unstale":"2024-09-12T02:07:48.186998+0000","last_undegraded":"2024-09-12T02:07:48.186998+0000","last_fullsized":"2024-09-12T02:07:48.186998+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:48.186819+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:48.186819+0000","last_clean_scrub_stamp":"2024-09-12T02:07:48.186819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:02.358934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"266'2","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.642601+0000","last_change":"2024-09-12T02:07:14.642601+0000","last_active":"2024-09-12T02:07:14.642601+0000","last_peered":"2024-09-12T02:07:14.642601+0000","last_clean":"2024-09-12T02:07:14.642601+0000","last_became_active":"2024-09-12T00:32:14.597944+0000","last_became_peered":"2024-09-12T00:32:14.597944+0000","last_unstale":"2024-09-12T02:07:14.642601+0000","last_undegraded":"2024-09-12T02:07:14.642601+0000","last_fullsized":"2024-09-12T02:07:14.642601+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:14.642408+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:14.642408+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.642408+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:49.542161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2064,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"266'38","reported_seq":176,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.604472+0000","last_change":"2024-09-12T02:07:15.604302+0000","last_active":"2024-09-12T02:07:15.604472+0000","last_peered":"2024-09-12T02:07:15.604472+0000","last_clean":"2024-09-12T02:07:15.604472+0000","last_became_active":"2024-09-12T00:26:23.317790+0000","last_became_peered":"2024-09-12T00:26:23.317790+0000","last_unstale":"2024-09-12T02:07:15.604472+0000","last_undegraded":"2024-09-12T02:07:15.604472+0000","last_fullsized":"2024-09-12T02:07:15.604472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'38","last_scrub_stamp":"2024-09-12T02:07:15.604109+0000","last_deep_scrub":"266'38","last_deep_scrub_stamp":"2024-09-12T02:07:15.604109+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.604109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:50.183161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":107,"num_write":80,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:40.735447+0000","last_change":"2024-09-12T02:07:40.735301+0000","last_active":"2024-09-12T02:07:40.735447+0000","last_peered":"2024-09-12T02:07:40.735447+0000","last_clean":"2024-09-12T02:07:40.735447+0000","last_became_active":"2024-09-12T01:00:24.077509+0000","last_became_peered":"2024-09-12T01:00:24.077509+0000","last_unstale":"2024-09-12T02:07:40.735447+0000","last_undegraded":"2024-09-12T02:07:40.735447+0000","last_fullsized":"2024-09-12T02:07:40.735447+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:40.735126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:40.735126+0000","last_clean_scrub_stamp":"2024-09-12T02:07:40.735126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:51.119161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"266'2","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.015442+0000","last_change":"2024-09-12T02:07:41.015442+0000","last_active":"2024-09-12T02:07:41.015442+0000","last_peered":"2024-09-12T02:07:41.015442+0000","last_clean":"2024-09-12T02:07:41.015442+0000","last_became_active":"2024-09-12T00:32:21.644753+0000","last_became_peered":"2024-09-12T00:32:21.644753+0000","last_unstale":"2024-09-12T02:07:41.015442+0000","last_undegraded":"2024-09-12T02:07:41.015442+0000","last_fullsized":"2024-09-12T02:07:41.015442+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:41.015256+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:41.015256+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.015256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:00.145462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"266'2","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:43.414939+0000","last_change":"2024-09-12T02:07:43.414939+0000","last_active":"2024-09-12T02:07:43.414939+0000","last_peered":"2024-09-12T02:07:43.414939+0000","last_clean":"2024-09-12T02:07:43.414939+0000","last_became_active":"2024-09-12T00:32:14.599452+0000","last_became_peered":"2024-09-12T00:32:14.599452+0000","last_unstale":"2024-09-12T02:07:43.414939+0000","last_undegraded":"2024-09-12T02:07:43.414939+0000","last_fullsized":"2024-09-12T02:07:43.414939+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:43.414759+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:43.414759+0000","last_clean_scrub_stamp":"2024-09-12T02:07:43.414759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:26.424760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"266'137","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:37.875312+0000","last_change":"2024-09-12T02:07:37.875312+0000","last_active":"2024-09-12T02:07:37.875312+0000","last_peered":"2024-09-12T02:07:37.875312+0000","last_clean":"2024-09-12T02:07:37.875312+0000","last_became_active":"2024-09-12T00:26:23.320613+0000","last_became_peered":"2024-09-12T00:26:23.320613+0000","last_unstale":"2024-09-12T02:07:37.875312+0000","last_undegraded":"2024-09-12T02:07:37.875312+0000","last_fullsized":"2024-09-12T02:07:37.875312+0000","mapping_epoch":253,"log_start":"263'100","ondisk_log_start":"263'100","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'137","last_scrub_stamp":"2024-09-12T02:07:37.875117+0000","last_deep_scrub":"266'137","last_deep_scrub_stamp":"2024-09-12T02:07:37.875117+0000","last_clean_scrub_stamp":"2024-09-12T02:07:37.875117+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:30.720938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":872,"num_read_kb":592,"num_write":184,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3720,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:57.207541+0000","last_change":"2024-09-12T02:07:57.207410+0000","last_active":"2024-09-12T02:07:57.207541+0000","last_peered":"2024-09-12T02:07:57.207541+0000","last_clean":"2024-09-12T02:07:57.207541+0000","last_became_active":"2024-09-12T01:00:24.060699+0000","last_became_peered":"2024-09-12T01:00:24.060699+0000","last_unstale":"2024-09-12T02:07:57.207541+0000","last_undegraded":"2024-09-12T02:07:57.207541+0000","last_fullsized":"2024-09-12T02:07:57.207541+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:57.207228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:57.207228+0000","last_clean_scrub_stamp":"2024-09-12T02:07:57.207228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:50.806725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'2","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.582765+0000","last_change":"2024-09-12T02:07:29.582613+0000","last_active":"2024-09-12T02:07:29.582765+0000","last_peered":"2024-09-12T02:07:29.582765+0000","last_clean":"2024-09-12T02:07:29.582765+0000","last_became_active":"2024-09-12T00:32:21.652122+0000","last_became_peered":"2024-09-12T00:32:21.652122+0000","last_unstale":"2024-09-12T02:07:29.582765+0000","last_undegraded":"2024-09-12T02:07:29.582765+0000","last_fullsized":"2024-09-12T02:07:29.582765+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:29.582419+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:29.582419+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.582419+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:16.256601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"266'7","reported_seq":91,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.088894+0000","last_change":"2024-09-12T02:07:31.088721+0000","last_active":"2024-09-12T02:07:31.088894+0000","last_peered":"2024-09-12T02:07:31.088894+0000","last_clean":"2024-09-12T02:07:31.088894+0000","last_became_active":"2024-09-12T00:32:14.591921+0000","last_became_peered":"2024-09-12T00:32:14.591921+0000","last_unstale":"2024-09-12T02:07:31.088894+0000","last_undegraded":"2024-09-12T02:07:31.088894+0000","last_fullsized":"2024-09-12T02:07:31.088894+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T02:07:31.088545+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T02:07:31.088545+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.088545+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:31.900675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3114,"num_write":12,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"266'28","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.849349+0000","last_change":"2024-09-12T02:07:31.849349+0000","last_active":"2024-09-12T02:07:31.849349+0000","last_peered":"2024-09-12T02:07:31.849349+0000","last_clean":"2024-09-12T02:07:31.849349+0000","last_became_active":"2024-09-12T00:26:23.322866+0000","last_became_peered":"2024-09-12T00:26:23.322866+0000","last_unstale":"2024-09-12T02:07:31.849349+0000","last_undegraded":"2024-09-12T02:07:31.849349+0000","last_fullsized":"2024-09-12T02:07:31.849349+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'28","last_scrub_stamp":"2024-09-12T02:07:31.849167+0000","last_deep_scrub":"266'28","last_deep_scrub_stamp":"2024-09-12T02:07:31.849167+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.849167+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:56.195167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":102,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:51.391573+0000","last_change":"2024-09-12T02:07:51.391436+0000","last_active":"2024-09-12T02:07:51.391573+0000","last_peered":"2024-09-12T02:07:51.391573+0000","last_clean":"2024-09-12T02:07:51.391573+0000","last_became_active":"2024-09-12T01:00:24.064203+0000","last_became_peered":"2024-09-12T01:00:24.064203+0000","last_unstale":"2024-09-12T02:07:51.391573+0000","last_undegraded":"2024-09-12T02:07:51.391573+0000","last_fullsized":"2024-09-12T02:07:51.391573+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:51.391261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:51.391261+0000","last_clean_scrub_stamp":"2024-09-12T02:07:51.391261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.028682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"266'7","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.600881+0000","last_change":"2024-09-12T02:07:30.600714+0000","last_active":"2024-09-12T02:07:30.600881+0000","last_peered":"2024-09-12T02:07:30.600881+0000","last_clean":"2024-09-12T02:07:30.600881+0000","last_became_active":"2024-09-12T00:32:21.659437+0000","last_became_peered":"2024-09-12T00:32:21.659437+0000","last_unstale":"2024-09-12T02:07:30.600881+0000","last_undegraded":"2024-09-12T02:07:30.600881+0000","last_fullsized":"2024-09-12T02:07:30.600881+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T02:07:30.600531+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T02:07:30.600531+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.600531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:40.120724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":12,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"266'9","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:42.113862+0000","last_change":"2024-09-12T02:07:42.113727+0000","last_active":"2024-09-12T02:07:42.113862+0000","last_peered":"2024-09-12T02:07:42.113862+0000","last_clean":"2024-09-12T02:07:42.113862+0000","last_became_active":"2024-09-12T00:32:14.597986+0000","last_became_peered":"2024-09-12T00:32:14.597986+0000","last_unstale":"2024-09-12T02:07:42.113862+0000","last_undegraded":"2024-09-12T02:07:42.113862+0000","last_fullsized":"2024-09-12T02:07:42.113862+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:42.113473+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:42.113473+0000","last_clean_scrub_stamp":"2024-09-12T02:07:42.113473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:44.147472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11262,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"266'46","reported_seq":207,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.510217+0000","last_change":"2024-09-12T02:07:33.510217+0000","last_active":"2024-09-12T02:07:33.510217+0000","last_peered":"2024-09-12T02:07:33.510217+0000","last_clean":"2024-09-12T02:07:33.510217+0000","last_became_active":"2024-09-12T00:26:23.336010+0000","last_became_peered":"2024-09-12T00:26:23.336010+0000","last_unstale":"2024-09-12T02:07:33.510217+0000","last_undegraded":"2024-09-12T02:07:33.510217+0000","last_fullsized":"2024-09-12T02:07:33.510217+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'46","last_scrub_stamp":"2024-09-12T02:07:33.510010+0000","last_deep_scrub":"266'46","last_deep_scrub_stamp":"2024-09-12T02:07:33.510010+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.510010+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:50.663625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":156,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:50.403585+0000","last_change":"2024-09-12T02:07:50.403585+0000","last_active":"2024-09-12T02:07:50.403585+0000","last_peered":"2024-09-12T02:07:50.403585+0000","last_clean":"2024-09-12T02:07:50.403585+0000","last_became_active":"2024-09-12T01:00:24.061624+0000","last_became_peered":"2024-09-12T01:00:24.061624+0000","last_unstale":"2024-09-12T02:07:50.403585+0000","last_undegraded":"2024-09-12T02:07:50.403585+0000","last_fullsized":"2024-09-12T02:07:50.403585+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:50.403402+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:50.403402+0000","last_clean_scrub_stamp":"2024-09-12T02:07:50.403402+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:00.328977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"263'7","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:49.160490+0000","last_change":"2024-09-12T02:07:49.160320+0000","last_active":"2024-09-12T02:07:49.160490+0000","last_peered":"2024-09-12T02:07:49.160490+0000","last_clean":"2024-09-12T02:07:49.160490+0000","last_became_active":"2024-09-12T00:32:21.666101+0000","last_became_peered":"2024-09-12T00:32:21.666101+0000","last_unstale":"2024-09-12T02:07:49.160490+0000","last_undegraded":"2024-09-12T02:07:49.160490+0000","last_fullsized":"2024-09-12T02:07:49.160490+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T02:07:49.160123+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T02:07:49.160123+0000","last_clean_scrub_stamp":"2024-09-12T02:07:49.160123+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:53.038534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3603,"num_write":12,"num_write_kb":1553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"266'3","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.145447+0000","last_change":"2024-09-12T02:07:25.145297+0000","last_active":"2024-09-12T02:07:25.145447+0000","last_peered":"2024-09-12T02:07:25.145447+0000","last_clean":"2024-09-12T02:07:25.145447+0000","last_became_active":"2024-09-12T00:32:14.579366+0000","last_became_peered":"2024-09-12T00:32:14.579366+0000","last_unstale":"2024-09-12T02:07:25.145447+0000","last_undegraded":"2024-09-12T02:07:25.145447+0000","last_fullsized":"2024-09-12T02:07:25.145447+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:07:25.145121+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:07:25.145121+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.145121+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:45.409885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'8","reported_seq":107,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:37.087226+0000","last_change":"2024-09-12T02:07:37.087226+0000","last_active":"2024-09-12T02:07:37.087226+0000","last_peered":"2024-09-12T02:07:37.087226+0000","last_clean":"2024-09-12T02:07:37.087226+0000","last_became_active":"2024-09-12T00:26:23.322841+0000","last_became_peered":"2024-09-12T00:26:23.322841+0000","last_unstale":"2024-09-12T02:07:37.087226+0000","last_undegraded":"2024-09-12T02:07:37.087226+0000","last_fullsized":"2024-09-12T02:07:37.087226+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T02:07:37.087043+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T02:07:37.087043+0000","last_clean_scrub_stamp":"2024-09-12T02:07:37.087043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:50.217818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:56.186216+0000","last_change":"2024-09-12T02:07:56.186059+0000","last_active":"2024-09-12T02:07:56.186216+0000","last_peered":"2024-09-12T02:07:56.186216+0000","last_clean":"2024-09-12T02:07:56.186216+0000","last_became_active":"2024-09-12T01:00:24.057061+0000","last_became_peered":"2024-09-12T01:00:24.057061+0000","last_unstale":"2024-09-12T02:07:56.186216+0000","last_undegraded":"2024-09-12T02:07:56.186216+0000","last_fullsized":"2024-09-12T02:07:56.186216+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:56.185848+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:56.185848+0000","last_clean_scrub_stamp":"2024-09-12T02:07:56.185848+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:25.373207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"266'6","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.089800+0000","last_change":"2024-09-12T02:07:27.089539+0000","last_active":"2024-09-12T02:07:27.089800+0000","last_peered":"2024-09-12T02:07:27.089800+0000","last_clean":"2024-09-12T02:07:27.089800+0000","last_became_active":"2024-09-12T00:32:21.646690+0000","last_became_peered":"2024-09-12T00:32:21.646690+0000","last_unstale":"2024-09-12T02:07:27.089800+0000","last_undegraded":"2024-09-12T02:07:27.089800+0000","last_fullsized":"2024-09-12T02:07:27.089800+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T02:07:27.089348+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T02:07:27.089348+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.089348+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:05.354347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2096,"num_write":6,"num_write_kb":1068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.744362+0000","last_change":"2024-09-12T02:07:34.744231+0000","last_active":"2024-09-12T02:07:34.744362+0000","last_peered":"2024-09-12T02:07:34.744362+0000","last_clean":"2024-09-12T02:07:34.744362+0000","last_became_active":"2024-09-12T00:32:14.576353+0000","last_became_peered":"2024-09-12T00:32:14.576353+0000","last_unstale":"2024-09-12T02:07:34.744362+0000","last_undegraded":"2024-09-12T02:07:34.744362+0000","last_fullsized":"2024-09-12T02:07:34.744362+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:34.744053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:34.744053+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.744053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:05.248712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"266'19","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:38.048207+0000","last_change":"2024-09-12T02:07:38.048207+0000","last_active":"2024-09-12T02:07:38.048207+0000","last_peered":"2024-09-12T02:07:38.048207+0000","last_clean":"2024-09-12T02:07:38.048207+0000","last_became_active":"2024-09-12T00:26:23.334078+0000","last_became_peered":"2024-09-12T00:26:23.334078+0000","last_unstale":"2024-09-12T02:07:38.048207+0000","last_undegraded":"2024-09-12T02:07:38.048207+0000","last_fullsized":"2024-09-12T02:07:38.048207+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T02:07:38.047968+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T02:07:38.047968+0000","last_clean_scrub_stamp":"2024-09-12T02:07:38.047968+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:52.034901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":39,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.612999+0000","last_change":"2024-09-12T02:07:20.612766+0000","last_active":"2024-09-12T02:07:20.612999+0000","last_peered":"2024-09-12T02:07:20.612999+0000","last_clean":"2024-09-12T02:07:20.612999+0000","last_became_active":"2024-09-12T01:00:24.075944+0000","last_became_peered":"2024-09-12T01:00:24.075944+0000","last_unstale":"2024-09-12T02:07:20.612999+0000","last_undegraded":"2024-09-12T02:07:20.612999+0000","last_fullsized":"2024-09-12T02:07:20.612999+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:20.612542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:20.612542+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.612542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:41.556751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"266'4","reported_seq":81,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:40.120709+0000","last_change":"2024-09-12T02:07:40.120709+0000","last_active":"2024-09-12T02:07:40.120709+0000","last_peered":"2024-09-12T02:07:40.120709+0000","last_clean":"2024-09-12T02:07:40.120709+0000","last_became_active":"2024-09-12T00:32:21.653054+0000","last_became_peered":"2024-09-12T00:32:21.653054+0000","last_unstale":"2024-09-12T02:07:40.120709+0000","last_undegraded":"2024-09-12T02:07:40.120709+0000","last_fullsized":"2024-09-12T02:07:40.120709+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:40.120528+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:40.120528+0000","last_clean_scrub_stamp":"2024-09-12T02:07:40.120528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:20.543677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8207,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"266'10","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:40.868716+0000","last_change":"2024-09-12T02:07:40.868716+0000","last_active":"2024-09-12T02:07:40.868716+0000","last_peered":"2024-09-12T02:07:40.868716+0000","last_clean":"2024-09-12T02:07:40.868716+0000","last_became_active":"2024-09-12T00:32:14.596393+0000","last_became_peered":"2024-09-12T00:32:14.596393+0000","last_unstale":"2024-09-12T02:07:40.868716+0000","last_undegraded":"2024-09-12T02:07:40.868716+0000","last_fullsized":"2024-09-12T02:07:40.868716+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T02:07:40.868537+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T02:07:40.868537+0000","last_clean_scrub_stamp":"2024-09-12T02:07:40.868537+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:03.243876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9234,"num_write":10,"num_write_kb":7184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"266'13","reported_seq":118,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.978104+0000","last_change":"2024-09-12T02:07:34.977815+0000","last_active":"2024-09-12T02:07:34.978104+0000","last_peered":"2024-09-12T02:07:34.978104+0000","last_clean":"2024-09-12T02:07:34.978104+0000","last_became_active":"2024-09-12T00:26:23.353590+0000","last_became_peered":"2024-09-12T00:26:23.353590+0000","last_unstale":"2024-09-12T02:07:34.978104+0000","last_undegraded":"2024-09-12T02:07:34.978104+0000","last_fullsized":"2024-09-12T02:07:34.978104+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'13","last_scrub_stamp":"2024-09-12T02:07:34.977586+0000","last_deep_scrub":"266'13","last_deep_scrub_stamp":"2024-09-12T02:07:34.977586+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.977586+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:02.838274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":34,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:45.903041+0000","last_change":"2024-09-12T02:07:45.902858+0000","last_active":"2024-09-12T02:07:45.903041+0000","last_peered":"2024-09-12T02:07:45.903041+0000","last_clean":"2024-09-12T02:07:45.903041+0000","last_became_active":"2024-09-12T01:00:24.069491+0000","last_became_peered":"2024-09-12T01:00:24.069491+0000","last_unstale":"2024-09-12T02:07:45.903041+0000","last_undegraded":"2024-09-12T02:07:45.903041+0000","last_fullsized":"2024-09-12T02:07:45.903041+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:45.902675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:45.902675+0000","last_clean_scrub_stamp":"2024-09-12T02:07:45.902675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:37.591577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:52.108643+0000","last_change":"2024-09-12T02:07:52.108643+0000","last_active":"2024-09-12T02:07:52.108643+0000","last_peered":"2024-09-12T02:07:52.108643+0000","last_clean":"2024-09-12T02:07:52.108643+0000","last_became_active":"2024-09-12T00:32:21.668268+0000","last_became_peered":"2024-09-12T00:32:21.668268+0000","last_unstale":"2024-09-12T02:07:52.108643+0000","last_undegraded":"2024-09-12T02:07:52.108643+0000","last_fullsized":"2024-09-12T02:07:52.108643+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:52.108460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:52.108460+0000","last_clean_scrub_stamp":"2024-09-12T02:07:52.108460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:52.722764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"266'7","reported_seq":90,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.638164+0000","last_change":"2024-09-12T02:07:22.638164+0000","last_active":"2024-09-12T02:07:22.638164+0000","last_peered":"2024-09-12T02:07:22.638164+0000","last_clean":"2024-09-12T02:07:22.638164+0000","last_became_active":"2024-09-12T00:32:14.610187+0000","last_became_peered":"2024-09-12T00:32:14.610187+0000","last_unstale":"2024-09-12T02:07:22.638164+0000","last_undegraded":"2024-09-12T02:07:22.638164+0000","last_fullsized":"2024-09-12T02:07:22.638164+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T02:07:22.637960+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T02:07:22.637960+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.637960+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:41.204403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2577,"num_write":12,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"0'0","reported_seq":88,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.710142+0000","last_change":"2024-09-12T02:07:32.709990+0000","last_active":"2024-09-12T02:07:32.710142+0000","last_peered":"2024-09-12T02:07:32.710142+0000","last_clean":"2024-09-12T02:07:32.710142+0000","last_became_active":"2024-09-12T00:26:23.328238+0000","last_became_peered":"2024-09-12T00:26:23.328238+0000","last_unstale":"2024-09-12T02:07:32.710142+0000","last_undegraded":"2024-09-12T02:07:32.710142+0000","last_fullsized":"2024-09-12T02:07:32.710142+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:32.709812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:32.709812+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.709812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:20.834850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.064254+0000","last_change":"2024-09-12T02:07:29.064110+0000","last_active":"2024-09-12T02:07:29.064254+0000","last_peered":"2024-09-12T02:07:29.064254+0000","last_clean":"2024-09-12T02:07:29.064254+0000","last_became_active":"2024-09-12T01:00:24.074237+0000","last_became_peered":"2024-09-12T01:00:24.074237+0000","last_unstale":"2024-09-12T02:07:29.064254+0000","last_undegraded":"2024-09-12T02:07:29.064254+0000","last_fullsized":"2024-09-12T02:07:29.064254+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:29.063929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:29.063929+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.063929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:37.168116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.595430+0000","last_change":"2024-09-12T02:07:28.595430+0000","last_active":"2024-09-12T02:07:28.595430+0000","last_peered":"2024-09-12T02:07:28.595430+0000","last_clean":"2024-09-12T02:07:28.595430+0000","last_became_active":"2024-09-12T00:32:21.642517+0000","last_became_peered":"2024-09-12T00:32:21.642517+0000","last_unstale":"2024-09-12T02:07:28.595430+0000","last_undegraded":"2024-09-12T02:07:28.595430+0000","last_fullsized":"2024-09-12T02:07:28.595430+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:28.595242+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:28.595242+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.595242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:54.726633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:40.456822+0000","last_change":"2024-09-12T02:07:40.456822+0000","last_active":"2024-09-12T02:07:40.456822+0000","last_peered":"2024-09-12T02:07:40.456822+0000","last_clean":"2024-09-12T02:07:40.456822+0000","last_became_active":"2024-09-12T00:32:14.607520+0000","last_became_peered":"2024-09-12T00:32:14.607520+0000","last_unstale":"2024-09-12T02:07:40.456822+0000","last_undegraded":"2024-09-12T02:07:40.456822+0000","last_fullsized":"2024-09-12T02:07:40.456822+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:40.456583+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:40.456583+0000","last_clean_scrub_stamp":"2024-09-12T02:07:40.456583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:29.402601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"266'27","reported_seq":158,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.134013+0000","last_change":"2024-09-12T02:07:22.133881+0000","last_active":"2024-09-12T02:07:22.134013+0000","last_peered":"2024-09-12T02:07:22.134013+0000","last_clean":"2024-09-12T02:07:22.134013+0000","last_became_active":"2024-09-12T00:26:23.313697+0000","last_became_peered":"2024-09-12T00:26:23.313697+0000","last_unstale":"2024-09-12T02:07:22.134013+0000","last_undegraded":"2024-09-12T02:07:22.134013+0000","last_fullsized":"2024-09-12T02:07:22.134013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'27","last_scrub_stamp":"2024-09-12T02:07:22.133702+0000","last_deep_scrub":"266'27","last_deep_scrub_stamp":"2024-09-12T02:07:22.133702+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.133702+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:37.305108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":88,"num_write":54,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:44.867513+0000","last_change":"2024-09-12T02:07:44.867513+0000","last_active":"2024-09-12T02:07:44.867513+0000","last_peered":"2024-09-12T02:07:44.867513+0000","last_clean":"2024-09-12T02:07:44.867513+0000","last_became_active":"2024-09-12T01:00:24.072931+0000","last_became_peered":"2024-09-12T01:00:24.072931+0000","last_unstale":"2024-09-12T02:07:44.867513+0000","last_undegraded":"2024-09-12T02:07:44.867513+0000","last_fullsized":"2024-09-12T02:07:44.867513+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:44.867339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:44.867339+0000","last_clean_scrub_stamp":"2024-09-12T02:07:44.867339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:50.192793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:46.168575+0000","last_change":"2024-09-12T02:07:46.168575+0000","last_active":"2024-09-12T02:07:46.168575+0000","last_peered":"2024-09-12T02:07:46.168575+0000","last_clean":"2024-09-12T02:07:46.168575+0000","last_became_active":"2024-09-12T00:32:21.641431+0000","last_became_peered":"2024-09-12T00:32:21.641431+0000","last_unstale":"2024-09-12T02:07:46.168575+0000","last_undegraded":"2024-09-12T02:07:46.168575+0000","last_fullsized":"2024-09-12T02:07:46.168575+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:46.168401+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:46.168401+0000","last_clean_scrub_stamp":"2024-09-12T02:07:46.168401+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:12.428906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20470,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.566676+0000","last_change":"2024-09-12T02:07:27.566676+0000","last_active":"2024-09-12T02:07:27.566676+0000","last_peered":"2024-09-12T02:07:27.566676+0000","last_clean":"2024-09-12T02:07:27.566676+0000","last_became_active":"2024-09-12T00:32:14.596263+0000","last_became_peered":"2024-09-12T00:32:14.596263+0000","last_unstale":"2024-09-12T02:07:27.566676+0000","last_undegraded":"2024-09-12T02:07:27.566676+0000","last_fullsized":"2024-09-12T02:07:27.566676+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:27.566497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:27.566497+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.566497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:36.193123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"266'66","reported_seq":274,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.604738+0000","last_change":"2024-09-12T02:07:23.604600+0000","last_active":"2024-09-12T02:07:23.604738+0000","last_peered":"2024-09-12T02:07:23.604738+0000","last_clean":"2024-09-12T02:07:23.604738+0000","last_became_active":"2024-09-12T00:26:23.327784+0000","last_became_peered":"2024-09-12T00:26:23.327784+0000","last_unstale":"2024-09-12T02:07:23.604738+0000","last_undegraded":"2024-09-12T02:07:23.604738+0000","last_fullsized":"2024-09-12T02:07:23.604738+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'66","last_scrub_stamp":"2024-09-12T02:07:23.604415+0000","last_deep_scrub":"266'66","last_deep_scrub_stamp":"2024-09-12T02:07:23.604415+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.604415+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:50.232583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":253,"num_write":117,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:54.114349+0000","last_change":"2024-09-12T02:07:54.114349+0000","last_active":"2024-09-12T02:07:54.114349+0000","last_peered":"2024-09-12T02:07:54.114349+0000","last_clean":"2024-09-12T02:07:54.114349+0000","last_became_active":"2024-09-12T01:00:24.066842+0000","last_became_peered":"2024-09-12T01:00:24.066842+0000","last_unstale":"2024-09-12T02:07:54.114349+0000","last_undegraded":"2024-09-12T02:07:54.114349+0000","last_fullsized":"2024-09-12T02:07:54.114349+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:54.114165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:54.114165+0000","last_clean_scrub_stamp":"2024-09-12T02:07:54.114165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:39.142882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:39.027222+0000","last_change":"2024-09-12T02:07:39.027069+0000","last_active":"2024-09-12T02:07:39.027222+0000","last_peered":"2024-09-12T02:07:39.027222+0000","last_clean":"2024-09-12T02:07:39.027222+0000","last_became_active":"2024-09-12T00:32:21.667149+0000","last_became_peered":"2024-09-12T00:32:21.667149+0000","last_unstale":"2024-09-12T02:07:39.027222+0000","last_undegraded":"2024-09-12T02:07:39.027222+0000","last_fullsized":"2024-09-12T02:07:39.027222+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:39.026896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:39.026896+0000","last_clean_scrub_stamp":"2024-09-12T02:07:39.026896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:09.267020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"266'3","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:38.498488+0000","last_change":"2024-09-12T02:07:38.498314+0000","last_active":"2024-09-12T02:07:38.498488+0000","last_peered":"2024-09-12T02:07:38.498488+0000","last_clean":"2024-09-12T02:07:38.498488+0000","last_became_active":"2024-09-12T00:32:14.601148+0000","last_became_peered":"2024-09-12T00:32:14.601148+0000","last_unstale":"2024-09-12T02:07:38.498488+0000","last_undegraded":"2024-09-12T02:07:38.498488+0000","last_fullsized":"2024-09-12T02:07:38.498488+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:07:38.498124+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:07:38.498124+0000","last_clean_scrub_stamp":"2024-09-12T02:07:38.498124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:46.389925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"266'39","reported_seq":191,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.529291+0000","last_change":"2024-09-12T02:07:32.529036+0000","last_active":"2024-09-12T02:07:32.529291+0000","last_peered":"2024-09-12T02:07:32.529291+0000","last_clean":"2024-09-12T02:07:32.529291+0000","last_became_active":"2024-09-12T00:26:23.317880+0000","last_became_peered":"2024-09-12T00:26:23.317880+0000","last_unstale":"2024-09-12T02:07:32.529291+0000","last_undegraded":"2024-09-12T02:07:32.529291+0000","last_fullsized":"2024-09-12T02:07:32.529291+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'39","last_scrub_stamp":"2024-09-12T02:07:32.528820+0000","last_deep_scrub":"266'39","last_deep_scrub_stamp":"2024-09-12T02:07:32.528820+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.528820+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:00.224353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:47.929430+0000","last_change":"2024-09-12T02:07:47.929301+0000","last_active":"2024-09-12T02:07:47.929430+0000","last_peered":"2024-09-12T02:07:47.929430+0000","last_clean":"2024-09-12T02:07:47.929430+0000","last_became_active":"2024-09-12T01:00:24.086101+0000","last_became_peered":"2024-09-12T01:00:24.086101+0000","last_unstale":"2024-09-12T02:07:47.929430+0000","last_undegraded":"2024-09-12T02:07:47.929430+0000","last_fullsized":"2024-09-12T02:07:47.929430+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:47.929107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:47.929107+0000","last_clean_scrub_stamp":"2024-09-12T02:07:47.929107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:50.958164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":75,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:39.867934+0000","last_change":"2024-09-12T02:07:39.867776+0000","last_active":"2024-09-12T02:07:39.867934+0000","last_peered":"2024-09-12T02:07:39.867934+0000","last_clean":"2024-09-12T02:07:39.867934+0000","last_became_active":"2024-09-12T00:32:21.634440+0000","last_became_peered":"2024-09-12T00:32:21.634440+0000","last_unstale":"2024-09-12T02:07:39.867934+0000","last_undegraded":"2024-09-12T02:07:39.867934+0000","last_fullsized":"2024-09-12T02:07:39.867934+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:39.867596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:39.867596+0000","last_clean_scrub_stamp":"2024-09-12T02:07:39.867596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:24.312250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.554839+0000","last_change":"2024-09-12T02:07:23.554546+0000","last_active":"2024-09-12T02:07:23.554839+0000","last_peered":"2024-09-12T02:07:23.554839+0000","last_clean":"2024-09-12T02:07:23.554839+0000","last_became_active":"2024-09-12T00:32:14.595782+0000","last_became_peered":"2024-09-12T00:32:14.595782+0000","last_unstale":"2024-09-12T02:07:23.554839+0000","last_undegraded":"2024-09-12T02:07:23.554839+0000","last_fullsized":"2024-09-12T02:07:23.554839+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T02:07:23.554267+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T02:07:23.554267+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.554267+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:11.127050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'30","reported_seq":173,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.803187+0000","last_change":"2024-09-12T02:07:30.803187+0000","last_active":"2024-09-12T02:07:30.803187+0000","last_peered":"2024-09-12T02:07:30.803187+0000","last_clean":"2024-09-12T02:07:30.803187+0000","last_became_active":"2024-09-12T00:26:23.324140+0000","last_became_peered":"2024-09-12T00:26:23.324140+0000","last_unstale":"2024-09-12T02:07:30.803187+0000","last_undegraded":"2024-09-12T02:07:30.803187+0000","last_fullsized":"2024-09-12T02:07:30.803187+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T02:07:30.802991+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T02:07:30.802991+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.802991+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:52.322242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":114,"num_write":53,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"266'2","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:46.956033+0000","last_change":"2024-09-12T02:07:46.955766+0000","last_active":"2024-09-12T02:07:46.956033+0000","last_peered":"2024-09-12T02:07:46.956033+0000","last_clean":"2024-09-12T02:07:46.956033+0000","last_became_active":"2024-09-12T01:00:24.080855+0000","last_became_peered":"2024-09-12T01:00:24.080855+0000","last_unstale":"2024-09-12T02:07:46.956033+0000","last_undegraded":"2024-09-12T02:07:46.956033+0000","last_fullsized":"2024-09-12T02:07:46.956033+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:46.955537+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:46.955537+0000","last_clean_scrub_stamp":"2024-09-12T02:07:46.955537+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:48.587050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"263'4","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.616543+0000","last_change":"2024-09-12T02:07:31.616543+0000","last_active":"2024-09-12T02:07:31.616543+0000","last_peered":"2024-09-12T02:07:31.616543+0000","last_clean":"2024-09-12T02:07:31.616543+0000","last_became_active":"2024-09-12T00:32:21.648333+0000","last_became_peered":"2024-09-12T00:32:21.648333+0000","last_unstale":"2024-09-12T02:07:31.616543+0000","last_undegraded":"2024-09-12T02:07:31.616543+0000","last_fullsized":"2024-09-12T02:07:31.616543+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T02:07:31.616358+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T02:07:31.616358+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.616358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:20.964624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"266'4","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:42.398394+0000","last_change":"2024-09-12T02:07:42.398255+0000","last_active":"2024-09-12T02:07:42.398394+0000","last_peered":"2024-09-12T02:07:42.398394+0000","last_clean":"2024-09-12T02:07:42.398394+0000","last_became_active":"2024-09-12T00:32:14.592875+0000","last_became_peered":"2024-09-12T00:32:14.592875+0000","last_unstale":"2024-09-12T02:07:42.398394+0000","last_undegraded":"2024-09-12T02:07:42.398394+0000","last_fullsized":"2024-09-12T02:07:42.398394+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:42.398041+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:42.398041+0000","last_clean_scrub_stamp":"2024-09-12T02:07:42.398041+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:07.655227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"266'15","reported_seq":127,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.982426+0000","last_change":"2024-09-12T02:07:29.982261+0000","last_active":"2024-09-12T02:07:29.982426+0000","last_peered":"2024-09-12T02:07:29.982426+0000","last_clean":"2024-09-12T02:07:29.982426+0000","last_became_active":"2024-09-12T00:26:23.324884+0000","last_became_peered":"2024-09-12T00:26:23.324884+0000","last_unstale":"2024-09-12T02:07:29.982426+0000","last_undegraded":"2024-09-12T02:07:29.982426+0000","last_fullsized":"2024-09-12T02:07:29.982426+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'15","last_scrub_stamp":"2024-09-12T02:07:29.982054+0000","last_deep_scrub":"266'15","last_deep_scrub_stamp":"2024-09-12T02:07:29.982054+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.982054+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:20.636440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:46.451311+0000","last_change":"2024-09-12T02:07:46.451174+0000","last_active":"2024-09-12T02:07:46.451311+0000","last_peered":"2024-09-12T02:07:46.451311+0000","last_clean":"2024-09-12T02:07:46.451311+0000","last_became_active":"2024-09-12T01:00:24.061882+0000","last_became_peered":"2024-09-12T01:00:24.061882+0000","last_unstale":"2024-09-12T02:07:46.451311+0000","last_undegraded":"2024-09-12T02:07:46.451311+0000","last_fullsized":"2024-09-12T02:07:46.451311+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:46.450986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:46.450986+0000","last_clean_scrub_stamp":"2024-09-12T02:07:46.450986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:38.754502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'4","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:41.884626+0000","last_change":"2024-09-12T02:07:41.884363+0000","last_active":"2024-09-12T02:07:41.884626+0000","last_peered":"2024-09-12T02:07:41.884626+0000","last_clean":"2024-09-12T02:07:41.884626+0000","last_became_active":"2024-09-12T00:32:21.667346+0000","last_became_peered":"2024-09-12T00:32:21.667346+0000","last_unstale":"2024-09-12T02:07:41.884626+0000","last_undegraded":"2024-09-12T02:07:41.884626+0000","last_fullsized":"2024-09-12T02:07:41.884626+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T02:07:41.884137+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T02:07:41.884137+0000","last_clean_scrub_stamp":"2024-09-12T02:07:41.884137+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:34.758004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"266'9","reported_seq":93,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:36.130988+0000","last_change":"2024-09-12T02:07:36.130988+0000","last_active":"2024-09-12T02:07:36.130988+0000","last_peered":"2024-09-12T02:07:36.130988+0000","last_clean":"2024-09-12T02:07:36.130988+0000","last_became_active":"2024-09-12T00:32:14.576974+0000","last_became_peered":"2024-09-12T00:32:14.576974+0000","last_unstale":"2024-09-12T02:07:36.130988+0000","last_undegraded":"2024-09-12T02:07:36.130988+0000","last_fullsized":"2024-09-12T02:07:36.130988+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:36.130774+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:36.130774+0000","last_clean_scrub_stamp":"2024-09-12T02:07:36.130774+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:04.647343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4127,"num_write":14,"num_write_kb":5151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"266'52","reported_seq":240,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.133367+0000","last_change":"2024-09-12T02:07:21.133235+0000","last_active":"2024-09-12T02:07:21.133367+0000","last_peered":"2024-09-12T02:07:21.133367+0000","last_clean":"2024-09-12T02:07:21.133367+0000","last_became_active":"2024-09-12T00:26:23.315633+0000","last_became_peered":"2024-09-12T00:26:23.315633+0000","last_unstale":"2024-09-12T02:07:21.133367+0000","last_undegraded":"2024-09-12T02:07:21.133367+0000","last_fullsized":"2024-09-12T02:07:21.133367+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'52","last_scrub_stamp":"2024-09-12T02:07:21.133042+0000","last_deep_scrub":"266'52","last_deep_scrub_stamp":"2024-09-12T02:07:21.133042+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.133042+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:25.001126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":203,"num_write":96,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:43.893118+0000","last_change":"2024-09-12T02:07:43.893118+0000","last_active":"2024-09-12T02:07:43.893118+0000","last_peered":"2024-09-12T02:07:43.893118+0000","last_clean":"2024-09-12T02:07:43.893118+0000","last_became_active":"2024-09-12T01:00:24.079834+0000","last_became_peered":"2024-09-12T01:00:24.079834+0000","last_unstale":"2024-09-12T02:07:43.893118+0000","last_undegraded":"2024-09-12T02:07:43.893118+0000","last_fullsized":"2024-09-12T02:07:43.893118+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:43.892940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:43.892940+0000","last_clean_scrub_stamp":"2024-09-12T02:07:43.892940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:33.893814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:44.403855+0000","last_change":"2024-09-12T02:07:44.403855+0000","last_active":"2024-09-12T02:07:44.403855+0000","last_peered":"2024-09-12T02:07:44.403855+0000","last_clean":"2024-09-12T02:07:44.403855+0000","last_became_active":"2024-09-12T00:32:21.663547+0000","last_became_peered":"2024-09-12T00:32:21.663547+0000","last_unstale":"2024-09-12T02:07:44.403855+0000","last_undegraded":"2024-09-12T02:07:44.403855+0000","last_fullsized":"2024-09-12T02:07:44.403855+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:44.403662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:44.403662+0000","last_clean_scrub_stamp":"2024-09-12T02:07:44.403662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:54.743067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:38.880002+0000","last_change":"2024-09-12T02:07:38.879838+0000","last_active":"2024-09-12T02:07:38.880002+0000","last_peered":"2024-09-12T02:07:38.880002+0000","last_clean":"2024-09-12T02:07:38.880002+0000","last_became_active":"2024-09-12T00:32:14.593670+0000","last_became_peered":"2024-09-12T00:32:14.593670+0000","last_unstale":"2024-09-12T02:07:38.880002+0000","last_undegraded":"2024-09-12T02:07:38.880002+0000","last_fullsized":"2024-09-12T02:07:38.880002+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:38.879640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:38.879640+0000","last_clean_scrub_stamp":"2024-09-12T02:07:38.879640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:09.993819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'28","reported_seq":165,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.474621+0000","last_change":"2024-09-12T02:07:34.474477+0000","last_active":"2024-09-12T02:07:34.474621+0000","last_peered":"2024-09-12T02:07:34.474621+0000","last_clean":"2024-09-12T02:07:34.474621+0000","last_became_active":"2024-09-12T00:26:23.338248+0000","last_became_peered":"2024-09-12T00:26:23.338248+0000","last_unstale":"2024-09-12T02:07:34.474621+0000","last_undegraded":"2024-09-12T02:07:34.474621+0000","last_fullsized":"2024-09-12T02:07:34.474621+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T02:07:34.474291+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T02:07:34.474291+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.474291+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:49.247433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":99,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:39.704156+0000","last_change":"2024-09-12T02:07:39.704156+0000","last_active":"2024-09-12T02:07:39.704156+0000","last_peered":"2024-09-12T02:07:39.704156+0000","last_clean":"2024-09-12T02:07:39.704156+0000","last_became_active":"2024-09-12T01:00:24.068145+0000","last_became_peered":"2024-09-12T01:00:24.068145+0000","last_unstale":"2024-09-12T02:07:39.704156+0000","last_undegraded":"2024-09-12T02:07:39.704156+0000","last_fullsized":"2024-09-12T02:07:39.704156+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:39.703977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:39.703977+0000","last_clean_scrub_stamp":"2024-09-12T02:07:39.703977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:39.366222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:45.415372+0000","last_change":"2024-09-12T02:07:45.415225+0000","last_active":"2024-09-12T02:07:45.415372+0000","last_peered":"2024-09-12T02:07:45.415372+0000","last_clean":"2024-09-12T02:07:45.415372+0000","last_became_active":"2024-09-12T00:32:21.668979+0000","last_became_peered":"2024-09-12T00:32:21.668979+0000","last_unstale":"2024-09-12T02:07:45.415372+0000","last_undegraded":"2024-09-12T02:07:45.415372+0000","last_fullsized":"2024-09-12T02:07:45.415372+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T02:07:45.415012+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T02:07:45.415012+0000","last_clean_scrub_stamp":"2024-09-12T02:07:45.415012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:58.223857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.568449+0000","last_change":"2024-09-12T02:07:18.568449+0000","last_active":"2024-09-12T02:07:18.568449+0000","last_peered":"2024-09-12T02:07:18.568449+0000","last_clean":"2024-09-12T02:07:18.568449+0000","last_became_active":"2024-09-12T00:32:14.610414+0000","last_became_peered":"2024-09-12T00:32:14.610414+0000","last_unstale":"2024-09-12T02:07:18.568449+0000","last_undegraded":"2024-09-12T02:07:18.568449+0000","last_fullsized":"2024-09-12T02:07:18.568449+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:18.568255+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:18.568255+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.568255+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:36.781285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6140,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"266'33","reported_seq":177,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.127561+0000","last_change":"2024-09-12T02:07:20.127247+0000","last_active":"2024-09-12T02:07:20.127561+0000","last_peered":"2024-09-12T02:07:20.127561+0000","last_clean":"2024-09-12T02:07:20.127561+0000","last_became_active":"2024-09-12T00:26:23.327296+0000","last_became_peered":"2024-09-12T00:26:23.327296+0000","last_unstale":"2024-09-12T02:07:20.127561+0000","last_undegraded":"2024-09-12T02:07:20.127561+0000","last_fullsized":"2024-09-12T02:07:20.127561+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T02:07:20.127030+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T02:07:20.127030+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.127030+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:58.191456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.644535+0000","last_change":"2024-09-12T02:07:33.644535+0000","last_active":"2024-09-12T02:07:33.644535+0000","last_peered":"2024-09-12T02:07:33.644535+0000","last_clean":"2024-09-12T02:07:33.644535+0000","last_became_active":"2024-09-12T01:00:24.067665+0000","last_became_peered":"2024-09-12T01:00:24.067665+0000","last_unstale":"2024-09-12T02:07:33.644535+0000","last_undegraded":"2024-09-12T02:07:33.644535+0000","last_fullsized":"2024-09-12T02:07:33.644535+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:33.644363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:33.644363+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.644363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:33.974614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.854561+0000","last_change":"2024-09-12T02:07:35.854296+0000","last_active":"2024-09-12T02:07:35.854561+0000","last_peered":"2024-09-12T02:07:35.854561+0000","last_clean":"2024-09-12T02:07:35.854561+0000","last_became_active":"2024-09-12T00:32:21.644891+0000","last_became_peered":"2024-09-12T00:32:21.644891+0000","last_unstale":"2024-09-12T02:07:35.854561+0000","last_undegraded":"2024-09-12T02:07:35.854561+0000","last_fullsized":"2024-09-12T02:07:35.854561+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:35.854058+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:35.854058+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.854058+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:53.155420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"266'2","reported_seq":84,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:36.708902+0000","last_change":"2024-09-12T02:07:36.708902+0000","last_active":"2024-09-12T02:07:36.708902+0000","last_peered":"2024-09-12T02:07:36.708902+0000","last_clean":"2024-09-12T02:07:36.708902+0000","last_became_active":"2024-09-12T00:32:14.598981+0000","last_became_peered":"2024-09-12T00:32:14.598981+0000","last_unstale":"2024-09-12T02:07:36.708902+0000","last_undegraded":"2024-09-12T02:07:36.708902+0000","last_fullsized":"2024-09-12T02:07:36.708902+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:36.708727+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:36.708727+0000","last_clean_scrub_stamp":"2024-09-12T02:07:36.708727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:09.874104+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"266'25","reported_seq":160,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.824747+0000","last_change":"2024-09-12T02:07:29.824747+0000","last_active":"2024-09-12T02:07:29.824747+0000","last_peered":"2024-09-12T02:07:29.824747+0000","last_clean":"2024-09-12T02:07:29.824747+0000","last_became_active":"2024-09-12T00:26:23.316443+0000","last_became_peered":"2024-09-12T00:26:23.316443+0000","last_unstale":"2024-09-12T02:07:29.824747+0000","last_undegraded":"2024-09-12T02:07:29.824747+0000","last_fullsized":"2024-09-12T02:07:29.824747+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'25","last_scrub_stamp":"2024-09-12T02:07:29.824565+0000","last_deep_scrub":"266'25","last_deep_scrub_stamp":"2024-09-12T02:07:29.824565+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.824565+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:22.429912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":90,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:42.062828+0000","last_change":"2024-09-12T02:07:42.062828+0000","last_active":"2024-09-12T02:07:42.062828+0000","last_peered":"2024-09-12T02:07:42.062828+0000","last_clean":"2024-09-12T02:07:42.062828+0000","last_became_active":"2024-09-12T01:00:24.071428+0000","last_became_peered":"2024-09-12T01:00:24.071428+0000","last_unstale":"2024-09-12T02:07:42.062828+0000","last_undegraded":"2024-09-12T02:07:42.062828+0000","last_fullsized":"2024-09-12T02:07:42.062828+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:42.062643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:42.062643+0000","last_clean_scrub_stamp":"2024-09-12T02:07:42.062643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:05.754915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"266'9","reported_seq":90,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:38.050607+0000","last_change":"2024-09-12T02:07:38.050467+0000","last_active":"2024-09-12T02:07:38.050607+0000","last_peered":"2024-09-12T02:07:38.050607+0000","last_clean":"2024-09-12T02:07:38.050607+0000","last_became_active":"2024-09-12T00:32:21.653749+0000","last_became_peered":"2024-09-12T00:32:21.653749+0000","last_unstale":"2024-09-12T02:07:38.050607+0000","last_undegraded":"2024-09-12T02:07:38.050607+0000","last_fullsized":"2024-09-12T02:07:38.050607+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:38.050272+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:38.050272+0000","last_clean_scrub_stamp":"2024-09-12T02:07:38.050272+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:04.987928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":14,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":85,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:34.877101+0000","last_change":"2024-09-12T02:07:34.876846+0000","last_active":"2024-09-12T02:07:34.877101+0000","last_peered":"2024-09-12T02:07:34.877101+0000","last_clean":"2024-09-12T02:07:34.877101+0000","last_became_active":"2024-09-12T00:32:14.596498+0000","last_became_peered":"2024-09-12T00:32:14.596498+0000","last_unstale":"2024-09-12T02:07:34.877101+0000","last_undegraded":"2024-09-12T02:07:34.877101+0000","last_fullsized":"2024-09-12T02:07:34.877101+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T02:07:34.876556+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T02:07:34.876556+0000","last_clean_scrub_stamp":"2024-09-12T02:07:34.876556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:02.390345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"266'50","reported_seq":226,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.528784+0000","last_change":"2024-09-12T02:07:24.528784+0000","last_active":"2024-09-12T02:07:24.528784+0000","last_peered":"2024-09-12T02:07:24.528784+0000","last_clean":"2024-09-12T02:07:24.528784+0000","last_became_active":"2024-09-12T00:26:23.340608+0000","last_became_peered":"2024-09-12T00:26:23.340608+0000","last_unstale":"2024-09-12T02:07:24.528784+0000","last_undegraded":"2024-09-12T02:07:24.528784+0000","last_fullsized":"2024-09-12T02:07:24.528784+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'50","last_scrub_stamp":"2024-09-12T02:07:24.528600+0000","last_deep_scrub":"266'50","last_deep_scrub_stamp":"2024-09-12T02:07:24.528600+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.528600+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.621123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":178,"num_write":83,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'2","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.587035+0000","last_change":"2024-09-12T02:07:17.586891+0000","last_active":"2024-09-12T02:07:17.587035+0000","last_peered":"2024-09-12T02:07:17.587035+0000","last_clean":"2024-09-12T02:07:17.587035+0000","last_became_active":"2024-09-12T01:00:24.083260+0000","last_became_peered":"2024-09-12T01:00:24.083260+0000","last_unstale":"2024-09-12T02:07:17.587035+0000","last_undegraded":"2024-09-12T02:07:17.587035+0000","last_fullsized":"2024-09-12T02:07:17.587035+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:17.586703+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:17.586703+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.586703+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:52.599255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"266'9","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.522565+0000","last_change":"2024-09-12T02:07:26.522415+0000","last_active":"2024-09-12T02:07:26.522565+0000","last_peered":"2024-09-12T02:07:26.522565+0000","last_clean":"2024-09-12T02:07:26.522565+0000","last_became_active":"2024-09-12T00:32:21.655849+0000","last_became_peered":"2024-09-12T00:32:21.655849+0000","last_unstale":"2024-09-12T02:07:26.522565+0000","last_undegraded":"2024-09-12T02:07:26.522565+0000","last_fullsized":"2024-09-12T02:07:26.522565+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T02:07:26.522238+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T02:07:26.522238+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.522238+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:41.615137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":15358,"num_write":14,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.838345+0000","last_change":"2024-09-12T02:07:32.838345+0000","last_active":"2024-09-12T02:07:32.838345+0000","last_peered":"2024-09-12T02:07:32.838345+0000","last_clean":"2024-09-12T02:07:32.838345+0000","last_became_active":"2024-09-12T00:32:14.604519+0000","last_became_peered":"2024-09-12T00:32:14.604519+0000","last_unstale":"2024-09-12T02:07:32.838345+0000","last_undegraded":"2024-09-12T02:07:32.838345+0000","last_fullsized":"2024-09-12T02:07:32.838345+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:32.838163+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:32.838163+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.838163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:04.803343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.655363+0000","last_change":"2024-09-12T02:07:30.655363+0000","last_active":"2024-09-12T02:07:30.655363+0000","last_peered":"2024-09-12T02:07:30.655363+0000","last_clean":"2024-09-12T02:07:30.655363+0000","last_became_active":"2024-09-12T00:26:23.328187+0000","last_became_peered":"2024-09-12T00:26:23.328187+0000","last_unstale":"2024-09-12T02:07:30.655363+0000","last_undegraded":"2024-09-12T02:07:30.655363+0000","last_fullsized":"2024-09-12T02:07:30.655363+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T02:07:30.655180+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T02:07:30.655180+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.655180+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:13.153302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":91,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:49.393823+0000","last_change":"2024-09-12T02:07:49.393823+0000","last_active":"2024-09-12T02:07:49.393823+0000","last_peered":"2024-09-12T02:07:49.393823+0000","last_clean":"2024-09-12T02:07:49.393823+0000","last_became_active":"2024-09-12T01:00:24.062597+0000","last_became_peered":"2024-09-12T01:00:24.062597+0000","last_unstale":"2024-09-12T02:07:49.393823+0000","last_undegraded":"2024-09-12T02:07:49.393823+0000","last_fullsized":"2024-09-12T02:07:49.393823+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:49.393637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:49.393637+0000","last_clean_scrub_stamp":"2024-09-12T02:07:49.393637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.135019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:38.745756+0000","last_change":"2024-09-12T02:07:38.745756+0000","last_active":"2024-09-12T02:07:38.745756+0000","last_peered":"2024-09-12T02:07:38.745756+0000","last_clean":"2024-09-12T02:07:38.745756+0000","last_became_active":"2024-09-12T00:32:21.644950+0000","last_became_peered":"2024-09-12T00:32:21.644950+0000","last_unstale":"2024-09-12T02:07:38.745756+0000","last_undegraded":"2024-09-12T02:07:38.745756+0000","last_fullsized":"2024-09-12T02:07:38.745756+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:38.745568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:38.745568+0000","last_clean_scrub_stamp":"2024-09-12T02:07:38.745568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:24.026675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":91,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.887987+0000","last_change":"2024-09-12T02:07:33.887829+0000","last_active":"2024-09-12T02:07:33.887987+0000","last_peered":"2024-09-12T02:07:33.887987+0000","last_clean":"2024-09-12T02:07:33.887987+0000","last_became_active":"2024-09-12T00:32:14.597376+0000","last_became_peered":"2024-09-12T00:32:14.597376+0000","last_unstale":"2024-09-12T02:07:33.887987+0000","last_undegraded":"2024-09-12T02:07:33.887987+0000","last_fullsized":"2024-09-12T02:07:33.887987+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:33.887632+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:33.887632+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.887632+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:35.381572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12276,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"266'77","reported_seq":305,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.110227+0000","last_change":"2024-09-12T02:07:29.110227+0000","last_active":"2024-09-12T02:07:29.110227+0000","last_peered":"2024-09-12T02:07:29.110227+0000","last_clean":"2024-09-12T02:07:29.110227+0000","last_became_active":"2024-09-12T00:26:23.338274+0000","last_became_peered":"2024-09-12T00:26:23.338274+0000","last_unstale":"2024-09-12T02:07:29.110227+0000","last_undegraded":"2024-09-12T02:07:29.110227+0000","last_fullsized":"2024-09-12T02:07:29.110227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'77","last_scrub_stamp":"2024-09-12T02:07:29.110050+0000","last_deep_scrub":"266'77","last_deep_scrub_stamp":"2024-09-12T02:07:29.110050+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.110050+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:17.917808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":296,"num_write":117,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:48.407029+0000","last_change":"2024-09-12T02:07:48.407029+0000","last_active":"2024-09-12T02:07:48.407029+0000","last_peered":"2024-09-12T02:07:48.407029+0000","last_clean":"2024-09-12T02:07:48.407029+0000","last_became_active":"2024-09-12T01:00:24.053408+0000","last_became_peered":"2024-09-12T01:00:24.053408+0000","last_unstale":"2024-09-12T02:07:48.407029+0000","last_undegraded":"2024-09-12T02:07:48.407029+0000","last_fullsized":"2024-09-12T02:07:48.407029+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:48.406840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:48.406840+0000","last_clean_scrub_stamp":"2024-09-12T02:07:48.406840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:48.623885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.131551+0000","last_change":"2024-09-12T02:07:26.131404+0000","last_active":"2024-09-12T02:07:26.131551+0000","last_peered":"2024-09-12T02:07:26.131551+0000","last_clean":"2024-09-12T02:07:26.131551+0000","last_became_active":"2024-09-12T00:32:33.790018+0000","last_became_peered":"2024-09-12T00:32:33.790018+0000","last_unstale":"2024-09-12T02:07:26.131551+0000","last_undegraded":"2024-09-12T02:07:26.131551+0000","last_fullsized":"2024-09-12T02:07:26.131551+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:26.131217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:26.131217+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.131217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:43.818640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.561865+0000","last_change":"2024-09-12T02:07:25.561731+0000","last_active":"2024-09-12T02:07:25.561865+0000","last_peered":"2024-09-12T02:07:25.561865+0000","last_clean":"2024-09-12T02:07:25.561865+0000","last_became_active":"2024-09-12T00:32:14.580350+0000","last_became_peered":"2024-09-12T00:32:14.580350+0000","last_unstale":"2024-09-12T02:07:25.561865+0000","last_undegraded":"2024-09-12T02:07:25.561865+0000","last_fullsized":"2024-09-12T02:07:25.561865+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.561549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.561549+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.561549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:44.815598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"266'23","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.156871+0000","last_change":"2024-09-12T02:07:19.156871+0000","last_active":"2024-09-12T02:07:19.156871+0000","last_peered":"2024-09-12T02:07:19.156871+0000","last_clean":"2024-09-12T02:07:19.156871+0000","last_became_active":"2024-09-12T00:26:23.318720+0000","last_became_peered":"2024-09-12T00:26:23.318720+0000","last_unstale":"2024-09-12T02:07:19.156871+0000","last_undegraded":"2024-09-12T02:07:19.156871+0000","last_fullsized":"2024-09-12T02:07:19.156871+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'23","last_scrub_stamp":"2024-09-12T02:07:19.156669+0000","last_deep_scrub":"266'23","last_deep_scrub_stamp":"2024-09-12T02:07:19.156669+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.156669+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:19.367324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":71,"num_write":46,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:42.917981+0000","last_change":"2024-09-12T02:07:42.917981+0000","last_active":"2024-09-12T02:07:42.917981+0000","last_peered":"2024-09-12T02:07:42.917981+0000","last_clean":"2024-09-12T02:07:42.917981+0000","last_became_active":"2024-09-12T01:00:24.072773+0000","last_became_peered":"2024-09-12T01:00:24.072773+0000","last_unstale":"2024-09-12T02:07:42.917981+0000","last_undegraded":"2024-09-12T02:07:42.917981+0000","last_fullsized":"2024-09-12T02:07:42.917981+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:42.917796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:42.917796+0000","last_clean_scrub_stamp":"2024-09-12T02:07:42.917796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:51.432154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"266'8","reported_seq":90,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.129634+0000","last_change":"2024-09-12T02:07:35.129491+0000","last_active":"2024-09-12T02:07:35.129634+0000","last_peered":"2024-09-12T02:07:35.129634+0000","last_clean":"2024-09-12T02:07:35.129634+0000","last_became_active":"2024-09-12T00:32:21.643272+0000","last_became_peered":"2024-09-12T00:32:21.643272+0000","last_unstale":"2024-09-12T02:07:35.129634+0000","last_undegraded":"2024-09-12T02:07:35.129634+0000","last_fullsized":"2024-09-12T02:07:35.129634+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'8","last_scrub_stamp":"2024-09-12T02:07:35.129310+0000","last_deep_scrub":"266'8","last_deep_scrub_stamp":"2024-09-12T02:07:35.129310+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.129310+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:11.967835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10236,"num_write":18,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.165809+0000","last_change":"2024-09-12T02:07:24.165654+0000","last_active":"2024-09-12T02:07:24.165809+0000","last_peered":"2024-09-12T02:07:24.165809+0000","last_clean":"2024-09-12T02:07:24.165809+0000","last_became_active":"2024-09-12T00:32:14.579278+0000","last_became_peered":"2024-09-12T00:32:14.579278+0000","last_unstale":"2024-09-12T02:07:24.165809+0000","last_undegraded":"2024-09-12T02:07:24.165809+0000","last_fullsized":"2024-09-12T02:07:24.165809+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.165470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.165470+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.165470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:02.815712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"266'19","reported_seq":145,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.838234+0000","last_change":"2024-09-12T02:07:27.838234+0000","last_active":"2024-09-12T02:07:27.838234+0000","last_peered":"2024-09-12T02:07:27.838234+0000","last_clean":"2024-09-12T02:07:27.838234+0000","last_became_active":"2024-09-12T00:26:23.306139+0000","last_became_peered":"2024-09-12T00:26:23.306139+0000","last_unstale":"2024-09-12T02:07:27.838234+0000","last_undegraded":"2024-09-12T02:07:27.838234+0000","last_fullsized":"2024-09-12T02:07:27.838234+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T02:07:27.838004+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T02:07:27.838004+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.838004+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:31.033055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":68,"num_write":36,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"266'329","reported_seq":1082,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.791875+0000","last_change":"2024-09-12T02:07:06.791875+0000","last_active":"2024-09-12T02:07:06.791875+0000","last_peered":"2024-09-12T02:07:06.791875+0000","last_clean":"2024-09-12T02:07:06.791875+0000","last_became_active":"2024-09-12T00:09:59.316094+0000","last_became_peered":"2024-09-12T00:09:59.316094+0000","last_unstale":"2024-09-12T02:07:06.791875+0000","last_undegraded":"2024-09-12T02:07:06.791875+0000","last_fullsized":"2024-09-12T02:07:06.791875+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'329","last_scrub_stamp":"2024-09-12T02:07:06.791586+0000","last_deep_scrub":"266'329","last_deep_scrub_stamp":"2024-09-12T02:07:06.791586+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.791586+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:12.851892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3441871,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":581,"num_read_kb":103153,"num_write":998,"num_write_kb":38551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"266'996","reported_seq":2787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.571015+0000","last_change":"2024-09-12T02:07:13.570879+0000","last_active":"2024-09-12T02:07:13.571015+0000","last_peered":"2024-09-12T02:07:13.571015+0000","last_clean":"2024-09-12T02:07:13.571015+0000","last_became_active":"2024-09-12T00:10:01.281465+0000","last_became_peered":"2024-09-12T00:10:01.281465+0000","last_unstale":"2024-09-12T02:07:13.571015+0000","last_undegraded":"2024-09-12T02:07:13.571015+0000","last_fullsized":"2024-09-12T02:07:13.571015+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'996","last_scrub_stamp":"2024-09-12T02:07:13.570650+0000","last_deep_scrub":"266'996","last_deep_scrub_stamp":"2024-09-12T02:07:13.570650+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.570650+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":900,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:50.111365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4736,"num_read_kb":4236,"num_write":1359,"num_write_kb":542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"266'354","reported_seq":1056,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.469755+0000","last_change":"2024-09-12T02:06:56.469755+0000","last_active":"2024-09-12T02:06:56.469755+0000","last_peered":"2024-09-12T02:06:56.469755+0000","last_clean":"2024-09-12T02:06:56.469755+0000","last_became_active":"2024-09-12T00:09:59.311178+0000","last_became_peered":"2024-09-12T00:09:59.311178+0000","last_unstale":"2024-09-12T02:06:56.469755+0000","last_undegraded":"2024-09-12T02:06:56.469755+0000","last_fullsized":"2024-09-12T02:06:56.469755+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'354","last_scrub_stamp":"2024-09-12T02:06:56.469492+0000","last_deep_scrub":"266'354","last_deep_scrub_stamp":"2024-09-12T02:06:56.469492+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.469492+0000","objects_scrubbed":9,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.533391+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399015,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":11355,"num_write":1177,"num_write_kb":19733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"266'878","reported_seq":2494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.857628+0000","last_change":"2024-09-12T02:07:10.857479+0000","last_active":"2024-09-12T02:07:10.857628+0000","last_peered":"2024-09-12T02:07:10.857628+0000","last_clean":"2024-09-12T02:07:10.857628+0000","last_became_active":"2024-09-12T00:10:01.268068+0000","last_became_peered":"2024-09-12T00:10:01.268068+0000","last_unstale":"2024-09-12T02:07:10.857628+0000","last_undegraded":"2024-09-12T02:07:10.857628+0000","last_fullsized":"2024-09-12T02:07:10.857628+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'878","last_scrub_stamp":"2024-09-12T02:07:10.857289+0000","last_deep_scrub":"266'878","last_deep_scrub_stamp":"2024-09-12T02:07:10.857289+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.857289+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:43.512649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4189,"num_read_kb":3768,"num_write":1161,"num_write_kb":424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"266'376","reported_seq":1090,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.497550+0000","last_change":"2024-09-12T02:07:00.497550+0000","last_active":"2024-09-12T02:07:00.497550+0000","last_peered":"2024-09-12T02:07:00.497550+0000","last_clean":"2024-09-12T02:07:00.497550+0000","last_became_active":"2024-09-12T00:09:59.296557+0000","last_became_peered":"2024-09-12T00:09:59.296557+0000","last_unstale":"2024-09-12T02:07:00.497550+0000","last_undegraded":"2024-09-12T02:07:00.497550+0000","last_fullsized":"2024-09-12T02:07:00.497550+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'376","last_scrub_stamp":"2024-09-12T02:07:00.497323+0000","last_deep_scrub":"266'376","last_deep_scrub_stamp":"2024-09-12T02:07:00.497323+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.497323+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.306173+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653297,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":575,"num_read_kb":57177,"num_write":1185,"num_write_kb":38522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1197","reported_seq":2918,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.068852+0000","last_change":"2024-09-12T02:07:13.068672+0000","last_active":"2024-09-12T02:07:13.068852+0000","last_peered":"2024-09-12T02:07:13.068852+0000","last_clean":"2024-09-12T02:07:13.068852+0000","last_became_active":"2024-09-12T00:10:01.251038+0000","last_became_peered":"2024-09-12T00:10:01.251038+0000","last_unstale":"2024-09-12T02:07:13.068852+0000","last_undegraded":"2024-09-12T02:07:13.068852+0000","last_fullsized":"2024-09-12T02:07:13.068852+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1197","last_scrub_stamp":"2024-09-12T02:07:13.068485+0000","last_deep_scrub":"266'1197","last_deep_scrub_stamp":"2024-09-12T02:07:13.068485+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.068485+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:34.941751+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5594,"num_read_kb":4965,"num_write":1641,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"266'307","reported_seq":965,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.585572+0000","last_change":"2024-09-12T02:07:06.585374+0000","last_active":"2024-09-12T02:07:06.585572+0000","last_peered":"2024-09-12T02:07:06.585572+0000","last_clean":"2024-09-12T02:07:06.585572+0000","last_became_active":"2024-09-12T00:09:59.278426+0000","last_became_peered":"2024-09-12T00:09:59.278426+0000","last_unstale":"2024-09-12T02:07:06.585572+0000","last_undegraded":"2024-09-12T02:07:06.585572+0000","last_fullsized":"2024-09-12T02:07:06.585572+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'307","last_scrub_stamp":"2024-09-12T02:07:06.585161+0000","last_deep_scrub":"266'307","last_deep_scrub_stamp":"2024-09-12T02:07:06.585161+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.585161+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:20.322727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":431,"num_read_kb":8612,"num_write":1021,"num_write_kb":32048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"266'443","reported_seq":1957,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.553617+0000","last_change":"2024-09-12T02:07:10.553353+0000","last_active":"2024-09-12T02:07:10.553617+0000","last_peered":"2024-09-12T02:07:10.553617+0000","last_clean":"2024-09-12T02:07:10.553617+0000","last_became_active":"2024-09-12T00:10:01.247807+0000","last_became_peered":"2024-09-12T00:10:01.247807+0000","last_unstale":"2024-09-12T02:07:10.553617+0000","last_undegraded":"2024-09-12T02:07:10.553617+0000","last_fullsized":"2024-09-12T02:07:10.553617+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'443","last_scrub_stamp":"2024-09-12T02:07:10.553061+0000","last_deep_scrub":"266'443","last_deep_scrub_stamp":"2024-09-12T02:07:10.553061+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.553061+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:25.618102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2317,"num_read_kb":2164,"num_write":517,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"266'312","reported_seq":1030,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.785609+0000","last_change":"2024-09-12T02:07:04.785461+0000","last_active":"2024-09-12T02:07:04.785609+0000","last_peered":"2024-09-12T02:07:04.785609+0000","last_clean":"2024-09-12T02:07:04.785609+0000","last_became_active":"2024-09-12T00:09:59.314222+0000","last_became_peered":"2024-09-12T00:09:59.314222+0000","last_unstale":"2024-09-12T02:07:04.785609+0000","last_undegraded":"2024-09-12T02:07:04.785609+0000","last_fullsized":"2024-09-12T02:07:04.785609+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'312","last_scrub_stamp":"2024-09-12T02:07:04.785112+0000","last_deep_scrub":"266'312","last_deep_scrub_stamp":"2024-09-12T02:07:04.785112+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.785112+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:19.854594+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":10075,"num_write":947,"num_write_kb":41375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"266'517","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.092162+0000","last_change":"2024-09-12T02:07:05.092162+0000","last_active":"2024-09-12T02:07:05.092162+0000","last_peered":"2024-09-12T02:07:05.092162+0000","last_clean":"2024-09-12T02:07:05.092162+0000","last_became_active":"2024-09-12T00:10:01.256253+0000","last_became_peered":"2024-09-12T00:10:01.256253+0000","last_unstale":"2024-09-12T02:07:05.092162+0000","last_undegraded":"2024-09-12T02:07:05.092162+0000","last_fullsized":"2024-09-12T02:07:05.092162+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'517","last_scrub_stamp":"2024-09-12T02:07:05.091915+0000","last_deep_scrub":"266'517","last_deep_scrub_stamp":"2024-09-12T02:07:05.091915+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.091915+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:58.529971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2461,"num_read_kb":2278,"num_write":611,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"266'342","reported_seq":1005,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.574347+0000","last_change":"2024-09-12T02:07:05.574196+0000","last_active":"2024-09-12T02:07:05.574347+0000","last_peered":"2024-09-12T02:07:05.574347+0000","last_clean":"2024-09-12T02:07:05.574347+0000","last_became_active":"2024-09-12T00:09:59.297821+0000","last_became_peered":"2024-09-12T00:09:59.297821+0000","last_unstale":"2024-09-12T02:07:05.574347+0000","last_undegraded":"2024-09-12T02:07:05.574347+0000","last_fullsized":"2024-09-12T02:07:05.574347+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'342","last_scrub_stamp":"2024-09-12T02:07:05.573973+0000","last_deep_scrub":"266'342","last_deep_scrub_stamp":"2024-09-12T02:07:05.573973+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.573973+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:17.466383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":489,"num_read_kb":14780,"num_write":963,"num_write_kb":35747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"266'380","reported_seq":1853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.056835+0000","last_change":"2024-09-12T02:07:12.056835+0000","last_active":"2024-09-12T02:07:12.056835+0000","last_peered":"2024-09-12T02:07:12.056835+0000","last_clean":"2024-09-12T02:07:12.056835+0000","last_became_active":"2024-09-12T00:10:01.250663+0000","last_became_peered":"2024-09-12T00:10:01.250663+0000","last_unstale":"2024-09-12T02:07:12.056835+0000","last_undegraded":"2024-09-12T02:07:12.056835+0000","last_fullsized":"2024-09-12T02:07:12.056835+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T02:07:12.056652+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T02:07:12.056652+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.056652+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.942975+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2078,"num_read_kb":1972,"num_write":422,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"266'353","reported_seq":1132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.810880+0000","last_change":"2024-09-12T02:07:03.810726+0000","last_active":"2024-09-12T02:07:03.810880+0000","last_peered":"2024-09-12T02:07:03.810880+0000","last_clean":"2024-09-12T02:07:03.810880+0000","last_became_active":"2024-09-12T00:09:59.311825+0000","last_became_peered":"2024-09-12T00:09:59.311825+0000","last_unstale":"2024-09-12T02:07:03.810880+0000","last_undegraded":"2024-09-12T02:07:03.810880+0000","last_fullsized":"2024-09-12T02:07:03.810880+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'353","last_scrub_stamp":"2024-09-12T02:07:03.810476+0000","last_deep_scrub":"266'353","last_deep_scrub_stamp":"2024-09-12T02:07:03.810476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.810476+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.639688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399264,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":842,"num_read_kb":88204,"num_write":1135,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"266'422","reported_seq":1892,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.571407+0000","last_change":"2024-09-12T02:07:14.571407+0000","last_active":"2024-09-12T02:07:14.571407+0000","last_peered":"2024-09-12T02:07:14.571407+0000","last_clean":"2024-09-12T02:07:14.571407+0000","last_became_active":"2024-09-12T00:10:01.274405+0000","last_became_peered":"2024-09-12T00:10:01.274405+0000","last_unstale":"2024-09-12T02:07:14.571407+0000","last_undegraded":"2024-09-12T02:07:14.571407+0000","last_fullsized":"2024-09-12T02:07:14.571407+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'422","last_scrub_stamp":"2024-09-12T02:07:14.571149+0000","last_deep_scrub":"266'422","last_deep_scrub_stamp":"2024-09-12T02:07:14.571149+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.571149+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:55.197355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2137,"num_read_kb":2003,"num_write":477,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"266'378","reported_seq":1074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.950434+0000","last_change":"2024-09-12T02:07:12.950263+0000","last_active":"2024-09-12T02:07:12.950434+0000","last_peered":"2024-09-12T02:07:12.950434+0000","last_clean":"2024-09-12T02:07:12.950434+0000","last_became_active":"2024-09-12T00:09:59.248750+0000","last_became_peered":"2024-09-12T00:09:59.248750+0000","last_unstale":"2024-09-12T02:07:12.950434+0000","last_undegraded":"2024-09-12T02:07:12.950434+0000","last_fullsized":"2024-09-12T02:07:12.950434+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'378","last_scrub_stamp":"2024-09-12T02:07:12.949940+0000","last_deep_scrub":"266'378","last_deep_scrub_stamp":"2024-09-12T02:07:12.949940+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.949940+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:49.263377+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4478894,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":698,"num_read_kb":26164,"num_write":1140,"num_write_kb":31035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"266'820","reported_seq":2453,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.639619+0000","last_change":"2024-09-12T02:06:57.639619+0000","last_active":"2024-09-12T02:06:57.639619+0000","last_peered":"2024-09-12T02:06:57.639619+0000","last_clean":"2024-09-12T02:06:57.639619+0000","last_became_active":"2024-09-12T00:10:01.249016+0000","last_became_peered":"2024-09-12T00:10:01.249016+0000","last_unstale":"2024-09-12T02:06:57.639619+0000","last_undegraded":"2024-09-12T02:06:57.639619+0000","last_fullsized":"2024-09-12T02:06:57.639619+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'820","last_scrub_stamp":"2024-09-12T02:06:57.639429+0000","last_deep_scrub":"266'820","last_deep_scrub_stamp":"2024-09-12T02:06:57.639429+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.639429+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:20.206412+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3841,"num_read_kb":3467,"num_write":1075,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"266'628","reported_seq":2390,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.056138+0000","last_change":"2024-09-12T02:07:10.056138+0000","last_active":"2024-09-12T02:07:10.056138+0000","last_peered":"2024-09-12T02:07:10.056138+0000","last_clean":"2024-09-12T02:07:10.056138+0000","last_became_active":"2024-09-12T00:10:01.252790+0000","last_became_peered":"2024-09-12T00:10:01.252790+0000","last_unstale":"2024-09-12T02:07:10.056138+0000","last_undegraded":"2024-09-12T02:07:10.056138+0000","last_fullsized":"2024-09-12T02:07:10.056138+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'628","last_scrub_stamp":"2024-09-12T02:07:10.055950+0000","last_deep_scrub":"266'628","last_deep_scrub_stamp":"2024-09-12T02:07:10.055950+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.055950+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:28.740887+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2892,"num_write":772,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"266'411","reported_seq":1116,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.820593+0000","last_change":"2024-09-12T02:07:05.820593+0000","last_active":"2024-09-12T02:07:05.820593+0000","last_peered":"2024-09-12T02:07:05.820593+0000","last_clean":"2024-09-12T02:07:05.820593+0000","last_became_active":"2024-09-12T00:09:59.285279+0000","last_became_peered":"2024-09-12T00:09:59.285279+0000","last_unstale":"2024-09-12T02:07:05.820593+0000","last_undegraded":"2024-09-12T02:07:05.820593+0000","last_fullsized":"2024-09-12T02:07:05.820593+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'411","last_scrub_stamp":"2024-09-12T02:07:05.820309+0000","last_deep_scrub":"266'411","last_deep_scrub_stamp":"2024-09-12T02:07:05.820309+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.820309+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:56.300299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569417,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":647,"num_read_kb":33158,"num_write":1312,"num_write_kb":40723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"266'387","reported_seq":2068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.862281+0000","last_change":"2024-09-12T02:07:09.862281+0000","last_active":"2024-09-12T02:07:09.862281+0000","last_peered":"2024-09-12T02:07:09.862281+0000","last_clean":"2024-09-12T02:07:09.862281+0000","last_became_active":"2024-09-12T00:10:01.269235+0000","last_became_peered":"2024-09-12T00:10:01.269235+0000","last_unstale":"2024-09-12T02:07:09.862281+0000","last_undegraded":"2024-09-12T02:07:09.862281+0000","last_fullsized":"2024-09-12T02:07:09.862281+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'387","last_scrub_stamp":"2024-09-12T02:07:09.862094+0000","last_deep_scrub":"266'387","last_deep_scrub_stamp":"2024-09-12T02:07:09.862094+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.862094+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:04.979312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2516,"num_read_kb":2424,"num_write":449,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2781,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"266'351","reported_seq":1000,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.080909+0000","last_change":"2024-09-12T02:07:07.080909+0000","last_active":"2024-09-12T02:07:07.080909+0000","last_peered":"2024-09-12T02:07:07.080909+0000","last_clean":"2024-09-12T02:07:07.080909+0000","last_became_active":"2024-09-12T00:09:59.298975+0000","last_became_peered":"2024-09-12T00:09:59.298975+0000","last_unstale":"2024-09-12T02:07:07.080909+0000","last_undegraded":"2024-09-12T02:07:07.080909+0000","last_fullsized":"2024-09-12T02:07:07.080909+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'351","last_scrub_stamp":"2024-09-12T02:07:07.080684+0000","last_deep_scrub":"266'351","last_deep_scrub_stamp":"2024-09-12T02:07:07.080684+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.080684+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:09.511021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":20543,"num_write":987,"num_write_kb":37808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"266'1149","reported_seq":2691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.622569+0000","last_change":"2024-09-12T02:07:10.622569+0000","last_active":"2024-09-12T02:07:10.622569+0000","last_peered":"2024-09-12T02:07:10.622569+0000","last_clean":"2024-09-12T02:07:10.622569+0000","last_became_active":"2024-09-12T00:10:01.270566+0000","last_became_peered":"2024-09-12T00:10:01.270566+0000","last_unstale":"2024-09-12T02:07:10.622569+0000","last_undegraded":"2024-09-12T02:07:10.622569+0000","last_fullsized":"2024-09-12T02:07:10.622569+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1149","last_scrub_stamp":"2024-09-12T02:07:10.622387+0000","last_deep_scrub":"266'1149","last_deep_scrub_stamp":"2024-09-12T02:07:10.622387+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.622387+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":1100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:22.452419+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5146,"num_read_kb":4532,"num_write":1573,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"266'328","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.640773+0000","last_change":"2024-09-12T02:07:00.640773+0000","last_active":"2024-09-12T02:07:00.640773+0000","last_peered":"2024-09-12T02:07:00.640773+0000","last_clean":"2024-09-12T02:07:00.640773+0000","last_became_active":"2024-09-12T00:10:31.475207+0000","last_became_peered":"2024-09-12T00:10:31.475207+0000","last_unstale":"2024-09-12T02:07:00.640773+0000","last_undegraded":"2024-09-12T02:07:00.640773+0000","last_fullsized":"2024-09-12T02:07:00.640773+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'328","last_scrub_stamp":"2024-09-12T02:07:00.640512+0000","last_deep_scrub":"266'328","last_deep_scrub_stamp":"2024-09-12T02:07:00.640512+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.640512+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:25.664541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":35516,"num_write":1077,"num_write_kb":27332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,3],"acting":[2,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"266'425","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.618646+0000","last_change":"2024-09-12T02:07:02.618646+0000","last_active":"2024-09-12T02:07:02.618646+0000","last_peered":"2024-09-12T02:07:02.618646+0000","last_clean":"2024-09-12T02:07:02.618646+0000","last_became_active":"2024-09-12T00:10:01.249060+0000","last_became_peered":"2024-09-12T00:10:01.249060+0000","last_unstale":"2024-09-12T02:07:02.618646+0000","last_undegraded":"2024-09-12T02:07:02.618646+0000","last_fullsized":"2024-09-12T02:07:02.618646+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'425","last_scrub_stamp":"2024-09-12T02:07:02.618429+0000","last_deep_scrub":"266'425","last_deep_scrub_stamp":"2024-09-12T02:07:02.618429+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.618429+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:02.382238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2426,"num_read_kb":2301,"num_write":498,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"266'349","reported_seq":1022,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.046073+0000","last_change":"2024-09-12T02:06:58.046073+0000","last_active":"2024-09-12T02:06:58.046073+0000","last_peered":"2024-09-12T02:06:58.046073+0000","last_clean":"2024-09-12T02:06:58.046073+0000","last_became_active":"2024-09-12T00:09:59.308979+0000","last_became_peered":"2024-09-12T00:09:59.308979+0000","last_unstale":"2024-09-12T02:06:58.046073+0000","last_undegraded":"2024-09-12T02:06:58.046073+0000","last_fullsized":"2024-09-12T02:06:58.046073+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T02:06:58.045671+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T02:06:58.045671+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.045671+0000","objects_scrubbed":11,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:32.257450+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9921950,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":468,"num_read_kb":33875,"num_write":1037,"num_write_kb":29129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"266'441","reported_seq":1933,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.611005+0000","last_change":"2024-09-12T02:06:59.611005+0000","last_active":"2024-09-12T02:06:59.611005+0000","last_peered":"2024-09-12T02:06:59.611005+0000","last_clean":"2024-09-12T02:06:59.611005+0000","last_became_active":"2024-09-12T00:10:01.238251+0000","last_became_peered":"2024-09-12T00:10:01.238251+0000","last_unstale":"2024-09-12T02:06:59.611005+0000","last_undegraded":"2024-09-12T02:06:59.611005+0000","last_fullsized":"2024-09-12T02:06:59.611005+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'441","last_scrub_stamp":"2024-09-12T02:06:59.610833+0000","last_deep_scrub":"266'441","last_deep_scrub_stamp":"2024-09-12T02:06:59.610833+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.610833+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:13.031338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2194,"num_read_kb":2058,"num_write":515,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":230,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"266'313","reported_seq":968,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.896306+0000","last_change":"2024-09-12T02:07:00.896306+0000","last_active":"2024-09-12T02:07:00.896306+0000","last_peered":"2024-09-12T02:07:00.896306+0000","last_clean":"2024-09-12T02:07:00.896306+0000","last_became_active":"2024-09-12T00:09:59.262666+0000","last_became_peered":"2024-09-12T00:09:59.262666+0000","last_unstale":"2024-09-12T02:07:00.896306+0000","last_undegraded":"2024-09-12T02:07:00.896306+0000","last_fullsized":"2024-09-12T02:07:00.896306+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'313","last_scrub_stamp":"2024-09-12T02:07:00.896081+0000","last_deep_scrub":"266'313","last_deep_scrub_stamp":"2024-09-12T02:07:00.896081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.896081+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:49.352670+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433326,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":422,"num_read_kb":23030,"num_write":985,"num_write_kb":39870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"266'663","reported_seq":2190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.095132+0000","last_change":"2024-09-12T02:07:11.095132+0000","last_active":"2024-09-12T02:07:11.095132+0000","last_peered":"2024-09-12T02:07:11.095132+0000","last_clean":"2024-09-12T02:07:11.095132+0000","last_became_active":"2024-09-12T00:10:01.257792+0000","last_became_peered":"2024-09-12T00:10:01.257792+0000","last_unstale":"2024-09-12T02:07:11.095132+0000","last_undegraded":"2024-09-12T02:07:11.095132+0000","last_fullsized":"2024-09-12T02:07:11.095132+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'663","last_scrub_stamp":"2024-09-12T02:07:11.094919+0000","last_deep_scrub":"266'663","last_deep_scrub_stamp":"2024-09-12T02:07:11.094919+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.094919+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":600,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:28.585837+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3304,"num_read_kb":2964,"num_write":919,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1227,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"266'329","reported_seq":995,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.452573+0000","last_change":"2024-09-12T02:07:01.452411+0000","last_active":"2024-09-12T02:07:01.452573+0000","last_peered":"2024-09-12T02:07:01.452573+0000","last_clean":"2024-09-12T02:07:01.452573+0000","last_became_active":"2024-09-12T00:09:59.293921+0000","last_became_peered":"2024-09-12T00:09:59.293921+0000","last_unstale":"2024-09-12T02:07:01.452573+0000","last_undegraded":"2024-09-12T02:07:01.452573+0000","last_fullsized":"2024-09-12T02:07:01.452573+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'329","last_scrub_stamp":"2024-09-12T02:07:01.452129+0000","last_deep_scrub":"266'329","last_deep_scrub_stamp":"2024-09-12T02:07:01.452129+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.452129+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:18.604057+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262199,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":482,"num_read_kb":35722,"num_write":1084,"num_write_kb":28418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"266'144","reported_seq":688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.111301+0000","last_change":"2024-09-12T02:07:28.111301+0000","last_active":"2024-09-12T02:07:28.111301+0000","last_peered":"2024-09-12T02:07:28.111301+0000","last_clean":"2024-09-12T02:07:28.111301+0000","last_became_active":"2024-09-12T00:10:09.356144+0000","last_became_peered":"2024-09-12T00:10:09.356144+0000","last_unstale":"2024-09-12T02:07:28.111301+0000","last_undegraded":"2024-09-12T02:07:28.111301+0000","last_fullsized":"2024-09-12T02:07:28.111301+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'144","last_scrub_stamp":"2024-09-12T02:07:28.111105+0000","last_deep_scrub":"266'144","last_deep_scrub_stamp":"2024-09-12T02:07:28.111105+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.111105+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:26.381630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":165,"num_write":339,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"266'787","reported_seq":2344,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.925510+0000","last_change":"2024-09-12T02:07:05.925510+0000","last_active":"2024-09-12T02:07:05.925510+0000","last_peered":"2024-09-12T02:07:05.925510+0000","last_clean":"2024-09-12T02:07:05.925510+0000","last_became_active":"2024-09-12T00:10:01.259053+0000","last_became_peered":"2024-09-12T00:10:01.259053+0000","last_unstale":"2024-09-12T02:07:05.925510+0000","last_undegraded":"2024-09-12T02:07:05.925510+0000","last_fullsized":"2024-09-12T02:07:05.925510+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'787","last_scrub_stamp":"2024-09-12T02:07:05.925325+0000","last_deep_scrub":"266'787","last_deep_scrub_stamp":"2024-09-12T02:07:05.925325+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.925325+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:04.831866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3705,"num_read_kb":3341,"num_write":1024,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"266'390","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.742097+0000","last_change":"2024-09-12T02:07:00.742097+0000","last_active":"2024-09-12T02:07:00.742097+0000","last_peered":"2024-09-12T02:07:00.742097+0000","last_clean":"2024-09-12T02:07:00.742097+0000","last_became_active":"2024-09-12T00:09:59.310643+0000","last_became_peered":"2024-09-12T00:09:59.310643+0000","last_unstale":"2024-09-12T02:07:00.742097+0000","last_undegraded":"2024-09-12T02:07:00.742097+0000","last_fullsized":"2024-09-12T02:07:00.742097+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:07:00.741744+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:07:00.741744+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.741744+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:30.067710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136934,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":31265,"num_write":1302,"num_write_kb":60174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.567418+0000","last_change":"2024-09-12T02:07:16.567418+0000","last_active":"2024-09-12T02:07:16.567418+0000","last_peered":"2024-09-12T02:07:16.567418+0000","last_clean":"2024-09-12T02:07:16.567418+0000","last_became_active":"2024-09-12T00:10:03.271233+0000","last_became_peered":"2024-09-12T00:10:03.271233+0000","last_unstale":"2024-09-12T02:07:16.567418+0000","last_undegraded":"2024-09-12T02:07:16.567418+0000","last_fullsized":"2024-09-12T02:07:16.567418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:16.567230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:16.567230+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.567230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:20.643320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"266'381","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.545873+0000","last_change":"2024-09-12T02:07:19.545873+0000","last_active":"2024-09-12T02:07:19.545873+0000","last_peered":"2024-09-12T02:07:19.545873+0000","last_clean":"2024-09-12T02:07:19.545873+0000","last_became_active":"2024-09-12T00:10:05.285417+0000","last_became_peered":"2024-09-12T00:10:05.285417+0000","last_unstale":"2024-09-12T02:07:19.545873+0000","last_undegraded":"2024-09-12T02:07:19.545873+0000","last_fullsized":"2024-09-12T02:07:19.545873+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:07:19.545684+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:07:19.545684+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.545684+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:24.365440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47464,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1152,"num_write":460,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.871914+0000","last_change":"2024-09-12T02:07:23.871914+0000","last_active":"2024-09-12T02:07:23.871914+0000","last_peered":"2024-09-12T02:07:23.871914+0000","last_clean":"2024-09-12T02:07:23.871914+0000","last_became_active":"2024-09-12T00:10:07.318114+0000","last_became_peered":"2024-09-12T00:10:07.318114+0000","last_unstale":"2024-09-12T02:07:23.871914+0000","last_undegraded":"2024-09-12T02:07:23.871914+0000","last_fullsized":"2024-09-12T02:07:23.871914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:23.871689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:23.871689+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.871689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:41.246339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"266'2467","reported_seq":4407,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:35.762732+0000","last_change":"2024-09-12T02:07:35.762732+0000","last_active":"2024-09-12T02:07:35.762732+0000","last_peered":"2024-09-12T02:07:35.762732+0000","last_clean":"2024-09-12T02:07:35.762732+0000","last_became_active":"2024-09-12T00:10:09.370949+0000","last_became_peered":"2024-09-12T00:10:09.370949+0000","last_unstale":"2024-09-12T02:07:35.762732+0000","last_undegraded":"2024-09-12T02:07:35.762732+0000","last_fullsized":"2024-09-12T02:07:35.762732+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2467","last_scrub_stamp":"2024-09-12T02:07:35.762430+0000","last_deep_scrub":"266'2467","last_deep_scrub_stamp":"2024-09-12T02:07:35.762430+0000","last_clean_scrub_stamp":"2024-09-12T02:07:35.762430+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":2400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:11.708816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":210,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6210,"num_read_kb":6193,"num_write":4929,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"266'416","reported_seq":1962,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.578930+0000","last_change":"2024-09-12T02:07:09.578930+0000","last_active":"2024-09-12T02:07:09.578930+0000","last_peered":"2024-09-12T02:07:09.578930+0000","last_clean":"2024-09-12T02:07:09.578930+0000","last_became_active":"2024-09-12T00:10:01.274710+0000","last_became_peered":"2024-09-12T00:10:01.274710+0000","last_unstale":"2024-09-12T02:07:09.578930+0000","last_undegraded":"2024-09-12T02:07:09.578930+0000","last_fullsized":"2024-09-12T02:07:09.578930+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'416","last_scrub_stamp":"2024-09-12T02:07:09.578701+0000","last_deep_scrub":"266'416","last_deep_scrub_stamp":"2024-09-12T02:07:09.578701+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.578701+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:42.665393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2273,"num_read_kb":2145,"num_write":493,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"266'407","reported_seq":1136,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.555841+0000","last_change":"2024-09-12T02:06:57.555841+0000","last_active":"2024-09-12T02:06:57.555841+0000","last_peered":"2024-09-12T02:06:57.555841+0000","last_clean":"2024-09-12T02:06:57.555841+0000","last_became_active":"2024-09-12T00:09:59.282228+0000","last_became_peered":"2024-09-12T00:09:59.282228+0000","last_unstale":"2024-09-12T02:06:57.555841+0000","last_undegraded":"2024-09-12T02:06:57.555841+0000","last_fullsized":"2024-09-12T02:06:57.555841+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'407","last_scrub_stamp":"2024-09-12T02:06:57.555604+0000","last_deep_scrub":"266'407","last_deep_scrub_stamp":"2024-09-12T02:06:57.555604+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.555604+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:18.445365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":89139,"num_write":1493,"num_write_kb":44201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.972701+0000","last_change":"2024-09-12T02:07:13.972701+0000","last_active":"2024-09-12T02:07:13.972701+0000","last_peered":"2024-09-12T02:07:13.972701+0000","last_clean":"2024-09-12T02:07:13.972701+0000","last_became_active":"2024-09-12T00:10:03.254006+0000","last_became_peered":"2024-09-12T00:10:03.254006+0000","last_unstale":"2024-09-12T02:07:13.972701+0000","last_undegraded":"2024-09-12T02:07:13.972701+0000","last_fullsized":"2024-09-12T02:07:13.972701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.972525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.972525+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.972525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:24.718065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"266'142","reported_seq":726,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.052180+0000","last_change":"2024-09-12T02:07:20.052180+0000","last_active":"2024-09-12T02:07:20.052180+0000","last_peered":"2024-09-12T02:07:20.052180+0000","last_clean":"2024-09-12T02:07:20.052180+0000","last_became_active":"2024-09-12T00:10:05.279990+0000","last_became_peered":"2024-09-12T00:10:05.279990+0000","last_unstale":"2024-09-12T02:07:20.052180+0000","last_undegraded":"2024-09-12T02:07:20.052180+0000","last_fullsized":"2024-09-12T02:07:20.052180+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'142","last_scrub_stamp":"2024-09-12T02:07:20.051980+0000","last_deep_scrub":"266'142","last_deep_scrub_stamp":"2024-09-12T02:07:20.051980+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.051980+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:51.476200+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":161,"num_read_kb":157,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.082003+0000","last_change":"2024-09-12T02:07:24.082003+0000","last_active":"2024-09-12T02:07:24.082003+0000","last_peered":"2024-09-12T02:07:24.082003+0000","last_clean":"2024-09-12T02:07:24.082003+0000","last_became_active":"2024-09-12T00:10:07.309927+0000","last_became_peered":"2024-09-12T00:10:07.309927+0000","last_unstale":"2024-09-12T02:07:24.082003+0000","last_undegraded":"2024-09-12T02:07:24.082003+0000","last_fullsized":"2024-09-12T02:07:24.082003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.081817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.081817+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.081817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:55.034002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"266'107","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.538794+0000","last_change":"2024-09-12T02:07:27.538642+0000","last_active":"2024-09-12T02:07:27.538794+0000","last_peered":"2024-09-12T02:07:27.538794+0000","last_clean":"2024-09-12T02:07:27.538794+0000","last_became_active":"2024-09-12T00:10:09.364927+0000","last_became_peered":"2024-09-12T00:10:09.364927+0000","last_unstale":"2024-09-12T02:07:27.538794+0000","last_undegraded":"2024-09-12T02:07:27.538794+0000","last_fullsized":"2024-09-12T02:07:27.538794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'107","last_scrub_stamp":"2024-09-12T02:07:27.538445+0000","last_deep_scrub":"266'107","last_deep_scrub_stamp":"2024-09-12T02:07:27.538445+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.538445+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.515707+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":697,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":101,"num_read_kb":100,"num_write":243,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"266'382","reported_seq":1920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.543265+0000","last_change":"2024-09-12T02:07:05.543265+0000","last_active":"2024-09-12T02:07:05.543265+0000","last_peered":"2024-09-12T02:07:05.543265+0000","last_clean":"2024-09-12T02:07:05.543265+0000","last_became_active":"2024-09-12T00:10:01.246633+0000","last_became_peered":"2024-09-12T00:10:01.246633+0000","last_unstale":"2024-09-12T02:07:05.543265+0000","last_undegraded":"2024-09-12T02:07:05.543265+0000","last_fullsized":"2024-09-12T02:07:05.543265+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'382","last_scrub_stamp":"2024-09-12T02:07:05.543080+0000","last_deep_scrub":"266'382","last_deep_scrub_stamp":"2024-09-12T02:07:05.543080+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.543080+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:54.983427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2031,"num_read_kb":1954,"num_write":422,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"266'322","reported_seq":980,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.653422+0000","last_change":"2024-09-12T02:06:55.653280+0000","last_active":"2024-09-12T02:06:55.653422+0000","last_peered":"2024-09-12T02:06:55.653422+0000","last_clean":"2024-09-12T02:06:55.653422+0000","last_became_active":"2024-09-12T00:10:31.472231+0000","last_became_peered":"2024-09-12T00:10:31.472231+0000","last_unstale":"2024-09-12T02:06:55.653422+0000","last_undegraded":"2024-09-12T02:06:55.653422+0000","last_fullsized":"2024-09-12T02:06:55.653422+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'322","last_scrub_stamp":"2024-09-12T02:06:55.653042+0000","last_deep_scrub":"266'322","last_deep_scrub_stamp":"2024-09-12T02:06:55.653042+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.653042+0000","objects_scrubbed":10,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:59.726925+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536061,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":478,"num_read_kb":34994,"num_write":999,"num_write_kb":46604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"266'4","reported_seq":1015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.999979+0000","last_change":"2024-09-12T02:07:18.999979+0000","last_active":"2024-09-12T02:07:18.999979+0000","last_peered":"2024-09-12T02:07:18.999979+0000","last_clean":"2024-09-12T02:07:18.999979+0000","last_became_active":"2024-09-12T00:10:03.265816+0000","last_became_peered":"2024-09-12T00:10:03.265816+0000","last_unstale":"2024-09-12T02:07:18.999979+0000","last_undegraded":"2024-09-12T02:07:18.999979+0000","last_fullsized":"2024-09-12T02:07:18.999979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:18.999783+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:18.999783+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.999783+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:39.516415+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"266'196","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.644390+0000","last_change":"2024-09-12T02:07:12.644244+0000","last_active":"2024-09-12T02:07:12.644390+0000","last_peered":"2024-09-12T02:07:12.644390+0000","last_clean":"2024-09-12T02:07:12.644390+0000","last_became_active":"2024-09-12T00:10:05.275499+0000","last_became_peered":"2024-09-12T00:10:05.275499+0000","last_unstale":"2024-09-12T02:07:12.644390+0000","last_undegraded":"2024-09-12T02:07:12.644390+0000","last_fullsized":"2024-09-12T02:07:12.644390+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T02:07:12.643996+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T02:07:12.643996+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.643996+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:07.730489+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":245,"num_read_kb":237,"num_write":164,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"266'775","reported_seq":3039,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.840916+0000","last_change":"2024-09-12T02:07:22.840916+0000","last_active":"2024-09-12T02:07:22.840916+0000","last_peered":"2024-09-12T02:07:22.840916+0000","last_clean":"2024-09-12T02:07:22.840916+0000","last_became_active":"2024-09-12T00:10:07.318302+0000","last_became_peered":"2024-09-12T00:10:07.318302+0000","last_unstale":"2024-09-12T02:07:22.840916+0000","last_undegraded":"2024-09-12T02:07:22.840916+0000","last_fullsized":"2024-09-12T02:07:22.840916+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'775","last_scrub_stamp":"2024-09-12T02:07:22.840736+0000","last_deep_scrub":"266'775","last_deep_scrub_stamp":"2024-09-12T02:07:22.840736+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.840736+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:58.453710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"266'207","reported_seq":1070,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.115514+0000","last_change":"2024-09-12T02:07:30.115383+0000","last_active":"2024-09-12T02:07:30.115514+0000","last_peered":"2024-09-12T02:07:30.115514+0000","last_clean":"2024-09-12T02:07:30.115514+0000","last_became_active":"2024-09-12T00:10:09.433045+0000","last_became_peered":"2024-09-12T00:10:09.433045+0000","last_unstale":"2024-09-12T02:07:30.115514+0000","last_undegraded":"2024-09-12T02:07:30.115514+0000","last_fullsized":"2024-09-12T02:07:30.115514+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'207","last_scrub_stamp":"2024-09-12T02:07:30.115201+0000","last_deep_scrub":"266'207","last_deep_scrub_stamp":"2024-09-12T02:07:30.115201+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.115201+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:51.345596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":632,"num_read_kb":620,"num_write":453,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"266'392","reported_seq":1970,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.916035+0000","last_change":"2024-09-12T02:07:03.916035+0000","last_active":"2024-09-12T02:07:03.916035+0000","last_peered":"2024-09-12T02:07:03.916035+0000","last_clean":"2024-09-12T02:07:03.916035+0000","last_became_active":"2024-09-12T00:10:01.261217+0000","last_became_peered":"2024-09-12T00:10:01.261217+0000","last_unstale":"2024-09-12T02:07:03.916035+0000","last_undegraded":"2024-09-12T02:07:03.916035+0000","last_fullsized":"2024-09-12T02:07:03.916035+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T02:07:03.915856+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T02:07:03.915856+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.915856+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:20.348940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2298,"num_read_kb":2187,"num_write":432,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2545,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"266'343","reported_seq":1006,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.195668+0000","last_change":"2024-09-12T02:06:56.195668+0000","last_active":"2024-09-12T02:06:56.195668+0000","last_peered":"2024-09-12T02:06:56.195668+0000","last_clean":"2024-09-12T02:06:56.195668+0000","last_became_active":"2024-09-12T00:09:59.281330+0000","last_became_peered":"2024-09-12T00:09:59.281330+0000","last_unstale":"2024-09-12T02:06:56.195668+0000","last_undegraded":"2024-09-12T02:06:56.195668+0000","last_fullsized":"2024-09-12T02:06:56.195668+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'343","last_scrub_stamp":"2024-09-12T02:06:56.195432+0000","last_deep_scrub":"266'343","last_deep_scrub_stamp":"2024-09-12T02:06:56.195432+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.195432+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:40.190762+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":6619,"num_write":1099,"num_write_kb":41386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.561158+0000","last_change":"2024-09-12T02:07:17.561158+0000","last_active":"2024-09-12T02:07:17.561158+0000","last_peered":"2024-09-12T02:07:17.561158+0000","last_clean":"2024-09-12T02:07:17.561158+0000","last_became_active":"2024-09-12T00:10:03.271292+0000","last_became_peered":"2024-09-12T00:10:03.271292+0000","last_unstale":"2024-09-12T02:07:17.561158+0000","last_undegraded":"2024-09-12T02:07:17.561158+0000","last_fullsized":"2024-09-12T02:07:17.561158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:17.560974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:17.560974+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.560974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:50.417667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"266'325","reported_seq":951,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.857988+0000","last_change":"2024-09-12T02:07:19.857988+0000","last_active":"2024-09-12T02:07:19.857988+0000","last_peered":"2024-09-12T02:07:19.857988+0000","last_clean":"2024-09-12T02:07:19.857988+0000","last_became_active":"2024-09-12T00:10:05.361419+0000","last_became_peered":"2024-09-12T00:10:05.361419+0000","last_unstale":"2024-09-12T02:07:19.857988+0000","last_undegraded":"2024-09-12T02:07:19.857988+0000","last_fullsized":"2024-09-12T02:07:19.857988+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'325","last_scrub_stamp":"2024-09-12T02:07:19.857782+0000","last_deep_scrub":"266'325","last_deep_scrub_stamp":"2024-09-12T02:07:19.857782+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.857782+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:54.271134+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61656,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":523,"num_read_kb":1153,"num_write":418,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"266'827","reported_seq":3131,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.989364+0000","last_change":"2024-09-12T02:07:26.989364+0000","last_active":"2024-09-12T02:07:26.989364+0000","last_peered":"2024-09-12T02:07:26.989364+0000","last_clean":"2024-09-12T02:07:26.989364+0000","last_became_active":"2024-09-12T00:10:07.335181+0000","last_became_peered":"2024-09-12T00:10:07.335181+0000","last_unstale":"2024-09-12T02:07:26.989364+0000","last_undegraded":"2024-09-12T02:07:26.989364+0000","last_fullsized":"2024-09-12T02:07:26.989364+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'827","last_scrub_stamp":"2024-09-12T02:07:26.989178+0000","last_deep_scrub":"266'827","last_deep_scrub_stamp":"2024-09-12T02:07:26.989178+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.989178+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:22.733341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"266'423","reported_seq":1883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.631654+0000","last_change":"2024-09-12T02:07:08.631654+0000","last_active":"2024-09-12T02:07:08.631654+0000","last_peered":"2024-09-12T02:07:08.631654+0000","last_clean":"2024-09-12T02:07:08.631654+0000","last_became_active":"2024-09-12T00:10:01.266204+0000","last_became_peered":"2024-09-12T00:10:01.266204+0000","last_unstale":"2024-09-12T02:07:08.631654+0000","last_undegraded":"2024-09-12T02:07:08.631654+0000","last_fullsized":"2024-09-12T02:07:08.631654+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T02:07:08.631455+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T02:07:08.631455+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.631455+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:50.621125+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2063,"num_read_kb":1939,"num_write":461,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":712,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"266'375","reported_seq":1040,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.749038+0000","last_change":"2024-09-12T02:06:59.748793+0000","last_active":"2024-09-12T02:06:59.749038+0000","last_peered":"2024-09-12T02:06:59.749038+0000","last_clean":"2024-09-12T02:06:59.749038+0000","last_became_active":"2024-09-12T00:09:59.307481+0000","last_became_peered":"2024-09-12T00:09:59.307481+0000","last_unstale":"2024-09-12T02:06:59.749038+0000","last_undegraded":"2024-09-12T02:06:59.749038+0000","last_fullsized":"2024-09-12T02:06:59.749038+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'375","last_scrub_stamp":"2024-09-12T02:06:59.748525+0000","last_deep_scrub":"266'375","last_deep_scrub_stamp":"2024-09-12T02:06:59.748525+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.748525+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:19.336128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306247,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":540,"num_read_kb":11316,"num_write":1196,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.894687+0000","last_change":"2024-09-12T02:07:12.894687+0000","last_active":"2024-09-12T02:07:12.894687+0000","last_peered":"2024-09-12T02:07:12.894687+0000","last_clean":"2024-09-12T02:07:12.894687+0000","last_became_active":"2024-09-12T00:10:03.258601+0000","last_became_peered":"2024-09-12T00:10:03.258601+0000","last_unstale":"2024-09-12T02:07:12.894687+0000","last_undegraded":"2024-09-12T02:07:12.894687+0000","last_fullsized":"2024-09-12T02:07:12.894687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.894507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.894507+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.894507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:09.932960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"266'487","reported_seq":1198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.603541+0000","last_change":"2024-09-12T02:07:21.603383+0000","last_active":"2024-09-12T02:07:21.603541+0000","last_peered":"2024-09-12T02:07:21.603541+0000","last_clean":"2024-09-12T02:07:21.603541+0000","last_became_active":"2024-09-12T00:10:05.361273+0000","last_became_peered":"2024-09-12T00:10:05.361273+0000","last_unstale":"2024-09-12T02:07:21.603541+0000","last_undegraded":"2024-09-12T02:07:21.603541+0000","last_fullsized":"2024-09-12T02:07:21.603541+0000","mapping_epoch":31,"log_start":"266'400","ondisk_log_start":"266'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'487","last_scrub_stamp":"2024-09-12T02:07:21.603162+0000","last_deep_scrub":"266'487","last_deep_scrub_stamp":"2024-09-12T02:07:21.603162+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.603162+0000","objects_scrubbed":10,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:05.657227+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46961,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":773,"num_read_kb":1424,"num_write":592,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.370591+0000","last_change":"2024-09-12T02:07:09.370591+0000","last_active":"2024-09-12T02:07:09.370591+0000","last_peered":"2024-09-12T02:07:09.370591+0000","last_clean":"2024-09-12T02:07:09.370591+0000","last_became_active":"2024-09-12T00:10:07.316670+0000","last_became_peered":"2024-09-12T00:10:07.316670+0000","last_unstale":"2024-09-12T02:07:09.370591+0000","last_undegraded":"2024-09-12T02:07:09.370591+0000","last_fullsized":"2024-09-12T02:07:09.370591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.370411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.370411+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.370411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:33.487199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"266'603","reported_seq":1453,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.649492+0000","last_change":"2024-09-12T02:07:26.649492+0000","last_active":"2024-09-12T02:07:26.649492+0000","last_peered":"2024-09-12T02:07:26.649492+0000","last_clean":"2024-09-12T02:07:26.649492+0000","last_became_active":"2024-09-12T00:10:09.368091+0000","last_became_peered":"2024-09-12T00:10:09.368091+0000","last_unstale":"2024-09-12T02:07:26.649492+0000","last_undegraded":"2024-09-12T02:07:26.649492+0000","last_fullsized":"2024-09-12T02:07:26.649492+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'603","last_scrub_stamp":"2024-09-12T02:07:26.649300+0000","last_deep_scrub":"266'603","last_deep_scrub_stamp":"2024-09-12T02:07:26.649300+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.649300+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:49.249973+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1323,"num_read_kb":1320,"num_write":1284,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"266'478","reported_seq":2146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.004942+0000","last_change":"2024-09-12T02:06:59.004792+0000","last_active":"2024-09-12T02:06:59.004942+0000","last_peered":"2024-09-12T02:06:59.004942+0000","last_clean":"2024-09-12T02:06:59.004942+0000","last_became_active":"2024-09-12T00:10:01.257821+0000","last_became_peered":"2024-09-12T00:10:01.257821+0000","last_unstale":"2024-09-12T02:06:59.004942+0000","last_undegraded":"2024-09-12T02:06:59.004942+0000","last_fullsized":"2024-09-12T02:06:59.004942+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T02:06:59.004587+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T02:06:59.004587+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.004587+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:37.594672+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2372,"num_write":561,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"266'348","reported_seq":1005,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.746366+0000","last_change":"2024-09-12T02:06:58.746131+0000","last_active":"2024-09-12T02:06:58.746366+0000","last_peered":"2024-09-12T02:06:58.746366+0000","last_clean":"2024-09-12T02:06:58.746366+0000","last_became_active":"2024-09-12T00:09:59.308185+0000","last_became_peered":"2024-09-12T00:09:59.308185+0000","last_unstale":"2024-09-12T02:06:58.746366+0000","last_undegraded":"2024-09-12T02:06:58.746366+0000","last_fullsized":"2024-09-12T02:06:58.746366+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'348","last_scrub_stamp":"2024-09-12T02:06:58.745829+0000","last_deep_scrub":"266'348","last_deep_scrub_stamp":"2024-09-12T02:06:58.745829+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.745829+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:55.531829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":32387,"num_write":1082,"num_write_kb":39559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.633879+0000","last_change":"2024-09-12T02:07:03.633737+0000","last_active":"2024-09-12T02:07:03.633879+0000","last_peered":"2024-09-12T02:07:03.633879+0000","last_clean":"2024-09-12T02:07:03.633879+0000","last_became_active":"2024-09-12T00:10:03.250360+0000","last_became_peered":"2024-09-12T00:10:03.250360+0000","last_unstale":"2024-09-12T02:07:03.633879+0000","last_undegraded":"2024-09-12T02:07:03.633879+0000","last_fullsized":"2024-09-12T02:07:03.633879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:03.633514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:03.633514+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.633514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:58.442879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"266'314","reported_seq":948,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.008699+0000","last_change":"2024-09-12T02:07:23.008699+0000","last_active":"2024-09-12T02:07:23.008699+0000","last_peered":"2024-09-12T02:07:23.008699+0000","last_clean":"2024-09-12T02:07:23.008699+0000","last_became_active":"2024-09-12T00:10:05.288035+0000","last_became_peered":"2024-09-12T00:10:05.288035+0000","last_unstale":"2024-09-12T02:07:23.008699+0000","last_undegraded":"2024-09-12T02:07:23.008699+0000","last_fullsized":"2024-09-12T02:07:23.008699+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'314","last_scrub_stamp":"2024-09-12T02:07:23.008515+0000","last_deep_scrub":"266'314","last_deep_scrub_stamp":"2024-09-12T02:07:23.008515+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.008515+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:13.204707+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51853,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1112,"num_write":408,"num_write_kb":295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.956571+0000","last_change":"2024-09-12T02:07:23.956414+0000","last_active":"2024-09-12T02:07:23.956571+0000","last_peered":"2024-09-12T02:07:23.956571+0000","last_clean":"2024-09-12T02:07:23.956571+0000","last_became_active":"2024-09-12T00:10:07.340248+0000","last_became_peered":"2024-09-12T00:10:07.340248+0000","last_unstale":"2024-09-12T02:07:23.956571+0000","last_undegraded":"2024-09-12T02:07:23.956571+0000","last_fullsized":"2024-09-12T02:07:23.956571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:23.956228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:23.956228+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.956228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:23.703295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"266'117","reported_seq":653,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.126059+0000","last_change":"2024-09-12T02:07:16.125890+0000","last_active":"2024-09-12T02:07:16.126059+0000","last_peered":"2024-09-12T02:07:16.126059+0000","last_clean":"2024-09-12T02:07:16.126059+0000","last_became_active":"2024-09-12T00:10:09.359663+0000","last_became_peered":"2024-09-12T00:10:09.359663+0000","last_unstale":"2024-09-12T02:07:16.126059+0000","last_undegraded":"2024-09-12T02:07:16.126059+0000","last_fullsized":"2024-09-12T02:07:16.126059+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'117","last_scrub_stamp":"2024-09-12T02:07:16.125715+0000","last_deep_scrub":"266'117","last_deep_scrub_stamp":"2024-09-12T02:07:16.125715+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.125715+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:39.824814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":110,"num_write":272,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"266'1044","reported_seq":2845,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.041016+0000","last_change":"2024-09-12T02:07:02.040796+0000","last_active":"2024-09-12T02:07:02.041016+0000","last_peered":"2024-09-12T02:07:02.041016+0000","last_clean":"2024-09-12T02:07:02.041016+0000","last_became_active":"2024-09-12T00:10:01.263012+0000","last_became_peered":"2024-09-12T00:10:01.263012+0000","last_unstale":"2024-09-12T02:07:02.041016+0000","last_undegraded":"2024-09-12T02:07:02.041016+0000","last_fullsized":"2024-09-12T02:07:02.041016+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1044","last_scrub_stamp":"2024-09-12T02:07:02.040566+0000","last_deep_scrub":"266'1044","last_deep_scrub_stamp":"2024-09-12T02:07:02.040566+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.040566+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":1000,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:28.934270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4917,"num_read_kb":4393,"num_write":1427,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"266'301","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.605434+0000","last_change":"2024-09-12T02:07:01.605147+0000","last_active":"2024-09-12T02:07:01.605434+0000","last_peered":"2024-09-12T02:07:01.605434+0000","last_clean":"2024-09-12T02:07:01.605434+0000","last_became_active":"2024-09-12T00:10:31.477934+0000","last_became_peered":"2024-09-12T00:10:31.477934+0000","last_unstale":"2024-09-12T02:07:01.605434+0000","last_undegraded":"2024-09-12T02:07:01.605434+0000","last_fullsized":"2024-09-12T02:07:01.605434+0000","mapping_epoch":38,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'301","last_scrub_stamp":"2024-09-12T02:07:01.604849+0000","last_deep_scrub":"266'301","last_deep_scrub_stamp":"2024-09-12T02:07:01.604849+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.604849+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.155816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":400,"num_read_kb":33911,"num_write":938,"num_write_kb":31727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.745903+0000","last_change":"2024-09-12T02:07:07.745903+0000","last_active":"2024-09-12T02:07:07.745903+0000","last_peered":"2024-09-12T02:07:07.745903+0000","last_clean":"2024-09-12T02:07:07.745903+0000","last_became_active":"2024-09-12T00:10:03.254328+0000","last_became_peered":"2024-09-12T00:10:03.254328+0000","last_unstale":"2024-09-12T02:07:07.745903+0000","last_undegraded":"2024-09-12T02:07:07.745903+0000","last_fullsized":"2024-09-12T02:07:07.745903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.745700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.745700+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.745700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:02.537185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"266'406","reported_seq":1080,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.814460+0000","last_change":"2024-09-12T02:07:17.814460+0000","last_active":"2024-09-12T02:07:17.814460+0000","last_peered":"2024-09-12T02:07:17.814460+0000","last_clean":"2024-09-12T02:07:17.814460+0000","last_became_active":"2024-09-12T00:10:05.285616+0000","last_became_peered":"2024-09-12T00:10:05.285616+0000","last_unstale":"2024-09-12T02:07:17.814460+0000","last_undegraded":"2024-09-12T02:07:17.814460+0000","last_fullsized":"2024-09-12T02:07:17.814460+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'406","last_scrub_stamp":"2024-09-12T02:07:17.814268+0000","last_deep_scrub":"266'406","last_deep_scrub_stamp":"2024-09-12T02:07:17.814268+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.814268+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:26.930072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44989,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":636,"num_read_kb":1221,"num_write":494,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"266'804","reported_seq":3302,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.577881+0000","last_change":"2024-09-12T02:07:20.577881+0000","last_active":"2024-09-12T02:07:20.577881+0000","last_peered":"2024-09-12T02:07:20.577881+0000","last_clean":"2024-09-12T02:07:20.577881+0000","last_became_active":"2024-09-12T00:10:07.319708+0000","last_became_peered":"2024-09-12T00:10:07.319708+0000","last_unstale":"2024-09-12T02:07:20.577881+0000","last_undegraded":"2024-09-12T02:07:20.577881+0000","last_fullsized":"2024-09-12T02:07:20.577881+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'804","last_scrub_stamp":"2024-09-12T02:07:20.577711+0000","last_deep_scrub":"266'804","last_deep_scrub_stamp":"2024-09-12T02:07:20.577711+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.577711+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:31.700028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"266'113","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.544103+0000","last_change":"2024-09-12T02:07:26.544103+0000","last_active":"2024-09-12T02:07:26.544103+0000","last_peered":"2024-09-12T02:07:26.544103+0000","last_clean":"2024-09-12T02:07:26.544103+0000","last_became_active":"2024-09-12T00:10:09.357682+0000","last_became_peered":"2024-09-12T00:10:09.357682+0000","last_unstale":"2024-09-12T02:07:26.544103+0000","last_undegraded":"2024-09-12T02:07:26.544103+0000","last_fullsized":"2024-09-12T02:07:26.544103+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'113","last_scrub_stamp":"2024-09-12T02:07:26.543887+0000","last_deep_scrub":"266'113","last_deep_scrub_stamp":"2024-09-12T02:07:26.543887+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.543887+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:23.602052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":116,"num_write":265,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"266'779","reported_seq":2348,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.499361+0000","last_change":"2024-09-12T02:07:04.499361+0000","last_active":"2024-09-12T02:07:04.499361+0000","last_peered":"2024-09-12T02:07:04.499361+0000","last_clean":"2024-09-12T02:07:04.499361+0000","last_became_active":"2024-09-12T00:10:01.258536+0000","last_became_peered":"2024-09-12T00:10:01.258536+0000","last_unstale":"2024-09-12T02:07:04.499361+0000","last_undegraded":"2024-09-12T02:07:04.499361+0000","last_fullsized":"2024-09-12T02:07:04.499361+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'779","last_scrub_stamp":"2024-09-12T02:07:04.499174+0000","last_deep_scrub":"266'779","last_deep_scrub_stamp":"2024-09-12T02:07:04.499174+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.499174+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:49.045153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3854,"num_read_kb":3489,"num_write":1035,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"266'390","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.676263+0000","last_change":"2024-09-12T02:06:58.676117+0000","last_active":"2024-09-12T02:06:58.676263+0000","last_peered":"2024-09-12T02:06:58.676263+0000","last_clean":"2024-09-12T02:06:58.676263+0000","last_became_active":"2024-09-12T00:09:59.283882+0000","last_became_peered":"2024-09-12T00:09:59.283882+0000","last_unstale":"2024-09-12T02:06:58.676263+0000","last_undegraded":"2024-09-12T02:06:58.676263+0000","last_fullsized":"2024-09-12T02:06:58.676263+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:06:58.675891+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:06:58.675891+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.675891+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:34.972022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":499,"num_read_kb":25090,"num_write":1213,"num_write_kb":35310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.707801+0000","last_change":"2024-09-12T02:07:05.707659+0000","last_active":"2024-09-12T02:07:05.707801+0000","last_peered":"2024-09-12T02:07:05.707801+0000","last_clean":"2024-09-12T02:07:05.707801+0000","last_became_active":"2024-09-12T00:10:03.250840+0000","last_became_peered":"2024-09-12T00:10:03.250840+0000","last_unstale":"2024-09-12T02:07:05.707801+0000","last_undegraded":"2024-09-12T02:07:05.707801+0000","last_fullsized":"2024-09-12T02:07:05.707801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:05.707476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:05.707476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.707476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:17.730653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"266'545","reported_seq":1246,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.544969+0000","last_change":"2024-09-12T02:07:16.544969+0000","last_active":"2024-09-12T02:07:16.544969+0000","last_peered":"2024-09-12T02:07:16.544969+0000","last_clean":"2024-09-12T02:07:16.544969+0000","last_became_active":"2024-09-12T00:10:05.285823+0000","last_became_peered":"2024-09-12T00:10:05.285823+0000","last_unstale":"2024-09-12T02:07:16.544969+0000","last_undegraded":"2024-09-12T02:07:16.544969+0000","last_fullsized":"2024-09-12T02:07:16.544969+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'545","last_scrub_stamp":"2024-09-12T02:07:16.544864+0000","last_deep_scrub":"266'545","last_deep_scrub_stamp":"2024-09-12T02:07:16.544864+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.544864+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:16.677319+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96632,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":936,"num_read_kb":2160,"num_write":758,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.666557+0000","last_change":"2024-09-12T02:07:09.666557+0000","last_active":"2024-09-12T02:07:09.666557+0000","last_peered":"2024-09-12T02:07:09.666557+0000","last_clean":"2024-09-12T02:07:09.666557+0000","last_became_active":"2024-09-12T00:10:07.321180+0000","last_became_peered":"2024-09-12T00:10:07.321180+0000","last_unstale":"2024-09-12T02:07:09.666557+0000","last_undegraded":"2024-09-12T02:07:09.666557+0000","last_fullsized":"2024-09-12T02:07:09.666557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.666383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.666383+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.666383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:09.668378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"266'136","reported_seq":722,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.504910+0000","last_change":"2024-09-12T02:07:20.504910+0000","last_active":"2024-09-12T02:07:20.504910+0000","last_peered":"2024-09-12T02:07:20.504910+0000","last_clean":"2024-09-12T02:07:20.504910+0000","last_became_active":"2024-09-12T00:10:09.359011+0000","last_became_peered":"2024-09-12T00:10:09.359011+0000","last_unstale":"2024-09-12T02:07:20.504910+0000","last_undegraded":"2024-09-12T02:07:20.504910+0000","last_fullsized":"2024-09-12T02:07:20.504910+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'136","last_scrub_stamp":"2024-09-12T02:07:20.504684+0000","last_deep_scrub":"266'136","last_deep_scrub_stamp":"2024-09-12T02:07:20.504684+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.504684+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:40.032140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":320,"num_read_kb":272,"num_write":321,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"266'1105","reported_seq":2654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.037747+0000","last_change":"2024-09-12T02:07:00.037591+0000","last_active":"2024-09-12T02:07:00.037747+0000","last_peered":"2024-09-12T02:07:00.037747+0000","last_clean":"2024-09-12T02:07:00.037747+0000","last_became_active":"2024-09-12T00:10:01.248297+0000","last_became_peered":"2024-09-12T00:10:01.248297+0000","last_unstale":"2024-09-12T02:07:00.037747+0000","last_undegraded":"2024-09-12T02:07:00.037747+0000","last_fullsized":"2024-09-12T02:07:00.037747+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1105","last_scrub_stamp":"2024-09-12T02:07:00.037413+0000","last_deep_scrub":"266'1105","last_deep_scrub_stamp":"2024-09-12T02:07:00.037413+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.037413+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":1000,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.519559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4909,"num_read_kb":4337,"num_write":1501,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"266'325","reported_seq":988,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.848958+0000","last_change":"2024-09-12T02:06:57.848683+0000","last_active":"2024-09-12T02:06:57.848958+0000","last_peered":"2024-09-12T02:06:57.848958+0000","last_clean":"2024-09-12T02:06:57.848958+0000","last_became_active":"2024-09-12T00:10:31.165905+0000","last_became_peered":"2024-09-12T00:10:31.165905+0000","last_unstale":"2024-09-12T02:06:57.848958+0000","last_undegraded":"2024-09-12T02:06:57.848958+0000","last_fullsized":"2024-09-12T02:06:57.848958+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'325","last_scrub_stamp":"2024-09-12T02:06:57.848241+0000","last_deep_scrub":"266'325","last_deep_scrub_stamp":"2024-09-12T02:06:57.848241+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.848241+0000","objects_scrubbed":9,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:33.677094+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273693,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":433,"num_read_kb":2613,"num_write":1035,"num_write_kb":17332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,7],"acting":[3,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.710647+0000","last_change":"2024-09-12T02:07:08.710647+0000","last_active":"2024-09-12T02:07:08.710647+0000","last_peered":"2024-09-12T02:07:08.710647+0000","last_clean":"2024-09-12T02:07:08.710647+0000","last_became_active":"2024-09-12T00:10:03.254056+0000","last_became_peered":"2024-09-12T00:10:03.254056+0000","last_unstale":"2024-09-12T02:07:08.710647+0000","last_undegraded":"2024-09-12T02:07:08.710647+0000","last_fullsized":"2024-09-12T02:07:08.710647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:08.710471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:08.710471+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.710471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:45.641565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"266'386","reported_seq":1032,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.005724+0000","last_change":"2024-09-12T02:07:19.005724+0000","last_active":"2024-09-12T02:07:19.005724+0000","last_peered":"2024-09-12T02:07:19.005724+0000","last_clean":"2024-09-12T02:07:19.005724+0000","last_became_active":"2024-09-12T00:10:05.299568+0000","last_became_peered":"2024-09-12T00:10:05.299568+0000","last_unstale":"2024-09-12T02:07:19.005724+0000","last_undegraded":"2024-09-12T02:07:19.005724+0000","last_fullsized":"2024-09-12T02:07:19.005724+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'386","last_scrub_stamp":"2024-09-12T02:07:19.005515+0000","last_deep_scrub":"266'386","last_deep_scrub_stamp":"2024-09-12T02:07:19.005515+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.005515+0000","objects_scrubbed":7,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:06.836073+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53522,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":635,"num_read_kb":1318,"num_write":554,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.637034+0000","last_change":"2024-09-12T02:07:22.636915+0000","last_active":"2024-09-12T02:07:22.637034+0000","last_peered":"2024-09-12T02:07:22.637034+0000","last_clean":"2024-09-12T02:07:22.637034+0000","last_became_active":"2024-09-12T00:10:07.334527+0000","last_became_peered":"2024-09-12T00:10:07.334527+0000","last_unstale":"2024-09-12T02:07:22.637034+0000","last_undegraded":"2024-09-12T02:07:22.637034+0000","last_fullsized":"2024-09-12T02:07:22.637034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:22.636687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:22.636687+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.636687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:15.135340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"266'175","reported_seq":755,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:32.964268+0000","last_change":"2024-09-12T02:07:32.964268+0000","last_active":"2024-09-12T02:07:32.964268+0000","last_peered":"2024-09-12T02:07:32.964268+0000","last_clean":"2024-09-12T02:07:32.964268+0000","last_became_active":"2024-09-12T00:10:09.373318+0000","last_became_peered":"2024-09-12T00:10:09.373318+0000","last_unstale":"2024-09-12T02:07:32.964268+0000","last_undegraded":"2024-09-12T02:07:32.964268+0000","last_fullsized":"2024-09-12T02:07:32.964268+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'175","last_scrub_stamp":"2024-09-12T02:07:32.964072+0000","last_deep_scrub":"266'175","last_deep_scrub_stamp":"2024-09-12T02:07:32.964072+0000","last_clean_scrub_stamp":"2024-09-12T02:07:32.964072+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:45.058830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":275,"num_write":406,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"266'793","reported_seq":2426,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.049441+0000","last_change":"2024-09-12T02:07:01.049290+0000","last_active":"2024-09-12T02:07:01.049441+0000","last_peered":"2024-09-12T02:07:01.049441+0000","last_clean":"2024-09-12T02:07:01.049441+0000","last_became_active":"2024-09-12T00:10:01.242213+0000","last_became_peered":"2024-09-12T00:10:01.242213+0000","last_unstale":"2024-09-12T02:07:01.049441+0000","last_undegraded":"2024-09-12T02:07:01.049441+0000","last_fullsized":"2024-09-12T02:07:01.049441+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'793","last_scrub_stamp":"2024-09-12T02:07:01.049091+0000","last_deep_scrub":"266'793","last_deep_scrub_stamp":"2024-09-12T02:07:01.049091+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.049091+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:47.730275+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3776,"num_read_kb":3427,"num_write":1023,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"266'387","reported_seq":1087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.183542+0000","last_change":"2024-09-12T02:06:57.183396+0000","last_active":"2024-09-12T02:06:57.183542+0000","last_peered":"2024-09-12T02:06:57.183542+0000","last_clean":"2024-09-12T02:06:57.183542+0000","last_became_active":"2024-09-12T00:09:59.298986+0000","last_became_peered":"2024-09-12T00:09:59.298986+0000","last_unstale":"2024-09-12T02:06:57.183542+0000","last_undegraded":"2024-09-12T02:06:57.183542+0000","last_fullsized":"2024-09-12T02:06:57.183542+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'387","last_scrub_stamp":"2024-09-12T02:06:57.183120+0000","last_deep_scrub":"266'387","last_deep_scrub_stamp":"2024-09-12T02:06:57.183120+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.183120+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:28.858130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":586,"num_read_kb":16563,"num_write":1186,"num_write_kb":29581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.329996+0000","last_change":"2024-09-12T02:07:06.329996+0000","last_active":"2024-09-12T02:07:06.329996+0000","last_peered":"2024-09-12T02:07:06.329996+0000","last_clean":"2024-09-12T02:07:06.329996+0000","last_became_active":"2024-09-12T00:10:03.262121+0000","last_became_peered":"2024-09-12T00:10:03.262121+0000","last_unstale":"2024-09-12T02:07:06.329996+0000","last_undegraded":"2024-09-12T02:07:06.329996+0000","last_fullsized":"2024-09-12T02:07:06.329996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:06.329806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:06.329806+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.329806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:06.288745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"266'396","reported_seq":1060,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.650731+0000","last_change":"2024-09-12T02:07:11.650583+0000","last_active":"2024-09-12T02:07:11.650731+0000","last_peered":"2024-09-12T02:07:11.650731+0000","last_clean":"2024-09-12T02:07:11.650731+0000","last_became_active":"2024-09-12T00:10:05.294629+0000","last_became_peered":"2024-09-12T00:10:05.294629+0000","last_unstale":"2024-09-12T02:07:11.650731+0000","last_undegraded":"2024-09-12T02:07:11.650731+0000","last_fullsized":"2024-09-12T02:07:11.650731+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'396","last_scrub_stamp":"2024-09-12T02:07:11.650372+0000","last_deep_scrub":"266'396","last_deep_scrub_stamp":"2024-09-12T02:07:11.650372+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.650372+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:14.428526+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46543,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":631,"num_read_kb":1251,"num_write":492,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"266'749","reported_seq":3296,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.619689+0000","last_change":"2024-09-12T02:07:10.619689+0000","last_active":"2024-09-12T02:07:10.619689+0000","last_peered":"2024-09-12T02:07:10.619689+0000","last_clean":"2024-09-12T02:07:10.619689+0000","last_became_active":"2024-09-12T00:10:07.314777+0000","last_became_peered":"2024-09-12T00:10:07.314777+0000","last_unstale":"2024-09-12T02:07:10.619689+0000","last_undegraded":"2024-09-12T02:07:10.619689+0000","last_fullsized":"2024-09-12T02:07:10.619689+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'749","last_scrub_stamp":"2024-09-12T02:07:10.619509+0000","last_deep_scrub":"266'749","last_deep_scrub_stamp":"2024-09-12T02:07:10.619509+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.619509+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:06.239730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"266'138","reported_seq":684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.467280+0000","last_change":"2024-09-12T02:07:17.467280+0000","last_active":"2024-09-12T02:07:17.467280+0000","last_peered":"2024-09-12T02:07:17.467280+0000","last_clean":"2024-09-12T02:07:17.467280+0000","last_became_active":"2024-09-12T00:10:09.346452+0000","last_became_peered":"2024-09-12T00:10:09.346452+0000","last_unstale":"2024-09-12T02:07:17.467280+0000","last_undegraded":"2024-09-12T02:07:17.467280+0000","last_fullsized":"2024-09-12T02:07:17.467280+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'138","last_scrub_stamp":"2024-09-12T02:07:17.467075+0000","last_deep_scrub":"266'138","last_deep_scrub_stamp":"2024-09-12T02:07:17.467075+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.467075+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:51.463617+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2119,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":133,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"266'1061","reported_seq":2659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.049484+0000","last_change":"2024-09-12T02:07:02.049238+0000","last_active":"2024-09-12T02:07:02.049484+0000","last_peered":"2024-09-12T02:07:02.049484+0000","last_clean":"2024-09-12T02:07:02.049484+0000","last_became_active":"2024-09-12T00:10:01.264718+0000","last_became_peered":"2024-09-12T00:10:01.264718+0000","last_unstale":"2024-09-12T02:07:02.049484+0000","last_undegraded":"2024-09-12T02:07:02.049484+0000","last_fullsized":"2024-09-12T02:07:02.049484+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1061","last_scrub_stamp":"2024-09-12T02:07:02.049006+0000","last_deep_scrub":"266'1061","last_deep_scrub_stamp":"2024-09-12T02:07:02.049006+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.049006+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":1000,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:54.290718+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4853,"num_read_kb":4249,"num_write":1477,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1148,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"266'417","reported_seq":1122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.038069+0000","last_change":"2024-09-12T02:06:54.037809+0000","last_active":"2024-09-12T02:06:54.038069+0000","last_peered":"2024-09-12T02:06:54.038069+0000","last_clean":"2024-09-12T02:06:54.038069+0000","last_became_active":"2024-09-12T00:09:59.301303+0000","last_became_peered":"2024-09-12T00:09:59.301303+0000","last_unstale":"2024-09-12T02:06:54.038069+0000","last_undegraded":"2024-09-12T02:06:54.038069+0000","last_fullsized":"2024-09-12T02:06:54.038069+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'417","last_scrub_stamp":"2024-09-12T02:06:54.037420+0000","last_deep_scrub":"266'417","last_deep_scrub_stamp":"2024-09-12T02:06:54.037420+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.037420+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:35.287042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1443899,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":629,"num_read_kb":39523,"num_write":1279,"num_write_kb":37758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.556793+0000","last_change":"2024-09-12T02:07:19.556652+0000","last_active":"2024-09-12T02:07:19.556793+0000","last_peered":"2024-09-12T02:07:19.556793+0000","last_clean":"2024-09-12T02:07:19.556793+0000","last_became_active":"2024-09-12T00:10:03.271281+0000","last_became_peered":"2024-09-12T00:10:03.271281+0000","last_unstale":"2024-09-12T02:07:19.556793+0000","last_undegraded":"2024-09-12T02:07:19.556793+0000","last_fullsized":"2024-09-12T02:07:19.556793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T02:07:19.556476+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T02:07:19.556476+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.556476+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:33.140789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"266'152","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.960004+0000","last_change":"2024-09-12T02:07:16.960004+0000","last_active":"2024-09-12T02:07:16.960004+0000","last_peered":"2024-09-12T02:07:16.960004+0000","last_clean":"2024-09-12T02:07:16.960004+0000","last_became_active":"2024-09-12T00:10:05.362449+0000","last_became_peered":"2024-09-12T00:10:05.362449+0000","last_unstale":"2024-09-12T02:07:16.960004+0000","last_undegraded":"2024-09-12T02:07:16.960004+0000","last_fullsized":"2024-09-12T02:07:16.960004+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'152","last_scrub_stamp":"2024-09-12T02:07:16.959823+0000","last_deep_scrub":"266'152","last_deep_scrub_stamp":"2024-09-12T02:07:16.959823+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.959823+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:57.960409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":177,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"266'764","reported_seq":3355,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.068319+0000","last_change":"2024-09-12T02:07:11.068319+0000","last_active":"2024-09-12T02:07:11.068319+0000","last_peered":"2024-09-12T02:07:11.068319+0000","last_clean":"2024-09-12T02:07:11.068319+0000","last_became_active":"2024-09-12T00:10:07.318566+0000","last_became_peered":"2024-09-12T00:10:07.318566+0000","last_unstale":"2024-09-12T02:07:11.068319+0000","last_undegraded":"2024-09-12T02:07:11.068319+0000","last_fullsized":"2024-09-12T02:07:11.068319+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'764","last_scrub_stamp":"2024-09-12T02:07:11.068113+0000","last_deep_scrub":"266'764","last_deep_scrub_stamp":"2024-09-12T02:07:11.068113+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.068113+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:47.655491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"266'182","reported_seq":721,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.123207+0000","last_change":"2024-09-12T02:07:26.123207+0000","last_active":"2024-09-12T02:07:26.123207+0000","last_peered":"2024-09-12T02:07:26.123207+0000","last_clean":"2024-09-12T02:07:26.123207+0000","last_became_active":"2024-09-12T00:10:09.353213+0000","last_became_peered":"2024-09-12T00:10:09.353213+0000","last_unstale":"2024-09-12T02:07:26.123207+0000","last_undegraded":"2024-09-12T02:07:26.123207+0000","last_fullsized":"2024-09-12T02:07:26.123207+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T02:07:26.123006+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T02:07:26.123006+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.123006+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:52:26.036216+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":117,"num_write":410,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"266'439","reported_seq":1999,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.417775+0000","last_change":"2024-09-12T02:07:00.417624+0000","last_active":"2024-09-12T02:07:00.417775+0000","last_peered":"2024-09-12T02:07:00.417775+0000","last_clean":"2024-09-12T02:07:00.417775+0000","last_became_active":"2024-09-12T00:10:01.256287+0000","last_became_peered":"2024-09-12T00:10:01.256287+0000","last_unstale":"2024-09-12T02:07:00.417775+0000","last_undegraded":"2024-09-12T02:07:00.417775+0000","last_fullsized":"2024-09-12T02:07:00.417775+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'439","last_scrub_stamp":"2024-09-12T02:07:00.417437+0000","last_deep_scrub":"266'439","last_deep_scrub_stamp":"2024-09-12T02:07:00.417437+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.417437+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:35.069664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2163,"num_write":523,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"266'451","reported_seq":1398,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.877423+0000","last_change":"2024-09-12T02:06:54.877268+0000","last_active":"2024-09-12T02:06:54.877423+0000","last_peered":"2024-09-12T02:06:54.877423+0000","last_clean":"2024-09-12T02:06:54.877423+0000","last_became_active":"2024-09-12T00:10:31.168654+0000","last_became_peered":"2024-09-12T00:10:31.168654+0000","last_unstale":"2024-09-12T02:06:54.877423+0000","last_undegraded":"2024-09-12T02:06:54.877423+0000","last_fullsized":"2024-09-12T02:06:54.877423+0000","mapping_epoch":38,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'451","last_scrub_stamp":"2024-09-12T02:06:54.877036+0000","last_deep_scrub":"266'451","last_deep_scrub_stamp":"2024-09-12T02:06:54.877036+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.877036+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:37.689710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777138,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1245,"num_read_kb":67964,"num_write":1343,"num_write_kb":19763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.058610+0000","last_change":"2024-09-12T02:07:15.058610+0000","last_active":"2024-09-12T02:07:15.058610+0000","last_peered":"2024-09-12T02:07:15.058610+0000","last_clean":"2024-09-12T02:07:15.058610+0000","last_became_active":"2024-09-12T00:10:03.272284+0000","last_became_peered":"2024-09-12T00:10:03.272284+0000","last_unstale":"2024-09-12T02:07:15.058610+0000","last_undegraded":"2024-09-12T02:07:15.058610+0000","last_fullsized":"2024-09-12T02:07:15.058610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.058442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.058442+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.058442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:24.721522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"266'545","reported_seq":1236,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.609582+0000","last_change":"2024-09-12T02:07:20.609582+0000","last_active":"2024-09-12T02:07:20.609582+0000","last_peered":"2024-09-12T02:07:20.609582+0000","last_clean":"2024-09-12T02:07:20.609582+0000","last_became_active":"2024-09-12T00:10:05.300354+0000","last_became_peered":"2024-09-12T00:10:05.300354+0000","last_unstale":"2024-09-12T02:07:20.609582+0000","last_undegraded":"2024-09-12T02:07:20.609582+0000","last_fullsized":"2024-09-12T02:07:20.609582+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'545","last_scrub_stamp":"2024-09-12T02:07:20.609387+0000","last_deep_scrub":"266'545","last_deep_scrub_stamp":"2024-09-12T02:07:20.609387+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.609387+0000","objects_scrubbed":9,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:45.881011+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54476,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1438,"num_read_kb":1976,"num_write":2042,"num_write_kb":1815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488698,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.072344+0000","last_change":"2024-09-12T02:07:12.072344+0000","last_active":"2024-09-12T02:07:12.072344+0000","last_peered":"2024-09-12T02:07:12.072344+0000","last_clean":"2024-09-12T02:07:12.072344+0000","last_became_active":"2024-09-12T00:10:07.340008+0000","last_became_peered":"2024-09-12T00:10:07.340008+0000","last_unstale":"2024-09-12T02:07:12.072344+0000","last_undegraded":"2024-09-12T02:07:12.072344+0000","last_fullsized":"2024-09-12T02:07:12.072344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.072166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.072166+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.072166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:29.623883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"266'140","reported_seq":692,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.739637+0000","last_change":"2024-09-12T02:07:19.739637+0000","last_active":"2024-09-12T02:07:19.739637+0000","last_peered":"2024-09-12T02:07:19.739637+0000","last_clean":"2024-09-12T02:07:19.739637+0000","last_became_active":"2024-09-12T00:10:09.372231+0000","last_became_peered":"2024-09-12T00:10:09.372231+0000","last_unstale":"2024-09-12T02:07:19.739637+0000","last_undegraded":"2024-09-12T02:07:19.739637+0000","last_fullsized":"2024-09-12T02:07:19.739637+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'140","last_scrub_stamp":"2024-09-12T02:07:19.739438+0000","last_deep_scrub":"266'140","last_deep_scrub_stamp":"2024-09-12T02:07:19.739438+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.739438+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:41.681859+0000","scrub_duration":211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":215,"num_write":350,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"266'757","reported_seq":2316,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.070990+0000","last_change":"2024-09-12T02:07:01.070708+0000","last_active":"2024-09-12T02:07:01.070990+0000","last_peered":"2024-09-12T02:07:01.070990+0000","last_clean":"2024-09-12T02:07:01.070990+0000","last_became_active":"2024-09-12T00:10:01.262490+0000","last_became_peered":"2024-09-12T00:10:01.262490+0000","last_unstale":"2024-09-12T02:07:01.070990+0000","last_undegraded":"2024-09-12T02:07:01.070990+0000","last_fullsized":"2024-09-12T02:07:01.070990+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'757","last_scrub_stamp":"2024-09-12T02:07:01.070499+0000","last_deep_scrub":"266'757","last_deep_scrub_stamp":"2024-09-12T02:07:01.070499+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.070499+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:21.203677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3557,"num_read_kb":3216,"num_write":966,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":272,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.772431+0000","last_change":"2024-09-12T02:06:55.772265+0000","last_active":"2024-09-12T02:06:55.772431+0000","last_peered":"2024-09-12T02:06:55.772431+0000","last_clean":"2024-09-12T02:06:55.772431+0000","last_became_active":"2024-09-12T00:09:40.224430+0000","last_became_peered":"2024-09-12T00:09:40.224430+0000","last_unstale":"2024-09-12T02:06:55.772431+0000","last_undegraded":"2024-09-12T02:06:55.772431+0000","last_fullsized":"2024-09-12T02:06:55.772431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T02:06:55.772071+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T02:06:55.772071+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.772071+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:02.200479+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":566,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.755705+0000","last_change":"2024-09-12T02:06:55.755705+0000","last_active":"2024-09-12T02:06:55.755705+0000","last_peered":"2024-09-12T02:06:55.755705+0000","last_clean":"2024-09-12T02:06:55.755705+0000","last_became_active":"2024-09-12T00:09:46.162330+0000","last_became_peered":"2024-09-12T00:09:46.162330+0000","last_unstale":"2024-09-12T02:06:55.755705+0000","last_undegraded":"2024-09-12T02:06:55.755705+0000","last_fullsized":"2024-09-12T02:06:55.755705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:06:55.755515+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:06:55.755515+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.755515+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:19.877569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00090615300000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"266'321","reported_seq":992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.871360+0000","last_change":"2024-09-12T02:06:55.871360+0000","last_active":"2024-09-12T02:06:55.871360+0000","last_peered":"2024-09-12T02:06:55.871360+0000","last_clean":"2024-09-12T02:06:55.871360+0000","last_became_active":"2024-09-12T00:09:59.310092+0000","last_became_peered":"2024-09-12T00:09:59.310092+0000","last_unstale":"2024-09-12T02:06:55.871360+0000","last_undegraded":"2024-09-12T02:06:55.871360+0000","last_fullsized":"2024-09-12T02:06:55.871360+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'321","last_scrub_stamp":"2024-09-12T02:06:55.871078+0000","last_deep_scrub":"266'321","last_deep_scrub_stamp":"2024-09-12T02:06:55.871078+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.871078+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:49.767328+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306611,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":494,"num_read_kb":13893,"num_write":1018,"num_write_kb":29182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"266'6","reported_seq":1019,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.875218+0000","last_change":"2024-09-12T02:07:11.875218+0000","last_active":"2024-09-12T02:07:11.875218+0000","last_peered":"2024-09-12T02:07:11.875218+0000","last_clean":"2024-09-12T02:07:11.875218+0000","last_became_active":"2024-09-12T00:10:03.261183+0000","last_became_peered":"2024-09-12T00:10:03.261183+0000","last_unstale":"2024-09-12T02:07:11.875218+0000","last_undegraded":"2024-09-12T02:07:11.875218+0000","last_fullsized":"2024-09-12T02:07:11.875218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T02:07:11.875038+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T02:07:11.875038+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.875038+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:02.168922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"266'814","reported_seq":1577,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.590850+0000","last_change":"2024-09-12T02:07:22.590850+0000","last_active":"2024-09-12T02:07:22.590850+0000","last_peered":"2024-09-12T02:07:22.590850+0000","last_clean":"2024-09-12T02:07:22.590850+0000","last_became_active":"2024-09-12T00:10:05.294267+0000","last_became_peered":"2024-09-12T00:10:05.294267+0000","last_unstale":"2024-09-12T02:07:22.590850+0000","last_undegraded":"2024-09-12T02:07:22.590850+0000","last_fullsized":"2024-09-12T02:07:22.590850+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'814","last_scrub_stamp":"2024-09-12T02:07:22.590669+0000","last_deep_scrub":"266'814","last_deep_scrub_stamp":"2024-09-12T02:07:22.590669+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.590669+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.111026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156191,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1567,"num_read_kb":3456,"num_write":1540,"num_write_kb":1367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107552,"num_omap_keys":260,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.612361+0000","last_change":"2024-09-12T02:07:21.612361+0000","last_active":"2024-09-12T02:07:21.612361+0000","last_peered":"2024-09-12T02:07:21.612361+0000","last_clean":"2024-09-12T02:07:21.612361+0000","last_became_active":"2024-09-12T00:10:07.323398+0000","last_became_peered":"2024-09-12T00:10:07.323398+0000","last_unstale":"2024-09-12T02:07:21.612361+0000","last_undegraded":"2024-09-12T02:07:21.612361+0000","last_fullsized":"2024-09-12T02:07:21.612361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:21.612192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:21.612192+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.612192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:53.420420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"266'249","reported_seq":1009,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.092694+0000","last_change":"2024-09-12T02:07:14.092694+0000","last_active":"2024-09-12T02:07:14.092694+0000","last_peered":"2024-09-12T02:07:14.092694+0000","last_clean":"2024-09-12T02:07:14.092694+0000","last_became_active":"2024-09-12T00:10:09.373661+0000","last_became_peered":"2024-09-12T00:10:09.373661+0000","last_unstale":"2024-09-12T02:07:14.092694+0000","last_undegraded":"2024-09-12T02:07:14.092694+0000","last_fullsized":"2024-09-12T02:07:14.092694+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'249","last_scrub_stamp":"2024-09-12T02:07:14.092461+0000","last_deep_scrub":"266'249","last_deep_scrub_stamp":"2024-09-12T02:07:14.092461+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.092461+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:24.522987+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":498,"num_write":430,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"266'1255","reported_seq":3064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.482860+0000","last_change":"2024-09-12T02:07:03.482730+0000","last_active":"2024-09-12T02:07:03.482860+0000","last_peered":"2024-09-12T02:07:03.482860+0000","last_clean":"2024-09-12T02:07:03.482860+0000","last_became_active":"2024-09-12T00:10:31.471885+0000","last_became_peered":"2024-09-12T00:10:31.471885+0000","last_unstale":"2024-09-12T02:07:03.482860+0000","last_undegraded":"2024-09-12T02:07:03.482860+0000","last_fullsized":"2024-09-12T02:07:03.482860+0000","mapping_epoch":38,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1255","last_scrub_stamp":"2024-09-12T02:07:03.482543+0000","last_deep_scrub":"266'1255","last_deep_scrub_stamp":"2024-09-12T02:07:03.482543+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.482543+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:26.888676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6022,"num_read_kb":5329,"num_write":1728,"num_write_kb":723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5360,"num_omap_keys":21,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":561,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.756880+0000","last_change":"2024-09-12T02:06:56.756739+0000","last_active":"2024-09-12T02:06:56.756880+0000","last_peered":"2024-09-12T02:06:56.756880+0000","last_clean":"2024-09-12T02:06:56.756880+0000","last_became_active":"2024-09-12T00:09:46.164248+0000","last_became_peered":"2024-09-12T00:09:46.164248+0000","last_unstale":"2024-09-12T02:06:56.756880+0000","last_undegraded":"2024-09-12T02:06:56.756880+0000","last_fullsized":"2024-09-12T02:06:56.756880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:56.756558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:56.756558+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.756558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:24.410460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099742600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"266'334","reported_seq":990,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.535461+0000","last_change":"2024-09-12T02:06:53.535461+0000","last_active":"2024-09-12T02:06:53.535461+0000","last_peered":"2024-09-12T02:06:53.535461+0000","last_clean":"2024-09-12T02:06:53.535461+0000","last_became_active":"2024-09-12T00:09:59.293880+0000","last_became_peered":"2024-09-12T00:09:59.293880+0000","last_unstale":"2024-09-12T02:06:53.535461+0000","last_undegraded":"2024-09-12T02:06:53.535461+0000","last_fullsized":"2024-09-12T02:06:53.535461+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'334","last_scrub_stamp":"2024-09-12T02:06:53.535293+0000","last_deep_scrub":"266'334","last_deep_scrub_stamp":"2024-09-12T02:06:53.535293+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.535293+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:40.126937+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5590248,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":449,"num_read_kb":16782,"num_write":1093,"num_write_kb":42263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.530675+0000","last_change":"2024-09-12T02:07:15.530675+0000","last_active":"2024-09-12T02:07:15.530675+0000","last_peered":"2024-09-12T02:07:15.530675+0000","last_clean":"2024-09-12T02:07:15.530675+0000","last_became_active":"2024-09-12T00:10:03.271454+0000","last_became_peered":"2024-09-12T00:10:03.271454+0000","last_unstale":"2024-09-12T02:07:15.530675+0000","last_undegraded":"2024-09-12T02:07:15.530675+0000","last_fullsized":"2024-09-12T02:07:15.530675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.530503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.530503+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.530503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:09.506727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"266'1460","reported_seq":3863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.403647+0000","last_change":"2024-09-12T02:07:13.403647+0000","last_active":"2024-09-12T02:07:13.403647+0000","last_peered":"2024-09-12T02:07:13.403647+0000","last_clean":"2024-09-12T02:07:13.403647+0000","last_became_active":"2024-09-12T00:10:05.295058+0000","last_became_peered":"2024-09-12T00:10:05.295058+0000","last_unstale":"2024-09-12T02:07:13.403647+0000","last_undegraded":"2024-09-12T02:07:13.403647+0000","last_fullsized":"2024-09-12T02:07:13.403647+0000","mapping_epoch":31,"log_start":"266'1400","ondisk_log_start":"266'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1460","last_scrub_stamp":"2024-09-12T02:07:13.403437+0000","last_deep_scrub":"266'1460","last_deep_scrub_stamp":"2024-09-12T02:07:13.403437+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.403437+0000","objects_scrubbed":12,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:33.536505+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161189,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2280,"num_read_kb":4238,"num_write":1386,"num_write_kb":1157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.882797+0000","last_change":"2024-09-12T02:07:24.882797+0000","last_active":"2024-09-12T02:07:24.882797+0000","last_peered":"2024-09-12T02:07:24.882797+0000","last_clean":"2024-09-12T02:07:24.882797+0000","last_became_active":"2024-09-12T00:10:07.319957+0000","last_became_peered":"2024-09-12T00:10:07.319957+0000","last_unstale":"2024-09-12T02:07:24.882797+0000","last_undegraded":"2024-09-12T02:07:24.882797+0000","last_fullsized":"2024-09-12T02:07:24.882797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.882615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.882615+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.882615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:06.172228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"266'87","reported_seq":619,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.537802+0000","last_change":"2024-09-12T02:07:21.537631+0000","last_active":"2024-09-12T02:07:21.537802+0000","last_peered":"2024-09-12T02:07:21.537802+0000","last_clean":"2024-09-12T02:07:21.537802+0000","last_became_active":"2024-09-12T00:10:09.430727+0000","last_became_peered":"2024-09-12T00:10:09.430727+0000","last_unstale":"2024-09-12T02:07:21.537802+0000","last_undegraded":"2024-09-12T02:07:21.537802+0000","last_fullsized":"2024-09-12T02:07:21.537802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'87","last_scrub_stamp":"2024-09-12T02:07:21.537445+0000","last_deep_scrub":"266'87","last_deep_scrub_stamp":"2024-09-12T02:07:21.537445+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.537445+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:02.227142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":209,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"266'639","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.450994+0000","last_change":"2024-09-12T02:06:58.450831+0000","last_active":"2024-09-12T02:06:58.450994+0000","last_peered":"2024-09-12T02:06:58.450994+0000","last_clean":"2024-09-12T02:06:58.450994+0000","last_became_active":"2024-09-12T00:10:01.277302+0000","last_became_peered":"2024-09-12T00:10:01.277302+0000","last_unstale":"2024-09-12T02:06:58.450994+0000","last_undegraded":"2024-09-12T02:06:58.450994+0000","last_fullsized":"2024-09-12T02:06:58.450994+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'639","last_scrub_stamp":"2024-09-12T02:06:58.450656+0000","last_deep_scrub":"266'639","last_deep_scrub_stamp":"2024-09-12T02:06:58.450656+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.450656+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:52.660098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3369,"num_read_kb":3119,"num_write":789,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":562,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.645702+0000","last_change":"2024-09-12T02:06:53.645702+0000","last_active":"2024-09-12T02:06:53.645702+0000","last_peered":"2024-09-12T02:06:53.645702+0000","last_clean":"2024-09-12T02:06:53.645702+0000","last_became_active":"2024-09-12T00:09:46.179853+0000","last_became_peered":"2024-09-12T00:09:46.179853+0000","last_unstale":"2024-09-12T02:06:53.645702+0000","last_undegraded":"2024-09-12T02:06:53.645702+0000","last_fullsized":"2024-09-12T02:06:53.645702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:53.645611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:53.645611+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.645611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:10.578130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056473999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"266'337","reported_seq":1051,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.539651+0000","last_change":"2024-09-12T02:06:54.539651+0000","last_active":"2024-09-12T02:06:54.539651+0000","last_peered":"2024-09-12T02:06:54.539651+0000","last_clean":"2024-09-12T02:06:54.539651+0000","last_became_active":"2024-09-12T00:09:59.317172+0000","last_became_peered":"2024-09-12T00:09:59.317172+0000","last_unstale":"2024-09-12T02:06:54.539651+0000","last_undegraded":"2024-09-12T02:06:54.539651+0000","last_fullsized":"2024-09-12T02:06:54.539651+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'337","last_scrub_stamp":"2024-09-12T02:06:54.539255+0000","last_deep_scrub":"266'337","last_deep_scrub_stamp":"2024-09-12T02:06:54.539255+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.539255+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:20.701196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263198,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":511,"num_read_kb":79957,"num_write":1084,"num_write_kb":20693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":538,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.747793+0000","last_change":"2024-09-12T02:07:06.747793+0000","last_active":"2024-09-12T02:07:06.747793+0000","last_peered":"2024-09-12T02:07:06.747793+0000","last_clean":"2024-09-12T02:07:06.747793+0000","last_became_active":"2024-09-12T00:10:03.274519+0000","last_became_peered":"2024-09-12T00:10:03.274519+0000","last_unstale":"2024-09-12T02:07:06.747793+0000","last_undegraded":"2024-09-12T02:07:06.747793+0000","last_fullsized":"2024-09-12T02:07:06.747793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:06.747613+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:06.747613+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.747613+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:42.645385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"266'406","reported_seq":2404,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.836963+0000","last_change":"2024-09-12T02:07:16.836963+0000","last_active":"2024-09-12T02:07:16.836963+0000","last_peered":"2024-09-12T02:07:16.836963+0000","last_clean":"2024-09-12T02:07:16.836963+0000","last_became_active":"2024-09-12T00:10:05.365417+0000","last_became_peered":"2024-09-12T00:10:05.365417+0000","last_unstale":"2024-09-12T02:07:16.836963+0000","last_undegraded":"2024-09-12T02:07:16.836963+0000","last_fullsized":"2024-09-12T02:07:16.836963+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'406","last_scrub_stamp":"2024-09-12T02:07:16.836746+0000","last_deep_scrub":"266'406","last_deep_scrub_stamp":"2024-09-12T02:07:16.836746+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.836746+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:37.314941+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":388,"num_read_kb":374,"num_write":387,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":527,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.563429+0000","last_change":"2024-09-12T02:07:18.563429+0000","last_active":"2024-09-12T02:07:18.563429+0000","last_peered":"2024-09-12T02:07:18.563429+0000","last_clean":"2024-09-12T02:07:18.563429+0000","last_became_active":"2024-09-12T00:10:07.319786+0000","last_became_peered":"2024-09-12T00:10:07.319786+0000","last_unstale":"2024-09-12T02:07:18.563429+0000","last_undegraded":"2024-09-12T02:07:18.563429+0000","last_fullsized":"2024-09-12T02:07:18.563429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:18.563252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:18.563252+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.563252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:27.472116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"266'258","reported_seq":898,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:39.092409+0000","last_change":"2024-09-12T02:07:39.092409+0000","last_active":"2024-09-12T02:07:39.092409+0000","last_peered":"2024-09-12T02:07:39.092409+0000","last_clean":"2024-09-12T02:07:39.092409+0000","last_became_active":"2024-09-12T00:10:09.365558+0000","last_became_peered":"2024-09-12T00:10:09.365558+0000","last_unstale":"2024-09-12T02:07:39.092409+0000","last_undegraded":"2024-09-12T02:07:39.092409+0000","last_fullsized":"2024-09-12T02:07:39.092409+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'258","last_scrub_stamp":"2024-09-12T02:07:39.092220+0000","last_deep_scrub":"266'258","last_deep_scrub_stamp":"2024-09-12T02:07:39.092220+0000","last_clean_scrub_stamp":"2024-09-12T02:07:39.092220+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:25.445097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":520,"num_write":557,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"266'479","reported_seq":2058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.377367+0000","last_change":"2024-09-12T02:07:01.377367+0000","last_active":"2024-09-12T02:07:01.377367+0000","last_peered":"2024-09-12T02:07:01.377367+0000","last_clean":"2024-09-12T02:07:01.377367+0000","last_became_active":"2024-09-12T00:10:01.256107+0000","last_became_peered":"2024-09-12T00:10:01.256107+0000","last_unstale":"2024-09-12T02:07:01.377367+0000","last_undegraded":"2024-09-12T02:07:01.377367+0000","last_fullsized":"2024-09-12T02:07:01.377367+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'479","last_scrub_stamp":"2024-09-12T02:07:01.377182+0000","last_deep_scrub":"266'479","last_deep_scrub_stamp":"2024-09-12T02:07:01.377182+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.377182+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:21.624019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2517,"num_read_kb":2366,"num_write":564,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":567,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.713155+0000","last_change":"2024-09-12T02:06:54.713155+0000","last_active":"2024-09-12T02:06:54.713155+0000","last_peered":"2024-09-12T02:06:54.713155+0000","last_clean":"2024-09-12T02:06:54.713155+0000","last_became_active":"2024-09-12T00:09:46.161046+0000","last_became_peered":"2024-09-12T00:09:46.161046+0000","last_unstale":"2024-09-12T02:06:54.713155+0000","last_undegraded":"2024-09-12T02:06:54.713155+0000","last_fullsized":"2024-09-12T02:06:54.713155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T02:06:54.712965+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T02:06:54.712965+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.712965+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:06.136484+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022130560000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"266'390","reported_seq":1054,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.642627+0000","last_change":"2024-09-12T02:06:52.642552+0000","last_active":"2024-09-12T02:06:52.642627+0000","last_peered":"2024-09-12T02:06:52.642627+0000","last_clean":"2024-09-12T02:06:52.642627+0000","last_became_active":"2024-09-12T00:10:31.473891+0000","last_became_peered":"2024-09-12T00:10:31.473891+0000","last_unstale":"2024-09-12T02:06:52.642627+0000","last_undegraded":"2024-09-12T02:06:52.642627+0000","last_fullsized":"2024-09-12T02:06:52.642627+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:06:52.642445+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:06:52.642445+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.642445+0000","objects_scrubbed":7,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:58.116732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1728219,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":35036,"num_write":1225,"num_write_kb":35348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,6],"acting":[2,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.597469+0000","last_change":"2024-09-12T02:07:11.597228+0000","last_active":"2024-09-12T02:07:11.597469+0000","last_peered":"2024-09-12T02:07:11.597469+0000","last_clean":"2024-09-12T02:07:11.597469+0000","last_became_active":"2024-09-12T00:10:03.264991+0000","last_became_peered":"2024-09-12T00:10:03.264991+0000","last_unstale":"2024-09-12T02:07:11.597469+0000","last_undegraded":"2024-09-12T02:07:11.597469+0000","last_fullsized":"2024-09-12T02:07:11.597469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:11.597020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:11.597020+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.597020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:58.686303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"266'214","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.998971+0000","last_change":"2024-09-12T02:07:21.998971+0000","last_active":"2024-09-12T02:07:21.998971+0000","last_peered":"2024-09-12T02:07:21.998971+0000","last_clean":"2024-09-12T02:07:21.998971+0000","last_became_active":"2024-09-12T00:10:05.286433+0000","last_became_peered":"2024-09-12T00:10:05.286433+0000","last_unstale":"2024-09-12T02:07:21.998971+0000","last_undegraded":"2024-09-12T02:07:21.998971+0000","last_fullsized":"2024-09-12T02:07:21.998971+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'214","last_scrub_stamp":"2024-09-12T02:07:21.998706+0000","last_deep_scrub":"266'214","last_deep_scrub_stamp":"2024-09-12T02:07:21.998706+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.998706+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:58.514298+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":276,"num_read_kb":269,"num_write":202,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.113674+0000","last_change":"2024-09-12T02:07:15.113674+0000","last_active":"2024-09-12T02:07:15.113674+0000","last_peered":"2024-09-12T02:07:15.113674+0000","last_clean":"2024-09-12T02:07:15.113674+0000","last_became_active":"2024-09-12T00:10:07.329823+0000","last_became_peered":"2024-09-12T00:10:07.329823+0000","last_unstale":"2024-09-12T02:07:15.113674+0000","last_undegraded":"2024-09-12T02:07:15.113674+0000","last_fullsized":"2024-09-12T02:07:15.113674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.113498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.113498+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.113498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:56.771935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"266'102","reported_seq":691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.652236+0000","last_change":"2024-09-12T02:07:28.652236+0000","last_active":"2024-09-12T02:07:28.652236+0000","last_peered":"2024-09-12T02:07:28.652236+0000","last_clean":"2024-09-12T02:07:28.652236+0000","last_became_active":"2024-09-12T00:10:09.368176+0000","last_became_peered":"2024-09-12T00:10:09.368176+0000","last_unstale":"2024-09-12T02:07:28.652236+0000","last_undegraded":"2024-09-12T02:07:28.652236+0000","last_fullsized":"2024-09-12T02:07:28.652236+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'102","last_scrub_stamp":"2024-09-12T02:07:28.652064+0000","last_deep_scrub":"266'102","last_deep_scrub_stamp":"2024-09-12T02:07:28.652064+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.652064+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:15.298710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":222,"num_read_kb":212,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"266'448","reported_seq":2083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.466851+0000","last_change":"2024-09-12T02:06:59.466851+0000","last_active":"2024-09-12T02:06:59.466851+0000","last_peered":"2024-09-12T02:06:59.466851+0000","last_clean":"2024-09-12T02:06:59.466851+0000","last_became_active":"2024-09-12T00:10:01.275794+0000","last_became_peered":"2024-09-12T00:10:01.275794+0000","last_unstale":"2024-09-12T02:06:59.466851+0000","last_undegraded":"2024-09-12T02:06:59.466851+0000","last_fullsized":"2024-09-12T02:06:59.466851+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'448","last_scrub_stamp":"2024-09-12T02:06:59.466676+0000","last_deep_scrub":"266'448","last_deep_scrub_stamp":"2024-09-12T02:06:59.466676+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.466676+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:34.269252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":509,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"266'358","reported_seq":1072,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.725876+0000","last_change":"2024-09-12T02:06:56.725876+0000","last_active":"2024-09-12T02:06:56.725876+0000","last_peered":"2024-09-12T02:06:56.725876+0000","last_clean":"2024-09-12T02:06:56.725876+0000","last_became_active":"2024-09-12T00:09:59.262793+0000","last_became_peered":"2024-09-12T00:09:59.262793+0000","last_unstale":"2024-09-12T02:06:56.725876+0000","last_undegraded":"2024-09-12T02:06:56.725876+0000","last_fullsized":"2024-09-12T02:06:56.725876+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'358","last_scrub_stamp":"2024-09-12T02:06:56.725610+0000","last_deep_scrub":"266'358","last_deep_scrub_stamp":"2024-09-12T02:06:56.725610+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.725610+0000","objects_scrubbed":11,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.475621+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1952053,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":559,"num_read_kb":23144,"num_write":1133,"num_write_kb":26459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":560,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.602572+0000","last_change":"2024-09-12T02:06:52.602572+0000","last_active":"2024-09-12T02:06:52.602572+0000","last_peered":"2024-09-12T02:06:52.602572+0000","last_clean":"2024-09-12T02:06:52.602572+0000","last_became_active":"2024-09-12T00:09:46.178541+0000","last_became_peered":"2024-09-12T00:09:46.178541+0000","last_unstale":"2024-09-12T02:06:52.602572+0000","last_undegraded":"2024-09-12T02:06:52.602572+0000","last_fullsized":"2024-09-12T02:06:52.602572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:52.602473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:52.602473+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.602473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:51.748160+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00107328,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.543069+0000","last_change":"2024-09-12T02:07:13.543069+0000","last_active":"2024-09-12T02:07:13.543069+0000","last_peered":"2024-09-12T02:07:13.543069+0000","last_clean":"2024-09-12T02:07:13.543069+0000","last_became_active":"2024-09-12T00:10:03.258209+0000","last_became_peered":"2024-09-12T00:10:03.258209+0000","last_unstale":"2024-09-12T02:07:13.543069+0000","last_undegraded":"2024-09-12T02:07:13.543069+0000","last_fullsized":"2024-09-12T02:07:13.543069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.542886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.542886+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.542886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:53.684122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"266'741","reported_seq":1498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.557356+0000","last_change":"2024-09-12T02:07:15.557356+0000","last_active":"2024-09-12T02:07:15.557356+0000","last_peered":"2024-09-12T02:07:15.557356+0000","last_clean":"2024-09-12T02:07:15.557356+0000","last_became_active":"2024-09-12T00:10:05.289058+0000","last_became_peered":"2024-09-12T00:10:05.289058+0000","last_unstale":"2024-09-12T02:07:15.557356+0000","last_undegraded":"2024-09-12T02:07:15.557356+0000","last_fullsized":"2024-09-12T02:07:15.557356+0000","mapping_epoch":31,"log_start":"266'700","ondisk_log_start":"266'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'741","last_scrub_stamp":"2024-09-12T02:07:15.557266+0000","last_deep_scrub":"266'741","last_deep_scrub_stamp":"2024-09-12T02:07:15.557266+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.557266+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:10.918921+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92166,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1168,"num_read_kb":2300,"num_write":1050,"num_write_kb":783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:22.073632+0000","last_change":"2024-09-12T02:07:22.073632+0000","last_active":"2024-09-12T02:07:22.073632+0000","last_peered":"2024-09-12T02:07:22.073632+0000","last_clean":"2024-09-12T02:07:22.073632+0000","last_became_active":"2024-09-12T00:10:07.326146+0000","last_became_peered":"2024-09-12T00:10:07.326146+0000","last_unstale":"2024-09-12T02:07:22.073632+0000","last_undegraded":"2024-09-12T02:07:22.073632+0000","last_fullsized":"2024-09-12T02:07:22.073632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:22.073451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:22.073451+0000","last_clean_scrub_stamp":"2024-09-12T02:07:22.073451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:54.639155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"266'139","reported_seq":672,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.571361+0000","last_change":"2024-09-12T02:07:30.571361+0000","last_active":"2024-09-12T02:07:30.571361+0000","last_peered":"2024-09-12T02:07:30.571361+0000","last_clean":"2024-09-12T02:07:30.571361+0000","last_became_active":"2024-09-12T00:10:09.433444+0000","last_became_peered":"2024-09-12T00:10:09.433444+0000","last_unstale":"2024-09-12T02:07:30.571361+0000","last_undegraded":"2024-09-12T02:07:30.571361+0000","last_fullsized":"2024-09-12T02:07:30.571361+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'139","last_scrub_stamp":"2024-09-12T02:07:30.571141+0000","last_deep_scrub":"266'139","last_deep_scrub_stamp":"2024-09-12T02:07:30.571141+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.571141+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:47.539180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"266'404","reported_seq":1916,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.480294+0000","last_change":"2024-09-12T02:07:02.480294+0000","last_active":"2024-09-12T02:07:02.480294+0000","last_peered":"2024-09-12T02:07:02.480294+0000","last_clean":"2024-09-12T02:07:02.480294+0000","last_became_active":"2024-09-12T00:10:01.282373+0000","last_became_peered":"2024-09-12T00:10:01.282373+0000","last_unstale":"2024-09-12T02:07:02.480294+0000","last_undegraded":"2024-09-12T02:07:02.480294+0000","last_fullsized":"2024-09-12T02:07:02.480294+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'404","last_scrub_stamp":"2024-09-12T02:07:02.480109+0000","last_deep_scrub":"266'404","last_deep_scrub_stamp":"2024-09-12T02:07:02.480109+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.480109+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:10.168566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2068,"num_read_kb":1970,"num_write":460,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"266'417","reported_seq":1205,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.505109+0000","last_change":"2024-09-12T02:06:55.505109+0000","last_active":"2024-09-12T02:06:55.505109+0000","last_peered":"2024-09-12T02:06:55.505109+0000","last_clean":"2024-09-12T02:06:55.505109+0000","last_became_active":"2024-09-12T00:09:59.251235+0000","last_became_peered":"2024-09-12T00:09:59.251235+0000","last_unstale":"2024-09-12T02:06:55.505109+0000","last_undegraded":"2024-09-12T02:06:55.505109+0000","last_fullsized":"2024-09-12T02:06:55.505109+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'417","last_scrub_stamp":"2024-09-12T02:06:55.504820+0000","last_deep_scrub":"266'417","last_deep_scrub_stamp":"2024-09-12T02:06:55.504820+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.504820+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:06.749291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":866,"num_read_kb":78676,"num_write":1275,"num_write_kb":36022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.781724+0000","last_change":"2024-09-12T02:06:57.781724+0000","last_active":"2024-09-12T02:06:57.781724+0000","last_peered":"2024-09-12T02:06:57.781724+0000","last_clean":"2024-09-12T02:06:57.781724+0000","last_became_active":"2024-09-12T00:09:46.177603+0000","last_became_peered":"2024-09-12T00:09:46.177603+0000","last_unstale":"2024-09-12T02:06:57.781724+0000","last_undegraded":"2024-09-12T02:06:57.781724+0000","last_fullsized":"2024-09-12T02:06:57.781724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:57.781540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:57.781540+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.781540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:12.770956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":539,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.051317+0000","last_change":"2024-09-12T02:07:04.051317+0000","last_active":"2024-09-12T02:07:04.051317+0000","last_peered":"2024-09-12T02:07:04.051317+0000","last_clean":"2024-09-12T02:07:04.051317+0000","last_became_active":"2024-09-12T00:10:03.258944+0000","last_became_peered":"2024-09-12T00:10:03.258944+0000","last_unstale":"2024-09-12T02:07:04.051317+0000","last_undegraded":"2024-09-12T02:07:04.051317+0000","last_fullsized":"2024-09-12T02:07:04.051317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:04.051138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:04.051138+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.051138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:03.444640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"266'265","reported_seq":917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.403890+0000","last_change":"2024-09-12T02:07:11.403890+0000","last_active":"2024-09-12T02:07:11.403890+0000","last_peered":"2024-09-12T02:07:11.403890+0000","last_clean":"2024-09-12T02:07:11.403890+0000","last_became_active":"2024-09-12T00:10:05.366757+0000","last_became_peered":"2024-09-12T00:10:05.366757+0000","last_unstale":"2024-09-12T02:07:11.403890+0000","last_undegraded":"2024-09-12T02:07:11.403890+0000","last_fullsized":"2024-09-12T02:07:11.403890+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'265","last_scrub_stamp":"2024-09-12T02:07:11.403703+0000","last_deep_scrub":"266'265","last_deep_scrub_stamp":"2024-09-12T02:07:11.403703+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.403703+0000","objects_scrubbed":8,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:13.743145+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":349,"num_read_kb":341,"num_write":230,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"266'828","reported_seq":5684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.571003+0000","last_change":"2024-09-12T02:07:23.571003+0000","last_active":"2024-09-12T02:07:23.571003+0000","last_peered":"2024-09-12T02:07:23.571003+0000","last_clean":"2024-09-12T02:07:23.571003+0000","last_became_active":"2024-09-12T00:10:07.313773+0000","last_became_peered":"2024-09-12T00:10:07.313773+0000","last_unstale":"2024-09-12T02:07:23.571003+0000","last_undegraded":"2024-09-12T02:07:23.571003+0000","last_fullsized":"2024-09-12T02:07:23.571003+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'828","last_scrub_stamp":"2024-09-12T02:07:23.570826+0000","last_deep_scrub":"266'828","last_deep_scrub_stamp":"2024-09-12T02:07:23.570826+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.570826+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:31.624121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"266'132","reported_seq":667,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:30.938654+0000","last_change":"2024-09-12T02:07:30.938654+0000","last_active":"2024-09-12T02:07:30.938654+0000","last_peered":"2024-09-12T02:07:30.938654+0000","last_clean":"2024-09-12T02:07:30.938654+0000","last_became_active":"2024-09-12T00:10:09.430396+0000","last_became_peered":"2024-09-12T00:10:09.430396+0000","last_unstale":"2024-09-12T02:07:30.938654+0000","last_undegraded":"2024-09-12T02:07:30.938654+0000","last_fullsized":"2024-09-12T02:07:30.938654+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'132","last_scrub_stamp":"2024-09-12T02:07:30.938468+0000","last_deep_scrub":"266'132","last_deep_scrub_stamp":"2024-09-12T02:07:30.938468+0000","last_clean_scrub_stamp":"2024-09-12T02:07:30.938468+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.269375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":931,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":122,"num_write":298,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"266'483","reported_seq":2204,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.924708+0000","last_change":"2024-09-12T02:07:11.924708+0000","last_active":"2024-09-12T02:07:11.924708+0000","last_peered":"2024-09-12T02:07:11.924708+0000","last_clean":"2024-09-12T02:07:11.924708+0000","last_became_active":"2024-09-12T00:10:01.261139+0000","last_became_peered":"2024-09-12T00:10:01.261139+0000","last_unstale":"2024-09-12T02:07:11.924708+0000","last_undegraded":"2024-09-12T02:07:11.924708+0000","last_fullsized":"2024-09-12T02:07:11.924708+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'483","last_scrub_stamp":"2024-09-12T02:07:11.924498+0000","last_deep_scrub":"266'483","last_deep_scrub_stamp":"2024-09-12T02:07:11.924498+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.924498+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:56.731333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2740,"num_read_kb":2607,"num_write":578,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"266'402","reported_seq":1219,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.868030+0000","last_change":"2024-09-12T02:06:53.867885+0000","last_active":"2024-09-12T02:06:53.868030+0000","last_peered":"2024-09-12T02:06:53.868030+0000","last_clean":"2024-09-12T02:06:53.868030+0000","last_became_active":"2024-09-12T00:09:59.280008+0000","last_became_peered":"2024-09-12T00:09:59.280008+0000","last_unstale":"2024-09-12T02:06:53.868030+0000","last_undegraded":"2024-09-12T02:06:53.868030+0000","last_fullsized":"2024-09-12T02:06:53.868030+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'402","last_scrub_stamp":"2024-09-12T02:06:53.867624+0000","last_deep_scrub":"266'402","last_deep_scrub_stamp":"2024-09-12T02:06:53.867624+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.867624+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:13.357536+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1137185,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":708,"num_read_kb":14008,"num_write":1294,"num_write_kb":38960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:53.553213+0000","last_change":"2024-09-12T02:06:53.553213+0000","last_active":"2024-09-12T02:06:53.553213+0000","last_peered":"2024-09-12T02:06:53.553213+0000","last_clean":"2024-09-12T02:06:53.553213+0000","last_became_active":"2024-09-12T00:09:46.162309+0000","last_became_peered":"2024-09-12T00:09:46.162309+0000","last_unstale":"2024-09-12T02:06:53.553213+0000","last_undegraded":"2024-09-12T02:06:53.553213+0000","last_fullsized":"2024-09-12T02:06:53.553213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:53.553124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:53.553124+0000","last_clean_scrub_stamp":"2024-09-12T02:06:53.553124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:47.235429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010860449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":538,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.045962+0000","last_change":"2024-09-12T02:07:14.045962+0000","last_active":"2024-09-12T02:07:14.045962+0000","last_peered":"2024-09-12T02:07:14.045962+0000","last_clean":"2024-09-12T02:07:14.045962+0000","last_became_active":"2024-09-12T00:10:03.256290+0000","last_became_peered":"2024-09-12T00:10:03.256290+0000","last_unstale":"2024-09-12T02:07:14.045962+0000","last_undegraded":"2024-09-12T02:07:14.045962+0000","last_fullsized":"2024-09-12T02:07:14.045962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:14.045784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:14.045784+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.045784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:25.603999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"266'183","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.989414+0000","last_change":"2024-09-12T02:07:17.989414+0000","last_active":"2024-09-12T02:07:17.989414+0000","last_peered":"2024-09-12T02:07:17.989414+0000","last_clean":"2024-09-12T02:07:17.989414+0000","last_became_active":"2024-09-12T00:10:05.293955+0000","last_became_peered":"2024-09-12T00:10:05.293955+0000","last_unstale":"2024-09-12T02:07:17.989414+0000","last_undegraded":"2024-09-12T02:07:17.989414+0000","last_fullsized":"2024-09-12T02:07:17.989414+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'183","last_scrub_stamp":"2024-09-12T02:07:17.989219+0000","last_deep_scrub":"266'183","last_deep_scrub_stamp":"2024-09-12T02:07:17.989219+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.989219+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:50.640511+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":233,"num_read_kb":227,"num_write":154,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"266'828","reported_seq":5167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:37.002228+0000","last_change":"2024-09-12T02:07:37.002228+0000","last_active":"2024-09-12T02:07:37.002228+0000","last_peered":"2024-09-12T02:07:37.002228+0000","last_clean":"2024-09-12T02:07:37.002228+0000","last_became_active":"2024-09-12T00:10:07.333642+0000","last_became_peered":"2024-09-12T00:10:07.333642+0000","last_unstale":"2024-09-12T02:07:37.002228+0000","last_undegraded":"2024-09-12T02:07:37.002228+0000","last_fullsized":"2024-09-12T02:07:37.002228+0000","mapping_epoch":33,"log_start":"266'800","ondisk_log_start":"266'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'828","last_scrub_stamp":"2024-09-12T02:07:37.002001+0000","last_deep_scrub":"266'828","last_deep_scrub_stamp":"2024-09-12T02:07:37.002001+0000","last_clean_scrub_stamp":"2024-09-12T02:07:37.002001+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:31.781328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"266'304","reported_seq":869,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.531909+0000","last_change":"2024-09-12T02:07:28.531909+0000","last_active":"2024-09-12T02:07:28.531909+0000","last_peered":"2024-09-12T02:07:28.531909+0000","last_clean":"2024-09-12T02:07:28.531909+0000","last_became_active":"2024-09-12T00:10:09.358708+0000","last_became_peered":"2024-09-12T00:10:09.358708+0000","last_unstale":"2024-09-12T02:07:28.531909+0000","last_undegraded":"2024-09-12T02:07:28.531909+0000","last_fullsized":"2024-09-12T02:07:28.531909+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'304","last_scrub_stamp":"2024-09-12T02:07:28.531729+0000","last_deep_scrub":"266'304","last_deep_scrub_stamp":"2024-09-12T02:07:28.531729+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.531729+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:25.701926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":399,"num_read_kb":387,"num_write":681,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"266'1118","reported_seq":2658,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.998245+0000","last_change":"2024-09-12T02:06:56.998245+0000","last_active":"2024-09-12T02:06:56.998245+0000","last_peered":"2024-09-12T02:06:56.998245+0000","last_clean":"2024-09-12T02:06:56.998245+0000","last_became_active":"2024-09-12T00:10:01.274310+0000","last_became_peered":"2024-09-12T00:10:01.274310+0000","last_unstale":"2024-09-12T02:06:56.998245+0000","last_undegraded":"2024-09-12T02:06:56.998245+0000","last_fullsized":"2024-09-12T02:06:56.998245+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1118","last_scrub_stamp":"2024-09-12T02:06:56.998048+0000","last_deep_scrub":"266'1118","last_deep_scrub_stamp":"2024-09-12T02:06:56.998048+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.998048+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":1100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:33.714167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5066,"num_read_kb":4471,"num_write":1537,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"266'372","reported_seq":1077,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:52.492593+0000","last_change":"2024-09-12T02:06:52.492480+0000","last_active":"2024-09-12T02:06:52.492593+0000","last_peered":"2024-09-12T02:06:52.492593+0000","last_clean":"2024-09-12T02:06:52.492593+0000","last_became_active":"2024-09-12T00:09:59.291630+0000","last_became_peered":"2024-09-12T00:09:59.291630+0000","last_unstale":"2024-09-12T02:06:52.492593+0000","last_undegraded":"2024-09-12T02:06:52.492593+0000","last_fullsized":"2024-09-12T02:06:52.492593+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'372","last_scrub_stamp":"2024-09-12T02:06:52.492329+0000","last_deep_scrub":"266'372","last_deep_scrub_stamp":"2024-09-12T02:06:52.492329+0000","last_clean_scrub_stamp":"2024-09-12T02:06:52.492329+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:26.589627+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306724,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":13946,"num_write":1174,"num_write_kb":43869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":561,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.202278+0000","last_change":"2024-09-12T02:06:55.202278+0000","last_active":"2024-09-12T02:06:55.202278+0000","last_peered":"2024-09-12T02:06:55.202278+0000","last_clean":"2024-09-12T02:06:55.202278+0000","last_became_active":"2024-09-12T00:09:46.163643+0000","last_became_peered":"2024-09-12T00:09:46.163643+0000","last_unstale":"2024-09-12T02:06:55.202278+0000","last_undegraded":"2024-09-12T02:06:55.202278+0000","last_fullsized":"2024-09-12T02:06:55.202278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:06:55.202103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:06:55.202103+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.202103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:46.554637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00095304600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":540,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:19.995648+0000","last_change":"2024-09-12T02:07:19.995648+0000","last_active":"2024-09-12T02:07:19.995648+0000","last_peered":"2024-09-12T02:07:19.995648+0000","last_clean":"2024-09-12T02:07:19.995648+0000","last_became_active":"2024-09-12T00:10:03.265087+0000","last_became_peered":"2024-09-12T00:10:03.265087+0000","last_unstale":"2024-09-12T02:07:19.995648+0000","last_undegraded":"2024-09-12T02:07:19.995648+0000","last_fullsized":"2024-09-12T02:07:19.995648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:19.995464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:19.995464+0000","last_clean_scrub_stamp":"2024-09-12T02:07:19.995464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:01.752957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"266'836","reported_seq":1634,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.867397+0000","last_change":"2024-09-12T02:07:15.867397+0000","last_active":"2024-09-12T02:07:15.867397+0000","last_peered":"2024-09-12T02:07:15.867397+0000","last_clean":"2024-09-12T02:07:15.867397+0000","last_became_active":"2024-09-12T00:10:05.361458+0000","last_became_peered":"2024-09-12T00:10:05.361458+0000","last_unstale":"2024-09-12T02:07:15.867397+0000","last_undegraded":"2024-09-12T02:07:15.867397+0000","last_fullsized":"2024-09-12T02:07:15.867397+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'836","last_scrub_stamp":"2024-09-12T02:07:15.867197+0000","last_deep_scrub":"266'836","last_deep_scrub_stamp":"2024-09-12T02:07:15.867197+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.867197+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:54.678521+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146801,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1463,"num_read_kb":3339,"num_write":1180,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.020129+0000","last_change":"2024-09-12T02:07:21.020129+0000","last_active":"2024-09-12T02:07:21.020129+0000","last_peered":"2024-09-12T02:07:21.020129+0000","last_clean":"2024-09-12T02:07:21.020129+0000","last_became_active":"2024-09-12T00:10:07.333984+0000","last_became_peered":"2024-09-12T00:10:07.333984+0000","last_unstale":"2024-09-12T02:07:21.020129+0000","last_undegraded":"2024-09-12T02:07:21.020129+0000","last_fullsized":"2024-09-12T02:07:21.020129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:21.019946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:21.019946+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.019946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:59.638445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"266'126","reported_seq":657,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.615767+0000","last_change":"2024-09-12T02:07:27.615767+0000","last_active":"2024-09-12T02:07:27.615767+0000","last_peered":"2024-09-12T02:07:27.615767+0000","last_clean":"2024-09-12T02:07:27.615767+0000","last_became_active":"2024-09-12T00:10:09.368289+0000","last_became_peered":"2024-09-12T00:10:09.368289+0000","last_unstale":"2024-09-12T02:07:27.615767+0000","last_undegraded":"2024-09-12T02:07:27.615767+0000","last_fullsized":"2024-09-12T02:07:27.615767+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'126","last_scrub_stamp":"2024-09-12T02:07:27.615559+0000","last_deep_scrub":"266'126","last_deep_scrub_stamp":"2024-09-12T02:07:27.615559+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.615559+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:04.535479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":292,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"266'158","reported_seq":754,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.561193+0000","last_change":"2024-09-12T02:07:31.561193+0000","last_active":"2024-09-12T02:07:31.561193+0000","last_peered":"2024-09-12T02:07:31.561193+0000","last_clean":"2024-09-12T02:07:31.561193+0000","last_became_active":"2024-09-12T00:10:09.372467+0000","last_became_peered":"2024-09-12T00:10:09.372467+0000","last_unstale":"2024-09-12T02:07:31.561193+0000","last_undegraded":"2024-09-12T02:07:31.561193+0000","last_fullsized":"2024-09-12T02:07:31.561193+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'158","last_scrub_stamp":"2024-09-12T02:07:31.561001+0000","last_deep_scrub":"266'158","last_deep_scrub_stamp":"2024-09-12T02:07:31.561001+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.561001+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:34.171025+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":220,"num_write":368,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"266'889","reported_seq":2706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.066271+0000","last_change":"2024-09-12T02:07:03.066271+0000","last_active":"2024-09-12T02:07:03.066271+0000","last_peered":"2024-09-12T02:07:03.066271+0000","last_clean":"2024-09-12T02:07:03.066271+0000","last_became_active":"2024-09-12T00:10:01.266479+0000","last_became_peered":"2024-09-12T00:10:01.266479+0000","last_unstale":"2024-09-12T02:07:03.066271+0000","last_undegraded":"2024-09-12T02:07:03.066271+0000","last_fullsized":"2024-09-12T02:07:03.066271+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'889","last_scrub_stamp":"2024-09-12T02:07:03.066081+0000","last_deep_scrub":"266'889","last_deep_scrub_stamp":"2024-09-12T02:07:03.066081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.066081+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:36.910267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4439,"num_read_kb":4016,"num_write":1172,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1578,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"266'328","reported_seq":1077,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.041051+0000","last_change":"2024-09-12T02:06:56.040868+0000","last_active":"2024-09-12T02:06:56.041051+0000","last_peered":"2024-09-12T02:06:56.041051+0000","last_clean":"2024-09-12T02:06:56.041051+0000","last_became_active":"2024-09-12T00:09:59.309979+0000","last_became_peered":"2024-09-12T00:09:59.309979+0000","last_unstale":"2024-09-12T02:06:56.041051+0000","last_undegraded":"2024-09-12T02:06:56.041051+0000","last_fullsized":"2024-09-12T02:06:56.041051+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'328","last_scrub_stamp":"2024-09-12T02:06:56.040661+0000","last_deep_scrub":"266'328","last_deep_scrub_stamp":"2024-09-12T02:06:56.040661+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.040661+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:55.878202+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":761,"num_read_kb":10875,"num_write":997,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.359965+0000","last_change":"2024-09-12T02:07:07.359965+0000","last_active":"2024-09-12T02:07:07.359965+0000","last_peered":"2024-09-12T02:07:07.359965+0000","last_clean":"2024-09-12T02:07:07.359965+0000","last_became_active":"2024-09-12T00:10:03.272547+0000","last_became_peered":"2024-09-12T00:10:03.272547+0000","last_unstale":"2024-09-12T02:07:07.359965+0000","last_undegraded":"2024-09-12T02:07:07.359965+0000","last_fullsized":"2024-09-12T02:07:07.359965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.359774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.359774+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.359774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:58.266703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"266'337","reported_seq":980,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.984776+0000","last_change":"2024-09-12T02:07:17.984776+0000","last_active":"2024-09-12T02:07:17.984776+0000","last_peered":"2024-09-12T02:07:17.984776+0000","last_clean":"2024-09-12T02:07:17.984776+0000","last_became_active":"2024-09-12T00:10:05.292446+0000","last_became_peered":"2024-09-12T00:10:05.292446+0000","last_unstale":"2024-09-12T02:07:17.984776+0000","last_undegraded":"2024-09-12T02:07:17.984776+0000","last_fullsized":"2024-09-12T02:07:17.984776+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'337","last_scrub_stamp":"2024-09-12T02:07:17.984572+0000","last_deep_scrub":"266'337","last_deep_scrub_stamp":"2024-09-12T02:07:17.984572+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.984572+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:22.772151+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16245,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":1009,"num_write":400,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.990819+0000","last_change":"2024-09-12T02:07:25.990819+0000","last_active":"2024-09-12T02:07:25.990819+0000","last_peered":"2024-09-12T02:07:25.990819+0000","last_clean":"2024-09-12T02:07:25.990819+0000","last_became_active":"2024-09-12T00:10:07.335659+0000","last_became_peered":"2024-09-12T00:10:07.335659+0000","last_unstale":"2024-09-12T02:07:25.990819+0000","last_undegraded":"2024-09-12T02:07:25.990819+0000","last_fullsized":"2024-09-12T02:07:25.990819+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.990613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.990613+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.990613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:39.556676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"266'117","reported_seq":651,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.985674+0000","last_change":"2024-09-12T02:07:31.985674+0000","last_active":"2024-09-12T02:07:31.985674+0000","last_peered":"2024-09-12T02:07:31.985674+0000","last_clean":"2024-09-12T02:07:31.985674+0000","last_became_active":"2024-09-12T00:10:09.356043+0000","last_became_peered":"2024-09-12T00:10:09.356043+0000","last_unstale":"2024-09-12T02:07:31.985674+0000","last_undegraded":"2024-09-12T02:07:31.985674+0000","last_fullsized":"2024-09-12T02:07:31.985674+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'117","last_scrub_stamp":"2024-09-12T02:07:31.985481+0000","last_deep_scrub":"266'117","last_deep_scrub_stamp":"2024-09-12T02:07:31.985481+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.985481+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:17.328350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":102,"num_write":274,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"266'484","reported_seq":2046,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.337781+0000","last_change":"2024-09-12T02:07:04.337781+0000","last_active":"2024-09-12T02:07:04.337781+0000","last_peered":"2024-09-12T02:07:04.337781+0000","last_clean":"2024-09-12T02:07:04.337781+0000","last_became_active":"2024-09-12T00:10:01.264977+0000","last_became_peered":"2024-09-12T00:10:01.264977+0000","last_unstale":"2024-09-12T02:07:04.337781+0000","last_undegraded":"2024-09-12T02:07:04.337781+0000","last_fullsized":"2024-09-12T02:07:04.337781+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'484","last_scrub_stamp":"2024-09-12T02:07:04.337573+0000","last_deep_scrub":"266'484","last_deep_scrub_stamp":"2024-09-12T02:07:04.337573+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.337573+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.524170+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2475,"num_read_kb":2306,"num_write":570,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"266'380","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.767936+0000","last_change":"2024-09-12T02:07:01.767936+0000","last_active":"2024-09-12T02:07:01.767936+0000","last_peered":"2024-09-12T02:07:01.767936+0000","last_clean":"2024-09-12T02:07:01.767936+0000","last_became_active":"2024-09-12T00:09:59.300181+0000","last_became_peered":"2024-09-12T00:09:59.300181+0000","last_unstale":"2024-09-12T02:07:01.767936+0000","last_undegraded":"2024-09-12T02:07:01.767936+0000","last_fullsized":"2024-09-12T02:07:01.767936+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T02:07:01.767612+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T02:07:01.767612+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.767612+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:31.745878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":10768,"num_write":1216,"num_write_kb":35109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.965571+0000","last_change":"2024-09-12T02:07:15.965571+0000","last_active":"2024-09-12T02:07:15.965571+0000","last_peered":"2024-09-12T02:07:15.965571+0000","last_clean":"2024-09-12T02:07:15.965571+0000","last_became_active":"2024-09-12T00:10:03.256053+0000","last_became_peered":"2024-09-12T00:10:03.256053+0000","last_unstale":"2024-09-12T02:07:15.965571+0000","last_undegraded":"2024-09-12T02:07:15.965571+0000","last_fullsized":"2024-09-12T02:07:15.965571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:15.965361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:15.965361+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.965361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:34.211984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"266'77","reported_seq":626,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.583569+0000","last_change":"2024-09-12T02:07:14.583569+0000","last_active":"2024-09-12T02:07:14.583569+0000","last_peered":"2024-09-12T02:07:14.583569+0000","last_clean":"2024-09-12T02:07:14.583569+0000","last_became_active":"2024-09-12T00:10:05.288688+0000","last_became_peered":"2024-09-12T00:10:05.288688+0000","last_unstale":"2024-09-12T02:07:14.583569+0000","last_undegraded":"2024-09-12T02:07:14.583569+0000","last_fullsized":"2024-09-12T02:07:14.583569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'77","last_scrub_stamp":"2024-09-12T02:07:14.583337+0000","last_deep_scrub":"266'77","last_deep_scrub_stamp":"2024-09-12T02:07:14.583337+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.583337+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:04.333383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.832765+0000","last_change":"2024-09-12T02:07:21.832765+0000","last_active":"2024-09-12T02:07:21.832765+0000","last_peered":"2024-09-12T02:07:21.832765+0000","last_clean":"2024-09-12T02:07:21.832765+0000","last_became_active":"2024-09-12T00:10:07.320729+0000","last_became_peered":"2024-09-12T00:10:07.320729+0000","last_unstale":"2024-09-12T02:07:21.832765+0000","last_undegraded":"2024-09-12T02:07:21.832765+0000","last_fullsized":"2024-09-12T02:07:21.832765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:21.832583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:21.832583+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.832583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:12.758498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"266'205","reported_seq":752,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.523688+0000","last_change":"2024-09-12T02:07:29.523524+0000","last_active":"2024-09-12T02:07:29.523688+0000","last_peered":"2024-09-12T02:07:29.523688+0000","last_clean":"2024-09-12T02:07:29.523688+0000","last_became_active":"2024-09-12T00:10:09.362096+0000","last_became_peered":"2024-09-12T00:10:09.362096+0000","last_unstale":"2024-09-12T02:07:29.523688+0000","last_undegraded":"2024-09-12T02:07:29.523688+0000","last_fullsized":"2024-09-12T02:07:29.523688+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T02:07:29.523340+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T02:07:29.523340+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.523340+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:29.658240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":296,"num_read_kb":291,"num_write":467,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"266'433","reported_seq":2154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.964744+0000","last_change":"2024-09-12T02:07:04.964744+0000","last_active":"2024-09-12T02:07:04.964744+0000","last_peered":"2024-09-12T02:07:04.964744+0000","last_clean":"2024-09-12T02:07:04.964744+0000","last_became_active":"2024-09-12T00:10:01.261030+0000","last_became_peered":"2024-09-12T00:10:01.261030+0000","last_unstale":"2024-09-12T02:07:04.964744+0000","last_undegraded":"2024-09-12T02:07:04.964744+0000","last_fullsized":"2024-09-12T02:07:04.964744+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'433","last_scrub_stamp":"2024-09-12T02:07:04.964572+0000","last_deep_scrub":"266'433","last_deep_scrub_stamp":"2024-09-12T02:07:04.964572+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.964572+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:57.148348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2550,"num_read_kb":2440,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2736,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"266'384","reported_seq":1086,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.676078+0000","last_change":"2024-09-12T02:06:57.676078+0000","last_active":"2024-09-12T02:06:57.676078+0000","last_peered":"2024-09-12T02:06:57.676078+0000","last_clean":"2024-09-12T02:06:57.676078+0000","last_became_active":"2024-09-12T00:09:59.288100+0000","last_became_peered":"2024-09-12T00:09:59.288100+0000","last_unstale":"2024-09-12T02:06:57.676078+0000","last_undegraded":"2024-09-12T02:06:57.676078+0000","last_fullsized":"2024-09-12T02:06:57.676078+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'384","last_scrub_stamp":"2024-09-12T02:06:57.675785+0000","last_deep_scrub":"266'384","last_deep_scrub_stamp":"2024-09-12T02:06:57.675785+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.675785+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:31.989566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":599,"num_read_kb":15869,"num_write":1177,"num_write_kb":23659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.856047+0000","last_change":"2024-09-12T02:07:13.856047+0000","last_active":"2024-09-12T02:07:13.856047+0000","last_peered":"2024-09-12T02:07:13.856047+0000","last_clean":"2024-09-12T02:07:13.856047+0000","last_became_active":"2024-09-12T00:10:03.255669+0000","last_became_peered":"2024-09-12T00:10:03.255669+0000","last_unstale":"2024-09-12T02:07:13.856047+0000","last_undegraded":"2024-09-12T02:07:13.856047+0000","last_fullsized":"2024-09-12T02:07:13.856047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.855842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.855842+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.855842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:48.988845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"266'350","reported_seq":1004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.991907+0000","last_change":"2024-09-12T02:07:27.991907+0000","last_active":"2024-09-12T02:07:27.991907+0000","last_peered":"2024-09-12T02:07:27.991907+0000","last_clean":"2024-09-12T02:07:27.991907+0000","last_became_active":"2024-09-12T00:10:05.299730+0000","last_became_peered":"2024-09-12T00:10:05.299730+0000","last_unstale":"2024-09-12T02:07:27.991907+0000","last_undegraded":"2024-09-12T02:07:27.991907+0000","last_fullsized":"2024-09-12T02:07:27.991907+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'350","last_scrub_stamp":"2024-09-12T02:07:27.991701+0000","last_deep_scrub":"266'350","last_deep_scrub_stamp":"2024-09-12T02:07:27.991701+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.991701+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:15.725731+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58900,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1109,"num_write":428,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:13.084311+0000","last_change":"2024-09-12T02:07:13.084311+0000","last_active":"2024-09-12T02:07:13.084311+0000","last_peered":"2024-09-12T02:07:13.084311+0000","last_clean":"2024-09-12T02:07:13.084311+0000","last_became_active":"2024-09-12T00:10:07.329741+0000","last_became_peered":"2024-09-12T00:10:07.329741+0000","last_unstale":"2024-09-12T02:07:13.084311+0000","last_undegraded":"2024-09-12T02:07:13.084311+0000","last_fullsized":"2024-09-12T02:07:13.084311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:13.084128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:13.084128+0000","last_clean_scrub_stamp":"2024-09-12T02:07:13.084128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:04.189686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"266'91","reported_seq":632,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:29.671389+0000","last_change":"2024-09-12T02:07:29.671249+0000","last_active":"2024-09-12T02:07:29.671389+0000","last_peered":"2024-09-12T02:07:29.671389+0000","last_clean":"2024-09-12T02:07:29.671389+0000","last_became_active":"2024-09-12T00:10:09.371755+0000","last_became_peered":"2024-09-12T00:10:09.371755+0000","last_unstale":"2024-09-12T02:07:29.671389+0000","last_undegraded":"2024-09-12T02:07:29.671389+0000","last_fullsized":"2024-09-12T02:07:29.671389+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'91","last_scrub_stamp":"2024-09-12T02:07:29.671047+0000","last_deep_scrub":"266'91","last_deep_scrub_stamp":"2024-09-12T02:07:29.671047+0000","last_clean_scrub_stamp":"2024-09-12T02:07:29.671047+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:47.726332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":117,"num_write":213,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"266'805","reported_seq":2443,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.987469+0000","last_change":"2024-09-12T02:07:14.987469+0000","last_active":"2024-09-12T02:07:14.987469+0000","last_peered":"2024-09-12T02:07:14.987469+0000","last_clean":"2024-09-12T02:07:14.987469+0000","last_became_active":"2024-09-12T00:10:01.258814+0000","last_became_peered":"2024-09-12T00:10:01.258814+0000","last_unstale":"2024-09-12T02:07:14.987469+0000","last_undegraded":"2024-09-12T02:07:14.987469+0000","last_fullsized":"2024-09-12T02:07:14.987469+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'805","last_scrub_stamp":"2024-09-12T02:07:14.987293+0000","last_deep_scrub":"266'805","last_deep_scrub_stamp":"2024-09-12T02:07:14.987293+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.987293+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:04.316537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3906,"num_read_kb":3532,"num_write":1046,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"266'415","reported_seq":1087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.547391+0000","last_change":"2024-09-12T02:06:56.547391+0000","last_active":"2024-09-12T02:06:56.547391+0000","last_peered":"2024-09-12T02:06:56.547391+0000","last_clean":"2024-09-12T02:06:56.547391+0000","last_became_active":"2024-09-12T00:09:59.262775+0000","last_became_peered":"2024-09-12T00:09:59.262775+0000","last_unstale":"2024-09-12T02:06:56.547391+0000","last_undegraded":"2024-09-12T02:06:56.547391+0000","last_fullsized":"2024-09-12T02:06:56.547391+0000","mapping_epoch":25,"log_start":"266'400","ondisk_log_start":"266'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'415","last_scrub_stamp":"2024-09-12T02:06:56.547179+0000","last_deep_scrub":"266'415","last_deep_scrub_stamp":"2024-09-12T02:06:56.547179+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.547179+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.608245+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":557,"num_read_kb":527,"num_write":1329,"num_write_kb":18885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.038234+0000","last_change":"2024-09-12T02:07:08.038234+0000","last_active":"2024-09-12T02:07:08.038234+0000","last_peered":"2024-09-12T02:07:08.038234+0000","last_clean":"2024-09-12T02:07:08.038234+0000","last_became_active":"2024-09-12T00:10:03.257953+0000","last_became_peered":"2024-09-12T00:10:03.257953+0000","last_unstale":"2024-09-12T02:07:08.038234+0000","last_undegraded":"2024-09-12T02:07:08.038234+0000","last_fullsized":"2024-09-12T02:07:08.038234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:08.038057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:08.038057+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.038057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:22.867531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"266'331","reported_seq":953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.855409+0000","last_change":"2024-09-12T02:07:18.855409+0000","last_active":"2024-09-12T02:07:18.855409+0000","last_peered":"2024-09-12T02:07:18.855409+0000","last_clean":"2024-09-12T02:07:18.855409+0000","last_became_active":"2024-09-12T00:10:05.285485+0000","last_became_peered":"2024-09-12T00:10:05.285485+0000","last_unstale":"2024-09-12T02:07:18.855409+0000","last_undegraded":"2024-09-12T02:07:18.855409+0000","last_fullsized":"2024-09-12T02:07:18.855409+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'331","last_scrub_stamp":"2024-09-12T02:07:18.855228+0000","last_deep_scrub":"266'331","last_deep_scrub_stamp":"2024-09-12T02:07:18.855228+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.855228+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:33.365002+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61516,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":551,"num_read_kb":1250,"num_write":446,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.616188+0000","last_change":"2024-09-12T02:07:23.616188+0000","last_active":"2024-09-12T02:07:23.616188+0000","last_peered":"2024-09-12T02:07:23.616188+0000","last_clean":"2024-09-12T02:07:23.616188+0000","last_became_active":"2024-09-12T00:10:07.325482+0000","last_became_peered":"2024-09-12T00:10:07.325482+0000","last_unstale":"2024-09-12T02:07:23.616188+0000","last_undegraded":"2024-09-12T02:07:23.616188+0000","last_fullsized":"2024-09-12T02:07:23.616188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:23.616016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:23.616016+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.616016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:14.088072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"266'842","reported_seq":2411,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.057496+0000","last_change":"2024-09-12T02:07:06.057496+0000","last_active":"2024-09-12T02:07:06.057496+0000","last_peered":"2024-09-12T02:07:06.057496+0000","last_clean":"2024-09-12T02:07:06.057496+0000","last_became_active":"2024-09-12T00:10:01.276906+0000","last_became_peered":"2024-09-12T00:10:01.276906+0000","last_unstale":"2024-09-12T02:07:06.057496+0000","last_undegraded":"2024-09-12T02:07:06.057496+0000","last_fullsized":"2024-09-12T02:07:06.057496+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'842","last_scrub_stamp":"2024-09-12T02:07:06.057301+0000","last_deep_scrub":"266'842","last_deep_scrub_stamp":"2024-09-12T02:07:06.057301+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.057301+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:30.646553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3919,"num_read_kb":3507,"num_write":1092,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"266'321","reported_seq":1003,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.854948+0000","last_change":"2024-09-12T02:06:58.854948+0000","last_active":"2024-09-12T02:06:58.854948+0000","last_peered":"2024-09-12T02:06:58.854948+0000","last_clean":"2024-09-12T02:06:58.854948+0000","last_became_active":"2024-09-12T00:09:59.248681+0000","last_became_peered":"2024-09-12T00:09:59.248681+0000","last_unstale":"2024-09-12T02:06:58.854948+0000","last_undegraded":"2024-09-12T02:06:58.854948+0000","last_fullsized":"2024-09-12T02:06:58.854948+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'321","last_scrub_stamp":"2024-09-12T02:06:58.854706+0000","last_deep_scrub":"266'321","last_deep_scrub_stamp":"2024-09-12T02:06:58.854706+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.854706+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:53.988034+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1398999,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":23744,"num_write":1111,"num_write_kb":29955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":537,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.562161+0000","last_change":"2024-09-12T02:07:12.562161+0000","last_active":"2024-09-12T02:07:12.562161+0000","last_peered":"2024-09-12T02:07:12.562161+0000","last_clean":"2024-09-12T02:07:12.562161+0000","last_became_active":"2024-09-12T00:10:03.260387+0000","last_became_peered":"2024-09-12T00:10:03.260387+0000","last_unstale":"2024-09-12T02:07:12.562161+0000","last_undegraded":"2024-09-12T02:07:12.562161+0000","last_fullsized":"2024-09-12T02:07:12.562161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.561935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.561935+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.561935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:15.815479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"266'548","reported_seq":1235,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:15.430143+0000","last_change":"2024-09-12T02:07:15.430071+0000","last_active":"2024-09-12T02:07:15.430143+0000","last_peered":"2024-09-12T02:07:15.430143+0000","last_clean":"2024-09-12T02:07:15.430143+0000","last_became_active":"2024-09-12T00:10:05.300613+0000","last_became_peered":"2024-09-12T00:10:05.300613+0000","last_unstale":"2024-09-12T02:07:15.430143+0000","last_undegraded":"2024-09-12T02:07:15.430143+0000","last_fullsized":"2024-09-12T02:07:15.430143+0000","mapping_epoch":31,"log_start":"266'500","ondisk_log_start":"266'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'548","last_scrub_stamp":"2024-09-12T02:07:15.429949+0000","last_deep_scrub":"266'548","last_deep_scrub_stamp":"2024-09-12T02:07:15.429949+0000","last_clean_scrub_stamp":"2024-09-12T02:07:15.429949+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:50.425830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102448,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":959,"num_read_kb":2206,"num_write":818,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.588319+0000","last_change":"2024-09-12T02:07:24.588181+0000","last_active":"2024-09-12T02:07:24.588319+0000","last_peered":"2024-09-12T02:07:24.588319+0000","last_clean":"2024-09-12T02:07:24.588319+0000","last_became_active":"2024-09-12T00:10:07.342700+0000","last_became_peered":"2024-09-12T00:10:07.342700+0000","last_unstale":"2024-09-12T02:07:24.588319+0000","last_undegraded":"2024-09-12T02:07:24.588319+0000","last_fullsized":"2024-09-12T02:07:24.588319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.588000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.588000+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.588000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:15.029488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"266'160","reported_seq":699,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:43.144345+0000","last_change":"2024-09-12T02:07:43.144345+0000","last_active":"2024-09-12T02:07:43.144345+0000","last_peered":"2024-09-12T02:07:43.144345+0000","last_clean":"2024-09-12T02:07:43.144345+0000","last_became_active":"2024-09-12T00:10:09.435513+0000","last_became_peered":"2024-09-12T00:10:09.435513+0000","last_unstale":"2024-09-12T02:07:43.144345+0000","last_undegraded":"2024-09-12T02:07:43.144345+0000","last_fullsized":"2024-09-12T02:07:43.144345+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'160","last_scrub_stamp":"2024-09-12T02:07:43.144149+0000","last_deep_scrub":"266'160","last_deep_scrub_stamp":"2024-09-12T02:07:43.144149+0000","last_clean_scrub_stamp":"2024-09-12T02:07:43.144149+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:19.093423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":659,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":193,"num_write":343,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"266'812","reported_seq":2378,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.541839+0000","last_change":"2024-09-12T02:07:06.541839+0000","last_active":"2024-09-12T02:07:06.541839+0000","last_peered":"2024-09-12T02:07:06.541839+0000","last_clean":"2024-09-12T02:07:06.541839+0000","last_became_active":"2024-09-12T00:10:01.260115+0000","last_became_peered":"2024-09-12T00:10:01.260115+0000","last_unstale":"2024-09-12T02:07:06.541839+0000","last_undegraded":"2024-09-12T02:07:06.541839+0000","last_fullsized":"2024-09-12T02:07:06.541839+0000","mapping_epoch":27,"log_start":"266'801","ondisk_log_start":"266'801","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'812","last_scrub_stamp":"2024-09-12T02:07:06.541653+0000","last_deep_scrub":"266'812","last_deep_scrub_stamp":"2024-09-12T02:07:06.541653+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.541653+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":801,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:47.466063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3786,"num_read_kb":3403,"num_write":1061,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"266'381","reported_seq":1164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:57.433070+0000","last_change":"2024-09-12T02:06:57.433070+0000","last_active":"2024-09-12T02:06:57.433070+0000","last_peered":"2024-09-12T02:06:57.433070+0000","last_clean":"2024-09-12T02:06:57.433070+0000","last_became_active":"2024-09-12T00:09:59.285792+0000","last_became_peered":"2024-09-12T00:09:59.285792+0000","last_unstale":"2024-09-12T02:06:57.433070+0000","last_undegraded":"2024-09-12T02:06:57.433070+0000","last_fullsized":"2024-09-12T02:06:57.433070+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:06:57.432824+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:06:57.432824+0000","last_clean_scrub_stamp":"2024-09-12T02:06:57.432824+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:51.237303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":739,"num_read_kb":25287,"num_write":1212,"num_write_kb":29345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":539,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.050934+0000","last_change":"2024-09-12T02:07:09.050934+0000","last_active":"2024-09-12T02:07:09.050934+0000","last_peered":"2024-09-12T02:07:09.050934+0000","last_clean":"2024-09-12T02:07:09.050934+0000","last_became_active":"2024-09-12T00:10:03.257760+0000","last_became_peered":"2024-09-12T00:10:03.257760+0000","last_unstale":"2024-09-12T02:07:09.050934+0000","last_undegraded":"2024-09-12T02:07:09.050934+0000","last_fullsized":"2024-09-12T02:07:09.050934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:09.050754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:09.050754+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.050754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:37.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"266'390","reported_seq":1045,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:20.818937+0000","last_change":"2024-09-12T02:07:20.818678+0000","last_active":"2024-09-12T02:07:20.818937+0000","last_peered":"2024-09-12T02:07:20.818937+0000","last_clean":"2024-09-12T02:07:20.818937+0000","last_became_active":"2024-09-12T00:10:05.292902+0000","last_became_peered":"2024-09-12T00:10:05.292902+0000","last_unstale":"2024-09-12T02:07:20.818937+0000","last_undegraded":"2024-09-12T02:07:20.818937+0000","last_fullsized":"2024-09-12T02:07:20.818937+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'390","last_scrub_stamp":"2024-09-12T02:07:20.818372+0000","last_deep_scrub":"266'390","last_deep_scrub_stamp":"2024-09-12T02:07:20.818372+0000","last_clean_scrub_stamp":"2024-09-12T02:07:20.818372+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:37.386926+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47287,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":1193,"num_write":510,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.506561+0000","last_change":"2024-09-12T02:07:18.506402+0000","last_active":"2024-09-12T02:07:18.506561+0000","last_peered":"2024-09-12T02:07:18.506561+0000","last_clean":"2024-09-12T02:07:18.506561+0000","last_became_active":"2024-09-12T00:10:07.321400+0000","last_became_peered":"2024-09-12T00:10:07.321400+0000","last_unstale":"2024-09-12T02:07:18.506561+0000","last_undegraded":"2024-09-12T02:07:18.506561+0000","last_fullsized":"2024-09-12T02:07:18.506561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:18.506178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:18.506178+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.506178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:58.545356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"266'192","reported_seq":755,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.089900+0000","last_change":"2024-09-12T02:07:17.089900+0000","last_active":"2024-09-12T02:07:17.089900+0000","last_peered":"2024-09-12T02:07:17.089900+0000","last_clean":"2024-09-12T02:07:17.089900+0000","last_became_active":"2024-09-12T00:10:09.355548+0000","last_became_peered":"2024-09-12T00:10:09.355548+0000","last_unstale":"2024-09-12T02:07:17.089900+0000","last_undegraded":"2024-09-12T02:07:17.089900+0000","last_fullsized":"2024-09-12T02:07:17.089900+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'192","last_scrub_stamp":"2024-09-12T02:07:17.089680+0000","last_deep_scrub":"266'192","last_deep_scrub_stamp":"2024-09-12T02:07:17.089680+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.089680+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:17.343686+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":268,"num_write":529,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"266'396","reported_seq":1789,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.971760+0000","last_change":"2024-09-12T02:07:09.971585+0000","last_active":"2024-09-12T02:07:09.971760+0000","last_peered":"2024-09-12T02:07:09.971760+0000","last_clean":"2024-09-12T02:07:09.971760+0000","last_became_active":"2024-09-12T00:10:01.256781+0000","last_became_peered":"2024-09-12T00:10:01.256781+0000","last_unstale":"2024-09-12T02:07:09.971760+0000","last_undegraded":"2024-09-12T02:07:09.971760+0000","last_fullsized":"2024-09-12T02:07:09.971760+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'396","last_scrub_stamp":"2024-09-12T02:07:09.971392+0000","last_deep_scrub":"266'396","last_deep_scrub_stamp":"2024-09-12T02:07:09.971392+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.971392+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:53.393957+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1972,"num_read_kb":1849,"num_write":456,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"266'342","reported_seq":993,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.004650+0000","last_change":"2024-09-12T02:06:55.004394+0000","last_active":"2024-09-12T02:06:55.004650+0000","last_peered":"2024-09-12T02:06:55.004650+0000","last_clean":"2024-09-12T02:06:55.004650+0000","last_became_active":"2024-09-12T00:09:59.295949+0000","last_became_peered":"2024-09-12T00:09:59.295949+0000","last_unstale":"2024-09-12T02:06:55.004650+0000","last_undegraded":"2024-09-12T02:06:55.004650+0000","last_fullsized":"2024-09-12T02:06:55.004650+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'342","last_scrub_stamp":"2024-09-12T02:06:55.004131+0000","last_deep_scrub":"266'342","last_deep_scrub_stamp":"2024-09-12T02:06:55.004131+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.004131+0000","objects_scrubbed":7,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:24.111205+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314586,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":1958,"num_write":1004,"num_write_kb":21693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.015988+0000","last_change":"2024-09-12T02:07:17.015850+0000","last_active":"2024-09-12T02:07:17.015988+0000","last_peered":"2024-09-12T02:07:17.015988+0000","last_clean":"2024-09-12T02:07:17.015988+0000","last_became_active":"2024-09-12T00:10:03.254941+0000","last_became_peered":"2024-09-12T00:10:03.254941+0000","last_unstale":"2024-09-12T02:07:17.015988+0000","last_undegraded":"2024-09-12T02:07:17.015988+0000","last_fullsized":"2024-09-12T02:07:17.015988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:17.015656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:17.015656+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.015656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:35.259126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"266'352","reported_seq":1002,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.005634+0000","last_change":"2024-09-12T02:07:25.005634+0000","last_active":"2024-09-12T02:07:25.005634+0000","last_peered":"2024-09-12T02:07:25.005634+0000","last_clean":"2024-09-12T02:07:25.005634+0000","last_became_active":"2024-09-12T00:10:05.362151+0000","last_became_peered":"2024-09-12T00:10:05.362151+0000","last_unstale":"2024-09-12T02:07:25.005634+0000","last_undegraded":"2024-09-12T02:07:25.005634+0000","last_fullsized":"2024-09-12T02:07:25.005634+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'352","last_scrub_stamp":"2024-09-12T02:07:25.005436+0000","last_deep_scrub":"266'352","last_deep_scrub_stamp":"2024-09-12T02:07:25.005436+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.005436+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:16.267655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45165,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":578,"num_read_kb":1204,"num_write":458,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.414408+0000","last_change":"2024-09-12T02:07:16.414408+0000","last_active":"2024-09-12T02:07:16.414408+0000","last_peered":"2024-09-12T02:07:16.414408+0000","last_clean":"2024-09-12T02:07:16.414408+0000","last_became_active":"2024-09-12T00:10:07.336129+0000","last_became_peered":"2024-09-12T00:10:07.336129+0000","last_unstale":"2024-09-12T02:07:16.414408+0000","last_undegraded":"2024-09-12T02:07:16.414408+0000","last_fullsized":"2024-09-12T02:07:16.414408+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:16.414226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:16.414226+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.414226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:38.943116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"266'103","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:31.691163+0000","last_change":"2024-09-12T02:07:31.691163+0000","last_active":"2024-09-12T02:07:31.691163+0000","last_peered":"2024-09-12T02:07:31.691163+0000","last_clean":"2024-09-12T02:07:31.691163+0000","last_became_active":"2024-09-12T00:10:09.370925+0000","last_became_peered":"2024-09-12T00:10:09.370925+0000","last_unstale":"2024-09-12T02:07:31.691163+0000","last_undegraded":"2024-09-12T02:07:31.691163+0000","last_fullsized":"2024-09-12T02:07:31.691163+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'103","last_scrub_stamp":"2024-09-12T02:07:31.690971+0000","last_deep_scrub":"266'103","last_deep_scrub_stamp":"2024-09-12T02:07:31.690971+0000","last_clean_scrub_stamp":"2024-09-12T02:07:31.690971+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:30.808146+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":111,"num_write":248,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"266'457","reported_seq":2126,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.672348+0000","last_change":"2024-09-12T02:06:56.672207+0000","last_active":"2024-09-12T02:06:56.672348+0000","last_peered":"2024-09-12T02:06:56.672348+0000","last_clean":"2024-09-12T02:06:56.672348+0000","last_became_active":"2024-09-12T00:10:01.257064+0000","last_became_peered":"2024-09-12T00:10:01.257064+0000","last_unstale":"2024-09-12T02:06:56.672348+0000","last_undegraded":"2024-09-12T02:06:56.672348+0000","last_fullsized":"2024-09-12T02:06:56.672348+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T02:06:56.672031+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T02:06:56.672031+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.672031+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:43.653119+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2638,"num_read_kb":2500,"num_write":538,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"266'393","reported_seq":1096,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.544401+0000","last_change":"2024-09-12T02:06:54.544339+0000","last_active":"2024-09-12T02:06:54.544401+0000","last_peered":"2024-09-12T02:06:54.544401+0000","last_clean":"2024-09-12T02:06:54.544401+0000","last_became_active":"2024-09-12T00:09:59.289217+0000","last_became_peered":"2024-09-12T00:09:59.289217+0000","last_unstale":"2024-09-12T02:06:54.544401+0000","last_undegraded":"2024-09-12T02:06:54.544401+0000","last_fullsized":"2024-09-12T02:06:54.544401+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T02:06:54.544232+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T02:06:54.544232+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.544232+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:13.653204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":33363,"num_write":1255,"num_write_kb":62829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.427645+0000","last_change":"2024-09-12T02:07:12.427491+0000","last_active":"2024-09-12T02:07:12.427645+0000","last_peered":"2024-09-12T02:07:12.427645+0000","last_clean":"2024-09-12T02:07:12.427645+0000","last_became_active":"2024-09-12T00:10:03.264802+0000","last_became_peered":"2024-09-12T00:10:03.264802+0000","last_unstale":"2024-09-12T02:07:12.427645+0000","last_undegraded":"2024-09-12T02:07:12.427645+0000","last_fullsized":"2024-09-12T02:07:12.427645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:12.427300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:12.427300+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.427300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:12.086674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"266'170","reported_seq":772,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:23.049420+0000","last_change":"2024-09-12T02:07:23.049420+0000","last_active":"2024-09-12T02:07:23.049420+0000","last_peered":"2024-09-12T02:07:23.049420+0000","last_clean":"2024-09-12T02:07:23.049420+0000","last_became_active":"2024-09-12T00:10:05.361625+0000","last_became_peered":"2024-09-12T00:10:05.361625+0000","last_unstale":"2024-09-12T02:07:23.049420+0000","last_undegraded":"2024-09-12T02:07:23.049420+0000","last_fullsized":"2024-09-12T02:07:23.049420+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'170","last_scrub_stamp":"2024-09-12T02:07:23.049225+0000","last_deep_scrub":"266'170","last_deep_scrub_stamp":"2024-09-12T02:07:23.049225+0000","last_clean_scrub_stamp":"2024-09-12T02:07:23.049225+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:36.389861+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":201,"num_read_kb":192,"num_write":144,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"266'765","reported_seq":3204,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.111797+0000","last_change":"2024-09-12T02:07:18.111797+0000","last_active":"2024-09-12T02:07:18.111797+0000","last_peered":"2024-09-12T02:07:18.111797+0000","last_clean":"2024-09-12T02:07:18.111797+0000","last_became_active":"2024-09-12T00:10:07.314980+0000","last_became_peered":"2024-09-12T00:10:07.314980+0000","last_unstale":"2024-09-12T02:07:18.111797+0000","last_undegraded":"2024-09-12T02:07:18.111797+0000","last_fullsized":"2024-09-12T02:07:18.111797+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'765","last_scrub_stamp":"2024-09-12T02:07:18.111612+0000","last_deep_scrub":"266'765","last_deep_scrub_stamp":"2024-09-12T02:07:18.111612+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.111612+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:20.698620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"266'122","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.863060+0000","last_change":"2024-09-12T02:07:25.863060+0000","last_active":"2024-09-12T02:07:25.863060+0000","last_peered":"2024-09-12T02:07:25.863060+0000","last_clean":"2024-09-12T02:07:25.863060+0000","last_became_active":"2024-09-12T00:10:09.369670+0000","last_became_peered":"2024-09-12T00:10:09.369670+0000","last_unstale":"2024-09-12T02:07:25.863060+0000","last_undegraded":"2024-09-12T02:07:25.863060+0000","last_fullsized":"2024-09-12T02:07:25.863060+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'122","last_scrub_stamp":"2024-09-12T02:07:25.862873+0000","last_deep_scrub":"266'122","last_deep_scrub_stamp":"2024-09-12T02:07:25.862873+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.862873+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:58.331730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":303,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"266'517","reported_seq":2021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.025361+0000","last_change":"2024-09-12T02:07:05.025188+0000","last_active":"2024-09-12T02:07:05.025361+0000","last_peered":"2024-09-12T02:07:05.025361+0000","last_clean":"2024-09-12T02:07:05.025361+0000","last_became_active":"2024-09-12T00:10:01.248535+0000","last_became_peered":"2024-09-12T00:10:01.248535+0000","last_unstale":"2024-09-12T02:07:05.025361+0000","last_undegraded":"2024-09-12T02:07:05.025361+0000","last_fullsized":"2024-09-12T02:07:05.025361+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'517","last_scrub_stamp":"2024-09-12T02:07:05.024997+0000","last_deep_scrub":"266'517","last_deep_scrub_stamp":"2024-09-12T02:07:05.024997+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.024997+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:36.426432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2593,"num_read_kb":2391,"num_write":659,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"266'402","reported_seq":1110,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.658383+0000","last_change":"2024-09-12T02:06:59.658106+0000","last_active":"2024-09-12T02:06:59.658383+0000","last_peered":"2024-09-12T02:06:59.658383+0000","last_clean":"2024-09-12T02:06:59.658383+0000","last_became_active":"2024-09-12T00:09:59.296207+0000","last_became_peered":"2024-09-12T00:09:59.296207+0000","last_unstale":"2024-09-12T02:06:59.658383+0000","last_undegraded":"2024-09-12T02:06:59.658383+0000","last_fullsized":"2024-09-12T02:06:59.658383+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'402","last_scrub_stamp":"2024-09-12T02:06:59.657782+0000","last_deep_scrub":"266'402","last_deep_scrub_stamp":"2024-09-12T02:06:59.657782+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.657782+0000","objects_scrubbed":10,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:49.546487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":512433,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":595,"num_read_kb":14266,"num_write":1257,"num_write_kb":35890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.829472+0000","last_change":"2024-09-12T02:07:14.829333+0000","last_active":"2024-09-12T02:07:14.829472+0000","last_peered":"2024-09-12T02:07:14.829472+0000","last_clean":"2024-09-12T02:07:14.829472+0000","last_became_active":"2024-09-12T00:10:03.259644+0000","last_became_peered":"2024-09-12T00:10:03.259644+0000","last_unstale":"2024-09-12T02:07:14.829472+0000","last_undegraded":"2024-09-12T02:07:14.829472+0000","last_fullsized":"2024-09-12T02:07:14.829472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:14.829153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:14.829153+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.829153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:55.178694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"266'393","reported_seq":1076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.646671+0000","last_change":"2024-09-12T02:07:25.646671+0000","last_active":"2024-09-12T02:07:25.646671+0000","last_peered":"2024-09-12T02:07:25.646671+0000","last_clean":"2024-09-12T02:07:25.646671+0000","last_became_active":"2024-09-12T00:10:05.297223+0000","last_became_peered":"2024-09-12T00:10:05.297223+0000","last_unstale":"2024-09-12T02:07:25.646671+0000","last_undegraded":"2024-09-12T02:07:25.646671+0000","last_fullsized":"2024-09-12T02:07:25.646671+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T02:07:25.646439+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T02:07:25.646439+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.646439+0000","objects_scrubbed":11,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:15.202173+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46277,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":600,"num_read_kb":1076,"num_write":448,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:24.632163+0000","last_change":"2024-09-12T02:07:24.632163+0000","last_active":"2024-09-12T02:07:24.632163+0000","last_peered":"2024-09-12T02:07:24.632163+0000","last_clean":"2024-09-12T02:07:24.632163+0000","last_became_active":"2024-09-12T00:10:07.323296+0000","last_became_peered":"2024-09-12T00:10:07.323296+0000","last_unstale":"2024-09-12T02:07:24.632163+0000","last_undegraded":"2024-09-12T02:07:24.632163+0000","last_fullsized":"2024-09-12T02:07:24.632163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:24.631902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:24.631902+0000","last_clean_scrub_stamp":"2024-09-12T02:07:24.631902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:20.809640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"266'148","reported_seq":680,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:26.889233+0000","last_change":"2024-09-12T02:07:26.889233+0000","last_active":"2024-09-12T02:07:26.889233+0000","last_peered":"2024-09-12T02:07:26.889233+0000","last_clean":"2024-09-12T02:07:26.889233+0000","last_became_active":"2024-09-12T00:10:09.361797+0000","last_became_peered":"2024-09-12T00:10:09.361797+0000","last_unstale":"2024-09-12T02:07:26.889233+0000","last_undegraded":"2024-09-12T02:07:26.889233+0000","last_fullsized":"2024-09-12T02:07:26.889233+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'148","last_scrub_stamp":"2024-09-12T02:07:26.889040+0000","last_deep_scrub":"266'148","last_deep_scrub_stamp":"2024-09-12T02:07:26.889040+0000","last_clean_scrub_stamp":"2024-09-12T02:07:26.889040+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:17.414450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":153,"num_write":354,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"266'799","reported_seq":2159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.040881+0000","last_change":"2024-09-12T02:07:06.040735+0000","last_active":"2024-09-12T02:07:06.040881+0000","last_peered":"2024-09-12T02:07:06.040881+0000","last_clean":"2024-09-12T02:07:06.040881+0000","last_became_active":"2024-09-12T00:10:31.165044+0000","last_became_peered":"2024-09-12T00:10:31.165044+0000","last_unstale":"2024-09-12T02:07:06.040881+0000","last_undegraded":"2024-09-12T02:07:06.040881+0000","last_fullsized":"2024-09-12T02:07:06.040881+0000","mapping_epoch":38,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'799","last_scrub_stamp":"2024-09-12T02:07:06.040541+0000","last_deep_scrub":"266'799","last_deep_scrub_stamp":"2024-09-12T02:07:06.040541+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.040541+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:23.943825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3606,"num_read_kb":3182,"num_write":1095,"num_write_kb":436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"266'377","reported_seq":1089,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.666197+0000","last_change":"2024-09-12T02:07:02.666038+0000","last_active":"2024-09-12T02:07:02.666197+0000","last_peered":"2024-09-12T02:07:02.666197+0000","last_clean":"2024-09-12T02:07:02.666197+0000","last_became_active":"2024-09-12T00:09:59.264091+0000","last_became_peered":"2024-09-12T00:09:59.264091+0000","last_unstale":"2024-09-12T02:07:02.666197+0000","last_undegraded":"2024-09-12T02:07:02.666197+0000","last_fullsized":"2024-09-12T02:07:02.666197+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'377","last_scrub_stamp":"2024-09-12T02:07:02.665688+0000","last_deep_scrub":"266'377","last_deep_scrub_stamp":"2024-09-12T02:07:02.665688+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.665688+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:35.183095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":673026,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":647,"num_read_kb":45982,"num_write":1108,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:18.567418+0000","last_change":"2024-09-12T02:07:18.567267+0000","last_active":"2024-09-12T02:07:18.567418+0000","last_peered":"2024-09-12T02:07:18.567418+0000","last_clean":"2024-09-12T02:07:18.567418+0000","last_became_active":"2024-09-12T00:10:03.263712+0000","last_became_peered":"2024-09-12T00:10:03.263712+0000","last_unstale":"2024-09-12T02:07:18.567418+0000","last_undegraded":"2024-09-12T02:07:18.567418+0000","last_fullsized":"2024-09-12T02:07:18.567418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:18.567082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:18.567082+0000","last_clean_scrub_stamp":"2024-09-12T02:07:18.567082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:10.276442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"266'316","reported_seq":943,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:17.557553+0000","last_change":"2024-09-12T02:07:17.557553+0000","last_active":"2024-09-12T02:07:17.557553+0000","last_peered":"2024-09-12T02:07:17.557553+0000","last_clean":"2024-09-12T02:07:17.557553+0000","last_became_active":"2024-09-12T00:10:05.297514+0000","last_became_peered":"2024-09-12T00:10:05.297514+0000","last_unstale":"2024-09-12T02:07:17.557553+0000","last_undegraded":"2024-09-12T02:07:17.557553+0000","last_fullsized":"2024-09-12T02:07:17.557553+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'316","last_scrub_stamp":"2024-09-12T02:07:17.557343+0000","last_deep_scrub":"266'316","last_deep_scrub_stamp":"2024-09-12T02:07:17.557343+0000","last_clean_scrub_stamp":"2024-09-12T02:07:17.557343+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:47.121784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42254,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":1111,"num_write":410,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.078944+0000","last_change":"2024-09-12T02:07:10.078944+0000","last_active":"2024-09-12T02:07:10.078944+0000","last_peered":"2024-09-12T02:07:10.078944+0000","last_clean":"2024-09-12T02:07:10.078944+0000","last_became_active":"2024-09-12T00:10:07.320880+0000","last_became_peered":"2024-09-12T00:10:07.320880+0000","last_unstale":"2024-09-12T02:07:10.078944+0000","last_undegraded":"2024-09-12T02:07:10.078944+0000","last_fullsized":"2024-09-12T02:07:10.078944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:10.078696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:10.078696+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.078696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:20.691685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"266'123","reported_seq":676,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.998611+0000","last_change":"2024-09-12T02:07:28.998611+0000","last_active":"2024-09-12T02:07:28.998611+0000","last_peered":"2024-09-12T02:07:28.998611+0000","last_clean":"2024-09-12T02:07:28.998611+0000","last_became_active":"2024-09-12T00:10:09.433296+0000","last_became_peered":"2024-09-12T00:10:09.433296+0000","last_unstale":"2024-09-12T02:07:28.998611+0000","last_undegraded":"2024-09-12T02:07:28.998611+0000","last_fullsized":"2024-09-12T02:07:28.998611+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'123","last_scrub_stamp":"2024-09-12T02:07:28.998417+0000","last_deep_scrub":"266'123","last_deep_scrub_stamp":"2024-09-12T02:07:28.998417+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.998417+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:29.865905+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1168,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":163,"num_write":292,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"266'599","reported_seq":2334,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:06.896330+0000","last_change":"2024-09-12T02:07:06.896330+0000","last_active":"2024-09-12T02:07:06.896330+0000","last_peered":"2024-09-12T02:07:06.896330+0000","last_clean":"2024-09-12T02:07:06.896330+0000","last_became_active":"2024-09-12T00:10:01.242013+0000","last_became_peered":"2024-09-12T00:10:01.242013+0000","last_unstale":"2024-09-12T02:07:06.896330+0000","last_undegraded":"2024-09-12T02:07:06.896330+0000","last_fullsized":"2024-09-12T02:07:06.896330+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'599","last_scrub_stamp":"2024-09-12T02:07:06.896120+0000","last_deep_scrub":"266'599","last_deep_scrub_stamp":"2024-09-12T02:07:06.896120+0000","last_clean_scrub_stamp":"2024-09-12T02:07:06.896120+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:25.178488+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3158,"num_read_kb":2927,"num_write":761,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"266'355","reported_seq":1039,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:56.836206+0000","last_change":"2024-09-12T02:06:56.836056+0000","last_active":"2024-09-12T02:06:56.836206+0000","last_peered":"2024-09-12T02:06:56.836206+0000","last_clean":"2024-09-12T02:06:56.836206+0000","last_became_active":"2024-09-12T00:09:59.311148+0000","last_became_peered":"2024-09-12T00:09:59.311148+0000","last_unstale":"2024-09-12T02:06:56.836206+0000","last_undegraded":"2024-09-12T02:06:56.836206+0000","last_fullsized":"2024-09-12T02:06:56.836206+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'355","last_scrub_stamp":"2024-09-12T02:06:56.835868+0000","last_deep_scrub":"266'355","last_deep_scrub_stamp":"2024-09-12T02:06:56.835868+0000","last_clean_scrub_stamp":"2024-09-12T02:06:56.835868+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:27.439194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":27101,"num_write":1127,"num_write_kb":32356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:16.016537+0000","last_change":"2024-09-12T02:07:16.016537+0000","last_active":"2024-09-12T02:07:16.016537+0000","last_peered":"2024-09-12T02:07:16.016537+0000","last_clean":"2024-09-12T02:07:16.016537+0000","last_became_active":"2024-09-12T00:10:03.252562+0000","last_became_peered":"2024-09-12T00:10:03.252562+0000","last_unstale":"2024-09-12T02:07:16.016537+0000","last_undegraded":"2024-09-12T02:07:16.016537+0000","last_fullsized":"2024-09-12T02:07:16.016537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:16.016357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:16.016357+0000","last_clean_scrub_stamp":"2024-09-12T02:07:16.016357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:39.102112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"266'278","reported_seq":883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:33.965286+0000","last_change":"2024-09-12T02:07:33.965149+0000","last_active":"2024-09-12T02:07:33.965286+0000","last_peered":"2024-09-12T02:07:33.965286+0000","last_clean":"2024-09-12T02:07:33.965286+0000","last_became_active":"2024-09-12T00:10:05.291758+0000","last_became_peered":"2024-09-12T00:10:05.291758+0000","last_unstale":"2024-09-12T02:07:33.965286+0000","last_undegraded":"2024-09-12T02:07:33.965286+0000","last_fullsized":"2024-09-12T02:07:33.965286+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'278","last_scrub_stamp":"2024-09-12T02:07:33.964974+0000","last_deep_scrub":"266'278","last_deep_scrub_stamp":"2024-09-12T02:07:33.964974+0000","last_clean_scrub_stamp":"2024-09-12T02:07:33.964974+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:02.059751+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47860,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":1100,"num_write":388,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.126840+0000","last_change":"2024-09-12T02:07:25.126678+0000","last_active":"2024-09-12T02:07:25.126840+0000","last_peered":"2024-09-12T02:07:25.126840+0000","last_clean":"2024-09-12T02:07:25.126840+0000","last_became_active":"2024-09-12T00:10:07.320509+0000","last_became_peered":"2024-09-12T00:10:07.320509+0000","last_unstale":"2024-09-12T02:07:25.126840+0000","last_undegraded":"2024-09-12T02:07:25.126840+0000","last_fullsized":"2024-09-12T02:07:25.126840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.126495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.126495+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.126495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:09.265720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"266'174","reported_seq":1673,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:28.868839+0000","last_change":"2024-09-12T02:07:28.868839+0000","last_active":"2024-09-12T02:07:28.868839+0000","last_peered":"2024-09-12T02:07:28.868839+0000","last_clean":"2024-09-12T02:07:28.868839+0000","last_became_active":"2024-09-12T00:10:09.363609+0000","last_became_peered":"2024-09-12T00:10:09.363609+0000","last_unstale":"2024-09-12T02:07:28.868839+0000","last_undegraded":"2024-09-12T02:07:28.868839+0000","last_fullsized":"2024-09-12T02:07:28.868839+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'174","last_scrub_stamp":"2024-09-12T02:07:28.868656+0000","last_deep_scrub":"266'174","last_deep_scrub_stamp":"2024-09-12T02:07:28.868656+0000","last_clean_scrub_stamp":"2024-09-12T02:07:28.868656+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:27.970633+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1201,"num_read_kb":1188,"num_write":377,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"266'769","reported_seq":2302,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.063112+0000","last_change":"2024-09-12T02:07:04.063112+0000","last_active":"2024-09-12T02:07:04.063112+0000","last_peered":"2024-09-12T02:07:04.063112+0000","last_clean":"2024-09-12T02:07:04.063112+0000","last_became_active":"2024-09-12T00:10:01.255086+0000","last_became_peered":"2024-09-12T00:10:01.255086+0000","last_unstale":"2024-09-12T02:07:04.063112+0000","last_undegraded":"2024-09-12T02:07:04.063112+0000","last_fullsized":"2024-09-12T02:07:04.063112+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'769","last_scrub_stamp":"2024-09-12T02:07:04.062933+0000","last_deep_scrub":"266'769","last_deep_scrub_stamp":"2024-09-12T02:07:04.062933+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.062933+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:11.242416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3623,"num_read_kb":3271,"num_write":1000,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"266'318","reported_seq":1027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:55.532324+0000","last_change":"2024-09-12T02:06:55.532324+0000","last_active":"2024-09-12T02:06:55.532324+0000","last_peered":"2024-09-12T02:06:55.532324+0000","last_clean":"2024-09-12T02:06:55.532324+0000","last_became_active":"2024-09-12T00:09:59.293822+0000","last_became_peered":"2024-09-12T00:09:59.293822+0000","last_unstale":"2024-09-12T02:06:55.532324+0000","last_undegraded":"2024-09-12T02:06:55.532324+0000","last_fullsized":"2024-09-12T02:06:55.532324+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'318","last_scrub_stamp":"2024-09-12T02:06:55.532061+0000","last_deep_scrub":"266'318","last_deep_scrub_stamp":"2024-09-12T02:06:55.532061+0000","last_clean_scrub_stamp":"2024-09-12T02:06:55.532061+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:37.599521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":523,"num_read_kb":10999,"num_write":984,"num_write_kb":11811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"266'2","reported_seq":528,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.390356+0000","last_change":"2024-09-12T02:07:08.390356+0000","last_active":"2024-09-12T02:07:08.390356+0000","last_peered":"2024-09-12T02:07:08.390356+0000","last_clean":"2024-09-12T02:07:08.390356+0000","last_became_active":"2024-09-12T00:10:03.272579+0000","last_became_peered":"2024-09-12T00:10:03.272579+0000","last_unstale":"2024-09-12T02:07:08.390356+0000","last_undegraded":"2024-09-12T02:07:08.390356+0000","last_fullsized":"2024-09-12T02:07:08.390356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T02:07:08.390169+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T02:07:08.390169+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.390169+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:30.745777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"266'377","reported_seq":1028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:21.087551+0000","last_change":"2024-09-12T02:07:21.087405+0000","last_active":"2024-09-12T02:07:21.087551+0000","last_peered":"2024-09-12T02:07:21.087551+0000","last_clean":"2024-09-12T02:07:21.087551+0000","last_became_active":"2024-09-12T00:10:05.288230+0000","last_became_peered":"2024-09-12T00:10:05.288230+0000","last_unstale":"2024-09-12T02:07:21.087551+0000","last_undegraded":"2024-09-12T02:07:21.087551+0000","last_fullsized":"2024-09-12T02:07:21.087551+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'377","last_scrub_stamp":"2024-09-12T02:07:21.087191+0000","last_deep_scrub":"266'377","last_deep_scrub_stamp":"2024-09-12T02:07:21.087191+0000","last_clean_scrub_stamp":"2024-09-12T02:07:21.087191+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:47.013440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51419,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":610,"num_read_kb":1309,"num_write":486,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:25.587206+0000","last_change":"2024-09-12T02:07:25.587084+0000","last_active":"2024-09-12T02:07:25.587206+0000","last_peered":"2024-09-12T02:07:25.587206+0000","last_clean":"2024-09-12T02:07:25.587206+0000","last_became_active":"2024-09-12T00:10:07.325726+0000","last_became_peered":"2024-09-12T00:10:07.325726+0000","last_unstale":"2024-09-12T02:07:25.587206+0000","last_undegraded":"2024-09-12T02:07:25.587206+0000","last_fullsized":"2024-09-12T02:07:25.587206+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:25.586903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:25.586903+0000","last_clean_scrub_stamp":"2024-09-12T02:07:25.586903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:59.223671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"266'153","reported_seq":689,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:27.097100+0000","last_change":"2024-09-12T02:07:27.097100+0000","last_active":"2024-09-12T02:07:27.097100+0000","last_peered":"2024-09-12T02:07:27.097100+0000","last_clean":"2024-09-12T02:07:27.097100+0000","last_became_active":"2024-09-12T00:10:09.353036+0000","last_became_peered":"2024-09-12T00:10:09.353036+0000","last_unstale":"2024-09-12T02:07:27.097100+0000","last_undegraded":"2024-09-12T02:07:27.097100+0000","last_fullsized":"2024-09-12T02:07:27.097100+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'153","last_scrub_stamp":"2024-09-12T02:07:27.096879+0000","last_deep_scrub":"266'153","last_deep_scrub_stamp":"2024-09-12T02:07:27.096879+0000","last_clean_scrub_stamp":"2024-09-12T02:07:27.096879+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:36.888055+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":163,"num_write":387,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"266'725","reported_seq":2138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.391036+0000","last_change":"2024-09-12T02:07:10.391036+0000","last_active":"2024-09-12T02:07:10.391036+0000","last_peered":"2024-09-12T02:07:10.391036+0000","last_clean":"2024-09-12T02:07:10.391036+0000","last_became_active":"2024-09-12T00:10:01.263786+0000","last_became_peered":"2024-09-12T00:10:01.263786+0000","last_unstale":"2024-09-12T02:07:10.391036+0000","last_undegraded":"2024-09-12T02:07:10.391036+0000","last_fullsized":"2024-09-12T02:07:10.391036+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'725","last_scrub_stamp":"2024-09-12T02:07:10.390853+0000","last_deep_scrub":"266'725","last_deep_scrub_stamp":"2024-09-12T02:07:10.390853+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.390853+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:24.901710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3380,"num_read_kb":3030,"num_write":963,"num_write_kb":354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"266'351","reported_seq":1024,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.152813+0000","last_change":"2024-09-12T02:06:58.152813+0000","last_active":"2024-09-12T02:06:58.152813+0000","last_peered":"2024-09-12T02:06:58.152813+0000","last_clean":"2024-09-12T02:06:58.152813+0000","last_became_active":"2024-09-12T00:09:59.287488+0000","last_became_peered":"2024-09-12T00:09:59.287488+0000","last_unstale":"2024-09-12T02:06:58.152813+0000","last_undegraded":"2024-09-12T02:06:58.152813+0000","last_fullsized":"2024-09-12T02:06:58.152813+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'351","last_scrub_stamp":"2024-09-12T02:06:58.152595+0000","last_deep_scrub":"266'351","last_deep_scrub_stamp":"2024-09-12T02:06:58.152595+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.152595+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:00.499623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174806,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":42853,"num_write":973,"num_write_kb":24863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"266'458","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:14.419572+0000","last_change":"2024-09-12T02:07:14.419572+0000","last_active":"2024-09-12T02:07:14.419572+0000","last_peered":"2024-09-12T02:07:14.419572+0000","last_clean":"2024-09-12T02:07:14.419572+0000","last_became_active":"2024-09-12T00:10:01.258361+0000","last_became_peered":"2024-09-12T00:10:01.258361+0000","last_unstale":"2024-09-12T02:07:14.419572+0000","last_undegraded":"2024-09-12T02:07:14.419572+0000","last_fullsized":"2024-09-12T02:07:14.419572+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T02:07:14.419394+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T02:07:14.419394+0000","last_clean_scrub_stamp":"2024-09-12T02:07:14.419394+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:23.617226+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2374,"num_read_kb":2204,"num_write":589,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"266'345","reported_seq":1064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.603030+0000","last_change":"2024-09-12T02:06:58.603030+0000","last_active":"2024-09-12T02:06:58.603030+0000","last_peered":"2024-09-12T02:06:58.603030+0000","last_clean":"2024-09-12T02:06:58.603030+0000","last_became_active":"2024-09-12T00:10:31.469140+0000","last_became_peered":"2024-09-12T00:10:31.469140+0000","last_unstale":"2024-09-12T02:06:58.603030+0000","last_undegraded":"2024-09-12T02:06:58.603030+0000","last_fullsized":"2024-09-12T02:06:58.603030+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'345","last_scrub_stamp":"2024-09-12T02:06:58.602735+0000","last_deep_scrub":"266'345","last_deep_scrub_stamp":"2024-09-12T02:06:58.602735+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.602735+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:27.793298+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1314842,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":558,"num_read_kb":38599,"num_write":1106,"num_write_kb":37292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"266'827","reported_seq":2521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:11.622206+0000","last_change":"2024-09-12T02:07:11.622206+0000","last_active":"2024-09-12T02:07:11.622206+0000","last_peered":"2024-09-12T02:07:11.622206+0000","last_clean":"2024-09-12T02:07:11.622206+0000","last_became_active":"2024-09-12T00:10:01.275843+0000","last_became_peered":"2024-09-12T00:10:01.275843+0000","last_unstale":"2024-09-12T02:07:11.622206+0000","last_undegraded":"2024-09-12T02:07:11.622206+0000","last_fullsized":"2024-09-12T02:07:11.622206+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'827","last_scrub_stamp":"2024-09-12T02:07:11.621963+0000","last_deep_scrub":"266'827","last_deep_scrub_stamp":"2024-09-12T02:07:11.621963+0000","last_clean_scrub_stamp":"2024-09-12T02:07:11.621963+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:54.952629+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4035,"num_read_kb":3644,"num_write":1104,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":697,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"266'347","reported_seq":1033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.635699+0000","last_change":"2024-09-12T02:07:01.635699+0000","last_active":"2024-09-12T02:07:01.635699+0000","last_peered":"2024-09-12T02:07:01.635699+0000","last_clean":"2024-09-12T02:07:01.635699+0000","last_became_active":"2024-09-12T00:09:59.309327+0000","last_became_peered":"2024-09-12T00:09:59.309327+0000","last_unstale":"2024-09-12T02:07:01.635699+0000","last_undegraded":"2024-09-12T02:07:01.635699+0000","last_fullsized":"2024-09-12T02:07:01.635699+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'347","last_scrub_stamp":"2024-09-12T02:07:01.635456+0000","last_deep_scrub":"266'347","last_deep_scrub_stamp":"2024-09-12T02:07:01.635456+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.635456+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:44.139239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":532,"num_read_kb":15469,"num_write":1110,"num_write_kb":37224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"266'499","reported_seq":2156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.362179+0000","last_change":"2024-09-12T02:07:03.362000+0000","last_active":"2024-09-12T02:07:03.362179+0000","last_peered":"2024-09-12T02:07:03.362179+0000","last_clean":"2024-09-12T02:07:03.362179+0000","last_became_active":"2024-09-12T00:10:01.261418+0000","last_became_peered":"2024-09-12T00:10:01.261418+0000","last_unstale":"2024-09-12T02:07:03.362179+0000","last_undegraded":"2024-09-12T02:07:03.362179+0000","last_fullsized":"2024-09-12T02:07:03.362179+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T02:07:03.361825+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T02:07:03.361825+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.361825+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:03.935407+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2751,"num_read_kb":2561,"num_write":595,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2295,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"266'353","reported_seq":1122,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:58.570841+0000","last_change":"2024-09-12T02:06:58.570841+0000","last_active":"2024-09-12T02:06:58.570841+0000","last_peered":"2024-09-12T02:06:58.570841+0000","last_clean":"2024-09-12T02:06:58.570841+0000","last_became_active":"2024-09-12T00:09:59.286590+0000","last_became_peered":"2024-09-12T00:09:59.286590+0000","last_unstale":"2024-09-12T02:06:58.570841+0000","last_undegraded":"2024-09-12T02:06:58.570841+0000","last_fullsized":"2024-09-12T02:06:58.570841+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'353","last_scrub_stamp":"2024-09-12T02:06:58.570616+0000","last_deep_scrub":"266'353","last_deep_scrub_stamp":"2024-09-12T02:06:58.570616+0000","last_clean_scrub_stamp":"2024-09-12T02:06:58.570616+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:48.488449+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904210,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":714,"num_read_kb":40012,"num_write":1077,"num_write_kb":35054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"266'1464","reported_seq":3093,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.937516+0000","last_change":"2024-09-12T02:07:07.937516+0000","last_active":"2024-09-12T02:07:07.937516+0000","last_peered":"2024-09-12T02:07:07.937516+0000","last_clean":"2024-09-12T02:07:07.937516+0000","last_became_active":"2024-09-12T00:10:01.261999+0000","last_became_peered":"2024-09-12T00:10:01.261999+0000","last_unstale":"2024-09-12T02:07:07.937516+0000","last_undegraded":"2024-09-12T02:07:07.937516+0000","last_fullsized":"2024-09-12T02:07:07.937516+0000","mapping_epoch":27,"log_start":"266'1400","ondisk_log_start":"266'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1464","last_scrub_stamp":"2024-09-12T02:07:07.937335+0000","last_deep_scrub":"266'1464","last_deep_scrub_stamp":"2024-09-12T02:07:07.937335+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.937335+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":1400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:48.762109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6652,"num_read_kb":5741,"num_write":2141,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"266'381","reported_seq":1133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.879266+0000","last_change":"2024-09-12T02:06:59.879266+0000","last_active":"2024-09-12T02:06:59.879266+0000","last_peered":"2024-09-12T02:06:59.879266+0000","last_clean":"2024-09-12T02:06:59.879266+0000","last_became_active":"2024-09-12T00:09:59.286301+0000","last_became_peered":"2024-09-12T00:09:59.286301+0000","last_unstale":"2024-09-12T02:06:59.879266+0000","last_undegraded":"2024-09-12T02:06:59.879266+0000","last_fullsized":"2024-09-12T02:06:59.879266+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'381","last_scrub_stamp":"2024-09-12T02:06:59.879029+0000","last_deep_scrub":"266'381","last_deep_scrub_stamp":"2024-09-12T02:06:59.879029+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.879029+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:40.618134+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":778,"num_read_kb":8721,"num_write":1199,"num_write_kb":26143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"266'392","reported_seq":1870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.077047+0000","last_change":"2024-09-12T02:07:07.077047+0000","last_active":"2024-09-12T02:07:07.077047+0000","last_peered":"2024-09-12T02:07:07.077047+0000","last_clean":"2024-09-12T02:07:07.077047+0000","last_became_active":"2024-09-12T00:10:01.266927+0000","last_became_peered":"2024-09-12T00:10:01.266927+0000","last_unstale":"2024-09-12T02:07:07.077047+0000","last_undegraded":"2024-09-12T02:07:07.077047+0000","last_fullsized":"2024-09-12T02:07:07.077047+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T02:07:07.076807+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T02:07:07.076807+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.076807+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:03.913347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2147,"num_read_kb":2014,"num_write":451,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"266'355","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:05.339949+0000","last_change":"2024-09-12T02:07:05.339949+0000","last_active":"2024-09-12T02:07:05.339949+0000","last_peered":"2024-09-12T02:07:05.339949+0000","last_clean":"2024-09-12T02:07:05.339949+0000","last_became_active":"2024-09-12T00:09:59.251413+0000","last_became_peered":"2024-09-12T00:09:59.251413+0000","last_unstale":"2024-09-12T02:07:05.339949+0000","last_undegraded":"2024-09-12T02:07:05.339949+0000","last_fullsized":"2024-09-12T02:07:05.339949+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'355","last_scrub_stamp":"2024-09-12T02:07:05.339718+0000","last_deep_scrub":"266'355","last_deep_scrub_stamp":"2024-09-12T02:07:05.339718+0000","last_clean_scrub_stamp":"2024-09-12T02:07:05.339718+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:18.042053+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":573,"num_read_kb":23722,"num_write":1195,"num_write_kb":25792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"266'450","reported_seq":2132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.930253+0000","last_change":"2024-09-12T02:07:08.930253+0000","last_active":"2024-09-12T02:07:08.930253+0000","last_peered":"2024-09-12T02:07:08.930253+0000","last_clean":"2024-09-12T02:07:08.930253+0000","last_became_active":"2024-09-12T00:10:01.259942+0000","last_became_peered":"2024-09-12T00:10:01.259942+0000","last_unstale":"2024-09-12T02:07:08.930253+0000","last_undegraded":"2024-09-12T02:07:08.930253+0000","last_fullsized":"2024-09-12T02:07:08.930253+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'450","last_scrub_stamp":"2024-09-12T02:07:08.930001+0000","last_deep_scrub":"266'450","last_deep_scrub_stamp":"2024-09-12T02:07:08.930001+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.930001+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:29.281113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2415,"num_read_kb":2305,"num_write":502,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"266'339","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.102179+0000","last_change":"2024-09-12T02:07:00.102179+0000","last_active":"2024-09-12T02:07:00.102179+0000","last_peered":"2024-09-12T02:07:00.102179+0000","last_clean":"2024-09-12T02:07:00.102179+0000","last_became_active":"2024-09-12T00:09:59.298085+0000","last_became_peered":"2024-09-12T00:09:59.298085+0000","last_unstale":"2024-09-12T02:07:00.102179+0000","last_undegraded":"2024-09-12T02:07:00.102179+0000","last_fullsized":"2024-09-12T02:07:00.102179+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'339","last_scrub_stamp":"2024-09-12T02:07:00.101803+0000","last_deep_scrub":"266'339","last_deep_scrub_stamp":"2024-09-12T02:07:00.101803+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.101803+0000","objects_scrubbed":6,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:33.009729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136867,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":58646,"num_write":1165,"num_write_kb":29645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"266'501","reported_seq":2216,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.040683+0000","last_change":"2024-09-12T02:07:03.040683+0000","last_active":"2024-09-12T02:07:03.040683+0000","last_peered":"2024-09-12T02:07:03.040683+0000","last_clean":"2024-09-12T02:07:03.040683+0000","last_became_active":"2024-09-12T00:10:01.255302+0000","last_became_peered":"2024-09-12T00:10:01.255302+0000","last_unstale":"2024-09-12T02:07:03.040683+0000","last_undegraded":"2024-09-12T02:07:03.040683+0000","last_fullsized":"2024-09-12T02:07:03.040683+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'501","last_scrub_stamp":"2024-09-12T02:07:03.040505+0000","last_deep_scrub":"266'501","last_deep_scrub_stamp":"2024-09-12T02:07:03.040505+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.040505+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:52.725447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2619,"num_write":619,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"266'347","reported_seq":1083,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:01.927866+0000","last_change":"2024-09-12T02:07:01.927866+0000","last_active":"2024-09-12T02:07:01.927866+0000","last_peered":"2024-09-12T02:07:01.927866+0000","last_clean":"2024-09-12T02:07:01.927866+0000","last_became_active":"2024-09-12T00:09:59.286393+0000","last_became_peered":"2024-09-12T00:09:59.286393+0000","last_unstale":"2024-09-12T02:07:01.927866+0000","last_undegraded":"2024-09-12T02:07:01.927866+0000","last_fullsized":"2024-09-12T02:07:01.927866+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'347","last_scrub_stamp":"2024-09-12T02:07:01.927667+0000","last_deep_scrub":"266'347","last_deep_scrub_stamp":"2024-09-12T02:07:01.927667+0000","last_clean_scrub_stamp":"2024-09-12T02:07:01.927667+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:21.933493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33187,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":621,"num_read_kb":4608,"num_write":1166,"num_write_kb":13882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"266'600","reported_seq":2564,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.495857+0000","last_change":"2024-09-12T02:07:07.495857+0000","last_active":"2024-09-12T02:07:07.495857+0000","last_peered":"2024-09-12T02:07:07.495857+0000","last_clean":"2024-09-12T02:07:07.495857+0000","last_became_active":"2024-09-12T00:10:01.247691+0000","last_became_peered":"2024-09-12T00:10:01.247691+0000","last_unstale":"2024-09-12T02:07:07.495857+0000","last_undegraded":"2024-09-12T02:07:07.495857+0000","last_fullsized":"2024-09-12T02:07:07.495857+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'600","last_scrub_stamp":"2024-09-12T02:07:07.495627+0000","last_deep_scrub":"266'600","last_deep_scrub_stamp":"2024-09-12T02:07:07.495627+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.495627+0000","objects_scrubbed":5,"log_size":100,"log_dups_size":500,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:17.862827+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3679,"num_read_kb":3455,"num_write":725,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4760,"num_omap_keys":19,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"266'359","reported_seq":1028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:00.622685+0000","last_change":"2024-09-12T02:07:00.622538+0000","last_active":"2024-09-12T02:07:00.622685+0000","last_peered":"2024-09-12T02:07:00.622685+0000","last_clean":"2024-09-12T02:07:00.622685+0000","last_became_active":"2024-09-12T00:09:59.300760+0000","last_became_peered":"2024-09-12T00:09:59.300760+0000","last_unstale":"2024-09-12T02:07:00.622685+0000","last_undegraded":"2024-09-12T02:07:00.622685+0000","last_fullsized":"2024-09-12T02:07:00.622685+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'359","last_scrub_stamp":"2024-09-12T02:07:00.622302+0000","last_deep_scrub":"266'359","last_deep_scrub_stamp":"2024-09-12T02:07:00.622302+0000","last_clean_scrub_stamp":"2024-09-12T02:07:00.622302+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:23.067734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436849,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":26981,"num_write":1171,"num_write_kb":52645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"266'958","reported_seq":2617,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.103295+0000","last_change":"2024-09-12T02:07:09.103295+0000","last_active":"2024-09-12T02:07:09.103295+0000","last_peered":"2024-09-12T02:07:09.103295+0000","last_clean":"2024-09-12T02:07:09.103295+0000","last_became_active":"2024-09-12T00:10:01.238674+0000","last_became_peered":"2024-09-12T00:10:01.238674+0000","last_unstale":"2024-09-12T02:07:09.103295+0000","last_undegraded":"2024-09-12T02:07:09.103295+0000","last_fullsized":"2024-09-12T02:07:09.103295+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'958","last_scrub_stamp":"2024-09-12T02:07:09.103056+0000","last_deep_scrub":"266'958","last_deep_scrub_stamp":"2024-09-12T02:07:09.103056+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.103056+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":900,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:04.336294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4713,"num_read_kb":4229,"num_write":1343,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"266'291","reported_seq":952,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.962261+0000","last_change":"2024-09-12T02:07:02.962261+0000","last_active":"2024-09-12T02:07:02.962261+0000","last_peered":"2024-09-12T02:07:02.962261+0000","last_clean":"2024-09-12T02:07:02.962261+0000","last_became_active":"2024-09-12T00:09:59.288260+0000","last_became_peered":"2024-09-12T00:09:59.288260+0000","last_unstale":"2024-09-12T02:07:02.962261+0000","last_undegraded":"2024-09-12T02:07:02.962261+0000","last_fullsized":"2024-09-12T02:07:02.962261+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'291","last_scrub_stamp":"2024-09-12T02:07:02.961949+0000","last_deep_scrub":"266'291","last_deep_scrub_stamp":"2024-09-12T02:07:02.961949+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.961949+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:11.825052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":437,"num_read_kb":7701,"num_write":890,"num_write_kb":23188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"266'343","reported_seq":1900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.665257+0000","last_change":"2024-09-12T02:07:04.665101+0000","last_active":"2024-09-12T02:07:04.665257+0000","last_peered":"2024-09-12T02:07:04.665257+0000","last_clean":"2024-09-12T02:07:04.665257+0000","last_became_active":"2024-09-12T00:10:01.265676+0000","last_became_peered":"2024-09-12T00:10:01.265676+0000","last_unstale":"2024-09-12T02:07:04.665257+0000","last_undegraded":"2024-09-12T02:07:04.665257+0000","last_fullsized":"2024-09-12T02:07:04.665257+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'343","last_scrub_stamp":"2024-09-12T02:07:04.664920+0000","last_deep_scrub":"266'343","last_deep_scrub_stamp":"2024-09-12T02:07:04.664920+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.664920+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:06.623311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1939,"num_read_kb":1902,"num_write":362,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"266'308","reported_seq":975,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:03.656753+0000","last_change":"2024-09-12T02:07:03.656753+0000","last_active":"2024-09-12T02:07:03.656753+0000","last_peered":"2024-09-12T02:07:03.656753+0000","last_clean":"2024-09-12T02:07:03.656753+0000","last_became_active":"2024-09-12T00:09:59.311132+0000","last_became_peered":"2024-09-12T00:09:59.311132+0000","last_unstale":"2024-09-12T02:07:03.656753+0000","last_undegraded":"2024-09-12T02:07:03.656753+0000","last_fullsized":"2024-09-12T02:07:03.656753+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'308","last_scrub_stamp":"2024-09-12T02:07:03.656539+0000","last_deep_scrub":"266'308","last_deep_scrub_stamp":"2024-09-12T02:07:03.656539+0000","last_clean_scrub_stamp":"2024-09-12T02:07:03.656539+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:24.830436+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190249,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":489,"num_read_kb":37892,"num_write":1016,"num_write_kb":21146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"266'932","reported_seq":2559,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.117490+0000","last_change":"2024-09-12T02:07:08.117490+0000","last_active":"2024-09-12T02:07:08.117490+0000","last_peered":"2024-09-12T02:07:08.117490+0000","last_clean":"2024-09-12T02:07:08.117490+0000","last_became_active":"2024-09-12T00:10:01.255682+0000","last_became_peered":"2024-09-12T00:10:01.255682+0000","last_unstale":"2024-09-12T02:07:08.117490+0000","last_undegraded":"2024-09-12T02:07:08.117490+0000","last_fullsized":"2024-09-12T02:07:08.117490+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'932","last_scrub_stamp":"2024-09-12T02:07:08.117306+0000","last_deep_scrub":"266'932","last_deep_scrub_stamp":"2024-09-12T02:07:08.117306+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.117306+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":900,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:01.030752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4312,"num_read_kb":3831,"num_write":1239,"num_write_kb":465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"266'335","reported_seq":1027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.528788+0000","last_change":"2024-09-12T02:06:59.528788+0000","last_active":"2024-09-12T02:06:59.528788+0000","last_peered":"2024-09-12T02:06:59.528788+0000","last_clean":"2024-09-12T02:06:59.528788+0000","last_became_active":"2024-09-12T00:09:59.300699+0000","last_became_peered":"2024-09-12T00:09:59.300699+0000","last_unstale":"2024-09-12T02:06:59.528788+0000","last_undegraded":"2024-09-12T02:06:59.528788+0000","last_fullsized":"2024-09-12T02:06:59.528788+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'335","last_scrub_stamp":"2024-09-12T02:06:59.528507+0000","last_deep_scrub":"266'335","last_deep_scrub_stamp":"2024-09-12T02:06:59.528507+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.528507+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:11.541603+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1315873,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":7533,"num_write":1090,"num_write_kb":30542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"266'859","reported_seq":2546,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.819973+0000","last_change":"2024-09-12T02:07:08.819973+0000","last_active":"2024-09-12T02:07:08.819973+0000","last_peered":"2024-09-12T02:07:08.819973+0000","last_clean":"2024-09-12T02:07:08.819973+0000","last_became_active":"2024-09-12T00:10:01.264795+0000","last_became_peered":"2024-09-12T00:10:01.264795+0000","last_unstale":"2024-09-12T02:07:08.819973+0000","last_undegraded":"2024-09-12T02:07:08.819973+0000","last_fullsized":"2024-09-12T02:07:08.819973+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'859","last_scrub_stamp":"2024-09-12T02:07:08.819764+0000","last_deep_scrub":"266'859","last_deep_scrub_stamp":"2024-09-12T02:07:08.819764+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.819764+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:26.975796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4163,"num_read_kb":3745,"num_write":1135,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"266'384","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:59.144719+0000","last_change":"2024-09-12T02:06:59.144719+0000","last_active":"2024-09-12T02:06:59.144719+0000","last_peered":"2024-09-12T02:06:59.144719+0000","last_clean":"2024-09-12T02:06:59.144719+0000","last_became_active":"2024-09-12T00:09:59.299516+0000","last_became_peered":"2024-09-12T00:09:59.299516+0000","last_unstale":"2024-09-12T02:06:59.144719+0000","last_undegraded":"2024-09-12T02:06:59.144719+0000","last_fullsized":"2024-09-12T02:06:59.144719+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'384","last_scrub_stamp":"2024-09-12T02:06:59.144457+0000","last_deep_scrub":"266'384","last_deep_scrub_stamp":"2024-09-12T02:06:59.144457+0000","last_clean_scrub_stamp":"2024-09-12T02:06:59.144457+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:38.499358+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":559,"num_read_kb":14945,"num_write":1232,"num_write_kb":37052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"266'500","reported_seq":2143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:08.526816+0000","last_change":"2024-09-12T02:07:08.526816+0000","last_active":"2024-09-12T02:07:08.526816+0000","last_peered":"2024-09-12T02:07:08.526816+0000","last_clean":"2024-09-12T02:07:08.526816+0000","last_became_active":"2024-09-12T00:10:01.258691+0000","last_became_peered":"2024-09-12T00:10:01.258691+0000","last_unstale":"2024-09-12T02:07:08.526816+0000","last_undegraded":"2024-09-12T02:07:08.526816+0000","last_fullsized":"2024-09-12T02:07:08.526816+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'500","last_scrub_stamp":"2024-09-12T02:07:08.526620+0000","last_deep_scrub":"266'500","last_deep_scrub_stamp":"2024-09-12T02:07:08.526620+0000","last_clean_scrub_stamp":"2024-09-12T02:07:08.526620+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:10.056735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2775,"num_read_kb":2593,"num_write":624,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"266'376","reported_seq":1046,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.800705+0000","last_change":"2024-09-12T02:07:02.800570+0000","last_active":"2024-09-12T02:07:02.800705+0000","last_peered":"2024-09-12T02:07:02.800705+0000","last_clean":"2024-09-12T02:07:02.800705+0000","last_became_active":"2024-09-12T00:09:59.313345+0000","last_became_peered":"2024-09-12T00:09:59.313345+0000","last_unstale":"2024-09-12T02:07:02.800705+0000","last_undegraded":"2024-09-12T02:07:02.800705+0000","last_fullsized":"2024-09-12T02:07:02.800705+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'376","last_scrub_stamp":"2024-09-12T02:07:02.800345+0000","last_deep_scrub":"266'376","last_deep_scrub_stamp":"2024-09-12T02:07:02.800345+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.800345+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:51.023798+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4483063,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":14481,"num_write":1098,"num_write_kb":25771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"266'326","reported_seq":1756,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:10.927377+0000","last_change":"2024-09-12T02:07:10.927377+0000","last_active":"2024-09-12T02:07:10.927377+0000","last_peered":"2024-09-12T02:07:10.927377+0000","last_clean":"2024-09-12T02:07:10.927377+0000","last_became_active":"2024-09-12T00:10:01.249832+0000","last_became_peered":"2024-09-12T00:10:01.249832+0000","last_unstale":"2024-09-12T02:07:10.927377+0000","last_undegraded":"2024-09-12T02:07:10.927377+0000","last_fullsized":"2024-09-12T02:07:10.927377+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'326","last_scrub_stamp":"2024-09-12T02:07:10.927188+0000","last_deep_scrub":"266'326","last_deep_scrub_stamp":"2024-09-12T02:07:10.927188+0000","last_clean_scrub_stamp":"2024-09-12T02:07:10.927188+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:40.299799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1802,"num_read_kb":1736,"num_write":351,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"266'317","reported_seq":1023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:06:54.657601+0000","last_change":"2024-09-12T02:06:54.657601+0000","last_active":"2024-09-12T02:06:54.657601+0000","last_peered":"2024-09-12T02:06:54.657601+0000","last_clean":"2024-09-12T02:06:54.657601+0000","last_became_active":"2024-09-12T00:09:59.311158+0000","last_became_peered":"2024-09-12T00:09:59.311158+0000","last_unstale":"2024-09-12T02:06:54.657601+0000","last_undegraded":"2024-09-12T02:06:54.657601+0000","last_fullsized":"2024-09-12T02:06:54.657601+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'317","last_scrub_stamp":"2024-09-12T02:06:54.657499+0000","last_deep_scrub":"266'317","last_deep_scrub_stamp":"2024-09-12T02:06:54.657499+0000","last_clean_scrub_stamp":"2024-09-12T02:06:54.657499+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:41.120241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316829,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":115277,"num_write":995,"num_write_kb":39549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"266'721","reported_seq":2272,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.820571+0000","last_change":"2024-09-12T02:07:07.820396+0000","last_active":"2024-09-12T02:07:07.820571+0000","last_peered":"2024-09-12T02:07:07.820571+0000","last_clean":"2024-09-12T02:07:07.820571+0000","last_became_active":"2024-09-12T00:10:01.267027+0000","last_became_peered":"2024-09-12T00:10:01.267027+0000","last_unstale":"2024-09-12T02:07:07.820571+0000","last_undegraded":"2024-09-12T02:07:07.820571+0000","last_fullsized":"2024-09-12T02:07:07.820571+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'721","last_scrub_stamp":"2024-09-12T02:07:07.820152+0000","last_deep_scrub":"266'721","last_deep_scrub_stamp":"2024-09-12T02:07:07.820152+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.820152+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:54.864599+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3526,"num_read_kb":3200,"num_write":1050,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"266'331","reported_seq":1002,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:04.617366+0000","last_change":"2024-09-12T02:07:04.617366+0000","last_active":"2024-09-12T02:07:04.617366+0000","last_peered":"2024-09-12T02:07:04.617366+0000","last_clean":"2024-09-12T02:07:04.617366+0000","last_became_active":"2024-09-12T00:09:59.285907+0000","last_became_peered":"2024-09-12T00:09:59.285907+0000","last_unstale":"2024-09-12T02:07:04.617366+0000","last_undegraded":"2024-09-12T02:07:04.617366+0000","last_fullsized":"2024-09-12T02:07:04.617366+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'331","last_scrub_stamp":"2024-09-12T02:07:04.617081+0000","last_deep_scrub":"266'331","last_deep_scrub_stamp":"2024-09-12T02:07:04.617081+0000","last_clean_scrub_stamp":"2024-09-12T02:07:04.617081+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:36.016645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569458,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":44645,"num_write":951,"num_write_kb":42281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"266'334","reported_seq":1017,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:07.598905+0000","last_change":"2024-09-12T02:07:07.598905+0000","last_active":"2024-09-12T02:07:07.598905+0000","last_peered":"2024-09-12T02:07:07.598905+0000","last_clean":"2024-09-12T02:07:07.598905+0000","last_became_active":"2024-09-12T00:09:59.282446+0000","last_became_peered":"2024-09-12T00:09:59.282446+0000","last_unstale":"2024-09-12T02:07:07.598905+0000","last_undegraded":"2024-09-12T02:07:07.598905+0000","last_fullsized":"2024-09-12T02:07:07.598905+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'334","last_scrub_stamp":"2024-09-12T02:07:07.598535+0000","last_deep_scrub":"266'334","last_deep_scrub_stamp":"2024-09-12T02:07:07.598535+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.598535+0000","objects_scrubbed":10,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:11.077428+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2535841,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":492,"num_read_kb":44688,"num_write":1069,"num_write_kb":33304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"266'458","reported_seq":2039,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:09.548533+0000","last_change":"2024-09-12T02:07:09.548533+0000","last_active":"2024-09-12T02:07:09.548533+0000","last_peered":"2024-09-12T02:07:09.548533+0000","last_clean":"2024-09-12T02:07:09.548533+0000","last_became_active":"2024-09-12T00:10:01.247767+0000","last_became_peered":"2024-09-12T00:10:01.247767+0000","last_unstale":"2024-09-12T02:07:09.548533+0000","last_undegraded":"2024-09-12T02:07:09.548533+0000","last_fullsized":"2024-09-12T02:07:09.548533+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T02:07:09.548332+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T02:07:09.548332+0000","last_clean_scrub_stamp":"2024-09-12T02:07:09.548332+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:46.662531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2488,"num_read_kb":2350,"num_write":536,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"266'350","reported_seq":1065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:02.349649+0000","last_change":"2024-09-12T02:07:02.349649+0000","last_active":"2024-09-12T02:07:02.349649+0000","last_peered":"2024-09-12T02:07:02.349649+0000","last_clean":"2024-09-12T02:07:02.349649+0000","last_became_active":"2024-09-12T00:10:31.168444+0000","last_became_peered":"2024-09-12T00:10:31.168444+0000","last_unstale":"2024-09-12T02:07:02.349649+0000","last_undegraded":"2024-09-12T02:07:02.349649+0000","last_fullsized":"2024-09-12T02:07:02.349649+0000","mapping_epoch":38,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'350","last_scrub_stamp":"2024-09-12T02:07:02.349335+0000","last_deep_scrub":"266'350","last_deep_scrub_stamp":"2024-09-12T02:07:02.349335+0000","last_clean_scrub_stamp":"2024-09-12T02:07:02.349335+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:22.134489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400029,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":596,"num_read_kb":20125,"num_write":1291,"num_write_kb":40521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,0],"acting":[1,4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"266'1090","reported_seq":2780,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T02:07:12.583557+0000","last_change":"2024-09-12T02:07:12.583557+0000","last_active":"2024-09-12T02:07:12.583557+0000","last_peered":"2024-09-12T02:07:12.583557+0000","last_clean":"2024-09-12T02:07:12.583557+0000","last_became_active":"2024-09-12T00:10:01.278762+0000","last_became_peered":"2024-09-12T00:10:01.278762+0000","last_unstale":"2024-09-12T02:07:12.583557+0000","last_undegraded":"2024-09-12T02:07:12.583557+0000","last_fullsized":"2024-09-12T02:07:12.583557+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1090","last_scrub_stamp":"2024-09-12T02:07:12.583390+0000","last_deep_scrub":"266'1090","last_deep_scrub_stamp":"2024-09-12T02:07:12.583390+0000","last_clean_scrub_stamp":"2024-09-12T02:07:12.583390+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":1000,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:04.451087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5202,"num_read_kb":4573,"num_write":1592,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6060,"num_read_kb":4225,"num_write":1955,"num_write_kb":852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6200,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1028,"ondisk_log_size":1028,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16119,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":15149,"num_read_kb":14793,"num_write":16764,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2870,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":32238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1972,"ondisk_log_size":1972,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440,"ondisk_log_size":440,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1579968,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":21268,"num_read_kb":40714,"num_write":17731,"num_write_kb":12514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":677416,"num_omap_keys":1576,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1913,"ondisk_log_size":1913,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":165,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":165,"num_whiteouts":0,"num_read":213079,"num_read_kb":194397,"num_write":55367,"num_write_kb":18884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":165,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43514,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3932,"ondisk_log_size":3932,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":73602788,"num_objects":381,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":381,"num_whiteouts":0,"num_read":36353,"num_read_kb":1955827,"num_write":72080,"num_write_kb":2110952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":100646912,"data_stored":100646912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3518,"ondisk_log_size":3518,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":180842,"num_write":186,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":169574,"num_write":186,"num_write_kb":127576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543572,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341692,"kb_used_data":17580,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":94030148,"statfs":{"total":96636764160,"available":96286871552,"internally_reserved":0,"allocated":18001920,"data_stored":15991149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":331872714},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543572,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306672,"kb_used_data":18656,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94065168,"statfs":{"total":96636764160,"available":96322732032,"internally_reserved":0,"allocated":19103744,"data_stored":17151124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294910406},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543578,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":191148,"kb_used_data":15644,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94180692,"statfs":{"total":96636764160,"available":96441028608,"internally_reserved":0,"allocated":16019456,"data_stored":13989543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543573,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162872,"kb_used_data":15080,"kb_used_omap":1,"kb_used_meta":147774,"kb_avail":94208968,"statfs":{"total":96636764160,"available":96469983232,"internally_reserved":0,"allocated":15441920,"data_stored":13515589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151321029},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543575,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308428,"kb_used_data":20412,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94063412,"statfs":{"total":96636764160,"available":96320933888,"internally_reserved":0,"allocated":20901888,"data_stored":18895025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":294910407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543573,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117028,"kb_used_data":13652,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94254812,"statfs":{"total":96636764160,"available":96516927488,"internally_reserved":0,"allocated":13979648,"data_stored":12036246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543575,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195036,"kb_used_data":11212,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94176804,"statfs":{"total":96636764160,"available":96437047296,"internally_reserved":0,"allocated":11481088,"data_stored":9500646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543574,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308548,"kb_used_data":20596,"kb_used_omap":1,"kb_used_meta":287934,"kb_avail":94063292,"statfs":{"total":96636764160,"available":96320811008,"internally_reserved":0,"allocated":21090304,"data_stored":19083000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294844869},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16199680,"data_stored":16199680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7208960,"data_stored":7208960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9744384,"data_stored":9744384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16601088,"data_stored":16601088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11227136,"data_stored":11227136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11698176,"data_stored":11698176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14860288,"data_stored":14860288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13107200,"data_stored":13107200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":5646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:08:17.124 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T02:08:17.481 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T02:08:17.481 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T02:08:17.482 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T02:08:17.482 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:19.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T02:08:23.584 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T02:08:23.585 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T02:08:23.585 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:23.675 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T02:08:23.675 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T02:08:23.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:25.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T02:08:25.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T02:08:29.778 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T02:08:29.778 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T02:08:29.778 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:29.854 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T02:08:29.854 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T02:08:29.854 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:31.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-12T02:08:31.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T02:08:35.955 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T02:08:35.956 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T02:08:35.956 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:37.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T02:08:37.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-12T02:08:42.057 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T02:08:42.058 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T02:08:42.058 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:42.150 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T02:08:42.151 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T02:08:42.151 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:42.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~6s 2024-09-12T02:08:48.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-12T02:08:48.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T02:08:48.253 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T02:08:48.253 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T02:08:48.254 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T02:08:48.254 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:48.282 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T02:08:48.282 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T02:08:48.282 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:48.314 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T02:08:48.314 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T02:08:48.314 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T02:08:48.314 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:48.348 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T02:08:48.348 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T02:08:48.348 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:48.416 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T02:08:48.417 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T02:08:48.417 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:08:48.440 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T02:08:48.440 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T02:08:48.440 DEBUG:teuthology.orchestra.run.smithi102:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T02:08:48.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T02:08:48.477 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T02:08:48.924 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T02:08:48.924 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T02:08:49.149 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T02:08:49.149 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T02:08:49.352 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T02:08:49.352 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T02:08:49.535 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T02:08:49.535 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T02:08:49.991 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T02:08:49.991 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T02:08:50.179 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T02:08:50.179 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T02:08:50.352 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T02:08:50.352 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T02:08:50.526 INFO:tasks.ceph:Archiving mon data... 2024-09-12T02:08:50.527 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828/data/mon.a.tgz 2024-09-12T02:08:50.527 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-12T02:08:50.533 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.QlJegyVSfq 2024-09-12T02:08:50.534 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QlJegyVSfq 2024-09-12T02:08:50.708 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.QlJegyVSfq 2024-09-12T02:08:50.769 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.QlJegyVSfq is 549KB 2024-09-12T02:08:50.830 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.QlJegyVSfq 2024-09-12T02:08:50.836 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828/data/mon.c.tgz 2024-09-12T02:08:50.836 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-12T02:08:50.886 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.lX8tKuwWOP 2024-09-12T02:08:50.886 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lX8tKuwWOP 2024-09-12T02:08:51.072 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.lX8tKuwWOP 2024-09-12T02:08:51.136 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.lX8tKuwWOP is 574KB 2024-09-12T02:08:51.198 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.lX8tKuwWOP 2024-09-12T02:08:51.204 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828/data/mon.b.tgz 2024-09-12T02:08:51.204 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-09-12T02:08:51.210 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.VxNvIsx8iU 2024-09-12T02:08:51.210 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VxNvIsx8iU 2024-09-12T02:08:51.393 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.VxNvIsx8iU 2024-09-12T02:08:51.454 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.VxNvIsx8iU is 574KB 2024-09-12T02:08:51.517 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.VxNvIsx8iU 2024-09-12T02:08:51.521 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T02:08:51.522 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:08:51.524 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T02:08:51.639 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:08:51.645 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T02:08:51.645 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T02:08:51.646 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828/remote/smithi102/crash 2024-09-12T02:08:51.647 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:08:51.661 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828/remote/smithi121/crash 2024-09-12T02:08:51.662 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T02:08:51.703 INFO:tasks.ceph:Compressing logs... 2024-09-12T02:08:51.703 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:08:51.709 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:08:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139525.log 2024-09-12T02:08:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156658.log 2024-09-12T02:08:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.139525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54376.log 2024-09-12T02:08:51.730 INFO:teuthology.orchestra.run.smithi102.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.139525.log.gz 2024-09-12T02:08:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.156658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45425.log 2024-09-12T02:08:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54376.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.156658.log.gz 2024-09-12T02:08:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104121.log 2024-09-12T02:08:51.731 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.54376.log.gz 2024-09-12T02:08:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45425.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T02:08:51.731 INFO:teuthology.orchestra.run.smithi102.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.45425.log.gz 2024-09-12T02:08:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82291.log 2024-09-12T02:08:51.736 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.104121.log: /var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91141.log 2024-09-12T02:08:51.736 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.82291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66380.log 2024-09-12T02:08:51.736 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104121.log.gz 2024-09-12T02:08:51.736 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.91141.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.82291.log.gz 2024-09-12T02:08:51.736 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147195.log 2024-09-12T02:08:51.736 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91141.log.gz 2024-09-12T02:08:51.736 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.66380.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.66380.log.gz 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57348.log 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.147195.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159093.log 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.147195.log.gz 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57348.log.gz 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56850.log 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.159093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46630.log 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159093.log.gz 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178031.log 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr: 60.9% -- replaced with /var/log/ceph/ceph-client.admin.56850.log.gz 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115331.log 2024-09-12T02:08:51.737 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46630.log.gz 2024-09-12T02:08:51.741 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.178031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65081.log 2024-09-12T02:08:51.742 INFO:teuthology.orchestra.run.smithi102.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.178031.log.gz 2024-09-12T02:08:51.742 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.115331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76980.log 2024-09-12T02:08:51.742 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.115331.log.gz 2024-09-12T02:08:51.742 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.65081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112381.log 2024-09-12T02:08:51.742 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.76980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151326.log 2024-09-12T02:08:51.742 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.76980.log.gz 2024-09-12T02:08:51.742 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.112381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185162.log 2024-09-12T02:08:51.742 INFO:teuthology.orchestra.run.smithi102.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65081.log.gz 2024-09-12T02:08:51.742 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112381.log.gz/var/log/ceph/ceph-client.admin.151326.log: 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173901.log 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.151326.log.gz 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108251.log 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185162.log.gz 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.173901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41161.log 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.173901.log.gz 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.108251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159068.log 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.108251.log.gz 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51966.log 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.159068.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.41161.log.gz 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166144.log 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159068.log.gz 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.51966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46655.log 2024-09-12T02:08:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.166144.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.51966.log.gz 2024-09-12T02:08:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74620.log 2024-09-12T02:08:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27065.log 2024-09-12T02:08:51.748 INFO:teuthology.orchestra.run.smithi102.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.166144.log.gz 2024-09-12T02:08:51.748 INFO:teuthology.orchestra.run.smithi102.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.46655.log.gz 2024-09-12T02:08:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.74620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173311.log 2024-09-12T02:08:51.748 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.74620.log.gz 2024-09-12T02:08:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.27065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102941.log 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27065.log.gz 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.173311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34486.log 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.173311.log.gz 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.102941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70836.log 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2%/var/log/ceph/ceph-client.admin.34486.log: -- replaced with /var/log/ceph/ceph-client.admin.102941.log.gz 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34486.log.gz 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.70836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153686.log 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.70836.log.gz 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137752.log 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144245.log 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.153686.log: /var/log/ceph/ceph-client.admin.137752.log: 81.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.153686.log.gz 2024-09-12T02:08:51.749 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.150736.log 2024-09-12T02:08:51.750 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.137752.log.gz 2024-09-12T02:08:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44220.log 2024-09-12T02:08:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.144245.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.144245.log.gz 2024-09-12T02:08:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.150736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.161196.log 2024-09-12T02:08:51.750 INFO:teuthology.orchestra.run.smithi102.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.150736.log.gz 2024-09-12T02:08:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110021.log 2024-09-12T02:08:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44220.log.gz 2024-09-12T02:08:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.161196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33141.log 2024-09-12T02:08:51.750 INFO:teuthology.orchestra.run.smithi102.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.0.161196.log.gz 2024-09-12T02:08:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.110021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121231.log 2024-09-12T02:08:51.764 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110021.log.gz 2024-09-12T02:08:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33141.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33141.log.gz -5 2024-09-12T02:08:51.764 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34438.log 2024-09-12T02:08:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185266.log 2024-09-12T02:08:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.121231.log: /var/log/ceph/ceph-client.admin.34438.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.121231.log.gz 2024-09-12T02:08:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133032.log 2024-09-12T02:08:51.764 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34438.log.gz 2024-09-12T02:08:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32929.log 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185266.log.gz 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.133032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120641.log 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32929.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.133032.log.gz 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32929.log.gz 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82881.log 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.120641.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.105301.log 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.82881.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.120641.log.gz 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185657.log 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82881.log.gz 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.105301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128312.log 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.105301.log.gz 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91731.log 2024-09-12T02:08:51.765 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185657.log.gz 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.128312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35101.log 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.91731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55016.log 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.91731.log.gz 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106481.log 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.35101.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35101.log.gz 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117691.log 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.55016.log.gz 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.106481.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.128312.log.gz 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.106481.log.gz 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53196.log 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.117691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150146.log 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.117691.log.gz 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.53196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33333.log 2024-09-12T02:08:51.766 INFO:teuthology.orchestra.run.smithi102.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.53196.log.gz 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.150146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88191.log 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.150146.log.gz 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109431.log 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33333.log.gz 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43015.log 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.88191.log.gz 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.109431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117101.log 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44195.log 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43015.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109431.log.gz 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.43015.log.gz 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.117101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185552.log 2024-09-12T02:08:51.767 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117101.log.gz 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182503.log 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44195.log.gz 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146015.log 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185552.log.gz 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.182503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87601.log 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182503.log.gz 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.146015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165416.log 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.146015.log.gz 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185681.log 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.87601.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.87601.log.gz 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.165416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157888.log 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75800.log 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.165416.log.gz 2024-09-12T02:08:51.768 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185681.log.gz 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.157888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137162.log 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr: 87.2%/var/log/ceph/ceph-client.admin.75800.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.157888.log.gz -5 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55606.log 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.75800.log.gz 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.137162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185578.log 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.55606.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.137162.log.gz 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182404.log 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.55606.log.gz 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43605.log 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185578.log.gz 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.182404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128902.log 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr: 26.7% -- replaced with /var/log/ceph/ceph-client.admin.182404.log.gz 2024-09-12T02:08:51.769 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.43605.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T02:08:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.128902.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.43605.log.gz 2024-09-12T02:08:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112971.log 2024-09-12T02:08:51.775 INFO:teuthology.orchestra.run.smithi102.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.128902.log.gz 2024-09-12T02:08:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60562.log 2024-09-12T02:08:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.112971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32865.log 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.112971.log.gz 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.60562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164238.log 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185448.log 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32865.log.gz 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.164238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157248.log 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34511.log 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4%/var/log/ceph/ceph-client.admin.185448.log: -- replaced with /var/log/ceph/ceph-client.admin.164238.log.gz 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185448.log.gz 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.157248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157248.log.gz 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167322.log 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.34511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61208.log 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.167322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185292.log 2024-09-12T02:08:51.776 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.167322.log.gz/var/log/ceph/ceph-client.admin.61208.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.34511.log.gz 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.60562.log.gz 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153096.log 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57396.log 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185292.log.gz 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.153096.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.153096.log.gz 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185474.log 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57396.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36862.log 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr: 55.7% -- replaced with /var/log/ceph/ceph-client.admin.57396.log.gz 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127722.log 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185474.log.gz 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.61208.log.gz/var/log/ceph/ceph-client.0.36862.log: 2024-09-12T02:08:51.777 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185370.log 2024-09-12T02:08:51.778 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.36862.log.gz 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27007.log 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26832.log 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.27007.log: /var/log/ceph/ceph-client.admin.26832.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26832.log.gz 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27007.log.gz 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26880.log 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26952.log 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.26880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26880.log.gz 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.26952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26952.log.gz 2024-09-12T02:08:51.787 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26856.log 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:gzip/var/log/ceph/ceph.audit.log: -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.26856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26928.log 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26856.log.gz 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26904.log 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.26928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26928.log.gz 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.26904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26904.log.gz 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26983.log 2024-09-12T02:08:51.788 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.26983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26983.log.gz 2024-09-12T02:08:51.794 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.127722.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.127722.log.gz 2024-09-12T02:08:51.794 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70198.log 2024-09-12T02:08:51.794 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181151.log 2024-09-12T02:08:51.794 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185370.log.gz 2024-09-12T02:08:51.794 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.70198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99401.log 2024-09-12T02:08:51.794 INFO:teuthology.orchestra.run.smithi102.stderr: 25.5% -- replaced with /var/log/ceph/ceph-client.admin.70198.log.gz 2024-09-12T02:08:51.794 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.181151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33140.log 2024-09-12T02:08:51.794 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.181151.log.gz 2024-09-12T02:08:51.794 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47246.log 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175081.log 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99401.log.gz 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33140.log: /var/log/ceph/ceph-client.admin.47246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33140.log.gz 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95271.log 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.47246.log.gz 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130082.log 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.175081.log: /var/log/ceph/ceph-client.admin.95271.log: 80.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178621.log 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.175081.log.gz 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.95271.log.gz 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.130082.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130082.log.gz 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185136.log 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.178621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185526.log 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr: 84.3%/var/log/ceph/ceph-client.admin.185136.log: -- replaced with /var/log/ceph/ceph-client.0.178621.log.gz 2024-09-12T02:08:51.795 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185500.log 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185136.log.gz 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75210.log 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185526.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.170360.log 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185500.log.gz 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.75210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33132.log 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75210.log.gz 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.170360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50196.log 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.170360.log.gz 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63789.log 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33132.log.gz 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.50196.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.50196.log.gz 2024-09-12T02:08:51.796 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81701.log 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.63789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67244.log 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.81701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97631.log 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.81701.log.gz 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.67244.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.67244.log.gz 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120051.log 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58561.log 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.63789.log.gz 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.120051.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97631.log.gz 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46015.log 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120051.log.gz 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32943.log 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.58561.log: /var/log/ceph/ceph-client.admin.46015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140705.log 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.46015.log.gz 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32943.log.gz 2024-09-12T02:08:51.797 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147786.log 2024-09-12T02:08:51.798 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54966.log 2024-09-12T02:08:51.798 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.140705.log: /var/log/ceph/ceph-client.admin.147786.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.147786.log.gz 2024-09-12T02:08:51.798 INFO:teuthology.orchestra.run.smithi102.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.140705.log.gz 2024-09-12T02:08:51.798 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57068.log 2024-09-12T02:08:51.798 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64434.log 2024-09-12T02:08:51.798 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54966.log.gz 2024-09-12T02:08:51.798 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57068.log: 57.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34462.log 2024-09-12T02:08:51.798 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57068.log.gz 2024-09-12T02:08:51.799 INFO:teuthology.orchestra.run.smithi121.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:08:51.802 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.64434.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64434.log.gz 2024-09-12T02:08:51.802 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39204.log 2024-09-12T02:08:51.802 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34414.log 2024-09-12T02:08:51.802 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34462.log.gz 2024-09-12T02:08:51.802 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.39204.log: 43.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142475.log 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.39204.log.gz 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34414.log.gz 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90551.log 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32770.log 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.142475.log: /var/log/ceph/ceph-client.admin.90551.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.142475.log.gz 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.90551.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.38620.log 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32770.log.gz 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133622.log 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51376.log 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.38620.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.38620.log.gz 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.133622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42425.log 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.133622.log.gz 2024-09-12T02:08:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.51376.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.51376.log.gz 2024-09-12T02:08:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69016.log 2024-09-12T02:08:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69607.log 2024-09-12T02:08:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42425.log: /var/log/ceph/ceph-client.admin.69016.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.42425.log.gz 2024-09-12T02:08:51.808 INFO:teuthology.orchestra.run.smithi102.stderr: 80.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84651.log 2024-09-12T02:08:51.808 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69016.log.gz 2024-09-12T02:08:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.69607.log: 95.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T02:08:51.809 INFO:teuthology.orchestra.run.smithi102.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.69607.log.gz 2024-09-12T02:08:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56196.log 2024-09-12T02:08:51.809 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9%/var/log/ceph/ceph-client.admin.84651.log: -- replaced with /var/log/ceph/ceph-client.admin.58561.log.gz 2024-09-12T02:08:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171541.log 2024-09-12T02:08:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.56196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61853.log 2024-09-12T02:08:51.809 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.56196.log.gz/var/log/ceph/ceph-client.0.171541.log: 2024-09-12T02:08:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177441.log 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr: 84.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67833.log 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.171541.log.gz 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.61853.log: /var/log/ceph/ceph-client.0.177441.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.84651.log.gz 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.177441.log.gz 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50786.log 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.67833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88781.log 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr: 84.2%/var/log/ceph/ceph-client.admin.50786.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.67833.log.gz -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6%/var/log/ceph/ceph-client.admin.88781.log: -- replaced with /var/log/ceph/ceph-client.admin.50786.log.gz 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35685.log 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.88781.log.gz 2024-09-12T02:08:51.810 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.3.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.61853.log.gz 2024-09-12T02:08:51.811 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110611.log 2024-09-12T02:08:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.35685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32945.log 2024-09-12T02:08:51.818 INFO:teuthology.orchestra.run.smithi102.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.35685.log.gz 2024-09-12T02:08:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.110611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127131.log 2024-09-12T02:08:51.818 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.110611.log.gz 2024-09-12T02:08:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73440.log 2024-09-12T02:08:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32945.log: /var/log/ceph/ceph-client.admin.127131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131852.log 2024-09-12T02:08:51.818 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32945.log.gz 2024-09-12T02:08:51.818 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.127131.log.gz 2024-09-12T02:08:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.73440.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.73440.log.gz 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44245.log 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.131852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32936.log 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44245.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.131852.log.gz 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33149.log 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.44245.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154298.log 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32936.log: /var/log/ceph/ceph-client.admin.33149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32936.log.gz 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33149.log.gz 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141295.log 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26992.log 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.154298.log: /var/log/ceph/ceph-client.admin.141295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105891.log 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr: 82.3%/var/log/ceph/ceph-client.admin.26992.log: -- replaced with /var/log/ceph/ceph-client.admin.141295.log.gz 87.4% -- replaced with /var/log/ceph/ceph-client.admin.154298.log.gz 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T02:08:51.819 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26992.log.gz 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77570.log 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33153.log 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.105891.log: /var/log/ceph/ceph-client.admin.77570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80521.log 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33153.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.77570.log.gz 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105891.log.gz 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33153.log.gz 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78160.log 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.80521.log: /var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155478.log 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.78160.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.80521.log.gz 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123591.log 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.78160.log.gz 2024-09-12T02:08:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.155478.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.155478.log.gz 2024-09-12T02:08:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T02:08:51.822 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169759.log 2024-09-12T02:08:51.822 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.123591.log: /var/log/ceph/ceph-osd.1.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123591.log.gz 2024-09-12T02:08:51.823 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52556.log 2024-09-12T02:08:51.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.169759.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.169759.log.gz 2024-09-12T02:08:51.823 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94091.log 2024-09-12T02:08:51.823 INFO:teuthology.orchestra.run.smithi102.stderr: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T02:08:51.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52556.log.gz 2024-09-12T02:08:51.823 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126541.log 2024-09-12T02:08:51.823 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63144.log 2024-09-12T02:08:51.823 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94091.log: /var/log/ceph/ceph-client.admin.126541.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.94091.log.gz 2024-09-12T02:08:51.824 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126541.log.gz 2024-09-12T02:08:51.824 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2024-09-12T02:08:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.63144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32938.log 2024-09-12T02:08:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44835.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2024-09-12T02:08:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33359.log 2024-09-12T02:08:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32938.log.gz 2024-09-12T02:08:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101171.log 2024-09-12T02:08:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33359.log.gz 2024-09-12T02:08:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57913.log 2024-09-12T02:08:51.842 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101171.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.101171.log.gz 2024-09-12T02:08:51.842 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134802.log 2024-09-12T02:08:51.843 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57913.log: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.57913.log.gz 2024-09-12T02:08:51.844 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149556.log 2024-09-12T02:08:51.845 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.134802.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.134802.log.gz 2024-09-12T02:08:51.845 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26817.log 2024-09-12T02:08:51.846 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.149556.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.149556.log.gz 2024-09-12T02:08:51.846 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54991.log 2024-09-12T02:08:51.847 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.26817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26817.log.gz 2024-09-12T02:08:51.847 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92321.log 2024-09-12T02:08:51.848 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.54991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54991.log.gz 2024-09-12T02:08:51.848 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185084.log 2024-09-12T02:08:51.849 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.92321.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.92321.log.gz 2024-09-12T02:08:51.850 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145425.log 2024-09-12T02:08:51.850 INFO:teuthology.orchestra.run.smithi102.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.63144.log.gz 2024-09-12T02:08:51.850 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185084.log.gz 2024-09-12T02:08:51.852 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37452.log 2024-09-12T02:08:51.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.145425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52606.log 2024-09-12T02:08:51.852 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.145425.log.gz 2024-09-12T02:08:51.852 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.37452.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37452.log.gz 2024-09-12T02:08:51.852 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74030.log 2024-09-12T02:08:51.855 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32793.log 2024-09-12T02:08:51.855 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52606.log: /var/log/ceph/ceph-client.admin.74030.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.52606.log.gz 2024-09-12T02:08:51.856 INFO:teuthology.orchestra.run.smithi102.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.74030.log.gz 2024-09-12T02:08:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132442.log 2024-09-12T02:08:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135392.log 2024-09-12T02:08:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32793.log.gz 2024-09-12T02:08:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.132442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154888.log 2024-09-12T02:08:51.856 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.132442.log.gz 2024-09-12T02:08:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.135392.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.135392.log.gz 2024-09-12T02:08:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78751.log 2024-09-12T02:08:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46605.log 2024-09-12T02:08:51.858 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.154888.log: /var/log/ceph/ceph-client.admin.78751.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.154888.log.gz 2024-09-12T02:08:51.858 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.78751.log.gz 2024-09-12T02:08:51.858 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130672.log 2024-09-12T02:08:51.858 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175671.log 2024-09-12T02:08:51.858 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46605.log: /var/log/ceph/ceph-client.admin.130672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46605.log.gz 2024-09-12T02:08:51.858 INFO:teuthology.orchestra.run.smithi102.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.130672.log.gz 2024-09-12T02:08:51.859 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33385.log 2024-09-12T02:08:51.859 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.175671.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.175671.log.gz 2024-09-12T02:08:51.860 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49016.log 2024-09-12T02:08:51.860 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169170.log 2024-09-12T02:08:51.861 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33385.log: /var/log/ceph/ceph-client.admin.49016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33385.log.gz 2024-09-12T02:08:51.861 INFO:teuthology.orchestra.run.smithi102.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.49016.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T02:08:51.861 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T02:08:51.862 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.169170.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.169170.log.gz 2024-09-12T02:08:51.862 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138935.log 2024-09-12T02:08:51.863 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185240.log 2024-09-12T02:08:51.863 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.138935.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.138935.log.gz 2024-09-12T02:08:51.876 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118281.log 2024-09-12T02:08:51.877 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185240.log.gz 2024-09-12T02:08:51.877 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32839.log 2024-09-12T02:08:51.878 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.118281.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.118281.log.gz 2024-09-12T02:08:51.879 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136572.log 2024-09-12T02:08:51.879 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32839.log.gz 2024-09-12T02:08:51.880 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32745.log 2024-09-12T02:08:51.882 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.136572.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.136572.log.gz 2024-09-12T02:08:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100581.log 2024-09-12T02:08:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32745.log.gz 2024-09-12T02:08:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181764.log 2024-09-12T02:08:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.100581.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.100581.log.gz 2024-09-12T02:08:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138345.log 2024-09-12T02:08:51.885 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T02:08:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.181764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181764.log.gz 2024-09-12T02:08:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98221.log 2024-09-12T02:08:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116511.log 2024-09-12T02:08:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.138345.log: /var/log/ceph/ceph-client.admin.98221.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98221.log.gz 2024-09-12T02:08:51.887 INFO:teuthology.orchestra.run.smithi102.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138345.log.gz 2024-09-12T02:08:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182452.log 2024-09-12T02:08:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57139.log 2024-09-12T02:08:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.116511.log: /var/log/ceph/ceph-client.admin.182452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182452.log.gz 2024-09-12T02:08:51.888 INFO:teuthology.orchestra.run.smithi102.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.116511.log.gz 2024-09-12T02:08:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162378.log 2024-09-12T02:08:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108841.log 2024-09-12T02:08:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57139.log: /var/log/ceph/ceph-client.admin.162378.log: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.57139.log.gz 2024-09-12T02:08:51.890 INFO:teuthology.orchestra.run.smithi102.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162378.log.gz 2024-09-12T02:08:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53786.log 2024-09-12T02:08:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107661.log 2024-09-12T02:08:51.891 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.108841.log: /var/log/ceph/ceph-client.admin.53786.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.108841.log.gz 2024-09-12T02:08:51.891 INFO:teuthology.orchestra.run.smithi102.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.53786.log.gz 2024-09-12T02:08:51.891 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113561.log 2024-09-12T02:08:51.893 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.107661.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.107661.log.gz 2024-09-12T02:08:51.893 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167911.log 2024-09-12T02:08:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182427.log 2024-09-12T02:08:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.113561.log: /var/log/ceph/ceph-client.admin.167911.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.113561.log.gz 2024-09-12T02:08:51.895 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124181.log 2024-09-12T02:08:51.895 INFO:teuthology.orchestra.run.smithi102.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.167911.log.gz 2024-09-12T02:08:51.895 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.182427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182427.log.gz 2024-09-12T02:08:51.895 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93501.log 2024-09-12T02:08:51.896 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99991.log 2024-09-12T02:08:51.896 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.124181.log: /var/log/ceph/ceph-client.admin.93501.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.124181.log.gz 2024-09-12T02:08:51.897 INFO:teuthology.orchestra.run.smithi102.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93501.log.gz 2024-09-12T02:08:51.897 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92911.log 2024-09-12T02:08:51.897 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T02:08:51.898 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.99991.log: /var/log/ceph/ceph-client.admin.92911.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99991.log.gz 2024-09-12T02:08:51.898 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38036.log 2024-09-12T02:08:51.900 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.c.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.92911.log.gz 2024-09-12T02:08:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32942.log 2024-09-12T02:08:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.38036.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.38036.log.gz 2024-09-12T02:08:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121821.log 2024-09-12T02:08:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32942.log.gz 2024-09-12T02:08:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183125.log 2024-09-12T02:08:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.121821.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.121821.log.gz 2024-09-12T02:08:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182477.log 2024-09-12T02:08:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.183125.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.183125.log.gz 2024-09-12T02:08:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148376.log 2024-09-12T02:08:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.182477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182477.log.gz 2024-09-12T02:08:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89961.log 2024-09-12T02:08:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.148376.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.148376.log.gz 2024-09-12T02:08:51.933 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71474.log 2024-09-12T02:08:51.933 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.89961.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.89961.log.gz 2024-09-12T02:08:51.934 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176261.log 2024-09-12T02:08:51.934 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.71474.log: 47.9% -- replaced with /var/log/ceph/ceph-client.admin.71474.log.gz 2024-09-12T02:08:51.935 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114741.log 2024-09-12T02:08:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.176261.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.176261.log.gz 2024-09-12T02:08:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163649.log 2024-09-12T02:08:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.114741.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.114741.log.gz 2024-09-12T02:08:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104711.log 2024-09-12T02:08:51.940 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.163649.log: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.163649.log.gz 2024-09-12T02:08:51.940 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59209.log 2024-09-12T02:08:51.941 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.104711.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104711.log.gz 2024-09-12T02:08:51.941 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65729.log 2024-09-12T02:08:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.59209.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.59209.log.gz 2024-09-12T02:08:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152506.log 2024-09-12T02:08:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.65729.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.65729.log.gz 2024-09-12T02:08:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32891.log 2024-09-12T02:08:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.152506.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.152506.log.gz 2024-09-12T02:08:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185032.log 2024-09-12T02:08:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32891.log.gz 2024-09-12T02:08:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36275.log 2024-09-12T02:08:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185032.log.gz 2024-09-12T02:08:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T02:08:51.953 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.36275.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.36275.log.gz 2024-09-12T02:08:51.953 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180561.log 2024-09-12T02:08:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81111.log 2024-09-12T02:08:51.969 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.180561.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.180561.log.gz 2024-09-12T02:08:51.980 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158478.log 2024-09-12T02:08:51.981 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.81111.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81111.log.gz 2024-09-12T02:08:51.996 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166733.log 2024-09-12T02:08:51.997 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.158478.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.158478.log.gz 2024-09-12T02:08:52.004 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107071.log 2024-09-12T02:08:52.005 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.166733.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.166733.log.gz 2024-09-12T02:08:52.012 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140115.log 2024-09-12T02:08:52.013 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.107071.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.107071.log.gz 2024-09-12T02:08:52.020 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T02:08:52.021 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.140115.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.140115.log.gz 2024-09-12T02:08:52.028 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33139.log 2024-09-12T02:08:52.031 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T02:08:52.036 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131262.log 2024-09-12T02:08:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33139.log.gz 2024-09-12T02:08:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97041.log 2024-09-12T02:08:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.131262.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.131262.log.gz 2024-09-12T02:08:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59855.log 2024-09-12T02:08:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.97041.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.97041.log.gz 2024-09-12T02:08:52.060 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148966.log 2024-09-12T02:08:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.59855.log: 93.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76390.log 2024-09-12T02:08:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.148966.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.148966.log.gz 2024-09-12T02:08:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102351.log 2024-09-12T02:08:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.76390.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.76390.log.gz 2024-09-12T02:08:52.080 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59855.log.gz 2024-09-12T02:08:52.084 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70246.log 2024-09-12T02:08:52.085 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.102351.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102351.log.gz 2024-09-12T02:08:52.094 INFO:teuthology.orchestra.run.smithi102.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T02:08:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57938.log 2024-09-12T02:08:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.70246.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.70246.log.gz 2024-09-12T02:08:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185631.log 2024-09-12T02:08:52.097 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57938.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.57938.log.gz 2024-09-12T02:08:52.097 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170951.log 2024-09-12T02:08:52.098 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185631.log.gz 2024-09-12T02:08:52.098 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71591.log 2024-09-12T02:08:52.099 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.170951.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.170951.log.gz 2024-09-12T02:08:52.099 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34390.log 2024-09-12T02:08:52.103 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.71591.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.71591.log.gz 2024-09-12T02:08:52.103 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176851.log 2024-09-12T02:08:52.104 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34390.log.gz 2024-09-12T02:08:52.104 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159708.log 2024-09-12T02:08:52.105 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.176851.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.176851.log.gz 2024-09-12T02:08:52.105 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159118.log 2024-09-12T02:08:52.106 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.159708.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.159708.log.gz 2024-09-12T02:08:52.107 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94681.log 2024-09-12T02:08:52.108 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.159118.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.159118.log.gz 2024-09-12T02:08:52.108 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181789.log 2024-09-12T02:08:52.109 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.94681.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94681.log.gz 2024-09-12T02:08:52.109 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183721.log 2024-09-12T02:08:52.110 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.181789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181789.log.gz 2024-09-12T02:08:52.111 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101761.log 2024-09-12T02:08:52.124 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.183721.log: gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T02:08:52.125 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.101761.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.101761.log.gz 2024-09-12T02:08:52.136 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98811.log 2024-09-12T02:08:52.137 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 62.9% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T02:08:52.140 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185214.log 2024-09-12T02:08:52.141 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.98811.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.98811.log.gz 2024-09-12T02:08:52.144 INFO:teuthology.orchestra.run.smithi102.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.0.183721.log.gz 2024-09-12T02:08:52.145 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85831.log 2024-09-12T02:08:52.145 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185214.log.gz 2024-09-12T02:08:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87011.log 2024-09-12T02:08:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.85831.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.85831.log.gz 2024-09-12T02:08:52.147 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185422.log 2024-09-12T02:08:52.147 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.87011.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.87011.log.gz 2024-09-12T02:08:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124771.log 2024-09-12T02:08:52.149 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185422.log.gz 2024-09-12T02:08:52.149 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185396.log 2024-09-12T02:08:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.124771.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.124771.log.gz 2024-09-12T02:08:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129492.log 2024-09-12T02:08:52.151 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185396.log.gz 2024-09-12T02:08:52.151 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68426.log 2024-09-12T02:08:52.152 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.129492.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.129492.log.gz 2024-09-12T02:08:52.152 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157298.log 2024-09-12T02:08:52.154 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.68426.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.68426.log.gz 2024-09-12T02:08:52.154 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164827.log 2024-09-12T02:08:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.157298.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.157298.log.gz 2024-09-12T02:08:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123001.log 2024-09-12T02:08:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.164827.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.164827.log.gz 2024-09-12T02:08:52.157 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115921.log 2024-09-12T02:08:52.157 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.123001.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.123001.log.gz 2024-09-12T02:08:52.158 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32939.log 2024-09-12T02:08:52.159 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.115921.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115921.log.gz 2024-09-12T02:08:52.160 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22025.log 2024-09-12T02:08:52.161 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32939.log.gz 2024-09-12T02:08:52.161 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118871.log 2024-09-12T02:08:52.161 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.tmp-client.admin.22025.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22025.log.gz 2024-09-12T02:08:52.162 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172131.log 2024-09-12T02:08:52.163 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.118871.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.118871.log.gz 2024-09-12T02:08:52.163 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57307.log 2024-09-12T02:08:52.164 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.172131.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.172131.log.gz 2024-09-12T02:08:52.164 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47836.log 2024-09-12T02:08:52.165 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57307.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.57307.log.gz 2024-09-12T02:08:52.165 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40559.log 2024-09-12T02:08:52.166 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47836.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.47836.log.gz 2024-09-12T02:08:52.166 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181814.log 2024-09-12T02:08:52.167 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40559.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.40559.log.gz 2024-09-12T02:08:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72850.log 2024-09-12T02:08:52.168 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.181814.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.181814.log.gz 2024-09-12T02:08:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154276.log 2024-09-12T02:08:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.72850.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.72850.log.gz 2024-09-12T02:08:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103531.log 2024-09-12T02:08:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.154276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154276.log.gz 2024-09-12T02:08:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111201.log 2024-09-12T02:08:52.172 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.103531.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103531.log.gz 2024-09-12T02:08:52.172 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62499.log 2024-09-12T02:08:52.173 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.111201.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111201.log.gz 2024-09-12T02:08:52.173 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179211.log 2024-09-12T02:08:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.62499.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62499.log.gz 2024-09-12T02:08:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32582.log 2024-09-12T02:08:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.179211.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.179211.log.gz 2024-09-12T02:08:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83471.log 2024-09-12T02:08:52.178 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32582.log.gz 2024-09-12T02:08:52.178 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125951.log 2024-09-12T02:08:52.179 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.83471.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.83471.log.gz 2024-09-12T02:08:52.179 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49606.log 2024-09-12T02:08:52.180 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.125951.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.125951.log.gz 2024-09-12T02:08:52.180 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125361.log 2024-09-12T02:08:52.181 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.49606.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.49606.log.gz 2024-09-12T02:08:52.181 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57972.log 2024-09-12T02:08:52.182 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.125361.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.125361.log.gz 2024-09-12T02:08:52.183 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134212.log 2024-09-12T02:08:52.183 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57972.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.57972.log.gz 2024-09-12T02:08:52.184 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89371.log 2024-09-12T02:08:52.185 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.134212.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.134212.log.gz 2024-09-12T02:08:52.185 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144835.log 2024-09-12T02:08:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.89371.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89371.log.gz 2024-09-12T02:08:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157273.log 2024-09-12T02:08:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.144835.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.144835.log.gz 2024-09-12T02:08:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48426.log 2024-09-12T02:08:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.157273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157273.log.gz 2024-09-12T02:08:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111791.log 2024-09-12T02:08:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48426.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.48426.log.gz 2024-09-12T02:08:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185058.log 2024-09-12T02:08:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.111791.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.111791.log.gz 2024-09-12T02:08:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151916.log 2024-09-12T02:08:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185058.log.gz 2024-09-12T02:08:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143065.log 2024-09-12T02:08:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.151916.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151916.log.gz 2024-09-12T02:08:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79931.log 2024-09-12T02:08:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.143065.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.143065.log.gz 2024-09-12T02:08:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135982.log 2024-09-12T02:08:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.79931.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.79931.log.gz 2024-09-12T02:08:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84061.log 2024-09-12T02:08:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.135982.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.135982.log.gz 2024-09-12T02:08:52.198 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122411.log 2024-09-12T02:08:52.198 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.84061.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.84061.log.gz 2024-09-12T02:08:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41835.log 2024-09-12T02:08:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.122411.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.122411.log.gz 2024-09-12T02:08:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185344.log 2024-09-12T02:08:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41835.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.41835.log.gz 2024-09-12T02:08:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185318.log 2024-09-12T02:08:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185344.log.gz 2024-09-12T02:08:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72181.log 2024-09-12T02:08:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185318.log.gz 2024-09-12T02:08:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95861.log 2024-09-12T02:08:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.72181.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.72181.log.gz 2024-09-12T02:08:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32940.log 2024-09-12T02:08:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.95861.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.95861.log.gz 2024-09-12T02:08:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181741.log 2024-09-12T02:08:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32940.log.gz 2024-09-12T02:08:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185188.log 2024-09-12T02:08:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.181741.log: 27.3% -- replaced with /var/log/ceph/ceph-client.admin.181741.log.gz 2024-09-12T02:08:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156068.log 2024-09-12T02:08:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185188.log.gz 2024-09-12T02:08:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161789.log 2024-09-12T02:08:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.156068.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.156068.log.gz 2024-09-12T02:08:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33146.log 2024-09-12T02:08:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.161789.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.161789.log.gz 2024-09-12T02:08:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185110.log 2024-09-12T02:08:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33146.log.gz 2024-09-12T02:08:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33125.log 2024-09-12T02:08:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185110.log.gz 2024-09-12T02:08:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86421.log 2024-09-12T02:08:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33125.log.gz 2024-09-12T02:08:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79341.log 2024-09-12T02:08:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.86421.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.86421.log.gz 2024-09-12T02:08:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174491.log 2024-09-12T02:08:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.79341.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.79341.log.gz 2024-09-12T02:08:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146605.log 2024-09-12T02:08:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.174491.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.174491.log.gz 2024-09-12T02:08:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172721.log 2024-09-12T02:08:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.146605.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.146605.log.gz 2024-09-12T02:08:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52581.log 2024-09-12T02:08:52.224 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.172721.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.172721.log.gz 2024-09-12T02:08:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182528.log 2024-09-12T02:08:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.52581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52581.log.gz 2024-09-12T02:08:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160298.log 2024-09-12T02:08:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.182528.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.182528.log.gz 2024-09-12T02:08:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57419.log 2024-09-12T02:08:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.160298.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.160298.log.gz 2024-09-12T02:08:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119461.log 2024-09-12T02:08:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57419.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.57419.log.gz 2024-09-12T02:08:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32813.log 2024-09-12T02:08:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.119461.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.119461.log.gz 2024-09-12T02:08:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114151.log 2024-09-12T02:08:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32813.log.gz 2024-09-12T02:08:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96451.log 2024-09-12T02:08:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.114151.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114151.log.gz 2024-09-12T02:08:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85241.log 2024-09-12T02:08:52.233 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.96451.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.96451.log.gz 2024-09-12T02:08:52.233 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141885.log 2024-09-12T02:08:52.234 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.85241.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.85241.log.gz 2024-09-12T02:08:52.235 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57371.log 2024-09-12T02:08:52.235 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.141885.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.141885.log.gz 2024-09-12T02:08:52.236 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143655.log 2024-09-12T02:08:52.252 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.57371.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185605.log 2024-09-12T02:08:52.253 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.143655.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.143655.log.gz 2024-09-12T02:08:52.253 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57371.log.gz 2024-09-12T02:08:52.257 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.185605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.185605.log.gz 2024-09-12T02:08:52.878 INFO:teuthology.orchestra.run.smithi121.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T02:08:53.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-12T02:08:53.634 INFO:teuthology.orchestra.run.smithi102.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T02:08:54.019 INFO:teuthology.orchestra.run.smithi121.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T02:08:55.422 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T02:08:56.239 INFO:teuthology.orchestra.run.smithi102.stderr: 92.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T02:09:02.187 INFO:teuthology.orchestra.run.smithi102.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T02:09:05.094 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T02:09:05.506 INFO:teuthology.orchestra.run.smithi121.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T02:09:05.613 INFO:teuthology.orchestra.run.smithi121.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T02:09:06.492 INFO:teuthology.orchestra.run.smithi121.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T02:09:09.017 INFO:teuthology.orchestra.run.smithi102.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T02:09:09.049 INFO:teuthology.orchestra.run.smithi121.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T02:09:09.051 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-12T02:09:09.051 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m17.297s 2024-09-12T02:09:09.051 INFO:teuthology.orchestra.run.smithi121.stderr:user 1m0.821s 2024-09-12T02:09:09.051 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m2.119s 2024-09-12T02:09:15.237 INFO:teuthology.orchestra.run.smithi102.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m23.531s 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi102.stderr:user 1m12.329s 2024-09-12T02:09:15.239 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m2.705s 2024-09-12T02:09:15.240 INFO:tasks.ceph:Archiving logs... 2024-09-12T02:09:15.240 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828/remote/smithi102/log 2024-09-12T02:09:15.242 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:09:23.777 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828/remote/smithi121/log 2024-09-12T02:09:23.777 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:09:31.404 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:09:31.430 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:09:31.430 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:09:31.432 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:09:31.516 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:09:31.526 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:09:31.527 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:09:31.529 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:09:31.543 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T02:09:31.544 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2024-09-12T02:09:31.544 INFO:teuthology.orchestra.run.smithi102.stdout:+hv01.front.sepi 67.205.162.81 3 u 150 256 377 0.136 +2.001 0.590 2024-09-12T02:09:31.544 INFO:teuthology.orchestra.run.smithi102.stdout:*hv02.front.sepi 63.231.80.2 3 u 25 256 377 0.197 -1.215 0.152 2024-09-12T02:09:31.544 INFO:teuthology.orchestra.run.smithi102.stdout:+hv03.front.sepi 74.6.168.72 3 u 53 256 377 0.159 -3.905 0.229 2024-09-12T02:09:31.544 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T02:09:31.545 INFO:teuthology.orchestra.run.smithi121.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T02:09:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:============================================================================== 2024-09-12T02:09:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:+hv01.front.sepi 67.205.162.81 3 u 158 256 377 0.172 +2.730 0.168 2024-09-12T02:09:31.546 INFO:teuthology.orchestra.run.smithi121.stdout:*hv02.front.sepi 63.231.80.2 3 u 32 256 377 0.162 -0.749 0.251 2024-09-12T02:09:31.546 INFO:teuthology.orchestra.run.smithi121.stdout:+hv03.front.sepi 74.6.168.72 3 u 100 256 377 0.196 -2.847 0.157 2024-09-12T02:09:31.546 INFO:teuthology.orchestra.run.smithi121.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T02:09:31.546 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:09:31.557 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:09:31.557 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:09:31.569 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:09:31.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:09:31.590 INFO:teuthology.task.internal:Duration was 7832.779444 seconds 2024-09-12T02:09:31.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:09:31.601 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:09:31.602 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:09:31.604 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:09:31.642 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:09:31.642 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-12T02:09:31.643 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:09:31.693 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-09-12T02:09:31.693 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:09:31.703 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:09:31.703 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:09:31.737 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:09:31.773 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:09:31.773 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:09:31.808 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:09:31.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:09:31.887 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:09:31.887 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:09:31.898 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:09:31.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:09:31.920 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:09:31.942 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:09:31.950 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-12T02:09:31.959 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-09-12T02:09:32.072 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:09:32.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:09:32.078 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:09:32.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:09:32.119 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:09:32.131 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:09:32.132 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828/remote/smithi102 2024-09-12T02:09:32.132 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:09:32.157 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901828/remote/smithi121 2024-09-12T02:09:32.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:09:32.183 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:09:32.183 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:09:32.193 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:09:32.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:09:32.240 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:09:32.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:09:32.251 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:09:32.251 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:09:32.253 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:09:32.257 INFO:teuthology.orchestra.run.smithi102.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:09 /home/ubuntu/cephtest 2024-09-12T02:09:32.275 INFO:teuthology.orchestra.run.smithi121.stdout: 658622 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:09 /home/ubuntu/cephtest 2024-09-12T02:09:32.276 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:09:32.288 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:09:32.314 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 7832.779443740845 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T02:09:32.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:09:32.401 INFO:teuthology.run:pass